2024-04-26T18:17:44.213 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T18:17:44.213 DEBUG:teuthology.run:Teuthology command: teuthology --name leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi --verbose --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/direct_io}} --archive /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674925 --owner scheduled_leonidus@teuthology -- /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674925/orig.config.yaml 2024-04-26T18:17:44.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T18:17:44.365 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674925 branch: wip-lusov-quiescer-fixes description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/direct_io}} email: null first_in_suite: false job_id: '7674925' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true name: leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-quiescer-fixes ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - nowsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiescer-fixes sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 9496 sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 sleep_before_teardown: 0 subset: 200/111111 suite: fs suite_branch: wip-lusov-quiescer-fixes suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi080.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF4ZxSWgZYEU4HslrO0qlj8nmSjP63Ttn+wCJ6e+GMU4XO8PcrNd6rg+aktHMQi2rQbgZBKug56DSw+KLSTNKMc= smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNuI+e/8tSgGcLnuBPLaF1ond0jCcuoDVjtKnrsGjaEMbaR6qJPx/+S5WUTtzmgwHbk2wJH5R9ZtCyAKkFyCbUU= smithi192.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJKZ8kzhNbDEWn9r2e5qDTT1yyNCo4puQf1mC8E16VX9tZyEd+Npu5rgONra/20IaVewJYtaCvrOwnIZmEnloSA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - direct_io teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_17:24:23 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T18:17:44.365 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa; will attempt to use it 2024-04-26T18:17:44.366 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa/tasks 2024-04-26T18:17:44.366 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T18:17:44.368 INFO:teuthology.task.internal:Checking packages... 2024-04-26T18:17:44.393 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1' 2024-04-26T18:17:44.393 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T18:17:44.393 INFO:teuthology.packaging:ref: None 2024-04-26T18:17:44.394 INFO:teuthology.packaging:tag: None 2024-04-26T18:17:44.394 INFO:teuthology.packaging:branch: wip-lusov-quiescer-fixes 2024-04-26T18:17:44.394 INFO:teuthology.packaging:sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T18:17:44.394 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-quiescer-fixes 2024-04-26T18:17:44.539 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3267.gbc94a2a9 2024-04-26T18:17:44.540 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T18:17:44.547 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T18:17:44.547 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T18:17:44.555 INFO:teuthology.task.internal:Saving configuration 2024-04-26T18:17:44.576 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T18:17:44.582 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T18:17:44.605 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674925', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 18:12:42.000606', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF4ZxSWgZYEU4HslrO0qlj8nmSjP63Ttn+wCJ6e+GMU4XO8PcrNd6rg+aktHMQi2rQbgZBKug56DSw+KLSTNKMc='} 2024-04-26T18:17:44.627 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674925', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 18:12:41.998987', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNuI+e/8tSgGcLnuBPLaF1ond0jCcuoDVjtKnrsGjaEMbaR6qJPx/+S5WUTtzmgwHbk2wJH5R9ZtCyAKkFyCbUU='} 2024-04-26T18:17:44.648 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674925', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 18:12:41.996663', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJKZ8kzhNbDEWn9r2e5qDTT1yyNCo4puQf1mC8E16VX9tZyEd+Npu5rgONra/20IaVewJYtaCvrOwnIZmEnloSA='} 2024-04-26T18:17:44.648 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T18:17:44.655 INFO:teuthology.task.internal:roles: ubuntu@smithi080.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-04-26T18:17:44.655 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-04-26T18:17:44.655 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-04-26T18:17:44.655 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T18:17:44.752 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0d458410d0>, signals=[15]) 2024-04-26T18:17:44.753 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T18:17:44.759 INFO:teuthology.task.internal:Opening connections... 2024-04-26T18:17:44.759 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi080.front.sepia.ceph.com 2024-04-26T18:17:44.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T18:17:44.838 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T18:17:44.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T18:17:44.915 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi192.front.sepia.ceph.com 2024-04-26T18:17:44.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T18:17:44.988 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T18:17:44.998 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2024-04-26T18:17:45.016 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2024-04-26T18:17:45.016 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-04-26T18:17:45.074 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream" 2024-04-26T18:17:45.074 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="9" 2024-04-26T18:17:45.074 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos" 2024-04-26T18:17:45.074 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora" 2024-04-26T18:17:45.074 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="9" 2024-04-26T18:17:45.075 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el9" 2024-04-26T18:17:45.075 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T18:17:45.075 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-04-26T18:17:45.075 INFO:teuthology.orchestra.run.smithi080.stdout:LOGO="fedora-logo-icon" 2024-04-26T18:17:45.075 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T18:17:45.075 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/" 2024-04-26T18:17:45.075 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T18:17:45.075 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T18:17:45.076 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T18:17:45.076 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-04-26T18:17:45.098 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2024-04-26T18:17:45.116 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2024-04-26T18:17:45.116 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-04-26T18:17:45.172 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2024-04-26T18:17:45.172 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="9" 2024-04-26T18:17:45.172 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2024-04-26T18:17:45.172 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2024-04-26T18:17:45.172 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="9" 2024-04-26T18:17:45.172 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el9" 2024-04-26T18:17:45.172 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T18:17:45.173 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-04-26T18:17:45.173 INFO:teuthology.orchestra.run.smithi082.stdout:LOGO="fedora-logo-icon" 2024-04-26T18:17:45.173 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T18:17:45.173 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2024-04-26T18:17:45.173 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T18:17:45.173 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T18:17:45.173 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T18:17:45.173 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-04-26T18:17:45.197 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2024-04-26T18:17:45.215 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2024-04-26T18:17:45.215 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2024-04-26T18:17:45.273 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2024-04-26T18:17:45.273 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9" 2024-04-26T18:17:45.273 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2024-04-26T18:17:45.273 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2024-04-26T18:17:45.273 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9" 2024-04-26T18:17:45.273 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9" 2024-04-26T18:17:45.273 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T18:17:45.273 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2024-04-26T18:17:45.273 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon" 2024-04-26T18:17:45.273 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T18:17:45.274 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2024-04-26T18:17:45.274 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T18:17:45.274 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T18:17:45.274 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T18:17:45.274 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2024-04-26T18:17:45.297 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T18:17:45.308 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T18:17:45.314 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T18:17:45.314 DEBUG:teuthology.orchestra.run.smithi080:> test '!' -e /home/ubuntu/cephtest 2024-04-26T18:17:45.317 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2024-04-26T18:17:45.319 DEBUG:teuthology.orchestra.run.smithi192:> test '!' -e /home/ubuntu/cephtest 2024-04-26T18:17:45.336 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T18:17:45.342 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T18:17:45.342 DEBUG:teuthology.orchestra.run.smithi080:> test -z $(ls -A /var/lib/ceph) 2024-04-26T18:17:45.374 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2024-04-26T18:17:45.376 DEBUG:teuthology.orchestra.run.smithi192:> test -z $(ls -A /var/lib/ceph) 2024-04-26T18:17:45.465 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T18:17:45.534 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T18:17:45.549 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-04-26T18:17:45.550 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-04-26T18:17:45.550 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-04-26T18:17:45.550 DEBUG:teuthology.orchestra.run.smithi080:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T18:17:45.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T18:17:45.566 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-04-26T18:17:45.624 INFO:teuthology.orchestra.run.smithi080.stdout:5.14.0-437.el9.x86_64 2024-04-26T18:17:45.624 INFO:teuthology.task.kernel:Running kernel on smithi080: 5.14.0-437.el9.x86_64 2024-04-26T18:17:45.624 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum install -y kernel 2024-04-26T18:17:48.672 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 8.0 MB 00:01 2024-04-26T18:17:50.782 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-04-26T18:17:55.749 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 6.2 MB 00:01 2024-04-26T18:17:57.334 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 16 kB 00:00 2024-04-26T18:18:00.700 INFO:teuthology.orchestra.run.smithi080.stdout:Extra Packages for Enterprise Linux 6.4 MB/s | 21 MB 00:03 2024-04-26T18:18:05.758 INFO:teuthology.orchestra.run.smithi080.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-26T18:18:07.606 INFO:teuthology.orchestra.run.smithi080.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T18:18:07.606 INFO:teuthology.orchestra.run.smithi080.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T18:18:07.696 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-04-26T18:18:07.697 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2024-04-26T18:18:07.697 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-04-26T18:18:07.825 DEBUG:teuthology.orchestra.run.smithi080:> echo no | sudo yum reinstall kernel || true 2024-04-26T18:18:08.325 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 06:18:05 PM UTC. 2024-04-26T18:18:08.452 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-04-26T18:18:08.461 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-26T18:18:08.461 INFO:teuthology.orchestra.run.smithi080.stdout: Package Architecture Version Repository Size 2024-04-26T18:18:08.461 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-26T18:18:08.461 INFO:teuthology.orchestra.run.smithi080.stdout:Reinstalling: 2024-04-26T18:18:08.461 INFO:teuthology.orchestra.run.smithi080.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T18:18:08.461 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:18:08.461 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-04-26T18:18:08.461 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-26T18:18:08.461 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:18:08.461 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 255 k 2024-04-26T18:18:08.461 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 0 2024-04-26T18:18:08.462 INFO:teuthology.orchestra.run.smithi080.stderr:Operation aborted. 2024-04-26T18:18:08.521 INFO:teuthology.orchestra.run.smithi080.stdout:Is this ok [y/N]: 2024-04-26T18:18:08.522 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum reinstall -y kernel || true 2024-04-26T18:18:09.017 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:00:04 ago on Fri 26 Apr 2024 06:18:05 PM UTC. 2024-04-26T18:18:09.132 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-04-26T18:18:09.133 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-26T18:18:09.133 INFO:teuthology.orchestra.run.smithi080.stdout: Package Architecture Version Repository Size 2024-04-26T18:18:09.133 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-26T18:18:09.133 INFO:teuthology.orchestra.run.smithi080.stdout:Reinstalling: 2024-04-26T18:18:09.134 INFO:teuthology.orchestra.run.smithi080.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T18:18:09.134 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:18:09.134 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-04-26T18:18:09.134 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-26T18:18:09.134 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:18:09.134 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 255 k 2024-04-26T18:18:09.134 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 0 2024-04-26T18:18:09.134 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-04-26T18:18:09.385 INFO:teuthology.orchestra.run.smithi080.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.4 MB/s | 255 kB 00:00 2024-04-26T18:18:09.385 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-04-26T18:18:09.385 INFO:teuthology.orchestra.run.smithi080.stdout:Total 1.0 MB/s | 255 kB 00:00 2024-04-26T18:18:09.403 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-04-26T18:18:09.578 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-04-26T18:18:09.578 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-04-26T18:18:09.583 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-04-26T18:18:09.583 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-04-26T18:18:09.721 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-04-26T18:18:09.795 INFO:teuthology.orchestra.run.smithi080.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T18:18:09.795 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T18:18:10.474 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T18:18:10.475 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T18:18:11.164 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T18:18:11.164 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:18:11.165 INFO:teuthology.orchestra.run.smithi080.stdout:Reinstalled: 2024-04-26T18:18:11.165 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T18:18:11.165 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:18:11.165 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-04-26T18:18:11.340 DEBUG:teuthology.orchestra.run.smithi080:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T18:18:11.387 INFO:teuthology.orchestra.run.smithi080.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T18:18:11.387 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T18:18:11.387 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T18:18:11.388 DEBUG:teuthology.parallel:result is None 2024-04-26T18:18:11.388 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T18:18:11.395 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T18:18:11.396 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T18:18:11.398 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T18:18:11.400 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T18:18:11.417 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T18:18:11.425 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T18:18:11.434 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T18:18:11.435 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T18:18:11.452 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T18:18:11.458 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T18:18:11.603 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T18:18:11.610 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T18:18:11.611 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T18:18:11.627 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T18:18:11.627 DEBUG:teuthology.orchestra.run.smithi192:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T18:18:11.643 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T18:18:11.644 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T18:18:11.646 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T18:18:11.670 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T18:18:11.675 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T18:18:11.694 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T18:18:11.700 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T18:18:11.725 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T18:18:11.735 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T18:18:11.739 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T18:18:11.741 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T18:18:11.751 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T18:18:11.752 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T18:18:11.755 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T18:18:11.780 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T18:18:11.808 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T18:18:11.817 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T18:18:11.818 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T18:18:11.822 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T18:18:11.847 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T18:18:11.865 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T18:18:11.918 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T18:18:11.969 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T18:18:12.047 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T18:18:12.089 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T18:18:12.090 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T18:18:12.152 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T18:18:12.195 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T18:18:12.246 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T18:18:12.327 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T18:18:12.369 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T18:18:12.370 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T18:18:12.435 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T18:18:12.479 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T18:18:12.541 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T18:18:12.584 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T18:18:12.626 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T18:18:12.626 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T18:18:12.690 DEBUG:teuthology.orchestra.run.smithi080:> sudo service rsyslog restart 2024-04-26T18:18:12.693 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2024-04-26T18:18:12.695 DEBUG:teuthology.orchestra.run.smithi192:> sudo service rsyslog restart 2024-04-26T18:18:12.730 INFO:teuthology.orchestra.run.smithi080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T18:18:12.732 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T18:18:12.784 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T18:18:13.027 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T18:18:13.034 INFO:teuthology.task.internal:Starting timer... 2024-04-26T18:18:13.035 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T18:18:13.045 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T18:18:13.057 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-26T18:18:13.057 DEBUG:teuthology.orchestra.run.smithi080:> sudo service auditd rotate 2024-04-26T18:18:13.131 INFO:teuthology.orchestra.run.smithi080.stdout:Rotating logs: 2024-04-26T18:18:13.133 DEBUG:teuthology.orchestra.run.smithi082:> sudo service auditd rotate 2024-04-26T18:18:13.205 INFO:teuthology.orchestra.run.smithi082.stdout:Rotating logs: 2024-04-26T18:18:13.207 DEBUG:teuthology.orchestra.run.smithi192:> sudo service auditd rotate 2024-04-26T18:18:13.257 INFO:teuthology.orchestra.run.smithi192.stdout:Rotating logs: 2024-04-26T18:18:13.259 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T18:18:13.259 DEBUG:teuthology.orchestra.run.smithi080:> /usr/sbin/getenforce 2024-04-26T18:18:13.283 INFO:teuthology.orchestra.run.smithi080.stdout:Permissive 2024-04-26T18:18:13.283 DEBUG:teuthology.orchestra.run.smithi082:> /usr/sbin/getenforce 2024-04-26T18:18:13.308 INFO:teuthology.orchestra.run.smithi082.stdout:Permissive 2024-04-26T18:18:13.309 DEBUG:teuthology.orchestra.run.smithi192:> /usr/sbin/getenforce 2024-04-26T18:18:13.345 INFO:teuthology.orchestra.run.smithi192.stdout:Permissive 2024-04-26T18:18:13.345 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi080.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi082.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi192.front.sepia.ceph.com': 'permissive'} 2024-04-26T18:18:13.345 DEBUG:teuthology.orchestra.run.smithi080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T18:18:13.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T18:18:13.372 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T18:18:13.398 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T18:18:13.399 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T18:18:13.423 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T18:18:13.424 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T18:18:13.424 DEBUG:teuthology.orchestra.run.smithi080:> sudo /usr/sbin/setenforce permissive 2024-04-26T18:18:13.448 DEBUG:teuthology.orchestra.run.smithi082:> sudo /usr/sbin/setenforce permissive 2024-04-26T18:18:13.472 DEBUG:teuthology.orchestra.run.smithi192:> sudo /usr/sbin/setenforce permissive 2024-04-26T18:18:13.496 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T18:18:13.515 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-26T18:18:13.538 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-26T18:18:13.679 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T18:18:13.696 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T18:18:13.698 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi080.front.sepia.ceph.com,smithi082.front.sepia.ceph.com,smithi192.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T18:22:05.614 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi080.front.sepia.ceph.com'), Remote(name='ubuntu@smithi082.front.sepia.ceph.com'), Remote(name='ubuntu@smithi192.front.sepia.ceph.com')] 2024-04-26T18:22:05.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-04-26T18:22:05.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T18:22:05.696 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-04-26T18:22:05.773 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-04-26T18:22:05.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-26T18:22:05.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T18:22:05.848 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-04-26T18:22:05.925 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-26T18:22:05.925 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-04-26T18:22:05.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T18:22:05.998 DEBUG:teuthology.orchestra.run.smithi192:> true 2024-04-26T18:22:06.074 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-04-26T18:22:06.075 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T18:22:06.084 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T18:22:06.084 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T18:22:06.085 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T18:22:06.087 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T18:22:06.087 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T18:22:06.089 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T18:22:06.089 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T18:22:06.112 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T18:22:06.116 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T18:22:06.125 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T18:22:06.129 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T18:22:06.145 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T18:22:06.148 INFO:teuthology.orchestra.run.smithi080.stderr:sudo: ntpd: command not found 2024-04-26T18:22:06.152 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: ntpd: command not found 2024-04-26T18:22:06.158 INFO:teuthology.orchestra.run.smithi080.stdout:506 Cannot talk to daemon 2024-04-26T18:22:06.159 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T18:22:06.162 INFO:teuthology.orchestra.run.smithi082.stdout:506 Cannot talk to daemon 2024-04-26T18:22:06.171 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T18:22:06.175 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T18:22:06.182 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: ntpd: command not found 2024-04-26T18:22:06.184 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T18:22:06.188 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T18:22:06.192 INFO:teuthology.orchestra.run.smithi192.stdout:506 Cannot talk to daemon 2024-04-26T18:22:06.206 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T18:22:06.219 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T18:22:06.235 INFO:teuthology.orchestra.run.smithi080.stderr:bash: line 1: ntpq: command not found 2024-04-26T18:22:06.238 INFO:teuthology.orchestra.run.smithi080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T18:22:06.238 INFO:teuthology.orchestra.run.smithi080.stdout:=============================================================================== 2024-04-26T18:22:06.238 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T18:22:06.238 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T18:22:06.239 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T18:22:06.239 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T18:22:06.247 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-04-26T18:22:06.250 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T18:22:06.250 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-04-26T18:22:06.250 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T18:22:06.250 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T18:22:06.250 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T18:22:06.250 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T18:22:06.275 INFO:teuthology.orchestra.run.smithi192.stderr:bash: line 1: ntpq: command not found 2024-04-26T18:22:06.278 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T18:22:06.278 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2024-04-26T18:22:06.278 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T18:22:06.278 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T18:22:06.278 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T18:22:06.278 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T18:22:06.279 INFO:teuthology.run_tasks:Running task install... 2024-04-26T18:22:06.288 DEBUG:teuthology.task.install:project ceph 2024-04-26T18:22:06.288 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1'}} 2024-04-26T18:22:06.288 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1'} 2024-04-26T18:22:06.288 INFO:teuthology.task.install:Using flavor: default 2024-04-26T18:22:06.294 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T18:22:06.294 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-26T18:22:06.294 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'tag': None, 'wait_for_package': False} 2024-04-26T18:22:06.295 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T18:22:06.297 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'tag': None, 'wait_for_package': False} 2024-04-26T18:22:06.297 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T18:22:06.298 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'tag': None, 'wait_for_package': False} 2024-04-26T18:22:06.298 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T18:22:06.447 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/ 2024-04-26T18:22:06.448 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3267.gbc94a2a9 2024-04-26T18:22:06.518 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/ 2024-04-26T18:22:06.519 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3267.gbc94a2a9 2024-04-26T18:22:06.523 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/ 2024-04-26T18:22:06.523 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3267.gbc94a2a9 2024-04-26T18:22:06.559 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T18:22:06.559 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T18:22:06.560 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T18:22:06.584 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T18:22:06.584 DEBUG:teuthology.orchestra.run.smithi082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T18:22:06.623 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T18:22:06.623 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T18:22:06.623 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T18:22:06.648 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T18:22:06.648 DEBUG:teuthology.orchestra.run.smithi080:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T18:22:06.649 DEBUG:teuthology.orchestra.run.smithi082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T18:22:06.691 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T18:22:06.692 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T18:22:06.692 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T18:22:06.713 DEBUG:teuthology.orchestra.run.smithi080:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T18:22:06.716 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T18:22:06.716 DEBUG:teuthology.orchestra.run.smithi192:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T18:22:06.724 DEBUG:teuthology.orchestra.run.smithi082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T18:22:06.780 DEBUG:teuthology.orchestra.run.smithi192:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T18:22:06.786 DEBUG:teuthology.orchestra.run.smithi080:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T18:22:06.787 INFO:teuthology.orchestra.run.smithi082.stdout:check_obsoletes = 1 2024-04-26T18:22:06.788 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum clean all 2024-04-26T18:22:06.849 INFO:teuthology.orchestra.run.smithi080.stdout:check_obsoletes = 1 2024-04-26T18:22:06.851 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum clean all 2024-04-26T18:22:06.854 DEBUG:teuthology.orchestra.run.smithi192:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T18:22:06.917 INFO:teuthology.orchestra.run.smithi192.stdout:check_obsoletes = 1 2024-04-26T18:22:06.918 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum clean all 2024-04-26T18:22:07.010 INFO:teuthology.orchestra.run.smithi082.stdout:48 files removed 2024-04-26T18:22:07.037 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T18:22:07.074 INFO:teuthology.orchestra.run.smithi080.stdout:48 files removed 2024-04-26T18:22:07.099 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T18:22:07.142 INFO:teuthology.orchestra.run.smithi192.stdout:48 files removed 2024-04-26T18:22:07.169 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T18:22:07.691 INFO:teuthology.orchestra.run.smithi080.stdout:ceph packages for x86_64 252 kB/s | 84 kB 00:00 2024-04-26T18:22:07.765 INFO:teuthology.orchestra.run.smithi082.stdout:ceph packages for x86_64 179 kB/s | 84 kB 00:00 2024-04-26T18:22:07.775 INFO:teuthology.orchestra.run.smithi192.stdout:ceph packages for x86_64 242 kB/s | 84 kB 00:00 2024-04-26T18:22:08.056 INFO:teuthology.orchestra.run.smithi080.stdout:ceph noarch packages 36 kB/s | 12 kB 00:00 2024-04-26T18:22:08.149 INFO:teuthology.orchestra.run.smithi082.stdout:ceph noarch packages 34 kB/s | 12 kB 00:00 2024-04-26T18:22:08.151 INFO:teuthology.orchestra.run.smithi192.stdout:ceph noarch packages 35 kB/s | 12 kB 00:00 2024-04-26T18:22:08.407 INFO:teuthology.orchestra.run.smithi080.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2024-04-26T18:22:08.549 INFO:teuthology.orchestra.run.smithi082.stdout:ceph source packages 5.2 kB/s | 1.9 kB 00:00 2024-04-26T18:22:08.560 INFO:teuthology.orchestra.run.smithi192.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-04-26T18:22:09.107 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-26T18:22:09.285 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-26T18:22:11.041 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-26T18:22:11.578 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - AppStream 15 MB/s | 19 MB 00:01 2024-04-26T18:22:15.050 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-26T18:22:16.187 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - CRB 6.0 MB/s | 6.2 MB 00:01 2024-04-26T18:22:16.618 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 16 kB 00:00 2024-04-26T18:22:16.715 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.0 MB 00:08 2024-04-26T18:22:17.880 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 16 kB 00:00 2024-04-26T18:22:18.855 INFO:teuthology.orchestra.run.smithi080.stdout:Extra Packages for Enterprise Linux 9.9 MB/s | 21 MB 00:02 2024-04-26T18:22:19.582 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 11 MB/s | 19 MB 00:01 2024-04-26T18:22:19.906 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-26T18:22:23.944 INFO:teuthology.orchestra.run.smithi080.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-26T18:22:25.048 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 10 kB/s | 1.7 kB 00:00 2024-04-26T18:22:26.072 INFO:teuthology.orchestra.run.smithi080.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T18:22:26.072 INFO:teuthology.orchestra.run.smithi080.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T18:22:26.083 INFO:teuthology.orchestra.run.smithi080.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T18:22:26.084 INFO:teuthology.orchestra.run.smithi080.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T18:22:26.085 INFO:teuthology.orchestra.run.smithi080.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T18:22:26.086 INFO:teuthology.orchestra.run.smithi080.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T18:22:26.087 INFO:teuthology.orchestra.run.smithi080.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T18:22:26.089 INFO:teuthology.orchestra.run.smithi080.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T18:22:26.090 INFO:teuthology.orchestra.run.smithi080.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T18:22:26.150 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-04-26T18:22:26.159 INFO:teuthology.orchestra.run.smithi080.stdout:======================================================================================= 2024-04-26T18:22:26.159 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-04-26T18:22:26.159 INFO:teuthology.orchestra.run.smithi080.stdout:======================================================================================= 2024-04-26T18:22:26.159 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-04-26T18:22:26.160 INFO:teuthology.orchestra.run.smithi080.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T18:22:26.160 INFO:teuthology.orchestra.run.smithi080.stdout: ceph x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 6.6 k 2024-04-26T18:22:26.160 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T18:22:26.160 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 890 k 2024-04-26T18:22:26.160 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 145 k 2024-04-26T18:22:26.160 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 1.5 M 2024-04-26T18:22:26.160 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 142 k 2024-04-26T18:22:26.160 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 3.5 M 2024-04-26T18:22:26.160 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 7.4 M 2024-04-26T18:22:26.160 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-rook noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 49 k 2024-04-26T18:22:26.160 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-radosgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 11 M 2024-04-26T18:22:26.160 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-test x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 49 M 2024-04-26T18:22:26.160 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-volume noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 273 k 2024-04-26T18:22:26.161 INFO:teuthology.orchestra.run.smithi080.stdout: cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 762 k 2024-04-26T18:22:26.161 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 224 k 2024-04-26T18:22:26.161 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-shell x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 27 k 2024-04-26T18:22:26.161 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-top noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 18 k 2024-04-26T18:22:26.161 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T18:22:26.161 INFO:teuthology.orchestra.run.smithi080.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T18:22:26.161 INFO:teuthology.orchestra.run.smithi080.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T18:22:26.161 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 32 k 2024-04-26T18:22:26.161 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 746 k 2024-04-26T18:22:26.161 INFO:teuthology.orchestra.run.smithi080.stdout: librados-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 127 k 2024-04-26T18:22:26.161 INFO:teuthology.orchestra.run.smithi080.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T18:22:26.161 INFO:teuthology.orchestra.run.smithi080.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T18:22:26.161 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T18:22:26.161 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T18:22:26.162 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T18:22:26.162 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T18:22:26.162 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cephfs x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 162 k 2024-04-26T18:22:26.162 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rados x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 320 k 2024-04-26T18:22:26.162 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 298 k 2024-04-26T18:22:26.162 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 99 k 2024-04-26T18:22:26.162 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 85 k 2024-04-26T18:22:26.162 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T18:22:26.162 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-nbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 170 k 2024-04-26T18:22:26.162 INFO:teuthology.orchestra.run.smithi080.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T18:22:26.162 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrading: 2024-04-26T18:22:26.162 INFO:teuthology.orchestra.run.smithi080.stdout: librados2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.4 M 2024-04-26T18:22:26.162 INFO:teuthology.orchestra.run.smithi080.stdout: librbd1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T18:22:26.163 INFO:teuthology.orchestra.run.smithi080.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T18:22:26.163 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T18:22:26.163 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-04-26T18:22:26.163 INFO:teuthology.orchestra.run.smithi080.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T18:22:26.163 INFO:teuthology.orchestra.run.smithi080.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T18:22:26.163 INFO:teuthology.orchestra.run.smithi080.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T18:22:26.163 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 21 M 2024-04-26T18:22:26.163 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 34 k 2024-04-26T18:22:26.163 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mds x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 2.4 M 2024-04-26T18:22:26.163 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 249 k 2024-04-26T18:22:26.163 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mon x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 4.7 M 2024-04-26T18:22:26.163 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-osd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 17 M 2024-04-26T18:22:26.163 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 16 k 2024-04-26T18:22:26.163 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-selinux x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 25 k 2024-04-26T18:22:26.164 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T18:22:26.164 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T18:22:26.164 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T18:22:26.164 INFO:teuthology.orchestra.run.smithi080.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T18:22:26.164 INFO:teuthology.orchestra.run.smithi080.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T18:22:26.164 INFO:teuthology.orchestra.run.smithi080.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T18:22:26.164 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T18:22:26.164 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T18:22:26.164 INFO:teuthology.orchestra.run.smithi080.stdout: libcephsqlite x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 163 k 2024-04-26T18:22:26.164 INFO:teuthology.orchestra.run.smithi080.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T18:22:26.164 INFO:teuthology.orchestra.run.smithi080.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T18:22:26.164 INFO:teuthology.orchestra.run.smithi080.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T18:22:26.164 INFO:teuthology.orchestra.run.smithi080.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T18:22:26.165 INFO:teuthology.orchestra.run.smithi080.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T18:22:26.165 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 501 k 2024-04-26T18:22:26.165 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T18:22:26.165 INFO:teuthology.orchestra.run.smithi080.stdout: librgw2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T18:22:26.165 INFO:teuthology.orchestra.run.smithi080.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T18:22:26.165 INFO:teuthology.orchestra.run.smithi080.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T18:22:26.165 INFO:teuthology.orchestra.run.smithi080.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T18:22:26.165 INFO:teuthology.orchestra.run.smithi080.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T18:22:26.165 INFO:teuthology.orchestra.run.smithi080.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T18:22:26.165 INFO:teuthology.orchestra.run.smithi080.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T18:22:26.165 INFO:teuthology.orchestra.run.smithi080.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T18:22:26.165 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T18:22:26.165 INFO:teuthology.orchestra.run.smithi080.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T18:22:26.165 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T18:22:26.165 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T18:22:26.166 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T18:22:26.166 INFO:teuthology.orchestra.run.smithi080.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T18:22:26.166 INFO:teuthology.orchestra.run.smithi080.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T18:22:26.166 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T18:22:26.166 INFO:teuthology.orchestra.run.smithi080.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T18:22:26.166 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T18:22:26.166 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 45 k 2024-04-26T18:22:26.166 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 135 k 2024-04-26T18:22:26.166 INFO:teuthology.orchestra.run.smithi080.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T18:22:26.166 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T18:22:26.166 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T18:22:26.166 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T18:22:26.166 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T18:22:26.167 INFO:teuthology.orchestra.run.smithi080.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T18:22:26.167 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T18:22:26.167 INFO:teuthology.orchestra.run.smithi080.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T18:22:26.167 INFO:teuthology.orchestra.run.smithi080.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T18:22:26.167 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T18:22:26.167 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T18:22:26.167 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T18:22:26.167 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T18:22:26.167 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T18:22:26.167 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T18:22:26.167 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T18:22:26.167 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T18:22:26.167 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T18:22:26.168 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T18:22:26.168 INFO:teuthology.orchestra.run.smithi080.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T18:22:26.168 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T18:22:26.168 INFO:teuthology.orchestra.run.smithi080.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T18:22:26.168 INFO:teuthology.orchestra.run.smithi080.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T18:22:26.168 INFO:teuthology.orchestra.run.smithi080.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T18:22:26.168 INFO:teuthology.orchestra.run.smithi080.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T18:22:26.168 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T18:22:26.168 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T18:22:26.168 INFO:teuthology.orchestra.run.smithi080.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T18:22:26.168 INFO:teuthology.orchestra.run.smithi080.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T18:22:26.168 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T18:22:26.168 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T18:22:26.168 INFO:teuthology.orchestra.run.smithi080.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T18:22:26.169 INFO:teuthology.orchestra.run.smithi080.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T18:22:26.169 INFO:teuthology.orchestra.run.smithi080.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T18:22:26.169 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T18:22:26.169 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T18:22:26.169 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T18:22:26.169 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T18:22:26.169 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T18:22:26.169 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T18:22:26.169 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T18:22:26.169 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T18:22:26.169 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T18:22:26.169 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T18:22:26.170 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T18:22:26.170 INFO:teuthology.orchestra.run.smithi080.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T18:22:26.170 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T18:22:26.170 INFO:teuthology.orchestra.run.smithi080.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T18:22:26.170 INFO:teuthology.orchestra.run.smithi080.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T18:22:26.170 INFO:teuthology.orchestra.run.smithi080.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T18:22:26.170 INFO:teuthology.orchestra.run.smithi080.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T18:22:26.170 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T18:22:26.170 INFO:teuthology.orchestra.run.smithi080.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T18:22:26.170 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T18:22:26.170 INFO:teuthology.orchestra.run.smithi080.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T18:22:26.170 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T18:22:26.170 INFO:teuthology.orchestra.run.smithi080.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T18:22:26.170 INFO:teuthology.orchestra.run.smithi080.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T18:22:26.171 INFO:teuthology.orchestra.run.smithi080.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T18:22:26.171 INFO:teuthology.orchestra.run.smithi080.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T18:22:26.171 INFO:teuthology.orchestra.run.smithi080.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T18:22:26.171 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T18:22:26.171 INFO:teuthology.orchestra.run.smithi080.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T18:22:26.171 INFO:teuthology.orchestra.run.smithi080.stdout:Installing weak dependencies: 2024-04-26T18:22:26.171 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T18:22:26.171 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:22:26.171 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-04-26T18:22:26.171 INFO:teuthology.orchestra.run.smithi080.stdout:======================================================================================= 2024-04-26T18:22:26.171 INFO:teuthology.orchestra.run.smithi080.stdout:Install 148 Packages 2024-04-26T18:22:26.171 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrade 4 Packages 2024-04-26T18:22:26.171 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:22:26.172 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 222 M 2024-04-26T18:22:26.172 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-04-26T18:22:26.988 INFO:teuthology.orchestra.run.smithi080.stdout:(1/152): ceph-19.0.0-3267.gbc94a2a9.el9.x86_64. 30 kB/s | 6.6 kB 00:00 2024-04-26T18:22:27.157 INFO:teuthology.orchestra.run.smithi192.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T18:22:27.158 INFO:teuthology.orchestra.run.smithi192.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T18:22:27.169 INFO:teuthology.orchestra.run.smithi192.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T18:22:27.169 INFO:teuthology.orchestra.run.smithi192.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T18:22:27.170 INFO:teuthology.orchestra.run.smithi192.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T18:22:27.171 INFO:teuthology.orchestra.run.smithi192.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T18:22:27.173 INFO:teuthology.orchestra.run.smithi192.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T18:22:27.175 INFO:teuthology.orchestra.run.smithi192.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T18:22:27.176 INFO:teuthology.orchestra.run.smithi192.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T18:22:27.237 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-04-26T18:22:27.257 INFO:teuthology.orchestra.run.smithi192.stdout:======================================================================================= 2024-04-26T18:22:27.257 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-04-26T18:22:27.257 INFO:teuthology.orchestra.run.smithi192.stdout:======================================================================================= 2024-04-26T18:22:27.257 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-04-26T18:22:27.257 INFO:teuthology.orchestra.run.smithi192.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T18:22:27.257 INFO:teuthology.orchestra.run.smithi192.stdout: ceph x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 6.6 k 2024-04-26T18:22:27.257 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T18:22:27.257 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 890 k 2024-04-26T18:22:27.257 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 145 k 2024-04-26T18:22:27.257 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 1.5 M 2024-04-26T18:22:27.257 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 142 k 2024-04-26T18:22:27.257 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 3.5 M 2024-04-26T18:22:27.257 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 7.4 M 2024-04-26T18:22:27.258 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 49 k 2024-04-26T18:22:27.258 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 11 M 2024-04-26T18:22:27.258 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 49 M 2024-04-26T18:22:27.258 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 273 k 2024-04-26T18:22:27.258 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 762 k 2024-04-26T18:22:27.258 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 224 k 2024-04-26T18:22:27.258 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-shell x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 27 k 2024-04-26T18:22:27.258 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-top noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 18 k 2024-04-26T18:22:27.258 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T18:22:27.258 INFO:teuthology.orchestra.run.smithi192.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T18:22:27.258 INFO:teuthology.orchestra.run.smithi192.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T18:22:27.258 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 32 k 2024-04-26T18:22:27.258 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 746 k 2024-04-26T18:22:27.258 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 127 k 2024-04-26T18:22:27.259 INFO:teuthology.orchestra.run.smithi192.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T18:22:27.259 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T18:22:27.259 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T18:22:27.259 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T18:22:27.259 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T18:22:27.259 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T18:22:27.259 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 162 k 2024-04-26T18:22:27.259 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 320 k 2024-04-26T18:22:27.259 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 298 k 2024-04-26T18:22:27.259 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 99 k 2024-04-26T18:22:27.259 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 85 k 2024-04-26T18:22:27.259 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T18:22:27.259 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 170 k 2024-04-26T18:22:27.259 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T18:22:27.260 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrading: 2024-04-26T18:22:27.260 INFO:teuthology.orchestra.run.smithi192.stdout: librados2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.4 M 2024-04-26T18:22:27.260 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T18:22:27.260 INFO:teuthology.orchestra.run.smithi192.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T18:22:27.260 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T18:22:27.260 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-04-26T18:22:27.260 INFO:teuthology.orchestra.run.smithi192.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T18:22:27.260 INFO:teuthology.orchestra.run.smithi192.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T18:22:27.260 INFO:teuthology.orchestra.run.smithi192.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T18:22:27.260 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 21 M 2024-04-26T18:22:27.260 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 34 k 2024-04-26T18:22:27.260 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 2.4 M 2024-04-26T18:22:27.260 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 249 k 2024-04-26T18:22:27.260 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 4.7 M 2024-04-26T18:22:27.261 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 17 M 2024-04-26T18:22:27.261 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 16 k 2024-04-26T18:22:27.261 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 25 k 2024-04-26T18:22:27.261 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T18:22:27.261 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T18:22:27.261 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T18:22:27.261 INFO:teuthology.orchestra.run.smithi192.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T18:22:27.261 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T18:22:27.261 INFO:teuthology.orchestra.run.smithi192.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T18:22:27.261 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T18:22:27.261 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T18:22:27.261 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 163 k 2024-04-26T18:22:27.261 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T18:22:27.261 INFO:teuthology.orchestra.run.smithi192.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T18:22:27.261 INFO:teuthology.orchestra.run.smithi192.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T18:22:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T18:22:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T18:22:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 501 k 2024-04-26T18:22:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T18:22:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T18:22:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T18:22:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T18:22:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T18:22:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T18:22:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T18:22:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T18:22:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T18:22:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T18:22:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T18:22:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T18:22:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T18:22:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T18:22:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T18:22:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T18:22:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T18:22:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T18:22:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T18:22:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 45 k 2024-04-26T18:22:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 135 k 2024-04-26T18:22:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T18:22:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T18:22:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T18:22:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T18:22:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T18:22:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T18:22:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T18:22:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T18:22:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T18:22:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T18:22:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T18:22:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T18:22:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T18:22:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T18:22:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T18:22:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T18:22:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T18:22:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T18:22:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T18:22:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T18:22:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T18:22:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T18:22:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T18:22:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T18:22:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T18:22:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T18:22:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T18:22:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T18:22:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T18:22:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T18:22:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T18:22:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T18:22:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T18:22:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T18:22:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T18:22:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T18:22:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T18:22:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T18:22:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T18:22:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T18:22:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T18:22:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T18:22:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T18:22:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T18:22:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T18:22:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T18:22:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T18:22:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T18:22:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T18:22:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T18:22:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T18:22:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T18:22:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T18:22:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T18:22:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T18:22:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T18:22:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T18:22:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T18:22:27.268 INFO:teuthology.orchestra.run.smithi192.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T18:22:27.268 INFO:teuthology.orchestra.run.smithi192.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T18:22:27.268 INFO:teuthology.orchestra.run.smithi192.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T18:22:27.268 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T18:22:27.268 INFO:teuthology.orchestra.run.smithi192.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T18:22:27.268 INFO:teuthology.orchestra.run.smithi192.stdout:Installing weak dependencies: 2024-04-26T18:22:27.268 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T18:22:27.268 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T18:22:27.268 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-04-26T18:22:27.268 INFO:teuthology.orchestra.run.smithi192.stdout:======================================================================================= 2024-04-26T18:22:27.268 INFO:teuthology.orchestra.run.smithi192.stdout:Install 148 Packages 2024-04-26T18:22:27.268 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrade 4 Packages 2024-04-26T18:22:27.268 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T18:22:27.269 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 222 M 2024-04-26T18:22:27.269 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-04-26T18:22:27.305 INFO:teuthology.orchestra.run.smithi080.stdout:(2/152): ceph-fuse-19.0.0-3267.gbc94a2a9.el9.x8 2.7 MB/s | 890 kB 00:00 2024-04-26T18:22:27.380 INFO:teuthology.orchestra.run.smithi080.stdout:(3/152): ceph-immutable-object-cache-19.0.0-326 1.9 MB/s | 145 kB 00:00 2024-04-26T18:22:27.914 INFO:teuthology.orchestra.run.smithi080.stdout:(4/152): ceph-mds-19.0.0-3267.gbc94a2a9.el9.x86 4.4 MB/s | 2.4 MB 00:00 2024-04-26T18:22:27.981 INFO:teuthology.orchestra.run.smithi080.stdout:(5/152): ceph-base-19.0.0-3267.gbc94a2a9.el9.x8 4.4 MB/s | 5.4 MB 00:01 2024-04-26T18:22:28.049 INFO:teuthology.orchestra.run.smithi192.stdout:(1/152): ceph-19.0.0-3267.gbc94a2a9.el9.x86_64. 23 kB/s | 6.6 kB 00:00 2024-04-26T18:22:28.298 INFO:teuthology.orchestra.run.smithi080.stdout:(6/152): ceph-mgr-19.0.0-3267.gbc94a2a9.el9.x86 3.9 MB/s | 1.5 MB 00:00 2024-04-26T18:22:28.490 INFO:teuthology.orchestra.run.smithi080.stdout:(7/152): ceph-common-19.0.0-3267.gbc94a2a9.el9. 12 MB/s | 21 MB 00:01 2024-04-26T18:22:28.782 INFO:teuthology.orchestra.run.smithi192.stdout:(2/152): ceph-fuse-19.0.0-3267.gbc94a2a9.el9.x8 1.2 MB/s | 890 kB 00:00 2024-04-26T18:22:28.823 INFO:teuthology.orchestra.run.smithi080.stdout:(8/152): ceph-mon-19.0.0-3267.gbc94a2a9.el9.x86 5.6 MB/s | 4.7 MB 00:00 2024-04-26T18:22:28.908 INFO:teuthology.orchestra.run.smithi192.stdout:(3/152): ceph-immutable-object-cache-19.0.0-326 1.1 MB/s | 145 kB 00:00 2024-04-26T18:22:28.915 INFO:teuthology.orchestra.run.smithi080.stdout:(9/152): ceph-selinux-19.0.0-3267.gbc94a2a9.el9 275 kB/s | 25 kB 00:00 2024-04-26T18:22:29.457 INFO:teuthology.orchestra.run.smithi080.stdout:(10/152): ceph-radosgw-19.0.0-3267.gbc94a2a9.el 11 MB/s | 11 MB 00:00 2024-04-26T18:22:29.524 INFO:teuthology.orchestra.run.smithi080.stdout:(11/152): cephfs-mirror-19.0.0-3267.gbc94a2a9.e 3.3 MB/s | 224 kB 00:00 2024-04-26T18:22:29.541 INFO:teuthology.orchestra.run.smithi192.stdout:(4/152): ceph-base-19.0.0-3267.gbc94a2a9.el9.x8 3.0 MB/s | 5.4 MB 00:01 2024-04-26T18:22:29.583 INFO:teuthology.orchestra.run.smithi080.stdout:(12/152): cephfs-shell-19.0.0-3267.gbc94a2a9.el 464 kB/s | 27 kB 00:00 2024-04-26T18:22:29.666 INFO:teuthology.orchestra.run.smithi080.stdout:(13/152): libcephfs-devel-19.0.0-3267.gbc94a2a9 380 kB/s | 32 kB 00:00 2024-04-26T18:22:29.775 INFO:teuthology.orchestra.run.smithi080.stdout:(14/152): libcephfs2-19.0.0-3267.gbc94a2a9.el9. 6.7 MB/s | 746 kB 00:00 2024-04-26T18:22:29.850 INFO:teuthology.orchestra.run.smithi080.stdout:(15/152): libcephsqlite-19.0.0-3267.gbc94a2a9.e 2.1 MB/s | 163 kB 00:00 2024-04-26T18:22:29.909 INFO:teuthology.orchestra.run.smithi080.stdout:(16/152): librados-devel-19.0.0-3267.gbc94a2a9. 2.1 MB/s | 127 kB 00:00 2024-04-26T18:22:29.933 INFO:teuthology.orchestra.run.smithi192.stdout:(5/152): ceph-mds-19.0.0-3267.gbc94a2a9.el9.x86 2.3 MB/s | 2.4 MB 00:01 2024-04-26T18:22:30.000 INFO:teuthology.orchestra.run.smithi192.stdout:(6/152): ceph-mgr-19.0.0-3267.gbc94a2a9.el9.x86 3.3 MB/s | 1.5 MB 00:00 2024-04-26T18:22:30.064 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 916 kB/s | 6.2 MB 00:06 2024-04-26T18:22:30.076 INFO:teuthology.orchestra.run.smithi080.stdout:(17/152): ceph-osd-19.0.0-3267.gbc94a2a9.el9.x8 9.5 MB/s | 17 MB 00:01 2024-04-26T18:22:30.109 INFO:teuthology.orchestra.run.smithi080.stdout:(18/152): libradosstriper1-19.0.0-3267.gbc94a2a 2.4 MB/s | 501 kB 00:00 2024-04-26T18:22:30.176 INFO:teuthology.orchestra.run.smithi080.stdout:(19/152): python3-ceph-argparse-19.0.0-3267.gbc 679 kB/s | 45 kB 00:00 2024-04-26T18:22:30.252 INFO:teuthology.orchestra.run.smithi080.stdout:(20/152): python3-ceph-common-19.0.0-3267.gbc94 1.8 MB/s | 135 kB 00:00 2024-04-26T18:22:30.344 INFO:teuthology.orchestra.run.smithi080.stdout:(21/152): python3-cephfs-19.0.0-3267.gbc94a2a9. 1.7 MB/s | 162 kB 00:00 2024-04-26T18:22:30.435 INFO:teuthology.orchestra.run.smithi080.stdout:(22/152): python3-rados-19.0.0-3267.gbc94a2a9.e 3.4 MB/s | 320 kB 00:00 2024-04-26T18:22:30.528 INFO:teuthology.orchestra.run.smithi080.stdout:(23/152): python3-rbd-19.0.0-3267.gbc94a2a9.el9 3.2 MB/s | 298 kB 00:00 2024-04-26T18:22:30.619 INFO:teuthology.orchestra.run.smithi080.stdout:(24/152): librgw2-19.0.0-3267.gbc94a2a9.el9.x86 9.9 MB/s | 5.4 MB 00:00 2024-04-26T18:22:30.645 INFO:teuthology.orchestra.run.smithi080.stdout:(25/152): python3-rgw-19.0.0-3267.gbc94a2a9.el9 850 kB/s | 99 kB 00:00 2024-04-26T18:22:30.678 INFO:teuthology.orchestra.run.smithi080.stdout:(26/152): rbd-fuse-19.0.0-3267.gbc94a2a9.el9.x8 1.4 MB/s | 85 kB 00:00 2024-04-26T18:22:30.779 INFO:teuthology.orchestra.run.smithi080.stdout:(27/152): rbd-nbd-19.0.0-3267.gbc94a2a9.el9.x86 1.7 MB/s | 170 kB 00:00 2024-04-26T18:22:30.871 INFO:teuthology.orchestra.run.smithi080.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3267.g 373 kB/s | 34 kB 00:00 2024-04-26T18:22:30.875 INFO:teuthology.orchestra.run.smithi192.stdout:(7/152): ceph-mon-19.0.0-3267.gbc94a2a9.el9.x86 5.0 MB/s | 4.7 MB 00:00 2024-04-26T18:22:30.946 INFO:teuthology.orchestra.run.smithi080.stdout:(29/152): rbd-mirror-19.0.0-3267.gbc94a2a9.el9. 10 MB/s | 3.1 MB 00:00 2024-04-26T18:22:30.972 INFO:teuthology.orchestra.run.smithi080.stdout:(30/152): ceph-mgr-cephadm-19.0.0-3267.gbc94a2a 1.4 MB/s | 142 kB 00:00 2024-04-26T18:22:31.414 INFO:teuthology.orchestra.run.smithi080.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3267.gbc94a 7.6 MB/s | 3.5 MB 00:00 2024-04-26T18:22:31.506 INFO:teuthology.orchestra.run.smithi080.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3267.gbc 2.7 MB/s | 249 kB 00:00 2024-04-26T18:22:31.590 INFO:teuthology.orchestra.run.smithi080.stdout:(33/152): ceph-mgr-rook-19.0.0-3267.gbc94a2a9.e 592 kB/s | 49 kB 00:00 2024-04-26T18:22:31.656 INFO:teuthology.orchestra.run.smithi080.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3267.gb 247 kB/s | 16 kB 00:00 2024-04-26T18:22:31.740 INFO:teuthology.orchestra.run.smithi080.stdout:(35/152): ceph-volume-19.0.0-3267.gbc94a2a9.el9 3.2 MB/s | 273 kB 00:00 2024-04-26T18:22:31.890 INFO:teuthology.orchestra.run.smithi080.stdout:(36/152): cephadm-19.0.0-3267.gbc94a2a9.el9.noa 5.0 MB/s | 762 kB 00:00 2024-04-26T18:22:31.991 INFO:teuthology.orchestra.run.smithi080.stdout:(37/152): ceph-mgr-diskprediction-local-19.0.0- 7.3 MB/s | 7.4 MB 00:01 2024-04-26T18:22:32.015 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 21 kB/s | 16 kB 00:00 2024-04-26T18:22:32.016 INFO:teuthology.orchestra.run.smithi080.stdout:(38/152): cephfs-top-19.0.0-3267.gbc94a2a9.el9. 145 kB/s | 18 kB 00:00 2024-04-26T18:22:32.241 INFO:teuthology.orchestra.run.smithi080.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 321 kB/s | 80 kB 00:00 2024-04-26T18:22:32.386 INFO:teuthology.orchestra.run.smithi080.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-04-26T18:22:32.425 INFO:teuthology.orchestra.run.smithi080.stdout:(41/152): libgfortran-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 803 kB 00:00 2024-04-26T18:22:32.500 INFO:teuthology.orchestra.run.smithi080.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-04-26T18:22:32.517 INFO:teuthology.orchestra.run.smithi192.stdout:(8/152): ceph-radosgw-19.0.0-3267.gbc94a2a9.el9 6.5 MB/s | 11 MB 00:01 2024-04-26T18:22:32.592 INFO:teuthology.orchestra.run.smithi080.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 7.3 MB/s | 1.2 MB 00:00 2024-04-26T18:22:32.609 INFO:teuthology.orchestra.run.smithi192.stdout:(9/152): ceph-selinux-19.0.0-3267.gbc94a2a9.el9 276 kB/s | 25 kB 00:00 2024-04-26T18:22:32.617 INFO:teuthology.orchestra.run.smithi080.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 911 kB/s | 106 kB 00:00 2024-04-26T18:22:32.668 INFO:teuthology.orchestra.run.smithi080.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-04-26T18:22:32.702 INFO:teuthology.orchestra.run.smithi080.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-04-26T18:22:32.776 INFO:teuthology.orchestra.run.smithi192.stdout:(10/152): ceph-osd-19.0.0-3267.gbc94a2a9.el9.x8 6.1 MB/s | 17 MB 00:02 2024-04-26T18:22:32.785 INFO:teuthology.orchestra.run.smithi080.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-04-26T18:22:32.826 INFO:teuthology.orchestra.run.smithi192.stdout:(11/152): cephfs-mirror-19.0.0-3267.gbc94a2a9.e 4.4 MB/s | 224 kB 00:00 2024-04-26T18:22:32.868 INFO:teuthology.orchestra.run.smithi192.stdout:(12/152): cephfs-shell-19.0.0-3267.gbc94a2a9.el 653 kB/s | 27 kB 00:00 2024-04-26T18:22:32.916 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 27 MB/s | 21 MB 00:00 2024-04-26T18:22:32.927 INFO:teuthology.orchestra.run.smithi192.stdout:(13/152): libcephfs-devel-19.0.0-3267.gbc94a2a9 543 kB/s | 32 kB 00:00 2024-04-26T18:22:32.960 INFO:teuthology.orchestra.run.smithi080.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-04-26T18:22:33.019 INFO:teuthology.orchestra.run.smithi080.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-04-26T18:22:33.052 INFO:teuthology.orchestra.run.smithi192.stdout:(14/152): libcephfs2-19.0.0-3267.gbc94a2a9.el9. 5.8 MB/s | 746 kB 00:00 2024-04-26T18:22:33.086 INFO:teuthology.orchestra.run.smithi080.stdout:(50/152): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 943 kB 00:00 2024-04-26T18:22:33.110 INFO:teuthology.orchestra.run.smithi192.stdout:(15/152): libcephsqlite-19.0.0-3267.gbc94a2a9.e 2.7 MB/s | 163 kB 00:00 2024-04-26T18:22:33.111 INFO:teuthology.orchestra.run.smithi080.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 233 kB/s | 21 kB 00:00 2024-04-26T18:22:33.169 INFO:teuthology.orchestra.run.smithi192.stdout:(16/152): librados-devel-19.0.0-3267.gbc94a2a9. 2.1 MB/s | 127 kB 00:00 2024-04-26T18:22:33.170 INFO:teuthology.orchestra.run.smithi080.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-04-26T18:22:33.195 INFO:teuthology.orchestra.run.smithi080.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 390 kB/s | 33 kB 00:00 2024-04-26T18:22:33.246 INFO:teuthology.orchestra.run.smithi080.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-04-26T18:22:33.286 INFO:teuthology.orchestra.run.smithi192.stdout:(17/152): libradosstriper1-19.0.0-3267.gbc94a2a 4.2 MB/s | 501 kB 00:00 2024-04-26T18:22:33.296 INFO:teuthology.orchestra.run.smithi080.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-04-26T18:22:33.363 INFO:teuthology.orchestra.run.smithi080.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-04-26T18:22:33.430 INFO:teuthology.orchestra.run.smithi080.stdout:(57/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-04-26T18:22:33.455 INFO:teuthology.orchestra.run.smithi080.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 492 kB/s | 45 kB 00:00 2024-04-26T18:22:33.530 INFO:teuthology.orchestra.run.smithi080.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 662 kB 00:00 2024-04-26T18:22:33.556 INFO:teuthology.orchestra.run.smithi080.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 5.7 MB/s | 582 kB 00:00 2024-04-26T18:22:33.598 INFO:teuthology.orchestra.run.smithi080.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 381 kB/s | 25 kB 00:00 2024-04-26T18:22:33.623 INFO:teuthology.orchestra.run.smithi080.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 708 kB/s | 47 kB 00:00 2024-04-26T18:22:33.673 INFO:teuthology.orchestra.run.smithi080.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-04-26T18:22:33.699 INFO:teuthology.orchestra.run.smithi080.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-04-26T18:22:33.732 INFO:teuthology.orchestra.run.smithi080.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 604 kB/s | 35 kB 00:00 2024-04-26T18:22:33.928 INFO:teuthology.orchestra.run.smithi192.stdout:(18/152): librgw2-19.0.0-3267.gbc94a2a9.el9.x86 8.4 MB/s | 5.4 MB 00:00 2024-04-26T18:22:33.970 INFO:teuthology.orchestra.run.smithi192.stdout:(19/152): python3-ceph-argparse-19.0.0-3267.gbc 1.1 MB/s | 45 kB 00:00 2024-04-26T18:22:34.020 INFO:teuthology.orchestra.run.smithi192.stdout:(20/152): python3-ceph-common-19.0.0-3267.gbc94 2.6 MB/s | 135 kB 00:00 2024-04-26T18:22:34.049 INFO:teuthology.orchestra.run.smithi080.stdout:(66/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-04-26T18:22:34.078 INFO:teuthology.orchestra.run.smithi192.stdout:(21/152): python3-cephfs-19.0.0-3267.gbc94a2a9. 2.7 MB/s | 162 kB 00:00 2024-04-26T18:22:34.124 INFO:teuthology.orchestra.run.smithi080.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 11 MB/s | 4.7 MB 00:00 2024-04-26T18:22:34.175 INFO:teuthology.orchestra.run.smithi080.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-04-26T18:22:34.179 INFO:teuthology.orchestra.run.smithi192.stdout:(22/152): python3-rados-19.0.0-3267.gbc94a2a9.e 3.1 MB/s | 320 kB 00:00 2024-04-26T18:22:34.234 INFO:teuthology.orchestra.run.smithi080.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 8.2 MB/s | 911 kB 00:00 2024-04-26T18:22:34.263 INFO:teuthology.orchestra.run.smithi192.stdout:(23/152): python3-rbd-19.0.0-3267.gbc94a2a9.el9 3.5 MB/s | 298 kB 00:00 2024-04-26T18:22:34.267 INFO:teuthology.orchestra.run.smithi080.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.4 MB/s | 133 kB 00:00 2024-04-26T18:22:34.313 INFO:teuthology.orchestra.run.smithi192.stdout:(24/152): python3-rgw-19.0.0-3267.gbc94a2a9.el9 2.0 MB/s | 99 kB 00:00 2024-04-26T18:22:34.371 INFO:teuthology.orchestra.run.smithi192.stdout:(25/152): rbd-fuse-19.0.0-3267.gbc94a2a9.el9.x8 1.4 MB/s | 85 kB 00:00 2024-04-26T18:22:34.375 INFO:teuthology.orchestra.run.smithi080.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-04-26T18:22:34.443 INFO:teuthology.orchestra.run.smithi080.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-04-26T18:22:34.593 INFO:teuthology.orchestra.run.smithi080.stdout:(73/152): postgresql-server-13.14-1.el9.x86_64. 16 MB/s | 5.8 MB 00:00 2024-04-26T18:22:34.668 INFO:teuthology.orchestra.run.smithi080.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 3.2 MB/s | 244 kB 00:00 2024-04-26T18:22:34.760 INFO:teuthology.orchestra.run.smithi080.stdout:(75/152): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-04-26T18:22:34.772 INFO:teuthology.orchestra.run.smithi192.stdout:(26/152): rbd-mirror-19.0.0-3267.gbc94a2a9.el9. 7.7 MB/s | 3.1 MB 00:00 2024-04-26T18:22:34.785 INFO:teuthology.orchestra.run.smithi080.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-04-26T18:22:34.822 INFO:teuthology.orchestra.run.smithi192.stdout:(27/152): rbd-nbd-19.0.0-3267.gbc94a2a9.el9.x86 3.4 MB/s | 170 kB 00:00 2024-04-26T18:22:34.827 INFO:teuthology.orchestra.run.smithi080.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 383 kB/s | 26 kB 00:00 2024-04-26T18:22:34.853 INFO:teuthology.orchestra.run.smithi080.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 287 kB/s | 19 kB 00:00 2024-04-26T18:22:34.873 INFO:teuthology.orchestra.run.smithi192.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3267.g 677 kB/s | 34 kB 00:00 2024-04-26T18:22:34.895 INFO:teuthology.orchestra.run.smithi080.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-04-26T18:22:34.920 INFO:teuthology.orchestra.run.smithi080.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 517 kB/s | 35 kB 00:00 2024-04-26T18:22:34.931 INFO:teuthology.orchestra.run.smithi192.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3267.gbc94a2a 2.4 MB/s | 142 kB 00:00 2024-04-26T18:22:35.004 INFO:teuthology.orchestra.run.smithi080.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-04-26T18:22:35.071 INFO:teuthology.orchestra.run.smithi080.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-04-26T18:22:35.165 INFO:teuthology.orchestra.run.smithi080.stdout:(83/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 5.1 MB 00:00 2024-04-26T18:22:35.196 INFO:teuthology.orchestra.run.smithi080.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 616 kB/s | 77 kB 00:00 2024-04-26T18:22:35.230 INFO:teuthology.orchestra.run.smithi080.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 656 kB/s | 42 kB 00:00 2024-04-26T18:22:35.272 INFO:teuthology.orchestra.run.smithi080.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-04-26T18:22:35.297 INFO:teuthology.orchestra.run.smithi080.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-04-26T18:22:35.339 INFO:teuthology.orchestra.run.smithi080.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-04-26T18:22:35.364 INFO:teuthology.orchestra.run.smithi080.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 762 kB/s | 51 kB 00:00 2024-04-26T18:22:35.398 INFO:teuthology.orchestra.run.smithi080.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 917 kB/s | 54 kB 00:00 2024-04-26T18:22:35.399 INFO:teuthology.orchestra.run.smithi192.stdout:(30/152): ceph-mgr-dashboard-19.0.0-3267.gbc94a 7.6 MB/s | 3.5 MB 00:00 2024-04-26T18:22:35.465 INFO:teuthology.orchestra.run.smithi080.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 627 kB/s | 42 kB 00:00 2024-04-26T18:22:35.524 INFO:teuthology.orchestra.run.smithi080.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 758 kB/s | 44 kB 00:00 2024-04-26T18:22:35.591 INFO:teuthology.orchestra.run.smithi080.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-04-26T18:22:35.658 INFO:teuthology.orchestra.run.smithi080.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 540 kB/s | 36 kB 00:00 2024-04-26T18:22:35.716 INFO:teuthology.orchestra.run.smithi080.stdout:(95/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-04-26T18:22:35.883 INFO:teuthology.orchestra.run.smithi080.stdout:(96/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-04-26T18:22:35.909 INFO:teuthology.orchestra.run.smithi080.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 1.5 MB/s | 305 kB 00:00 2024-04-26T18:22:35.942 INFO:teuthology.orchestra.run.smithi080.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 990 kB/s | 58 kB 00:00 2024-04-26T18:22:35.984 INFO:teuthology.orchestra.run.smithi080.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.2 MB/s | 94 kB 00:00 2024-04-26T18:22:36.018 INFO:teuthology.orchestra.run.smithi080.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 846 kB/s | 64 kB 00:00 2024-04-26T18:22:36.043 INFO:teuthology.orchestra.run.smithi080.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 762 kB/s | 45 kB 00:00 2024-04-26T18:22:36.290 INFO:teuthology.orchestra.run.smithi192.stdout:(31/152): ceph-mgr-diskprediction-local-19.0.0- 8.3 MB/s | 7.4 MB 00:00 2024-04-26T18:22:36.349 INFO:teuthology.orchestra.run.smithi192.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3267.gbc 4.2 MB/s | 249 kB 00:00 2024-04-26T18:22:36.407 INFO:teuthology.orchestra.run.smithi192.stdout:(33/152): ceph-mgr-rook-19.0.0-3267.gbc94a2a9.e 848 kB/s | 49 kB 00:00 2024-04-26T18:22:36.466 INFO:teuthology.orchestra.run.smithi192.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3267.gb 283 kB/s | 16 kB 00:00 2024-04-26T18:22:36.542 INFO:teuthology.orchestra.run.smithi192.stdout:(35/152): ceph-volume-19.0.0-3267.gbc94a2a9.el9 3.5 MB/s | 273 kB 00:00 2024-04-26T18:22:36.585 INFO:teuthology.orchestra.run.smithi080.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 39 kB/s | 22 kB 00:00 2024-04-26T18:22:36.667 INFO:teuthology.orchestra.run.smithi192.stdout:(36/152): cephadm-19.0.0-3267.gbc94a2a9.el9.noa 6.0 MB/s | 762 kB 00:00 2024-04-26T18:22:36.725 INFO:teuthology.orchestra.run.smithi192.stdout:(37/152): cephfs-top-19.0.0-3267.gbc94a2a9.el9. 313 kB/s | 18 kB 00:00 2024-04-26T18:22:36.859 INFO:teuthology.orchestra.run.smithi192.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 602 kB/s | 80 kB 00:00 2024-04-26T18:22:36.860 INFO:teuthology.orchestra.run.smithi080.stdout:(103/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.9 MB/s | 548 kB 00:00 2024-04-26T18:22:36.927 INFO:teuthology.orchestra.run.smithi080.stdout:(104/152): gperftools-libs-2.9.1-2.el9.x86_64.r 4.5 MB/s | 309 kB 00:00 2024-04-26T18:22:36.976 INFO:teuthology.orchestra.run.smithi192.stdout:(39/152): libgfortran-11.4.1-3.el9.x86_64.rpm 6.7 MB/s | 803 kB 00:00 2024-04-26T18:22:36.977 INFO:teuthology.orchestra.run.smithi080.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 387 kB/s | 19 kB 00:00 2024-04-26T18:22:37.026 INFO:teuthology.orchestra.run.smithi192.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2024-04-26T18:22:37.161 INFO:teuthology.orchestra.run.smithi080.stdout:(106/152): libarrow-9.0.0-11.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2024-04-26T18:22:37.211 INFO:teuthology.orchestra.run.smithi080.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 520 kB/s | 26 kB 00:00 2024-04-26T18:22:37.226 INFO:teuthology.orchestra.run.smithi192.stdout:(41/152): ceph-common-19.0.0-3267.gbc94a2a9.el9 2.2 MB/s | 21 MB 00:09 2024-04-26T18:22:37.251 INFO:teuthology.orchestra.run.smithi192.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-04-26T18:22:37.261 INFO:teuthology.orchestra.run.smithi080.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 966 kB/s | 49 kB 00:00 2024-04-26T18:22:37.302 INFO:teuthology.orchestra.run.smithi192.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-04-26T18:22:37.312 INFO:teuthology.orchestra.run.smithi080.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-04-26T18:22:37.352 INFO:teuthology.orchestra.run.smithi192.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-04-26T18:22:37.370 INFO:teuthology.orchestra.run.smithi080.stdout:(110/152): luarocks-3.9.2-1.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-04-26T18:22:37.402 INFO:teuthology.orchestra.run.smithi192.stdout:(45/152): python3-requests-2.25.1-8.el9.noarch. 2.5 MB/s | 125 kB 00:00 2024-04-26T18:22:37.429 INFO:teuthology.orchestra.run.smithi080.stdout:(111/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-04-26T18:22:37.488 INFO:teuthology.orchestra.run.smithi080.stdout:(112/152): protobuf-compiler-3.14.0-13.el9.x86_ 598 kB/s | 863 kB 00:01 2024-04-26T18:22:37.513 INFO:teuthology.orchestra.run.smithi080.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-04-26T18:22:37.564 INFO:teuthology.orchestra.run.smithi080.stdout:(114/152): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-04-26T18:22:37.613 INFO:teuthology.orchestra.run.smithi080.stdout:(115/152): python3-certifi-2021.10.8-2.el9.noar 301 kB/s | 15 kB 00:00 2024-04-26T18:22:37.639 INFO:teuthology.orchestra.run.smithi080.stdout:(116/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 288 kB/s | 43 kB 00:00 2024-04-26T18:22:37.673 INFO:teuthology.orchestra.run.smithi080.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-04-26T18:22:37.731 INFO:teuthology.orchestra.run.smithi080.stdout:(118/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-04-26T18:22:37.781 INFO:teuthology.orchestra.run.smithi080.stdout:(119/152): python3-colorama-0.4.4-12.el9.noarch 706 kB/s | 35 kB 00:00 2024-04-26T18:22:37.807 INFO:teuthology.orchestra.run.smithi080.stdout:(120/152): python3-cherrypy-18.6.1-2.el9.noarch 2.1 MB/s | 358 kB 00:00 2024-04-26T18:22:37.836 INFO:teuthology.orchestra.run.smithi192.stdout:(46/152): ceph-test-19.0.0-3267.gbc94a2a9.el9.x 9.4 MB/s | 49 MB 00:05 2024-04-26T18:22:37.840 INFO:teuthology.orchestra.run.smithi080.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 3.4 MB/s | 206 kB 00:00 2024-04-26T18:22:37.861 INFO:teuthology.orchestra.run.smithi192.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 468 kB/s | 215 kB 00:00 2024-04-26T18:22:37.895 INFO:teuthology.orchestra.run.smithi192.stdout:(48/152): python3-cryptography-36.0.1-4.el9.x86 1.8 MB/s | 1.2 MB 00:00 2024-04-26T18:22:37.899 INFO:teuthology.orchestra.run.smithi080.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-04-26T18:22:37.932 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-04-26T18:22:37.945 INFO:teuthology.orchestra.run.smithi192.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 11 MB/s | 943 kB 00:00 2024-04-26T18:22:37.949 INFO:teuthology.orchestra.run.smithi080.stdout:(123/152): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2024-04-26T18:22:37.971 INFO:teuthology.orchestra.run.smithi192.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-04-26T18:22:37.991 INFO:teuthology.orchestra.run.smithi080.stdout:(124/152): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-04-26T18:22:37.996 INFO:teuthology.orchestra.run.smithi192.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 429 kB/s | 21 kB 00:00 2024-04-26T18:22:38.016 INFO:teuthology.orchestra.run.smithi080.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 265 kB/s | 18 kB 00:00 2024-04-26T18:22:38.021 INFO:teuthology.orchestra.run.smithi192.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-04-26T18:22:38.041 INFO:teuthology.orchestra.run.smithi080.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-04-26T18:22:38.046 INFO:teuthology.orchestra.run.smithi192.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 656 kB/s | 33 kB 00:00 2024-04-26T18:22:38.067 INFO:teuthology.orchestra.run.smithi080.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-04-26T18:22:38.088 INFO:teuthology.orchestra.run.smithi192.stdout:(54/152): automake-1.16.2-8.el9.noarch.rpm 2.7 MB/s | 689 kB 00:00 2024-04-26T18:22:38.092 INFO:teuthology.orchestra.run.smithi080.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-04-26T18:22:38.105 INFO:teuthology.orchestra.run.smithi192.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 310 kB/s | 18 kB 00:00 2024-04-26T18:22:38.164 INFO:teuthology.orchestra.run.smithi192.stdout:(56/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2024-04-26T18:22:38.181 INFO:teuthology.orchestra.run.smithi192.stdout:(57/152): libaio-devel-0.3.111-13.el9.x86_64.rp 121 kB/s | 11 kB 00:00 2024-04-26T18:22:38.206 INFO:teuthology.orchestra.run.smithi192.stdout:(58/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-04-26T18:22:38.223 INFO:teuthology.orchestra.run.smithi192.stdout:(59/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 770 kB/s | 45 kB 00:00 2024-04-26T18:22:38.265 INFO:teuthology.orchestra.run.smithi192.stdout:(60/152): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-04-26T18:22:38.299 INFO:teuthology.orchestra.run.smithi192.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 338 kB/s | 25 kB 00:00 2024-04-26T18:22:38.315 INFO:teuthology.orchestra.run.smithi192.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-04-26T18:22:38.341 INFO:teuthology.orchestra.run.smithi192.stdout:(63/152): libtool-2.4.6-45.el9.x86_64.rpm 4.2 MB/s | 582 kB 00:00 2024-04-26T18:22:38.366 INFO:teuthology.orchestra.run.smithi192.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 292 kB 00:00 2024-04-26T18:22:38.391 INFO:teuthology.orchestra.run.smithi192.stdout:(65/152): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-04-26T18:22:38.417 INFO:teuthology.orchestra.run.smithi192.stdout:(66/152): openblas-0.3.21-2.el9.x86_64.rpm 466 kB/s | 35 kB 00:00 2024-04-26T18:22:38.517 INFO:teuthology.orchestra.run.smithi192.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 32 MB/s | 4.7 MB 00:00 2024-04-26T18:22:38.526 INFO:teuthology.orchestra.run.smithi080.stdout:(129/152): ceph-test-19.0.0-3267.gbc94a2a9.el9. 5.1 MB/s | 49 MB 00:09 2024-04-26T18:22:38.551 INFO:teuthology.orchestra.run.smithi080.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 101 kB/s | 46 kB 00:00 2024-04-26T18:22:38.567 INFO:teuthology.orchestra.run.smithi192.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-26T18:22:38.585 INFO:teuthology.orchestra.run.smithi080.stdout:(131/152): python3-kubernetes-26.1.0-2.el9.noar 2.0 MB/s | 1.0 MB 00:00 2024-04-26T18:22:38.609 INFO:teuthology.orchestra.run.smithi192.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 9.7 MB/s | 911 kB 00:00 2024-04-26T18:22:38.610 INFO:teuthology.orchestra.run.smithi080.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 984 kB/s | 58 kB 00:00 2024-04-26T18:22:38.634 INFO:teuthology.orchestra.run.smithi192.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-04-26T18:22:38.643 INFO:teuthology.orchestra.run.smithi080.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-04-26T18:22:38.669 INFO:teuthology.orchestra.run.smithi080.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-04-26T18:22:38.701 INFO:teuthology.orchestra.run.smithi192.stdout:(71/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-04-26T18:22:38.702 INFO:teuthology.orchestra.run.smithi080.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-04-26T18:22:38.735 INFO:teuthology.orchestra.run.smithi192.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-04-26T18:22:38.752 INFO:teuthology.orchestra.run.smithi192.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-04-26T18:22:38.752 INFO:teuthology.orchestra.run.smithi080.stdout:(136/152): python3-more-itertools-8.12.0-2.el9. 348 kB/s | 79 kB 00:00 2024-04-26T18:22:38.786 INFO:teuthology.orchestra.run.smithi080.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 241 kB/s | 28 kB 00:00 2024-04-26T18:22:38.811 INFO:teuthology.orchestra.run.smithi192.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 4.1 MB/s | 244 kB 00:00 2024-04-26T18:22:38.812 INFO:teuthology.orchestra.run.smithi080.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 282 kB/s | 31 kB 00:00 2024-04-26T18:22:38.837 INFO:teuthology.orchestra.run.smithi080.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-04-26T18:22:38.862 INFO:teuthology.orchestra.run.smithi080.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 785 kB/s | 59 kB 00:00 2024-04-26T18:22:38.886 INFO:teuthology.orchestra.run.smithi192.stdout:(75/152): postgresql-server-13.14-1.el9.x86_64. 21 MB/s | 5.8 MB 00:00 2024-04-26T18:22:38.888 INFO:teuthology.orchestra.run.smithi080.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 472 kB/s | 36 kB 00:00 2024-04-26T18:22:38.911 INFO:teuthology.orchestra.run.smithi192.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-04-26T18:22:38.913 INFO:teuthology.orchestra.run.smithi080.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2024-04-26T18:22:38.930 INFO:teuthology.orchestra.run.smithi080.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-04-26T18:22:38.936 INFO:teuthology.orchestra.run.smithi192.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-04-26T18:22:38.961 INFO:teuthology.orchestra.run.smithi192.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-04-26T18:22:38.972 INFO:teuthology.orchestra.run.smithi080.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 7.1 MB/s | 427 kB 00:00 2024-04-26T18:22:38.987 INFO:teuthology.orchestra.run.smithi192.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-04-26T18:22:38.997 INFO:teuthology.orchestra.run.smithi080.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 299 kB/s | 20 kB 00:00 2024-04-26T18:22:39.013 INFO:teuthology.orchestra.run.smithi192.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 686 kB/s | 35 kB 00:00 2024-04-26T18:22:39.022 INFO:teuthology.orchestra.run.smithi080.stdout:(146/152): python3-webob-1.8.7-6.el9.noarch.rpm 1.4 MB/s | 230 kB 00:00 2024-04-26T18:22:39.047 INFO:teuthology.orchestra.run.smithi080.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-04-26T18:22:39.071 INFO:teuthology.orchestra.run.smithi192.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-04-26T18:22:39.089 INFO:teuthology.orchestra.run.smithi080.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-04-26T18:22:39.146 INFO:teuthology.orchestra.run.smithi192.stdout:(82/152): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-04-26T18:22:39.171 INFO:teuthology.orchestra.run.smithi192.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-04-26T18:22:39.188 INFO:teuthology.orchestra.run.smithi192.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-04-26T18:22:39.255 INFO:teuthology.orchestra.run.smithi192.stdout:(85/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 5.1 MB 00:00 2024-04-26T18:22:39.280 INFO:teuthology.orchestra.run.smithi192.stdout:(86/152): python3-prettytable-0.7.2-27.el9.noar 389 kB/s | 42 kB 00:00 2024-04-26T18:22:39.306 INFO:teuthology.orchestra.run.smithi192.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-26T18:22:39.331 INFO:teuthology.orchestra.run.smithi192.stdout:(88/152): python3-protobuf-3.14.0-13.el9.noarch 1.8 MB/s | 269 kB 00:00 2024-04-26T18:22:39.356 INFO:teuthology.orchestra.run.smithi192.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-26T18:22:39.381 INFO:teuthology.orchestra.run.smithi192.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-26T18:22:39.407 INFO:teuthology.orchestra.run.smithi080.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 4.3 MB/s | 1.3 MB 00:00 2024-04-26T18:22:39.407 INFO:teuthology.orchestra.run.smithi192.stdout:(91/152): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-04-26T18:22:39.440 INFO:teuthology.orchestra.run.smithi192.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 711 kB/s | 42 kB 00:00 2024-04-26T18:22:39.466 INFO:teuthology.orchestra.run.smithi192.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 753 kB/s | 44 kB 00:00 2024-04-26T18:22:39.491 INFO:teuthology.orchestra.run.smithi192.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-04-26T18:22:39.515 INFO:teuthology.orchestra.run.smithi080.stdout:(150/152): librados2-19.0.0-3267.gbc94a2a9.el9. 6.9 MB/s | 3.4 MB 00:00 2024-04-26T18:22:39.516 INFO:teuthology.orchestra.run.smithi192.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 709 kB/s | 36 kB 00:00 2024-04-26T18:22:39.533 INFO:teuthology.orchestra.run.smithi192.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-04-26T18:22:39.567 INFO:teuthology.orchestra.run.smithi192.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-04-26T18:22:39.584 INFO:teuthology.orchestra.run.smithi192.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-04-26T18:22:39.609 INFO:teuthology.orchestra.run.smithi192.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 2.2 MB/s | 94 kB 00:00 2024-04-26T18:22:39.626 INFO:teuthology.orchestra.run.smithi192.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-04-26T18:22:39.640 INFO:teuthology.orchestra.run.smithi080.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 10 MB/s | 2.4 MB 00:00 2024-04-26T18:22:39.651 INFO:teuthology.orchestra.run.smithi192.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-04-26T18:22:39.691 INFO:teuthology.orchestra.run.smithi080.stdout:(152/152): librbd1-19.0.0-3267.gbc94a2a9.el9.x8 4.9 MB/s | 3.1 MB 00:00 2024-04-26T18:22:39.694 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-04-26T18:22:39.694 INFO:teuthology.orchestra.run.smithi080.stdout:Total 16 MB/s | 222 MB 00:13 2024-04-26T18:22:39.819 INFO:teuthology.orchestra.run.smithi192.stdout:(102/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-04-26T18:22:39.844 INFO:teuthology.orchestra.run.smithi192.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 103 kB/s | 22 kB 00:00 2024-04-26T18:22:40.059 INFO:teuthology.orchestra.run.smithi082.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T18:22:40.060 INFO:teuthology.orchestra.run.smithi082.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T18:22:40.070 INFO:teuthology.orchestra.run.smithi082.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T18:22:40.071 INFO:teuthology.orchestra.run.smithi082.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T18:22:40.072 INFO:teuthology.orchestra.run.smithi082.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T18:22:40.073 INFO:teuthology.orchestra.run.smithi082.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T18:22:40.074 INFO:teuthology.orchestra.run.smithi082.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T18:22:40.076 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T18:22:40.077 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T18:22:40.086 INFO:teuthology.orchestra.run.smithi192.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-04-26T18:22:40.137 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-26T18:22:40.156 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-04-26T18:22:40.156 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-04-26T18:22:40.156 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-04-26T18:22:40.156 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-04-26T18:22:40.156 INFO:teuthology.orchestra.run.smithi082.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T18:22:40.156 INFO:teuthology.orchestra.run.smithi082.stdout: ceph x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 6.6 k 2024-04-26T18:22:40.156 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T18:22:40.157 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 890 k 2024-04-26T18:22:40.157 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 145 k 2024-04-26T18:22:40.157 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 1.5 M 2024-04-26T18:22:40.157 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 142 k 2024-04-26T18:22:40.157 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 3.5 M 2024-04-26T18:22:40.157 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 7.4 M 2024-04-26T18:22:40.157 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 49 k 2024-04-26T18:22:40.157 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 11 M 2024-04-26T18:22:40.157 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 49 M 2024-04-26T18:22:40.157 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 273 k 2024-04-26T18:22:40.157 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 762 k 2024-04-26T18:22:40.157 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 224 k 2024-04-26T18:22:40.157 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-shell x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 27 k 2024-04-26T18:22:40.157 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 18 k 2024-04-26T18:22:40.157 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T18:22:40.158 INFO:teuthology.orchestra.run.smithi082.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T18:22:40.158 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T18:22:40.158 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 32 k 2024-04-26T18:22:40.158 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 746 k 2024-04-26T18:22:40.158 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 127 k 2024-04-26T18:22:40.158 INFO:teuthology.orchestra.run.smithi082.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T18:22:40.158 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T18:22:40.158 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T18:22:40.158 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T18:22:40.158 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T18:22:40.158 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T18:22:40.158 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 162 k 2024-04-26T18:22:40.158 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 320 k 2024-04-26T18:22:40.158 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 298 k 2024-04-26T18:22:40.159 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 99 k 2024-04-26T18:22:40.159 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 85 k 2024-04-26T18:22:40.159 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T18:22:40.159 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 170 k 2024-04-26T18:22:40.159 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T18:22:40.159 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2024-04-26T18:22:40.159 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.4 M 2024-04-26T18:22:40.159 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T18:22:40.159 INFO:teuthology.orchestra.run.smithi082.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T18:22:40.159 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T18:22:40.159 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-04-26T18:22:40.159 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T18:22:40.159 INFO:teuthology.orchestra.run.smithi082.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T18:22:40.160 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T18:22:40.160 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 21 M 2024-04-26T18:22:40.160 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 34 k 2024-04-26T18:22:40.160 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 2.4 M 2024-04-26T18:22:40.160 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 249 k 2024-04-26T18:22:40.160 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 4.7 M 2024-04-26T18:22:40.160 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 17 M 2024-04-26T18:22:40.160 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 16 k 2024-04-26T18:22:40.160 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 25 k 2024-04-26T18:22:40.160 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T18:22:40.160 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T18:22:40.160 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T18:22:40.160 INFO:teuthology.orchestra.run.smithi082.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T18:22:40.160 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T18:22:40.161 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T18:22:40.161 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T18:22:40.161 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T18:22:40.161 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 163 k 2024-04-26T18:22:40.161 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T18:22:40.161 INFO:teuthology.orchestra.run.smithi082.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T18:22:40.161 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T18:22:40.161 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T18:22:40.161 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T18:22:40.161 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 501 k 2024-04-26T18:22:40.161 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T18:22:40.161 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T18:22:40.161 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T18:22:40.161 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T18:22:40.161 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T18:22:40.162 INFO:teuthology.orchestra.run.smithi082.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T18:22:40.162 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T18:22:40.162 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T18:22:40.162 INFO:teuthology.orchestra.run.smithi082.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T18:22:40.162 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T18:22:40.162 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T18:22:40.162 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T18:22:40.162 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T18:22:40.162 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T18:22:40.162 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T18:22:40.162 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T18:22:40.162 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T18:22:40.162 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T18:22:40.162 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T18:22:40.163 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 45 k 2024-04-26T18:22:40.163 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 135 k 2024-04-26T18:22:40.163 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T18:22:40.163 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T18:22:40.163 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T18:22:40.163 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T18:22:40.163 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T18:22:40.163 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T18:22:40.163 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T18:22:40.163 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T18:22:40.163 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T18:22:40.163 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T18:22:40.163 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T18:22:40.163 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T18:22:40.163 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T18:22:40.163 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T18:22:40.164 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T18:22:40.164 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T18:22:40.164 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T18:22:40.164 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T18:22:40.164 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T18:22:40.164 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T18:22:40.164 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T18:22:40.164 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T18:22:40.164 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T18:22:40.164 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T18:22:40.164 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T18:22:40.164 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T18:22:40.164 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T18:22:40.164 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T18:22:40.164 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T18:22:40.165 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T18:22:40.165 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T18:22:40.165 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T18:22:40.165 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T18:22:40.165 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T18:22:40.165 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T18:22:40.165 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T18:22:40.165 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T18:22:40.165 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T18:22:40.165 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T18:22:40.165 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T18:22:40.165 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T18:22:40.165 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T18:22:40.166 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T18:22:40.166 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T18:22:40.166 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T18:22:40.166 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T18:22:40.166 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T18:22:40.166 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T18:22:40.166 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T18:22:40.166 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T18:22:40.166 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T18:22:40.166 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T18:22:40.166 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T18:22:40.166 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T18:22:40.166 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T18:22:40.166 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T18:22:40.167 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T18:22:40.167 INFO:teuthology.orchestra.run.smithi082.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T18:22:40.167 INFO:teuthology.orchestra.run.smithi082.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T18:22:40.167 INFO:teuthology.orchestra.run.smithi082.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T18:22:40.167 INFO:teuthology.orchestra.run.smithi082.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T18:22:40.167 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T18:22:40.167 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T18:22:40.167 INFO:teuthology.orchestra.run.smithi082.stdout:Installing weak dependencies: 2024-04-26T18:22:40.167 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T18:22:40.167 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T18:22:40.167 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-04-26T18:22:40.167 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-04-26T18:22:40.167 INFO:teuthology.orchestra.run.smithi082.stdout:Install 148 Packages 2024-04-26T18:22:40.167 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 4 Packages 2024-04-26T18:22:40.167 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T18:22:40.168 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 222 M 2024-04-26T18:22:40.168 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-04-26T18:22:40.261 INFO:teuthology.orchestra.run.smithi192.stdout:(105/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.2 MB/s | 548 kB 00:00 2024-04-26T18:22:40.286 INFO:teuthology.orchestra.run.smithi192.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 698 kB/s | 309 kB 00:00 2024-04-26T18:22:40.328 INFO:teuthology.orchestra.run.smithi192.stdout:(107/152): grpc-data-1.46.7-10.el9.noarch.rpm 80 kB/s | 19 kB 00:00 2024-04-26T18:22:40.362 INFO:teuthology.orchestra.run.smithi192.stdout:(108/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 344 kB/s | 26 kB 00:00 2024-04-26T18:22:40.437 INFO:teuthology.orchestra.run.smithi192.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 900 kB/s | 67 kB 00:00 2024-04-26T18:22:40.462 INFO:teuthology.orchestra.run.smithi192.stdout:(110/152): liboath-2.6.7-2.el9.x86_64.rpm 362 kB/s | 49 kB 00:00 2024-04-26T18:22:40.588 INFO:teuthology.orchestra.run.smithi192.stdout:(111/152): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-04-26T18:22:40.613 INFO:teuthology.orchestra.run.smithi192.stdout:(112/152): luarocks-3.9.2-1.el9.noarch.rpm 861 kB/s | 151 kB 00:00 2024-04-26T18:22:40.663 INFO:teuthology.orchestra.run.smithi192.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-04-26T18:22:40.688 INFO:teuthology.orchestra.run.smithi192.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 577 kB/s | 43 kB 00:00 2024-04-26T18:22:40.730 INFO:teuthology.orchestra.run.smithi192.stdout:(115/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.1 MB/s | 839 kB 00:00 2024-04-26T18:22:40.755 INFO:teuthology.orchestra.run.smithi192.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 349 kB/s | 32 kB 00:00 2024-04-26T18:22:40.781 INFO:teuthology.orchestra.run.smithi192.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 163 kB/s | 15 kB 00:00 2024-04-26T18:22:40.798 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-04-26T18:22:40.806 INFO:teuthology.orchestra.run.smithi192.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-04-26T18:22:40.839 INFO:teuthology.orchestra.run.smithi192.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-04-26T18:22:40.873 INFO:teuthology.orchestra.run.smithi192.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 527 kB/s | 35 kB 00:00 2024-04-26T18:22:40.898 INFO:teuthology.orchestra.run.smithi192.stdout:(121/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-04-26T18:22:40.924 INFO:teuthology.orchestra.run.smithi192.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 2.4 MB/s | 206 kB 00:00 2024-04-26T18:22:40.940 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-04-26T18:22:40.940 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-04-26T18:22:40.982 INFO:teuthology.orchestra.run.smithi192.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-04-26T18:22:41.007 INFO:teuthology.orchestra.run.smithi192.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-04-26T18:22:41.058 INFO:teuthology.orchestra.run.smithi192.stdout:(125/152): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-04-26T18:22:41.083 INFO:teuthology.orchestra.run.smithi192.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 175 kB/s | 18 kB 00:00 2024-04-26T18:22:41.109 INFO:teuthology.orchestra.run.smithi192.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 229 kB/s | 23 kB 00:00 2024-04-26T18:22:41.134 INFO:teuthology.orchestra.run.smithi192.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-04-26T18:22:41.176 INFO:teuthology.orchestra.run.smithi192.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 295 kB/s | 20 kB 00:00 2024-04-26T18:22:41.201 INFO:teuthology.orchestra.run.smithi192.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 691 kB/s | 46 kB 00:00 2024-04-26T18:22:41.225 INFO:teuthology.orchestra.run.smithi082.stdout:(1/152): ceph-19.0.0-3267.gbc94a2a9.el9.x86_64. 30 kB/s | 6.6 kB 00:00 2024-04-26T18:22:41.234 INFO:teuthology.orchestra.run.smithi192.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-04-26T18:22:41.276 INFO:teuthology.orchestra.run.smithi192.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 769 kB/s | 58 kB 00:00 2024-04-26T18:22:41.310 INFO:teuthology.orchestra.run.smithi192.stdout:(133/152): python3-kubernetes-26.1.0-2.el9.noar 5.1 MB/s | 1.0 MB 00:00 2024-04-26T18:22:41.335 INFO:teuthology.orchestra.run.smithi192.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-04-26T18:22:41.361 INFO:teuthology.orchestra.run.smithi192.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 196 kB/s | 16 kB 00:00 2024-04-26T18:22:41.386 INFO:teuthology.orchestra.run.smithi192.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-04-26T18:22:41.411 INFO:teuthology.orchestra.run.smithi192.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-04-26T18:22:41.436 INFO:teuthology.orchestra.run.smithi192.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-04-26T18:22:41.462 INFO:teuthology.orchestra.run.smithi192.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-26T18:22:41.487 INFO:teuthology.orchestra.run.smithi192.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 785 kB/s | 59 kB 00:00 2024-04-26T18:22:41.520 INFO:teuthology.orchestra.run.smithi192.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 426 kB/s | 36 kB 00:00 2024-04-26T18:22:41.542 INFO:teuthology.orchestra.run.smithi082.stdout:(2/152): ceph-fuse-19.0.0-3267.gbc94a2a9.el9.x8 2.7 MB/s | 890 kB 00:00 2024-04-26T18:22:41.546 INFO:teuthology.orchestra.run.smithi192.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 609 kB/s | 51 kB 00:00 2024-04-26T18:22:41.571 INFO:teuthology.orchestra.run.smithi192.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-04-26T18:22:41.596 INFO:teuthology.orchestra.run.smithi192.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-26T18:22:41.609 INFO:teuthology.orchestra.run.smithi082.stdout:(3/152): ceph-immutable-object-cache-19.0.0-326 2.1 MB/s | 145 kB 00:00 2024-04-26T18:22:41.630 INFO:teuthology.orchestra.run.smithi192.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-04-26T18:22:41.655 INFO:teuthology.orchestra.run.smithi192.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 238 kB/s | 20 kB 00:00 2024-04-26T18:22:41.680 INFO:teuthology.orchestra.run.smithi192.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-04-26T18:22:41.764 INFO:teuthology.orchestra.run.smithi192.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-04-26T18:22:41.964 INFO:teuthology.orchestra.run.smithi192.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 6.8 MB/s | 1.3 MB 00:00 2024-04-26T18:22:42.026 INFO:teuthology.orchestra.run.smithi082.stdout:(4/152): ceph-mds-19.0.0-3267.gbc94a2a9.el9.x86 5.7 MB/s | 2.4 MB 00:00 2024-04-26T18:22:42.065 INFO:teuthology.orchestra.run.smithi192.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-04-26T18:22:42.093 INFO:teuthology.orchestra.run.smithi082.stdout:(5/152): ceph-base-19.0.0-3267.gbc94a2a9.el9.x8 4.9 MB/s | 5.4 MB 00:01 2024-04-26T18:22:42.360 INFO:teuthology.orchestra.run.smithi082.stdout:(6/152): ceph-mgr-19.0.0-3267.gbc94a2a9.el9.x86 4.5 MB/s | 1.5 MB 00:00 2024-04-26T18:22:42.390 INFO:teuthology.orchestra.run.smithi192.stdout:(151/152): librbd1-19.0.0-3267.gbc94a2a9.el9.x8 4.4 MB/s | 3.1 MB 00:00 2024-04-26T18:22:42.448 INFO:teuthology.orchestra.run.smithi192.stdout:(152/152): librados2-19.0.0-3267.gbc94a2a9.el9. 4.3 MB/s | 3.4 MB 00:00 2024-04-26T18:22:42.454 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-04-26T18:22:42.455 INFO:teuthology.orchestra.run.smithi192.stdout:Total 15 MB/s | 222 MB 00:15 2024-04-26T18:22:42.702 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-04-26T18:22:42.703 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-04-26T18:22:42.718 INFO:teuthology.orchestra.run.smithi082.stdout:(7/152): ceph-mon-19.0.0-3267.gbc94a2a9.el9.x86 7.5 MB/s | 4.7 MB 00:00 2024-04-26T18:22:43.577 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-04-26T18:22:43.718 INFO:teuthology.orchestra.run.smithi082.stdout:(8/152): ceph-common-19.0.0-3267.gbc94a2a9.el9. 7.8 MB/s | 21 MB 00:02 2024-04-26T18:22:43.728 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-04-26T18:22:43.728 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-04-26T18:22:43.802 INFO:teuthology.orchestra.run.smithi082.stdout:(9/152): ceph-selinux-19.0.0-3267.gbc94a2a9.el9 303 kB/s | 25 kB 00:00 2024-04-26T18:22:43.944 INFO:teuthology.orchestra.run.smithi082.stdout:(10/152): ceph-radosgw-19.0.0-3267.gbc94a2a9.el 8.6 MB/s | 11 MB 00:01 2024-04-26T18:22:44.052 INFO:teuthology.orchestra.run.smithi082.stdout:(11/152): cephfs-mirror-19.0.0-3267.gbc94a2a9.e 2.0 MB/s | 224 kB 00:00 2024-04-26T18:22:44.136 INFO:teuthology.orchestra.run.smithi082.stdout:(12/152): cephfs-shell-19.0.0-3267.gbc94a2a9.el 324 kB/s | 27 kB 00:00 2024-04-26T18:22:44.228 INFO:teuthology.orchestra.run.smithi082.stdout:(13/152): libcephfs-devel-19.0.0-3267.gbc94a2a9 346 kB/s | 32 kB 00:00 2024-04-26T18:22:44.420 INFO:teuthology.orchestra.run.smithi082.stdout:(14/152): ceph-osd-19.0.0-3267.gbc94a2a9.el9.x8 8.2 MB/s | 17 MB 00:02 2024-04-26T18:22:44.462 INFO:teuthology.orchestra.run.smithi082.stdout:(15/152): libcephfs2-19.0.0-3267.gbc94a2a9.el9. 3.1 MB/s | 746 kB 00:00 2024-04-26T18:22:44.495 INFO:teuthology.orchestra.run.smithi082.stdout:(16/152): libcephsqlite-19.0.0-3267.gbc94a2a9.e 2.1 MB/s | 163 kB 00:00 2024-04-26T18:22:44.554 INFO:teuthology.orchestra.run.smithi082.stdout:(17/152): librados-devel-19.0.0-3267.gbc94a2a9. 1.3 MB/s | 127 kB 00:00 2024-04-26T18:22:44.588 INFO:teuthology.orchestra.run.smithi082.stdout:(18/152): libradosstriper1-19.0.0-3267.gbc94a2a 5.3 MB/s | 501 kB 00:00 2024-04-26T18:22:44.663 INFO:teuthology.orchestra.run.smithi082.stdout:(19/152): python3-ceph-argparse-19.0.0-3267.gbc 603 kB/s | 45 kB 00:00 2024-04-26T18:22:44.747 INFO:teuthology.orchestra.run.smithi082.stdout:(20/152): python3-ceph-common-19.0.0-3267.gbc94 1.6 MB/s | 135 kB 00:00 2024-04-26T18:22:44.832 INFO:teuthology.orchestra.run.smithi082.stdout:(21/152): python3-cephfs-19.0.0-3267.gbc94a2a9. 1.9 MB/s | 162 kB 00:00 2024-04-26T18:22:44.933 INFO:teuthology.orchestra.run.smithi082.stdout:(22/152): python3-rados-19.0.0-3267.gbc94a2a9.e 3.1 MB/s | 320 kB 00:00 2024-04-26T18:22:45.025 INFO:teuthology.orchestra.run.smithi082.stdout:(23/152): python3-rbd-19.0.0-3267.gbc94a2a9.el9 3.2 MB/s | 298 kB 00:00 2024-04-26T18:22:45.100 INFO:teuthology.orchestra.run.smithi082.stdout:(24/152): librgw2-19.0.0-3267.gbc94a2a9.el9.x86 9.8 MB/s | 5.4 MB 00:00 2024-04-26T18:22:45.125 INFO:teuthology.orchestra.run.smithi082.stdout:(25/152): python3-rgw-19.0.0-3267.gbc94a2a9.el9 991 kB/s | 99 kB 00:00 2024-04-26T18:22:45.176 INFO:teuthology.orchestra.run.smithi082.stdout:(26/152): rbd-fuse-19.0.0-3267.gbc94a2a9.el9.x8 1.1 MB/s | 85 kB 00:00 2024-04-26T18:22:45.259 INFO:teuthology.orchestra.run.smithi082.stdout:(27/152): rbd-nbd-19.0.0-3267.gbc94a2a9.el9.x86 2.0 MB/s | 170 kB 00:00 2024-04-26T18:22:45.343 INFO:teuthology.orchestra.run.smithi082.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3267.g 411 kB/s | 34 kB 00:00 2024-04-26T18:22:45.418 INFO:teuthology.orchestra.run.smithi082.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3267.gbc94a2a 1.9 MB/s | 142 kB 00:00 2024-04-26T18:22:45.468 INFO:teuthology.orchestra.run.smithi082.stdout:(30/152): rbd-mirror-19.0.0-3267.gbc94a2a9.el9. 9.0 MB/s | 3.1 MB 00:00 2024-04-26T18:22:45.532 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-04-26T18:22:45.532 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-04-26T18:22:45.860 INFO:teuthology.orchestra.run.smithi082.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3267.gbc94a 8.0 MB/s | 3.5 MB 00:00 2024-04-26T18:22:45.952 INFO:teuthology.orchestra.run.smithi082.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3267.gbc 2.7 MB/s | 249 kB 00:00 2024-04-26T18:22:46.036 INFO:teuthology.orchestra.run.smithi082.stdout:(33/152): ceph-mgr-rook-19.0.0-3267.gbc94a2a9.e 592 kB/s | 49 kB 00:00 2024-04-26T18:22:46.119 INFO:teuthology.orchestra.run.smithi082.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3267.gb 197 kB/s | 16 kB 00:00 2024-04-26T18:22:46.219 INFO:teuthology.orchestra.run.smithi082.stdout:(35/152): ceph-volume-19.0.0-3267.gbc94a2a9.el9 2.7 MB/s | 273 kB 00:00 2024-04-26T18:22:46.337 INFO:teuthology.orchestra.run.smithi082.stdout:(36/152): ceph-mgr-diskprediction-local-19.0.0- 8.5 MB/s | 7.4 MB 00:00 2024-04-26T18:22:46.370 INFO:teuthology.orchestra.run.smithi082.stdout:(37/152): cephadm-19.0.0-3267.gbc94a2a9.el9.noa 5.0 MB/s | 762 kB 00:00 2024-04-26T18:22:46.420 INFO:teuthology.orchestra.run.smithi082.stdout:(38/152): cephfs-top-19.0.0-3267.gbc94a2a9.el9. 218 kB/s | 18 kB 00:00 2024-04-26T18:22:46.454 INFO:teuthology.orchestra.run.smithi082.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 961 kB/s | 80 kB 00:00 2024-04-26T18:22:46.529 INFO:teuthology.orchestra.run.smithi082.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2024-04-26T18:22:46.571 INFO:teuthology.orchestra.run.smithi082.stdout:(41/152): libgfortran-11.4.1-3.el9.x86_64.rpm 5.2 MB/s | 803 kB 00:00 2024-04-26T18:22:46.638 INFO:teuthology.orchestra.run.smithi082.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-04-26T18:22:46.697 INFO:teuthology.orchestra.run.smithi082.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-04-26T18:22:46.730 INFO:teuthology.orchestra.run.smithi082.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-04-26T18:22:46.772 INFO:teuthology.orchestra.run.smithi082.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-04-26T18:22:46.814 INFO:teuthology.orchestra.run.smithi082.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-04-26T18:22:46.865 INFO:teuthology.orchestra.run.smithi082.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-04-26T18:22:47.307 INFO:teuthology.orchestra.run.smithi082.stdout:(48/152): ceph-test-19.0.0-3267.gbc94a2a9.el9.x 14 MB/s | 49 MB 00:03 2024-04-26T18:22:47.357 INFO:teuthology.orchestra.run.smithi082.stdout:(49/152): automake-1.16.2-8.el9.noarch.rpm 1.2 MB/s | 689 kB 00:00 2024-04-26T18:22:47.394 INFO:teuthology.orchestra.run.smithi082.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 107 kB 00:00 2024-04-26T18:22:47.407 INFO:teuthology.orchestra.run.smithi082.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 429 kB/s | 21 kB 00:00 2024-04-26T18:22:47.449 INFO:teuthology.orchestra.run.smithi082.stdout:(52/152): bison-3.7.4-5.el9.x86_64.rpm 1.6 MB/s | 943 kB 00:00 2024-04-26T18:22:47.466 INFO:teuthology.orchestra.run.smithi082.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-04-26T18:22:47.500 INFO:teuthology.orchestra.run.smithi082.stdout:(54/152): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-04-26T18:22:47.542 INFO:teuthology.orchestra.run.smithi082.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 242 kB/s | 18 kB 00:00 2024-04-26T18:22:47.567 INFO:teuthology.orchestra.run.smithi082.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-04-26T18:22:47.676 INFO:teuthology.orchestra.run.smithi082.stdout:(57/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-04-26T18:22:47.701 INFO:teuthology.orchestra.run.smithi082.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 339 kB/s | 45 kB 00:00 2024-04-26T18:22:47.726 INFO:teuthology.orchestra.run.smithi082.stdout:(59/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 871 kB/s | 160 kB 00:00 2024-04-26T18:22:47.777 INFO:teuthology.orchestra.run.smithi082.stdout:(60/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 511 kB/s | 25 kB 00:00 2024-04-26T18:22:47.810 INFO:teuthology.orchestra.run.smithi082.stdout:(61/152): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-04-26T18:22:47.835 INFO:teuthology.orchestra.run.smithi082.stdout:(62/152): libtool-2.4.6-45.el9.x86_64.rpm 4.2 MB/s | 582 kB 00:00 2024-04-26T18:22:47.861 INFO:teuthology.orchestra.run.smithi082.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 567 kB/s | 47 kB 00:00 2024-04-26T18:22:47.911 INFO:teuthology.orchestra.run.smithi082.stdout:(64/152): openblas-0.3.21-2.el9.x86_64.rpm 708 kB/s | 35 kB 00:00 2024-04-26T18:22:47.936 INFO:teuthology.orchestra.run.smithi082.stdout:(65/152): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-04-26T18:22:47.961 INFO:teuthology.orchestra.run.smithi082.stdout:(66/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.9 MB/s | 292 kB 00:00 2024-04-26T18:22:48.095 INFO:teuthology.orchestra.run.smithi082.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-04-26T18:22:48.179 INFO:teuthology.orchestra.run.smithi082.stdout:(68/152): openblas-openmp-0.3.21-2.el9.x86_64.r 18 MB/s | 4.7 MB 00:00 2024-04-26T18:22:48.245 INFO:teuthology.orchestra.run.smithi082.stdout:(69/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-04-26T18:22:48.287 INFO:teuthology.orchestra.run.smithi082.stdout:(70/152): postgresql-contrib-13.14-1.el9.x86_64 4.6 MB/s | 911 kB 00:00 2024-04-26T18:22:48.312 INFO:teuthology.orchestra.run.smithi082.stdout:(71/152): postgresql-private-libs-13.14-1.el9.x 998 kB/s | 133 kB 00:00 2024-04-26T18:22:48.371 INFO:teuthology.orchestra.run.smithi082.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-26T18:22:48.430 INFO:teuthology.orchestra.run.smithi082.stdout:(73/152): protobuf-3.14.0-13.el9.x86_64.rpm 7.1 MB/s | 1.0 MB 00:00 2024-04-26T18:22:48.547 INFO:teuthology.orchestra.run.smithi082.stdout:(74/152): postgresql-server-13.14-1.el9.x86_64. 19 MB/s | 5.8 MB 00:00 2024-04-26T18:22:48.588 INFO:teuthology.orchestra.run.smithi082.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.5 MB/s | 244 kB 00:00 2024-04-26T18:22:48.639 INFO:teuthology.orchestra.run.smithi082.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-04-26T18:22:48.664 INFO:teuthology.orchestra.run.smithi082.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 341 kB/s | 26 kB 00:00 2024-04-26T18:22:48.706 INFO:teuthology.orchestra.run.smithi082.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 286 kB/s | 19 kB 00:00 2024-04-26T18:22:48.748 INFO:teuthology.orchestra.run.smithi082.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-04-26T18:22:48.773 INFO:teuthology.orchestra.run.smithi082.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 519 kB/s | 35 kB 00:00 2024-04-26T18:22:48.849 INFO:teuthology.orchestra.run.smithi082.stdout:(81/152): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-04-26T18:22:48.878 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-04-26T18:22:48.916 INFO:teuthology.orchestra.run.smithi082.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 250 kB 00:00 2024-04-26T18:22:48.958 INFO:teuthology.orchestra.run.smithi082.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-04-26T18:22:48.969 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T18:22:49.015 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T18:22:49.016 INFO:teuthology.orchestra.run.smithi082.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 769 kB/s | 77 kB 00:00 2024-04-26T18:22:49.041 INFO:teuthology.orchestra.run.smithi082.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 507 kB/s | 42 kB 00:00 2024-04-26T18:22:49.068 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T18:22:49.108 INFO:teuthology.orchestra.run.smithi082.stdout:(86/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-04-26T18:22:49.112 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T18:22:49.137 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T18:22:49.159 INFO:teuthology.orchestra.run.smithi082.stdout:(87/152): python3-protobuf-3.14.0-13.el9.noarch 1.9 MB/s | 269 kB 00:00 2024-04-26T18:22:49.180 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T18:22:49.184 INFO:teuthology.orchestra.run.smithi082.stdout:(88/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-04-26T18:22:49.209 INFO:teuthology.orchestra.run.smithi082.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-04-26T18:22:49.226 INFO:teuthology.orchestra.run.smithi082.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 758 kB/s | 51 kB 00:00 2024-04-26T18:22:49.251 INFO:teuthology.orchestra.run.smithi082.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 801 kB/s | 54 kB 00:00 2024-04-26T18:22:49.293 INFO:teuthology.orchestra.run.smithi082.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 624 kB/s | 42 kB 00:00 2024-04-26T18:22:49.310 INFO:teuthology.orchestra.run.smithi082.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 755 kB/s | 44 kB 00:00 2024-04-26T18:22:49.352 INFO:teuthology.orchestra.run.smithi082.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 863 kB/s | 36 kB 00:00 2024-04-26T18:22:49.386 INFO:teuthology.orchestra.run.smithi082.stdout:(95/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-04-26T18:22:49.436 INFO:teuthology.orchestra.run.smithi082.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 567 kB/s | 47 kB 00:00 2024-04-26T18:22:49.486 INFO:teuthology.orchestra.run.smithi082.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 305 kB 00:00 2024-04-26T18:22:49.508 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T18:22:49.511 INFO:teuthology.orchestra.run.smithi082.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 767 kB/s | 58 kB 00:00 2024-04-26T18:22:49.562 INFO:teuthology.orchestra.run.smithi082.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.2 MB/s | 94 kB 00:00 2024-04-26T18:22:49.587 INFO:teuthology.orchestra.run.smithi082.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 844 kB/s | 64 kB 00:00 2024-04-26T18:22:49.630 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T18:22:49.646 INFO:teuthology.orchestra.run.smithi082.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 535 kB/s | 45 kB 00:00 2024-04-26T18:22:49.752 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T18:22:49.781 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T18:22:49.863 INFO:teuthology.orchestra.run.smithi082.stdout:(102/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-04-26T18:22:49.871 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T18:22:49.888 INFO:teuthology.orchestra.run.smithi082.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 74 kB/s | 22 kB 00:00 2024-04-26T18:22:49.910 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T18:22:49.988 INFO:teuthology.orchestra.run.smithi082.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-04-26T18:22:50.062 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T18:22:50.107 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T18:22:50.130 INFO:teuthology.orchestra.run.smithi082.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 137 kB/s | 19 kB 00:00 2024-04-26T18:22:50.135 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T18:22:50.164 INFO:teuthology.orchestra.run.smithi082.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 1.1 MB/s | 309 kB 00:00 2024-04-26T18:22:50.206 INFO:teuthology.orchestra.run.smithi082.stdout:(107/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.6 MB/s | 548 kB 00:00 2024-04-26T18:22:50.231 INFO:teuthology.orchestra.run.smithi082.stdout:(108/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 389 kB/s | 26 kB 00:00 2024-04-26T18:22:50.239 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T18:22:50.262 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T18:22:50.273 INFO:teuthology.orchestra.run.smithi082.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 729 kB/s | 49 kB 00:00 2024-04-26T18:22:50.298 INFO:teuthology.orchestra.run.smithi082.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-04-26T18:22:50.324 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T18:22:50.332 INFO:teuthology.orchestra.run.smithi082.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-04-26T18:22:50.345 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T18:22:50.364 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T18:22:50.415 INFO:teuthology.orchestra.run.smithi082.stdout:(112/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-04-26T18:22:50.441 INFO:teuthology.orchestra.run.smithi082.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-04-26T18:22:50.483 INFO:teuthology.orchestra.run.smithi082.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 649 kB/s | 43 kB 00:00 2024-04-26T18:22:50.508 INFO:teuthology.orchestra.run.smithi082.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 482 kB/s | 32 kB 00:00 2024-04-26T18:22:50.553 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T18:22:50.587 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T18:22:50.617 INFO:teuthology.orchestra.run.smithi082.stdout:(116/152): libarrow-9.0.0-11.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2024-04-26T18:22:50.642 INFO:teuthology.orchestra.run.smithi082.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 94 kB/s | 15 kB 00:00 2024-04-26T18:22:50.667 INFO:teuthology.orchestra.run.smithi082.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.1 MB/s | 172 kB 00:00 2024-04-26T18:22:50.692 INFO:teuthology.orchestra.run.smithi082.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-04-26T18:22:50.695 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T18:22:50.718 INFO:teuthology.orchestra.run.smithi082.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-04-26T18:22:50.743 INFO:teuthology.orchestra.run.smithi082.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 468 kB/s | 35 kB 00:00 2024-04-26T18:22:50.768 INFO:teuthology.orchestra.run.smithi082.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-04-26T18:22:50.793 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T18:22:50.818 INFO:teuthology.orchestra.run.smithi082.stdout:(123/152): python3-grpcio-1.46.7-10.el9.x86_64. 20 MB/s | 2.0 MB 00:00 2024-04-26T18:22:50.828 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T18:22:50.844 INFO:teuthology.orchestra.run.smithi082.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-04-26T18:22:50.863 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T18:22:50.869 INFO:teuthology.orchestra.run.smithi082.stdout:(125/152): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-04-26T18:22:50.894 INFO:teuthology.orchestra.run.smithi082.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 234 kB/s | 18 kB 00:00 2024-04-26T18:22:50.920 INFO:teuthology.orchestra.run.smithi082.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 307 kB/s | 23 kB 00:00 2024-04-26T18:22:50.937 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T18:22:50.945 INFO:teuthology.orchestra.run.smithi082.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 257 kB/s | 19 kB 00:00 2024-04-26T18:22:50.970 INFO:teuthology.orchestra.run.smithi082.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-04-26T18:22:50.971 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T18:22:51.004 INFO:teuthology.orchestra.run.smithi082.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-04-26T18:22:51.023 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T18:22:51.029 INFO:teuthology.orchestra.run.smithi082.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 552 kB/s | 46 kB 00:00 2024-04-26T18:22:51.054 INFO:teuthology.orchestra.run.smithi082.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 941 kB/s | 79 kB 00:00 2024-04-26T18:22:51.055 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T18:22:51.079 INFO:teuthology.orchestra.run.smithi082.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 765 kB/s | 58 kB 00:00 2024-04-26T18:22:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T18:22:51.105 INFO:teuthology.orchestra.run.smithi082.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-26T18:22:51.130 INFO:teuthology.orchestra.run.smithi082.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-04-26T18:22:51.155 INFO:teuthology.orchestra.run.smithi082.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-04-26T18:22:51.162 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T18:22:51.172 INFO:teuthology.orchestra.run.smithi082.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 422 kB/s | 28 kB 00:00 2024-04-26T18:22:51.189 INFO:teuthology.orchestra.run.smithi082.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 523 kB/s | 31 kB 00:00 2024-04-26T18:22:51.222 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T18:22:51.223 INFO:teuthology.orchestra.run.smithi082.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 2.7 MB/s | 188 kB 00:00 2024-04-26T18:22:51.240 INFO:teuthology.orchestra.run.smithi082.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 880 kB/s | 59 kB 00:00 2024-04-26T18:22:51.253 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T18:22:51.257 INFO:teuthology.orchestra.run.smithi082.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 532 kB/s | 36 kB 00:00 2024-04-26T18:22:51.282 INFO:teuthology.orchestra.run.smithi082.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 864 kB/s | 51 kB 00:00 2024-04-26T18:22:51.297 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T18:22:51.307 INFO:teuthology.orchestra.run.smithi082.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 3.3 MB/s | 230 kB 00:00 2024-04-26T18:22:51.333 INFO:teuthology.orchestra.run.smithi082.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-26T18:22:51.358 INFO:teuthology.orchestra.run.smithi082.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-04-26T18:22:51.374 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T18:22:51.383 INFO:teuthology.orchestra.run.smithi082.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 265 kB/s | 20 kB 00:00 2024-04-26T18:22:51.407 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 31/156 2024-04-26T18:22:51.417 INFO:teuthology.orchestra.run.smithi082.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-04-26T18:22:51.451 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 32/156 2024-04-26T18:22:51.459 INFO:teuthology.orchestra.run.smithi082.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-04-26T18:22:51.479 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 33/156 2024-04-26T18:22:51.558 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T18:22:51.567 INFO:teuthology.orchestra.run.smithi082.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 12 MB/s | 1.3 MB 00:00 2024-04-26T18:22:51.603 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T18:22:51.649 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-04-26T18:22:51.677 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T18:22:51.701 INFO:teuthology.orchestra.run.smithi082.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 18 MB/s | 2.4 MB 00:00 2024-04-26T18:22:51.736 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T18:22:51.774 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T18:22:51.813 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T18:22:51.835 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T18:22:51.843 INFO:teuthology.orchestra.run.smithi082.stdout:(151/152): librados2-19.0.0-3267.gbc94a2a9.el9. 7.4 MB/s | 3.4 MB 00:00 2024-04-26T18:22:51.863 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T18:22:51.869 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T18:22:51.895 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T18:22:51.901 INFO:teuthology.orchestra.run.smithi082.stdout:(152/152): librbd1-19.0.0-3267.gbc94a2a9.el9.x8 6.5 MB/s | 3.1 MB 00:00 2024-04-26T18:22:51.904 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-26T18:22:51.904 INFO:teuthology.orchestra.run.smithi082.stdout:Total 19 MB/s | 222 MB 00:11 2024-04-26T18:22:51.937 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T18:22:52.256 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T18:22:52.363 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T18:22:52.395 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T18:22:52.484 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T18:22:52.514 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T18:22:52.567 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T18:22:52.596 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T18:22:52.605 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T18:22:52.639 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T18:22:52.643 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T18:22:52.694 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 43/156 2024-04-26T18:22:52.744 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T18:22:52.790 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T18:22:52.848 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T18:22:52.876 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T18:22:52.907 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T18:22:52.947 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T18:22:52.962 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T18:22:52.985 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T18:22:53.002 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T18:22:53.022 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-04-26T18:22:53.048 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T18:22:53.070 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T18:22:53.083 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T18:22:53.094 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T18:22:53.114 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T18:22:53.150 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T18:22:53.165 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-04-26T18:22:53.165 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-04-26T18:22:53.206 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T18:22:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T18:22:53.253 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T18:22:53.286 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T18:22:53.293 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T18:22:53.336 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T18:22:53.393 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T18:22:53.471 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T18:22:53.479 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T18:22:53.519 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T18:22:53.525 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T18:22:53.553 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T18:22:53.555 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T18:22:53.596 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T18:22:53.618 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T18:22:53.652 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T18:22:53.690 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T18:22:53.696 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T18:22:53.728 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T18:22:53.738 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T18:22:53.756 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T18:22:53.778 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T18:22:53.804 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T18:22:53.825 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T18:22:53.828 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T18:22:53.889 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T18:22:53.904 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T18:22:53.917 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T18:22:53.952 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T18:22:54.029 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T18:22:54.030 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T18:22:54.061 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T18:22:54.063 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 31/156 2024-04-26T18:22:54.090 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T18:22:54.106 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 32/156 2024-04-26T18:22:54.123 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T18:22:54.144 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 33/156 2024-04-26T18:22:54.162 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T18:22:54.194 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T18:22:54.215 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T18:22:54.224 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T18:22:54.250 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T18:22:54.259 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T18:22:54.333 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T18:22:54.363 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T18:22:54.463 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T18:22:54.519 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T18:22:54.610 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T18:22:54.644 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T18:22:54.734 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T18:22:54.783 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T18:22:54.813 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T18:22:54.861 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T18:22:54.927 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-04-26T18:22:54.929 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-04-26T18:22:54.959 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T18:22:55.014 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T18:22:55.048 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T18:22:55.139 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T18:22:55.168 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T18:22:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T18:22:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 43/156 2024-04-26T18:22:55.291 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T18:22:55.445 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T18:22:55.502 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T18:22:55.557 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T18:22:55.629 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T18:22:55.661 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T18:22:55.698 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T18:22:55.741 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T18:22:55.744 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T18:22:55.780 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T18:22:55.787 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T18:22:55.823 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T18:22:55.829 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T18:22:55.865 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T18:22:55.928 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T18:22:55.987 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T18:22:56.001 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T18:22:56.046 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T18:22:56.074 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T18:22:56.076 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T18:22:56.114 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T18:22:56.117 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T18:22:56.219 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T18:22:56.259 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T18:22:56.292 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T18:22:56.299 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T18:22:56.325 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T18:22:56.329 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T18:22:56.350 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T18:22:56.406 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T18:22:56.423 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T18:22:56.551 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T18:22:56.590 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T18:22:56.618 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T18:22:56.652 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T18:22:56.691 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T18:22:56.723 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T18:22:56.753 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T18:22:56.787 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T18:22:56.820 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T18:22:56.862 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T18:22:56.897 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T18:22:56.984 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T18:22:57.055 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T18:22:57.168 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T18:22:57.212 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T18:22:57.242 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T18:22:57.290 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T18:22:57.397 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T18:22:57.451 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T18:22:58.173 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T18:22:58.215 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T18:22:58.249 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T18:22:58.347 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T18:22:58.407 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T18:22:58.409 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T18:22:58.493 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T18:22:58.494 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T18:22:58.520 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T18:22:58.526 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T18:22:58.553 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T18:22:58.703 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T18:22:58.740 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T18:22:58.818 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T18:22:58.868 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T18:22:58.899 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T18:22:58.990 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T18:22:59.021 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 100/156 2024-04-26T18:22:59.057 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T18:22:59.462 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T18:22:59.547 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T18:22:59.569 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T18:22:59.579 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T18:22:59.641 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T18:22:59.663 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 104/156 2024-04-26T18:23:00.798 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T18:23:00.838 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-04-26T18:23:00.878 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T18:23:00.905 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T18:23:00.920 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T18:23:00.939 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T18:23:00.958 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T18:23:01.023 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T18:23:01.063 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T18:23:01.088 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T18:23:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T18:23:01.250 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T18:23:01.293 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T18:23:01.384 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T18:23:01.414 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 100/156 2024-04-26T18:23:01.451 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T18:23:01.454 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T18:23:01.565 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T18:23:01.686 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T18:23:01.716 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T18:23:01.806 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T18:23:01.836 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T18:23:01.928 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T18:23:01.952 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T18:23:01.955 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T18:23:01.984 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T18:23:01.984 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T18:23:02.009 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T18:23:02.031 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 104/156 2024-04-26T18:23:02.033 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T18:23:02.061 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T18:23:02.164 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T18:23:02.188 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T18:23:02.297 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T18:23:02.297 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T18:23:02.297 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T18:23:02.480 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T18:23:02.513 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T18:23:02.525 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T18:23:02.580 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T18:23:02.623 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T18:23:02.673 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T18:23:02.673 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T18:23:02.673 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T18:23:02.674 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:23:02.706 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T18:23:02.710 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T18:23:02.754 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T18:23:02.789 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T18:23:02.862 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T18:23:02.897 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T18:23:02.940 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T18:23:02.972 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T18:23:03.009 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T18:23:03.078 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T18:23:03.130 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T18:23:03.162 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T18:23:03.205 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T18:23:03.289 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T18:23:03.324 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 31/156 2024-04-26T18:23:03.367 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 32/156 2024-04-26T18:23:03.396 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 33/156 2024-04-26T18:23:03.464 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T18:23:03.519 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T18:23:03.594 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T18:23:03.729 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T18:23:03.780 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T18:23:04.299 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T18:23:04.303 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T18:23:04.336 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T18:23:04.392 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T18:23:04.421 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T18:23:04.464 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T18:23:04.502 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 43/156 2024-04-26T18:23:04.543 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T18:23:04.712 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T18:23:04.754 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T18:23:04.808 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T18:23:04.879 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T18:23:04.890 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T18:23:04.922 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T18:23:04.923 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T18:23:04.958 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T18:23:05.005 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T18:23:05.014 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T18:23:05.014 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T18:23:05.014 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T18:23:05.014 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T18:23:05.041 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T18:23:05.041 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T18:23:05.083 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T18:23:05.126 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T18:23:05.262 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T18:23:05.307 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T18:23:05.337 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T18:23:05.378 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T18:23:05.471 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T18:23:05.503 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T18:23:05.543 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T18:23:05.568 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T18:23:05.593 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T18:23:05.659 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T18:23:05.785 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T18:23:05.817 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T18:23:05.845 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T18:23:05.879 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T18:23:05.918 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T18:23:05.950 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T18:23:05.980 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T18:23:06.014 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T18:23:06.048 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T18:23:06.113 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T18:23:06.368 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T18:23:06.550 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T18:23:06.654 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T18:23:06.685 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T18:23:06.732 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T18:23:06.832 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T18:23:06.886 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T18:23:07.611 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T18:23:07.658 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T18:23:07.692 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T18:23:07.791 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T18:23:07.841 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T18:23:07.930 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T18:23:07.961 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T18:23:08.139 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T18:23:08.167 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T18:23:08.246 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T18:23:08.889 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T18:23:08.998 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T18:23:10.238 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T18:23:10.313 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T18:23:10.340 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T18:23:10.373 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T18:23:10.688 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T18:23:10.736 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T18:23:10.826 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T18:23:10.857 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 100/156 2024-04-26T18:23:10.894 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T18:23:11.372 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T18:23:11.397 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T18:23:11.469 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T18:23:11.499 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 104/156 2024-04-26T18:23:13.897 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T18:23:13.929 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T18:23:13.994 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T18:23:13.994 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /sys 2024-04-26T18:23:13.994 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /proc 2024-04-26T18:23:13.995 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /mnt 2024-04-26T18:23:13.995 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /var/tmp 2024-04-26T18:23:13.995 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /home 2024-04-26T18:23:13.995 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /root 2024-04-26T18:23:13.995 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /tmp 2024-04-26T18:23:13.995 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:23:14.195 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T18:23:14.213 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T18:23:14.213 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:14.213 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T18:23:14.213 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:23:14.478 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T18:23:14.524 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T18:23:14.615 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T18:23:14.616 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T18:23:14.616 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T18:23:14.616 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T18:23:14.650 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T18:23:15.698 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T18:23:15.724 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T18:23:15.724 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:15.724 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T18:23:15.724 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T18:23:15.724 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T18:23:15.724 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:23:15.948 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T18:23:15.971 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T18:23:15.971 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:15.971 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T18:23:15.971 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T18:23:15.971 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T18:23:15.972 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:23:16.408 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T18:23:16.430 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T18:23:16.430 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:16.430 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T18:23:16.430 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T18:23:16.430 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T18:23:16.430 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:23:16.460 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T18:23:16.460 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /sys 2024-04-26T18:23:16.460 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /proc 2024-04-26T18:23:16.460 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /mnt 2024-04-26T18:23:16.460 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /var/tmp 2024-04-26T18:23:16.460 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /home 2024-04-26T18:23:16.460 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /root 2024-04-26T18:23:16.460 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /tmp 2024-04-26T18:23:16.460 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T18:23:16.537 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T18:23:16.586 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T18:23:16.629 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T18:23:16.642 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T18:23:16.644 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T18:23:16.644 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:16.645 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T18:23:16.645 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T18:23:16.828 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T18:23:16.884 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T18:23:16.961 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T18:23:17.050 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T18:23:17.190 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T18:23:17.225 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T18:23:17.266 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T18:23:17.285 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T18:23:17.737 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T18:23:17.792 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T18:23:17.824 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 124/156 2024-04-26T18:23:17.885 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 125/156 2024-04-26T18:23:17.915 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T18:23:18.132 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T18:23:18.157 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T18:23:18.157 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:18.157 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T18:23:18.157 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T18:23:18.158 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T18:23:18.158 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T18:23:18.382 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T18:23:18.405 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T18:23:18.405 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:18.406 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T18:23:18.406 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T18:23:18.406 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T18:23:18.406 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T18:23:18.841 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T18:23:18.864 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T18:23:18.864 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:18.864 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T18:23:18.864 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T18:23:18.864 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T18:23:18.865 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T18:23:18.956 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T18:23:18.963 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T18:23:18.992 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T18:23:19.028 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T18:23:19.084 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T18:23:19.269 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T18:23:19.325 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T18:23:19.403 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T18:23:19.491 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T18:23:19.631 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T18:23:19.667 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T18:23:19.708 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T18:23:19.735 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T18:23:19.963 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T18:23:20.001 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T18:23:20.103 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T18:23:20.170 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T18:23:20.200 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T18:23:20.232 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 124/156 2024-04-26T18:23:20.281 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 129/156 2024-04-26T18:23:20.294 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 125/156 2024-04-26T18:23:20.311 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T18:23:20.324 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T18:23:20.334 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T18:23:20.334 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:20.334 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T18:23:20.334 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T18:23:20.334 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T18:23:20.334 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:23:20.379 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T18:23:20.390 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T18:23:20.489 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 132/156 2024-04-26T18:23:20.535 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 133/156 2024-04-26T18:23:21.349 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T18:23:21.384 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T18:23:21.462 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T18:23:21.498 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T18:23:21.520 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T18:23:21.521 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:21.521 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T18:23:21.521 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T18:23:21.521 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T18:23:21.521 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:23:21.565 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T18:23:21.587 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T18:23:21.587 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:21.587 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T18:23:21.588 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:23:21.633 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T18:23:21.655 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T18:23:21.655 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:21.655 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T18:23:21.655 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T18:23:21.655 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T18:23:21.655 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:23:21.967 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T18:23:21.990 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T18:23:21.990 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:21.990 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T18:23:21.990 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T18:23:21.990 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T18:23:21.990 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:23:22.343 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T18:23:22.367 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T18:23:22.468 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T18:23:22.629 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 129/156 2024-04-26T18:23:22.661 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T18:23:22.685 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T18:23:22.685 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:22.685 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T18:23:22.685 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T18:23:22.685 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T18:23:22.685 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T18:23:22.729 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T18:23:22.740 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T18:23:22.837 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 132/156 2024-04-26T18:23:22.885 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 133/156 2024-04-26T18:23:23.805 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T18:23:23.831 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T18:23:23.854 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T18:23:23.855 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:23.855 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T18:23:23.855 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T18:23:23.855 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T18:23:23.855 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T18:23:23.898 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T18:23:23.920 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T18:23:23.921 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:23.921 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T18:23:23.921 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T18:23:23.974 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T18:23:23.997 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T18:23:23.997 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:23.997 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T18:23:23.997 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T18:23:23.997 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T18:23:23.997 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T18:23:24.308 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T18:23:24.331 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T18:23:24.331 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:24.331 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T18:23:24.331 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T18:23:24.331 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T18:23:24.331 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T18:23:26.151 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T18:23:26.151 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /sys 2024-04-26T18:23:26.152 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /proc 2024-04-26T18:23:26.152 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /mnt 2024-04-26T18:23:26.152 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /var/tmp 2024-04-26T18:23:26.152 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /home 2024-04-26T18:23:26.152 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /root 2024-04-26T18:23:26.152 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /tmp 2024-04-26T18:23:26.152 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T18:23:26.328 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T18:23:26.344 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T18:23:26.344 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:26.344 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T18:23:26.344 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T18:23:26.595 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 139/156 2024-04-26T18:23:26.636 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 140/156 2024-04-26T18:23:26.677 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 141/156 2024-04-26T18:23:26.718 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T18:23:26.745 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T18:23:26.936 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 144/156 2024-04-26T18:23:26.975 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T18:23:27.005 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 146/156 2024-04-26T18:23:27.561 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T18:23:27.611 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T18:23:27.631 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T18:23:27.839 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T18:23:27.865 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T18:23:27.865 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:27.865 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T18:23:27.865 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T18:23:27.865 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T18:23:27.865 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T18:23:28.090 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T18:23:28.113 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T18:23:28.113 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:28.113 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T18:23:28.113 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T18:23:28.113 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T18:23:28.113 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T18:23:28.457 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 148/156 2024-04-26T18:23:28.541 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T18:23:28.557 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T18:23:28.580 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T18:23:28.580 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:28.580 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T18:23:28.580 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T18:23:28.580 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T18:23:28.580 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T18:23:28.582 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T18:23:28.673 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T18:23:28.687 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T18:23:28.712 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T18:23:28.712 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T18:23:28.743 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T18:23:28.799 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T18:23:28.805 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T18:23:28.838 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T18:23:28.838 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T18:23:28.931 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T18:23:28.937 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 139/156 2024-04-26T18:23:28.978 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 140/156 2024-04-26T18:23:28.985 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T18:23:29.004 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T18:23:29.019 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 141/156 2024-04-26T18:23:29.033 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T18:23:29.051 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T18:23:29.078 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T18:23:29.110 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T18:23:29.199 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T18:23:29.258 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 144/156 2024-04-26T18:23:29.300 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T18:23:29.329 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 146/156 2024-04-26T18:23:29.330 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T18:23:29.375 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T18:23:29.406 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T18:23:29.434 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T18:23:29.882 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T18:23:29.886 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T18:23:29.907 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T18:23:29.918 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T18:23:29.931 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 124/156 2024-04-26T18:23:29.939 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T18:23:30.001 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 125/156 2024-04-26T18:23:30.030 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T18:23:30.767 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 148/156 2024-04-26T18:23:30.859 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T18:23:30.900 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T18:23:30.981 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T18:23:31.022 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T18:23:31.022 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T18:23:31.058 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T18:23:31.091 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T18:23:31.106 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T18:23:31.139 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T18:23:31.139 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T18:23:31.229 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T18:23:31.296 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T18:23:32.061 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T18:23:32.090 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T18:23:32.194 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T18:23:32.354 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 129/156 2024-04-26T18:23:32.376 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T18:23:32.399 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T18:23:32.400 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:32.400 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T18:23:32.400 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T18:23:32.400 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T18:23:32.400 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T18:23:32.443 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T18:23:32.455 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T18:23:32.553 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 132/156 2024-04-26T18:23:32.608 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 133/156 2024-04-26T18:23:33.540 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T18:23:33.571 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T18:23:33.594 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T18:23:33.594 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:33.594 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T18:23:33.594 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T18:23:33.594 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T18:23:33.594 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T18:23:33.638 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T18:23:33.660 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T18:23:33.661 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:33.661 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T18:23:33.661 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T18:23:33.705 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T18:23:33.729 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T18:23:33.729 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:33.729 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T18:23:33.729 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T18:23:33.729 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T18:23:33.729 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T18:23:34.039 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T18:23:34.062 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T18:23:34.062 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T18:23:34.062 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T18:23:34.062 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T18:23:34.062 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T18:23:34.062 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T18:23:35.064 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T18:23:35.064 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 1/156 2024-04-26T18:23:35.064 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2/156 2024-04-26T18:23:35.064 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 3/156 2024-04-26T18:23:35.064 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 4/156 2024-04-26T18:23:35.064 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 5/156 2024-04-26T18:23:35.064 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 6/156 2024-04-26T18:23:35.064 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 7/156 2024-04-26T18:23:35.064 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T18:23:35.064 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T18:23:35.065 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T18:23:35.065 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 11/156 2024-04-26T18:23:35.065 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 12/156 2024-04-26T18:23:35.065 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T18:23:35.065 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 14/156 2024-04-26T18:23:35.065 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 15/156 2024-04-26T18:23:35.065 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 16/156 2024-04-26T18:23:35.065 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 17/156 2024-04-26T18:23:35.065 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 18/156 2024-04-26T18:23:35.065 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 19/156 2024-04-26T18:23:35.065 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 20/156 2024-04-26T18:23:35.065 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 21/156 2024-04-26T18:23:35.065 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 22/156 2024-04-26T18:23:35.065 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 23/156 2024-04-26T18:23:35.065 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 24/156 2024-04-26T18:23:35.066 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 25/156 2024-04-26T18:23:35.077 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 26/156 2024-04-26T18:23:35.077 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 27/156 2024-04-26T18:23:35.077 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 28/156 2024-04-26T18:23:35.077 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 29/156 2024-04-26T18:23:35.077 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 30/156 2024-04-26T18:23:35.077 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 31/156 2024-04-26T18:23:35.077 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 32/156 2024-04-26T18:23:35.077 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 33/156 2024-04-26T18:23:35.077 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 34/156 2024-04-26T18:23:35.078 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 35/156 2024-04-26T18:23:35.078 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 36/156 2024-04-26T18:23:35.078 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 37/156 2024-04-26T18:23:35.078 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 38/156 2024-04-26T18:23:35.078 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 39/156 2024-04-26T18:23:35.078 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T18:23:35.078 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T18:23:35.078 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T18:23:35.078 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T18:23:35.078 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T18:23:35.078 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T18:23:35.078 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T18:23:35.078 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T18:23:35.078 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T18:23:35.079 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T18:23:35.079 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T18:23:35.079 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T18:23:35.079 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T18:23:35.079 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T18:23:35.079 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T18:23:35.079 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T18:23:35.079 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T18:23:35.079 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T18:23:35.079 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T18:23:35.079 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T18:23:35.079 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T18:23:35.079 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T18:23:35.079 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T18:23:35.080 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T18:23:35.080 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T18:23:35.080 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T18:23:35.080 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T18:23:35.080 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T18:23:35.080 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T18:23:35.080 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T18:23:35.080 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T18:23:35.080 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T18:23:35.080 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T18:23:35.080 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T18:23:35.080 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T18:23:35.080 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T18:23:35.080 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T18:23:35.080 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T18:23:35.081 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T18:23:35.081 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T18:23:35.081 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T18:23:35.081 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T18:23:35.081 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T18:23:35.081 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T18:23:35.081 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T18:23:35.081 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T18:23:35.081 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T18:23:35.081 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T18:23:35.081 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T18:23:35.081 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T18:23:35.081 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T18:23:35.081 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T18:23:35.081 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T18:23:35.082 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T18:23:35.082 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T18:23:35.082 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T18:23:35.082 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T18:23:35.082 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T18:23:35.082 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T18:23:35.082 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T18:23:35.082 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T18:23:35.082 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T18:23:35.082 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T18:23:35.082 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T18:23:35.082 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T18:23:35.082 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T18:23:35.082 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T18:23:35.083 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T18:23:35.083 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T18:23:35.083 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T18:23:35.083 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T18:23:35.083 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T18:23:35.083 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T18:23:35.083 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T18:23:35.083 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T18:23:35.083 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T18:23:35.083 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T18:23:35.083 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T18:23:35.083 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T18:23:35.083 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T18:23:35.083 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T18:23:35.083 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T18:23:35.084 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T18:23:35.084 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T18:23:35.084 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T18:23:35.084 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T18:23:35.084 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T18:23:35.084 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T18:23:35.084 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T18:23:35.084 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T18:23:35.084 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T18:23:35.084 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T18:23:35.084 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T18:23:35.084 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T18:23:35.084 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T18:23:35.084 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T18:23:35.084 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T18:23:35.085 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T18:23:35.085 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T18:23:35.085 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T18:23:35.085 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T18:23:35.085 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T18:23:35.085 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T18:23:35.085 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T18:23:35.085 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T18:23:35.085 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T18:23:35.085 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T18:23:35.085 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T18:23:35.085 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T18:23:35.085 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 149/156 2024-04-26T18:23:35.085 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T18:23:35.086 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 151/156 2024-04-26T18:23:35.086 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T18:23:35.086 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T18:23:35.086 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T18:23:35.086 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T18:23:36.998 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T18:23:36.998 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 1/156 2024-04-26T18:23:36.998 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2/156 2024-04-26T18:23:36.999 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 3/156 2024-04-26T18:23:36.999 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 4/156 2024-04-26T18:23:36.999 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 5/156 2024-04-26T18:23:36.999 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 6/156 2024-04-26T18:23:36.999 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 7/156 2024-04-26T18:23:36.999 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T18:23:36.999 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T18:23:36.999 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T18:23:36.999 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 11/156 2024-04-26T18:23:36.999 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 12/156 2024-04-26T18:23:36.999 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T18:23:36.999 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 14/156 2024-04-26T18:23:36.999 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 15/156 2024-04-26T18:23:36.999 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 16/156 2024-04-26T18:23:37.000 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 17/156 2024-04-26T18:23:37.000 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 18/156 2024-04-26T18:23:37.000 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 19/156 2024-04-26T18:23:37.000 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 20/156 2024-04-26T18:23:37.000 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 21/156 2024-04-26T18:23:37.000 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 22/156 2024-04-26T18:23:37.000 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 23/156 2024-04-26T18:23:37.000 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 24/156 2024-04-26T18:23:37.000 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 25/156 2024-04-26T18:23:37.000 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 26/156 2024-04-26T18:23:37.000 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 27/156 2024-04-26T18:23:37.000 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 28/156 2024-04-26T18:23:37.000 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 29/156 2024-04-26T18:23:37.000 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 30/156 2024-04-26T18:23:37.011 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 31/156 2024-04-26T18:23:37.012 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 32/156 2024-04-26T18:23:37.012 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 33/156 2024-04-26T18:23:37.012 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 34/156 2024-04-26T18:23:37.012 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 35/156 2024-04-26T18:23:37.012 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 36/156 2024-04-26T18:23:37.012 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 37/156 2024-04-26T18:23:37.012 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 38/156 2024-04-26T18:23:37.012 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 39/156 2024-04-26T18:23:37.012 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T18:23:37.012 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T18:23:37.012 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T18:23:37.012 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T18:23:37.012 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T18:23:37.012 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T18:23:37.013 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T18:23:37.013 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T18:23:37.013 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T18:23:37.013 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T18:23:37.013 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T18:23:37.013 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T18:23:37.013 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T18:23:37.013 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T18:23:37.013 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T18:23:37.013 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T18:23:37.013 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T18:23:37.013 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T18:23:37.013 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T18:23:37.013 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T18:23:37.013 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T18:23:37.013 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T18:23:37.014 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T18:23:37.014 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T18:23:37.014 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T18:23:37.014 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T18:23:37.014 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T18:23:37.014 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T18:23:37.014 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T18:23:37.014 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T18:23:37.014 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T18:23:37.014 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T18:23:37.014 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T18:23:37.014 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T18:23:37.014 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T18:23:37.015 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T18:23:37.015 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T18:23:37.015 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T18:23:37.015 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T18:23:37.015 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T18:23:37.015 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T18:23:37.015 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T18:23:37.015 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T18:23:37.015 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T18:23:37.015 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T18:23:37.015 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T18:23:37.015 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T18:23:37.015 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T18:23:37.015 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T18:23:37.015 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T18:23:37.016 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T18:23:37.016 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T18:23:37.016 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T18:23:37.016 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T18:23:37.016 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T18:23:37.016 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T18:23:37.016 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T18:23:37.016 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T18:23:37.016 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T18:23:37.016 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T18:23:37.016 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T18:23:37.016 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T18:23:37.016 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T18:23:37.016 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T18:23:37.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T18:23:37.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T18:23:37.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T18:23:37.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T18:23:37.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T18:23:37.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T18:23:37.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T18:23:37.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T18:23:37.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T18:23:37.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T18:23:37.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T18:23:37.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T18:23:37.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T18:23:37.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T18:23:37.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T18:23:37.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T18:23:37.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T18:23:37.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T18:23:37.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T18:23:37.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T18:23:37.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T18:23:37.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T18:23:37.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T18:23:37.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T18:23:37.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T18:23:37.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T18:23:37.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T18:23:37.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T18:23:37.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T18:23:37.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T18:23:37.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T18:23:37.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T18:23:37.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T18:23:37.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T18:23:37.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T18:23:37.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T18:23:37.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T18:23:37.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T18:23:37.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T18:23:37.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T18:23:37.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T18:23:37.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T18:23:37.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T18:23:37.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T18:23:37.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T18:23:37.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 149/156 2024-04-26T18:23:37.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T18:23:37.020 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 151/156 2024-04-26T18:23:37.020 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T18:23:37.020 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T18:23:37.020 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T18:23:37.020 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T18:23:37.175 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T18:23:37.175 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:23:37.175 INFO:teuthology.orchestra.run.smithi080.stdout:Upgraded: 2024-04-26T18:23:37.175 INFO:teuthology.orchestra.run.smithi080.stdout: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.175 INFO:teuthology.orchestra.run.smithi080.stdout: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.175 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T18:23:37.175 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T18:23:37.175 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-04-26T18:23:37.175 INFO:teuthology.orchestra.run.smithi080.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T18:23:37.175 INFO:teuthology.orchestra.run.smithi080.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T18:23:37.175 INFO:teuthology.orchestra.run.smithi080.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T18:23:37.176 INFO:teuthology.orchestra.run.smithi080.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T18:23:37.176 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.176 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.176 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.176 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.176 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:37.176 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.176 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.176 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.176 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:37.176 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:37.176 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:37.176 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:37.176 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:37.177 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.177 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.177 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:37.177 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.177 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.177 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.177 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:37.177 INFO:teuthology.orchestra.run.smithi080.stdout: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:37.177 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.177 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.177 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:37.177 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T18:23:37.177 INFO:teuthology.orchestra.run.smithi080.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T18:23:37.177 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T18:23:37.178 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T18:23:37.178 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T18:23:37.178 INFO:teuthology.orchestra.run.smithi080.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T18:23:37.178 INFO:teuthology.orchestra.run.smithi080.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T18:23:37.178 INFO:teuthology.orchestra.run.smithi080.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T18:23:37.178 INFO:teuthology.orchestra.run.smithi080.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T18:23:37.178 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T18:23:37.178 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T18:23:37.178 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.178 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.178 INFO:teuthology.orchestra.run.smithi080.stdout: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.178 INFO:teuthology.orchestra.run.smithi080.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T18:23:37.178 INFO:teuthology.orchestra.run.smithi080.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T18:23:37.178 INFO:teuthology.orchestra.run.smithi080.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T18:23:37.178 INFO:teuthology.orchestra.run.smithi080.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T18:23:37.179 INFO:teuthology.orchestra.run.smithi080.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T18:23:37.179 INFO:teuthology.orchestra.run.smithi080.stdout: librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.179 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.179 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T18:23:37.179 INFO:teuthology.orchestra.run.smithi080.stdout: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.179 INFO:teuthology.orchestra.run.smithi080.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T18:23:37.179 INFO:teuthology.orchestra.run.smithi080.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T18:23:37.179 INFO:teuthology.orchestra.run.smithi080.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T18:23:37.179 INFO:teuthology.orchestra.run.smithi080.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T18:23:37.179 INFO:teuthology.orchestra.run.smithi080.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T18:23:37.179 INFO:teuthology.orchestra.run.smithi080.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T18:23:37.179 INFO:teuthology.orchestra.run.smithi080.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T18:23:37.179 INFO:teuthology.orchestra.run.smithi080.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T18:23:37.179 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T18:23:37.179 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T18:23:37.180 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T18:23:37.180 INFO:teuthology.orchestra.run.smithi080.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T18:23:37.180 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T18:23:37.180 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T18:23:37.180 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T18:23:37.180 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T18:23:37.180 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T18:23:37.180 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T18:23:37.180 INFO:teuthology.orchestra.run.smithi080.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T18:23:37.180 INFO:teuthology.orchestra.run.smithi080.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T18:23:37.180 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T18:23:37.180 INFO:teuthology.orchestra.run.smithi080.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T18:23:37.180 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T18:23:37.180 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.180 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.181 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.181 INFO:teuthology.orchestra.run.smithi080.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T18:23:37.181 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T18:23:37.181 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T18:23:37.181 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T18:23:37.181 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T18:23:37.181 INFO:teuthology.orchestra.run.smithi080.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T18:23:37.181 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T18:23:37.181 INFO:teuthology.orchestra.run.smithi080.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T18:23:37.181 INFO:teuthology.orchestra.run.smithi080.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T18:23:37.181 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T18:23:37.181 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T18:23:37.181 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T18:23:37.181 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T18:23:37.181 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T18:23:37.182 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T18:23:37.182 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T18:23:37.182 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T18:23:37.182 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T18:23:37.182 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T18:23:37.182 INFO:teuthology.orchestra.run.smithi080.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T18:23:37.182 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T18:23:37.182 INFO:teuthology.orchestra.run.smithi080.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T18:23:37.182 INFO:teuthology.orchestra.run.smithi080.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T18:23:37.182 INFO:teuthology.orchestra.run.smithi080.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T18:23:37.182 INFO:teuthology.orchestra.run.smithi080.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T18:23:37.182 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T18:23:37.182 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T18:23:37.182 INFO:teuthology.orchestra.run.smithi080.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T18:23:37.182 INFO:teuthology.orchestra.run.smithi080.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T18:23:37.183 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T18:23:37.183 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T18:23:37.183 INFO:teuthology.orchestra.run.smithi080.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T18:23:37.183 INFO:teuthology.orchestra.run.smithi080.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T18:23:37.183 INFO:teuthology.orchestra.run.smithi080.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T18:23:37.183 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T18:23:37.183 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T18:23:37.183 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T18:23:37.183 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T18:23:37.183 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T18:23:37.183 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T18:23:37.183 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.183 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.183 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T18:23:37.184 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T18:23:37.184 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T18:23:37.184 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.184 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T18:23:37.184 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T18:23:37.184 INFO:teuthology.orchestra.run.smithi080.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T18:23:37.184 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T18:23:37.184 INFO:teuthology.orchestra.run.smithi080.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T18:23:37.184 INFO:teuthology.orchestra.run.smithi080.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T18:23:37.184 INFO:teuthology.orchestra.run.smithi080.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T18:23:37.184 INFO:teuthology.orchestra.run.smithi080.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T18:23:37.184 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T18:23:37.184 INFO:teuthology.orchestra.run.smithi080.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T18:23:37.184 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T18:23:37.185 INFO:teuthology.orchestra.run.smithi080.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T18:23:37.185 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T18:23:37.185 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T18:23:37.185 INFO:teuthology.orchestra.run.smithi080.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T18:23:37.185 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.185 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.185 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:37.185 INFO:teuthology.orchestra.run.smithi080.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T18:23:37.185 INFO:teuthology.orchestra.run.smithi080.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T18:23:37.185 INFO:teuthology.orchestra.run.smithi080.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T18:23:37.185 INFO:teuthology.orchestra.run.smithi080.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T18:23:37.185 INFO:teuthology.orchestra.run.smithi080.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T18:23:37.185 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T18:23:37.186 INFO:teuthology.orchestra.run.smithi080.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T18:23:37.186 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:23:37.186 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-04-26T18:23:37.583 DEBUG:teuthology.parallel:result is None 2024-04-26T18:23:38.684 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 139/156 2024-04-26T18:23:38.725 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 140/156 2024-04-26T18:23:38.766 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 141/156 2024-04-26T18:23:38.798 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T18:23:38.826 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T18:23:39.006 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 144/156 2024-04-26T18:23:39.055 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T18:23:39.085 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 146/156 2024-04-26T18:23:39.133 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T18:23:39.133 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T18:23:39.133 INFO:teuthology.orchestra.run.smithi192.stdout:Upgraded: 2024-04-26T18:23:39.133 INFO:teuthology.orchestra.run.smithi192.stdout: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.133 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.133 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T18:23:39.133 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T18:23:39.134 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-04-26T18:23:39.134 INFO:teuthology.orchestra.run.smithi192.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T18:23:39.134 INFO:teuthology.orchestra.run.smithi192.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T18:23:39.134 INFO:teuthology.orchestra.run.smithi192.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T18:23:39.134 INFO:teuthology.orchestra.run.smithi192.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T18:23:39.134 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.134 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.134 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.134 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.134 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:39.134 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.134 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.134 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.134 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:39.135 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:39.135 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:39.135 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:39.135 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:39.135 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.135 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.135 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:39.135 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.135 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.135 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.135 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:39.135 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:39.135 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.135 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.135 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:39.136 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T18:23:39.136 INFO:teuthology.orchestra.run.smithi192.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T18:23:39.136 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T18:23:39.136 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T18:23:39.136 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T18:23:39.136 INFO:teuthology.orchestra.run.smithi192.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T18:23:39.136 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T18:23:39.136 INFO:teuthology.orchestra.run.smithi192.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T18:23:39.136 INFO:teuthology.orchestra.run.smithi192.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T18:23:39.136 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T18:23:39.136 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T18:23:39.136 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.136 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.136 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.136 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T18:23:39.137 INFO:teuthology.orchestra.run.smithi192.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T18:23:39.137 INFO:teuthology.orchestra.run.smithi192.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T18:23:39.137 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T18:23:39.137 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T18:23:39.137 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.137 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.137 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T18:23:39.137 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.137 INFO:teuthology.orchestra.run.smithi192.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T18:23:39.137 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T18:23:39.137 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T18:23:39.137 INFO:teuthology.orchestra.run.smithi192.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T18:23:39.137 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T18:23:39.137 INFO:teuthology.orchestra.run.smithi192.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T18:23:39.137 INFO:teuthology.orchestra.run.smithi192.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T18:23:39.138 INFO:teuthology.orchestra.run.smithi192.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T18:23:39.138 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T18:23:39.138 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T18:23:39.138 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T18:23:39.138 INFO:teuthology.orchestra.run.smithi192.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T18:23:39.138 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T18:23:39.138 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T18:23:39.138 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T18:23:39.138 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T18:23:39.138 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T18:23:39.138 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T18:23:39.138 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T18:23:39.138 INFO:teuthology.orchestra.run.smithi192.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T18:23:39.138 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T18:23:39.139 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T18:23:39.139 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T18:23:39.139 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.139 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.139 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.139 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T18:23:39.139 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T18:23:39.139 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T18:23:39.139 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T18:23:39.139 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T18:23:39.139 INFO:teuthology.orchestra.run.smithi192.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T18:23:39.139 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T18:23:39.139 INFO:teuthology.orchestra.run.smithi192.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T18:23:39.139 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T18:23:39.139 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T18:23:39.139 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T18:23:39.139 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T18:23:39.140 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T18:23:39.140 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T18:23:39.140 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T18:23:39.140 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T18:23:39.140 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T18:23:39.140 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T18:23:39.140 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T18:23:39.140 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T18:23:39.140 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T18:23:39.140 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T18:23:39.140 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T18:23:39.140 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T18:23:39.140 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T18:23:39.140 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T18:23:39.140 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T18:23:39.141 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T18:23:39.141 INFO:teuthology.orchestra.run.smithi192.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T18:23:39.141 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T18:23:39.141 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T18:23:39.141 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T18:23:39.141 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T18:23:39.141 INFO:teuthology.orchestra.run.smithi192.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T18:23:39.141 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T18:23:39.141 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T18:23:39.141 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T18:23:39.141 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T18:23:39.141 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T18:23:39.141 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T18:23:39.141 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.142 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.142 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T18:23:39.142 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T18:23:39.142 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T18:23:39.142 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.142 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T18:23:39.142 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T18:23:39.142 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T18:23:39.142 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T18:23:39.142 INFO:teuthology.orchestra.run.smithi192.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T18:23:39.142 INFO:teuthology.orchestra.run.smithi192.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T18:23:39.142 INFO:teuthology.orchestra.run.smithi192.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T18:23:39.142 INFO:teuthology.orchestra.run.smithi192.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T18:23:39.142 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T18:23:39.143 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T18:23:39.143 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T18:23:39.143 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T18:23:39.143 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T18:23:39.143 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T18:23:39.143 INFO:teuthology.orchestra.run.smithi192.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T18:23:39.143 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.143 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.143 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:39.143 INFO:teuthology.orchestra.run.smithi192.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T18:23:39.143 INFO:teuthology.orchestra.run.smithi192.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T18:23:39.143 INFO:teuthology.orchestra.run.smithi192.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T18:23:39.143 INFO:teuthology.orchestra.run.smithi192.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T18:23:39.143 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T18:23:39.143 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T18:23:39.144 INFO:teuthology.orchestra.run.smithi192.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T18:23:39.144 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T18:23:39.144 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-04-26T18:23:39.526 DEBUG:teuthology.parallel:result is None 2024-04-26T18:23:39.655 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T18:23:39.699 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T18:23:39.720 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T18:23:40.555 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 148/156 2024-04-26T18:23:40.645 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T18:23:40.686 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T18:23:40.769 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T18:23:40.799 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T18:23:40.800 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T18:23:40.884 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T18:23:40.925 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T18:23:40.925 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T18:23:41.016 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T18:23:41.081 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T18:23:46.821 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T18:23:46.821 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 1/156 2024-04-26T18:23:46.821 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2/156 2024-04-26T18:23:46.821 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 3/156 2024-04-26T18:23:46.821 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 4/156 2024-04-26T18:23:46.821 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 5/156 2024-04-26T18:23:46.821 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 6/156 2024-04-26T18:23:46.821 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 7/156 2024-04-26T18:23:46.821 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T18:23:46.821 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T18:23:46.821 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T18:23:46.821 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 11/156 2024-04-26T18:23:46.822 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 12/156 2024-04-26T18:23:46.822 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T18:23:46.822 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 14/156 2024-04-26T18:23:46.822 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 15/156 2024-04-26T18:23:46.822 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 16/156 2024-04-26T18:23:46.822 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 17/156 2024-04-26T18:23:46.822 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 18/156 2024-04-26T18:23:46.822 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 19/156 2024-04-26T18:23:46.822 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 20/156 2024-04-26T18:23:46.822 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 21/156 2024-04-26T18:23:46.822 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 22/156 2024-04-26T18:23:46.822 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 23/156 2024-04-26T18:23:46.822 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 24/156 2024-04-26T18:23:46.822 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 25/156 2024-04-26T18:23:46.823 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 26/156 2024-04-26T18:23:46.823 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 27/156 2024-04-26T18:23:46.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 28/156 2024-04-26T18:23:46.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 29/156 2024-04-26T18:23:46.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 30/156 2024-04-26T18:23:46.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 31/156 2024-04-26T18:23:46.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 32/156 2024-04-26T18:23:46.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 33/156 2024-04-26T18:23:46.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 34/156 2024-04-26T18:23:46.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 35/156 2024-04-26T18:23:46.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 36/156 2024-04-26T18:23:46.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 37/156 2024-04-26T18:23:46.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 38/156 2024-04-26T18:23:46.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 39/156 2024-04-26T18:23:46.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T18:23:46.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T18:23:46.837 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T18:23:46.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T18:23:46.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T18:23:46.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T18:23:46.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T18:23:46.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T18:23:46.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T18:23:46.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T18:23:46.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T18:23:46.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T18:23:46.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T18:23:46.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T18:23:46.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T18:23:46.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T18:23:46.838 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T18:23:46.839 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T18:23:46.839 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T18:23:46.839 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T18:23:46.839 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T18:23:46.839 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T18:23:46.839 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T18:23:46.839 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T18:23:46.839 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T18:23:46.839 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T18:23:46.839 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T18:23:46.839 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T18:23:46.839 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T18:23:46.839 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T18:23:46.839 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T18:23:46.839 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T18:23:46.839 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T18:23:46.840 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T18:23:46.840 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T18:23:46.840 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T18:23:46.840 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T18:23:46.840 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T18:23:46.840 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T18:23:46.840 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T18:23:46.840 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T18:23:46.840 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T18:23:46.840 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T18:23:46.840 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T18:23:46.840 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T18:23:46.840 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T18:23:46.840 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T18:23:46.840 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T18:23:46.841 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T18:23:46.841 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T18:23:46.841 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T18:23:46.841 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T18:23:46.841 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T18:23:46.841 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T18:23:46.841 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T18:23:46.841 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T18:23:46.841 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T18:23:46.841 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T18:23:46.841 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T18:23:46.841 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T18:23:46.841 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T18:23:46.841 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T18:23:46.841 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T18:23:46.841 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T18:23:46.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T18:23:46.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T18:23:46.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T18:23:46.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T18:23:46.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T18:23:46.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T18:23:46.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T18:23:46.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T18:23:46.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T18:23:46.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T18:23:46.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T18:23:46.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T18:23:46.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T18:23:46.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T18:23:46.842 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T18:23:46.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T18:23:46.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T18:23:46.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T18:23:46.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T18:23:46.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T18:23:46.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T18:23:46.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T18:23:46.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T18:23:46.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T18:23:46.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T18:23:46.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T18:23:46.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T18:23:46.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T18:23:46.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T18:23:46.843 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T18:23:46.844 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T18:23:46.844 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T18:23:46.844 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T18:23:46.844 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T18:23:46.844 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T18:23:46.844 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T18:23:46.844 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T18:23:46.844 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T18:23:46.844 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T18:23:46.844 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T18:23:46.844 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T18:23:46.844 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T18:23:46.844 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T18:23:46.844 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T18:23:46.844 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T18:23:46.845 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 149/156 2024-04-26T18:23:46.845 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T18:23:46.845 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 151/156 2024-04-26T18:23:46.845 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T18:23:46.845 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T18:23:46.845 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T18:23:46.845 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T18:23:49.030 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T18:23:49.031 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T18:23:49.031 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2024-04-26T18:23:49.031 INFO:teuthology.orchestra.run.smithi082.stdout: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.031 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.031 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T18:23:49.031 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T18:23:49.031 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-04-26T18:23:49.031 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T18:23:49.031 INFO:teuthology.orchestra.run.smithi082.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T18:23:49.031 INFO:teuthology.orchestra.run.smithi082.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T18:23:49.031 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T18:23:49.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:49.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:49.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:49.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:49.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:49.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:49.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.033 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:49.033 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.033 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.033 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.033 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:49.033 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:49.033 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.033 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.033 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T18:23:49.033 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T18:23:49.033 INFO:teuthology.orchestra.run.smithi082.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T18:23:49.033 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T18:23:49.033 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T18:23:49.033 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T18:23:49.034 INFO:teuthology.orchestra.run.smithi082.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T18:23:49.034 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T18:23:49.034 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T18:23:49.034 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T18:23:49.034 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T18:23:49.034 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T18:23:49.034 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.034 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.034 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.034 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T18:23:49.034 INFO:teuthology.orchestra.run.smithi082.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T18:23:49.035 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T18:23:49.035 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T18:23:49.035 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T18:23:49.035 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.035 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.035 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T18:23:49.035 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.035 INFO:teuthology.orchestra.run.smithi082.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T18:23:49.035 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T18:23:49.035 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T18:23:49.035 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T18:23:49.035 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T18:23:49.035 INFO:teuthology.orchestra.run.smithi082.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T18:23:49.035 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T18:23:49.035 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T18:23:49.035 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T18:23:49.036 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T18:23:49.036 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T18:23:49.036 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T18:23:49.036 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T18:23:49.036 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T18:23:49.036 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T18:23:49.036 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T18:23:49.036 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T18:23:49.036 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T18:23:49.036 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T18:23:49.036 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T18:23:49.036 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T18:23:49.036 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T18:23:49.036 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T18:23:49.036 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.036 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T18:23:49.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T18:23:49.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T18:23:49.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T18:23:49.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T18:23:49.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T18:23:49.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T18:23:49.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T18:23:49.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T18:23:49.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T18:23:49.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T18:23:49.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T18:23:49.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T18:23:49.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T18:23:49.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T18:23:49.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T18:23:49.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T18:23:49.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T18:23:49.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T18:23:49.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T18:23:49.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T18:23:49.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T18:23:49.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T18:23:49.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T18:23:49.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T18:23:49.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T18:23:49.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T18:23:49.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T18:23:49.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T18:23:49.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T18:23:49.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T18:23:49.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T18:23:49.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T18:23:49.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T18:23:49.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T18:23:49.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T18:23:49.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T18:23:49.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T18:23:49.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T18:23:49.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T18:23:49.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T18:23:49.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T18:23:49.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T18:23:49.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T18:23:49.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T18:23:49.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T18:23:49.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T18:23:49.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T18:23:49.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T18:23:49.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T18:23:49.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T18:23:49.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T18:23:49.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T18:23:49.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T18:23:49.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T18:23:49.040 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T18:23:49.040 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T18:23:49.041 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T18:23:49.041 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.041 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.041 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T18:23:49.041 INFO:teuthology.orchestra.run.smithi082.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T18:23:49.041 INFO:teuthology.orchestra.run.smithi082.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T18:23:49.041 INFO:teuthology.orchestra.run.smithi082.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T18:23:49.041 INFO:teuthology.orchestra.run.smithi082.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T18:23:49.041 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T18:23:49.041 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T18:23:49.041 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T18:23:49.042 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T18:23:49.042 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-26T18:23:49.424 DEBUG:teuthology.parallel:result is None 2024-04-26T18:23:49.425 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T18:23:49.652 DEBUG:teuthology.orchestra.run.smithi080:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T18:23:49.677 INFO:teuthology.orchestra.run.smithi080.stdout:19.0.0-3267.gbc94a2a9.el9 2024-04-26T18:23:49.678 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3267.gbc94a2a9.el9 2024-04-26T18:23:49.678 INFO:teuthology.task.install:The correct ceph version 19.0.0-3267.gbc94a2a9 is installed. 2024-04-26T18:23:49.679 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T18:23:49.902 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T18:23:49.925 INFO:teuthology.orchestra.run.smithi082.stdout:19.0.0-3267.gbc94a2a9.el9 2024-04-26T18:23:49.925 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3267.gbc94a2a9.el9 2024-04-26T18:23:49.925 INFO:teuthology.task.install:The correct ceph version 19.0.0-3267.gbc94a2a9 is installed. 2024-04-26T18:23:49.927 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T18:23:50.076 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T18:23:50.102 INFO:teuthology.orchestra.run.smithi192.stdout:19.0.0-3267.gbc94a2a9.el9 2024-04-26T18:23:50.102 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3267.gbc94a2a9.el9 2024-04-26T18:23:50.102 INFO:teuthology.task.install:The correct ceph version 19.0.0-3267.gbc94a2a9 is installed. 2024-04-26T18:23:50.104 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T18:23:50.104 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T18:23:50.105 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T18:23:50.135 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T18:23:50.135 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T18:23:50.161 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T18:23:50.162 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T18:23:50.192 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T18:23:50.192 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T18:23:50.192 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T18:23:50.219 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T18:23:50.287 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T18:23:50.287 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T18:23:50.310 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T18:23:50.374 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T18:23:50.374 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T18:23:50.402 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T18:23:50.469 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T18:23:50.469 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T18:23:50.469 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T18:23:50.498 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T18:23:50.563 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T18:23:50.563 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T18:23:50.587 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T18:23:50.650 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T18:23:50.651 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T18:23:50.675 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T18:23:50.739 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T18:23:50.740 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T18:23:50.740 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T18:23:50.763 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T18:23:50.828 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T18:23:50.828 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T18:23:50.851 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T18:23:50.918 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T18:23:50.918 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T18:23:50.941 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T18:23:51.005 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-26T18:23:51.102 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-04-26T18:23:51.102 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T18:23:51.103 INFO:tasks.cephadm:Cluster fsid is 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:23:51.103 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-26T18:23:51.103 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.80', 'mon.b': '172.21.15.82', 'mon.c': '172.21.15.192'} 2024-04-26T18:23:51.103 INFO:tasks.cephadm:First mon is mon.a on smithi080 2024-04-26T18:23:51.103 INFO:tasks.cephadm:First mgr is x 2024-04-26T18:23:51.103 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-26T18:23:51.103 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname $(hostname -s) 2024-04-26T18:23:51.127 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname $(hostname -s) 2024-04-26T18:23:51.152 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname $(hostname -s) 2024-04-26T18:23:51.177 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-04-26T18:23:51.178 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T18:23:51.393 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/78913/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3267-gbc94a2a9', 'node_name': '172.21.5.39+adami09', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3267.gbc94a2a9'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-04-26 08:22:46.917786', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-lusov-quiescer-fixes', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-04-26T18:23:51.613 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-lusov-quiescer-fixes, sha1 bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T18:23:51.614 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/x86_64/flavors/default/cephadm 2024-04-26T18:23:51.614 DEBUG:teuthology.orchestra.run.smithi080:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-26T18:23:51.997 INFO:teuthology.orchestra.run.smithi080.stdout:-rw-r--r--. 1 ubuntu ubuntu 781590 Apr 26 18:23 /home/ubuntu/cephtest/cephadm 2024-04-26T18:23:51.997 DEBUG:teuthology.orchestra.run.smithi082:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-26T18:23:52.579 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r--. 1 ubuntu ubuntu 781590 Apr 26 18:23 /home/ubuntu/cephtest/cephadm 2024-04-26T18:23:52.579 DEBUG:teuthology.orchestra.run.smithi192:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-26T18:23:53.108 INFO:teuthology.orchestra.run.smithi192.stdout:-rw-r--r--. 1 ubuntu ubuntu 781590 Apr 26 18:23 /home/ubuntu/cephtest/cephadm 2024-04-26T18:23:53.108 DEBUG:teuthology.orchestra.run.smithi080:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-26T18:23:53.126 DEBUG:teuthology.orchestra.run.smithi082:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-26T18:23:53.143 DEBUG:teuthology.orchestra.run.smithi192:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-26T18:23:53.181 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 on all hosts... 2024-04-26T18:23:53.181 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 pull 2024-04-26T18:23:53.183 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 pull 2024-04-26T18:23:53.185 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 pull 2024-04-26T18:23:54.747 INFO:teuthology.orchestra.run.smithi080.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1... 2024-04-26T18:23:54.772 INFO:teuthology.orchestra.run.smithi192.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1... 2024-04-26T18:23:54.862 INFO:teuthology.orchestra.run.smithi082.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1... 2024-04-26T18:24:26.194 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T18:24:26.194 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev)", 2024-04-26T18:24:26.194 INFO:teuthology.orchestra.run.smithi082.stdout: "image_id": "3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555", 2024-04-26T18:24:26.194 INFO:teuthology.orchestra.run.smithi082.stdout: "repo_digests": [ 2024-04-26T18:24:26.194 INFO:teuthology.orchestra.run.smithi082.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc" 2024-04-26T18:24:26.194 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T18:24:26.194 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T18:24:46.773 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-04-26T18:24:46.773 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_version": "ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev)", 2024-04-26T18:24:46.773 INFO:teuthology.orchestra.run.smithi192.stdout: "image_id": "3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555", 2024-04-26T18:24:46.773 INFO:teuthology.orchestra.run.smithi192.stdout: "repo_digests": [ 2024-04-26T18:24:46.773 INFO:teuthology.orchestra.run.smithi192.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc" 2024-04-26T18:24:46.773 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-04-26T18:24:46.774 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-04-26T18:24:49.713 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:24:49.716 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_version": "ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev)", 2024-04-26T18:24:49.716 INFO:teuthology.orchestra.run.smithi080.stdout: "image_id": "3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555", 2024-04-26T18:24:49.716 INFO:teuthology.orchestra.run.smithi080.stdout: "repo_digests": [ 2024-04-26T18:24:49.716 INFO:teuthology.orchestra.run.smithi080.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc" 2024-04-26T18:24:49.716 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-26T18:24:49.717 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:24:49.738 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /etc/ceph 2024-04-26T18:24:49.780 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph 2024-04-26T18:24:49.813 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /etc/ceph 2024-04-26T18:24:49.844 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 777 /etc/ceph 2024-04-26T18:24:49.869 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /etc/ceph 2024-04-26T18:24:49.897 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 777 /etc/ceph 2024-04-26T18:24:49.924 INFO:tasks.cephadm:Writing seed config... 2024-04-26T18:24:49.925 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-26T18:24:49.925 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-26T18:24:49.925 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-26T18:24:49.925 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-26T18:24:49.925 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-26T18:24:49.925 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-04-26T18:24:49.925 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-26T18:24:49.925 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-26T18:24:49.925 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-26T18:24:49.925 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-04-26T18:24:49.926 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-04-26T18:24:49.926 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-04-26T18:24:49.926 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-04-26T18:24:49.926 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-26T18:24:49.926 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-26T18:24:49.926 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-26T18:24:49.926 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-26T18:24:49.926 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-04-26T18:24:49.926 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-26T18:24:49.926 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-26T18:24:49.926 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-26T18:24:49.926 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-04-26T18:24:49.926 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-04-26T18:24:49.926 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-26T18:24:49.927 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-26T18:24:49.927 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-26T18:24:49.927 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-26T18:24:49.927 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-26T18:24:49.927 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-26T18:24:49.927 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-26T18:24:49.927 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-26T18:24:49.927 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-26T18:24:49.927 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-04-26T18:24:49.927 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-26T18:24:49.927 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-04-26T18:24:49.927 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-04-26T18:24:49.927 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-26T18:24:49.927 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-26T18:24:49.927 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-04-26T18:24:49.927 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-26T18:24:49.928 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-26T18:24:49.928 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-26T18:24:49.928 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-26T18:24:49.928 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-26T18:24:49.928 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-26T18:24:49.928 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-04-26T18:24:49.928 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-04-26T18:24:49.929 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T18:24:49.929 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-26T18:24:49.944 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 2187ca98-03fa-11ef-bc93-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-26T18:24:49.944 DEBUG:teuthology.orchestra.run.smithi080:mon.a> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mon.a.service 2024-04-26T18:24:49.986 DEBUG:teuthology.orchestra.run.smithi080:mgr.x> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mgr.x.service 2024-04-26T18:24:50.029 INFO:tasks.cephadm:Bootstrapping... 2024-04-26T18:24:50.029 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 -v bootstrap --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.80 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-26T18:24:50.216 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-04-26T18:24:50.216 INFO:teuthology.orchestra.run.smithi080.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', '-v', 'bootstrap', '--fsid', '2187ca98-03fa-11ef-bc93-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.80', '--skip-admin-label'] 2024-04-26T18:24:50.217 INFO:teuthology.orchestra.run.smithi080.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-26T18:24:50.217 INFO:teuthology.orchestra.run.smithi080.stdout:Verifying podman|docker is present... 2024-04-26T18:24:50.242 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-26T18:24:50.242 INFO:teuthology.orchestra.run.smithi080.stdout:Verifying lvm2 is present... 2024-04-26T18:24:50.242 INFO:teuthology.orchestra.run.smithi080.stdout:Verifying time synchronization is in place... 2024-04-26T18:24:50.249 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-26T18:24:50.249 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-26T18:24:50.255 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-26T18:24:50.255 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout inactive 2024-04-26T18:24:50.261 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout enabled 2024-04-26T18:24:50.267 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout active 2024-04-26T18:24:50.268 INFO:teuthology.orchestra.run.smithi080.stdout:Unit chronyd.service is enabled and running 2024-04-26T18:24:50.268 INFO:teuthology.orchestra.run.smithi080.stdout:Repeating the final host check... 2024-04-26T18:24:50.290 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-26T18:24:50.291 INFO:teuthology.orchestra.run.smithi080.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-26T18:24:50.291 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl is present 2024-04-26T18:24:50.291 INFO:teuthology.orchestra.run.smithi080.stdout:lvcreate is present 2024-04-26T18:24:50.297 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-26T18:24:50.297 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-26T18:24:50.303 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-26T18:24:50.303 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout inactive 2024-04-26T18:24:50.309 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout enabled 2024-04-26T18:24:50.315 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout active 2024-04-26T18:24:50.315 INFO:teuthology.orchestra.run.smithi080.stdout:Unit chronyd.service is enabled and running 2024-04-26T18:24:50.315 INFO:teuthology.orchestra.run.smithi080.stdout:Host looks OK 2024-04-26T18:24:50.315 INFO:teuthology.orchestra.run.smithi080.stdout:Cluster fsid: 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:24:50.316 INFO:teuthology.orchestra.run.smithi080.stdout:Acquiring lock 140328655850656 on /run/cephadm/2187ca98-03fa-11ef-bc93-c7b262605968.lock 2024-04-26T18:24:50.316 INFO:teuthology.orchestra.run.smithi080.stdout:Lock 140328655850656 acquired on /run/cephadm/2187ca98-03fa-11ef-bc93-c7b262605968.lock 2024-04-26T18:24:50.316 INFO:teuthology.orchestra.run.smithi080.stdout:Verifying IP 172.21.15.80 port 3300 ... 2024-04-26T18:24:50.316 INFO:teuthology.orchestra.run.smithi080.stdout:Verifying IP 172.21.15.80 port 6789 ... 2024-04-26T18:24:50.316 INFO:teuthology.orchestra.run.smithi080.stdout:Base mon IP(s) is [172.21.15.80:3300, 172.21.15.80:6789], mon addrv is [v2:172.21.15.80:3300,v1:172.21.15.80:6789] 2024-04-26T18:24:50.319 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.80 metric 100 2024-04-26T18:24:50.319 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.80 metric 100 2024-04-26T18:24:50.322 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-26T18:24:50.322 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-04-26T18:24:50.322 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-04-26T18:24:50.324 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-26T18:24:50.324 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-26T18:24:50.324 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-26T18:24:50.324 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-04-26T18:24:50.325 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout inet6 fe80::476c:c833:d463:130a/64 scope link noprefixroute 2024-04-26T18:24:50.325 INFO:teuthology.orchestra.run.smithi080.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-26T18:24:50.325 INFO:teuthology.orchestra.run.smithi080.stdout:Mon IP `172.21.15.80` is in CIDR network `172.21.0.0/20` 2024-04-26T18:24:50.325 INFO:teuthology.orchestra.run.smithi080.stdout:Mon IP `172.21.15.80` is in CIDR network `172.21.0.0/20` 2024-04-26T18:24:50.325 INFO:teuthology.orchestra.run.smithi080.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-26T18:24:50.326 INFO:teuthology.orchestra.run.smithi080.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-26T18:24:50.326 INFO:teuthology.orchestra.run.smithi080.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1... 2024-04-26T18:24:50.807 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stdout 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 2024-04-26T18:24:50.807 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1... 2024-04-26T18:24:50.808 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stderr Getting image source signatures 2024-04-26T18:24:50.808 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stderr Copying blob sha256:449452a284afe5840255d087488a224329a4679c5f5d200bb867a639c75ddfd2 2024-04-26T18:24:50.808 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stderr Copying blob sha256:3d665f4c032644be9cae748af04bee69f2bfe96cdc3616dabe0ab17899633ab5 2024-04-26T18:24:50.808 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stderr Copying config sha256:3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 2024-04-26T18:24:50.808 INFO:teuthology.orchestra.run.smithi080.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-26T18:24:51.637 INFO:teuthology.orchestra.run.smithi080.stdout:ceph: stdout ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:24:51.637 INFO:teuthology.orchestra.run.smithi080.stdout:Ceph version: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:24:51.637 INFO:teuthology.orchestra.run.smithi080.stdout:Extracting ceph user uid/gid from container image... 2024-04-26T18:24:52.458 INFO:teuthology.orchestra.run.smithi080.stdout:stat: stdout 167 167 2024-04-26T18:24:52.458 INFO:teuthology.orchestra.run.smithi080.stdout:Creating initial keys... 2024-04-26T18:24:53.510 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph-authtool: stdout AQB08StmzzT/LhAAz5E8j9Dq3F0PIhKTcJNGAQ== 2024-04-26T18:24:54.484 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph-authtool: stdout AQB18StmHLJfMBAAMWt6PSJNLYKnJmEetzh+4g== 2024-04-26T18:24:55.501 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph-authtool: stdout AQB28StmS1BZMBAA7OSB/mKr+j53y8dU3oBG0Q== 2024-04-26T18:24:55.502 INFO:teuthology.orchestra.run.smithi080.stdout:Creating initial monmap... 2024-04-26T18:24:56.416 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-26T18:24:56.416 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-04-26T18:24:56.416 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:24:56.417 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-26T18:24:56.417 INFO:teuthology.orchestra.run.smithi080.stdout:monmaptool for a [v2:172.21.15.80:3300,v1:172.21.15.80:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-26T18:24:56.417 INFO:teuthology.orchestra.run.smithi080.stdout:setting min_mon_release = quincy 2024-04-26T18:24:56.417 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/monmaptool: set fsid to 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:24:56.417 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-26T18:24:56.417 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:24:56.417 INFO:teuthology.orchestra.run.smithi080.stdout:Creating mon... 2024-04-26T18:24:57.364 INFO:teuthology.orchestra.run.smithi080.stdout:create mon.a on 2024-04-26T18:24:57.566 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-26T18:24:57.732 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-26T18:24:57.935 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-2187ca98-03fa-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-2187ca98-03fa-11ef-bc93-c7b262605968.target. 2024-04-26T18:24:57.935 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-2187ca98-03fa-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-2187ca98-03fa-11ef-bc93-c7b262605968.target. 2024-04-26T18:24:58.191 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mon.a 2024-04-26T18:24:58.191 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Failed to reset failed state of unit ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mon.a.service: Unit ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mon.a.service not loaded. 2024-04-26T18:24:58.371 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-2187ca98-03fa-11ef-bc93-c7b262605968.target.wants/ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mon.a.service → /etc/systemd/system/ceph-2187ca98-03fa-11ef-bc93-c7b262605968@.service. 2024-04-26T18:24:58.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:24:58 smithi080 ceph-mon[28760]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-26T18:24:58.866 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T18:24:58.866 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout disabled 2024-04-26T18:24:58.873 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T18:24:58.873 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout inactive 2024-04-26T18:24:58.873 INFO:teuthology.orchestra.run.smithi080.stdout:firewalld.service is not enabled 2024-04-26T18:24:58.873 INFO:teuthology.orchestra.run.smithi080.stdout:Not possible to enable service . firewalld.service is not available 2024-04-26T18:24:58.873 INFO:teuthology.orchestra.run.smithi080.stdout:Waiting for mon to start... 2024-04-26T18:24:58.873 INFO:teuthology.orchestra.run.smithi080.stdout:Waiting for mon... 2024-04-26T18:24:59.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:24:58 smithi080 bash[28741]: 7087833204f9b0913eb3a114b8548ad4f066503587000853ab09bb07b81ce330 2024-04-26T18:24:59.101 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:24:58 smithi080 systemd[1]: Started Ceph mon.a for 2187ca98-03fa-11ef-bc93-c7b262605968. 2024-04-26T18:24:59.885 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout cluster: 2024-04-26T18:24:59.885 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout id: 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:24:59.885 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-26T18:24:59.885 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2024-04-26T18:24:59.885 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout services: 2024-04-26T18:24:59.885 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.582307s) 2024-04-26T18:24:59.885 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-26T18:24:59.885 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-26T18:24:59.885 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2024-04-26T18:24:59.885 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout data: 2024-04-26T18:24:59.885 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-26T18:24:59.885 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-26T18:24:59.885 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-26T18:24:59.886 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout pgs: 2024-04-26T18:24:59.886 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2024-04-26T18:24:59.886 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.314+0000 7fd09cee7700 1 Processor -- start 2024-04-26T18:24:59.886 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.314+0000 7fd09cee7700 1 -- start start 2024-04-26T18:24:59.886 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.314+0000 7fd09cee7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd098107d10 0x7fd098108130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:59.886 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.314+0000 7fd09cee7700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd098108700 con 0x7fd098107d10 2024-04-26T18:24:59.886 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.315+0000 7fd09659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd098107d10 0x7fd098108130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:59.886 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.315+0000 7fd09659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd098107d10 0x7fd098108130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54752/0 (socket says 172.21.15.80:54752) 2024-04-26T18:24:59.886 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.315+0000 7fd09659c700 1 -- 172.21.15.80:0/1947548798 learned_addr learned my addr 172.21.15.80:0/1947548798 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:24:59.886 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.315+0000 7fd09659c700 1 -- 172.21.15.80:0/1947548798 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd098108f10 con 0x7fd098107d10 2024-04-26T18:24:59.886 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.315+0000 7fd09659c700 1 --2- 172.21.15.80:0/1947548798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd098107d10 0x7fd098108130 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd0880098a0 tx=0x7fd088009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762c3910c9fdf360 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:24:59.886 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.315+0000 7fd09559a700 1 -- 172.21.15.80:0/1947548798 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd088004160 con 0x7fd098107d10 2024-04-26T18:24:59.886 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.315+0000 7fd09559a700 1 -- 172.21.15.80:0/1947548798 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd088004300 con 0x7fd098107d10 2024-04-26T18:24:59.886 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.315+0000 7fd09559a700 1 -- 172.21.15.80:0/1947548798 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0880036a0 con 0x7fd098107d10 2024-04-26T18:24:59.887 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.316+0000 7fd09cee7700 1 -- 172.21.15.80:0/1947548798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd098107d10 msgr2=0x7fd098108130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:59.887 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.316+0000 7fd09cee7700 1 --2- 172.21.15.80:0/1947548798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd098107d10 0x7fd098108130 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd0880098a0 tx=0x7fd088009bb0 comp rx=0 tx=0).stop 2024-04-26T18:24:59.887 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.316+0000 7fd09cee7700 1 -- 172.21.15.80:0/1947548798 shutdown_connections 2024-04-26T18:24:59.887 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.316+0000 7fd09cee7700 1 --2- 172.21.15.80:0/1947548798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd098107d10 0x7fd098108130 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:59.887 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.316+0000 7fd09cee7700 1 -- 172.21.15.80:0/1947548798 >> 172.21.15.80:0/1947548798 conn(0x7fd098103290 msgr2=0x7fd0981056f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:24:59.887 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.316+0000 7fd09cee7700 1 -- 172.21.15.80:0/1947548798 shutdown_connections 2024-04-26T18:24:59.887 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.316+0000 7fd09cee7700 1 -- 172.21.15.80:0/1947548798 wait complete. 2024-04-26T18:24:59.887 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.317+0000 7fd09cee7700 1 Processor -- start 2024-04-26T18:24:59.887 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.317+0000 7fd09cee7700 1 -- start start 2024-04-26T18:24:59.887 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.317+0000 7fd09cee7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd098107d10 0x7fd09819b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:59.887 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.317+0000 7fd09cee7700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd098109440 con 0x7fd098107d10 2024-04-26T18:24:59.887 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.317+0000 7fd09659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd098107d10 0x7fd09819b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:59.887 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.317+0000 7fd09659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd098107d10 0x7fd09819b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54766/0 (socket says 172.21.15.80:54766) 2024-04-26T18:24:59.887 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.317+0000 7fd09659c700 1 -- 172.21.15.80:0/1008689714 learned_addr learned my addr 172.21.15.80:0/1008689714 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:24:59.888 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.317+0000 7fd09659c700 1 -- 172.21.15.80:0/1008689714 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd09819b9c0 con 0x7fd098107d10 2024-04-26T18:24:59.888 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.318+0000 7fd09659c700 1 --2- 172.21.15.80:0/1008689714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd098107d10 0x7fd09819b480 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd0981089a0 tx=0x7fd088004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:24:59.888 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.318+0000 7fd0877fe700 1 -- 172.21.15.80:0/1008689714 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd088003db0 con 0x7fd098107d10 2024-04-26T18:24:59.888 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.318+0000 7fd0877fe700 1 -- 172.21.15.80:0/1008689714 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd088011630 con 0x7fd098107d10 2024-04-26T18:24:59.888 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.318+0000 7fd09cee7700 1 -- 172.21.15.80:0/1008689714 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd09819bc50 con 0x7fd098107d10 2024-04-26T18:24:59.888 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.318+0000 7fd0877fe700 1 -- 172.21.15.80:0/1008689714 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd088011930 con 0x7fd098107d10 2024-04-26T18:24:59.888 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.318+0000 7fd09cee7700 1 -- 172.21.15.80:0/1008689714 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd09819e940 con 0x7fd098107d10 2024-04-26T18:24:59.888 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.318+0000 7fd0877fe700 1 -- 172.21.15.80:0/1008689714 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd088024480 con 0x7fd098107d10 2024-04-26T18:24:59.888 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.318+0000 7fd0877fe700 1 -- 172.21.15.80:0/1008689714 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd08801a7a0 con 0x7fd098107d10 2024-04-26T18:24:59.888 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.319+0000 7fd09cee7700 1 -- 172.21.15.80:0/1008689714 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd098064a80 con 0x7fd098107d10 2024-04-26T18:24:59.888 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.321+0000 7fd0877fe700 1 -- 172.21.15.80:0/1008689714 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd088043e50 con 0x7fd098107d10 2024-04-26T18:24:59.888 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.389+0000 7fd09cee7700 1 -- 172.21.15.80:0/1008689714 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fd09802e5e0 con 0x7fd098107d10 2024-04-26T18:24:59.888 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.390+0000 7fd0877fe700 1 -- 172.21.15.80:0/1008689714 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fd088032070 con 0x7fd098107d10 2024-04-26T18:24:59.888 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.390+0000 7fd09cee7700 1 -- 172.21.15.80:0/1008689714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd098107d10 msgr2=0x7fd09819b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:59.888 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.390+0000 7fd09cee7700 1 --2- 172.21.15.80:0/1008689714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd098107d10 0x7fd09819b480 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd0981089a0 tx=0x7fd088004750 comp rx=0 tx=0).stop 2024-04-26T18:24:59.889 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.390+0000 7fd09cee7700 1 -- 172.21.15.80:0/1008689714 shutdown_connections 2024-04-26T18:24:59.889 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.390+0000 7fd09cee7700 1 --2- 172.21.15.80:0/1008689714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd098107d10 0x7fd09819b480 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:59.889 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.390+0000 7fd09cee7700 1 -- 172.21.15.80:0/1008689714 >> 172.21.15.80:0/1008689714 conn(0x7fd098103290 msgr2=0x7fd098192160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:24:59.889 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.390+0000 7fd09cee7700 1 -- 172.21.15.80:0/1008689714 shutdown_connections 2024-04-26T18:24:59.889 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:24:59.391+0000 7fd09cee7700 1 -- 172.21.15.80:0/1008689714 wait complete. 2024-04-26T18:24:59.889 INFO:teuthology.orchestra.run.smithi080.stdout:mon is available 2024-04-26T18:24:59.889 INFO:teuthology.orchestra.run.smithi080.stdout:Assimilating anything we can from ceph.conf... 2024-04-26T18:24:59.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:24:59 smithi080 ceph-mon[28760]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-26T18:24:59.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:24:59 smithi080 ceph-mon[28760]: monmap epoch 1 2024-04-26T18:24:59.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:24:59 smithi080 ceph-mon[28760]: fsid 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:24:59.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:24:59 smithi080 ceph-mon[28760]: last_changed 2024-04-26T18:24:55.824625+0000 2024-04-26T18:24:59.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:24:59 smithi080 ceph-mon[28760]: created 2024-04-26T18:24:55.824625+0000 2024-04-26T18:24:59.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:24:59 smithi080 ceph-mon[28760]: min_mon_release 19 (squid) 2024-04-26T18:24:59.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:24:59 smithi080 ceph-mon[28760]: election_strategy: 1 2024-04-26T18:24:59.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:24:59 smithi080 ceph-mon[28760]: 0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-04-26T18:24:59.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:24:59 smithi080 ceph-mon[28760]: fsmap 2024-04-26T18:24:59.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:24:59 smithi080 ceph-mon[28760]: osdmap e1: 0 total, 0 up, 0 in 2024-04-26T18:24:59.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:24:59 smithi080 ceph-mon[28760]: mgrmap e1: no daemons active 2024-04-26T18:24:59.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:24:59 smithi080 ceph-mon[28760]: from='client.? 172.21.15.80:0/1008689714' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-26T18:25:00.986 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:00 smithi080 ceph-mon[28760]: from='client.? 172.21.15.80:0/2999495813' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-26T18:25:00.986 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:00 smithi080 ceph-mon[28760]: from='client.? 172.21.15.80:0/2999495813' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-26T18:25:00.995 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2024-04-26T18:25:00.995 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout [global] 2024-04-26T18:25:00.995 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout fsid = 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:25:00.995 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-04-26T18:25:00.995 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.80:3300,v1:172.21.15.80:6789] 2024-04-26T18:25:00.996 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-26T18:25:00.996 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-26T18:25:00.996 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-26T18:25:00.996 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-26T18:25:00.996 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2024-04-26T18:25:00.996 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-26T18:25:00.996 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-26T18:25:00.996 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2024-04-26T18:25:00.996 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout [osd] 2024-04-26T18:25:00.996 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-26T18:25:00.996 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-26T18:25:00.996 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-26T18:25:00.996 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-26T18:25:00.996 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-26T18:25:00.996 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.310+0000 7f18910f8700 1 Processor -- start 2024-04-26T18:25:00.997 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.310+0000 7f18910f8700 1 -- start start 2024-04-26T18:25:00.997 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.310+0000 7f18910f8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f188c107d30 0x7f188c108150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:00.997 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.310+0000 7f18910f8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f188c108720 con 0x7f188c107d30 2024-04-26T18:25:00.997 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.311+0000 7f188ad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f188c107d30 0x7f188c108150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:00.997 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.311+0000 7f188ad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f188c107d30 0x7f188c108150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54778/0 (socket says 172.21.15.80:54778) 2024-04-26T18:25:00.997 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.311+0000 7f188ad9d700 1 -- 172.21.15.80:0/2304883326 learned_addr learned my addr 172.21.15.80:0/2304883326 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:00.997 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.311+0000 7f188ad9d700 1 -- 172.21.15.80:0/2304883326 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188c108f30 con 0x7f188c107d30 2024-04-26T18:25:00.997 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.311+0000 7f188ad9d700 1 --2- 172.21.15.80:0/2304883326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f188c107d30 0x7f188c108150 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f187c0098a0 tx=0x7f187c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2cf9cb06d4bf8d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:00.997 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.311+0000 7f1889d9b700 1 -- 172.21.15.80:0/2304883326 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f187c004160 con 0x7f188c107d30 2024-04-26T18:25:00.997 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.311+0000 7f1889d9b700 1 -- 172.21.15.80:0/2304883326 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187c004300 con 0x7f188c107d30 2024-04-26T18:25:00.997 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.311+0000 7f1889d9b700 1 -- 172.21.15.80:0/2304883326 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f187c0036a0 con 0x7f188c107d30 2024-04-26T18:25:00.997 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.312+0000 7f18910f8700 1 -- 172.21.15.80:0/2304883326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f188c107d30 msgr2=0x7f188c108150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:00.997 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.312+0000 7f18910f8700 1 --2- 172.21.15.80:0/2304883326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f188c107d30 0x7f188c108150 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f187c0098a0 tx=0x7f187c009bb0 comp rx=0 tx=0).stop 2024-04-26T18:25:00.997 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.312+0000 7f18910f8700 1 -- 172.21.15.80:0/2304883326 shutdown_connections 2024-04-26T18:25:00.997 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.312+0000 7f18910f8700 1 --2- 172.21.15.80:0/2304883326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f188c107d30 0x7f188c108150 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:00.998 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.312+0000 7f18910f8700 1 -- 172.21.15.80:0/2304883326 >> 172.21.15.80:0/2304883326 conn(0x7f188c103290 msgr2=0x7f188c105710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:00.998 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.312+0000 7f18910f8700 1 -- 172.21.15.80:0/2304883326 shutdown_connections 2024-04-26T18:25:00.998 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.312+0000 7f18910f8700 1 -- 172.21.15.80:0/2304883326 wait complete. 2024-04-26T18:25:00.998 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.313+0000 7f18910f8700 1 Processor -- start 2024-04-26T18:25:00.998 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.313+0000 7f18910f8700 1 -- start start 2024-04-26T18:25:00.998 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.313+0000 7f18910f8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f188c107d30 0x7f188c07ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:00.998 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.313+0000 7f18910f8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f188c109460 con 0x7f188c107d30 2024-04-26T18:25:00.998 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.313+0000 7f188ad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f188c107d30 0x7f188c07ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:00.998 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.313+0000 7f188ad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f188c107d30 0x7f188c07ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54790/0 (socket says 172.21.15.80:54790) 2024-04-26T18:25:00.998 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.313+0000 7f188ad9d700 1 -- 172.21.15.80:0/2999495813 learned_addr learned my addr 172.21.15.80:0/2999495813 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:00.998 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.313+0000 7f188ad9d700 1 -- 172.21.15.80:0/2999495813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188c19d0e0 con 0x7f188c107d30 2024-04-26T18:25:00.998 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.314+0000 7f188ad9d700 1 --2- 172.21.15.80:0/2999495813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f188c107d30 0x7f188c07ca10 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f187c000c00 tx=0x7f187c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:00.998 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.314+0000 7f1873fff700 1 -- 172.21.15.80:0/2999495813 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f187c003db0 con 0x7f188c107d30 2024-04-26T18:25:00.998 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.314+0000 7f1873fff700 1 -- 172.21.15.80:0/2999495813 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187c011630 con 0x7f188c107d30 2024-04-26T18:25:00.998 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.314+0000 7f18910f8700 1 -- 172.21.15.80:0/2999495813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f188c1a16f0 con 0x7f188c107d30 2024-04-26T18:25:00.998 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.314+0000 7f1873fff700 1 -- 172.21.15.80:0/2999495813 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f187c011950 con 0x7f188c107d30 2024-04-26T18:25:00.999 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.314+0000 7f18910f8700 1 -- 172.21.15.80:0/2999495813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f188c1a1a90 con 0x7f188c107d30 2024-04-26T18:25:00.999 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.314+0000 7f1873fff700 1 -- 172.21.15.80:0/2999495813 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f187c01a460 con 0x7f188c107d30 2024-04-26T18:25:00.999 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.314+0000 7f1873fff700 1 -- 172.21.15.80:0/2999495813 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f187c01b780 con 0x7f188c107d30 2024-04-26T18:25:00.999 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.315+0000 7f18910f8700 1 -- 172.21.15.80:0/2999495813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f188c064a80 con 0x7f188c107d30 2024-04-26T18:25:00.999 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.317+0000 7f1873fff700 1 -- 172.21.15.80:0/2999495813 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f187c031020 con 0x7f188c107d30 2024-04-26T18:25:00.999 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.385+0000 7f18910f8700 1 -- 172.21.15.80:0/2999495813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f188c02e880 con 0x7f188c107d30 2024-04-26T18:25:00.999 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.388+0000 7f1873fff700 1 -- 172.21.15.80:0/2999495813 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+465 (secure 0 0 0) 0x7f187c01b9d0 con 0x7f188c107d30 2024-04-26T18:25:00.999 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.389+0000 7f1873fff700 1 -- 172.21.15.80:0/2999495813 <== mon.0 v2:172.21.15.80:3300/0 8 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f187c01ad70 con 0x7f188c107d30 2024-04-26T18:25:00.999 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.390+0000 7f18910f8700 1 -- 172.21.15.80:0/2999495813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f188c107d30 msgr2=0x7f188c07ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:00.999 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.390+0000 7f18910f8700 1 --2- 172.21.15.80:0/2999495813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f188c107d30 0x7f188c07ca10 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f187c000c00 tx=0x7f187c004750 comp rx=0 tx=0).stop 2024-04-26T18:25:00.999 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.390+0000 7f18910f8700 1 -- 172.21.15.80:0/2999495813 shutdown_connections 2024-04-26T18:25:00.999 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.390+0000 7f18910f8700 1 --2- 172.21.15.80:0/2999495813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f188c107d30 0x7f188c07ca10 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:00.999 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.390+0000 7f18910f8700 1 -- 172.21.15.80:0/2999495813 >> 172.21.15.80:0/2999495813 conn(0x7f188c103290 msgr2=0x7f188c1920e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:00.999 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.390+0000 7f18910f8700 1 -- 172.21.15.80:0/2999495813 shutdown_connections 2024-04-26T18:25:00.999 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:00.390+0000 7f18910f8700 1 -- 172.21.15.80:0/2999495813 wait complete. 2024-04-26T18:25:01.000 INFO:teuthology.orchestra.run.smithi080.stdout:Generating new minimal ceph.conf... 2024-04-26T18:25:02.225 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:01 smithi080 ceph-mon[28760]: from='client.? 172.21.15.80:0/3820687773' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:25:02.232 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.410+0000 7f9e04147700 1 Processor -- start 2024-04-26T18:25:02.233 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.410+0000 7f9e04147700 1 -- start start 2024-04-26T18:25:02.233 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.410+0000 7f9e04147700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dfc108dc0 0x7f9dfc1091e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:02.233 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.410+0000 7f9e04147700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc1097b0 con 0x7f9dfc108dc0 2024-04-26T18:25:02.233 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.411+0000 7f9e01ee3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dfc108dc0 0x7f9dfc1091e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:02.233 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.411+0000 7f9e01ee3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dfc108dc0 0x7f9dfc1091e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54794/0 (socket says 172.21.15.80:54794) 2024-04-26T18:25:02.233 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.411+0000 7f9e01ee3700 1 -- 172.21.15.80:0/47493647 learned_addr learned my addr 172.21.15.80:0/47493647 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:02.233 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.411+0000 7f9e01ee3700 1 -- 172.21.15.80:0/47493647 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dfc109fc0 con 0x7f9dfc108dc0 2024-04-26T18:25:02.233 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.411+0000 7f9e01ee3700 1 --2- 172.21.15.80:0/47493647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dfc108dc0 0x7f9dfc1091e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9dec0098a0 tx=0x7f9dec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15aa43a86401b1c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:02.233 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.411+0000 7f9e00ee1700 1 -- 172.21.15.80:0/47493647 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dec004160 con 0x7f9dfc108dc0 2024-04-26T18:25:02.233 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.411+0000 7f9e00ee1700 1 -- 172.21.15.80:0/47493647 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f9dec004300 con 0x7f9dfc108dc0 2024-04-26T18:25:02.233 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.411+0000 7f9e00ee1700 1 -- 172.21.15.80:0/47493647 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dec011af0 con 0x7f9dfc108dc0 2024-04-26T18:25:02.233 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.412+0000 7f9e04147700 1 -- 172.21.15.80:0/47493647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dfc108dc0 msgr2=0x7f9dfc1091e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:02.233 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.412+0000 7f9e04147700 1 --2- 172.21.15.80:0/47493647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dfc108dc0 0x7f9dfc1091e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9dec0098a0 tx=0x7f9dec009bb0 comp rx=0 tx=0).stop 2024-04-26T18:25:02.234 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.412+0000 7f9e04147700 1 -- 172.21.15.80:0/47493647 shutdown_connections 2024-04-26T18:25:02.234 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.412+0000 7f9e04147700 1 --2- 172.21.15.80:0/47493647 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dfc108dc0 0x7f9dfc1091e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:02.234 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.412+0000 7f9e04147700 1 -- 172.21.15.80:0/47493647 >> 172.21.15.80:0/47493647 conn(0x7f9dfc104380 msgr2=0x7f9dfc1067a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:02.234 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.412+0000 7f9e04147700 1 -- 172.21.15.80:0/47493647 shutdown_connections 2024-04-26T18:25:02.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.412+0000 7f9e04147700 1 -- 172.21.15.80:0/47493647 wait complete. 2024-04-26T18:25:02.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.413+0000 7f9e04147700 1 Processor -- start 2024-04-26T18:25:02.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.413+0000 7f9e04147700 1 -- start start 2024-04-26T18:25:02.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.413+0000 7f9e04147700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dfc108dc0 0x7f9dfc07f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:02.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.413+0000 7f9e04147700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc10d370 con 0x7f9dfc108dc0 2024-04-26T18:25:02.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.413+0000 7f9e01ee3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dfc108dc0 0x7f9dfc07f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:02.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.413+0000 7f9e01ee3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dfc108dc0 0x7f9dfc07f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54806/0 (socket says 172.21.15.80:54806) 2024-04-26T18:25:02.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.413+0000 7f9e01ee3700 1 -- 172.21.15.80:0/3820687773 learned_addr learned my addr 172.21.15.80:0/3820687773 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:02.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.413+0000 7f9e01ee3700 1 -- 172.21.15.80:0/3820687773 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dfc07f900 con 0x7f9dfc108dc0 2024-04-26T18:25:02.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.413+0000 7f9e01ee3700 1 --2- 172.21.15.80:0/3820687773 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dfc108dc0 0x7f9dfc07f3c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9dec000c00 tx=0x7f9dec011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:02.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.413+0000 7f9df2ffd700 1 -- 172.21.15.80:0/3820687773 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dec003b20 con 0x7f9dfc108dc0 2024-04-26T18:25:02.235 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.413+0000 7f9e04147700 1 -- 172.21.15.80:0/3820687773 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dfc07daf0 con 0x7f9dfc108dc0 2024-04-26T18:25:02.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.414+0000 7f9df2ffd700 1 -- 172.21.15.80:0/3820687773 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f9dec01a8c0 con 0x7f9dfc108dc0 2024-04-26T18:25:02.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.414+0000 7f9df2ffd700 1 -- 172.21.15.80:0/3820687773 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dec024940 con 0x7f9dfc108dc0 2024-04-26T18:25:02.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.414+0000 7f9e04147700 1 -- 172.21.15.80:0/3820687773 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dfc07e030 con 0x7f9dfc108dc0 2024-04-26T18:25:02.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.414+0000 7f9df2ffd700 1 -- 172.21.15.80:0/3820687773 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9dec022020 con 0x7f9dfc108dc0 2024-04-26T18:25:02.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.414+0000 7f9df2ffd700 1 -- 172.21.15.80:0/3820687773 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9dec0193c0 con 0x7f9dfc108dc0 2024-04-26T18:25:02.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.415+0000 7f9e04147700 1 -- 172.21.15.80:0/3820687773 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dfc064a80 con 0x7f9dfc108dc0 2024-04-26T18:25:02.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.417+0000 7f9df2ffd700 1 -- 172.21.15.80:0/3820687773 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f9dec02dde0 con 0x7f9dfc108dc0 2024-04-26T18:25:02.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.483+0000 7f9e04147700 1 -- 172.21.15.80:0/3820687773 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f9dfc07e370 con 0x7f9dfc108dc0 2024-04-26T18:25:02.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.484+0000 7f9df2ffd700 1 -- 172.21.15.80:0/3820687773 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f9dec0042c0 con 0x7f9dfc108dc0 2024-04-26T18:25:02.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.484+0000 7f9e04147700 1 -- 172.21.15.80:0/3820687773 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dfc108dc0 msgr2=0x7f9dfc07f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:02.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.484+0000 7f9e04147700 1 --2- 172.21.15.80:0/3820687773 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dfc108dc0 0x7f9dfc07f3c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9dec000c00 tx=0x7f9dec011b70 comp rx=0 tx=0).stop 2024-04-26T18:25:02.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.485+0000 7f9e04147700 1 -- 172.21.15.80:0/3820687773 shutdown_connections 2024-04-26T18:25:02.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.485+0000 7f9e04147700 1 --2- 172.21.15.80:0/3820687773 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dfc108dc0 0x7f9dfc07f3c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:02.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.485+0000 7f9e04147700 1 -- 172.21.15.80:0/3820687773 >> 172.21.15.80:0/3820687773 conn(0x7f9dfc104380 msgr2=0x7f9dfc104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:02.236 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.485+0000 7f9e04147700 1 -- 172.21.15.80:0/3820687773 shutdown_connections 2024-04-26T18:25:02.237 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:01.485+0000 7f9e04147700 1 -- 172.21.15.80:0/3820687773 wait complete. 2024-04-26T18:25:02.237 INFO:teuthology.orchestra.run.smithi080.stdout:Restarting the monitor... 2024-04-26T18:25:02.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:02 smithi080 systemd[1]: Stopping Ceph mon.a for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:25:02.862 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:02 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-a[28756]: 2024-04-26T18:25:02.503+0000 7f8c0e721700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:25:02.863 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:02 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-a[28756]: 2024-04-26T18:25:02.503+0000 7f8c0e721700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-26T18:25:02.863 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:02 smithi080 podman[29006]: 2024-04-26 18:25:02.586320066 +0000 UTC m=+0.192077418 container died 7087833204f9b0913eb3a114b8548ad4f066503587000853ab09bb07b81ce330 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T18:25:03.124 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:02 smithi080 podman[29006]: 2024-04-26 18:25:02.97105557 +0000 UTC m=+0.576812915 container cleanup 7087833204f9b0913eb3a114b8548ad4f066503587000853ab09bb07b81ce330 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-26T18:25:03.124 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:02 smithi080 bash[29006]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-a 2024-04-26T18:25:03.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 podman[29020]: 2024-04-26 18:25:03.230308398 +0000 UTC m=+0.639391343 container remove 7087833204f9b0913eb3a114b8548ad4f066503587000853ab09bb07b81ce330 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-a, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-26T18:25:03.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 systemd[1]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mon.a.service: Deactivated successfully. 2024-04-26T18:25:03.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 systemd[1]: Stopped Ceph mon.a for 2187ca98-03fa-11ef-bc93-c7b262605968. 2024-04-26T18:25:03.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 systemd[1]: Starting Ceph mon.a for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:25:03.807 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 podman[29116]: 2024-04-26 18:25:03.46083138 +0000 UTC m=+0.018256209 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T18:25:03.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 podman[29116]: 2024-04-26 18:25:03.589385391 +0000 UTC m=+0.146810190 container create d90b35aa1c5e00f079bfd87dca615947476f14d53918d5752b1dbd3cf292741a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-a, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T18:25:03.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 podman[29116]: 2024-04-26 18:25:03.775087634 +0000 UTC m=+0.332512443 container init d90b35aa1c5e00f079bfd87dca615947476f14d53918d5752b1dbd3cf292741a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-04-26T18:25:03.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 podman[29116]: 2024-04-26 18:25:03.778131772 +0000 UTC m=+0.335556573 container start d90b35aa1c5e00f079bfd87dca615947476f14d53918d5752b1dbd3cf292741a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-a, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, ceph=True) 2024-04-26T18:25:03.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: set uid:gid to 167:167 (ceph:ceph) 2024-04-26T18:25:03.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev), process ceph-mon, pid 2 2024-04-26T18:25:03.808 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: pidfile_write: ignore empty --pid-file 2024-04-26T18:25:03.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: load: jerasure load: lrc 2024-04-26T18:25:03.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: RocksDB version: 7.9.2 2024-04-26T18:25:03.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Git sha 0 2024-04-26T18:25:03.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Compile date 2024-04-26 07:20:26 2024-04-26T18:25:03.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: DB SUMMARY 2024-04-26T18:25:03.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: DB Session ID: 6OHGZJPXKMA3BPOTP16G 2024-04-26T18:25:03.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: CURRENT file: CURRENT 2024-04-26T18:25:03.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: IDENTITY file: IDENTITY 2024-04-26T18:25:03.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-04-26T18:25:03.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-04-26T18:25:03.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105124 ; 2024-04-26T18:25:03.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.error_if_exists: 0 2024-04-26T18:25:03.810 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.create_if_missing: 0 2024-04-26T18:25:03.810 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.paranoid_checks: 1 2024-04-26T18:25:03.810 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-26T18:25:03.810 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-26T18:25:03.810 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-26T18:25:03.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.env: 0x55fa42f4acc0 2024-04-26T18:25:03.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.fs: PosixFileSystem 2024-04-26T18:25:03.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.info_log: 0x55fa446f7d80 2024-04-26T18:25:03.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_file_opening_threads: 16 2024-04-26T18:25:03.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.statistics: (nil) 2024-04-26T18:25:03.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.use_fsync: 0 2024-04-26T18:25:03.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_log_file_size: 0 2024-04-26T18:25:03.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-26T18:25:03.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-26T18:25:03.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.keep_log_file_num: 1000 2024-04-26T18:25:03.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.recycle_log_file_num: 0 2024-04-26T18:25:03.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.allow_fallocate: 1 2024-04-26T18:25:03.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.allow_mmap_reads: 0 2024-04-26T18:25:03.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.allow_mmap_writes: 0 2024-04-26T18:25:03.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.use_direct_reads: 0 2024-04-26T18:25:03.811 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-26T18:25:03.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.create_missing_column_families: 0 2024-04-26T18:25:03.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.db_log_dir: 2024-04-26T18:25:03.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.wal_dir: 2024-04-26T18:25:03.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-26T18:25:03.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-26T18:25:03.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-26T18:25:03.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-26T18:25:03.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-26T18:25:03.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-26T18:25:03.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.advise_random_on_open: 1 2024-04-26T18:25:03.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.db_write_buffer_size: 0 2024-04-26T18:25:03.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.write_buffer_manager: 0x55fa446c90e0 2024-04-26T18:25:03.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-26T18:25:03.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-26T18:25:03.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-26T18:25:03.812 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.rate_limiter: (nil) 2024-04-26T18:25:03.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-26T18:25:03.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.wal_recovery_mode: 2 2024-04-26T18:25:03.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.enable_thread_tracking: 0 2024-04-26T18:25:03.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.enable_pipelined_write: 0 2024-04-26T18:25:03.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.unordered_write: 0 2024-04-26T18:25:03.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-26T18:25:03.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-26T18:25:03.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-26T18:25:03.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-26T18:25:03.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.row_cache: None 2024-04-26T18:25:03.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.wal_filter: None 2024-04-26T18:25:03.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-26T18:25:03.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.allow_ingest_behind: 0 2024-04-26T18:25:03.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.two_write_queues: 0 2024-04-26T18:25:03.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.manual_wal_flush: 0 2024-04-26T18:25:03.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.wal_compression: 0 2024-04-26T18:25:03.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.atomic_flush: 0 2024-04-26T18:25:03.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-26T18:25:03.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-26T18:25:03.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-26T18:25:03.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.log_readahead_size: 0 2024-04-26T18:25:03.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-26T18:25:03.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.best_efforts_recovery: 0 2024-04-26T18:25:03.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-26T18:25:03.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-26T18:25:03.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.allow_data_in_errors: 0 2024-04-26T18:25:03.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.db_host_id: __hostname__ 2024-04-26T18:25:03.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-26T18:25:03.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_background_jobs: 2 2024-04-26T18:25:03.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_background_compactions: -1 2024-04-26T18:25:03.815 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_subcompactions: 1 2024-04-26T18:25:03.815 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-26T18:25:03.815 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-26T18:25:03.815 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-26T18:25:03.815 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_total_wal_size: 0 2024-04-26T18:25:03.815 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-26T18:25:03.815 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-26T18:25:03.815 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-26T18:25:03.815 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-26T18:25:03.815 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_open_files: -1 2024-04-26T18:25:03.815 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.bytes_per_sync: 0 2024-04-26T18:25:03.815 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-26T18:25:03.815 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-26T18:25:03.815 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.compaction_readahead_size: 0 2024-04-26T18:25:03.815 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_background_flushes: -1 2024-04-26T18:25:03.815 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Compression algorithms supported: 2024-04-26T18:25:03.816 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-26T18:25:03.816 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: kZSTD supported: 0 2024-04-26T18:25:03.816 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: kXpressCompression supported: 0 2024-04-26T18:25:03.816 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: kLZ4HCCompression supported: 1 2024-04-26T18:25:03.816 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: kZlibCompression supported: 1 2024-04-26T18:25:03.816 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: kSnappyCompression supported: 1 2024-04-26T18:25:03.816 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: kLZ4Compression supported: 1 2024-04-26T18:25:03.816 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: kBZip2Compression supported: 0 2024-04-26T18:25:03.816 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-26T18:25:03.816 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-26T18:25:03.816 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-26T18:25:03.816 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-26T18:25:03.816 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-26T18:25:03.817 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.merge_operator: 2024-04-26T18:25:03.817 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.compaction_filter: None 2024-04-26T18:25:03.817 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.compaction_filter_factory: None 2024-04-26T18:25:03.817 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.sst_partitioner_factory: None 2024-04-26T18:25:03.817 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-26T18:25:03.817 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-26T18:25:03.817 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55fa446f7f40) 2024-04-26T18:25:03.817 INFO:journalctl@ceph.mon.a.smithi080.stdout: cache_index_and_filter_blocks: 1 2024-04-26T18:25:03.817 INFO:journalctl@ceph.mon.a.smithi080.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-26T18:25:03.817 INFO:journalctl@ceph.mon.a.smithi080.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-26T18:25:03.817 INFO:journalctl@ceph.mon.a.smithi080.stdout: pin_top_level_index_and_filter: 1 2024-04-26T18:25:03.817 INFO:journalctl@ceph.mon.a.smithi080.stdout: index_type: 0 2024-04-26T18:25:03.817 INFO:journalctl@ceph.mon.a.smithi080.stdout: data_block_index_type: 0 2024-04-26T18:25:03.817 INFO:journalctl@ceph.mon.a.smithi080.stdout: index_shortening: 1 2024-04-26T18:25:03.817 INFO:journalctl@ceph.mon.a.smithi080.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-26T18:25:03.817 INFO:journalctl@ceph.mon.a.smithi080.stdout: checksum: 4 2024-04-26T18:25:03.818 INFO:journalctl@ceph.mon.a.smithi080.stdout: no_block_cache: 0 2024-04-26T18:25:03.818 INFO:journalctl@ceph.mon.a.smithi080.stdout: block_cache: 0x55fa446fb1f0 2024-04-26T18:25:03.818 INFO:journalctl@ceph.mon.a.smithi080.stdout: block_cache_name: BinnedLRUCache 2024-04-26T18:25:03.818 INFO:journalctl@ceph.mon.a.smithi080.stdout: block_cache_options: 2024-04-26T18:25:03.818 INFO:journalctl@ceph.mon.a.smithi080.stdout: capacity : 536870912 2024-04-26T18:25:03.818 INFO:journalctl@ceph.mon.a.smithi080.stdout: num_shard_bits : 4 2024-04-26T18:25:03.818 INFO:journalctl@ceph.mon.a.smithi080.stdout: strict_capacity_limit : 0 2024-04-26T18:25:03.818 INFO:journalctl@ceph.mon.a.smithi080.stdout: high_pri_pool_ratio: 0.000 2024-04-26T18:25:03.818 INFO:journalctl@ceph.mon.a.smithi080.stdout: block_cache_compressed: (nil) 2024-04-26T18:25:03.818 INFO:journalctl@ceph.mon.a.smithi080.stdout: persistent_cache: (nil) 2024-04-26T18:25:03.818 INFO:journalctl@ceph.mon.a.smithi080.stdout: block_size: 4096 2024-04-26T18:25:03.818 INFO:journalctl@ceph.mon.a.smithi080.stdout: block_size_deviation: 10 2024-04-26T18:25:03.818 INFO:journalctl@ceph.mon.a.smithi080.stdout: block_restart_interval: 16 2024-04-26T18:25:03.819 INFO:journalctl@ceph.mon.a.smithi080.stdout: index_block_restart_interval: 1 2024-04-26T18:25:03.819 INFO:journalctl@ceph.mon.a.smithi080.stdout: metadata_block_size: 4096 2024-04-26T18:25:03.819 INFO:journalctl@ceph.mon.a.smithi080.stdout: partition_filters: 0 2024-04-26T18:25:03.819 INFO:journalctl@ceph.mon.a.smithi080.stdout: use_delta_encoding: 1 2024-04-26T18:25:03.819 INFO:journalctl@ceph.mon.a.smithi080.stdout: filter_policy: bloomfilter 2024-04-26T18:25:03.819 INFO:journalctl@ceph.mon.a.smithi080.stdout: whole_key_filtering: 1 2024-04-26T18:25:03.819 INFO:journalctl@ceph.mon.a.smithi080.stdout: verify_compression: 0 2024-04-26T18:25:03.819 INFO:journalctl@ceph.mon.a.smithi080.stdout: read_amp_bytes_per_bit: 0 2024-04-26T18:25:03.819 INFO:journalctl@ceph.mon.a.smithi080.stdout: format_version: 5 2024-04-26T18:25:03.819 INFO:journalctl@ceph.mon.a.smithi080.stdout: enable_index_compression: 1 2024-04-26T18:25:03.819 INFO:journalctl@ceph.mon.a.smithi080.stdout: block_align: 0 2024-04-26T18:25:03.819 INFO:journalctl@ceph.mon.a.smithi080.stdout: max_auto_readahead_size: 262144 2024-04-26T18:25:03.819 INFO:journalctl@ceph.mon.a.smithi080.stdout: prepopulate_block_cache: 0 2024-04-26T18:25:03.819 INFO:journalctl@ceph.mon.a.smithi080.stdout: initial_auto_readahead_size: 8192 2024-04-26T18:25:03.819 INFO:journalctl@ceph.mon.a.smithi080.stdout: num_file_reads_for_auto_readahead: 2 2024-04-26T18:25:03.820 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.write_buffer_size: 33554432 2024-04-26T18:25:03.820 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_write_buffer_number: 2 2024-04-26T18:25:03.820 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.compression: NoCompression 2024-04-26T18:25:03.820 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.bottommost_compression: Disabled 2024-04-26T18:25:03.820 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.prefix_extractor: nullptr 2024-04-26T18:25:03.820 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-26T18:25:03.820 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.num_levels: 7 2024-04-26T18:25:03.820 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-26T18:25:03.820 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-26T18:25:03.820 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-26T18:25:03.820 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-26T18:25:03.820 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-26T18:25:03.820 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-26T18:25:03.820 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-26T18:25:03.820 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-26T18:25:03.820 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-26T18:25:03.820 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-26T18:25:03.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-26T18:25:03.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-26T18:25:03.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-26T18:25:03.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.compression_opts.level: 32767 2024-04-26T18:25:03.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.compression_opts.strategy: 0 2024-04-26T18:25:03.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-26T18:25:03.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-26T18:25:03.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-26T18:25:03.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-26T18:25:03.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.compression_opts.enabled: false 2024-04-26T18:25:03.821 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-26T18:25:03.822 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-26T18:25:03.822 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-26T18:25:03.822 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-26T18:25:03.822 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.target_file_size_base: 67108864 2024-04-26T18:25:03.822 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-26T18:25:03.822 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-26T18:25:03.822 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-26T18:25:03.822 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-26T18:25:03.822 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-26T18:25:03.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-26T18:25:03.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-26T18:25:03.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-26T18:25:03.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-26T18:25:03.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-26T18:25:03.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-26T18:25:03.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-26T18:25:03.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-26T18:25:03.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-26T18:25:03.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.arena_block_size: 1048576 2024-04-26T18:25:03.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-26T18:25:03.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-26T18:25:03.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.disable_auto_compactions: 0 2024-04-26T18:25:03.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-26T18:25:03.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-26T18:25:03.824 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-26T18:25:03.824 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-26T18:25:03.824 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-26T18:25:03.824 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-26T18:25:03.824 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-26T18:25:03.824 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-26T18:25:03.824 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-26T18:25:03.824 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-26T18:25:03.824 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-26T18:25:03.824 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.inplace_update_support: 0 2024-04-26T18:25:03.824 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-26T18:25:03.824 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-26T18:25:03.824 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-26T18:25:03.824 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-26T18:25:03.824 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.bloom_locality: 0 2024-04-26T18:25:03.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.max_successive_merges: 0 2024-04-26T18:25:03.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-26T18:25:03.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.paranoid_file_checks: 0 2024-04-26T18:25:03.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.force_consistency_checks: 1 2024-04-26T18:25:03.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.report_bg_io_stats: 0 2024-04-26T18:25:03.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.ttl: 2592000 2024-04-26T18:25:03.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-26T18:25:03.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-26T18:25:03.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-26T18:25:03.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.enable_blob_files: false 2024-04-26T18:25:03.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.min_blob_size: 0 2024-04-26T18:25:03.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.blob_file_size: 268435456 2024-04-26T18:25:03.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-26T18:25:03.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-26T18:25:03.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-26T18:25:03.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-26T18:25:03.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-26T18:25:03.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.blob_file_starting_level: 0 2024-04-26T18:25:03.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-26T18:25:03.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-04-26T18:25:03.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-04-26T18:25:03.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5805f0ec-7442-4f72-9295-9aa6f54e1468 2024-04-26T18:25:03.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714155903806790, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-04-26T18:25:03.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-04-26T18:25:03.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714155903807756, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100291, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 326, "table_properties": {"data_size": 98176, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14169, "raw_average_key_size": 49, "raw_value_size": 90460, "raw_average_value_size": 317, "num_data_blocks": 12, "num_entries": 285, "num_filter_entries": 285, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714155903, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5805f0ec-7442-4f72-9295-9aa6f54e1468", "db_session_id": "6OHGZJPXKMA3BPOTP16G", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-04-26T18:25:03.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714155903807837, "job": 1, "event": "recovery_finished"} 2024-04-26T18:25:03.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-04-26T18:25:03.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-26T18:25:03.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55fa44818000 2024-04-26T18:25:03.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: DB pointer 0x55fa44804000 2024-04-26T18:25:03.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-26T18:25:03.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-26T18:25:03.827 INFO:journalctl@ceph.mon.a.smithi080.stdout: ** DB Stats ** 2024-04-26T18:25:03.827 INFO:journalctl@ceph.mon.a.smithi080.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T18:25:03.827 INFO:journalctl@ceph.mon.a.smithi080.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-26T18:25:03.827 INFO:journalctl@ceph.mon.a.smithi080.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T18:25:03.827 INFO:journalctl@ceph.mon.a.smithi080.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T18:25:03.827 INFO:journalctl@ceph.mon.a.smithi080.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-26T18:25:03.827 INFO:journalctl@ceph.mon.a.smithi080.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T18:25:03.827 INFO:journalctl@ceph.mon.a.smithi080.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T18:25:03.827 INFO:journalctl@ceph.mon.a.smithi080.stdout: 2024-04-26T18:25:03.827 INFO:journalctl@ceph.mon.a.smithi080.stdout: ** Compaction Stats [default] ** 2024-04-26T18:25:03.827 INFO:journalctl@ceph.mon.a.smithi080.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T18:25:03.827 INFO:journalctl@ceph.mon.a.smithi080.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-26T18:25:03.828 INFO:journalctl@ceph.mon.a.smithi080.stdout: L0 2/0 99.80 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 163.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T18:25:03.828 INFO:journalctl@ceph.mon.a.smithi080.stdout: Sum 2/0 99.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 163.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T18:25:03.828 INFO:journalctl@ceph.mon.a.smithi080.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 163.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T18:25:03.828 INFO:journalctl@ceph.mon.a.smithi080.stdout: 2024-04-26T18:25:03.828 INFO:journalctl@ceph.mon.a.smithi080.stdout: ** Compaction Stats [default] ** 2024-04-26T18:25:03.828 INFO:journalctl@ceph.mon.a.smithi080.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T18:25:03.828 INFO:journalctl@ceph.mon.a.smithi080.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-26T18:25:03.828 INFO:journalctl@ceph.mon.a.smithi080.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 163.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T18:25:03.828 INFO:journalctl@ceph.mon.a.smithi080.stdout: 2024-04-26T18:25:03.828 INFO:journalctl@ceph.mon.a.smithi080.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-26T18:25:03.828 INFO:journalctl@ceph.mon.a.smithi080.stdout: 2024-04-26T18:25:03.828 INFO:journalctl@ceph.mon.a.smithi080.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T18:25:03.828 INFO:journalctl@ceph.mon.a.smithi080.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-26T18:25:03.828 INFO:journalctl@ceph.mon.a.smithi080.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-26T18:25:03.828 INFO:journalctl@ceph.mon.a.smithi080.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-26T18:25:03.828 INFO:journalctl@ceph.mon.a.smithi080.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-26T18:25:03.828 INFO:journalctl@ceph.mon.a.smithi080.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-26T18:25:03.829 INFO:journalctl@ceph.mon.a.smithi080.stdout: Cumulative compaction: 0.00 GB write, 29.06 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T18:25:03.829 INFO:journalctl@ceph.mon.a.smithi080.stdout: Interval compaction: 0.00 GB write, 29.06 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T18:25:03.829 INFO:journalctl@ceph.mon.a.smithi080.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-26T18:25:03.829 INFO:journalctl@ceph.mon.a.smithi080.stdout: Block cache BinnedLRUCache@0x55fa446fb1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-04-26T18:25:03.829 INFO:journalctl@ceph.mon.a.smithi080.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-04-26T18:25:03.829 INFO:journalctl@ceph.mon.a.smithi080.stdout: 2024-04-26T18:25:03.829 INFO:journalctl@ceph.mon.a.smithi080.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-26T18:25:03.829 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: starting mon.a rank 0 at public addrs [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] at bind addrs [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:25:03.829 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: mon.a@-1(???) e1 preinit fsid 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:25:03.829 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: mon.a@-1(???).mds e1 new map 2024-04-26T18:25:03.829 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: mon.a@-1(???).mds e1 print_map 2024-04-26T18:25:03.829 INFO:journalctl@ceph.mon.a.smithi080.stdout: e1 2024-04-26T18:25:03.829 INFO:journalctl@ceph.mon.a.smithi080.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T18:25:03.829 INFO:journalctl@ceph.mon.a.smithi080.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T18:25:03.830 INFO:journalctl@ceph.mon.a.smithi080.stdout: legacy client fscid: -1 2024-04-26T18:25:03.830 INFO:journalctl@ceph.mon.a.smithi080.stdout: 2024-04-26T18:25:03.830 INFO:journalctl@ceph.mon.a.smithi080.stdout: No filesystems configured 2024-04-26T18:25:03.830 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-26T18:25:03.830 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T18:25:03.830 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T18:25:03.830 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T18:25:03.830 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-26T18:25:03.916 INFO:teuthology.orchestra.run.smithi080.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-26T18:25:04.141 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-26T18:25:04.141 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: monmap epoch 1 2024-04-26T18:25:04.141 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: fsid 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:25:04.141 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: last_changed 2024-04-26T18:24:55.824625+0000 2024-04-26T18:25:04.141 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: created 2024-04-26T18:24:55.824625+0000 2024-04-26T18:25:04.142 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: min_mon_release 19 (squid) 2024-04-26T18:25:04.142 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: election_strategy: 1 2024-04-26T18:25:04.142 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: 0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-04-26T18:25:04.142 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: fsmap 2024-04-26T18:25:04.142 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: osdmap e1: 0 total, 0 up, 0 in 2024-04-26T18:25:04.142 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 ceph-mon[29135]: mgrmap e1: no daemons active 2024-04-26T18:25:04.142 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 bash[29116]: d90b35aa1c5e00f079bfd87dca615947476f14d53918d5752b1dbd3cf292741a 2024-04-26T18:25:04.142 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:03 smithi080 systemd[1]: Started Ceph mon.a for 2187ca98-03fa-11ef-bc93-c7b262605968. 2024-04-26T18:25:04.971 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.337+0000 7ff0643b0700 1 Processor -- start 2024-04-26T18:25:04.971 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.337+0000 7ff0643b0700 1 -- start start 2024-04-26T18:25:04.971 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.337+0000 7ff0643b0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff05c07f6f0 0x7ff05c07db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:04.971 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.337+0000 7ff0643b0700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c07e120 con 0x7ff05c07f6f0 2024-04-26T18:25:04.971 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.337+0000 7ff06214c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff05c07f6f0 0x7ff05c07db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:04.971 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.337+0000 7ff06214c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff05c07f6f0 0x7ff05c07db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52330/0 (socket says 172.21.15.80:52330) 2024-04-26T18:25:04.972 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.337+0000 7ff06214c700 1 -- 172.21.15.80:0/285697429 learned_addr learned my addr 172.21.15.80:0/285697429 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:04.972 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.337+0000 7ff06214c700 1 -- 172.21.15.80:0/285697429 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff05c07e2a0 con 0x7ff05c07f6f0 2024-04-26T18:25:04.972 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.338+0000 7ff06214c700 1 --2- 172.21.15.80:0/285697429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff05c07f6f0 0x7ff05c07db50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff04c0098a0 tx=0x7ff04c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcab7d4c4ab80bb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:04.972 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.338+0000 7ff06114a700 1 -- 172.21.15.80:0/285697429 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff04c004160 con 0x7ff05c07f6f0 2024-04-26T18:25:04.972 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.338+0000 7ff06114a700 1 -- 172.21.15.80:0/285697429 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff04c004300 con 0x7ff05c07f6f0 2024-04-26T18:25:04.972 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.338+0000 7ff06114a700 1 -- 172.21.15.80:0/285697429 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff04c011af0 con 0x7ff05c07f6f0 2024-04-26T18:25:04.972 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.338+0000 7ff0643b0700 1 -- 172.21.15.80:0/285697429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff05c07f6f0 msgr2=0x7ff05c07db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:04.972 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.338+0000 7ff0643b0700 1 --2- 172.21.15.80:0/285697429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff05c07f6f0 0x7ff05c07db50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff04c0098a0 tx=0x7ff04c009bb0 comp rx=0 tx=0).stop 2024-04-26T18:25:04.972 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.338+0000 7ff0643b0700 1 -- 172.21.15.80:0/285697429 shutdown_connections 2024-04-26T18:25:04.973 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.338+0000 7ff0643b0700 1 --2- 172.21.15.80:0/285697429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff05c07f6f0 0x7ff05c07db50 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:04.973 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.339+0000 7ff0643b0700 1 -- 172.21.15.80:0/285697429 >> 172.21.15.80:0/285697429 conn(0x7ff05c104380 msgr2=0x7ff05c1067a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:04.973 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.339+0000 7ff0643b0700 1 -- 172.21.15.80:0/285697429 shutdown_connections 2024-04-26T18:25:04.973 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.339+0000 7ff0643b0700 1 -- 172.21.15.80:0/285697429 wait complete. 2024-04-26T18:25:04.973 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.339+0000 7ff0643b0700 1 Processor -- start 2024-04-26T18:25:04.973 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.339+0000 7ff0643b0700 1 -- start start 2024-04-26T18:25:04.973 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.339+0000 7ff0643b0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff05c07f6f0 0x7ff05c19ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:04.973 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.339+0000 7ff0643b0700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c10f370 con 0x7ff05c07f6f0 2024-04-26T18:25:04.973 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.339+0000 7ff06214c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff05c07f6f0 0x7ff05c19ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:04.973 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.339+0000 7ff06214c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff05c07f6f0 0x7ff05c19ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52344/0 (socket says 172.21.15.80:52344) 2024-04-26T18:25:04.973 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.339+0000 7ff06214c700 1 -- 172.21.15.80:0/2864280220 learned_addr learned my addr 172.21.15.80:0/2864280220 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:04.973 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.340+0000 7ff06214c700 1 -- 172.21.15.80:0/2864280220 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff05c19f490 con 0x7ff05c07f6f0 2024-04-26T18:25:04.973 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.340+0000 7ff06214c700 1 --2- 172.21.15.80:0/2864280220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff05c07f6f0 0x7ff05c19ef50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff04c000c00 tx=0x7ff04c011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:04.974 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.340+0000 7ff0537fe700 1 -- 172.21.15.80:0/2864280220 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff04c003b20 con 0x7ff05c07f6f0 2024-04-26T18:25:04.974 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.340+0000 7ff0537fe700 1 -- 172.21.15.80:0/2864280220 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff04c01a8c0 con 0x7ff05c07f6f0 2024-04-26T18:25:04.974 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.340+0000 7ff0537fe700 1 -- 172.21.15.80:0/2864280220 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff04c024940 con 0x7ff05c07f6f0 2024-04-26T18:25:04.974 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.340+0000 7ff0643b0700 1 -- 172.21.15.80:0/2864280220 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff05c19f720 con 0x7ff05c07f6f0 2024-04-26T18:25:04.974 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.340+0000 7ff0643b0700 1 -- 172.21.15.80:0/2864280220 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff05c1a2410 con 0x7ff05c07f6f0 2024-04-26T18:25:04.974 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.340+0000 7ff0537fe700 1 -- 172.21.15.80:0/2864280220 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff04c022020 con 0x7ff05c07f6f0 2024-04-26T18:25:04.974 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.340+0000 7ff0537fe700 1 -- 172.21.15.80:0/2864280220 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff04c02dd90 con 0x7ff05c07f6f0 2024-04-26T18:25:04.974 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.341+0000 7ff0643b0700 1 -- 172.21.15.80:0/2864280220 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff05c064a80 con 0x7ff05c07f6f0 2024-04-26T18:25:04.974 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.343+0000 7ff0537fe700 1 -- 172.21.15.80:0/2864280220 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff04c042e50 con 0x7ff05c07f6f0 2024-04-26T18:25:04.974 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.409+0000 7ff0643b0700 1 -- 172.21.15.80:0/2864280220 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7ff05c1a25e0 con 0x7ff05c07f6f0 2024-04-26T18:25:04.974 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.411+0000 7ff0537fe700 1 -- 172.21.15.80:0/2864280220 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7ff04c031020 con 0x7ff05c07f6f0 2024-04-26T18:25:04.974 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.412+0000 7ff0643b0700 1 -- 172.21.15.80:0/2864280220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff05c07f6f0 msgr2=0x7ff05c19ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:04.974 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.412+0000 7ff0643b0700 1 --2- 172.21.15.80:0/2864280220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff05c07f6f0 0x7ff05c19ef50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff04c000c00 tx=0x7ff04c011b70 comp rx=0 tx=0).stop 2024-04-26T18:25:04.974 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.412+0000 7ff0643b0700 1 -- 172.21.15.80:0/2864280220 shutdown_connections 2024-04-26T18:25:04.974 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.412+0000 7ff0643b0700 1 --2- 172.21.15.80:0/2864280220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff05c07f6f0 0x7ff05c19ef50 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:04.975 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.412+0000 7ff0643b0700 1 -- 172.21.15.80:0/2864280220 >> 172.21.15.80:0/2864280220 conn(0x7ff05c104380 msgr2=0x7ff05c104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:04.975 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.412+0000 7ff0643b0700 1 -- 172.21.15.80:0/2864280220 shutdown_connections 2024-04-26T18:25:04.975 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:04.412+0000 7ff0643b0700 1 -- 172.21.15.80:0/2864280220 wait complete. 2024-04-26T18:25:04.975 INFO:teuthology.orchestra.run.smithi080.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-26T18:25:04.996 INFO:teuthology.orchestra.run.smithi080.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-26T18:25:04.996 INFO:teuthology.orchestra.run.smithi080.stdout:Creating mgr... 2024-04-26T18:25:04.997 INFO:teuthology.orchestra.run.smithi080.stdout:Verifying port 0.0.0.0:9283 ... 2024-04-26T18:25:04.997 INFO:teuthology.orchestra.run.smithi080.stdout:Verifying port 0.0.0.0:8765 ... 2024-04-26T18:25:05.251 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mgr.x 2024-04-26T18:25:05.252 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Failed to reset failed state of unit ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mgr.x.service: Unit ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mgr.x.service not loaded. 2024-04-26T18:25:05.398 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-2187ca98-03fa-11ef-bc93-c7b262605968.target.wants/ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-2187ca98-03fa-11ef-bc93-c7b262605968@.service. 2024-04-26T18:25:05.703 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:05 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2864280220' entity='client.admin' 2024-04-26T18:25:05.874 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T18:25:05.874 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout disabled 2024-04-26T18:25:05.881 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T18:25:05.881 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout inactive 2024-04-26T18:25:05.881 INFO:teuthology.orchestra.run.smithi080.stdout:firewalld.service is not enabled 2024-04-26T18:25:05.882 INFO:teuthology.orchestra.run.smithi080.stdout:Not possible to enable service . firewalld.service is not available 2024-04-26T18:25:05.890 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T18:25:05.890 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout disabled 2024-04-26T18:25:05.897 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T18:25:05.897 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout inactive 2024-04-26T18:25:05.897 INFO:teuthology.orchestra.run.smithi080.stdout:firewalld.service is not enabled 2024-04-26T18:25:05.897 INFO:teuthology.orchestra.run.smithi080.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-04-26T18:25:05.897 INFO:teuthology.orchestra.run.smithi080.stdout:Waiting for mgr to start... 2024-04-26T18:25:05.897 INFO:teuthology.orchestra.run.smithi080.stdout:Waiting for mgr... 2024-04-26T18:25:06.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:06 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3501484665' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T18:25:06.743 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:06 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:06.647+0000 7f63d2452200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T18:25:08.194 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:07 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:07.849+0000 7f63d2452200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T18:25:08.194 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:08 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:08.021+0000 7f63d2452200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T18:25:08.194 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:08 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:08.194+0000 7f63d2452200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T18:25:08.785 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:08 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:08.489+0000 7f63d2452200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T18:25:08.785 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:08 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:08.584+0000 7f63d2452200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T18:25:08.785 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:08 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:08.785+0000 7f63d2452200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T18:25:09.190 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:08 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:08.980+0000 7f63d2452200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T18:25:09.991 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:09 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:09.575+0000 7f63d2452200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T18:25:10.243 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:09 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:09.991+0000 7f63d2452200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T18:25:10.243 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:10 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:10.089+0000 7f63d2452200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T18:25:10.743 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:10 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:10.289+0000 7f63d2452200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T18:25:11.138 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:10 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:10.806+0000 7f63d2452200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T18:25:11.138 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:10 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:10.898+0000 7f63d2452200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T18:25:11.475 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:11 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:11.138+0000 7f63d2452200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T18:25:11.475 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:11 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:11.269+0000 7f63d2452200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T18:25:11.476 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:11 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:11.362+0000 7f63d2452200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T18:25:11.476 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:11 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:11.475+0000 7f63d2452200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T18:25:12.141 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:11 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:11.773+0000 7f63d2452200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T18:25:12.156 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2024-04-26T18:25:12.156 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout { 2024-04-26T18:25:12.156 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "fsid": "2187ca98-03fa-11ef-bc93-c7b262605968", 2024-04-26T18:25:12.156 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T18:25:12.156 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T18:25:12.156 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T18:25:12.156 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T18:25:12.156 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-26T18:25:12.156 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T18:25:12.156 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T18:25:12.156 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 0 2024-04-26T18:25:12.157 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2024-04-26T18:25:12.157 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T18:25:12.157 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "a" 2024-04-26T18:25:12.157 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2024-04-26T18:25:12.157 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-04-26T18:25:12.157 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T18:25:12.157 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T18:25:12.157 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-26T18:25:12.157 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T18:25:12.157 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-26T18:25:12.157 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T18:25:12.157 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T18:25:12.157 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T18:25:12.157 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T18:25:12.157 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T18:25:12.158 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T18:25:12.158 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T18:25:12.158 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T18:25:12.158 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-26T18:25:12.158 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T18:25:12.158 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T18:25:12.158 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T18:25:12.158 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T18:25:12.158 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T18:25:12.158 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T18:25:12.158 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T18:25:12.158 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T18:25:12.158 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T18:25:12.158 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-26T18:25:12.158 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T18:25:12.159 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T18:25:12.159 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T18:25:12.159 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T18:25:12.159 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-26T18:25:12.159 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T18:25:12.159 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-26T18:25:12.159 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T18:25:12.159 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T18:25:12.159 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T18:25:12.159 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T18:25:12.159 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T18:25:12.159 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2024-04-26T18:25:12.159 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T18:25:12.159 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-26T18:25:12.159 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T18:25:12.159 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T18:25:12.159 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T18:24:58.809884+0000", 2024-04-26T18:25:12.160 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T18:25:12.160 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-26T18:25:12.160 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T18:25:12.160 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout } 2024-04-26T18:25:12.160 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.316+0000 7f734710b700 1 Processor -- start 2024-04-26T18:25:12.160 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.316+0000 7f734710b700 1 -- start start 2024-04-26T18:25:12.160 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.316+0000 7f734710b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7340107d00 0x7f7340108120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:12.160 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.316+0000 7f734710b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f73401086f0 con 0x7f7340107d00 2024-04-26T18:25:12.160 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.316+0000 7f7344ea7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7340107d00 0x7f7340108120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:12.160 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.316+0000 7f7344ea7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7340107d00 0x7f7340108120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52362/0 (socket says 172.21.15.80:52362) 2024-04-26T18:25:12.160 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.316+0000 7f7344ea7700 1 -- 172.21.15.80:0/1541947882 learned_addr learned my addr 172.21.15.80:0/1541947882 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:12.160 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.316+0000 7f7344ea7700 1 -- 172.21.15.80:0/1541947882 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7340108f00 con 0x7f7340107d00 2024-04-26T18:25:12.160 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.317+0000 7f7344ea7700 1 --2- 172.21.15.80:0/1541947882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7340107d00 0x7f7340108120 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f73340098a0 tx=0x7f7334009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e03e57c0b902077 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:12.160 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.317+0000 7f733f7fe700 1 -- 172.21.15.80:0/1541947882 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7334004160 con 0x7f7340107d00 2024-04-26T18:25:12.161 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.317+0000 7f733f7fe700 1 -- 172.21.15.80:0/1541947882 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f7334004300 con 0x7f7340107d00 2024-04-26T18:25:12.161 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.317+0000 7f733f7fe700 1 -- 172.21.15.80:0/1541947882 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7334011af0 con 0x7f7340107d00 2024-04-26T18:25:12.161 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.318+0000 7f734710b700 1 -- 172.21.15.80:0/1541947882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7340107d00 msgr2=0x7f7340108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:12.161 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.318+0000 7f734710b700 1 --2- 172.21.15.80:0/1541947882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7340107d00 0x7f7340108120 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f73340098a0 tx=0x7f7334009bb0 comp rx=0 tx=0).stop 2024-04-26T18:25:12.161 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.318+0000 7f734710b700 1 -- 172.21.15.80:0/1541947882 shutdown_connections 2024-04-26T18:25:12.161 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.318+0000 7f734710b700 1 --2- 172.21.15.80:0/1541947882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7340107d00 0x7f7340108120 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:12.161 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.318+0000 7f734710b700 1 -- 172.21.15.80:0/1541947882 >> 172.21.15.80:0/1541947882 conn(0x7f7340103280 msgr2=0x7f73401056e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:12.161 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.318+0000 7f734710b700 1 -- 172.21.15.80:0/1541947882 shutdown_connections 2024-04-26T18:25:12.161 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.318+0000 7f734710b700 1 -- 172.21.15.80:0/1541947882 wait complete. 2024-04-26T18:25:12.161 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.318+0000 7f734710b700 1 Processor -- start 2024-04-26T18:25:12.161 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.318+0000 7f734710b700 1 -- start start 2024-04-26T18:25:12.161 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.318+0000 7f734710b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7340107d00 0x7f734019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:12.161 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.318+0000 7f734710b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f734010c2b0 con 0x7f7340107d00 2024-04-26T18:25:12.161 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.319+0000 7f7344ea7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7340107d00 0x7f734019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:12.161 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.319+0000 7f7344ea7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7340107d00 0x7f734019cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52364/0 (socket says 172.21.15.80:52364) 2024-04-26T18:25:12.161 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.319+0000 7f7344ea7700 1 -- 172.21.15.80:0/3501484665 learned_addr learned my addr 172.21.15.80:0/3501484665 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:12.162 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.319+0000 7f7344ea7700 1 -- 172.21.15.80:0/3501484665 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734019d310 con 0x7f7340107d00 2024-04-26T18:25:12.162 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.319+0000 7f7344ea7700 1 --2- 172.21.15.80:0/3501484665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7340107d00 0x7f734019cdd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7334009fb0 tx=0x7f7334011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:12.162 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.319+0000 7f733dffb700 1 -- 172.21.15.80:0/3501484665 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73340036a0 con 0x7f7340107d00 2024-04-26T18:25:12.162 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.319+0000 7f733dffb700 1 -- 172.21.15.80:0/3501484665 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f733401a430 con 0x7f7340107d00 2024-04-26T18:25:12.162 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.319+0000 7f734710b700 1 -- 172.21.15.80:0/3501484665 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f734019d5a0 con 0x7f7340107d00 2024-04-26T18:25:12.162 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.319+0000 7f733dffb700 1 -- 172.21.15.80:0/3501484665 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7334019550 con 0x7f7340107d00 2024-04-26T18:25:12.162 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.319+0000 7f734710b700 1 -- 172.21.15.80:0/3501484665 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73401a0290 con 0x7f7340107d00 2024-04-26T18:25:12.162 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.320+0000 7f733dffb700 1 -- 172.21.15.80:0/3501484665 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7334019be0 con 0x7f7340107d00 2024-04-26T18:25:12.162 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.320+0000 7f733dffb700 1 -- 172.21.15.80:0/3501484665 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7334024730 con 0x7f7340107d00 2024-04-26T18:25:12.162 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.320+0000 7f734710b700 1 -- 172.21.15.80:0/3501484665 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7340064a80 con 0x7f7340107d00 2024-04-26T18:25:12.162 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.323+0000 7f733dffb700 1 -- 172.21.15.80:0/3501484665 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f733402dd50 con 0x7f7340107d00 2024-04-26T18:25:12.163 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.401+0000 7f734710b700 1 -- 172.21.15.80:0/3501484665 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f734002e690 con 0x7f7340107d00 2024-04-26T18:25:12.163 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.401+0000 7f733dffb700 1 -- 172.21.15.80:0/3501484665 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f7334033030 con 0x7f7340107d00 2024-04-26T18:25:12.163 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.402+0000 7f734710b700 1 -- 172.21.15.80:0/3501484665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7340107d00 msgr2=0x7f734019cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:12.163 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.402+0000 7f734710b700 1 --2- 172.21.15.80:0/3501484665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7340107d00 0x7f734019cdd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7334009fb0 tx=0x7f7334011940 comp rx=0 tx=0).stop 2024-04-26T18:25:12.163 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.402+0000 7f734710b700 1 -- 172.21.15.80:0/3501484665 shutdown_connections 2024-04-26T18:25:12.163 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.402+0000 7f734710b700 1 --2- 172.21.15.80:0/3501484665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7340107d00 0x7f734019cdd0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:12.163 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.402+0000 7f734710b700 1 -- 172.21.15.80:0/3501484665 >> 172.21.15.80:0/3501484665 conn(0x7f7340103280 msgr2=0x7f73401041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:12.163 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.402+0000 7f734710b700 1 -- 172.21.15.80:0/3501484665 shutdown_connections 2024-04-26T18:25:12.163 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:06.402+0000 7f734710b700 1 -- 172.21.15.80:0/3501484665 wait complete. 2024-04-26T18:25:12.163 INFO:teuthology.orchestra.run.smithi080.stdout:mgr not available, waiting (1/15)... 2024-04-26T18:25:12.493 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:12 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:12.369+0000 7f63d2452200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T18:25:12.993 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:12 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:12.583+0000 7f63d2452200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T18:25:12.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:12 smithi080 ceph-mon[29135]: Activating manager daemon x 2024-04-26T18:25:12.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:12 smithi080 ceph-mon[29135]: mgrmap e2: x(active, starting, since 0.00303659s) 2024-04-26T18:25:12.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:12 smithi080 ceph-mon[29135]: from='mgr.14100 172.21.15.80:0/2651064051' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T18:25:12.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:12 smithi080 ceph-mon[29135]: from='mgr.14100 172.21.15.80:0/2651064051' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T18:25:12.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:12 smithi080 ceph-mon[29135]: from='mgr.14100 172.21.15.80:0/2651064051' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T18:25:12.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:12 smithi080 ceph-mon[29135]: from='mgr.14100 172.21.15.80:0/2651064051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T18:25:12.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:12 smithi080 ceph-mon[29135]: from='mgr.14100 172.21.15.80:0/2651064051' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T18:25:12.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:12 smithi080 ceph-mon[29135]: Manager daemon x is now available 2024-04-26T18:25:12.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:12 smithi080 ceph-mon[29135]: from='mgr.14100 172.21.15.80:0/2651064051' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T18:25:12.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:12 smithi080 ceph-mon[29135]: from='mgr.14100 172.21.15.80:0/2651064051' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T18:25:12.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:12 smithi080 ceph-mon[29135]: from='mgr.14100 172.21.15.80:0/2651064051' entity='mgr.x' 2024-04-26T18:25:12.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:12 smithi080 ceph-mon[29135]: from='mgr.14100 172.21.15.80:0/2651064051' entity='mgr.x' 2024-04-26T18:25:12.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:12 smithi080 ceph-mon[29135]: from='mgr.14100 172.21.15.80:0/2651064051' entity='mgr.x' 2024-04-26T18:25:14.867 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:14 smithi080 ceph-mon[29135]: mgrmap e3: x(active, since 1.00705s) 2024-04-26T18:25:15.434 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2024-04-26T18:25:15.434 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout { 2024-04-26T18:25:15.435 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "fsid": "2187ca98-03fa-11ef-bc93-c7b262605968", 2024-04-26T18:25:15.435 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T18:25:15.435 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T18:25:15.435 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T18:25:15.435 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T18:25:15.435 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-26T18:25:15.435 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T18:25:15.435 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T18:25:15.435 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 0 2024-04-26T18:25:15.435 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2024-04-26T18:25:15.435 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T18:25:15.435 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "a" 2024-04-26T18:25:15.435 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2024-04-26T18:25:15.435 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-04-26T18:25:15.435 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T18:25:15.436 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T18:25:15.436 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-26T18:25:15.436 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T18:25:15.436 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-26T18:25:15.436 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T18:25:15.436 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T18:25:15.436 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T18:25:15.436 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T18:25:15.436 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T18:25:15.436 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T18:25:15.436 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T18:25:15.436 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T18:25:15.436 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-26T18:25:15.436 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T18:25:15.436 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T18:25:15.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T18:25:15.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T18:25:15.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T18:25:15.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T18:25:15.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T18:25:15.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T18:25:15.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T18:25:15.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-26T18:25:15.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T18:25:15.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T18:25:15.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T18:25:15.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T18:25:15.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-26T18:25:15.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T18:25:15.444 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-26T18:25:15.444 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T18:25:15.444 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T18:25:15.444 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T18:25:15.444 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T18:25:15.444 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T18:25:15.444 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ], 2024-04-26T18:25:15.444 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T18:25:15.444 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-26T18:25:15.444 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T18:25:15.445 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T18:25:15.445 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T18:24:58.809884+0000", 2024-04-26T18:25:15.445 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T18:25:15.445 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout }, 2024-04-26T18:25:15.445 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T18:25:15.445 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout } 2024-04-26T18:25:15.445 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.571+0000 7f397e959700 1 Processor -- start 2024-04-26T18:25:15.445 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.571+0000 7f397e959700 1 -- start start 2024-04-26T18:25:15.445 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.571+0000 7f397e959700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3978108e00 0x7f3978109220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:15.445 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.571+0000 7f397e959700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3978109760 con 0x7f3978108e00 2024-04-26T18:25:15.445 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.571+0000 7f3977fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3978108e00 0x7f3978109220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:15.445 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.571+0000 7f3977fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3978108e00 0x7f3978109220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47976/0 (socket says 172.21.15.80:47976) 2024-04-26T18:25:15.445 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.571+0000 7f3977fff700 1 -- 172.21.15.80:0/476445434 learned_addr learned my addr 172.21.15.80:0/476445434 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:15.445 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.571+0000 7f3977fff700 1 -- 172.21.15.80:0/476445434 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3978109f60 con 0x7f3978108e00 2024-04-26T18:25:15.446 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.572+0000 7f3977fff700 1 --2- 172.21.15.80:0/476445434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3978108e00 0x7f3978109220 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f39680098a0 tx=0x7f3968009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1de4015050bf84c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:15.446 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.572+0000 7f3976ffd700 1 -- 172.21.15.80:0/476445434 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3968004160 con 0x7f3978108e00 2024-04-26T18:25:15.446 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.572+0000 7f3976ffd700 1 -- 172.21.15.80:0/476445434 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3968004300 con 0x7f3978108e00 2024-04-26T18:25:15.446 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.572+0000 7f3976ffd700 1 -- 172.21.15.80:0/476445434 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3968011af0 con 0x7f3978108e00 2024-04-26T18:25:15.446 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.572+0000 7f397e959700 1 -- 172.21.15.80:0/476445434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3978108e00 msgr2=0x7f3978109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:15.446 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.572+0000 7f397e959700 1 --2- 172.21.15.80:0/476445434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3978108e00 0x7f3978109220 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f39680098a0 tx=0x7f3968009bb0 comp rx=0 tx=0).stop 2024-04-26T18:25:15.446 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.572+0000 7f397e959700 1 -- 172.21.15.80:0/476445434 shutdown_connections 2024-04-26T18:25:15.446 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.572+0000 7f397e959700 1 --2- 172.21.15.80:0/476445434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3978108e00 0x7f3978109220 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:15.446 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.572+0000 7f397e959700 1 -- 172.21.15.80:0/476445434 >> 172.21.15.80:0/476445434 conn(0x7f3978104380 msgr2=0x7f39781067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:15.446 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.572+0000 7f397e959700 1 -- 172.21.15.80:0/476445434 shutdown_connections 2024-04-26T18:25:15.446 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.573+0000 7f397e959700 1 -- 172.21.15.80:0/476445434 wait complete. 2024-04-26T18:25:15.446 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.573+0000 7f397e959700 1 Processor -- start 2024-04-26T18:25:15.446 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.573+0000 7f397e959700 1 -- start start 2024-04-26T18:25:15.446 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.573+0000 7f397e959700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3978108e00 0x7f397819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:15.447 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.573+0000 7f397e959700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f397810d3a0 con 0x7f3978108e00 2024-04-26T18:25:15.447 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.573+0000 7f3977fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3978108e00 0x7f397819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:15.447 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.574+0000 7f3977fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3978108e00 0x7f397819cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47988/0 (socket says 172.21.15.80:47988) 2024-04-26T18:25:15.447 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.574+0000 7f3977fff700 1 -- 172.21.15.80:0/808925273 learned_addr learned my addr 172.21.15.80:0/808925273 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:15.447 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.574+0000 7f3977fff700 1 -- 172.21.15.80:0/808925273 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397819d2d0 con 0x7f3978108e00 2024-04-26T18:25:15.447 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.574+0000 7f3977fff700 1 --2- 172.21.15.80:0/808925273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3978108e00 0x7f397819cd90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3968009fb0 tx=0x7f3968011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:15.447 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.574+0000 7f39757fa700 1 -- 172.21.15.80:0/808925273 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39680036a0 con 0x7f3978108e00 2024-04-26T18:25:15.447 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.574+0000 7f39757fa700 1 -- 172.21.15.80:0/808925273 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f396801a430 con 0x7f3978108e00 2024-04-26T18:25:15.447 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.574+0000 7f397e959700 1 -- 172.21.15.80:0/808925273 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f397819d560 con 0x7f3978108e00 2024-04-26T18:25:15.447 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.574+0000 7f39757fa700 1 -- 172.21.15.80:0/808925273 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3968019550 con 0x7f3978108e00 2024-04-26T18:25:15.447 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.574+0000 7f397e959700 1 -- 172.21.15.80:0/808925273 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39781a0210 con 0x7f3978108e00 2024-04-26T18:25:15.447 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.575+0000 7f39757fa700 1 -- 172.21.15.80:0/808925273 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) ==== 46441+0+0 (secure 0 0 0) 0x7f3968019850 con 0x7f3978108e00 2024-04-26T18:25:15.447 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.575+0000 7f39757fa700 1 --2- 172.21.15.80:0/808925273 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7f39600393e0 0x7f396003b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:15.448 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.575+0000 7f39757fa700 1 -- 172.21.15.80:0/808925273 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f396804d950 con 0x7f3978108e00 2024-04-26T18:25:15.448 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.575+0000 7f397e959700 1 -- 172.21.15.80:0/808925273 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3978064a80 con 0x7f3978108e00 2024-04-26T18:25:15.448 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.575+0000 7f39777fe700 1 --2- 172.21.15.80:0/808925273 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7f39600393e0 0x7f396003b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:15.448 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.576+0000 7f39777fe700 1 --2- 172.21.15.80:0/808925273 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7f39600393e0 0x7f396003b8a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f396c006fd0 tx=0x7f396c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:15.448 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.581+0000 7f39757fa700 1 -- 172.21.15.80:0/808925273 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f396800f2e0 con 0x7f3978108e00 2024-04-26T18:25:15.448 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.591+0000 7f39757fa700 1 -- 172.21.15.80:0/808925273 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7f396802d960 con 0x7f3978108e00 2024-04-26T18:25:15.448 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.867+0000 7f397e959700 1 -- 172.21.15.80:0/808925273 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f39781a0890 con 0x7f3978108e00 2024-04-26T18:25:15.448 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.867+0000 7f39757fa700 1 -- 172.21.15.80:0/808925273 <== mon.0 v2:172.21.15.80:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f396801a5e0 con 0x7f3978108e00 2024-04-26T18:25:15.448 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.870+0000 7f397e959700 1 -- 172.21.15.80:0/808925273 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7f39600393e0 msgr2=0x7f396003b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:15.448 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.870+0000 7f397e959700 1 --2- 172.21.15.80:0/808925273 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7f39600393e0 0x7f396003b8a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f396c006fd0 tx=0x7f396c006e40 comp rx=0 tx=0).stop 2024-04-26T18:25:15.448 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.870+0000 7f397e959700 1 -- 172.21.15.80:0/808925273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3978108e00 msgr2=0x7f397819cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:15.448 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.870+0000 7f397e959700 1 --2- 172.21.15.80:0/808925273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3978108e00 0x7f397819cd90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3968009fb0 tx=0x7f3968011940 comp rx=0 tx=0).stop 2024-04-26T18:25:15.448 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.871+0000 7f397e959700 1 -- 172.21.15.80:0/808925273 shutdown_connections 2024-04-26T18:25:15.448 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.871+0000 7f397e959700 1 --2- 172.21.15.80:0/808925273 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7f39600393e0 0x7f396003b8a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:15.448 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.871+0000 7f397e959700 1 --2- 172.21.15.80:0/808925273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3978108e00 0x7f397819cd90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:15.449 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.871+0000 7f397e959700 1 -- 172.21.15.80:0/808925273 >> 172.21.15.80:0/808925273 conn(0x7f3978104380 msgr2=0x7f3978104e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:15.449 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.871+0000 7f397e959700 1 -- 172.21.15.80:0/808925273 shutdown_connections 2024-04-26T18:25:15.449 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:14.871+0000 7f397e959700 1 -- 172.21.15.80:0/808925273 wait complete. 2024-04-26T18:25:15.449 INFO:teuthology.orchestra.run.smithi080.stdout:mgr is available 2024-04-26T18:25:15.802 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:15 smithi080 ceph-mon[29135]: mgrmap e4: x(active, since 2s) 2024-04-26T18:25:15.802 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:15 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/808925273' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T18:25:16.543 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2024-04-26T18:25:16.544 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout [global] 2024-04-26T18:25:16.544 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout fsid = 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:25:16.544 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-04-26T18:25:16.544 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-26T18:25:16.544 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-26T18:25:16.544 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-26T18:25:16.544 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-26T18:25:16.544 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2024-04-26T18:25:16.544 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-26T18:25:16.544 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-26T18:25:16.544 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 2024-04-26T18:25:16.544 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout [osd] 2024-04-26T18:25:16.544 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-26T18:25:16.545 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-26T18:25:16.545 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-26T18:25:16.545 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-26T18:25:16.545 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-26T18:25:16.545 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.801+0000 7fb73bef8700 1 Processor -- start 2024-04-26T18:25:16.545 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.802+0000 7fb73bef8700 1 -- start start 2024-04-26T18:25:16.545 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.802+0000 7fb73bef8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb734108e00 0x7fb734109220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:16.545 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.802+0000 7fb73bef8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb734109760 con 0x7fb734108e00 2024-04-26T18:25:16.545 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.802+0000 7fb739c94700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb734108e00 0x7fb734109220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:16.545 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.802+0000 7fb739c94700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb734108e00 0x7fb734109220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48002/0 (socket says 172.21.15.80:48002) 2024-04-26T18:25:16.545 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.802+0000 7fb739c94700 1 -- 172.21.15.80:0/2946880682 learned_addr learned my addr 172.21.15.80:0/2946880682 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:16.545 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.802+0000 7fb739c94700 1 -- 172.21.15.80:0/2946880682 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb734109f60 con 0x7fb734108e00 2024-04-26T18:25:16.545 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.803+0000 7fb739c94700 1 --2- 172.21.15.80:0/2946880682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb734108e00 0x7fb734109220 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb7240098a0 tx=0x7fb724009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f70fdff28cfc8a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:16.545 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.803+0000 7fb738c92700 1 -- 172.21.15.80:0/2946880682 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb724004160 con 0x7fb734108e00 2024-04-26T18:25:16.546 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.803+0000 7fb738c92700 1 -- 172.21.15.80:0/2946880682 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb724004300 con 0x7fb734108e00 2024-04-26T18:25:16.546 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.803+0000 7fb738c92700 1 -- 172.21.15.80:0/2946880682 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb724011af0 con 0x7fb734108e00 2024-04-26T18:25:16.546 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.803+0000 7fb73bef8700 1 -- 172.21.15.80:0/2946880682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb734108e00 msgr2=0x7fb734109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:16.546 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.803+0000 7fb73bef8700 1 --2- 172.21.15.80:0/2946880682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb734108e00 0x7fb734109220 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb7240098a0 tx=0x7fb724009bb0 comp rx=0 tx=0).stop 2024-04-26T18:25:16.546 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.803+0000 7fb73bef8700 1 -- 172.21.15.80:0/2946880682 shutdown_connections 2024-04-26T18:25:16.546 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.803+0000 7fb73bef8700 1 --2- 172.21.15.80:0/2946880682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb734108e00 0x7fb734109220 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:16.546 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.803+0000 7fb73bef8700 1 -- 172.21.15.80:0/2946880682 >> 172.21.15.80:0/2946880682 conn(0x7fb734104380 msgr2=0x7fb7341067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:16.546 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.803+0000 7fb73bef8700 1 -- 172.21.15.80:0/2946880682 shutdown_connections 2024-04-26T18:25:16.546 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.804+0000 7fb73bef8700 1 -- 172.21.15.80:0/2946880682 wait complete. 2024-04-26T18:25:16.546 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.804+0000 7fb73bef8700 1 Processor -- start 2024-04-26T18:25:16.546 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.804+0000 7fb73bef8700 1 -- start start 2024-04-26T18:25:16.546 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.804+0000 7fb73bef8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb734108e00 0x7fb73407f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:16.546 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.804+0000 7fb73bef8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb73410d3a0 con 0x7fb734108e00 2024-04-26T18:25:16.547 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.804+0000 7fb739c94700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb734108e00 0x7fb73407f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:16.547 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.804+0000 7fb739c94700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb734108e00 0x7fb73407f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48008/0 (socket says 172.21.15.80:48008) 2024-04-26T18:25:16.547 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.804+0000 7fb739c94700 1 -- 172.21.15.80:0/2583548440 learned_addr learned my addr 172.21.15.80:0/2583548440 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:16.547 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.805+0000 7fb739c94700 1 -- 172.21.15.80:0/2583548440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb73407f900 con 0x7fb734108e00 2024-04-26T18:25:16.547 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.805+0000 7fb739c94700 1 --2- 172.21.15.80:0/2583548440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb734108e00 0x7fb73407f3c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb724009fb0 tx=0x7fb724011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:16.547 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.805+0000 7fb72affd700 1 -- 172.21.15.80:0/2583548440 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7240036a0 con 0x7fb734108e00 2024-04-26T18:25:16.547 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.805+0000 7fb72affd700 1 -- 172.21.15.80:0/2583548440 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb72401a430 con 0x7fb734108e00 2024-04-26T18:25:16.547 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.805+0000 7fb73bef8700 1 -- 172.21.15.80:0/2583548440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb73407daf0 con 0x7fb734108e00 2024-04-26T18:25:16.547 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.805+0000 7fb72affd700 1 -- 172.21.15.80:0/2583548440 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb724019550 con 0x7fb734108e00 2024-04-26T18:25:16.547 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.805+0000 7fb73bef8700 1 -- 172.21.15.80:0/2583548440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb73407e030 con 0x7fb734108e00 2024-04-26T18:25:16.547 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.806+0000 7fb72affd700 1 -- 172.21.15.80:0/2583548440 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7fb724019800 con 0x7fb734108e00 2024-04-26T18:25:16.547 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.806+0000 7fb72affd700 1 --2- 172.21.15.80:0/2583548440 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7fb720039560 0x7fb72003ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:16.547 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.806+0000 7fb72affd700 1 -- 172.21.15.80:0/2583548440 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb72404d9b0 con 0x7fb734108e00 2024-04-26T18:25:16.548 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.806+0000 7fb73bef8700 1 -- 172.21.15.80:0/2583548440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb734064a80 con 0x7fb734108e00 2024-04-26T18:25:16.548 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.806+0000 7fb739493700 1 --2- 172.21.15.80:0/2583548440 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7fb720039560 0x7fb72003ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:16.548 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.807+0000 7fb739493700 1 --2- 172.21.15.80:0/2583548440 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7fb720039560 0x7fb72003ba20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb730006fd0 tx=0x7fb730006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:16.548 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:15.811+0000 7fb72affd700 1 -- 172.21.15.80:0/2583548440 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb724023c90 con 0x7fb734108e00 2024-04-26T18:25:16.548 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.006+0000 7fb73bef8700 1 -- 172.21.15.80:0/2583548440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fb73407e2b0 con 0x7fb734108e00 2024-04-26T18:25:16.548 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.007+0000 7fb72affd700 1 -- 172.21.15.80:0/2583548440 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+409 (secure 0 0 0) 0x7fb73407e2b0 con 0x7fb734108e00 2024-04-26T18:25:16.548 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.010+0000 7fb73bef8700 1 -- 172.21.15.80:0/2583548440 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7fb720039560 msgr2=0x7fb72003ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:16.548 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.010+0000 7fb73bef8700 1 --2- 172.21.15.80:0/2583548440 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7fb720039560 0x7fb72003ba20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb730006fd0 tx=0x7fb730006e40 comp rx=0 tx=0).stop 2024-04-26T18:25:16.548 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.010+0000 7fb73bef8700 1 -- 172.21.15.80:0/2583548440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb734108e00 msgr2=0x7fb73407f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:16.548 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.010+0000 7fb73bef8700 1 --2- 172.21.15.80:0/2583548440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb734108e00 0x7fb73407f3c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb724009fb0 tx=0x7fb724011940 comp rx=0 tx=0).stop 2024-04-26T18:25:16.548 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.010+0000 7fb73bef8700 1 -- 172.21.15.80:0/2583548440 shutdown_connections 2024-04-26T18:25:16.548 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.010+0000 7fb73bef8700 1 --2- 172.21.15.80:0/2583548440 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7fb720039560 0x7fb72003ba20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:16.548 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.010+0000 7fb73bef8700 1 --2- 172.21.15.80:0/2583548440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb734108e00 0x7fb73407f3c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:16.549 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.010+0000 7fb73bef8700 1 -- 172.21.15.80:0/2583548440 >> 172.21.15.80:0/2583548440 conn(0x7fb734104380 msgr2=0x7fb734104e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:16.549 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.010+0000 7fb73bef8700 1 -- 172.21.15.80:0/2583548440 shutdown_connections 2024-04-26T18:25:16.549 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.010+0000 7fb73bef8700 1 -- 172.21.15.80:0/2583548440 wait complete. 2024-04-26T18:25:16.549 INFO:teuthology.orchestra.run.smithi080.stdout:Enabling cephadm module... 2024-04-26T18:25:16.854 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:16 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2583548440' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-26T18:25:17.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:17 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3460464924' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-26T18:25:17.882 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:17 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: ignoring --setuser ceph since I am not root 2024-04-26T18:25:17.882 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:17 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: ignoring --setgroup ceph since I am not root 2024-04-26T18:25:17.882 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:17 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:17.760+0000 7f769e488200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T18:25:18.173 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:17 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:17.944+0000 7f769e488200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T18:25:18.173 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:18 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:18.046+0000 7f769e488200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T18:25:18.181 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.955+0000 7fa878f86700 1 Processor -- start 2024-04-26T18:25:18.181 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.955+0000 7fa878f86700 1 -- start start 2024-04-26T18:25:18.181 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.955+0000 7fa878f86700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa874107710 0x7fa874107b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:18.181 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.955+0000 7fa878f86700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa87407cdf0 con 0x7fa874107710 2024-04-26T18:25:18.181 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.955+0000 7fa87259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa874107710 0x7fa874107b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:18.181 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.955+0000 7fa87259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa874107710 0x7fa874107b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48014/0 (socket says 172.21.15.80:48014) 2024-04-26T18:25:18.181 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.955+0000 7fa87259c700 1 -- 172.21.15.80:0/3976208267 learned_addr learned my addr 172.21.15.80:0/3976208267 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:18.181 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.956+0000 7fa87259c700 1 -- 172.21.15.80:0/3976208267 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa874108070 con 0x7fa874107710 2024-04-26T18:25:18.181 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.956+0000 7fa87259c700 1 --2- 172.21.15.80:0/3976208267 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa874107710 0x7fa874107b30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa8640098a0 tx=0x7fa864009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bab137c8a6dbc1d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:18.181 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.956+0000 7fa871d9b700 1 -- 172.21.15.80:0/3976208267 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa864004160 con 0x7fa874107710 2024-04-26T18:25:18.181 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.956+0000 7fa871d9b700 1 -- 172.21.15.80:0/3976208267 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa864004300 con 0x7fa874107710 2024-04-26T18:25:18.182 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.956+0000 7fa871d9b700 1 -- 172.21.15.80:0/3976208267 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa864011af0 con 0x7fa874107710 2024-04-26T18:25:18.182 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.957+0000 7fa878f86700 1 -- 172.21.15.80:0/3976208267 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa874107710 msgr2=0x7fa874107b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:18.182 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.957+0000 7fa878f86700 1 --2- 172.21.15.80:0/3976208267 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa874107710 0x7fa874107b30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa8640098a0 tx=0x7fa864009bb0 comp rx=0 tx=0).stop 2024-04-26T18:25:18.182 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.957+0000 7fa878f86700 1 -- 172.21.15.80:0/3976208267 shutdown_connections 2024-04-26T18:25:18.182 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.957+0000 7fa878f86700 1 --2- 172.21.15.80:0/3976208267 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa874107710 0x7fa874107b30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:18.182 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.957+0000 7fa878f86700 1 -- 172.21.15.80:0/3976208267 >> 172.21.15.80:0/3976208267 conn(0x7fa874103290 msgr2=0x7fa874105710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:18.182 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.957+0000 7fa878f86700 1 -- 172.21.15.80:0/3976208267 shutdown_connections 2024-04-26T18:25:18.182 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.957+0000 7fa878f86700 1 -- 172.21.15.80:0/3976208267 wait complete. 2024-04-26T18:25:18.182 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.957+0000 7fa878f86700 1 Processor -- start 2024-04-26T18:25:18.182 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.958+0000 7fa878f86700 1 -- start start 2024-04-26T18:25:18.182 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.958+0000 7fa878f86700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa874107710 0x7fa87419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:18.182 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.958+0000 7fa878f86700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa8741090a0 con 0x7fa874107710 2024-04-26T18:25:18.182 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.958+0000 7fa87259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa874107710 0x7fa87419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:18.182 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.958+0000 7fa87259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa874107710 0x7fa87419ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48024/0 (socket says 172.21.15.80:48024) 2024-04-26T18:25:18.183 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.958+0000 7fa87259c700 1 -- 172.21.15.80:0/3460464924 learned_addr learned my addr 172.21.15.80:0/3460464924 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:18.183 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.958+0000 7fa87259c700 1 -- 172.21.15.80:0/3460464924 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87419f4a0 con 0x7fa874107710 2024-04-26T18:25:18.183 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.958+0000 7fa87259c700 1 --2- 172.21.15.80:0/3460464924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa874107710 0x7fa87419ef60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa864011ac0 tx=0x7fa864011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:18.183 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.959+0000 7fa86bfff700 1 -- 172.21.15.80:0/3460464924 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa864003970 con 0x7fa874107710 2024-04-26T18:25:18.183 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.959+0000 7fa86bfff700 1 -- 172.21.15.80:0/3460464924 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa864003b10 con 0x7fa874107710 2024-04-26T18:25:18.183 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.959+0000 7fa878f86700 1 -- 172.21.15.80:0/3460464924 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa87419f730 con 0x7fa874107710 2024-04-26T18:25:18.183 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.959+0000 7fa86bfff700 1 -- 172.21.15.80:0/3460464924 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa864024610 con 0x7fa874107710 2024-04-26T18:25:18.183 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.959+0000 7fa878f86700 1 -- 172.21.15.80:0/3460464924 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8741a2420 con 0x7fa874107710 2024-04-26T18:25:18.183 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.959+0000 7fa86bfff700 1 -- 172.21.15.80:0/3460464924 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7fa864024890 con 0x7fa874107710 2024-04-26T18:25:18.183 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.959+0000 7fa878f86700 1 -- 172.21.15.80:0/3460464924 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa874064a80 con 0x7fa874107710 2024-04-26T18:25:18.183 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.960+0000 7fa86bfff700 1 --2- 172.21.15.80:0/3460464924 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7fa860039560 0x7fa86003ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:18.183 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.960+0000 7fa86bfff700 1 -- 172.21.15.80:0/3460464924 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa86404d8c0 con 0x7fa874107710 2024-04-26T18:25:18.183 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.960+0000 7fa869d9b700 1 --2- 172.21.15.80:0/3460464924 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7fa860039560 0x7fa86003ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:18.184 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.960+0000 7fa869d9b700 1 --2- 172.21.15.80:0/3460464924 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7fa860039560 0x7fa86003ba20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa85c006fd0 tx=0x7fa85c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:18.184 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:16.965+0000 7fa86bfff700 1 -- 172.21.15.80:0/3460464924 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa8640172b0 con 0x7fa874107710 2024-04-26T18:25:18.184 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:17.216+0000 7fa878f86700 1 -- 172.21.15.80:0/3460464924 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fa8740008d0 con 0x7fa874107710 2024-04-26T18:25:18.184 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:17.594+0000 7fa86bfff700 1 -- 172.21.15.80:0/3460464924 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fa86400b9f0 con 0x7fa874107710 2024-04-26T18:25:18.184 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:17.596+0000 7fa86bfff700 1 -- 172.21.15.80:0/3460464924 <== mon.0 v2:172.21.15.80:3300/0 8 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7fa86402d910 con 0x7fa874107710 2024-04-26T18:25:18.184 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:17.597+0000 7fa878f86700 1 -- 172.21.15.80:0/3460464924 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7fa860039560 msgr2=0x7fa86003ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:18.184 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:17.597+0000 7fa878f86700 1 --2- 172.21.15.80:0/3460464924 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7fa860039560 0x7fa86003ba20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa85c006fd0 tx=0x7fa85c006e40 comp rx=0 tx=0).stop 2024-04-26T18:25:18.184 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:17.597+0000 7fa878f86700 1 -- 172.21.15.80:0/3460464924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa874107710 msgr2=0x7fa87419ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:18.184 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:17.597+0000 7fa878f86700 1 --2- 172.21.15.80:0/3460464924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa874107710 0x7fa87419ef60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa864011ac0 tx=0x7fa864011ba0 comp rx=0 tx=0).stop 2024-04-26T18:25:18.184 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:17.597+0000 7fa878f86700 1 -- 172.21.15.80:0/3460464924 shutdown_connections 2024-04-26T18:25:18.184 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:17.597+0000 7fa878f86700 1 --2- 172.21.15.80:0/3460464924 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7fa860039560 0x7fa86003ba20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:18.184 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:17.597+0000 7fa878f86700 1 --2- 172.21.15.80:0/3460464924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa874107710 0x7fa87419ef60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:18.184 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:17.597+0000 7fa878f86700 1 -- 172.21.15.80:0/3460464924 >> 172.21.15.80:0/3460464924 conn(0x7fa874103290 msgr2=0x7fa874195c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:18.184 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:17.597+0000 7fa878f86700 1 -- 172.21.15.80:0/3460464924 shutdown_connections 2024-04-26T18:25:18.184 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:17.597+0000 7fa878f86700 1 -- 172.21.15.80:0/3460464924 wait complete. 2024-04-26T18:25:18.449 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:18 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:18.362+0000 7f769e488200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T18:25:18.449 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:18 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:18.449+0000 7f769e488200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T18:25:18.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:18 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3460464924' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-26T18:25:18.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:18 smithi080 ceph-mon[29135]: mgrmap e5: x(active, since 5s) 2024-04-26T18:25:19.945 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:19 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3784165718' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-26T18:25:19.945 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:19 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:19.661+0000 7f769e488200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T18:25:19.945 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:19 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:19.831+0000 7f769e488200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T18:25:20.201 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:20 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:20.006+0000 7f769e488200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T18:25:20.493 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:20 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:20.304+0000 7f769e488200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T18:25:20.600 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:20 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:20.401+0000 7f769e488200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T18:25:20.993 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:20 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:20.607+0000 7f769e488200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T18:25:20.993 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:20 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:20.801+0000 7f769e488200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T18:25:21.743 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:21 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:21.407+0000 7f769e488200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T18:25:22.121 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:21 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:21.823+0000 7f769e488200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T18:25:22.121 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:21 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:21.920+0000 7f769e488200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T18:25:22.121 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:22 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:22.120+0000 7f769e488200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T18:25:22.971 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:22 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:22.638+0000 7f769e488200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T18:25:22.971 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:22 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:22.729+0000 7f769e488200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T18:25:23.150 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout { 2024-04-26T18:25:23.150 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-26T18:25:23.150 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-26T18:25:23.150 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-26T18:25:23.150 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-26T18:25:23.150 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout } 2024-04-26T18:25:23.150 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.600+0000 7fcbe0508700 1 Processor -- start 2024-04-26T18:25:23.150 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.600+0000 7fcbe0508700 1 -- start start 2024-04-26T18:25:23.150 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.601+0000 7fcbe0508700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd81098a0 0x7fcbd810bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:23.150 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.601+0000 7fcbe0508700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd807ce70 con 0x7fcbd81098a0 2024-04-26T18:25:23.151 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.601+0000 7fcbde2a4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd81098a0 0x7fcbd810bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:23.151 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.601+0000 7fcbde2a4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd81098a0 0x7fcbd810bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48050/0 (socket says 172.21.15.80:48050) 2024-04-26T18:25:23.151 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.601+0000 7fcbde2a4700 1 -- 172.21.15.80:0/4038098357 learned_addr learned my addr 172.21.15.80:0/4038098357 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:23.151 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.601+0000 7fcbde2a4700 1 -- 172.21.15.80:0/4038098357 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd810c1d0 con 0x7fcbd81098a0 2024-04-26T18:25:23.151 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.601+0000 7fcbde2a4700 1 --2- 172.21.15.80:0/4038098357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd81098a0 0x7fcbd810bc90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcbd40098a0 tx=0x7fcbd4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72ad8657f21daa0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:23.151 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.601+0000 7fcbdd2a2700 1 -- 172.21.15.80:0/4038098357 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbd4004160 con 0x7fcbd81098a0 2024-04-26T18:25:23.151 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.601+0000 7fcbdd2a2700 1 -- 172.21.15.80:0/4038098357 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fcbd4004300 con 0x7fcbd81098a0 2024-04-26T18:25:23.151 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.602+0000 7fcbdd2a2700 1 -- 172.21.15.80:0/4038098357 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbd4011af0 con 0x7fcbd81098a0 2024-04-26T18:25:23.151 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.602+0000 7fcbe0508700 1 -- 172.21.15.80:0/4038098357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd81098a0 msgr2=0x7fcbd810bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:23.151 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.602+0000 7fcbe0508700 1 --2- 172.21.15.80:0/4038098357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd81098a0 0x7fcbd810bc90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcbd40098a0 tx=0x7fcbd4009bb0 comp rx=0 tx=0).stop 2024-04-26T18:25:23.151 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.602+0000 7fcbe0508700 1 -- 172.21.15.80:0/4038098357 shutdown_connections 2024-04-26T18:25:23.152 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.602+0000 7fcbe0508700 1 --2- 172.21.15.80:0/4038098357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd81098a0 0x7fcbd810bc90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:23.152 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.602+0000 7fcbe0508700 1 -- 172.21.15.80:0/4038098357 >> 172.21.15.80:0/4038098357 conn(0x7fcbd8103290 msgr2=0x7fcbd8105710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:23.152 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.602+0000 7fcbe0508700 1 -- 172.21.15.80:0/4038098357 shutdown_connections 2024-04-26T18:25:23.152 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.602+0000 7fcbe0508700 1 -- 172.21.15.80:0/4038098357 wait complete. 2024-04-26T18:25:23.152 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.603+0000 7fcbe0508700 1 Processor -- start 2024-04-26T18:25:23.152 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.603+0000 7fcbe0508700 1 -- start start 2024-04-26T18:25:23.152 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.603+0000 7fcbe0508700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd81098a0 0x7fcbd8109120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:23.152 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.603+0000 7fcbe0508700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd810d1a0 con 0x7fcbd81098a0 2024-04-26T18:25:23.152 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.603+0000 7fcbde2a4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd81098a0 0x7fcbd8109120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:23.152 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.603+0000 7fcbde2a4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd81098a0 0x7fcbd8109120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48052/0 (socket says 172.21.15.80:48052) 2024-04-26T18:25:23.152 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.603+0000 7fcbde2a4700 1 -- 172.21.15.80:0/3784165718 learned_addr learned my addr 172.21.15.80:0/3784165718 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:23.152 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.604+0000 7fcbde2a4700 1 -- 172.21.15.80:0/3784165718 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd8109660 con 0x7fcbd81098a0 2024-04-26T18:25:23.152 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.604+0000 7fcbde2a4700 1 --2- 172.21.15.80:0/3784165718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd81098a0 0x7fcbd8109120 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4011ac0 tx=0x7fcbd4011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:23.152 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.604+0000 7fcbcf7fe700 1 -- 172.21.15.80:0/3784165718 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbd4003970 con 0x7fcbd81098a0 2024-04-26T18:25:23.153 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.604+0000 7fcbcf7fe700 1 -- 172.21.15.80:0/3784165718 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fcbd4003b10 con 0x7fcbd81098a0 2024-04-26T18:25:23.153 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.604+0000 7fcbcf7fe700 1 -- 172.21.15.80:0/3784165718 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbd4024610 con 0x7fcbd81098a0 2024-04-26T18:25:23.153 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.604+0000 7fcbe0508700 1 -- 172.21.15.80:0/3784165718 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbd8107850 con 0x7fcbd81098a0 2024-04-26T18:25:23.153 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.604+0000 7fcbe0508700 1 -- 172.21.15.80:0/3784165718 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbd8107d90 con 0x7fcbd81098a0 2024-04-26T18:25:23.153 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.605+0000 7fcbe0508700 1 -- 172.21.15.80:0/3784165718 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbd8064a80 con 0x7fcbd81098a0 2024-04-26T18:25:23.153 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.605+0000 7fcbcf7fe700 1 -- 172.21.15.80:0/3784165718 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7fcbd4024890 con 0x7fcbd81098a0 2024-04-26T18:25:23.153 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.605+0000 7fcbcf7fe700 1 --2- 172.21.15.80:0/3784165718 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7fcbc40395b0 0x7fcbc403ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:23.153 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.605+0000 7fcbcf7fe700 1 -- 172.21.15.80:0/3784165718 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcbd404d900 con 0x7fcbd81098a0 2024-04-26T18:25:23.153 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.605+0000 7fcbddaa3700 1 -- 172.21.15.80:0/3784165718 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7fcbc40395b0 msgr2=0x7fcbc403ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/4208962819 2024-04-26T18:25:23.153 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.605+0000 7fcbddaa3700 1 --2- 172.21.15.80:0/3784165718 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7fcbc40395b0 0x7fcbc403ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T18:25:23.153 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.613+0000 7fcbcf7fe700 1 -- 172.21.15.80:0/3784165718 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcbd4019c70 con 0x7fcbd81098a0 2024-04-26T18:25:23.153 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.806+0000 7fcbddaa3700 1 -- 172.21.15.80:0/3784165718 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7fcbc40395b0 msgr2=0x7fcbc403ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/4208962819 2024-04-26T18:25:23.153 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.806+0000 7fcbddaa3700 1 --2- 172.21.15.80:0/3784165718 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7fcbc40395b0 0x7fcbc403ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T18:25:23.153 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.911+0000 7fcbe0508700 1 -- 172.21.15.80:0/3784165718 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fcbd81086c0 con 0x7fcbd81098a0 2024-04-26T18:25:23.153 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.912+0000 7fcbcf7fe700 1 -- 172.21.15.80:0/3784165718 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fcbd40172b0 con 0x7fcbd81098a0 2024-04-26T18:25:23.154 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.914+0000 7fcbe0508700 1 -- 172.21.15.80:0/3784165718 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7fcbc40395b0 msgr2=0x7fcbc403ba70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T18:25:23.154 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.914+0000 7fcbe0508700 1 --2- 172.21.15.80:0/3784165718 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7fcbc40395b0 0x7fcbc403ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:23.154 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.914+0000 7fcbe0508700 1 -- 172.21.15.80:0/3784165718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd81098a0 msgr2=0x7fcbd8109120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:23.154 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.914+0000 7fcbe0508700 1 --2- 172.21.15.80:0/3784165718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd81098a0 0x7fcbd8109120 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4011ac0 tx=0x7fcbd4011ba0 comp rx=0 tx=0).stop 2024-04-26T18:25:23.154 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.914+0000 7fcbe0508700 1 -- 172.21.15.80:0/3784165718 shutdown_connections 2024-04-26T18:25:23.154 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.914+0000 7fcbe0508700 1 --2- 172.21.15.80:0/3784165718 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7fcbc40395b0 0x7fcbc403ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:23.154 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.914+0000 7fcbe0508700 1 --2- 172.21.15.80:0/3784165718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd81098a0 0x7fcbd8109120 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:23.154 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.914+0000 7fcbe0508700 1 -- 172.21.15.80:0/3784165718 >> 172.21.15.80:0/3784165718 conn(0x7fcbd8103290 msgr2=0x7fcbd8103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:23.154 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.914+0000 7fcbe0508700 1 -- 172.21.15.80:0/3784165718 shutdown_connections 2024-04-26T18:25:23.154 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:18.914+0000 7fcbe0508700 1 -- 172.21.15.80:0/3784165718 wait complete. 2024-04-26T18:25:23.154 INFO:teuthology.orchestra.run.smithi080.stdout:Waiting for the mgr to restart... 2024-04-26T18:25:23.154 INFO:teuthology.orchestra.run.smithi080.stdout:Waiting for mgr epoch 5... 2024-04-26T18:25:23.243 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:22 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:22.970+0000 7f769e488200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T18:25:23.243 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:23.104+0000 7f769e488200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T18:25:23.243 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:23.204+0000 7f769e488200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T18:25:23.550 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:23.323+0000 7f769e488200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T18:25:23.993 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:23.631+0000 7f769e488200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T18:25:24.438 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:24 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:24.224+0000 7f769e488200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T18:25:24.438 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:24 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:24.438+0000 7f769e488200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T18:25:24.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:24 smithi080 ceph-mon[29135]: Active manager daemon x restarted 2024-04-26T18:25:24.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:24 smithi080 ceph-mon[29135]: Activating manager daemon x 2024-04-26T18:25:24.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:24 smithi080 ceph-mon[29135]: osdmap e2: 0 total, 0 up, 0 in 2024-04-26T18:25:24.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:24 smithi080 ceph-mon[29135]: mgrmap e6: x(active, starting, since 0.00371429s) 2024-04-26T18:25:24.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:24 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T18:25:24.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:24 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T18:25:24.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:24 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T18:25:24.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:24 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T18:25:24.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:24 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T18:25:24.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:24 smithi080 ceph-mon[29135]: Manager daemon x is now available 2024-04-26T18:25:24.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:24 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' 2024-04-26T18:25:24.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:24 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' 2024-04-26T18:25:24.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:24 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:25:24.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:24 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:25:24.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:24 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T18:25:25.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:25 smithi080 ceph-mon[29135]: Found migration_current of "None". Setting to last migration. 2024-04-26T18:25:25.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:25 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T18:25:25.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:25 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' 2024-04-26T18:25:25.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:25 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' 2024-04-26T18:25:25.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:25 smithi080 ceph-mon[29135]: mgrmap e7: x(active, since 1.00585s) 2024-04-26T18:25:26.024 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout { 2024-04-26T18:25:26.024 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-26T18:25:26.024 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-26T18:25:26.024 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout } 2024-04-26T18:25:26.024 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.550+0000 7f453a36b700 1 Processor -- start 2024-04-26T18:25:26.025 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.550+0000 7f453a36b700 1 -- start start 2024-04-26T18:25:26.025 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.550+0000 7f453a36b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45341070f0 0x7f4534107510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:26.025 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.550+0000 7f453a36b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4534107ae0 con 0x7f45341070f0 2024-04-26T18:25:26.025 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.550+0000 7f4533fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45341070f0 0x7f4534107510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:26.025 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.550+0000 7f4533fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45341070f0 0x7f4534107510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40270/0 (socket says 172.21.15.80:40270) 2024-04-26T18:25:26.025 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.550+0000 7f4533fff700 1 -- 172.21.15.80:0/3748270359 learned_addr learned my addr 172.21.15.80:0/3748270359 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:26.025 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.551+0000 7f4533fff700 1 -- 172.21.15.80:0/3748270359 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4534107c60 con 0x7f45341070f0 2024-04-26T18:25:26.025 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.551+0000 7f4533fff700 1 --2- 172.21.15.80:0/3748270359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45341070f0 0x7f4534107510 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f45240098a0 tx=0x7f4524009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ece87c2774fbbc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:26.025 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.551+0000 7f4532ffd700 1 -- 172.21.15.80:0/3748270359 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4524004160 con 0x7f45341070f0 2024-04-26T18:25:26.025 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.551+0000 7f4532ffd700 1 -- 172.21.15.80:0/3748270359 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f4524004300 con 0x7f45341070f0 2024-04-26T18:25:26.025 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.551+0000 7f4532ffd700 1 -- 172.21.15.80:0/3748270359 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4524011af0 con 0x7f45341070f0 2024-04-26T18:25:26.025 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.552+0000 7f453a36b700 1 -- 172.21.15.80:0/3748270359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45341070f0 msgr2=0x7f4534107510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:26.025 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.552+0000 7f453a36b700 1 --2- 172.21.15.80:0/3748270359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45341070f0 0x7f4534107510 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f45240098a0 tx=0x7f4524009bb0 comp rx=0 tx=0).stop 2024-04-26T18:25:26.026 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.552+0000 7f453a36b700 1 -- 172.21.15.80:0/3748270359 shutdown_connections 2024-04-26T18:25:26.026 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.552+0000 7f453a36b700 1 --2- 172.21.15.80:0/3748270359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45341070f0 0x7f4534107510 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:26.026 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.552+0000 7f453a36b700 1 -- 172.21.15.80:0/3748270359 >> 172.21.15.80:0/3748270359 conn(0x7f4534102a10 msgr2=0x7f4534104e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:26.026 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.552+0000 7f453a36b700 1 -- 172.21.15.80:0/3748270359 shutdown_connections 2024-04-26T18:25:26.027 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.552+0000 7f453a36b700 1 -- 172.21.15.80:0/3748270359 wait complete. 2024-04-26T18:25:26.027 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.553+0000 7f453a36b700 1 Processor -- start 2024-04-26T18:25:26.027 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.553+0000 7f453a36b700 1 -- start start 2024-04-26T18:25:26.027 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.553+0000 7f453a36b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45341070f0 0x7f453419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:26.027 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.553+0000 7f453a36b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f453410afd0 con 0x7f45341070f0 2024-04-26T18:25:26.027 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.553+0000 7f4533fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45341070f0 0x7f453419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:26.027 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.553+0000 7f4533fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45341070f0 0x7f453419ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40286/0 (socket says 172.21.15.80:40286) 2024-04-26T18:25:26.027 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.553+0000 7f4533fff700 1 -- 172.21.15.80:0/3811949301 learned_addr learned my addr 172.21.15.80:0/3811949301 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:26.027 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.554+0000 7f4533fff700 1 -- 172.21.15.80:0/3811949301 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f453419d340 con 0x7f45341070f0 2024-04-26T18:25:26.027 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.554+0000 7f4533fff700 1 --2- 172.21.15.80:0/3811949301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45341070f0 0x7f453419ce00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f45240117b0 tx=0x7f4524011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:26.028 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.554+0000 7f45317fa700 1 -- 172.21.15.80:0/3811949301 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4524003af0 con 0x7f45341070f0 2024-04-26T18:25:26.028 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.554+0000 7f45317fa700 1 -- 172.21.15.80:0/3811949301 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f4524020070 con 0x7f45341070f0 2024-04-26T18:25:26.028 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.554+0000 7f453a36b700 1 -- 172.21.15.80:0/3811949301 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f453419d5d0 con 0x7f45341070f0 2024-04-26T18:25:26.028 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.554+0000 7f45317fa700 1 -- 172.21.15.80:0/3811949301 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4524019550 con 0x7f45341070f0 2024-04-26T18:25:26.028 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.554+0000 7f453a36b700 1 -- 172.21.15.80:0/3811949301 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45341a02c0 con 0x7f45341070f0 2024-04-26T18:25:26.028 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.555+0000 7f45317fa700 1 -- 172.21.15.80:0/3811949301 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7f4524019810 con 0x7f45341070f0 2024-04-26T18:25:26.028 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.555+0000 7f45317fa700 1 --2- 172.21.15.80:0/3811949301 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7f451c0395b0 0x7f451c03ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:26.028 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.555+0000 7f453a36b700 1 -- 172.21.15.80:0/3811949301 --> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4534064a80 con 0x7f451c0395b0 2024-04-26T18:25:26.028 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.555+0000 7f45317fa700 1 -- 172.21.15.80:0/3811949301 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f452404e9a0 con 0x7f45341070f0 2024-04-26T18:25:26.028 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.555+0000 7f45337fe700 1 -- 172.21.15.80:0/3811949301 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7f451c0395b0 msgr2=0x7f451c03ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/4208962819 2024-04-26T18:25:26.028 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.555+0000 7f45337fe700 1 --2- 172.21.15.80:0/3811949301 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7f451c0395b0 0x7f451c03ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T18:25:26.028 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.756+0000 7f45337fe700 1 -- 172.21.15.80:0/3811949301 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7f451c0395b0 msgr2=0x7f451c03ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/4208962819 2024-04-26T18:25:26.029 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:23.756+0000 7f45337fe700 1 --2- 172.21.15.80:0/3811949301 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7f451c0395b0 0x7f451c03ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T18:25:26.029 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:24.157+0000 7f45337fe700 1 -- 172.21.15.80:0/3811949301 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7f451c0395b0 msgr2=0x7f451c03ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/4208962819 2024-04-26T18:25:26.029 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:24.157+0000 7f45337fe700 1 --2- 172.21.15.80:0/3811949301 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7f451c0395b0 0x7f451c03ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T18:25:26.029 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:24.442+0000 7f45317fa700 1 -- 172.21.15.80:0/3811949301 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mgrmap(e 6) ==== 46325+0+0 (secure 0 0 0) 0x7f452402bd00 con 0x7f45341070f0 2024-04-26T18:25:26.029 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:24.442+0000 7f45317fa700 1 -- 172.21.15.80:0/3811949301 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7f451c0395b0 msgr2=0x7f451c03ba70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T18:25:26.029 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:24.442+0000 7f45317fa700 1 --2- 172.21.15.80:0/3811949301 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7f451c0395b0 0x7f451c03ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:26.029 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:25.443+0000 7f45317fa700 1 -- 172.21.15.80:0/3811949301 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mgrmap(e 7) ==== 46452+0+0 (secure 0 0 0) 0x7f452404f3a0 con 0x7f45341070f0 2024-04-26T18:25:26.029 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:25.443+0000 7f45317fa700 1 --2- 172.21.15.80:0/3811949301 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f451c03ccb0 0x7f451c03f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:26.029 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:25.443+0000 7f45317fa700 1 -- 172.21.15.80:0/3811949301 --> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4534064a80 con 0x7f451c03ccb0 2024-04-26T18:25:26.029 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:25.443+0000 7f45337fe700 1 --2- 172.21.15.80:0/3811949301 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f451c03ccb0 0x7f451c03f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:26.029 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:25.444+0000 7f45337fe700 1 --2- 172.21.15.80:0/3811949301 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f451c03ccb0 0x7f451c03f0a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4528003a10 tx=0x7f4528009290 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:26.029 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:25.444+0000 7f45317fa700 1 -- 172.21.15.80:0/3811949301 <== mgr.14116 v2:172.21.15.80:6800/1997155783 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f4534064a80 con 0x7f451c03ccb0 2024-04-26T18:25:26.030 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:25.458+0000 7f453a36b700 1 -- 172.21.15.80:0/3811949301 --> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f453410d370 con 0x7f451c03ccb0 2024-04-26T18:25:26.030 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:25.459+0000 7f45317fa700 1 -- 172.21.15.80:0/3811949301 <== mgr.14116 v2:172.21.15.80:6800/1997155783 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f453410d370 con 0x7f451c03ccb0 2024-04-26T18:25:26.030 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:25.459+0000 7f453a36b700 1 -- 172.21.15.80:0/3811949301 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f451c03ccb0 msgr2=0x7f451c03f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:26.030 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:25.459+0000 7f453a36b700 1 --2- 172.21.15.80:0/3811949301 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f451c03ccb0 0x7f451c03f0a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4528003a10 tx=0x7f4528009290 comp rx=0 tx=0).stop 2024-04-26T18:25:26.030 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:25.459+0000 7f453a36b700 1 -- 172.21.15.80:0/3811949301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45341070f0 msgr2=0x7f453419ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:26.030 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:25.459+0000 7f453a36b700 1 --2- 172.21.15.80:0/3811949301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45341070f0 0x7f453419ce00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f45240117b0 tx=0x7f4524011b70 comp rx=0 tx=0).stop 2024-04-26T18:25:26.030 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:25.459+0000 7f453a36b700 1 -- 172.21.15.80:0/3811949301 shutdown_connections 2024-04-26T18:25:26.030 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:25.459+0000 7f453a36b700 1 --2- 172.21.15.80:0/3811949301 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f451c03ccb0 0x7f451c03f0a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:26.030 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:25.459+0000 7f453a36b700 1 --2- 172.21.15.80:0/3811949301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45341070f0 0x7f453419ce00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:26.030 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:25.459+0000 7f453a36b700 1 --2- 172.21.15.80:0/3811949301 >> [v2:172.21.15.80:6800/4208962819,v1:172.21.15.80:6801/4208962819] conn(0x7f451c0395b0 0x7f451c03ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:26.031 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:25.459+0000 7f453a36b700 1 -- 172.21.15.80:0/3811949301 >> 172.21.15.80:0/3811949301 conn(0x7f4534102a10 msgr2=0x7f4534103620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:26.031 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:25.459+0000 7f453a36b700 1 -- 172.21.15.80:0/3811949301 shutdown_connections 2024-04-26T18:25:26.031 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:25.459+0000 7f453a36b700 1 -- 172.21.15.80:0/3811949301 wait complete. 2024-04-26T18:25:26.031 INFO:teuthology.orchestra.run.smithi080.stdout:mgr epoch 5 is available 2024-04-26T18:25:26.031 INFO:teuthology.orchestra.run.smithi080.stdout:Setting orchestrator backend to cephadm... 2024-04-26T18:25:26.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:26 smithi080 ceph-mon[29135]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-26T18:25:26.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:26 smithi080 ceph-mon[29135]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-26T18:25:26.632 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:26 smithi080 ceph-mon[29135]: [26/Apr/2024:18:25:25] ENGINE Bus STARTING 2024-04-26T18:25:26.633 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:26 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:25:27.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:27 smithi080 ceph-mon[29135]: [26/Apr/2024:18:25:25] ENGINE Serving on https://172.21.15.80:7150 2024-04-26T18:25:27.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:27 smithi080 ceph-mon[29135]: [26/Apr/2024:18:25:25] ENGINE Serving on http://172.21.15.80:8765 2024-04-26T18:25:27.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:27 smithi080 ceph-mon[29135]: [26/Apr/2024:18:25:25] ENGINE Bus STARTED 2024-04-26T18:25:27.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:27 smithi080 ceph-mon[29135]: mgrmap e8: x(active, since 2s) 2024-04-26T18:25:27.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:27 smithi080 ceph-mon[29135]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:25:27.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:27 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' 2024-04-26T18:25:27.624 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:27 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:25:27.629 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.408+0000 7fd7a5116700 1 Processor -- start 2024-04-26T18:25:27.629 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.408+0000 7fd7a5116700 1 -- start start 2024-04-26T18:25:27.629 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.408+0000 7fd7a5116700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a0108dc0 0x7fd7a01091e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:27.629 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.408+0000 7fd7a5116700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a01097b0 con 0x7fd7a0108dc0 2024-04-26T18:25:27.630 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.408+0000 7fd79ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a0108dc0 0x7fd7a01091e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:27.630 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.408+0000 7fd79ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a0108dc0 0x7fd7a01091e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40354/0 (socket says 172.21.15.80:40354) 2024-04-26T18:25:27.630 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.408+0000 7fd79ed9d700 1 -- 172.21.15.80:0/1581130176 learned_addr learned my addr 172.21.15.80:0/1581130176 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:27.630 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.408+0000 7fd79ed9d700 1 -- 172.21.15.80:0/1581130176 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a0109fc0 con 0x7fd7a0108dc0 2024-04-26T18:25:27.630 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.408+0000 7fd79ed9d700 1 --2- 172.21.15.80:0/1581130176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a0108dc0 0x7fd7a01091e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd7900098a0 tx=0x7fd790009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b01dd9e82f2eb24 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:27.630 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.408+0000 7fd79dd9b700 1 -- 172.21.15.80:0/1581130176 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd790004160 con 0x7fd7a0108dc0 2024-04-26T18:25:27.630 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.409+0000 7fd79dd9b700 1 -- 172.21.15.80:0/1581130176 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd790004300 con 0x7fd7a0108dc0 2024-04-26T18:25:27.630 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.409+0000 7fd79dd9b700 1 -- 172.21.15.80:0/1581130176 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd790011af0 con 0x7fd7a0108dc0 2024-04-26T18:25:27.630 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.409+0000 7fd7a5116700 1 -- 172.21.15.80:0/1581130176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a0108dc0 msgr2=0x7fd7a01091e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:27.630 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.409+0000 7fd7a5116700 1 --2- 172.21.15.80:0/1581130176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a0108dc0 0x7fd7a01091e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd7900098a0 tx=0x7fd790009bb0 comp rx=0 tx=0).stop 2024-04-26T18:25:27.630 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.409+0000 7fd7a5116700 1 -- 172.21.15.80:0/1581130176 shutdown_connections 2024-04-26T18:25:27.630 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.409+0000 7fd7a5116700 1 --2- 172.21.15.80:0/1581130176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a0108dc0 0x7fd7a01091e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:27.630 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.409+0000 7fd7a5116700 1 -- 172.21.15.80:0/1581130176 >> 172.21.15.80:0/1581130176 conn(0x7fd7a0104380 msgr2=0x7fd7a01067a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:27.630 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.409+0000 7fd7a5116700 1 -- 172.21.15.80:0/1581130176 shutdown_connections 2024-04-26T18:25:27.631 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.409+0000 7fd7a5116700 1 -- 172.21.15.80:0/1581130176 wait complete. 2024-04-26T18:25:27.631 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.410+0000 7fd7a5116700 1 Processor -- start 2024-04-26T18:25:27.631 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.410+0000 7fd7a5116700 1 -- start start 2024-04-26T18:25:27.631 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.410+0000 7fd7a5116700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a0108dc0 0x7fd7a019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:27.631 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.410+0000 7fd7a5116700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a010d370 con 0x7fd7a0108dc0 2024-04-26T18:25:27.631 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.410+0000 7fd79ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a0108dc0 0x7fd7a019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:27.631 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.410+0000 7fd79ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a0108dc0 0x7fd7a019cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40370/0 (socket says 172.21.15.80:40370) 2024-04-26T18:25:27.631 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.410+0000 7fd79ed9d700 1 -- 172.21.15.80:0/1101050027 learned_addr learned my addr 172.21.15.80:0/1101050027 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:27.631 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.411+0000 7fd79ed9d700 1 -- 172.21.15.80:0/1101050027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a019d290 con 0x7fd7a0108dc0 2024-04-26T18:25:27.631 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.411+0000 7fd79ed9d700 1 --2- 172.21.15.80:0/1101050027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a0108dc0 0x7fd7a019cd50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd790003f40 tx=0x7fd790011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:27.631 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.411+0000 7fd787fff700 1 -- 172.21.15.80:0/1101050027 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7900038b0 con 0x7fd7a0108dc0 2024-04-26T18:25:27.631 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.411+0000 7fd787fff700 1 -- 172.21.15.80:0/1101050027 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd790003a50 con 0x7fd7a0108dc0 2024-04-26T18:25:27.631 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.411+0000 7fd787fff700 1 -- 172.21.15.80:0/1101050027 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd79001a5c0 con 0x7fd7a0108dc0 2024-04-26T18:25:27.631 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.411+0000 7fd7a5116700 1 -- 172.21.15.80:0/1101050027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a019d520 con 0x7fd7a0108dc0 2024-04-26T18:25:27.632 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.411+0000 7fd7a5116700 1 -- 172.21.15.80:0/1101050027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a01a0210 con 0x7fd7a0108dc0 2024-04-26T18:25:27.632 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.412+0000 7fd787fff700 1 -- 172.21.15.80:0/1101050027 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 7) ==== 46452+0+0 (secure 0 0 0) 0x7fd790024430 con 0x7fd7a0108dc0 2024-04-26T18:25:27.632 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.412+0000 7fd787fff700 1 --2- 172.21.15.80:0/1101050027 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7fd7880394a0 0x7fd78803b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:27.632 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.412+0000 7fd7a5116700 1 -- 172.21.15.80:0/1101050027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7a0064a80 con 0x7fd7a0108dc0 2024-04-26T18:25:27.632 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.412+0000 7fd787fff700 1 -- 172.21.15.80:0/1101050027 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd79004d8d0 con 0x7fd7a0108dc0 2024-04-26T18:25:27.632 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.412+0000 7fd79e59c700 1 --2- 172.21.15.80:0/1101050027 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7fd7880394a0 0x7fd78803b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:27.632 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.413+0000 7fd79e59c700 1 --2- 172.21.15.80:0/1101050027 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7fd7880394a0 0x7fd78803b960 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd794006fd0 tx=0x7fd794006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:27.632 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.417+0000 7fd787fff700 1 -- 172.21.15.80:0/1101050027 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd790017d70 con 0x7fd7a0108dc0 2024-04-26T18:25:27.632 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.497+0000 7fd787fff700 1 -- 172.21.15.80:0/1101050027 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fd79002d910 con 0x7fd7a0108dc0 2024-04-26T18:25:27.632 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.632+0000 7fd7a5116700 1 -- 172.21.15.80:0/1101050027 --> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fd7a01055e0 con 0x7fd7880394a0 2024-04-26T18:25:27.632 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.637+0000 7fd787fff700 1 -- 172.21.15.80:0/1101050027 <== mgr.14116 v2:172.21.15.80:6800/1997155783 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd7a01055e0 con 0x7fd7880394a0 2024-04-26T18:25:27.632 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.639+0000 7fd7a5116700 1 -- 172.21.15.80:0/1101050027 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7fd7880394a0 msgr2=0x7fd78803b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:27.632 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.639+0000 7fd7a5116700 1 --2- 172.21.15.80:0/1101050027 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7fd7880394a0 0x7fd78803b960 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd794006fd0 tx=0x7fd794006e40 comp rx=0 tx=0).stop 2024-04-26T18:25:27.632 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.639+0000 7fd7a5116700 1 -- 172.21.15.80:0/1101050027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a0108dc0 msgr2=0x7fd7a019cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:27.632 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.639+0000 7fd7a5116700 1 --2- 172.21.15.80:0/1101050027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a0108dc0 0x7fd7a019cd50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd790003f40 tx=0x7fd790011890 comp rx=0 tx=0).stop 2024-04-26T18:25:27.632 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.639+0000 7fd7a5116700 1 -- 172.21.15.80:0/1101050027 shutdown_connections 2024-04-26T18:25:27.632 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.639+0000 7fd7a5116700 1 --2- 172.21.15.80:0/1101050027 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7fd7880394a0 0x7fd78803b960 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:27.633 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.639+0000 7fd7a5116700 1 --2- 172.21.15.80:0/1101050027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a0108dc0 0x7fd7a019cd50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:27.633 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.639+0000 7fd7a5116700 1 -- 172.21.15.80:0/1101050027 >> 172.21.15.80:0/1101050027 conn(0x7fd7a0104380 msgr2=0x7fd7a0104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:27.633 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.639+0000 7fd7a5116700 1 -- 172.21.15.80:0/1101050027 shutdown_connections 2024-04-26T18:25:27.633 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:26.639+0000 7fd7a5116700 1 -- 172.21.15.80:0/1101050027 wait complete. 2024-04-26T18:25:28.801 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-26T18:25:28.801 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.079+0000 7fd95ef77700 1 Processor -- start 2024-04-26T18:25:28.801 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.079+0000 7fd95ef77700 1 -- start start 2024-04-26T18:25:28.801 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.079+0000 7fd95ef77700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd958108e00 0x7fd958109220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:28.801 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.079+0000 7fd95ef77700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd958109760 con 0x7fd958108e00 2024-04-26T18:25:28.802 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.079+0000 7fd95cd13700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd958108e00 0x7fd958109220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:28.802 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.079+0000 7fd95cd13700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd958108e00 0x7fd958109220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40386/0 (socket says 172.21.15.80:40386) 2024-04-26T18:25:28.802 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.079+0000 7fd95cd13700 1 -- 172.21.15.80:0/1068815534 learned_addr learned my addr 172.21.15.80:0/1068815534 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:28.802 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.079+0000 7fd95cd13700 1 -- 172.21.15.80:0/1068815534 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd958109f60 con 0x7fd958108e00 2024-04-26T18:25:28.802 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.079+0000 7fd95cd13700 1 --2- 172.21.15.80:0/1068815534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd958108e00 0x7fd958109220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd94c0098a0 tx=0x7fd94c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a954b23149d0b39 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:28.802 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.080+0000 7fd9577fe700 1 -- 172.21.15.80:0/1068815534 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd94c004160 con 0x7fd958108e00 2024-04-26T18:25:28.802 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.080+0000 7fd9577fe700 1 -- 172.21.15.80:0/1068815534 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd94c004300 con 0x7fd958108e00 2024-04-26T18:25:28.802 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.080+0000 7fd9577fe700 1 -- 172.21.15.80:0/1068815534 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd94c011af0 con 0x7fd958108e00 2024-04-26T18:25:28.802 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.080+0000 7fd95ef77700 1 -- 172.21.15.80:0/1068815534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd958108e00 msgr2=0x7fd958109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:28.802 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.080+0000 7fd95ef77700 1 --2- 172.21.15.80:0/1068815534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd958108e00 0x7fd958109220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd94c0098a0 tx=0x7fd94c009bb0 comp rx=0 tx=0).stop 2024-04-26T18:25:28.802 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.080+0000 7fd95ef77700 1 -- 172.21.15.80:0/1068815534 shutdown_connections 2024-04-26T18:25:28.802 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.080+0000 7fd95ef77700 1 --2- 172.21.15.80:0/1068815534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd958108e00 0x7fd958109220 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:28.802 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.080+0000 7fd95ef77700 1 -- 172.21.15.80:0/1068815534 >> 172.21.15.80:0/1068815534 conn(0x7fd958104380 msgr2=0x7fd9581067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:28.803 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.080+0000 7fd95ef77700 1 -- 172.21.15.80:0/1068815534 shutdown_connections 2024-04-26T18:25:28.803 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.080+0000 7fd95ef77700 1 -- 172.21.15.80:0/1068815534 wait complete. 2024-04-26T18:25:28.803 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.081+0000 7fd95ef77700 1 Processor -- start 2024-04-26T18:25:28.803 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.081+0000 7fd95ef77700 1 -- start start 2024-04-26T18:25:28.803 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.081+0000 7fd95ef77700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd958108e00 0x7fd95807f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:28.803 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.081+0000 7fd95ef77700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd95810d3a0 con 0x7fd958108e00 2024-04-26T18:25:28.803 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.081+0000 7fd95cd13700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd958108e00 0x7fd95807f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:28.803 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.081+0000 7fd95cd13700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd958108e00 0x7fd95807f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40400/0 (socket says 172.21.15.80:40400) 2024-04-26T18:25:28.803 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.081+0000 7fd95cd13700 1 -- 172.21.15.80:0/3486370871 learned_addr learned my addr 172.21.15.80:0/3486370871 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:28.803 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.081+0000 7fd95cd13700 1 -- 172.21.15.80:0/3486370871 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95807f900 con 0x7fd958108e00 2024-04-26T18:25:28.803 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.081+0000 7fd95cd13700 1 --2- 172.21.15.80:0/3486370871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd958108e00 0x7fd95807f3c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd94c011ac0 tx=0x7fd94c011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:28.804 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.082+0000 7fd955ffb700 1 -- 172.21.15.80:0/3486370871 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd94c003970 con 0x7fd958108e00 2024-04-26T18:25:28.804 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.082+0000 7fd955ffb700 1 -- 172.21.15.80:0/3486370871 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd94c003b10 con 0x7fd958108e00 2024-04-26T18:25:28.804 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.082+0000 7fd95ef77700 1 -- 172.21.15.80:0/3486370871 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd95807daf0 con 0x7fd958108e00 2024-04-26T18:25:28.804 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.082+0000 7fd955ffb700 1 -- 172.21.15.80:0/3486370871 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd94c024610 con 0x7fd958108e00 2024-04-26T18:25:28.804 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.082+0000 7fd95ef77700 1 -- 172.21.15.80:0/3486370871 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd95807e030 con 0x7fd958108e00 2024-04-26T18:25:28.804 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.083+0000 7fd955ffb700 1 -- 172.21.15.80:0/3486370871 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fd94c024890 con 0x7fd958108e00 2024-04-26T18:25:28.804 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.083+0000 7fd95ef77700 1 -- 172.21.15.80:0/3486370871 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd958064a80 con 0x7fd958108e00 2024-04-26T18:25:28.804 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.083+0000 7fd955ffb700 1 --2- 172.21.15.80:0/3486370871 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7fd9480395b0 0x7fd94803ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:28.804 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.083+0000 7fd955ffb700 1 -- 172.21.15.80:0/3486370871 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd94c04d930 con 0x7fd958108e00 2024-04-26T18:25:28.804 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.083+0000 7fd957fff700 1 --2- 172.21.15.80:0/3486370871 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7fd9480395b0 0x7fd94803ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:28.804 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.083+0000 7fd957fff700 1 --2- 172.21.15.80:0/3486370871 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7fd9480395b0 0x7fd94803ba70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd944006fd0 tx=0x7fd944006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:28.804 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.088+0000 7fd955ffb700 1 -- 172.21.15.80:0/3486370871 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd94c0172b0 con 0x7fd958108e00 2024-04-26T18:25:28.804 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.291+0000 7fd95ef77700 1 -- 172.21.15.80:0/3486370871 --> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fd9581055a0 con 0x7fd9480395b0 2024-04-26T18:25:28.804 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.292+0000 7fd955ffb700 1 -- 172.21.15.80:0/3486370871 <== mgr.14116 v2:172.21.15.80:6800/1997155783 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fd9581055a0 con 0x7fd9480395b0 2024-04-26T18:25:28.805 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.294+0000 7fd95ef77700 1 -- 172.21.15.80:0/3486370871 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7fd9480395b0 msgr2=0x7fd94803ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:28.805 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.294+0000 7fd95ef77700 1 --2- 172.21.15.80:0/3486370871 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7fd9480395b0 0x7fd94803ba70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd944006fd0 tx=0x7fd944006e40 comp rx=0 tx=0).stop 2024-04-26T18:25:28.805 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.294+0000 7fd95ef77700 1 -- 172.21.15.80:0/3486370871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd958108e00 msgr2=0x7fd95807f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:28.805 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.294+0000 7fd95ef77700 1 --2- 172.21.15.80:0/3486370871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd958108e00 0x7fd95807f3c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd94c011ac0 tx=0x7fd94c011ba0 comp rx=0 tx=0).stop 2024-04-26T18:25:28.805 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.294+0000 7fd95ef77700 1 -- 172.21.15.80:0/3486370871 shutdown_connections 2024-04-26T18:25:28.805 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.294+0000 7fd95ef77700 1 --2- 172.21.15.80:0/3486370871 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7fd9480395b0 0x7fd94803ba70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:28.805 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.294+0000 7fd95ef77700 1 --2- 172.21.15.80:0/3486370871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd958108e00 0x7fd95807f3c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:28.805 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.294+0000 7fd95ef77700 1 -- 172.21.15.80:0/3486370871 >> 172.21.15.80:0/3486370871 conn(0x7fd958104380 msgr2=0x7fd958104e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:28.805 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.294+0000 7fd95ef77700 1 -- 172.21.15.80:0/3486370871 shutdown_connections 2024-04-26T18:25:28.805 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:28.294+0000 7fd95ef77700 1 -- 172.21.15.80:0/3486370871 wait complete. 2024-04-26T18:25:28.805 INFO:teuthology.orchestra.run.smithi080.stdout:Generating ssh key... 2024-04-26T18:25:28.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:28 smithi080 ceph-mon[29135]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:25:29.743 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:29 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: Generating public/private rsa key pair. 2024-04-26T18:25:29.743 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:29 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: Your identification has been saved in /tmp/tmp7th41mo3/key. 2024-04-26T18:25:29.743 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:29 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: Your public key has been saved in /tmp/tmp7th41mo3/key.pub. 2024-04-26T18:25:29.744 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:29 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: The key fingerprint is: 2024-04-26T18:25:29.744 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:29 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: SHA256:Zb9hW/cMrzH5vq0VtEmOowuBhjmGR2nXxiDvUV0EHoY ceph-2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:25:29.744 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:29 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: The key's randomart image is: 2024-04-26T18:25:29.744 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:29 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: +---[RSA 3072]----+ 2024-04-26T18:25:29.744 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:29 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: | . . .o++o | 2024-04-26T18:25:29.744 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:29 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: | + =Eo.. | 2024-04-26T18:25:29.744 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:29 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: | + + +o. o | 2024-04-26T18:25:29.744 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:29 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: | + = +o . = o| 2024-04-26T18:25:29.744 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:29 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: | . * +S. +oo=.| 2024-04-26T18:25:29.744 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:29 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: | o o ...=.*o| 2024-04-26T18:25:29.744 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:29 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: | . .o + =| 2024-04-26T18:25:29.744 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:29 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: | . . *.| 2024-04-26T18:25:29.744 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:29 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: | . o+=| 2024-04-26T18:25:29.744 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:29 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: +----[SHA256]-----+ 2024-04-26T18:25:30.040 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.215+0000 7f5770c19700 1 Processor -- start 2024-04-26T18:25:30.040 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.216+0000 7f5770c19700 1 -- start start 2024-04-26T18:25:30.040 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.216+0000 7f5770c19700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f576c109890 0x7f576c10bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:30.040 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.216+0000 7f5770c19700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f576c07d6a0 con 0x7f576c109890 2024-04-26T18:25:30.040 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.216+0000 7f576a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f576c109890 0x7f576c10bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:30.040 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.216+0000 7f576a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f576c109890 0x7f576c10bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40402/0 (socket says 172.21.15.80:40402) 2024-04-26T18:25:30.040 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.216+0000 7f576a59c700 1 -- 172.21.15.80:0/3849198779 learned_addr learned my addr 172.21.15.80:0/3849198779 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:30.040 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.216+0000 7f576a59c700 1 -- 172.21.15.80:0/3849198779 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f576c10c1c0 con 0x7f576c109890 2024-04-26T18:25:30.040 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.216+0000 7f576a59c700 1 --2- 172.21.15.80:0/3849198779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f576c109890 0x7f576c10bc80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5764009e80 tx=0x7f576400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38147985301b2dea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:30.040 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.217+0000 7f576959a700 1 -- 172.21.15.80:0/3849198779 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5764017070 con 0x7f576c109890 2024-04-26T18:25:30.040 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.217+0000 7f576959a700 1 -- 172.21.15.80:0/3849198779 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f576400b8c0 con 0x7f576c109890 2024-04-26T18:25:30.041 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.217+0000 7f576959a700 1 -- 172.21.15.80:0/3849198779 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5764004490 con 0x7f576c109890 2024-04-26T18:25:30.041 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.217+0000 7f5770c19700 1 -- 172.21.15.80:0/3849198779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f576c109890 msgr2=0x7f576c10bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:30.041 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.217+0000 7f5770c19700 1 --2- 172.21.15.80:0/3849198779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f576c109890 0x7f576c10bc80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5764009e80 tx=0x7f576400b330 comp rx=0 tx=0).stop 2024-04-26T18:25:30.041 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.217+0000 7f5770c19700 1 -- 172.21.15.80:0/3849198779 shutdown_connections 2024-04-26T18:25:30.041 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.217+0000 7f5770c19700 1 --2- 172.21.15.80:0/3849198779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f576c109890 0x7f576c10bc80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:30.041 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.217+0000 7f5770c19700 1 -- 172.21.15.80:0/3849198779 >> 172.21.15.80:0/3849198779 conn(0x7f576c103260 msgr2=0x7f576c1056a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:30.041 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.217+0000 7f5770c19700 1 -- 172.21.15.80:0/3849198779 shutdown_connections 2024-04-26T18:25:30.041 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.217+0000 7f5770c19700 1 -- 172.21.15.80:0/3849198779 wait complete. 2024-04-26T18:25:30.041 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.218+0000 7f5770c19700 1 Processor -- start 2024-04-26T18:25:30.041 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.218+0000 7f5770c19700 1 -- start start 2024-04-26T18:25:30.041 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.218+0000 7f5770c19700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f576c109890 0x7f576c19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:30.041 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.218+0000 7f5770c19700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f576c10d130 con 0x7f576c109890 2024-04-26T18:25:30.041 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.218+0000 7f576a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f576c109890 0x7f576c19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:30.042 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.218+0000 7f576a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f576c109890 0x7f576c19ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40406/0 (socket says 172.21.15.80:40406) 2024-04-26T18:25:30.042 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.219+0000 7f576a59c700 1 -- 172.21.15.80:0/3337578114 learned_addr learned my addr 172.21.15.80:0/3337578114 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:30.042 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.219+0000 7f576a59c700 1 -- 172.21.15.80:0/3337578114 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f576c19d1f0 con 0x7f576c109890 2024-04-26T18:25:30.042 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.219+0000 7f576a59c700 1 --2- 172.21.15.80:0/3337578114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f576c109890 0x7f576c19ccb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f576400b7b0 tx=0x7f576400be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:30.042 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.219+0000 7f57637fe700 1 -- 172.21.15.80:0/3337578114 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5764020020 con 0x7f576c109890 2024-04-26T18:25:30.042 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.219+0000 7f57637fe700 1 -- 172.21.15.80:0/3337578114 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5764003d10 con 0x7f576c109890 2024-04-26T18:25:30.042 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.219+0000 7f5770c19700 1 -- 172.21.15.80:0/3337578114 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f576c19d480 con 0x7f576c109890 2024-04-26T18:25:30.042 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.219+0000 7f57637fe700 1 -- 172.21.15.80:0/3337578114 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5764017040 con 0x7f576c109890 2024-04-26T18:25:30.042 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.219+0000 7f5770c19700 1 -- 172.21.15.80:0/3337578114 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f576c1a0170 con 0x7f576c109890 2024-04-26T18:25:30.042 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.220+0000 7f57637fe700 1 -- 172.21.15.80:0/3337578114 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f5764023020 con 0x7f576c109890 2024-04-26T18:25:30.042 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.220+0000 7f5770c19700 1 -- 172.21.15.80:0/3337578114 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f576c064a80 con 0x7f576c109890 2024-04-26T18:25:30.043 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.220+0000 7f57637fe700 1 --2- 172.21.15.80:0/3337578114 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f57580395b0 0x7f575803ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:30.043 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.220+0000 7f57637fe700 1 -- 172.21.15.80:0/3337578114 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f576400f050 con 0x7f576c109890 2024-04-26T18:25:30.043 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.221+0000 7f5769d9b700 1 --2- 172.21.15.80:0/3337578114 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f57580395b0 0x7f575803ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:30.043 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.221+0000 7f5769d9b700 1 --2- 172.21.15.80:0/3337578114 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f57580395b0 0x7f575803ba70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5754006fd0 tx=0x7f5754006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:30.043 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.225+0000 7f57637fe700 1 -- 172.21.15.80:0/3337578114 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f576402a020 con 0x7f576c109890 2024-04-26T18:25:30.043 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.426+0000 7f5770c19700 1 -- 172.21.15.80:0/3337578114 --> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f576c104460 con 0x7f57580395b0 2024-04-26T18:25:30.043 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.480+0000 7f57637fe700 1 -- 172.21.15.80:0/3337578114 <== mgr.14116 v2:172.21.15.80:6800/1997155783 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f576c104460 con 0x7f57580395b0 2024-04-26T18:25:30.043 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.482+0000 7f5770c19700 1 -- 172.21.15.80:0/3337578114 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f57580395b0 msgr2=0x7f575803ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:30.043 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.482+0000 7f5770c19700 1 --2- 172.21.15.80:0/3337578114 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f57580395b0 0x7f575803ba70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5754006fd0 tx=0x7f5754006e40 comp rx=0 tx=0).stop 2024-04-26T18:25:30.043 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.482+0000 7f5770c19700 1 -- 172.21.15.80:0/3337578114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f576c109890 msgr2=0x7f576c19ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:30.043 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.482+0000 7f5770c19700 1 --2- 172.21.15.80:0/3337578114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f576c109890 0x7f576c19ccb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f576400b7b0 tx=0x7f576400be90 comp rx=0 tx=0).stop 2024-04-26T18:25:30.043 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.482+0000 7f5770c19700 1 -- 172.21.15.80:0/3337578114 shutdown_connections 2024-04-26T18:25:30.043 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.482+0000 7f5770c19700 1 --2- 172.21.15.80:0/3337578114 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f57580395b0 0x7f575803ba70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:30.043 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.482+0000 7f5770c19700 1 --2- 172.21.15.80:0/3337578114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f576c109890 0x7f576c19ccb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:30.044 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.482+0000 7f5770c19700 1 -- 172.21.15.80:0/3337578114 >> 172.21.15.80:0/3337578114 conn(0x7f576c103260 msgr2=0x7f576c103d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:30.044 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.483+0000 7f5770c19700 1 -- 172.21.15.80:0/3337578114 shutdown_connections 2024-04-26T18:25:30.044 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:29.483+0000 7f5770c19700 1 -- 172.21.15.80:0/3337578114 wait complete. 2024-04-26T18:25:30.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:30 smithi080 ceph-mon[29135]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:25:30.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:30 smithi080 ceph-mon[29135]: Generating ssh key... 2024-04-26T18:25:30.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:30 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' 2024-04-26T18:25:30.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:30 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' 2024-04-26T18:25:31.222 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtxMrVAIS6axjyyHJ6FuhX3LxeTXRKM6qCUtxSz5TQVvHJXJL1UWSFdO7zBbQFGMjApFjdkGA4g2gs4O9FNYSBHFTLABcitItmYcH6A+BC1aN7tjZ1cLshKUwElk3s+HrXmj+8FJDTGB5/j2EpXSAeNd6x6rmkiMo8LTDYLIm759VfrH1XgeBKI6/YyGleAZcy2Q3GhZNSY57DAVr/IRIABMBPC3kkGKe8+Tsk1/bMoXQNuoO/nXNUI697/K7YWqODjlqB9+C/dt8GlXFrWzuH4tSGG6ULFr7S6jTPZcsZaH6tuWxocQL7jkVZKVMYNzS5iOoNQUXpYioLNs023YlVcsjm9xJq8d+Ow7NOlUonZaY12+7aQL5Ac7hTZOswNwM5ynSwr0qSbGJgV97v3fbSsMJJub8/AlGLs6SYE0HZ5tbe78RF//WuKiemyF9fHXxz+L7XjZYjLzK1aWf7+PHw8Z3k/k5r8XQDytdNnkwws9eQ84GlPUbbUY9IdZ0DkMM= ceph-2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:25:31.223 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.401+0000 7f3722d9c700 1 Processor -- start 2024-04-26T18:25:31.223 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.401+0000 7f3722d9c700 1 -- start start 2024-04-26T18:25:31.223 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.401+0000 7f3722d9c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c1076b0 0x7f371c107ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:31.223 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.401+0000 7f3722d9c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f371c07d680 con 0x7f371c1076b0 2024-04-26T18:25:31.223 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.401+0000 7f3720b38700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c1076b0 0x7f371c107ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:31.223 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.401+0000 7f3720b38700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c1076b0 0x7f371c107ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40418/0 (socket says 172.21.15.80:40418) 2024-04-26T18:25:31.223 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.401+0000 7f3720b38700 1 -- 172.21.15.80:0/1890194490 learned_addr learned my addr 172.21.15.80:0/1890194490 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:31.223 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.402+0000 7f3720b38700 1 -- 172.21.15.80:0/1890194490 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371c108010 con 0x7f371c1076b0 2024-04-26T18:25:31.223 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.402+0000 7f3720b38700 1 --2- 172.21.15.80:0/1890194490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c1076b0 0x7f371c107ad0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f37100098a0 tx=0x7f3710009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa9a944f8abac43 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:31.223 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.402+0000 7f371b7fe700 1 -- 172.21.15.80:0/1890194490 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3710004160 con 0x7f371c1076b0 2024-04-26T18:25:31.223 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.402+0000 7f371b7fe700 1 -- 172.21.15.80:0/1890194490 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3710004300 con 0x7f371c1076b0 2024-04-26T18:25:31.223 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.402+0000 7f371b7fe700 1 -- 172.21.15.80:0/1890194490 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3710011af0 con 0x7f371c1076b0 2024-04-26T18:25:31.223 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.402+0000 7f3722d9c700 1 -- 172.21.15.80:0/1890194490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c1076b0 msgr2=0x7f371c107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:31.224 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.402+0000 7f3722d9c700 1 --2- 172.21.15.80:0/1890194490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c1076b0 0x7f371c107ad0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f37100098a0 tx=0x7f3710009bb0 comp rx=0 tx=0).stop 2024-04-26T18:25:31.224 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.403+0000 7f3722d9c700 1 -- 172.21.15.80:0/1890194490 shutdown_connections 2024-04-26T18:25:31.224 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.403+0000 7f3722d9c700 1 --2- 172.21.15.80:0/1890194490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c1076b0 0x7f371c107ad0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:31.224 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.403+0000 7f3722d9c700 1 -- 172.21.15.80:0/1890194490 >> 172.21.15.80:0/1890194490 conn(0x7f371c103250 msgr2=0x7f371c1056b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:31.224 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.403+0000 7f3722d9c700 1 -- 172.21.15.80:0/1890194490 shutdown_connections 2024-04-26T18:25:31.224 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.403+0000 7f3722d9c700 1 -- 172.21.15.80:0/1890194490 wait complete. 2024-04-26T18:25:31.224 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.403+0000 7f3722d9c700 1 Processor -- start 2024-04-26T18:25:31.224 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.403+0000 7f3722d9c700 1 -- start start 2024-04-26T18:25:31.224 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.403+0000 7f3722d9c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c1076b0 0x7f371c19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:31.224 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.403+0000 7f3722d9c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f371c109040 con 0x7f371c1076b0 2024-04-26T18:25:31.224 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.403+0000 7f3720b38700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c1076b0 0x7f371c19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:31.224 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.404+0000 7f3720b38700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c1076b0 0x7f371c19eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40424/0 (socket says 172.21.15.80:40424) 2024-04-26T18:25:31.224 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.404+0000 7f3720b38700 1 -- 172.21.15.80:0/22983246 learned_addr learned my addr 172.21.15.80:0/22983246 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:31.225 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.404+0000 7f3720b38700 1 -- 172.21.15.80:0/22983246 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371c19f420 con 0x7f371c1076b0 2024-04-26T18:25:31.225 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.404+0000 7f3720b38700 1 --2- 172.21.15.80:0/22983246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c1076b0 0x7f371c19eee0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3710003f40 tx=0x7f3710011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:31.225 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.404+0000 7f3719ffb700 1 -- 172.21.15.80:0/22983246 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37100038b0 con 0x7f371c1076b0 2024-04-26T18:25:31.225 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.404+0000 7f3719ffb700 1 -- 172.21.15.80:0/22983246 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3710003a50 con 0x7f371c1076b0 2024-04-26T18:25:31.225 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.404+0000 7f3719ffb700 1 -- 172.21.15.80:0/22983246 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f371001a5c0 con 0x7f371c1076b0 2024-04-26T18:25:31.225 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.404+0000 7f3722d9c700 1 -- 172.21.15.80:0/22983246 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f371c19f6b0 con 0x7f371c1076b0 2024-04-26T18:25:31.225 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.404+0000 7f3722d9c700 1 -- 172.21.15.80:0/22983246 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f371c1a23a0 con 0x7f371c1076b0 2024-04-26T18:25:31.225 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.405+0000 7f3719ffb700 1 -- 172.21.15.80:0/22983246 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f3710024430 con 0x7f371c1076b0 2024-04-26T18:25:31.225 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.405+0000 7f3719ffb700 1 --2- 172.21.15.80:0/22983246 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f370c039560 0x7f370c03ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:31.225 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.405+0000 7f3722d9c700 1 -- 172.21.15.80:0/22983246 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f371c064a80 con 0x7f371c1076b0 2024-04-26T18:25:31.225 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.405+0000 7f3719ffb700 1 -- 172.21.15.80:0/22983246 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f371004dab0 con 0x7f371c1076b0 2024-04-26T18:25:31.225 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.405+0000 7f371bfff700 1 --2- 172.21.15.80:0/22983246 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f370c039560 0x7f370c03ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:31.225 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.406+0000 7f371bfff700 1 --2- 172.21.15.80:0/22983246 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f370c039560 0x7f370c03ba20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3708006fd0 tx=0x7f3708006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:31.225 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.411+0000 7f3719ffb700 1 -- 172.21.15.80:0/22983246 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f371002d910 con 0x7f371c1076b0 2024-04-26T18:25:31.226 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.614+0000 7f3722d9c700 1 -- 172.21.15.80:0/22983246 --> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f371c02e790 con 0x7f370c039560 2024-04-26T18:25:31.226 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.615+0000 7f3719ffb700 1 -- 172.21.15.80:0/22983246 <== mgr.14116 v2:172.21.15.80:6800/1997155783 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f371c02e790 con 0x7f370c039560 2024-04-26T18:25:31.226 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.617+0000 7f3722d9c700 1 -- 172.21.15.80:0/22983246 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f370c039560 msgr2=0x7f370c03ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:31.226 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.617+0000 7f3722d9c700 1 --2- 172.21.15.80:0/22983246 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f370c039560 0x7f370c03ba20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3708006fd0 tx=0x7f3708006e40 comp rx=0 tx=0).stop 2024-04-26T18:25:31.226 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.617+0000 7f3722d9c700 1 -- 172.21.15.80:0/22983246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c1076b0 msgr2=0x7f371c19eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:31.226 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.617+0000 7f3722d9c700 1 --2- 172.21.15.80:0/22983246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c1076b0 0x7f371c19eee0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3710003f40 tx=0x7f3710011890 comp rx=0 tx=0).stop 2024-04-26T18:25:31.226 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.617+0000 7f3722d9c700 1 -- 172.21.15.80:0/22983246 shutdown_connections 2024-04-26T18:25:31.226 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.617+0000 7f3722d9c700 1 --2- 172.21.15.80:0/22983246 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f370c039560 0x7f370c03ba20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:31.226 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.617+0000 7f3722d9c700 1 --2- 172.21.15.80:0/22983246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f371c1076b0 0x7f371c19eee0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:31.226 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.617+0000 7f3722d9c700 1 -- 172.21.15.80:0/22983246 >> 172.21.15.80:0/22983246 conn(0x7f371c103250 msgr2=0x7f371c195bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:31.226 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.617+0000 7f3722d9c700 1 -- 172.21.15.80:0/22983246 shutdown_connections 2024-04-26T18:25:31.226 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:30.617+0000 7f3722d9c700 1 -- 172.21.15.80:0/22983246 wait complete. 2024-04-26T18:25:31.226 INFO:teuthology.orchestra.run.smithi080.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-26T18:25:31.226 INFO:teuthology.orchestra.run.smithi080.stdout:Adding key to root@localhost authorized_keys... 2024-04-26T18:25:31.227 INFO:teuthology.orchestra.run.smithi080.stdout:Adding host smithi080... 2024-04-26T18:25:31.616 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:31 smithi080 ceph-mon[29135]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:25:32.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:32 smithi080 ceph-mon[29135]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi080", "addr": "172.21.15.80", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:25:32.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:32 smithi080 ceph-mon[29135]: Deploying cephadm binary to smithi080 2024-04-26T18:25:36.486 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout Added host 'smithi080' with addr '172.21.15.80' 2024-04-26T18:25:36.486 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.633+0000 7f3ad69f4700 1 Processor -- start 2024-04-26T18:25:36.486 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.633+0000 7f3ad69f4700 1 -- start start 2024-04-26T18:25:36.487 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.633+0000 7f3ad69f4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad0108e00 0x7f3ad0109220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:36.487 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.633+0000 7f3ad69f4700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad0109760 con 0x7f3ad0108e00 2024-04-26T18:25:36.487 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.633+0000 7f3acffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad0108e00 0x7f3ad0109220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:36.487 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.633+0000 7f3acffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad0108e00 0x7f3ad0109220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40436/0 (socket says 172.21.15.80:40436) 2024-04-26T18:25:36.487 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.633+0000 7f3acffff700 1 -- 172.21.15.80:0/4138107323 learned_addr learned my addr 172.21.15.80:0/4138107323 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:36.487 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.633+0000 7f3acffff700 1 -- 172.21.15.80:0/4138107323 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad0109f60 con 0x7f3ad0108e00 2024-04-26T18:25:36.487 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.634+0000 7f3acffff700 1 --2- 172.21.15.80:0/4138107323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad0108e00 0x7f3ad0109220 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00098a0 tx=0x7f3ac0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6547ee0f15c9841 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:36.487 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.634+0000 7f3aceffd700 1 -- 172.21.15.80:0/4138107323 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ac0004160 con 0x7f3ad0108e00 2024-04-26T18:25:36.487 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.634+0000 7f3aceffd700 1 -- 172.21.15.80:0/4138107323 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3ac0004300 con 0x7f3ad0108e00 2024-04-26T18:25:36.487 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.634+0000 7f3aceffd700 1 -- 172.21.15.80:0/4138107323 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ac0011af0 con 0x7f3ad0108e00 2024-04-26T18:25:36.487 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.634+0000 7f3ad69f4700 1 -- 172.21.15.80:0/4138107323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad0108e00 msgr2=0x7f3ad0109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:36.487 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.634+0000 7f3ad69f4700 1 --2- 172.21.15.80:0/4138107323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad0108e00 0x7f3ad0109220 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00098a0 tx=0x7f3ac0009bb0 comp rx=0 tx=0).stop 2024-04-26T18:25:36.487 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.634+0000 7f3ad69f4700 1 -- 172.21.15.80:0/4138107323 shutdown_connections 2024-04-26T18:25:36.488 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.634+0000 7f3ad69f4700 1 --2- 172.21.15.80:0/4138107323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad0108e00 0x7f3ad0109220 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:36.488 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.634+0000 7f3ad69f4700 1 -- 172.21.15.80:0/4138107323 >> 172.21.15.80:0/4138107323 conn(0x7f3ad0104380 msgr2=0x7f3ad01067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:36.488 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.634+0000 7f3ad69f4700 1 -- 172.21.15.80:0/4138107323 shutdown_connections 2024-04-26T18:25:36.488 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.634+0000 7f3ad69f4700 1 -- 172.21.15.80:0/4138107323 wait complete. 2024-04-26T18:25:36.488 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.635+0000 7f3ad69f4700 1 Processor -- start 2024-04-26T18:25:36.488 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.635+0000 7f3ad69f4700 1 -- start start 2024-04-26T18:25:36.488 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.635+0000 7f3ad69f4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad0108e00 0x7f3ad019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:36.488 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.635+0000 7f3ad69f4700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad010d3a0 con 0x7f3ad0108e00 2024-04-26T18:25:36.488 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.635+0000 7f3acffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad0108e00 0x7f3ad019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:36.488 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.635+0000 7f3acffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad0108e00 0x7f3ad019cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40450/0 (socket says 172.21.15.80:40450) 2024-04-26T18:25:36.488 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.635+0000 7f3acffff700 1 -- 172.21.15.80:0/703599662 learned_addr learned my addr 172.21.15.80:0/703599662 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:36.488 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.636+0000 7f3acffff700 1 -- 172.21.15.80:0/703599662 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad019d2d0 con 0x7f3ad0108e00 2024-04-26T18:25:36.488 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.636+0000 7f3acffff700 1 --2- 172.21.15.80:0/703599662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad0108e00 0x7f3ad019cd90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0011ac0 tx=0x7f3ac0011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:36.488 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.636+0000 7f3acd7fa700 1 -- 172.21.15.80:0/703599662 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ac0003970 con 0x7f3ad0108e00 2024-04-26T18:25:36.489 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.636+0000 7f3acd7fa700 1 -- 172.21.15.80:0/703599662 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3ac0003b10 con 0x7f3ad0108e00 2024-04-26T18:25:36.489 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.636+0000 7f3acd7fa700 1 -- 172.21.15.80:0/703599662 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ac0024610 con 0x7f3ad0108e00 2024-04-26T18:25:36.489 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.636+0000 7f3ad69f4700 1 -- 172.21.15.80:0/703599662 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad019d560 con 0x7f3ad0108e00 2024-04-26T18:25:36.489 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.636+0000 7f3ad69f4700 1 -- 172.21.15.80:0/703599662 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ad01a0210 con 0x7f3ad0108e00 2024-04-26T18:25:36.489 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.637+0000 7f3acd7fa700 1 -- 172.21.15.80:0/703599662 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f3ac001a430 con 0x7f3ad0108e00 2024-04-26T18:25:36.489 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.637+0000 7f3ad69f4700 1 -- 172.21.15.80:0/703599662 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ad0064a80 con 0x7f3ad0108e00 2024-04-26T18:25:36.489 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.637+0000 7f3acd7fa700 1 --2- 172.21.15.80:0/703599662 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f3ab80395b0 0x7f3ab803ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:36.489 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.637+0000 7f3acd7fa700 1 -- 172.21.15.80:0/703599662 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3ac004d910 con 0x7f3ad0108e00 2024-04-26T18:25:36.489 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.637+0000 7f3acf7fe700 1 --2- 172.21.15.80:0/703599662 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f3ab80395b0 0x7f3ab803ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:36.489 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.638+0000 7f3acf7fe700 1 --2- 172.21.15.80:0/703599662 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f3ab80395b0 0x7f3ab803ba70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4006fd0 tx=0x7f3ac4006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:36.489 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.642+0000 7f3acd7fa700 1 -- 172.21.15.80:0/703599662 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3ac0016260 con 0x7f3ad0108e00 2024-04-26T18:25:36.489 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:31.843+0000 7f3ad69f4700 1 -- 172.21.15.80:0/703599662 --> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi080", "addr": "172.21.15.80", "target": ["mon-mgr", ""]}) -- 0x7f3ad01055a0 con 0x7f3ab80395b0 2024-04-26T18:25:36.489 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:35.915+0000 7f3acd7fa700 1 -- 172.21.15.80:0/703599662 <== mgr.14116 v2:172.21.15.80:6800/1997155783 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f3ad01055a0 con 0x7f3ab80395b0 2024-04-26T18:25:36.489 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:35.917+0000 7f3ad69f4700 1 -- 172.21.15.80:0/703599662 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f3ab80395b0 msgr2=0x7f3ab803ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:36.489 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:35.917+0000 7f3ad69f4700 1 --2- 172.21.15.80:0/703599662 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f3ab80395b0 0x7f3ab803ba70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4006fd0 tx=0x7f3ac4006e40 comp rx=0 tx=0).stop 2024-04-26T18:25:36.490 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:35.917+0000 7f3ad69f4700 1 -- 172.21.15.80:0/703599662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad0108e00 msgr2=0x7f3ad019cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:36.490 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:35.917+0000 7f3ad69f4700 1 --2- 172.21.15.80:0/703599662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad0108e00 0x7f3ad019cd90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0011ac0 tx=0x7f3ac0011ba0 comp rx=0 tx=0).stop 2024-04-26T18:25:36.490 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:35.917+0000 7f3ad69f4700 1 -- 172.21.15.80:0/703599662 shutdown_connections 2024-04-26T18:25:36.490 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:35.917+0000 7f3ad69f4700 1 --2- 172.21.15.80:0/703599662 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f3ab80395b0 0x7f3ab803ba70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:36.490 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:35.917+0000 7f3ad69f4700 1 --2- 172.21.15.80:0/703599662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad0108e00 0x7f3ad019cd90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:36.490 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:35.917+0000 7f3ad69f4700 1 -- 172.21.15.80:0/703599662 >> 172.21.15.80:0/703599662 conn(0x7f3ad0104380 msgr2=0x7f3ad0104e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:36.490 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:35.917+0000 7f3ad69f4700 1 -- 172.21.15.80:0/703599662 shutdown_connections 2024-04-26T18:25:36.490 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:35.917+0000 7f3ad69f4700 1 -- 172.21.15.80:0/703599662 wait complete. 2024-04-26T18:25:36.490 INFO:teuthology.orchestra.run.smithi080.stdout:Deploying unmanaged mon service... 2024-04-26T18:25:37.114 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:36 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' 2024-04-26T18:25:37.114 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:36 smithi080 ceph-mon[29135]: Added host smithi080 2024-04-26T18:25:37.115 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:36 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:25:37.637 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-26T18:25:37.637 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.893+0000 7ff06bd45700 1 Processor -- start 2024-04-26T18:25:37.637 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.893+0000 7ff06bd45700 1 -- start start 2024-04-26T18:25:37.637 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.894+0000 7ff06bd45700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff064108e00 0x7ff064109220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:37.637 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.894+0000 7ff06bd45700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff064109760 con 0x7ff064108e00 2024-04-26T18:25:37.637 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.894+0000 7ff069ae1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff064108e00 0x7ff064109220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:37.637 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.894+0000 7ff069ae1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff064108e00 0x7ff064109220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54626/0 (socket says 172.21.15.80:54626) 2024-04-26T18:25:37.638 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.894+0000 7ff069ae1700 1 -- 172.21.15.80:0/386951371 learned_addr learned my addr 172.21.15.80:0/386951371 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:37.638 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.894+0000 7ff069ae1700 1 -- 172.21.15.80:0/386951371 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff064109f60 con 0x7ff064108e00 2024-04-26T18:25:37.638 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.894+0000 7ff069ae1700 1 --2- 172.21.15.80:0/386951371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff064108e00 0x7ff064109220 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff0600098a0 tx=0x7ff060009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f502e065cbacdcf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:37.638 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.894+0000 7ff068adf700 1 -- 172.21.15.80:0/386951371 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff060004160 con 0x7ff064108e00 2024-04-26T18:25:37.638 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.895+0000 7ff068adf700 1 -- 172.21.15.80:0/386951371 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff060004300 con 0x7ff064108e00 2024-04-26T18:25:37.638 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.895+0000 7ff068adf700 1 -- 172.21.15.80:0/386951371 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff060011af0 con 0x7ff064108e00 2024-04-26T18:25:37.638 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.895+0000 7ff06bd45700 1 -- 172.21.15.80:0/386951371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff064108e00 msgr2=0x7ff064109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:37.638 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.895+0000 7ff06bd45700 1 --2- 172.21.15.80:0/386951371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff064108e00 0x7ff064109220 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff0600098a0 tx=0x7ff060009bb0 comp rx=0 tx=0).stop 2024-04-26T18:25:37.638 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.895+0000 7ff06bd45700 1 -- 172.21.15.80:0/386951371 shutdown_connections 2024-04-26T18:25:37.638 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.895+0000 7ff06bd45700 1 --2- 172.21.15.80:0/386951371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff064108e00 0x7ff064109220 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:37.638 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.895+0000 7ff06bd45700 1 -- 172.21.15.80:0/386951371 >> 172.21.15.80:0/386951371 conn(0x7ff064104380 msgr2=0x7ff0641067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:37.638 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.895+0000 7ff06bd45700 1 -- 172.21.15.80:0/386951371 shutdown_connections 2024-04-26T18:25:37.638 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.895+0000 7ff06bd45700 1 -- 172.21.15.80:0/386951371 wait complete. 2024-04-26T18:25:37.638 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.896+0000 7ff06bd45700 1 Processor -- start 2024-04-26T18:25:37.639 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.896+0000 7ff06bd45700 1 -- start start 2024-04-26T18:25:37.639 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.896+0000 7ff06bd45700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff064108e00 0x7ff06419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:37.639 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.896+0000 7ff06bd45700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff06410d3a0 con 0x7ff064108e00 2024-04-26T18:25:37.639 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.896+0000 7ff069ae1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff064108e00 0x7ff06419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:37.639 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.896+0000 7ff069ae1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff064108e00 0x7ff06419cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54638/0 (socket says 172.21.15.80:54638) 2024-04-26T18:25:37.639 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.896+0000 7ff069ae1700 1 -- 172.21.15.80:0/3870219974 learned_addr learned my addr 172.21.15.80:0/3870219974 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:37.639 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.896+0000 7ff069ae1700 1 -- 172.21.15.80:0/3870219974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff06419d290 con 0x7ff064108e00 2024-04-26T18:25:37.639 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.896+0000 7ff069ae1700 1 --2- 172.21.15.80:0/3870219974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff064108e00 0x7ff06419cd50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff060009fb0 tx=0x7ff060011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:37.639 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.897+0000 7ff05affd700 1 -- 172.21.15.80:0/3870219974 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0600036a0 con 0x7ff064108e00 2024-04-26T18:25:37.639 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.897+0000 7ff05affd700 1 -- 172.21.15.80:0/3870219974 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff06001a430 con 0x7ff064108e00 2024-04-26T18:25:37.639 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.897+0000 7ff06bd45700 1 -- 172.21.15.80:0/3870219974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff06419d520 con 0x7ff064108e00 2024-04-26T18:25:37.639 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.897+0000 7ff05affd700 1 -- 172.21.15.80:0/3870219974 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff060019550 con 0x7ff064108e00 2024-04-26T18:25:37.639 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.897+0000 7ff06bd45700 1 -- 172.21.15.80:0/3870219974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0641a0210 con 0x7ff064108e00 2024-04-26T18:25:37.640 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.898+0000 7ff05affd700 1 -- 172.21.15.80:0/3870219974 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7ff060003840 con 0x7ff064108e00 2024-04-26T18:25:37.640 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.898+0000 7ff06bd45700 1 -- 172.21.15.80:0/3870219974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff064064a80 con 0x7ff064108e00 2024-04-26T18:25:37.640 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.898+0000 7ff05affd700 1 --2- 172.21.15.80:0/3870219974 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7ff0500395b0 0x7ff05003ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:37.640 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.898+0000 7ff05affd700 1 -- 172.21.15.80:0/3870219974 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff06004d8a0 con 0x7ff064108e00 2024-04-26T18:25:37.640 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.898+0000 7ff0692e0700 1 --2- 172.21.15.80:0/3870219974 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7ff0500395b0 0x7ff05003ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:37.640 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.898+0000 7ff0692e0700 1 --2- 172.21.15.80:0/3870219974 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7ff0500395b0 0x7ff05003ba70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff054006fd0 tx=0x7ff054006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:37.640 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:36.903+0000 7ff05affd700 1 -- 172.21.15.80:0/3870219974 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff0600172b0 con 0x7ff064108e00 2024-04-26T18:25:37.640 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:37.114+0000 7ff06bd45700 1 -- 172.21.15.80:0/3870219974 --> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7ff0641055f0 con 0x7ff0500395b0 2024-04-26T18:25:37.640 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:37.119+0000 7ff05affd700 1 -- 172.21.15.80:0/3870219974 <== mgr.14116 v2:172.21.15.80:6800/1997155783 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff0641055f0 con 0x7ff0500395b0 2024-04-26T18:25:37.640 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:37.121+0000 7ff06bd45700 1 -- 172.21.15.80:0/3870219974 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7ff0500395b0 msgr2=0x7ff05003ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:37.640 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:37.121+0000 7ff06bd45700 1 --2- 172.21.15.80:0/3870219974 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7ff0500395b0 0x7ff05003ba70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff054006fd0 tx=0x7ff054006e40 comp rx=0 tx=0).stop 2024-04-26T18:25:37.640 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:37.121+0000 7ff06bd45700 1 -- 172.21.15.80:0/3870219974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff064108e00 msgr2=0x7ff06419cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:37.640 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:37.121+0000 7ff06bd45700 1 --2- 172.21.15.80:0/3870219974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff064108e00 0x7ff06419cd50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff060009fb0 tx=0x7ff060011940 comp rx=0 tx=0).stop 2024-04-26T18:25:37.640 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:37.121+0000 7ff06bd45700 1 -- 172.21.15.80:0/3870219974 shutdown_connections 2024-04-26T18:25:37.641 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:37.121+0000 7ff06bd45700 1 --2- 172.21.15.80:0/3870219974 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7ff0500395b0 0x7ff05003ba70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:37.641 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:37.121+0000 7ff06bd45700 1 --2- 172.21.15.80:0/3870219974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff064108e00 0x7ff06419cd50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:37.641 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:37.121+0000 7ff06bd45700 1 -- 172.21.15.80:0/3870219974 >> 172.21.15.80:0/3870219974 conn(0x7ff064104380 msgr2=0x7ff064104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:37.641 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:37.121+0000 7ff06bd45700 1 -- 172.21.15.80:0/3870219974 shutdown_connections 2024-04-26T18:25:37.641 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:37.121+0000 7ff06bd45700 1 -- 172.21.15.80:0/3870219974 wait complete. 2024-04-26T18:25:37.641 INFO:teuthology.orchestra.run.smithi080.stdout:Deploying unmanaged mgr service... 2024-04-26T18:25:38.282 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:38 smithi080 ceph-mon[29135]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:25:38.282 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:38 smithi080 ceph-mon[29135]: Saving service mon spec with placement count:5 2024-04-26T18:25:38.282 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:38 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' 2024-04-26T18:25:38.987 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-26T18:25:38.987 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.048+0000 7f373abc5700 1 Processor -- start 2024-04-26T18:25:38.988 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.048+0000 7f373abc5700 1 -- start start 2024-04-26T18:25:38.988 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.048+0000 7f373abc5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3734108de0 0x7f3734109200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:38.988 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.048+0000 7f373abc5700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f37341097d0 con 0x7f3734108de0 2024-04-26T18:25:38.988 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.049+0000 7f3738961700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3734108de0 0x7f3734109200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:38.988 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.049+0000 7f3738961700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3734108de0 0x7f3734109200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54648/0 (socket says 172.21.15.80:54648) 2024-04-26T18:25:38.988 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.049+0000 7f3738961700 1 -- 172.21.15.80:0/3619105116 learned_addr learned my addr 172.21.15.80:0/3619105116 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:38.988 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.049+0000 7f3738961700 1 -- 172.21.15.80:0/3619105116 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3734109fe0 con 0x7f3734108de0 2024-04-26T18:25:38.988 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.049+0000 7f3738961700 1 --2- 172.21.15.80:0/3619105116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3734108de0 0x7f3734109200 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f37280098a0 tx=0x7f3728009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05aea89004ea8b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:38.988 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.049+0000 7f37337fe700 1 -- 172.21.15.80:0/3619105116 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3728004160 con 0x7f3734108de0 2024-04-26T18:25:38.988 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.049+0000 7f37337fe700 1 -- 172.21.15.80:0/3619105116 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3728004300 con 0x7f3734108de0 2024-04-26T18:25:38.988 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.049+0000 7f37337fe700 1 -- 172.21.15.80:0/3619105116 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3728011af0 con 0x7f3734108de0 2024-04-26T18:25:38.989 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.050+0000 7f373abc5700 1 -- 172.21.15.80:0/3619105116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3734108de0 msgr2=0x7f3734109200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:38.989 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.050+0000 7f373abc5700 1 --2- 172.21.15.80:0/3619105116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3734108de0 0x7f3734109200 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f37280098a0 tx=0x7f3728009bb0 comp rx=0 tx=0).stop 2024-04-26T18:25:38.989 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.050+0000 7f373abc5700 1 -- 172.21.15.80:0/3619105116 shutdown_connections 2024-04-26T18:25:38.989 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.050+0000 7f373abc5700 1 --2- 172.21.15.80:0/3619105116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3734108de0 0x7f3734109200 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:38.989 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.050+0000 7f373abc5700 1 -- 172.21.15.80:0/3619105116 >> 172.21.15.80:0/3619105116 conn(0x7f3734104340 msgr2=0x7f37341067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:38.989 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.050+0000 7f373abc5700 1 -- 172.21.15.80:0/3619105116 shutdown_connections 2024-04-26T18:25:38.989 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.050+0000 7f373abc5700 1 -- 172.21.15.80:0/3619105116 wait complete. 2024-04-26T18:25:38.989 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.050+0000 7f373abc5700 1 Processor -- start 2024-04-26T18:25:38.989 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.050+0000 7f373abc5700 1 -- start start 2024-04-26T18:25:38.989 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.050+0000 7f373abc5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3734108de0 0x7f373407f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:38.989 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.050+0000 7f373abc5700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f373410d390 con 0x7f3734108de0 2024-04-26T18:25:38.989 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.051+0000 7f3738961700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3734108de0 0x7f373407f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:38.989 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.051+0000 7f3738961700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3734108de0 0x7f373407f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54654/0 (socket says 172.21.15.80:54654) 2024-04-26T18:25:38.989 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.051+0000 7f3738961700 1 -- 172.21.15.80:0/4077627498 learned_addr learned my addr 172.21.15.80:0/4077627498 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:38.990 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.051+0000 7f3738961700 1 -- 172.21.15.80:0/4077627498 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f373407f900 con 0x7f3734108de0 2024-04-26T18:25:38.990 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.051+0000 7f3738961700 1 --2- 172.21.15.80:0/4077627498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3734108de0 0x7f373407f3c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3728003f40 tx=0x7f3728011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:38.990 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.051+0000 7f3731ffb700 1 -- 172.21.15.80:0/4077627498 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37280038b0 con 0x7f3734108de0 2024-04-26T18:25:38.990 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.051+0000 7f3731ffb700 1 -- 172.21.15.80:0/4077627498 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3728003a50 con 0x7f3734108de0 2024-04-26T18:25:38.990 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.051+0000 7f373abc5700 1 -- 172.21.15.80:0/4077627498 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f373407daf0 con 0x7f3734108de0 2024-04-26T18:25:38.990 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.051+0000 7f3731ffb700 1 -- 172.21.15.80:0/4077627498 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f372801a5c0 con 0x7f3734108de0 2024-04-26T18:25:38.990 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.051+0000 7f373abc5700 1 -- 172.21.15.80:0/4077627498 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f373407e030 con 0x7f3734108de0 2024-04-26T18:25:38.990 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.052+0000 7f3731ffb700 1 -- 172.21.15.80:0/4077627498 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f372801a870 con 0x7f3734108de0 2024-04-26T18:25:38.990 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.052+0000 7f373abc5700 1 -- 172.21.15.80:0/4077627498 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3734064a80 con 0x7f3734108de0 2024-04-26T18:25:38.990 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.053+0000 7f3731ffb700 1 --2- 172.21.15.80:0/4077627498 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f37240395b0 0x7f372403ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:38.990 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.053+0000 7f3731ffb700 1 -- 172.21.15.80:0/4077627498 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f372804dbb0 con 0x7f3734108de0 2024-04-26T18:25:38.991 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.053+0000 7f3733fff700 1 --2- 172.21.15.80:0/4077627498 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f37240395b0 0x7f372403ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:38.991 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.053+0000 7f3733fff700 1 --2- 172.21.15.80:0/4077627498 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f37240395b0 0x7f372403ba70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3720006fd0 tx=0x7f3720006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:38.991 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.058+0000 7f3731ffb700 1 -- 172.21.15.80:0/4077627498 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3728019c70 con 0x7f3734108de0 2024-04-26T18:25:38.991 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.275+0000 7f373abc5700 1 -- 172.21.15.80:0/4077627498 --> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f3734105580 con 0x7f37240395b0 2024-04-26T18:25:38.991 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.279+0000 7f3731ffb700 1 -- 172.21.15.80:0/4077627498 <== mgr.14116 v2:172.21.15.80:6800/1997155783 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f3734105580 con 0x7f37240395b0 2024-04-26T18:25:38.991 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.281+0000 7f373abc5700 1 -- 172.21.15.80:0/4077627498 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f37240395b0 msgr2=0x7f372403ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:38.991 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.281+0000 7f373abc5700 1 --2- 172.21.15.80:0/4077627498 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f37240395b0 0x7f372403ba70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3720006fd0 tx=0x7f3720006e40 comp rx=0 tx=0).stop 2024-04-26T18:25:38.991 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.281+0000 7f373abc5700 1 -- 172.21.15.80:0/4077627498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3734108de0 msgr2=0x7f373407f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:38.991 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.281+0000 7f373abc5700 1 --2- 172.21.15.80:0/4077627498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3734108de0 0x7f373407f3c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3728003f40 tx=0x7f3728011890 comp rx=0 tx=0).stop 2024-04-26T18:25:38.991 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.281+0000 7f373abc5700 1 -- 172.21.15.80:0/4077627498 shutdown_connections 2024-04-26T18:25:38.991 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.281+0000 7f373abc5700 1 --2- 172.21.15.80:0/4077627498 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f37240395b0 0x7f372403ba70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:38.991 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.281+0000 7f373abc5700 1 --2- 172.21.15.80:0/4077627498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3734108de0 0x7f373407f3c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:38.991 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.281+0000 7f373abc5700 1 -- 172.21.15.80:0/4077627498 >> 172.21.15.80:0/4077627498 conn(0x7f3734104340 msgr2=0x7f3734104e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:38.992 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.281+0000 7f373abc5700 1 -- 172.21.15.80:0/4077627498 shutdown_connections 2024-04-26T18:25:38.992 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:38.281+0000 7f373abc5700 1 -- 172.21.15.80:0/4077627498 wait complete. 2024-04-26T18:25:39.541 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:39 smithi080 ceph-mon[29135]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:25:39.541 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:39 smithi080 ceph-mon[29135]: Saving service mgr spec with placement count:2 2024-04-26T18:25:39.541 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:39 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' 2024-04-26T18:25:40.588 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.541+0000 7f913178c700 1 Processor -- start 2024-04-26T18:25:40.588 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.541+0000 7f913178c700 1 -- start start 2024-04-26T18:25:40.588 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.541+0000 7f913178c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912c107690 0x7f912c107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:40.588 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.541+0000 7f913178c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f912c07d6a0 con 0x7f912c107690 2024-04-26T18:25:40.588 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.541+0000 7f912affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912c107690 0x7f912c107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:40.588 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.541+0000 7f912affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912c107690 0x7f912c107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54668/0 (socket says 172.21.15.80:54668) 2024-04-26T18:25:40.588 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.541+0000 7f912affd700 1 -- 172.21.15.80:0/961820754 learned_addr learned my addr 172.21.15.80:0/961820754 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:40.588 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.541+0000 7f912affd700 1 -- 172.21.15.80:0/961820754 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f912c107ff0 con 0x7f912c107690 2024-04-26T18:25:40.588 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.542+0000 7f912affd700 1 --2- 172.21.15.80:0/961820754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912c107690 0x7f912c107ab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f911c0098a0 tx=0x7f911c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4b1acdba6e712 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:40.588 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.542+0000 7f9129ffb700 1 -- 172.21.15.80:0/961820754 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f911c004160 con 0x7f912c107690 2024-04-26T18:25:40.588 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.542+0000 7f9129ffb700 1 -- 172.21.15.80:0/961820754 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f911c004300 con 0x7f912c107690 2024-04-26T18:25:40.588 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.542+0000 7f9129ffb700 1 -- 172.21.15.80:0/961820754 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f911c011af0 con 0x7f912c107690 2024-04-26T18:25:40.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.542+0000 7f913178c700 1 -- 172.21.15.80:0/961820754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912c107690 msgr2=0x7f912c107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:40.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.542+0000 7f913178c700 1 --2- 172.21.15.80:0/961820754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912c107690 0x7f912c107ab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f911c0098a0 tx=0x7f911c009bb0 comp rx=0 tx=0).stop 2024-04-26T18:25:40.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.543+0000 7f913178c700 1 -- 172.21.15.80:0/961820754 shutdown_connections 2024-04-26T18:25:40.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.543+0000 7f913178c700 1 --2- 172.21.15.80:0/961820754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912c107690 0x7f912c107ab0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:40.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.543+0000 7f913178c700 1 -- 172.21.15.80:0/961820754 >> 172.21.15.80:0/961820754 conn(0x7f912c103290 msgr2=0x7f912c1056b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:40.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.543+0000 7f913178c700 1 -- 172.21.15.80:0/961820754 shutdown_connections 2024-04-26T18:25:40.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.543+0000 7f913178c700 1 -- 172.21.15.80:0/961820754 wait complete. 2024-04-26T18:25:40.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.543+0000 7f913178c700 1 Processor -- start 2024-04-26T18:25:40.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.543+0000 7f913178c700 1 -- start start 2024-04-26T18:25:40.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.544+0000 7f913178c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912c107690 0x7f912c19eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:40.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.544+0000 7f913178c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f912c109020 con 0x7f912c107690 2024-04-26T18:25:40.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.544+0000 7f912affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912c107690 0x7f912c19eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:40.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.544+0000 7f912affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912c107690 0x7f912c19eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54684/0 (socket says 172.21.15.80:54684) 2024-04-26T18:25:40.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.544+0000 7f912affd700 1 -- 172.21.15.80:0/304009135 learned_addr learned my addr 172.21.15.80:0/304009135 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:40.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.544+0000 7f912affd700 1 -- 172.21.15.80:0/304009135 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f912c19f400 con 0x7f912c107690 2024-04-26T18:25:40.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.544+0000 7f912affd700 1 --2- 172.21.15.80:0/304009135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912c107690 0x7f912c19eec0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f911c003f40 tx=0x7f911c011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:40.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.544+0000 7f9113fff700 1 -- 172.21.15.80:0/304009135 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f911c0038b0 con 0x7f912c107690 2024-04-26T18:25:40.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.544+0000 7f913178c700 1 -- 172.21.15.80:0/304009135 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f912c19f690 con 0x7f912c107690 2024-04-26T18:25:40.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.544+0000 7f9113fff700 1 -- 172.21.15.80:0/304009135 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f911c003a50 con 0x7f912c107690 2024-04-26T18:25:40.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.544+0000 7f9113fff700 1 -- 172.21.15.80:0/304009135 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f911c01a5c0 con 0x7f912c107690 2024-04-26T18:25:40.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.544+0000 7f913178c700 1 -- 172.21.15.80:0/304009135 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f912c1a2380 con 0x7f912c107690 2024-04-26T18:25:40.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.545+0000 7f9113fff700 1 -- 172.21.15.80:0/304009135 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f911c01a8c0 con 0x7f912c107690 2024-04-26T18:25:40.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.545+0000 7f913178c700 1 -- 172.21.15.80:0/304009135 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f912c064a80 con 0x7f912c107690 2024-04-26T18:25:40.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.545+0000 7f9113fff700 1 --2- 172.21.15.80:0/304009135 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f9114039560 0x7f911403ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:40.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.545+0000 7f9113fff700 1 -- 172.21.15.80:0/304009135 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f911c04db00 con 0x7f912c107690 2024-04-26T18:25:40.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.546+0000 7f912a7fc700 1 --2- 172.21.15.80:0/304009135 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f9114039560 0x7f911403ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:40.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.546+0000 7f912a7fc700 1 --2- 172.21.15.80:0/304009135 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f9114039560 0x7f911403ba20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9120006fd0 tx=0x7f9120006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:40.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.550+0000 7f9113fff700 1 -- 172.21.15.80:0/304009135 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f911c019c70 con 0x7f912c107690 2024-04-26T18:25:40.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.750+0000 7f913178c700 1 -- 172.21.15.80:0/304009135 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f912c0008d0 con 0x7f912c107690 2024-04-26T18:25:40.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.753+0000 7f9113fff700 1 -- 172.21.15.80:0/304009135 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7f911c02d910 con 0x7f912c107690 2024-04-26T18:25:40.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.755+0000 7f913178c700 1 -- 172.21.15.80:0/304009135 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f9114039560 msgr2=0x7f911403ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:40.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.755+0000 7f913178c700 1 --2- 172.21.15.80:0/304009135 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f9114039560 0x7f911403ba20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9120006fd0 tx=0x7f9120006e40 comp rx=0 tx=0).stop 2024-04-26T18:25:40.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.755+0000 7f913178c700 1 -- 172.21.15.80:0/304009135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912c107690 msgr2=0x7f912c19eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:40.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.755+0000 7f913178c700 1 --2- 172.21.15.80:0/304009135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912c107690 0x7f912c19eec0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f911c003f40 tx=0x7f911c011890 comp rx=0 tx=0).stop 2024-04-26T18:25:40.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.755+0000 7f913178c700 1 -- 172.21.15.80:0/304009135 shutdown_connections 2024-04-26T18:25:40.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.755+0000 7f913178c700 1 --2- 172.21.15.80:0/304009135 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f9114039560 0x7f911403ba20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:40.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.755+0000 7f913178c700 1 --2- 172.21.15.80:0/304009135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f912c107690 0x7f912c19eec0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:40.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.755+0000 7f913178c700 1 -- 172.21.15.80:0/304009135 >> 172.21.15.80:0/304009135 conn(0x7f912c103290 msgr2=0x7f912c195ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:40.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.755+0000 7f913178c700 1 -- 172.21.15.80:0/304009135 shutdown_connections 2024-04-26T18:25:40.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:39.755+0000 7f913178c700 1 -- 172.21.15.80:0/304009135 wait complete. 2024-04-26T18:25:40.967 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:40 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/304009135' entity='client.admin' 2024-04-26T18:25:40.968 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:40 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' 2024-04-26T18:25:40.968 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:40 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' 2024-04-26T18:25:42.080 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.071+0000 7f0201f00700 1 Processor -- start 2024-04-26T18:25:42.080 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.071+0000 7f0201f00700 1 -- start start 2024-04-26T18:25:42.080 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.071+0000 7f0201f00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01fc107cf0 0x7f01fc108110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:42.080 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.071+0000 7f0201f00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc1086e0 con 0x7f01fc107cf0 2024-04-26T18:25:42.080 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.071+0000 7f01fb7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01fc107cf0 0x7f01fc108110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:42.081 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.071+0000 7f01fb7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01fc107cf0 0x7f01fc108110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54696/0 (socket says 172.21.15.80:54696) 2024-04-26T18:25:42.081 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.071+0000 7f01fb7fe700 1 -- 172.21.15.80:0/1581308308 learned_addr learned my addr 172.21.15.80:0/1581308308 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:42.081 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.072+0000 7f01fb7fe700 1 -- 172.21.15.80:0/1581308308 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01fc108ef0 con 0x7f01fc107cf0 2024-04-26T18:25:42.081 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.072+0000 7f01fb7fe700 1 --2- 172.21.15.80:0/1581308308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01fc107cf0 0x7f01fc108110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00bb40 tx=0x7f01ec00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5583bc2ca16088ad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:42.081 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.072+0000 7f01fa7fc700 1 -- 172.21.15.80:0/1581308308 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01ec00dbe0 con 0x7f01fc107cf0 2024-04-26T18:25:42.081 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.072+0000 7f01fa7fc700 1 -- 172.21.15.80:0/1581308308 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01ec0044e0 con 0x7f01fc107cf0 2024-04-26T18:25:42.081 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.072+0000 7f01fa7fc700 1 -- 172.21.15.80:0/1581308308 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01ec010470 con 0x7f01fc107cf0 2024-04-26T18:25:42.081 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.073+0000 7f0201f00700 1 -- 172.21.15.80:0/1581308308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01fc107cf0 msgr2=0x7f01fc108110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:42.081 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.073+0000 7f0201f00700 1 --2- 172.21.15.80:0/1581308308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01fc107cf0 0x7f01fc108110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00bb40 tx=0x7f01ec00be50 comp rx=0 tx=0).stop 2024-04-26T18:25:42.081 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.073+0000 7f0201f00700 1 -- 172.21.15.80:0/1581308308 shutdown_connections 2024-04-26T18:25:42.081 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.073+0000 7f0201f00700 1 --2- 172.21.15.80:0/1581308308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01fc107cf0 0x7f01fc108110 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:42.081 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.073+0000 7f0201f00700 1 -- 172.21.15.80:0/1581308308 >> 172.21.15.80:0/1581308308 conn(0x7f01fc1032f0 msgr2=0x7f01fc105710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:42.081 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.073+0000 7f0201f00700 1 -- 172.21.15.80:0/1581308308 shutdown_connections 2024-04-26T18:25:42.081 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.073+0000 7f0201f00700 1 -- 172.21.15.80:0/1581308308 wait complete. 2024-04-26T18:25:42.081 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.074+0000 7f0201f00700 1 Processor -- start 2024-04-26T18:25:42.082 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.074+0000 7f0201f00700 1 -- start start 2024-04-26T18:25:42.082 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.074+0000 7f0201f00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01fc107cf0 0x7f01fc19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:42.082 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.074+0000 7f0201f00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc07c820 con 0x7f01fc107cf0 2024-04-26T18:25:42.082 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.074+0000 7f01fb7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01fc107cf0 0x7f01fc19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:42.082 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.074+0000 7f01fb7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01fc107cf0 0x7f01fc19aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54712/0 (socket says 172.21.15.80:54712) 2024-04-26T18:25:42.082 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.074+0000 7f01fb7fe700 1 -- 172.21.15.80:0/2191938603 learned_addr learned my addr 172.21.15.80:0/2191938603 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:42.082 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.074+0000 7f01fb7fe700 1 -- 172.21.15.80:0/2191938603 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01fc19afb0 con 0x7f01fc107cf0 2024-04-26T18:25:42.082 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.075+0000 7f01fb7fe700 1 --2- 172.21.15.80:0/2191938603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01fc107cf0 0x7f01fc19aa70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00d650 tx=0x7f01ec003ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:42.082 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.075+0000 7f01f8ff9700 1 -- 172.21.15.80:0/2191938603 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01ec027070 con 0x7f01fc107cf0 2024-04-26T18:25:42.082 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.075+0000 7f0201f00700 1 -- 172.21.15.80:0/2191938603 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01fc19b240 con 0x7f01fc107cf0 2024-04-26T18:25:42.082 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.075+0000 7f01f8ff9700 1 -- 172.21.15.80:0/2191938603 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01ec010c20 con 0x7f01fc107cf0 2024-04-26T18:25:42.082 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.075+0000 7f0201f00700 1 -- 172.21.15.80:0/2191938603 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01fc19df30 con 0x7f01fc107cf0 2024-04-26T18:25:42.082 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.075+0000 7f01f8ff9700 1 -- 172.21.15.80:0/2191938603 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01ec022b10 con 0x7f01fc107cf0 2024-04-26T18:25:42.082 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.076+0000 7f01f8ff9700 1 -- 172.21.15.80:0/2191938603 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f01ec02a070 con 0x7f01fc107cf0 2024-04-26T18:25:42.083 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.076+0000 7f01f8ff9700 1 --2- 172.21.15.80:0/2191938603 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f01e4039560 0x7f01e403ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:42.083 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.076+0000 7f01f8ff9700 1 -- 172.21.15.80:0/2191938603 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f01ec01f070 con 0x7f01fc107cf0 2024-04-26T18:25:42.083 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.076+0000 7f01faffd700 1 --2- 172.21.15.80:0/2191938603 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f01e4039560 0x7f01e403ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:42.083 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.077+0000 7f0201f00700 1 -- 172.21.15.80:0/2191938603 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01fc064a80 con 0x7f01fc107cf0 2024-04-26T18:25:42.083 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.077+0000 7f01faffd700 1 --2- 172.21.15.80:0/2191938603 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f01e4039560 0x7f01e403ba20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f01f0006fd0 tx=0x7f01f0006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:42.083 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.082+0000 7f01f8ff9700 1 -- 172.21.15.80:0/2191938603 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f01ec015070 con 0x7f01fc107cf0 2024-04-26T18:25:42.083 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.300+0000 7f0201f00700 1 -- 172.21.15.80:0/2191938603 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f01fc19e100 con 0x7f01fc107cf0 2024-04-26T18:25:42.083 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.303+0000 7f01f8ff9700 1 -- 172.21.15.80:0/2191938603 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f01ec017300 con 0x7f01fc107cf0 2024-04-26T18:25:42.083 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.305+0000 7f0201f00700 1 -- 172.21.15.80:0/2191938603 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f01e4039560 msgr2=0x7f01e403ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:42.083 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.305+0000 7f0201f00700 1 --2- 172.21.15.80:0/2191938603 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f01e4039560 0x7f01e403ba20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f01f0006fd0 tx=0x7f01f0006e40 comp rx=0 tx=0).stop 2024-04-26T18:25:42.083 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.305+0000 7f0201f00700 1 -- 172.21.15.80:0/2191938603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01fc107cf0 msgr2=0x7f01fc19aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:42.083 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.305+0000 7f0201f00700 1 --2- 172.21.15.80:0/2191938603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01fc107cf0 0x7f01fc19aa70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00d650 tx=0x7f01ec003ff0 comp rx=0 tx=0).stop 2024-04-26T18:25:42.083 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.305+0000 7f0201f00700 1 -- 172.21.15.80:0/2191938603 shutdown_connections 2024-04-26T18:25:42.083 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.305+0000 7f0201f00700 1 --2- 172.21.15.80:0/2191938603 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f01e4039560 0x7f01e403ba20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:42.084 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.305+0000 7f0201f00700 1 --2- 172.21.15.80:0/2191938603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01fc107cf0 0x7f01fc19aa70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:42.084 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.305+0000 7f0201f00700 1 -- 172.21.15.80:0/2191938603 >> 172.21.15.80:0/2191938603 conn(0x7f01fc1032f0 msgr2=0x7f01fc1910b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:42.084 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.305+0000 7f0201f00700 1 -- 172.21.15.80:0/2191938603 shutdown_connections 2024-04-26T18:25:42.084 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:41.305+0000 7f0201f00700 1 -- 172.21.15.80:0/2191938603 wait complete. 2024-04-26T18:25:42.084 INFO:teuthology.orchestra.run.smithi080.stdout:Enabling the dashboard module... 2024-04-26T18:25:42.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:42 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2191938603' entity='client.admin' 2024-04-26T18:25:43.794 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:43 smithi080 ceph-mon[29135]: from='mgr.14116 172.21.15.80:0/152895734' entity='mgr.x' 2024-04-26T18:25:43.794 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:43 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3857041322' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-26T18:25:43.795 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:43 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: ignoring --setuser ceph since I am not root 2024-04-26T18:25:43.795 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:43 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: ignoring --setgroup ceph since I am not root 2024-04-26T18:25:43.795 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:43 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:43.700+0000 7f6278ede200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T18:25:44.096 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:43 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:43.896+0000 7f6278ede200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T18:25:44.097 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:44 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:43.999+0000 7f6278ede200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T18:25:44.105 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.821+0000 7fef6bb15700 1 Processor -- start 2024-04-26T18:25:44.105 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.821+0000 7fef6bb15700 1 -- start start 2024-04-26T18:25:44.105 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.821+0000 7fef6bb15700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef64108e00 0x7fef64109220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:44.105 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.821+0000 7fef6bb15700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fef64109760 con 0x7fef64108e00 2024-04-26T18:25:44.105 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.821+0000 7fef698b1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef64108e00 0x7fef64109220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:44.105 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.821+0000 7fef698b1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef64108e00 0x7fef64109220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54724/0 (socket says 172.21.15.80:54724) 2024-04-26T18:25:44.105 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.821+0000 7fef698b1700 1 -- 172.21.15.80:0/3181358226 learned_addr learned my addr 172.21.15.80:0/3181358226 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:44.105 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.822+0000 7fef698b1700 1 -- 172.21.15.80:0/3181358226 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef64109f60 con 0x7fef64108e00 2024-04-26T18:25:44.105 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.822+0000 7fef698b1700 1 --2- 172.21.15.80:0/3181358226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef64108e00 0x7fef64109220 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef600098a0 tx=0x7fef60009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d62c2a9082a263d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:44.105 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.822+0000 7fef688af700 1 -- 172.21.15.80:0/3181358226 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef60004160 con 0x7fef64108e00 2024-04-26T18:25:44.105 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.822+0000 7fef688af700 1 -- 172.21.15.80:0/3181358226 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef60004300 con 0x7fef64108e00 2024-04-26T18:25:44.106 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.822+0000 7fef688af700 1 -- 172.21.15.80:0/3181358226 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef60011a20 con 0x7fef64108e00 2024-04-26T18:25:44.106 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.822+0000 7fef6bb15700 1 -- 172.21.15.80:0/3181358226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef64108e00 msgr2=0x7fef64109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:44.106 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.822+0000 7fef6bb15700 1 --2- 172.21.15.80:0/3181358226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef64108e00 0x7fef64109220 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef600098a0 tx=0x7fef60009bb0 comp rx=0 tx=0).stop 2024-04-26T18:25:44.106 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.823+0000 7fef6bb15700 1 -- 172.21.15.80:0/3181358226 shutdown_connections 2024-04-26T18:25:44.106 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.823+0000 7fef6bb15700 1 --2- 172.21.15.80:0/3181358226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef64108e00 0x7fef64109220 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:44.106 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.823+0000 7fef6bb15700 1 -- 172.21.15.80:0/3181358226 >> 172.21.15.80:0/3181358226 conn(0x7fef64104380 msgr2=0x7fef641067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:44.106 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.823+0000 7fef6bb15700 1 -- 172.21.15.80:0/3181358226 shutdown_connections 2024-04-26T18:25:44.106 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.823+0000 7fef6bb15700 1 -- 172.21.15.80:0/3181358226 wait complete. 2024-04-26T18:25:44.106 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.823+0000 7fef6bb15700 1 Processor -- start 2024-04-26T18:25:44.106 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.823+0000 7fef6bb15700 1 -- start start 2024-04-26T18:25:44.106 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.823+0000 7fef6bb15700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef64108e00 0x7fef6407f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:44.106 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.823+0000 7fef6bb15700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fef6410d3a0 con 0x7fef64108e00 2024-04-26T18:25:44.106 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.823+0000 7fef698b1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef64108e00 0x7fef6407f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:44.107 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.824+0000 7fef698b1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef64108e00 0x7fef6407f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54732/0 (socket says 172.21.15.80:54732) 2024-04-26T18:25:44.107 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.824+0000 7fef698b1700 1 -- 172.21.15.80:0/3857041322 learned_addr learned my addr 172.21.15.80:0/3857041322 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:44.107 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.824+0000 7fef698b1700 1 -- 172.21.15.80:0/3857041322 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef6407f900 con 0x7fef64108e00 2024-04-26T18:25:44.107 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.824+0000 7fef698b1700 1 --2- 172.21.15.80:0/3857041322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef64108e00 0x7fef6407f3c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fef60004660 tx=0x7fef60011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:44.107 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.824+0000 7fef5affd700 1 -- 172.21.15.80:0/3857041322 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef60003aa0 con 0x7fef64108e00 2024-04-26T18:25:44.107 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.824+0000 7fef5affd700 1 -- 172.21.15.80:0/3857041322 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef6001b8f0 con 0x7fef64108e00 2024-04-26T18:25:44.107 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.824+0000 7fef5affd700 1 -- 172.21.15.80:0/3857041322 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef60023900 con 0x7fef64108e00 2024-04-26T18:25:44.107 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.824+0000 7fef6bb15700 1 -- 172.21.15.80:0/3857041322 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef6407daf0 con 0x7fef64108e00 2024-04-26T18:25:44.107 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.824+0000 7fef6bb15700 1 -- 172.21.15.80:0/3857041322 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef6407e030 con 0x7fef64108e00 2024-04-26T18:25:44.107 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.825+0000 7fef6bb15700 1 -- 172.21.15.80:0/3857041322 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef64064a80 con 0x7fef64108e00 2024-04-26T18:25:44.107 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.825+0000 7fef5affd700 1 -- 172.21.15.80:0/3857041322 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fef60023bc0 con 0x7fef64108e00 2024-04-26T18:25:44.107 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.825+0000 7fef5affd700 1 --2- 172.21.15.80:0/3857041322 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7fef500395b0 0x7fef5003ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:44.107 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.826+0000 7fef5affd700 1 -- 172.21.15.80:0/3857041322 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fef6004def0 con 0x7fef64108e00 2024-04-26T18:25:44.107 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.826+0000 7fef690b0700 1 --2- 172.21.15.80:0/3857041322 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7fef500395b0 0x7fef5003ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:44.108 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.826+0000 7fef690b0700 1 --2- 172.21.15.80:0/3857041322 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7fef500395b0 0x7fef5003ba70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fef54006fd0 tx=0x7fef54006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:44.108 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:42.830+0000 7fef5affd700 1 -- 172.21.15.80:0/3857041322 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fef6001f030 con 0x7fef64108e00 2024-04-26T18:25:44.108 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:43.115+0000 7fef6bb15700 1 -- 172.21.15.80:0/3857041322 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fef641a2d20 con 0x7fef64108e00 2024-04-26T18:25:44.108 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:43.523+0000 7fef5affd700 1 -- 172.21.15.80:0/3857041322 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fef600292a0 con 0x7fef64108e00 2024-04-26T18:25:44.108 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:43.524+0000 7fef5affd700 1 -- 172.21.15.80:0/3857041322 <== mon.0 v2:172.21.15.80:3300/0 8 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7fef6002c3f0 con 0x7fef64108e00 2024-04-26T18:25:44.108 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:43.526+0000 7fef6bb15700 1 -- 172.21.15.80:0/3857041322 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7fef500395b0 msgr2=0x7fef5003ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:44.108 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:43.526+0000 7fef6bb15700 1 --2- 172.21.15.80:0/3857041322 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7fef500395b0 0x7fef5003ba70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fef54006fd0 tx=0x7fef54006e40 comp rx=0 tx=0).stop 2024-04-26T18:25:44.108 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:43.526+0000 7fef6bb15700 1 -- 172.21.15.80:0/3857041322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef64108e00 msgr2=0x7fef6407f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:44.108 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:43.526+0000 7fef6bb15700 1 --2- 172.21.15.80:0/3857041322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef64108e00 0x7fef6407f3c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fef60004660 tx=0x7fef60011aa0 comp rx=0 tx=0).stop 2024-04-26T18:25:44.108 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:43.526+0000 7fef6bb15700 1 -- 172.21.15.80:0/3857041322 shutdown_connections 2024-04-26T18:25:44.108 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:43.526+0000 7fef6bb15700 1 --2- 172.21.15.80:0/3857041322 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7fef500395b0 0x7fef5003ba70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:44.108 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:43.526+0000 7fef6bb15700 1 --2- 172.21.15.80:0/3857041322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef64108e00 0x7fef6407f3c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:44.108 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:43.526+0000 7fef6bb15700 1 -- 172.21.15.80:0/3857041322 >> 172.21.15.80:0/3857041322 conn(0x7fef64104380 msgr2=0x7fef64104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:44.108 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:43.526+0000 7fef6bb15700 1 -- 172.21.15.80:0/3857041322 shutdown_connections 2024-04-26T18:25:44.109 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:43.526+0000 7fef6bb15700 1 -- 172.21.15.80:0/3857041322 wait complete. 2024-04-26T18:25:44.347 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:44 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:44.312+0000 7f6278ede200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T18:25:44.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:44 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3857041322' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-26T18:25:44.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:44 smithi080 ceph-mon[29135]: mgrmap e9: x(active, since 19s) 2024-04-26T18:25:44.743 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:44 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:44.399+0000 7f6278ede200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T18:25:45.436 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout { 2024-04-26T18:25:45.436 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-26T18:25:45.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-26T18:25:45.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-26T18:25:45.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-26T18:25:45.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout } 2024-04-26T18:25:45.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.542+0000 7f7cc0d24700 1 Processor -- start 2024-04-26T18:25:45.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.542+0000 7f7cc0d24700 1 -- start start 2024-04-26T18:25:45.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.543+0000 7f7cc0d24700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cbc1098c0 0x7f7cbc10bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:45.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.543+0000 7f7cc0d24700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7cbc07ce50 con 0x7f7cbc1098c0 2024-04-26T18:25:45.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.543+0000 7f7cba59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cbc1098c0 0x7f7cbc10bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:45.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.543+0000 7f7cba59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cbc1098c0 0x7f7cbc10bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53546/0 (socket says 172.21.15.80:53546) 2024-04-26T18:25:45.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.543+0000 7f7cba59c700 1 -- 172.21.15.80:0/1491625811 learned_addr learned my addr 172.21.15.80:0/1491625811 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:45.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.543+0000 7f7cba59c700 1 -- 172.21.15.80:0/1491625811 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cbc10c1f0 con 0x7f7cbc1098c0 2024-04-26T18:25:45.437 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.543+0000 7f7cba59c700 1 --2- 172.21.15.80:0/1491625811 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cbc1098c0 0x7f7cbc10bcb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0098a0 tx=0x7f7cac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a0a388a020e466 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:45.438 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.543+0000 7f7cb959a700 1 -- 172.21.15.80:0/1491625811 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cac004160 con 0x7f7cbc1098c0 2024-04-26T18:25:45.438 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.544+0000 7f7cb959a700 1 -- 172.21.15.80:0/1491625811 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cac004300 con 0x7f7cbc1098c0 2024-04-26T18:25:45.438 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.544+0000 7f7cb959a700 1 -- 172.21.15.80:0/1491625811 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cac011a20 con 0x7f7cbc1098c0 2024-04-26T18:25:45.438 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.544+0000 7f7cc0d24700 1 -- 172.21.15.80:0/1491625811 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cbc1098c0 msgr2=0x7f7cbc10bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:45.438 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.544+0000 7f7cc0d24700 1 --2- 172.21.15.80:0/1491625811 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cbc1098c0 0x7f7cbc10bcb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0098a0 tx=0x7f7cac009bb0 comp rx=0 tx=0).stop 2024-04-26T18:25:45.438 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.544+0000 7f7cc0d24700 1 -- 172.21.15.80:0/1491625811 shutdown_connections 2024-04-26T18:25:45.438 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.544+0000 7f7cc0d24700 1 --2- 172.21.15.80:0/1491625811 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cbc1098c0 0x7f7cbc10bcb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:45.438 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.544+0000 7f7cc0d24700 1 -- 172.21.15.80:0/1491625811 >> 172.21.15.80:0/1491625811 conn(0x7f7cbc103290 msgr2=0x7f7cbc105710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:45.438 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.544+0000 7f7cc0d24700 1 -- 172.21.15.80:0/1491625811 shutdown_connections 2024-04-26T18:25:45.438 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.544+0000 7f7cc0d24700 1 -- 172.21.15.80:0/1491625811 wait complete. 2024-04-26T18:25:45.438 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.545+0000 7f7cc0d24700 1 Processor -- start 2024-04-26T18:25:45.438 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.545+0000 7f7cc0d24700 1 -- start start 2024-04-26T18:25:45.438 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.545+0000 7f7cc0d24700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cbc1098c0 0x7f7cbc19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:45.438 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.545+0000 7f7cc0d24700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7cbc10d190 con 0x7f7cbc1098c0 2024-04-26T18:25:45.439 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.545+0000 7f7cba59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cbc1098c0 0x7f7cbc19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:45.439 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.545+0000 7f7cba59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cbc1098c0 0x7f7cbc19cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53556/0 (socket says 172.21.15.80:53556) 2024-04-26T18:25:45.439 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.545+0000 7f7cba59c700 1 -- 172.21.15.80:0/2247103748 learned_addr learned my addr 172.21.15.80:0/2247103748 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:45.439 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.546+0000 7f7cba59c700 1 -- 172.21.15.80:0/2247103748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cbc19d240 con 0x7f7cbc1098c0 2024-04-26T18:25:45.439 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.546+0000 7f7cba59c700 1 --2- 172.21.15.80:0/2247103748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cbc1098c0 0x7f7cbc19cd00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0116e0 tx=0x7f7cac011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:45.439 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.546+0000 7f7cab7fe700 1 -- 172.21.15.80:0/2247103748 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cac003b20 con 0x7f7cbc1098c0 2024-04-26T18:25:45.439 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.546+0000 7f7cab7fe700 1 -- 172.21.15.80:0/2247103748 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cac01b8f0 con 0x7f7cbc1098c0 2024-04-26T18:25:45.439 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.546+0000 7f7cc0d24700 1 -- 172.21.15.80:0/2247103748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cbc19d530 con 0x7f7cbc1098c0 2024-04-26T18:25:45.439 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.546+0000 7f7cab7fe700 1 -- 172.21.15.80:0/2247103748 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cac0238c0 con 0x7f7cbc1098c0 2024-04-26T18:25:45.439 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.546+0000 7f7cc0d24700 1 -- 172.21.15.80:0/2247103748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cbc1a01b0 con 0x7f7cbc1098c0 2024-04-26T18:25:45.439 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.547+0000 7f7cab7fe700 1 -- 172.21.15.80:0/2247103748 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7f7cac023a60 con 0x7f7cbc1098c0 2024-04-26T18:25:45.439 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.547+0000 7f7cc0d24700 1 -- 172.21.15.80:0/2247103748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cbc064a80 con 0x7f7cbc1098c0 2024-04-26T18:25:45.439 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.547+0000 7f7cab7fe700 1 --2- 172.21.15.80:0/2247103748 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f7ca4039610 0x7f7ca403bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:45.439 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.547+0000 7f7cab7fe700 1 -- 172.21.15.80:0/2247103748 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7cac04e020 con 0x7f7cbc1098c0 2024-04-26T18:25:45.439 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.547+0000 7f7cb9d9b700 1 -- 172.21.15.80:0/2247103748 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f7ca4039610 msgr2=0x7f7ca403bad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/1997155783 2024-04-26T18:25:45.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.547+0000 7f7cb9d9b700 1 --2- 172.21.15.80:0/2247103748 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f7ca4039610 0x7f7ca403bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T18:25:45.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.552+0000 7f7cab7fe700 1 -- 172.21.15.80:0/2247103748 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7cac01f030 con 0x7f7cbc1098c0 2024-04-26T18:25:45.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.748+0000 7f7cb9d9b700 1 -- 172.21.15.80:0/2247103748 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f7ca4039610 msgr2=0x7f7ca403bad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/1997155783 2024-04-26T18:25:45.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.748+0000 7f7cb9d9b700 1 --2- 172.21.15.80:0/2247103748 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f7ca4039610 0x7f7ca403bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T18:25:45.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.855+0000 7f7cc0d24700 1 -- 172.21.15.80:0/2247103748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f7cbc1a08c0 con 0x7f7cbc1098c0 2024-04-26T18:25:45.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.855+0000 7f7cab7fe700 1 -- 172.21.15.80:0/2247103748 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f7cac020d70 con 0x7f7cbc1098c0 2024-04-26T18:25:45.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.857+0000 7f7cc0d24700 1 -- 172.21.15.80:0/2247103748 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f7ca4039610 msgr2=0x7f7ca403bad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T18:25:45.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.857+0000 7f7cc0d24700 1 --2- 172.21.15.80:0/2247103748 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f7ca4039610 0x7f7ca403bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:45.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.857+0000 7f7cc0d24700 1 -- 172.21.15.80:0/2247103748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cbc1098c0 msgr2=0x7f7cbc19cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:45.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.857+0000 7f7cc0d24700 1 --2- 172.21.15.80:0/2247103748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cbc1098c0 0x7f7cbc19cd00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0116e0 tx=0x7f7cac011aa0 comp rx=0 tx=0).stop 2024-04-26T18:25:45.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.857+0000 7f7cc0d24700 1 -- 172.21.15.80:0/2247103748 shutdown_connections 2024-04-26T18:25:45.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.857+0000 7f7cc0d24700 1 --2- 172.21.15.80:0/2247103748 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f7ca4039610 0x7f7ca403bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:45.440 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.857+0000 7f7cc0d24700 1 --2- 172.21.15.80:0/2247103748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7cbc1098c0 0x7f7cbc19cd00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:45.441 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.857+0000 7f7cc0d24700 1 -- 172.21.15.80:0/2247103748 >> 172.21.15.80:0/2247103748 conn(0x7f7cbc103290 msgr2=0x7f7cbc103de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:45.441 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.858+0000 7f7cc0d24700 1 -- 172.21.15.80:0/2247103748 shutdown_connections 2024-04-26T18:25:45.441 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:44.858+0000 7f7cc0d24700 1 -- 172.21.15.80:0/2247103748 wait complete. 2024-04-26T18:25:45.441 INFO:teuthology.orchestra.run.smithi080.stdout:Waiting for the mgr to restart... 2024-04-26T18:25:45.441 INFO:teuthology.orchestra.run.smithi080.stdout:Waiting for mgr epoch 9... 2024-04-26T18:25:45.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:45 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2247103748' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-26T18:25:45.747 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:45 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:45.620+0000 7f6278ede200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T18:25:46.055 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:45 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:45.798+0000 7f6278ede200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T18:25:46.055 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:45 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:45.971+0000 7f6278ede200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T18:25:46.350 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:46 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:46.258+0000 7f6278ede200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T18:25:46.351 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:46 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:46.350+0000 7f6278ede200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T18:25:46.743 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:46 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:46.552+0000 7f6278ede200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T18:25:47.243 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:46 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:46.744+0000 7f6278ede200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T18:25:47.743 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:47 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:47.337+0000 7f6278ede200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T18:25:48.051 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:47 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:47.755+0000 7f6278ede200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T18:25:48.051 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:47 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:47.851+0000 7f6278ede200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T18:25:48.051 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:48 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:48.051+0000 7f6278ede200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T18:25:48.858 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:48 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:48.595+0000 7f6278ede200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T18:25:48.859 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:48 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:48.691+0000 7f6278ede200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T18:25:49.177 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:48 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:48.942+0000 7f6278ede200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T18:25:49.178 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:49 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:49.079+0000 7f6278ede200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T18:25:49.178 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:49 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:49.177+0000 7f6278ede200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T18:25:49.493 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:49 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:49.297+0000 7f6278ede200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T18:25:49.993 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:49 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:49.596+0000 7f6278ede200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T18:25:50.464 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:50 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:50.193+0000 7f6278ede200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T18:25:50.464 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:25:50 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:25:50.410+0000 7f6278ede200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T18:25:50.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:50 smithi080 ceph-mon[29135]: Active manager daemon x restarted 2024-04-26T18:25:50.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:50 smithi080 ceph-mon[29135]: Activating manager daemon x 2024-04-26T18:25:50.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:50 smithi080 ceph-mon[29135]: osdmap e3: 0 total, 0 up, 0 in 2024-04-26T18:25:50.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:50 smithi080 ceph-mon[29135]: mgrmap e10: x(active, starting, since 0.00309086s) 2024-04-26T18:25:50.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:50 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T18:25:50.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:50 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T18:25:50.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:50 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T18:25:50.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:50 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T18:25:50.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:50 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T18:25:50.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:50 smithi080 ceph-mon[29135]: Manager daemon x is now available 2024-04-26T18:25:50.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:50 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:25:50.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:50 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T18:25:51.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T18:25:51.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:51 smithi080 ceph-mon[29135]: mgrmap e11: x(active, since 1.00583s) 2024-04-26T18:25:52.329 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout { 2024-04-26T18:25:52.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-26T18:25:52.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-26T18:25:52.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout } 2024-04-26T18:25:52.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.849+0000 7f0b57c20700 1 Processor -- start 2024-04-26T18:25:52.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.849+0000 7f0b57c20700 1 -- start start 2024-04-26T18:25:52.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.849+0000 7f0b57c20700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b50107110 0x7f0b50107530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:52.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.849+0000 7f0b57c20700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0b50107b00 con 0x7f0b50107110 2024-04-26T18:25:52.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.849+0000 7f0b559bc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b50107110 0x7f0b50107530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:52.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.849+0000 7f0b559bc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b50107110 0x7f0b50107530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53560/0 (socket says 172.21.15.80:53560) 2024-04-26T18:25:52.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.849+0000 7f0b559bc700 1 -- 172.21.15.80:0/639842951 learned_addr learned my addr 172.21.15.80:0/639842951 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:52.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.850+0000 7f0b559bc700 1 -- 172.21.15.80:0/639842951 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b50107c80 con 0x7f0b50107110 2024-04-26T18:25:52.330 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.850+0000 7f0b559bc700 1 --2- 172.21.15.80:0/639842951 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b50107110 0x7f0b50107530 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0098a0 tx=0x7f0b4c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70c07cf117cfe61 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:52.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.850+0000 7f0b549ba700 1 -- 172.21.15.80:0/639842951 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b4c004160 con 0x7f0b50107110 2024-04-26T18:25:52.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.850+0000 7f0b549ba700 1 -- 172.21.15.80:0/639842951 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b4c004300 con 0x7f0b50107110 2024-04-26T18:25:52.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.850+0000 7f0b549ba700 1 -- 172.21.15.80:0/639842951 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b4c011a20 con 0x7f0b50107110 2024-04-26T18:25:52.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.851+0000 7f0b57c20700 1 -- 172.21.15.80:0/639842951 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b50107110 msgr2=0x7f0b50107530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:52.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.851+0000 7f0b57c20700 1 --2- 172.21.15.80:0/639842951 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b50107110 0x7f0b50107530 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0098a0 tx=0x7f0b4c009bb0 comp rx=0 tx=0).stop 2024-04-26T18:25:52.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.851+0000 7f0b57c20700 1 -- 172.21.15.80:0/639842951 shutdown_connections 2024-04-26T18:25:52.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.851+0000 7f0b57c20700 1 --2- 172.21.15.80:0/639842951 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b50107110 0x7f0b50107530 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:52.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.851+0000 7f0b57c20700 1 -- 172.21.15.80:0/639842951 >> 172.21.15.80:0/639842951 conn(0x7f0b50102a10 msgr2=0x7f0b50104e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:52.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.851+0000 7f0b57c20700 1 -- 172.21.15.80:0/639842951 shutdown_connections 2024-04-26T18:25:52.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.851+0000 7f0b57c20700 1 -- 172.21.15.80:0/639842951 wait complete. 2024-04-26T18:25:52.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.851+0000 7f0b57c20700 1 Processor -- start 2024-04-26T18:25:52.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.852+0000 7f0b57c20700 1 -- start start 2024-04-26T18:25:52.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.852+0000 7f0b57c20700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b50107110 0x7f0b5019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:52.331 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.852+0000 7f0b57c20700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5010b020 con 0x7f0b50107110 2024-04-26T18:25:52.332 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.852+0000 7f0b559bc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b50107110 0x7f0b5019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:52.332 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.852+0000 7f0b559bc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b50107110 0x7f0b5019cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53572/0 (socket says 172.21.15.80:53572) 2024-04-26T18:25:52.332 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.852+0000 7f0b559bc700 1 -- 172.21.15.80:0/1263842745 learned_addr learned my addr 172.21.15.80:0/1263842745 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:52.332 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.852+0000 7f0b559bc700 1 -- 172.21.15.80:0/1263842745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5019d240 con 0x7f0b50107110 2024-04-26T18:25:52.332 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.852+0000 7f0b559bc700 1 --2- 172.21.15.80:0/1263842745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b50107110 0x7f0b5019cd00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0119f0 tx=0x7f0b4c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:52.332 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.852+0000 7f0b46ffd700 1 -- 172.21.15.80:0/1263842745 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b4c0039e0 con 0x7f0b50107110 2024-04-26T18:25:52.332 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.852+0000 7f0b57c20700 1 -- 172.21.15.80:0/1263842745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b5019d530 con 0x7f0b50107110 2024-04-26T18:25:52.332 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.852+0000 7f0b46ffd700 1 -- 172.21.15.80:0/1263842745 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b4c01b8f0 con 0x7f0b50107110 2024-04-26T18:25:52.332 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.853+0000 7f0b46ffd700 1 -- 172.21.15.80:0/1263842745 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b4c0237a0 con 0x7f0b50107110 2024-04-26T18:25:52.332 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.853+0000 7f0b57c20700 1 -- 172.21.15.80:0/1263842745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b501a01b0 con 0x7f0b50107110 2024-04-26T18:25:52.332 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.854+0000 7f0b46ffd700 1 -- 172.21.15.80:0/1263842745 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7f0b4c02c3f0 con 0x7f0b50107110 2024-04-26T18:25:52.332 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.854+0000 7f0b46ffd700 1 --2- 172.21.15.80:0/1263842745 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f0b3c0395b0 0x7f0b3c03ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:52.332 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.854+0000 7f0b46ffd700 1 -- 172.21.15.80:0/1263842745 --> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0b3c03c180 con 0x7f0b3c0395b0 2024-04-26T18:25:52.332 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.854+0000 7f0b46ffd700 1 -- 172.21.15.80:0/1263842745 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0b4c04df10 con 0x7f0b50107110 2024-04-26T18:25:52.333 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.854+0000 7f0b551bb700 1 -- 172.21.15.80:0/1263842745 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f0b3c0395b0 msgr2=0x7f0b3c03ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/1997155783 2024-04-26T18:25:52.333 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:45.854+0000 7f0b551bb700 1 --2- 172.21.15.80:0/1263842745 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f0b3c0395b0 0x7f0b3c03ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T18:25:52.333 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:46.055+0000 7f0b551bb700 1 -- 172.21.15.80:0/1263842745 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f0b3c0395b0 msgr2=0x7f0b3c03ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/1997155783 2024-04-26T18:25:52.333 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:46.055+0000 7f0b551bb700 1 --2- 172.21.15.80:0/1263842745 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f0b3c0395b0 0x7f0b3c03ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T18:25:52.333 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:46.456+0000 7f0b551bb700 1 -- 172.21.15.80:0/1263842745 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f0b3c0395b0 msgr2=0x7f0b3c03ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/1997155783 2024-04-26T18:25:52.333 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:46.456+0000 7f0b551bb700 1 --2- 172.21.15.80:0/1263842745 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f0b3c0395b0 0x7f0b3c03ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T18:25:52.333 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:47.257+0000 7f0b551bb700 1 -- 172.21.15.80:0/1263842745 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f0b3c0395b0 msgr2=0x7f0b3c03ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/1997155783 2024-04-26T18:25:52.333 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:47.257+0000 7f0b551bb700 1 --2- 172.21.15.80:0/1263842745 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f0b3c0395b0 0x7f0b3c03ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T18:25:52.333 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:48.858+0000 7f0b551bb700 1 -- 172.21.15.80:0/1263842745 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f0b3c0395b0 msgr2=0x7f0b3c03ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/1997155783 2024-04-26T18:25:52.333 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:48.858+0000 7f0b551bb700 1 --2- 172.21.15.80:0/1263842745 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f0b3c0395b0 0x7f0b3c03ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-26T18:25:52.333 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:50.414+0000 7f0b46ffd700 1 -- 172.21.15.80:0/1263842745 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mgrmap(e 10) ==== 46338+0+0 (secure 0 0 0) 0x7f0b4c0193d0 con 0x7f0b50107110 2024-04-26T18:25:52.333 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:50.414+0000 7f0b46ffd700 1 -- 172.21.15.80:0/1263842745 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f0b3c0395b0 msgr2=0x7f0b3c03ba70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T18:25:52.333 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:50.414+0000 7f0b46ffd700 1 --2- 172.21.15.80:0/1263842745 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f0b3c0395b0 0x7f0b3c03ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:52.333 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:51.415+0000 7f0b46ffd700 1 -- 172.21.15.80:0/1263842745 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mgrmap(e 11) ==== 46465+0+0 (secure 0 0 0) 0x7f0b4c021d20 con 0x7f0b50107110 2024-04-26T18:25:52.333 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:51.415+0000 7f0b46ffd700 1 --2- 172.21.15.80:0/1263842745 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f0b3c03cfe0 0x7f0b3c03f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:52.334 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:51.415+0000 7f0b46ffd700 1 -- 172.21.15.80:0/1263842745 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0b3c03c180 con 0x7f0b3c03cfe0 2024-04-26T18:25:52.334 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:51.416+0000 7f0b551bb700 1 --2- 172.21.15.80:0/1263842745 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f0b3c03cfe0 0x7f0b3c03f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:52.334 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:51.417+0000 7f0b551bb700 1 --2- 172.21.15.80:0/1263842745 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f0b3c03cfe0 0x7f0b3c03f3d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0b40003a10 tx=0x7f0b400092b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:52.334 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:51.417+0000 7f0b46ffd700 1 -- 172.21.15.80:0/1263842745 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f0b3c03c180 con 0x7f0b3c03cfe0 2024-04-26T18:25:52.334 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:51.426+0000 7f0b57c20700 1 -- 172.21.15.80:0/1263842745 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f0b50064a80 con 0x7f0b3c03cfe0 2024-04-26T18:25:52.334 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:51.426+0000 7f0b46ffd700 1 -- 172.21.15.80:0/1263842745 <== mgr.14148 v2:172.21.15.80:6800/179326828 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f0b50064a80 con 0x7f0b3c03cfe0 2024-04-26T18:25:52.334 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:51.426+0000 7f0b57c20700 1 -- 172.21.15.80:0/1263842745 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f0b3c03cfe0 msgr2=0x7f0b3c03f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:52.334 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:51.426+0000 7f0b57c20700 1 --2- 172.21.15.80:0/1263842745 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f0b3c03cfe0 0x7f0b3c03f3d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0b40003a10 tx=0x7f0b400092b0 comp rx=0 tx=0).stop 2024-04-26T18:25:52.334 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:51.426+0000 7f0b57c20700 1 -- 172.21.15.80:0/1263842745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b50107110 msgr2=0x7f0b5019cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:52.334 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:51.426+0000 7f0b57c20700 1 --2- 172.21.15.80:0/1263842745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b50107110 0x7f0b5019cd00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0119f0 tx=0x7f0b4c011ad0 comp rx=0 tx=0).stop 2024-04-26T18:25:52.334 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:51.426+0000 7f0b57c20700 1 -- 172.21.15.80:0/1263842745 shutdown_connections 2024-04-26T18:25:52.334 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:51.426+0000 7f0b57c20700 1 --2- 172.21.15.80:0/1263842745 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f0b3c03cfe0 0x7f0b3c03f3d0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:52.334 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:51.426+0000 7f0b57c20700 1 --2- 172.21.15.80:0/1263842745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b50107110 0x7f0b5019cd00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:52.334 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:51.427+0000 7f0b57c20700 1 --2- 172.21.15.80:0/1263842745 >> [v2:172.21.15.80:6800/1997155783,v1:172.21.15.80:6801/1997155783] conn(0x7f0b3c0395b0 0x7f0b3c03ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:52.334 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:51.427+0000 7f0b57c20700 1 -- 172.21.15.80:0/1263842745 >> 172.21.15.80:0/1263842745 conn(0x7f0b50102a10 msgr2=0x7f0b50103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:52.335 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:51.427+0000 7f0b57c20700 1 -- 172.21.15.80:0/1263842745 shutdown_connections 2024-04-26T18:25:52.335 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:51.427+0000 7f0b57c20700 1 -- 172.21.15.80:0/1263842745 wait complete. 2024-04-26T18:25:52.335 INFO:teuthology.orchestra.run.smithi080.stdout:mgr epoch 9 is available 2024-04-26T18:25:52.335 INFO:teuthology.orchestra.run.smithi080.stdout:Generating a dashboard self-signed certificate... 2024-04-26T18:25:52.570 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:52 smithi080 ceph-mon[29135]: [26/Apr/2024:18:25:51] ENGINE Bus STARTING 2024-04-26T18:25:52.570 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:52 smithi080 ceph-mon[29135]: [26/Apr/2024:18:25:51] ENGINE Serving on http://172.21.15.80:8765 2024-04-26T18:25:52.570 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:52 smithi080 ceph-mon[29135]: [26/Apr/2024:18:25:51] ENGINE Serving on https://172.21.15.80:7150 2024-04-26T18:25:52.570 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:52 smithi080 ceph-mon[29135]: [26/Apr/2024:18:25:51] ENGINE Bus STARTED 2024-04-26T18:25:52.571 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:52 smithi080 ceph-mon[29135]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-26T18:25:52.571 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:52 smithi080 ceph-mon[29135]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-26T18:25:52.571 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:52 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:25:53.586 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-26T18:25:53.587 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.782+0000 7f920cfc4700 1 Processor -- start 2024-04-26T18:25:53.587 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.783+0000 7f920cfc4700 1 -- start start 2024-04-26T18:25:53.587 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.783+0000 7f920cfc4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9208109940 0x7f920810bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:53.587 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.783+0000 7f920cfc4700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f920807cdd0 con 0x7f9208109940 2024-04-26T18:25:53.587 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.783+0000 7f920659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9208109940 0x7f920810bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:53.587 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.783+0000 7f920659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9208109940 0x7f920810bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53642/0 (socket says 172.21.15.80:53642) 2024-04-26T18:25:53.587 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.783+0000 7f920659c700 1 -- 172.21.15.80:0/1774974818 learned_addr learned my addr 172.21.15.80:0/1774974818 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:53.587 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.784+0000 7f920659c700 1 -- 172.21.15.80:0/1774974818 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920810c270 con 0x7f9208109940 2024-04-26T18:25:53.588 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.784+0000 7f920659c700 1 --2- 172.21.15.80:0/1774974818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9208109940 0x7f920810bd30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0098a0 tx=0x7f91fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1a0babf382cf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:53.588 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.784+0000 7f920559a700 1 -- 172.21.15.80:0/1774974818 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91fc004160 con 0x7f9208109940 2024-04-26T18:25:53.588 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.784+0000 7f920559a700 1 -- 172.21.15.80:0/1774974818 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91fc004300 con 0x7f9208109940 2024-04-26T18:25:53.588 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.784+0000 7f920559a700 1 -- 172.21.15.80:0/1774974818 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91fc011a20 con 0x7f9208109940 2024-04-26T18:25:53.588 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.785+0000 7f920cfc4700 1 -- 172.21.15.80:0/1774974818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9208109940 msgr2=0x7f920810bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:53.588 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.785+0000 7f920cfc4700 1 --2- 172.21.15.80:0/1774974818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9208109940 0x7f920810bd30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0098a0 tx=0x7f91fc009bb0 comp rx=0 tx=0).stop 2024-04-26T18:25:53.588 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.785+0000 7f920cfc4700 1 -- 172.21.15.80:0/1774974818 shutdown_connections 2024-04-26T18:25:53.588 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.785+0000 7f920cfc4700 1 --2- 172.21.15.80:0/1774974818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9208109940 0x7f920810bd30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:53.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.785+0000 7f920cfc4700 1 -- 172.21.15.80:0/1774974818 >> 172.21.15.80:0/1774974818 conn(0x7f9208103290 msgr2=0x7f9208105710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:53.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.785+0000 7f920cfc4700 1 -- 172.21.15.80:0/1774974818 shutdown_connections 2024-04-26T18:25:53.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.785+0000 7f920cfc4700 1 -- 172.21.15.80:0/1774974818 wait complete. 2024-04-26T18:25:53.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.786+0000 7f920cfc4700 1 Processor -- start 2024-04-26T18:25:53.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.786+0000 7f920cfc4700 1 -- start start 2024-04-26T18:25:53.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.786+0000 7f920cfc4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9208109940 0x7f920819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:53.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.786+0000 7f920cfc4700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f920810d210 con 0x7f9208109940 2024-04-26T18:25:53.589 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.786+0000 7f920659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9208109940 0x7f920819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:53.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.786+0000 7f920659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9208109940 0x7f920819ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53646/0 (socket says 172.21.15.80:53646) 2024-04-26T18:25:53.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.786+0000 7f920659c700 1 -- 172.21.15.80:0/1523271429 learned_addr learned my addr 172.21.15.80:0/1523271429 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:53.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.786+0000 7f920659c700 1 -- 172.21.15.80:0/1523271429 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920819f4b0 con 0x7f9208109940 2024-04-26T18:25:53.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.786+0000 7f920659c700 1 --2- 172.21.15.80:0/1523271429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9208109940 0x7f920819ef70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0116e0 tx=0x7f91fc011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:53.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.786+0000 7f91f77fe700 1 -- 172.21.15.80:0/1523271429 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91fc003b20 con 0x7f9208109940 2024-04-26T18:25:53.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.786+0000 7f91f77fe700 1 -- 172.21.15.80:0/1523271429 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91fc01b8f0 con 0x7f9208109940 2024-04-26T18:25:53.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.786+0000 7f920cfc4700 1 -- 172.21.15.80:0/1523271429 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f920819f740 con 0x7f9208109940 2024-04-26T18:25:53.590 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.787+0000 7f91f77fe700 1 -- 172.21.15.80:0/1523271429 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91fc0238c0 con 0x7f9208109940 2024-04-26T18:25:53.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.787+0000 7f920cfc4700 1 -- 172.21.15.80:0/1523271429 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92081a2430 con 0x7f9208109940 2024-04-26T18:25:53.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.787+0000 7f91f77fe700 1 -- 172.21.15.80:0/1523271429 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7f91fc023b90 con 0x7f9208109940 2024-04-26T18:25:53.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.787+0000 7f920cfc4700 1 -- 172.21.15.80:0/1523271429 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9208064a80 con 0x7f9208109940 2024-04-26T18:25:53.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.788+0000 7f91f77fe700 1 --2- 172.21.15.80:0/1523271429 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f91f00395b0 0x7f91f003ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:53.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.788+0000 7f91f77fe700 1 -- 172.21.15.80:0/1523271429 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f91fc04e2e0 con 0x7f9208109940 2024-04-26T18:25:53.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.788+0000 7f9205d9b700 1 --2- 172.21.15.80:0/1523271429 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f91f00395b0 0x7f91f003ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:53.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.788+0000 7f9205d9b700 1 --2- 172.21.15.80:0/1523271429 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f91f00395b0 0x7f91f003ba70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f91f8006fd0 tx=0x7f91f8006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:53.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:52.793+0000 7f91f77fe700 1 -- 172.21.15.80:0/1523271429 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f91fc01f030 con 0x7f9208109940 2024-04-26T18:25:53.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:53.012+0000 7f920cfc4700 1 -- 172.21.15.80:0/1523271429 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f9208104420 con 0x7f91f00395b0 2024-04-26T18:25:53.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:53.063+0000 7f91f77fe700 1 -- 172.21.15.80:0/1523271429 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f9208104420 con 0x7f91f00395b0 2024-04-26T18:25:53.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:53.065+0000 7f920cfc4700 1 -- 172.21.15.80:0/1523271429 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f91f00395b0 msgr2=0x7f91f003ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:53.591 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:53.065+0000 7f920cfc4700 1 --2- 172.21.15.80:0/1523271429 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f91f00395b0 0x7f91f003ba70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f91f8006fd0 tx=0x7f91f8006e40 comp rx=0 tx=0).stop 2024-04-26T18:25:53.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:53.065+0000 7f920cfc4700 1 -- 172.21.15.80:0/1523271429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9208109940 msgr2=0x7f920819ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:53.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:53.065+0000 7f920cfc4700 1 --2- 172.21.15.80:0/1523271429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9208109940 0x7f920819ef70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0116e0 tx=0x7f91fc011aa0 comp rx=0 tx=0).stop 2024-04-26T18:25:53.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:53.065+0000 7f920cfc4700 1 -- 172.21.15.80:0/1523271429 shutdown_connections 2024-04-26T18:25:53.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:53.065+0000 7f920cfc4700 1 --2- 172.21.15.80:0/1523271429 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f91f00395b0 0x7f91f003ba70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:53.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:53.065+0000 7f920cfc4700 1 --2- 172.21.15.80:0/1523271429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9208109940 0x7f920819ef70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:53.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:53.065+0000 7f920cfc4700 1 -- 172.21.15.80:0/1523271429 >> 172.21.15.80:0/1523271429 conn(0x7f9208103290 msgr2=0x7f9208103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:53.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:53.065+0000 7f920cfc4700 1 -- 172.21.15.80:0/1523271429 shutdown_connections 2024-04-26T18:25:53.592 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:53.065+0000 7f920cfc4700 1 -- 172.21.15.80:0/1523271429 wait complete. 2024-04-26T18:25:53.592 INFO:teuthology.orchestra.run.smithi080.stdout:Creating initial admin user... 2024-04-26T18:25:53.911 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:53 smithi080 ceph-mon[29135]: mgrmap e12: x(active, since 2s) 2024-04-26T18:25:53.912 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:53 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:25:53.912 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:53 smithi080 ceph-mon[29135]: from='client.14160 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:25:53.912 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:53 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:25:53.912 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:53 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:25:55.712 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:55 smithi080 ceph-mon[29135]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:25:55.713 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:55 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:25:55.820 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$j5mHqSsF3FaozQK9eYk9YeU47GRCflzK6zSmGMaFpY1Ao8SqF0eRG", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1714155954, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-26T18:25:55.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.013+0000 7f58c7f76700 1 Processor -- start 2024-04-26T18:25:55.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.014+0000 7f58c7f76700 1 -- start start 2024-04-26T18:25:55.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.014+0000 7f58c7f76700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c0108e20 0x7f58c0109240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:55.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.014+0000 7f58c7f76700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f58c0109780 con 0x7f58c0108e20 2024-04-26T18:25:55.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.014+0000 7f58c5d12700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c0108e20 0x7f58c0109240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:55.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.014+0000 7f58c5d12700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c0108e20 0x7f58c0109240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55650/0 (socket says 172.21.15.80:55650) 2024-04-26T18:25:55.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.014+0000 7f58c5d12700 1 -- 172.21.15.80:0/2474482356 learned_addr learned my addr 172.21.15.80:0/2474482356 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:55.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.014+0000 7f58c5d12700 1 -- 172.21.15.80:0/2474482356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c0109f80 con 0x7f58c0108e20 2024-04-26T18:25:55.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.014+0000 7f58c5d12700 1 --2- 172.21.15.80:0/2474482356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c0108e20 0x7f58c0109240 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0098a0 tx=0x7f58bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb5a59e3e437480 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:55.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.014+0000 7f58c4d10700 1 -- 172.21.15.80:0/2474482356 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58bc004160 con 0x7f58c0108e20 2024-04-26T18:25:55.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.015+0000 7f58c4d10700 1 -- 172.21.15.80:0/2474482356 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58bc004300 con 0x7f58c0108e20 2024-04-26T18:25:55.821 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.015+0000 7f58c4d10700 1 -- 172.21.15.80:0/2474482356 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58bc011a20 con 0x7f58c0108e20 2024-04-26T18:25:55.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.015+0000 7f58c7f76700 1 -- 172.21.15.80:0/2474482356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c0108e20 msgr2=0x7f58c0109240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:55.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.015+0000 7f58c7f76700 1 --2- 172.21.15.80:0/2474482356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c0108e20 0x7f58c0109240 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0098a0 tx=0x7f58bc009bb0 comp rx=0 tx=0).stop 2024-04-26T18:25:55.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.015+0000 7f58c7f76700 1 -- 172.21.15.80:0/2474482356 shutdown_connections 2024-04-26T18:25:55.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.015+0000 7f58c7f76700 1 --2- 172.21.15.80:0/2474482356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c0108e20 0x7f58c0109240 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:55.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.015+0000 7f58c7f76700 1 -- 172.21.15.80:0/2474482356 >> 172.21.15.80:0/2474482356 conn(0x7f58c01043c0 msgr2=0x7f58c0106800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:55.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.015+0000 7f58c7f76700 1 -- 172.21.15.80:0/2474482356 shutdown_connections 2024-04-26T18:25:55.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.015+0000 7f58c7f76700 1 -- 172.21.15.80:0/2474482356 wait complete. 2024-04-26T18:25:55.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.016+0000 7f58c7f76700 1 Processor -- start 2024-04-26T18:25:55.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.016+0000 7f58c7f76700 1 -- start start 2024-04-26T18:25:55.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.016+0000 7f58c7f76700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c0108e20 0x7f58c007f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:55.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.016+0000 7f58c7f76700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f58c010d3c0 con 0x7f58c0108e20 2024-04-26T18:25:55.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.016+0000 7f58c5d12700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c0108e20 0x7f58c007f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:55.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.016+0000 7f58c5d12700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c0108e20 0x7f58c007f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55652/0 (socket says 172.21.15.80:55652) 2024-04-26T18:25:55.822 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.016+0000 7f58c5d12700 1 -- 172.21.15.80:0/2920780213 learned_addr learned my addr 172.21.15.80:0/2920780213 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:55.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.016+0000 7f58c5d12700 1 -- 172.21.15.80:0/2920780213 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c007f900 con 0x7f58c0108e20 2024-04-26T18:25:55.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.016+0000 7f58c5d12700 1 --2- 172.21.15.80:0/2920780213 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c0108e20 0x7f58c007f3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f58bc004660 tx=0x7f58bc011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:55.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.016+0000 7f58b6ffd700 1 -- 172.21.15.80:0/2920780213 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58bc003aa0 con 0x7f58c0108e20 2024-04-26T18:25:55.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.017+0000 7f58c7f76700 1 -- 172.21.15.80:0/2920780213 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c007daf0 con 0x7f58c0108e20 2024-04-26T18:25:55.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.017+0000 7f58b6ffd700 1 -- 172.21.15.80:0/2920780213 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58bc01b8f0 con 0x7f58c0108e20 2024-04-26T18:25:55.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.017+0000 7f58b6ffd700 1 -- 172.21.15.80:0/2920780213 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58bc023900 con 0x7f58c0108e20 2024-04-26T18:25:55.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.017+0000 7f58c7f76700 1 -- 172.21.15.80:0/2920780213 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c007e030 con 0x7f58c0108e20 2024-04-26T18:25:55.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.017+0000 7f58b6ffd700 1 -- 172.21.15.80:0/2920780213 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7f58bc023bc0 con 0x7f58c0108e20 2024-04-26T18:25:55.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.018+0000 7f58c7f76700 1 -- 172.21.15.80:0/2920780213 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c010d540 con 0x7f58c0108e20 2024-04-26T18:25:55.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.018+0000 7f58b6ffd700 1 --2- 172.21.15.80:0/2920780213 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f58ac039600 0x7f58ac03bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:55.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.018+0000 7f58b6ffd700 1 -- 172.21.15.80:0/2920780213 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f58bc04e1b0 con 0x7f58c0108e20 2024-04-26T18:25:55.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.018+0000 7f58c5511700 1 --2- 172.21.15.80:0/2920780213 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f58ac039600 0x7f58ac03bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:55.823 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.018+0000 7f58c5511700 1 --2- 172.21.15.80:0/2920780213 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f58ac039600 0x7f58ac03bac0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f58b0006fd0 tx=0x7f58b0006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:55.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.023+0000 7f58b6ffd700 1 -- 172.21.15.80:0/2920780213 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f58bc01f030 con 0x7f58c0108e20 2024-04-26T18:25:55.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.249+0000 7f58c7f76700 1 -- 172.21.15.80:0/2920780213 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f58c0064a80 con 0x7f58ac039600 2024-04-26T18:25:55.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.473+0000 7f58b6ffd700 1 -- 172.21.15.80:0/2920780213 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f58c0064a80 con 0x7f58ac039600 2024-04-26T18:25:55.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.475+0000 7f58c7f76700 1 -- 172.21.15.80:0/2920780213 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f58ac039600 msgr2=0x7f58ac03bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:55.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.475+0000 7f58c7f76700 1 --2- 172.21.15.80:0/2920780213 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f58ac039600 0x7f58ac03bac0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f58b0006fd0 tx=0x7f58b0006e40 comp rx=0 tx=0).stop 2024-04-26T18:25:55.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.475+0000 7f58c7f76700 1 -- 172.21.15.80:0/2920780213 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c0108e20 msgr2=0x7f58c007f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:55.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.475+0000 7f58c7f76700 1 --2- 172.21.15.80:0/2920780213 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c0108e20 0x7f58c007f3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f58bc004660 tx=0x7f58bc011aa0 comp rx=0 tx=0).stop 2024-04-26T18:25:55.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.475+0000 7f58c7f76700 1 -- 172.21.15.80:0/2920780213 shutdown_connections 2024-04-26T18:25:55.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.475+0000 7f58c7f76700 1 --2- 172.21.15.80:0/2920780213 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f58ac039600 0x7f58ac03bac0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:55.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.475+0000 7f58c7f76700 1 --2- 172.21.15.80:0/2920780213 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c0108e20 0x7f58c007f3c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:55.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.475+0000 7f58c7f76700 1 -- 172.21.15.80:0/2920780213 >> 172.21.15.80:0/2920780213 conn(0x7f58c01043c0 msgr2=0x7f58c0104e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:55.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.475+0000 7f58c7f76700 1 -- 172.21.15.80:0/2920780213 shutdown_connections 2024-04-26T18:25:55.824 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:54.475+0000 7f58c7f76700 1 -- 172.21.15.80:0/2920780213 wait complete. 2024-04-26T18:25:55.824 INFO:teuthology.orchestra.run.smithi080.stdout:Fetching dashboard port number... 2024-04-26T18:25:56.719 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:56 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1274982379' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-26T18:25:56.976 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stdout 8443 2024-04-26T18:25:56.976 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.206+0000 7f42f4508700 1 Processor -- start 2024-04-26T18:25:56.976 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.206+0000 7f42f4508700 1 -- start start 2024-04-26T18:25:56.976 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.207+0000 7f42f4508700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42ec07f710 0x7f42ec07db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:56.976 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.207+0000 7f42f4508700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f42ec07e140 con 0x7f42ec07f710 2024-04-26T18:25:56.977 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.207+0000 7f42f22a4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42ec07f710 0x7f42ec07db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:56.977 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.207+0000 7f42f22a4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42ec07f710 0x7f42ec07db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55654/0 (socket says 172.21.15.80:55654) 2024-04-26T18:25:56.977 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.207+0000 7f42f22a4700 1 -- 172.21.15.80:0/2974645843 learned_addr learned my addr 172.21.15.80:0/2974645843 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:56.977 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.207+0000 7f42f22a4700 1 -- 172.21.15.80:0/2974645843 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ec07e2c0 con 0x7f42ec07f710 2024-04-26T18:25:56.977 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.207+0000 7f42f22a4700 1 --2- 172.21.15.80:0/2974645843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42ec07f710 0x7f42ec07db70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f42dc0098a0 tx=0x7f42dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f54e4c37f9b9365 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:56.977 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.207+0000 7f42f12a2700 1 -- 172.21.15.80:0/2974645843 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42dc004160 con 0x7f42ec07f710 2024-04-26T18:25:56.977 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.207+0000 7f42f12a2700 1 -- 172.21.15.80:0/2974645843 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42dc004300 con 0x7f42ec07f710 2024-04-26T18:25:56.977 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.207+0000 7f42f12a2700 1 -- 172.21.15.80:0/2974645843 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42dc011a20 con 0x7f42ec07f710 2024-04-26T18:25:56.977 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.208+0000 7f42f4508700 1 -- 172.21.15.80:0/2974645843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42ec07f710 msgr2=0x7f42ec07db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:56.977 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.208+0000 7f42f4508700 1 --2- 172.21.15.80:0/2974645843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42ec07f710 0x7f42ec07db70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f42dc0098a0 tx=0x7f42dc009bb0 comp rx=0 tx=0).stop 2024-04-26T18:25:56.977 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.208+0000 7f42f4508700 1 -- 172.21.15.80:0/2974645843 shutdown_connections 2024-04-26T18:25:56.977 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.208+0000 7f42f4508700 1 --2- 172.21.15.80:0/2974645843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42ec07f710 0x7f42ec07db70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:56.977 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.208+0000 7f42f4508700 1 -- 172.21.15.80:0/2974645843 >> 172.21.15.80:0/2974645843 conn(0x7f42ec104380 msgr2=0x7f42ec1067a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:56.977 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.208+0000 7f42f4508700 1 -- 172.21.15.80:0/2974645843 shutdown_connections 2024-04-26T18:25:56.977 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.208+0000 7f42f4508700 1 -- 172.21.15.80:0/2974645843 wait complete. 2024-04-26T18:25:56.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.209+0000 7f42f4508700 1 Processor -- start 2024-04-26T18:25:56.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.209+0000 7f42f4508700 1 -- start start 2024-04-26T18:25:56.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.209+0000 7f42f4508700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42ec07f710 0x7f42ec19ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:56.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.209+0000 7f42f4508700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f42ec10f3a0 con 0x7f42ec07f710 2024-04-26T18:25:56.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.209+0000 7f42f22a4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42ec07f710 0x7f42ec19ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:56.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.209+0000 7f42f22a4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42ec07f710 0x7f42ec19ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55670/0 (socket says 172.21.15.80:55670) 2024-04-26T18:25:56.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.209+0000 7f42f22a4700 1 -- 172.21.15.80:0/1274982379 learned_addr learned my addr 172.21.15.80:0/1274982379 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:56.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.209+0000 7f42f22a4700 1 -- 172.21.15.80:0/1274982379 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ec19f3b0 con 0x7f42ec07f710 2024-04-26T18:25:56.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.209+0000 7f42f22a4700 1 --2- 172.21.15.80:0/1274982379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42ec07f710 0x7f42ec19ee70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f42dc0116e0 tx=0x7f42dc011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:56.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.210+0000 7f42e37fe700 1 -- 172.21.15.80:0/1274982379 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42dc0039e0 con 0x7f42ec07f710 2024-04-26T18:25:56.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.210+0000 7f42e37fe700 1 -- 172.21.15.80:0/1274982379 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42dc01b8f0 con 0x7f42ec07f710 2024-04-26T18:25:56.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.210+0000 7f42f4508700 1 -- 172.21.15.80:0/1274982379 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42ec19f640 con 0x7f42ec07f710 2024-04-26T18:25:56.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.210+0000 7f42e37fe700 1 -- 172.21.15.80:0/1274982379 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42dc023760 con 0x7f42ec07f710 2024-04-26T18:25:56.978 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.210+0000 7f42f4508700 1 -- 172.21.15.80:0/1274982379 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42ec1a2330 con 0x7f42ec07f710 2024-04-26T18:25:56.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.210+0000 7f42e37fe700 1 -- 172.21.15.80:0/1274982379 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7f42dc0239d0 con 0x7f42ec07f710 2024-04-26T18:25:56.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.210+0000 7f42f4508700 1 -- 172.21.15.80:0/1274982379 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42ec064a80 con 0x7f42ec07f710 2024-04-26T18:25:56.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.211+0000 7f42e37fe700 1 --2- 172.21.15.80:0/1274982379 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f42d80395b0 0x7f42d803ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:56.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.211+0000 7f42e37fe700 1 -- 172.21.15.80:0/1274982379 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f42dc04e080 con 0x7f42ec07f710 2024-04-26T18:25:56.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.211+0000 7f42f1aa3700 1 --2- 172.21.15.80:0/1274982379 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f42d80395b0 0x7f42d803ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:56.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.211+0000 7f42f1aa3700 1 --2- 172.21.15.80:0/1274982379 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f42d80395b0 0x7f42d803ba70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f42e8006fd0 tx=0x7f42e8006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:56.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.216+0000 7f42e37fe700 1 -- 172.21.15.80:0/1274982379 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f42dc01f030 con 0x7f42ec07f710 2024-04-26T18:25:56.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.411+0000 7f42f4508700 1 -- 172.21.15.80:0/1274982379 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f42ec1a28e0 con 0x7f42ec07f710 2024-04-26T18:25:56.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.412+0000 7f42e37fe700 1 -- 172.21.15.80:0/1274982379 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f42dc01a3d0 con 0x7f42ec07f710 2024-04-26T18:25:56.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.415+0000 7f42f4508700 1 -- 172.21.15.80:0/1274982379 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f42d80395b0 msgr2=0x7f42d803ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:56.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.415+0000 7f42f4508700 1 --2- 172.21.15.80:0/1274982379 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f42d80395b0 0x7f42d803ba70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f42e8006fd0 tx=0x7f42e8006e40 comp rx=0 tx=0).stop 2024-04-26T18:25:56.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.415+0000 7f42f4508700 1 -- 172.21.15.80:0/1274982379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42ec07f710 msgr2=0x7f42ec19ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:56.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.415+0000 7f42f4508700 1 --2- 172.21.15.80:0/1274982379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42ec07f710 0x7f42ec19ee70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f42dc0116e0 tx=0x7f42dc011aa0 comp rx=0 tx=0).stop 2024-04-26T18:25:56.979 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.415+0000 7f42f4508700 1 -- 172.21.15.80:0/1274982379 shutdown_connections 2024-04-26T18:25:56.980 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.415+0000 7f42f4508700 1 --2- 172.21.15.80:0/1274982379 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f42d80395b0 0x7f42d803ba70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:56.980 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.415+0000 7f42f4508700 1 --2- 172.21.15.80:0/1274982379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42ec07f710 0x7f42ec19ee70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:56.980 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.415+0000 7f42f4508700 1 -- 172.21.15.80:0/1274982379 >> 172.21.15.80:0/1274982379 conn(0x7f42ec104380 msgr2=0x7f42ec104da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:56.980 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.415+0000 7f42f4508700 1 -- 172.21.15.80:0/1274982379 shutdown_connections 2024-04-26T18:25:56.980 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:56.415+0000 7f42f4508700 1 -- 172.21.15.80:0/1274982379 wait complete. 2024-04-26T18:25:56.983 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T18:25:56.983 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout disabled 2024-04-26T18:25:56.990 INFO:teuthology.orchestra.run.smithi080.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T18:25:56.990 INFO:teuthology.orchestra.run.smithi080.stdout:systemctl: stdout inactive 2024-04-26T18:25:56.990 INFO:teuthology.orchestra.run.smithi080.stdout:firewalld.service is not enabled 2024-04-26T18:25:56.990 INFO:teuthology.orchestra.run.smithi080.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-26T18:25:56.992 INFO:teuthology.orchestra.run.smithi080.stdout:Ceph Dashboard is now available at: 2024-04-26T18:25:56.992 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:25:56.992 INFO:teuthology.orchestra.run.smithi080.stdout: URL: https://smithi080:8443/ 2024-04-26T18:25:56.992 INFO:teuthology.orchestra.run.smithi080.stdout: User: admin 2024-04-26T18:25:56.992 INFO:teuthology.orchestra.run.smithi080.stdout: Password: 2whcpab6ji 2024-04-26T18:25:56.992 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:25:56.992 INFO:teuthology.orchestra.run.smithi080.stdout:Saving cluster configuration to /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config directory 2024-04-26T18:25:56.993 INFO:teuthology.orchestra.run.smithi080.stdout:Enabling autotune for osd_memory_target 2024-04-26T18:25:57.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:57 smithi080 ceph-mon[29135]: mgrmap e13: x(active, since 6s) 2024-04-26T18:25:58.226 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.439+0000 7fa5aa6ce700 1 Processor -- start 2024-04-26T18:25:58.226 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.439+0000 7fa5aa6ce700 1 -- start start 2024-04-26T18:25:58.226 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.439+0000 7fa5aa6ce700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a4108e20 0x7fa5a4109240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:58.226 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.439+0000 7fa5aa6ce700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a4109780 con 0x7fa5a4108e20 2024-04-26T18:25:58.226 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.439+0000 7fa5a3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a4108e20 0x7fa5a4109240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:58.226 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.440+0000 7fa5a3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a4108e20 0x7fa5a4109240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55676/0 (socket says 172.21.15.80:55676) 2024-04-26T18:25:58.226 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.440+0000 7fa5a3fff700 1 -- 172.21.15.80:0/1576302461 learned_addr learned my addr 172.21.15.80:0/1576302461 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:58.226 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.440+0000 7fa5a3fff700 1 -- 172.21.15.80:0/1576302461 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a4109f80 con 0x7fa5a4108e20 2024-04-26T18:25:58.226 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.440+0000 7fa5a3fff700 1 --2- 172.21.15.80:0/1576302461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a4108e20 0x7fa5a4109240 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa5940098a0 tx=0x7fa594009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826fbebfe2eb7331 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:58.226 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.440+0000 7fa5a2ffd700 1 -- 172.21.15.80:0/1576302461 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa594004160 con 0x7fa5a4108e20 2024-04-26T18:25:58.226 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.440+0000 7fa5a2ffd700 1 -- 172.21.15.80:0/1576302461 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa594004300 con 0x7fa5a4108e20 2024-04-26T18:25:58.226 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.440+0000 7fa5a2ffd700 1 -- 172.21.15.80:0/1576302461 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa594011a20 con 0x7fa5a4108e20 2024-04-26T18:25:58.227 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.441+0000 7fa5aa6ce700 1 -- 172.21.15.80:0/1576302461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a4108e20 msgr2=0x7fa5a4109240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:58.227 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.441+0000 7fa5aa6ce700 1 --2- 172.21.15.80:0/1576302461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a4108e20 0x7fa5a4109240 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa5940098a0 tx=0x7fa594009bb0 comp rx=0 tx=0).stop 2024-04-26T18:25:58.227 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.441+0000 7fa5aa6ce700 1 -- 172.21.15.80:0/1576302461 shutdown_connections 2024-04-26T18:25:58.227 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.441+0000 7fa5aa6ce700 1 --2- 172.21.15.80:0/1576302461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a4108e20 0x7fa5a4109240 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:58.227 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.441+0000 7fa5aa6ce700 1 -- 172.21.15.80:0/1576302461 >> 172.21.15.80:0/1576302461 conn(0x7fa5a41043c0 msgr2=0x7fa5a4106800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:58.227 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.441+0000 7fa5aa6ce700 1 -- 172.21.15.80:0/1576302461 shutdown_connections 2024-04-26T18:25:58.227 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.441+0000 7fa5aa6ce700 1 -- 172.21.15.80:0/1576302461 wait complete. 2024-04-26T18:25:58.227 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.441+0000 7fa5aa6ce700 1 Processor -- start 2024-04-26T18:25:58.227 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.441+0000 7fa5aa6ce700 1 -- start start 2024-04-26T18:25:58.227 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.442+0000 7fa5aa6ce700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a4108e20 0x7fa5a419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:58.227 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.442+0000 7fa5aa6ce700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a410d3c0 con 0x7fa5a4108e20 2024-04-26T18:25:58.227 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.442+0000 7fa5a3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a4108e20 0x7fa5a419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:58.227 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.442+0000 7fa5a3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a4108e20 0x7fa5a419ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55692/0 (socket says 172.21.15.80:55692) 2024-04-26T18:25:58.227 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.442+0000 7fa5a3fff700 1 -- 172.21.15.80:0/306450618 learned_addr learned my addr 172.21.15.80:0/306450618 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:58.227 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.442+0000 7fa5a3fff700 1 -- 172.21.15.80:0/306450618 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a419d210 con 0x7fa5a4108e20 2024-04-26T18:25:58.228 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.442+0000 7fa5a3fff700 1 --2- 172.21.15.80:0/306450618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a4108e20 0x7fa5a419ccd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa5940116e0 tx=0x7fa594011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:58.228 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.442+0000 7fa5a17fa700 1 -- 172.21.15.80:0/306450618 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa594003b20 con 0x7fa5a4108e20 2024-04-26T18:25:58.228 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.442+0000 7fa5aa6ce700 1 -- 172.21.15.80:0/306450618 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5a419d4a0 con 0x7fa5a4108e20 2024-04-26T18:25:58.228 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.442+0000 7fa5a17fa700 1 -- 172.21.15.80:0/306450618 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa59401b8f0 con 0x7fa5a4108e20 2024-04-26T18:25:58.228 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.442+0000 7fa5a17fa700 1 -- 172.21.15.80:0/306450618 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5940238c0 con 0x7fa5a4108e20 2024-04-26T18:25:58.228 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.442+0000 7fa5aa6ce700 1 -- 172.21.15.80:0/306450618 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5a41a0180 con 0x7fa5a4108e20 2024-04-26T18:25:58.228 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.443+0000 7fa5a17fa700 1 -- 172.21.15.80:0/306450618 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fa594023b70 con 0x7fa5a4108e20 2024-04-26T18:25:58.228 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.443+0000 7fa5a17fa700 1 --2- 172.21.15.80:0/306450618 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fa58c039650 0x7fa58c03bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:58.228 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.443+0000 7fa5a17fa700 1 -- 172.21.15.80:0/306450618 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa59401baa0 con 0x7fa5a4108e20 2024-04-26T18:25:58.228 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.443+0000 7fa5aa6ce700 1 -- 172.21.15.80:0/306450618 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5a410d540 con 0x7fa5a4108e20 2024-04-26T18:25:58.228 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.443+0000 7fa5a37fe700 1 --2- 172.21.15.80:0/306450618 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fa58c039650 0x7fa58c03bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:58.228 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.444+0000 7fa5a37fe700 1 --2- 172.21.15.80:0/306450618 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fa58c039650 0x7fa58c03bb10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa598006fd0 tx=0x7fa598006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:58.228 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.448+0000 7fa5a17fa700 1 -- 172.21.15.80:0/306450618 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa59401f030 con 0x7fa5a4108e20 2024-04-26T18:25:58.228 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.645+0000 7fa5aa6ce700 1 -- 172.21.15.80:0/306450618 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7fa5a41a0350 con 0x7fa5a4108e20 2024-04-26T18:25:58.228 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.646+0000 7fa5a17fa700 1 -- 172.21.15.80:0/306450618 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7fa594018c10 con 0x7fa5a4108e20 2024-04-26T18:25:58.229 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.648+0000 7fa5aa6ce700 1 -- 172.21.15.80:0/306450618 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fa58c039650 msgr2=0x7fa58c03bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:58.229 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.648+0000 7fa5aa6ce700 1 --2- 172.21.15.80:0/306450618 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fa58c039650 0x7fa58c03bb10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa598006fd0 tx=0x7fa598006e40 comp rx=0 tx=0).stop 2024-04-26T18:25:58.229 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.648+0000 7fa5aa6ce700 1 -- 172.21.15.80:0/306450618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a4108e20 msgr2=0x7fa5a419ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:58.229 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.648+0000 7fa5aa6ce700 1 --2- 172.21.15.80:0/306450618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a4108e20 0x7fa5a419ccd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa5940116e0 tx=0x7fa594011aa0 comp rx=0 tx=0).stop 2024-04-26T18:25:58.229 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.648+0000 7fa5aa6ce700 1 -- 172.21.15.80:0/306450618 shutdown_connections 2024-04-26T18:25:58.229 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.648+0000 7fa5aa6ce700 1 --2- 172.21.15.80:0/306450618 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fa58c039650 0x7fa58c03bb10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:58.229 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.648+0000 7fa5aa6ce700 1 --2- 172.21.15.80:0/306450618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5a4108e20 0x7fa5a419ccd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:58.229 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.648+0000 7fa5aa6ce700 1 -- 172.21.15.80:0/306450618 >> 172.21.15.80:0/306450618 conn(0x7fa5a41043c0 msgr2=0x7fa5a4104e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:58.229 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.648+0000 7fa5aa6ce700 1 -- 172.21.15.80:0/306450618 shutdown_connections 2024-04-26T18:25:58.229 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:57.648+0000 7fa5aa6ce700 1 -- 172.21.15.80:0/306450618 wait complete. 2024-04-26T18:25:59.600 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.638+0000 7faea708d700 1 Processor -- start 2024-04-26T18:25:59.600 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.638+0000 7faea708d700 1 -- start start 2024-04-26T18:25:59.600 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.638+0000 7faea708d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea0108e00 0x7faea0109220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:59.600 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.638+0000 7faea708d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7faea0109760 con 0x7faea0108e00 2024-04-26T18:25:59.600 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.638+0000 7faea4e29700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea0108e00 0x7faea0109220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:59.600 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.638+0000 7faea4e29700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea0108e00 0x7faea0109220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55700/0 (socket says 172.21.15.80:55700) 2024-04-26T18:25:59.601 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.638+0000 7faea4e29700 1 -- 172.21.15.80:0/1260357811 learned_addr learned my addr 172.21.15.80:0/1260357811 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:59.601 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.638+0000 7faea4e29700 1 -- 172.21.15.80:0/1260357811 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea0109f60 con 0x7faea0108e00 2024-04-26T18:25:59.601 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.638+0000 7faea4e29700 1 --2- 172.21.15.80:0/1260357811 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea0108e00 0x7faea0109220 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fae940098a0 tx=0x7fae94009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8234038a44a69b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:59.601 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.639+0000 7fae9f7fe700 1 -- 172.21.15.80:0/1260357811 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae94004160 con 0x7faea0108e00 2024-04-26T18:25:59.601 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.639+0000 7fae9f7fe700 1 -- 172.21.15.80:0/1260357811 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae94004300 con 0x7faea0108e00 2024-04-26T18:25:59.601 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.639+0000 7fae9f7fe700 1 -- 172.21.15.80:0/1260357811 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae94011a20 con 0x7faea0108e00 2024-04-26T18:25:59.601 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.639+0000 7faea708d700 1 -- 172.21.15.80:0/1260357811 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea0108e00 msgr2=0x7faea0109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:59.601 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.639+0000 7faea708d700 1 --2- 172.21.15.80:0/1260357811 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea0108e00 0x7faea0109220 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fae940098a0 tx=0x7fae94009bb0 comp rx=0 tx=0).stop 2024-04-26T18:25:59.601 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.639+0000 7faea708d700 1 -- 172.21.15.80:0/1260357811 shutdown_connections 2024-04-26T18:25:59.601 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.639+0000 7faea708d700 1 --2- 172.21.15.80:0/1260357811 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea0108e00 0x7faea0109220 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:59.601 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.639+0000 7faea708d700 1 -- 172.21.15.80:0/1260357811 >> 172.21.15.80:0/1260357811 conn(0x7faea0104380 msgr2=0x7faea01067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:59.601 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.639+0000 7faea708d700 1 -- 172.21.15.80:0/1260357811 shutdown_connections 2024-04-26T18:25:59.601 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.639+0000 7faea708d700 1 -- 172.21.15.80:0/1260357811 wait complete. 2024-04-26T18:25:59.601 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.640+0000 7faea708d700 1 Processor -- start 2024-04-26T18:25:59.601 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.640+0000 7faea708d700 1 -- start start 2024-04-26T18:25:59.602 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.640+0000 7faea708d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea0108e00 0x7faea019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:59.602 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.640+0000 7faea708d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7faea010d3a0 con 0x7faea0108e00 2024-04-26T18:25:59.602 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.640+0000 7faea4e29700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea0108e00 0x7faea019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:59.602 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.640+0000 7faea4e29700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea0108e00 0x7faea019ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55704/0 (socket says 172.21.15.80:55704) 2024-04-26T18:25:59.602 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.640+0000 7faea4e29700 1 -- 172.21.15.80:0/2900114711 learned_addr learned my addr 172.21.15.80:0/2900114711 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:25:59.602 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.640+0000 7faea4e29700 1 -- 172.21.15.80:0/2900114711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea019d1f0 con 0x7faea0108e00 2024-04-26T18:25:59.602 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.641+0000 7faea4e29700 1 --2- 172.21.15.80:0/2900114711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea0108e00 0x7faea019ccb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fae94004660 tx=0x7fae94011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:59.602 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.641+0000 7fae9dffb700 1 -- 172.21.15.80:0/2900114711 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae94003aa0 con 0x7faea0108e00 2024-04-26T18:25:59.602 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.641+0000 7fae9dffb700 1 -- 172.21.15.80:0/2900114711 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae9401b8f0 con 0x7faea0108e00 2024-04-26T18:25:59.602 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.641+0000 7faea708d700 1 -- 172.21.15.80:0/2900114711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea019d480 con 0x7faea0108e00 2024-04-26T18:25:59.602 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.641+0000 7fae9dffb700 1 -- 172.21.15.80:0/2900114711 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae94023900 con 0x7faea0108e00 2024-04-26T18:25:59.602 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.641+0000 7faea708d700 1 -- 172.21.15.80:0/2900114711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea01a0170 con 0x7faea0108e00 2024-04-26T18:25:59.602 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.642+0000 7fae9dffb700 1 -- 172.21.15.80:0/2900114711 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fae94023b70 con 0x7faea0108e00 2024-04-26T18:25:59.602 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.642+0000 7faea708d700 1 -- 172.21.15.80:0/2900114711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faea010d520 con 0x7faea0108e00 2024-04-26T18:25:59.602 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.642+0000 7fae9dffb700 1 --2- 172.21.15.80:0/2900114711 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fae90039700 0x7fae9003bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:59.603 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.642+0000 7fae9dffb700 1 -- 172.21.15.80:0/2900114711 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fae9404e170 con 0x7faea0108e00 2024-04-26T18:25:59.603 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.642+0000 7fae9ffff700 1 --2- 172.21.15.80:0/2900114711 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fae90039700 0x7fae9003bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:59.603 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.642+0000 7fae9ffff700 1 --2- 172.21.15.80:0/2900114711 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fae90039700 0x7fae9003bbc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fae8c006fd0 tx=0x7fae8c006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:59.603 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.647+0000 7fae9dffb700 1 -- 172.21.15.80:0/2900114711 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fae9401f030 con 0x7faea0108e00 2024-04-26T18:25:59.603 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.956+0000 7faea708d700 1 -- 172.21.15.80:0/2900114711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7faea01a0750 con 0x7faea0108e00 2024-04-26T18:25:59.603 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.958+0000 7fae9dffb700 1 -- 172.21.15.80:0/2900114711 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7fae94010380 con 0x7faea0108e00 2024-04-26T18:25:59.603 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.960+0000 7faea708d700 1 -- 172.21.15.80:0/2900114711 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fae90039700 msgr2=0x7fae9003bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:59.603 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.960+0000 7faea708d700 1 --2- 172.21.15.80:0/2900114711 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fae90039700 0x7fae9003bbc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fae8c006fd0 tx=0x7fae8c006e40 comp rx=0 tx=0).stop 2024-04-26T18:25:59.603 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.960+0000 7faea708d700 1 -- 172.21.15.80:0/2900114711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea0108e00 msgr2=0x7faea019ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:59.603 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.960+0000 7faea708d700 1 --2- 172.21.15.80:0/2900114711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea0108e00 0x7faea019ccb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fae94004660 tx=0x7fae94011aa0 comp rx=0 tx=0).stop 2024-04-26T18:25:59.603 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.960+0000 7faea708d700 1 -- 172.21.15.80:0/2900114711 shutdown_connections 2024-04-26T18:25:59.603 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.960+0000 7faea708d700 1 --2- 172.21.15.80:0/2900114711 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fae90039700 0x7fae9003bbc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:59.603 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.960+0000 7faea708d700 1 --2- 172.21.15.80:0/2900114711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faea0108e00 0x7faea019ccb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:59.603 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.960+0000 7faea708d700 1 -- 172.21.15.80:0/2900114711 >> 172.21.15.80:0/2900114711 conn(0x7faea0104380 msgr2=0x7faea0104e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:59.604 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.960+0000 7faea708d700 1 -- 172.21.15.80:0/2900114711 shutdown_connections 2024-04-26T18:25:59.604 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr 2024-04-26T18:25:58.960+0000 7faea708d700 1 -- 172.21.15.80:0/2900114711 wait complete. 2024-04-26T18:25:59.604 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-26T18:25:59.604 INFO:teuthology.orchestra.run.smithi080.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-26T18:25:59.604 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:25:59.604 INFO:teuthology.orchestra.run.smithi080.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-26T18:25:59.604 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:25:59.604 INFO:teuthology.orchestra.run.smithi080.stdout:Or, if you are only running a single cluster on this host: 2024-04-26T18:25:59.604 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:25:59.604 INFO:teuthology.orchestra.run.smithi080.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-26T18:25:59.604 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:25:59.604 INFO:teuthology.orchestra.run.smithi080.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-26T18:25:59.604 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:25:59.604 INFO:teuthology.orchestra.run.smithi080.stdout: ceph telemetry on 2024-04-26T18:25:59.604 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:25:59.604 INFO:teuthology.orchestra.run.smithi080.stdout:For more information see: 2024-04-26T18:25:59.605 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:25:59.605 INFO:teuthology.orchestra.run.smithi080.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-04-26T18:25:59.605 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:25:59.605 INFO:teuthology.orchestra.run.smithi080.stdout:Bootstrap complete. 2024-04-26T18:25:59.635 INFO:tasks.cephadm:Fetching config... 2024-04-26T18:25:59.635 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T18:25:59.635 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-26T18:25:59.651 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-26T18:25:59.651 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T18:25:59.651 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-26T18:25:59.705 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-26T18:25:59.705 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T18:25:59.705 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/keyring of=/dev/stdout 2024-04-26T18:25:59.769 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-26T18:25:59.769 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T18:25:59.769 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-26T18:25:59.824 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-26T18:25:59.824 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtxMrVAIS6axjyyHJ6FuhX3LxeTXRKM6qCUtxSz5TQVvHJXJL1UWSFdO7zBbQFGMjApFjdkGA4g2gs4O9FNYSBHFTLABcitItmYcH6A+BC1aN7tjZ1cLshKUwElk3s+HrXmj+8FJDTGB5/j2EpXSAeNd6x6rmkiMo8LTDYLIm759VfrH1XgeBKI6/YyGleAZcy2Q3GhZNSY57DAVr/IRIABMBPC3kkGKe8+Tsk1/bMoXQNuoO/nXNUI697/K7YWqODjlqB9+C/dt8GlXFrWzuH4tSGG6ULFr7S6jTPZcsZaH6tuWxocQL7jkVZKVMYNzS5iOoNQUXpYioLNs023YlVcsjm9xJq8d+Ow7NOlUonZaY12+7aQL5Ac7hTZOswNwM5ynSwr0qSbGJgV97v3fbSsMJJub8/AlGLs6SYE0HZ5tbe78RF//WuKiemyF9fHXxz+L7XjZYjLzK1aWf7+PHw8Z3k/k5r8XQDytdNnkwws9eQ84GlPUbbUY9IdZ0DkMM= ceph-2187ca98-03fa-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-26T18:25:59.897 INFO:teuthology.orchestra.run.smithi080.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtxMrVAIS6axjyyHJ6FuhX3LxeTXRKM6qCUtxSz5TQVvHJXJL1UWSFdO7zBbQFGMjApFjdkGA4g2gs4O9FNYSBHFTLABcitItmYcH6A+BC1aN7tjZ1cLshKUwElk3s+HrXmj+8FJDTGB5/j2EpXSAeNd6x6rmkiMo8LTDYLIm759VfrH1XgeBKI6/YyGleAZcy2Q3GhZNSY57DAVr/IRIABMBPC3kkGKe8+Tsk1/bMoXQNuoO/nXNUI697/K7YWqODjlqB9+C/dt8GlXFrWzuH4tSGG6ULFr7S6jTPZcsZaH6tuWxocQL7jkVZKVMYNzS5iOoNQUXpYioLNs023YlVcsjm9xJq8d+Ow7NOlUonZaY12+7aQL5Ac7hTZOswNwM5ynSwr0qSbGJgV97v3fbSsMJJub8/AlGLs6SYE0HZ5tbe78RF//WuKiemyF9fHXxz+L7XjZYjLzK1aWf7+PHw8Z3k/k5r8XQDytdNnkwws9eQ84GlPUbbUY9IdZ0DkMM= ceph-2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:25:59.908 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtxMrVAIS6axjyyHJ6FuhX3LxeTXRKM6qCUtxSz5TQVvHJXJL1UWSFdO7zBbQFGMjApFjdkGA4g2gs4O9FNYSBHFTLABcitItmYcH6A+BC1aN7tjZ1cLshKUwElk3s+HrXmj+8FJDTGB5/j2EpXSAeNd6x6rmkiMo8LTDYLIm759VfrH1XgeBKI6/YyGleAZcy2Q3GhZNSY57DAVr/IRIABMBPC3kkGKe8+Tsk1/bMoXQNuoO/nXNUI697/K7YWqODjlqB9+C/dt8GlXFrWzuH4tSGG6ULFr7S6jTPZcsZaH6tuWxocQL7jkVZKVMYNzS5iOoNQUXpYioLNs023YlVcsjm9xJq8d+Ow7NOlUonZaY12+7aQL5Ac7hTZOswNwM5ynSwr0qSbGJgV97v3fbSsMJJub8/AlGLs6SYE0HZ5tbe78RF//WuKiemyF9fHXxz+L7XjZYjLzK1aWf7+PHw8Z3k/k5r8XQDytdNnkwws9eQ84GlPUbbUY9IdZ0DkMM= ceph-2187ca98-03fa-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-26T18:25:59.949 INFO:teuthology.orchestra.run.smithi082.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtxMrVAIS6axjyyHJ6FuhX3LxeTXRKM6qCUtxSz5TQVvHJXJL1UWSFdO7zBbQFGMjApFjdkGA4g2gs4O9FNYSBHFTLABcitItmYcH6A+BC1aN7tjZ1cLshKUwElk3s+HrXmj+8FJDTGB5/j2EpXSAeNd6x6rmkiMo8LTDYLIm759VfrH1XgeBKI6/YyGleAZcy2Q3GhZNSY57DAVr/IRIABMBPC3kkGKe8+Tsk1/bMoXQNuoO/nXNUI697/K7YWqODjlqB9+C/dt8GlXFrWzuH4tSGG6ULFr7S6jTPZcsZaH6tuWxocQL7jkVZKVMYNzS5iOoNQUXpYioLNs023YlVcsjm9xJq8d+Ow7NOlUonZaY12+7aQL5Ac7hTZOswNwM5ynSwr0qSbGJgV97v3fbSsMJJub8/AlGLs6SYE0HZ5tbe78RF//WuKiemyF9fHXxz+L7XjZYjLzK1aWf7+PHw8Z3k/k5r8XQDytdNnkwws9eQ84GlPUbbUY9IdZ0DkMM= ceph-2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:25:59.960 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtxMrVAIS6axjyyHJ6FuhX3LxeTXRKM6qCUtxSz5TQVvHJXJL1UWSFdO7zBbQFGMjApFjdkGA4g2gs4O9FNYSBHFTLABcitItmYcH6A+BC1aN7tjZ1cLshKUwElk3s+HrXmj+8FJDTGB5/j2EpXSAeNd6x6rmkiMo8LTDYLIm759VfrH1XgeBKI6/YyGleAZcy2Q3GhZNSY57DAVr/IRIABMBPC3kkGKe8+Tsk1/bMoXQNuoO/nXNUI697/K7YWqODjlqB9+C/dt8GlXFrWzuH4tSGG6ULFr7S6jTPZcsZaH6tuWxocQL7jkVZKVMYNzS5iOoNQUXpYioLNs023YlVcsjm9xJq8d+Ow7NOlUonZaY12+7aQL5Ac7hTZOswNwM5ynSwr0qSbGJgV97v3fbSsMJJub8/AlGLs6SYE0HZ5tbe78RF//WuKiemyF9fHXxz+L7XjZYjLzK1aWf7+PHw8Z3k/k5r8XQDytdNnkwws9eQ84GlPUbbUY9IdZ0DkMM= ceph-2187ca98-03fa-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-26T18:25:59.999 INFO:teuthology.orchestra.run.smithi192.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtxMrVAIS6axjyyHJ6FuhX3LxeTXRKM6qCUtxSz5TQVvHJXJL1UWSFdO7zBbQFGMjApFjdkGA4g2gs4O9FNYSBHFTLABcitItmYcH6A+BC1aN7tjZ1cLshKUwElk3s+HrXmj+8FJDTGB5/j2EpXSAeNd6x6rmkiMo8LTDYLIm759VfrH1XgeBKI6/YyGleAZcy2Q3GhZNSY57DAVr/IRIABMBPC3kkGKe8+Tsk1/bMoXQNuoO/nXNUI697/K7YWqODjlqB9+C/dt8GlXFrWzuH4tSGG6ULFr7S6jTPZcsZaH6tuWxocQL7jkVZKVMYNzS5iOoNQUXpYioLNs023YlVcsjm9xJq8d+Ow7NOlUonZaY12+7aQL5Ac7hTZOswNwM5ynSwr0qSbGJgV97v3fbSsMJJub8/AlGLs6SYE0HZ5tbe78RF//WuKiemyF9fHXxz+L7XjZYjLzK1aWf7+PHw8Z3k/k5r8XQDytdNnkwws9eQ84GlPUbbUY9IdZ0DkMM= ceph-2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:26:00.012 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-26T18:26:00.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:25:59 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2900114711' entity='client.admin' 2024-04-26T18:26:00.252 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:26:02.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.474+0000 7f022a5d9700 1 -- 172.21.15.80:0/67056318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0224101da0 msgr2=0x7f02241021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:02.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.474+0000 7f022a5d9700 1 --2- 172.21.15.80:0/67056318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0224101da0 0x7f02241021c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f020c009910 tx=0x7f020c009c20 comp rx=0 tx=0).stop 2024-04-26T18:26:02.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.474+0000 7f022a5d9700 1 -- 172.21.15.80:0/67056318 shutdown_connections 2024-04-26T18:26:02.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.474+0000 7f022a5d9700 1 --2- 172.21.15.80:0/67056318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0224101da0 0x7f02241021c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:02.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.474+0000 7f022a5d9700 1 -- 172.21.15.80:0/67056318 >> 172.21.15.80:0/67056318 conn(0x7f02240fd360 msgr2=0x7f02240ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:02.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.474+0000 7f022a5d9700 1 -- 172.21.15.80:0/67056318 shutdown_connections 2024-04-26T18:26:02.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.474+0000 7f022a5d9700 1 -- 172.21.15.80:0/67056318 wait complete. 2024-04-26T18:26:02.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.475+0000 7f022a5d9700 1 Processor -- start 2024-04-26T18:26:02.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.475+0000 7f022a5d9700 1 -- start start 2024-04-26T18:26:02.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.475+0000 7f022a5d9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0224101da0 0x7f022406bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:02.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.475+0000 7f022a5d9700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0224107ce0 con 0x7f0224101da0 2024-04-26T18:26:02.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.475+0000 7f0223fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0224101da0 0x7f022406bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:02.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.475+0000 7f0223fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0224101da0 0x7f022406bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55724/0 (socket says 172.21.15.80:55724) 2024-04-26T18:26:02.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.475+0000 7f0223fff700 1 -- 172.21.15.80:0/2601782501 learned_addr learned my addr 172.21.15.80:0/2601782501 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:26:02.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.475+0000 7f0223fff700 1 -- 172.21.15.80:0/2601782501 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f022419b270 con 0x7f0224101da0 2024-04-26T18:26:02.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.476+0000 7f0223fff700 1 --2- 172.21.15.80:0/2601782501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0224101da0 0x7f022406bd30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f020c004fb0 tx=0x7f020c009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:02.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.476+0000 7f02217fa700 1 -- 172.21.15.80:0/2601782501 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f020c027070 con 0x7f0224101da0 2024-04-26T18:26:02.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.476+0000 7f022a5d9700 1 -- 172.21.15.80:0/2601782501 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f022419b440 con 0x7f0224101da0 2024-04-26T18:26:02.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.476+0000 7f02217fa700 1 -- 172.21.15.80:0/2601782501 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f020c00be10 con 0x7f0224101da0 2024-04-26T18:26:02.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.476+0000 7f02217fa700 1 -- 172.21.15.80:0/2601782501 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f020c022de0 con 0x7f0224101da0 2024-04-26T18:26:02.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.476+0000 7f022a5d9700 1 -- 172.21.15.80:0/2601782501 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f022419b860 con 0x7f0224101da0 2024-04-26T18:26:02.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.477+0000 7f02217fa700 1 -- 172.21.15.80:0/2601782501 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f020c02a070 con 0x7f0224101da0 2024-04-26T18:26:02.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.477+0000 7f022a5d9700 1 -- 172.21.15.80:0/2601782501 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0224108460 con 0x7f0224101da0 2024-04-26T18:26:02.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.477+0000 7f02217fa700 1 --2- 172.21.15.80:0/2601782501 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f02100396b0 0x7f021003bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:02.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.477+0000 7f02217fa700 1 -- 172.21.15.80:0/2601782501 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f020c01e030 con 0x7f0224101da0 2024-04-26T18:26:02.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.477+0000 7f02237fe700 1 --2- 172.21.15.80:0/2601782501 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f02100396b0 0x7f021003bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:02.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.477+0000 7f02237fe700 1 --2- 172.21.15.80:0/2601782501 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f02100396b0 0x7f021003bb70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0214006fd0 tx=0x7f0214006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:02.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.482+0000 7f02217fa700 1 -- 172.21.15.80:0/2601782501 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f020c013070 con 0x7f0224101da0 2024-04-26T18:26:02.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.679+0000 7f022a5d9700 1 -- 172.21.15.80:0/2601782501 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f022402e600 con 0x7f0224101da0 2024-04-26T18:26:02.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.681+0000 7f02217fa700 1 -- 172.21.15.80:0/2601782501 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f020c031020 con 0x7f0224101da0 2024-04-26T18:26:02.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.684+0000 7f022a5d9700 1 -- 172.21.15.80:0/2601782501 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f02100396b0 msgr2=0x7f021003bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:02.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.684+0000 7f022a5d9700 1 --2- 172.21.15.80:0/2601782501 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f02100396b0 0x7f021003bb70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0214006fd0 tx=0x7f0214006e40 comp rx=0 tx=0).stop 2024-04-26T18:26:02.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.684+0000 7f022a5d9700 1 -- 172.21.15.80:0/2601782501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0224101da0 msgr2=0x7f022406bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:02.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.684+0000 7f022a5d9700 1 --2- 172.21.15.80:0/2601782501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0224101da0 0x7f022406bd30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f020c004fb0 tx=0x7f020c009f60 comp rx=0 tx=0).stop 2024-04-26T18:26:02.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.684+0000 7f022a5d9700 1 -- 172.21.15.80:0/2601782501 shutdown_connections 2024-04-26T18:26:02.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.684+0000 7f022a5d9700 1 --2- 172.21.15.80:0/2601782501 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f02100396b0 0x7f021003bb70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:02.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.684+0000 7f022a5d9700 1 --2- 172.21.15.80:0/2601782501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0224101da0 0x7f022406bd30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:02.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.684+0000 7f022a5d9700 1 -- 172.21.15.80:0/2601782501 >> 172.21.15.80:0/2601782501 conn(0x7f02240fd360 msgr2=0x7f02240fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:02.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.684+0000 7f022a5d9700 1 -- 172.21.15.80:0/2601782501 shutdown_connections 2024-04-26T18:26:02.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:02.684+0000 7f022a5d9700 1 -- 172.21.15.80:0/2601782501 wait complete. 2024-04-26T18:26:02.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:02 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:02.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:02 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:02.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:02 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi080", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:02.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:02 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:02.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:02 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:26:02.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:02 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:03.262 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-26T18:26:03.262 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-26T18:26:03.496 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:26:03.893 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:03 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2601782501' entity='client.admin' 2024-04-26T18:26:03.893 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:03 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:26:03.893 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:03 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:04.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.989+0000 7f3f6a27d700 1 -- 172.21.15.80:0/2232642883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f641044e0 msgr2=0x7f3f64104900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:04.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.989+0000 7f3f6a27d700 1 --2- 172.21.15.80:0/2232642883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f641044e0 0x7f3f64104900 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3f54009910 tx=0x7f3f54009c20 comp rx=0 tx=0).stop 2024-04-26T18:26:04.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.990+0000 7f3f6a27d700 1 -- 172.21.15.80:0/2232642883 shutdown_connections 2024-04-26T18:26:04.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.990+0000 7f3f6a27d700 1 --2- 172.21.15.80:0/2232642883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f641044e0 0x7f3f64104900 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:04.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.990+0000 7f3f6a27d700 1 -- 172.21.15.80:0/2232642883 >> 172.21.15.80:0/2232642883 conn(0x7f3f640fe470 msgr2=0x7f3f64100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:04.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.990+0000 7f3f6a27d700 1 -- 172.21.15.80:0/2232642883 shutdown_connections 2024-04-26T18:26:04.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.990+0000 7f3f6a27d700 1 -- 172.21.15.80:0/2232642883 wait complete. 2024-04-26T18:26:04.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.990+0000 7f3f6a27d700 1 Processor -- start 2024-04-26T18:26:04.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.990+0000 7f3f6a27d700 1 -- start start 2024-04-26T18:26:04.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.991+0000 7f3f6a27d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f641044e0 0x7f3f641985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:04.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.991+0000 7f3f6a27d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3f64108e50 con 0x7f3f641044e0 2024-04-26T18:26:04.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.991+0000 7f3f63fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f641044e0 0x7f3f641985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:04.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.991+0000 7f3f63fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f641044e0 0x7f3f641985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37558/0 (socket says 172.21.15.80:37558) 2024-04-26T18:26:04.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.991+0000 7f3f63fff700 1 -- 172.21.15.80:0/1431138118 learned_addr learned my addr 172.21.15.80:0/1431138118 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:26:04.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.991+0000 7f3f63fff700 1 -- 172.21.15.80:0/1431138118 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f64198af0 con 0x7f3f641044e0 2024-04-26T18:26:04.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.991+0000 7f3f63fff700 1 --2- 172.21.15.80:0/1431138118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f641044e0 0x7f3f641985b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3f54005950 tx=0x7f3f54004fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:04.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.991+0000 7f3f617fa700 1 -- 172.21.15.80:0/1431138118 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f54026070 con 0x7f3f641044e0 2024-04-26T18:26:04.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.991+0000 7f3f617fa700 1 -- 172.21.15.80:0/1431138118 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f5400bc00 con 0x7f3f641044e0 2024-04-26T18:26:04.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.991+0000 7f3f6a27d700 1 -- 172.21.15.80:0/1431138118 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f64198d80 con 0x7f3f641044e0 2024-04-26T18:26:04.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.991+0000 7f3f617fa700 1 -- 172.21.15.80:0/1431138118 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f54003a10 con 0x7f3f641044e0 2024-04-26T18:26:04.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.991+0000 7f3f6a27d700 1 -- 172.21.15.80:0/1431138118 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f6419ba70 con 0x7f3f641044e0 2024-04-26T18:26:04.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.992+0000 7f3f617fa700 1 -- 172.21.15.80:0/1431138118 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f3f54029070 con 0x7f3f641044e0 2024-04-26T18:26:04.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.992+0000 7f3f6a27d700 1 -- 172.21.15.80:0/1431138118 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f641095d0 con 0x7f3f641044e0 2024-04-26T18:26:04.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.992+0000 7f3f617fa700 1 --2- 172.21.15.80:0/1431138118 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f3f4c039650 0x7f3f4c03bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:04.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.992+0000 7f3f617fa700 1 -- 172.21.15.80:0/1431138118 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3f5401e070 con 0x7f3f641044e0 2024-04-26T18:26:04.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.992+0000 7f3f637fe700 1 --2- 172.21.15.80:0/1431138118 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f3f4c039650 0x7f3f4c03bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:04.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.993+0000 7f3f637fe700 1 --2- 172.21.15.80:0/1431138118 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f3f4c039650 0x7f3f4c03bb10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3f58006fd0 tx=0x7f3f58006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:04.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:04.997+0000 7f3f617fa700 1 -- 172.21.15.80:0/1431138118 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3f54013070 con 0x7f3f641044e0 2024-04-26T18:26:05.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:05.199+0000 7f3f6a27d700 1 -- 172.21.15.80:0/1431138118 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f3f64063860 con 0x7f3f4c039650 2024-04-26T18:26:05.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:05.202+0000 7f3f617fa700 1 -- 172.21.15.80:0/1431138118 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3f64063860 con 0x7f3f4c039650 2024-04-26T18:26:05.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:05.204+0000 7f3f6a27d700 1 -- 172.21.15.80:0/1431138118 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f3f4c039650 msgr2=0x7f3f4c03bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:05.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:05.204+0000 7f3f6a27d700 1 --2- 172.21.15.80:0/1431138118 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f3f4c039650 0x7f3f4c03bb10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3f58006fd0 tx=0x7f3f58006e40 comp rx=0 tx=0).stop 2024-04-26T18:26:05.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:05.204+0000 7f3f6a27d700 1 -- 172.21.15.80:0/1431138118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f641044e0 msgr2=0x7f3f641985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:05.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:05.204+0000 7f3f6a27d700 1 --2- 172.21.15.80:0/1431138118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f641044e0 0x7f3f641985b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3f54005950 tx=0x7f3f54004fa0 comp rx=0 tx=0).stop 2024-04-26T18:26:05.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:05.204+0000 7f3f6a27d700 1 -- 172.21.15.80:0/1431138118 shutdown_connections 2024-04-26T18:26:05.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:05.204+0000 7f3f6a27d700 1 --2- 172.21.15.80:0/1431138118 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f3f4c039650 0x7f3f4c03bb10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:05.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:05.204+0000 7f3f6a27d700 1 --2- 172.21.15.80:0/1431138118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f641044e0 0x7f3f641985b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:05.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:05.204+0000 7f3f6a27d700 1 -- 172.21.15.80:0/1431138118 >> 172.21.15.80:0/1431138118 conn(0x7f3f640fe470 msgr2=0x7f3f640fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:05.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:05.204+0000 7f3f6a27d700 1 -- 172.21.15.80:0/1431138118 shutdown_connections 2024-04-26T18:26:05.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:05.204+0000 7f3f6a27d700 1 -- 172.21.15.80:0/1431138118 wait complete. 2024-04-26T18:26:05.953 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi082 2024-04-26T18:26:05.953 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T18:26:05.953 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/etc/ceph/ceph.conf 2024-04-26T18:26:05.971 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T18:26:05.971 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T18:26:06.028 INFO:tasks.cephadm:Adding host smithi082 to orchestrator... 2024-04-26T18:26:06.028 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph orch host add smithi082 2024-04-26T18:26:06.263 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:26:06.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:06 smithi080 ceph-mon[29135]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:26:06.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:06.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:26:06.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:06.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:26:06.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:06 smithi080 ceph-mon[29135]: Updating smithi080:/etc/ceph/ceph.conf 2024-04-26T18:26:06.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:06 smithi080 ceph-mon[29135]: Updating smithi080:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T18:26:06.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:06.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:06.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:07.465 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:07 smithi080 ceph-mon[29135]: Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2024-04-26T18:26:07.466 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:07 smithi080 ceph-mon[29135]: Updating smithi080:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T18:26:07.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.768+0000 7f6b22bbe700 1 -- 172.21.15.80:0/3553118646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b1c103090 msgr2=0x7f6b1c103470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:07.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.768+0000 7f6b22bbe700 1 --2- 172.21.15.80:0/3553118646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b1c103090 0x7f6b1c103470 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6b10009910 tx=0x7f6b10009c20 comp rx=0 tx=0).stop 2024-04-26T18:26:07.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.769+0000 7f6b22bbe700 1 -- 172.21.15.80:0/3553118646 shutdown_connections 2024-04-26T18:26:07.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.769+0000 7f6b22bbe700 1 --2- 172.21.15.80:0/3553118646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b1c103090 0x7f6b1c103470 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:07.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.769+0000 7f6b22bbe700 1 -- 172.21.15.80:0/3553118646 >> 172.21.15.80:0/3553118646 conn(0x7f6b1c0fe960 msgr2=0x7f6b1c100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:07.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.769+0000 7f6b22bbe700 1 -- 172.21.15.80:0/3553118646 shutdown_connections 2024-04-26T18:26:07.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.769+0000 7f6b22bbe700 1 -- 172.21.15.80:0/3553118646 wait complete. 2024-04-26T18:26:07.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.769+0000 7f6b22bbe700 1 Processor -- start 2024-04-26T18:26:07.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.769+0000 7f6b22bbe700 1 -- start start 2024-04-26T18:26:07.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.769+0000 7f6b22bbe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b1c103090 0x7f6b1c19e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:07.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.769+0000 7f6b22bbe700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6b1c10d310 con 0x7f6b1c103090 2024-04-26T18:26:07.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.769+0000 7f6b2095a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b1c103090 0x7f6b1c19e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:07.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.769+0000 7f6b2095a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b1c103090 0x7f6b1c19e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37572/0 (socket says 172.21.15.80:37572) 2024-04-26T18:26:07.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.769+0000 7f6b2095a700 1 -- 172.21.15.80:0/3714149639 learned_addr learned my addr 172.21.15.80:0/3714149639 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:26:07.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.770+0000 7f6b2095a700 1 -- 172.21.15.80:0/3714149639 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b1c19eaf0 con 0x7f6b1c103090 2024-04-26T18:26:07.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.770+0000 7f6b2095a700 1 --2- 172.21.15.80:0/3714149639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b1c103090 0x7f6b1c19e5b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6b100056d0 tx=0x7f6b100057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:07.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.770+0000 7f6b19ffb700 1 -- 172.21.15.80:0/3714149639 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b10026070 con 0x7f6b1c103090 2024-04-26T18:26:07.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.770+0000 7f6b19ffb700 1 -- 172.21.15.80:0/3714149639 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b1000bba0 con 0x7f6b1c103090 2024-04-26T18:26:07.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.770+0000 7f6b22bbe700 1 -- 172.21.15.80:0/3714149639 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b1c19ede0 con 0x7f6b1c103090 2024-04-26T18:26:07.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.770+0000 7f6b19ffb700 1 -- 172.21.15.80:0/3714149639 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b10003920 con 0x7f6b1c103090 2024-04-26T18:26:07.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.770+0000 7f6b22bbe700 1 -- 172.21.15.80:0/3714149639 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b1c198850 con 0x7f6b1c103090 2024-04-26T18:26:07.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.771+0000 7f6b19ffb700 1 -- 172.21.15.80:0/3714149639 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f6b10029070 con 0x7f6b1c103090 2024-04-26T18:26:07.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.771+0000 7f6b22bbe700 1 -- 172.21.15.80:0/3714149639 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b1c104570 con 0x7f6b1c103090 2024-04-26T18:26:07.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.771+0000 7f6b19ffb700 1 --2- 172.21.15.80:0/3714149639 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6b0c039650 0x7f6b0c03bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:07.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.771+0000 7f6b19ffb700 1 -- 172.21.15.80:0/3714149639 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6b1001e070 con 0x7f6b1c103090 2024-04-26T18:26:07.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.771+0000 7f6b1bfff700 1 --2- 172.21.15.80:0/3714149639 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6b0c039650 0x7f6b0c03bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:07.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.772+0000 7f6b1bfff700 1 --2- 172.21.15.80:0/3714149639 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6b0c039650 0x7f6b0c03bb10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6b08006fd0 tx=0x7f6b08006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:07.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.776+0000 7f6b19ffb700 1 -- 172.21.15.80:0/3714149639 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6b10013070 con 0x7f6b1c103090 2024-04-26T18:26:07.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:07.980+0000 7f6b22bbe700 1 -- 172.21.15.80:0/3714149639 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi082", "target": ["mon-mgr", ""]}) -- 0x7f6b1c199be0 con 0x7f6b0c039650 2024-04-26T18:26:08.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:08 smithi080 ceph-mon[29135]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi082", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:26:08.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:08 smithi080 ceph-mon[29135]: Deploying cephadm binary to smithi082 2024-04-26T18:26:11.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:11 smithi080 ceph-mon[29135]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:12.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:12.052+0000 7f6b19ffb700 1 -- 172.21.15.80:0/3714149639 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f6b1c199be0 con 0x7f6b0c039650 2024-04-26T18:26:12.052 INFO:teuthology.orchestra.run.smithi080.stdout:Added host 'smithi082' with addr '172.21.15.82' 2024-04-26T18:26:12.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:12.054+0000 7f6b22bbe700 1 -- 172.21.15.80:0/3714149639 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6b0c039650 msgr2=0x7f6b0c03bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:12.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:12.054+0000 7f6b22bbe700 1 --2- 172.21.15.80:0/3714149639 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6b0c039650 0x7f6b0c03bb10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6b08006fd0 tx=0x7f6b08006e40 comp rx=0 tx=0).stop 2024-04-26T18:26:12.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:12.054+0000 7f6b22bbe700 1 -- 172.21.15.80:0/3714149639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b1c103090 msgr2=0x7f6b1c19e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:12.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:12.054+0000 7f6b22bbe700 1 --2- 172.21.15.80:0/3714149639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b1c103090 0x7f6b1c19e5b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6b100056d0 tx=0x7f6b100057b0 comp rx=0 tx=0).stop 2024-04-26T18:26:12.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:12.054+0000 7f6b22bbe700 1 -- 172.21.15.80:0/3714149639 shutdown_connections 2024-04-26T18:26:12.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:12.054+0000 7f6b22bbe700 1 --2- 172.21.15.80:0/3714149639 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6b0c039650 0x7f6b0c03bb10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:12.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:12.054+0000 7f6b22bbe700 1 --2- 172.21.15.80:0/3714149639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b1c103090 0x7f6b1c19e5b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:12.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:12.054+0000 7f6b22bbe700 1 -- 172.21.15.80:0/3714149639 >> 172.21.15.80:0/3714149639 conn(0x7f6b1c0fe960 msgr2=0x7f6b1c104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:12.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:12.055+0000 7f6b22bbe700 1 -- 172.21.15.80:0/3714149639 shutdown_connections 2024-04-26T18:26:12.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:12.055+0000 7f6b22bbe700 1 -- 172.21.15.80:0/3714149639 wait complete. 2024-04-26T18:26:12.674 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-26T18:26:12.905 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:26:13.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:13.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:13 smithi080 ceph-mon[29135]: Added host smithi082 2024-04-26T18:26:13.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:26:13.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:13 smithi080 ceph-mon[29135]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:13.316 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:14.167 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:14 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:14.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.415+0000 7f0eb1256700 1 -- 172.21.15.80:0/1182073491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0eac108e40 msgr2=0x7f0eac109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:14.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.415+0000 7f0eb1256700 1 --2- 172.21.15.80:0/1182073491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0eac108e40 0x7f0eac109220 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c009910 tx=0x7f0e9c009c20 comp rx=0 tx=0).stop 2024-04-26T18:26:14.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.416+0000 7f0eb1256700 1 -- 172.21.15.80:0/1182073491 shutdown_connections 2024-04-26T18:26:14.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.416+0000 7f0eb1256700 1 --2- 172.21.15.80:0/1182073491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0eac108e40 0x7f0eac109220 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:14.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.416+0000 7f0eb1256700 1 -- 172.21.15.80:0/1182073491 >> 172.21.15.80:0/1182073491 conn(0x7f0eac079350 msgr2=0x7f0eac079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:14.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.416+0000 7f0eb1256700 1 -- 172.21.15.80:0/1182073491 shutdown_connections 2024-04-26T18:26:14.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.416+0000 7f0eb1256700 1 -- 172.21.15.80:0/1182073491 wait complete. 2024-04-26T18:26:14.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.416+0000 7f0eb1256700 1 Processor -- start 2024-04-26T18:26:14.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.417+0000 7f0eb1256700 1 -- start start 2024-04-26T18:26:14.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.417+0000 7f0eb1256700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0eac108e40 0x7f0eac19e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:14.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.417+0000 7f0eb1256700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0eac10d310 con 0x7f0eac108e40 2024-04-26T18:26:14.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.417+0000 7f0eaad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0eac108e40 0x7f0eac19e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:14.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.417+0000 7f0eaad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0eac108e40 0x7f0eac19e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48494/0 (socket says 172.21.15.80:48494) 2024-04-26T18:26:14.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.417+0000 7f0eaad9d700 1 -- 172.21.15.80:0/2775095604 learned_addr learned my addr 172.21.15.80:0/2775095604 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:26:14.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.417+0000 7f0eaad9d700 1 -- 172.21.15.80:0/2775095604 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eac19eaf0 con 0x7f0eac108e40 2024-04-26T18:26:14.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.417+0000 7f0eaad9d700 1 --2- 172.21.15.80:0/2775095604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0eac108e40 0x7f0eac19e5b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c0056d0 tx=0x7f0e9c0057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:14.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.417+0000 7f0ea8d99700 1 -- 172.21.15.80:0/2775095604 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e9c026070 con 0x7f0eac108e40 2024-04-26T18:26:14.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.418+0000 7f0ea8d99700 1 -- 172.21.15.80:0/2775095604 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e9c00bba0 con 0x7f0eac108e40 2024-04-26T18:26:14.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.418+0000 7f0eb1256700 1 -- 172.21.15.80:0/2775095604 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eac19ede0 con 0x7f0eac108e40 2024-04-26T18:26:14.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.418+0000 7f0ea8d99700 1 -- 172.21.15.80:0/2775095604 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e9c003920 con 0x7f0eac108e40 2024-04-26T18:26:14.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.418+0000 7f0eb1256700 1 -- 172.21.15.80:0/2775095604 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eac198850 con 0x7f0eac108e40 2024-04-26T18:26:14.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.419+0000 7f0ea8d99700 1 -- 172.21.15.80:0/2775095604 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f0e9c029070 con 0x7f0eac108e40 2024-04-26T18:26:14.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.419+0000 7f0ea8d99700 1 --2- 172.21.15.80:0/2775095604 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f0e98039650 0x7f0e9803bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:14.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.419+0000 7f0eb1256700 1 -- 172.21.15.80:0/2775095604 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eac06b040 con 0x7f0eac108e40 2024-04-26T18:26:14.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.419+0000 7f0ea8d99700 1 -- 172.21.15.80:0/2775095604 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0e9c01e070 con 0x7f0eac108e40 2024-04-26T18:26:14.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.419+0000 7f0ea259c700 1 --2- 172.21.15.80:0/2775095604 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f0e98039650 0x7f0e9803bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:14.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.419+0000 7f0ea259c700 1 --2- 172.21.15.80:0/2775095604 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f0e98039650 0x7f0e9803bb10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0e94006fd0 tx=0x7f0e94006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:14.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.424+0000 7f0ea8d99700 1 -- 172.21.15.80:0/2775095604 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0e9c013070 con 0x7f0eac108e40 2024-04-26T18:26:14.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.627+0000 7f0eb1256700 1 -- 172.21.15.80:0/2775095604 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0eac199bb0 con 0x7f0e98039650 2024-04-26T18:26:14.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.628+0000 7f0ea8d99700 1 -- 172.21.15.80:0/2775095604 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f0eac199bb0 con 0x7f0e98039650 2024-04-26T18:26:14.628 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:26:14.628 INFO:teuthology.orchestra.run.smithi080.stdout:[{"addr": "172.21.15.80", "hostname": "smithi080", "labels": [], "status": ""}, {"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}] 2024-04-26T18:26:14.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.630+0000 7f0eb1256700 1 -- 172.21.15.80:0/2775095604 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f0e98039650 msgr2=0x7f0e9803bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:14.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.630+0000 7f0eb1256700 1 --2- 172.21.15.80:0/2775095604 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f0e98039650 0x7f0e9803bb10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0e94006fd0 tx=0x7f0e94006e40 comp rx=0 tx=0).stop 2024-04-26T18:26:14.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.630+0000 7f0eb1256700 1 -- 172.21.15.80:0/2775095604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0eac108e40 msgr2=0x7f0eac19e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:14.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.630+0000 7f0eb1256700 1 --2- 172.21.15.80:0/2775095604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0eac108e40 0x7f0eac19e5b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c0056d0 tx=0x7f0e9c0057b0 comp rx=0 tx=0).stop 2024-04-26T18:26:14.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.630+0000 7f0eb1256700 1 -- 172.21.15.80:0/2775095604 shutdown_connections 2024-04-26T18:26:14.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.630+0000 7f0eb1256700 1 --2- 172.21.15.80:0/2775095604 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f0e98039650 0x7f0e9803bb10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:14.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.630+0000 7f0eb1256700 1 --2- 172.21.15.80:0/2775095604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0eac108e40 0x7f0eac19e5b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:14.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.630+0000 7f0eb1256700 1 -- 172.21.15.80:0/2775095604 >> 172.21.15.80:0/2775095604 conn(0x7f0eac079350 msgr2=0x7f0eac0fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:14.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.630+0000 7f0eb1256700 1 -- 172.21.15.80:0/2775095604 shutdown_connections 2024-04-26T18:26:14.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:14.630+0000 7f0eb1256700 1 -- 172.21.15.80:0/2775095604 wait complete. 2024-04-26T18:26:15.212 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi192 2024-04-26T18:26:15.213 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T18:26:15.213 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/etc/ceph/ceph.conf 2024-04-26T18:26:15.232 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T18:26:15.232 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T18:26:15.289 INFO:tasks.cephadm:Adding host smithi192 to orchestrator... 2024-04-26T18:26:15.289 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph orch host add smithi192 2024-04-26T18:26:15.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:15 smithi080 ceph-mon[29135]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:15.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:15 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:26:16.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:16 smithi080 ceph-mon[29135]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T18:26:16.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.980+0000 7f64b9e1d700 1 -- 172.21.15.80:0/3901422249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64b4103090 msgr2=0x7f64b4103470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:16.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.980+0000 7f64b9e1d700 1 --2- 172.21.15.80:0/3901422249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64b4103090 0x7f64b4103470 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f64a4009910 tx=0x7f64a4009c20 comp rx=0 tx=0).stop 2024-04-26T18:26:16.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.980+0000 7f64b9e1d700 1 -- 172.21.15.80:0/3901422249 shutdown_connections 2024-04-26T18:26:16.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.980+0000 7f64b9e1d700 1 --2- 172.21.15.80:0/3901422249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64b4103090 0x7f64b4103470 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:16.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.980+0000 7f64b9e1d700 1 -- 172.21.15.80:0/3901422249 >> 172.21.15.80:0/3901422249 conn(0x7f64b40fe960 msgr2=0x7f64b4100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:16.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.980+0000 7f64b9e1d700 1 -- 172.21.15.80:0/3901422249 shutdown_connections 2024-04-26T18:26:16.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.980+0000 7f64b9e1d700 1 -- 172.21.15.80:0/3901422249 wait complete. 2024-04-26T18:26:16.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.981+0000 7f64b9e1d700 1 Processor -- start 2024-04-26T18:26:16.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.981+0000 7f64b9e1d700 1 -- start start 2024-04-26T18:26:16.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.981+0000 7f64b9e1d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64b4103090 0x7f64b419e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:16.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.981+0000 7f64b9e1d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f64b410d310 con 0x7f64b4103090 2024-04-26T18:26:16.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.981+0000 7f64b37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64b4103090 0x7f64b419e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:16.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.981+0000 7f64b37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64b4103090 0x7f64b419e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48504/0 (socket says 172.21.15.80:48504) 2024-04-26T18:26:16.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.981+0000 7f64b37fe700 1 -- 172.21.15.80:0/2449068348 learned_addr learned my addr 172.21.15.80:0/2449068348 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:26:16.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.982+0000 7f64b37fe700 1 -- 172.21.15.80:0/2449068348 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b419eaf0 con 0x7f64b4103090 2024-04-26T18:26:16.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.982+0000 7f64b37fe700 1 --2- 172.21.15.80:0/2449068348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64b4103090 0x7f64b419e5b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f64a40056d0 tx=0x7f64a40057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:16.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.982+0000 7f64b0ff9700 1 -- 172.21.15.80:0/2449068348 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64a4026070 con 0x7f64b4103090 2024-04-26T18:26:16.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.982+0000 7f64b9e1d700 1 -- 172.21.15.80:0/2449068348 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b419ede0 con 0x7f64b4103090 2024-04-26T18:26:16.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.982+0000 7f64b0ff9700 1 -- 172.21.15.80:0/2449068348 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64a400bba0 con 0x7f64b4103090 2024-04-26T18:26:16.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.982+0000 7f64b0ff9700 1 -- 172.21.15.80:0/2449068348 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64a4003920 con 0x7f64b4103090 2024-04-26T18:26:16.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.982+0000 7f64b9e1d700 1 -- 172.21.15.80:0/2449068348 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b4198850 con 0x7f64b4103090 2024-04-26T18:26:16.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.983+0000 7f64b0ff9700 1 -- 172.21.15.80:0/2449068348 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f64a4029070 con 0x7f64b4103090 2024-04-26T18:26:16.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.983+0000 7f64b9e1d700 1 -- 172.21.15.80:0/2449068348 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64b4104570 con 0x7f64b4103090 2024-04-26T18:26:16.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.983+0000 7f64b0ff9700 1 --2- 172.21.15.80:0/2449068348 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f649c0396b0 0x7f649c03bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:16.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.983+0000 7f64b0ff9700 1 -- 172.21.15.80:0/2449068348 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f64a401e070 con 0x7f64b4103090 2024-04-26T18:26:16.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.983+0000 7f64b2ffd700 1 --2- 172.21.15.80:0/2449068348 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f649c0396b0 0x7f649c03bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:16.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.984+0000 7f64b2ffd700 1 --2- 172.21.15.80:0/2449068348 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f649c0396b0 0x7f649c03bb70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f64a8006fd0 tx=0x7f64a8006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:16.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:16.988+0000 7f64b0ff9700 1 -- 172.21.15.80:0/2449068348 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f64a4013070 con 0x7f64b4103090 2024-04-26T18:26:17.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:17.190+0000 7f64b9e1d700 1 -- 172.21.15.80:0/2449068348 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi192", "target": ["mon-mgr", ""]}) -- 0x7f64b4199bb0 con 0x7f649c0396b0 2024-04-26T18:26:17.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:17 smithi080 ceph-mon[29135]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:18.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:18 smithi080 ceph-mon[29135]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi192", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:26:18.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:18.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:18.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:18.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:18.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi082", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:18.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:18.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:26:19.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:19 smithi080 ceph-mon[29135]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-26T18:26:19.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:19 smithi080 ceph-mon[29135]: Deploying cephadm binary to smithi192 2024-04-26T18:26:19.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:19 smithi080 ceph-mon[29135]: Updating smithi082:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T18:26:19.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:19 smithi080 ceph-mon[29135]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-04-26T18:26:19.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:19 smithi080 ceph-mon[29135]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:21.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:21.307+0000 7f64b0ff9700 1 -- 172.21.15.80:0/2449068348 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f64b4199bb0 con 0x7f649c0396b0 2024-04-26T18:26:21.309 INFO:teuthology.orchestra.run.smithi080.stdout:Added host 'smithi192' with addr '172.21.15.192' 2024-04-26T18:26:21.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:21.310+0000 7f64b9e1d700 1 -- 172.21.15.80:0/2449068348 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f649c0396b0 msgr2=0x7f649c03bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:21.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:21.310+0000 7f64b9e1d700 1 --2- 172.21.15.80:0/2449068348 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f649c0396b0 0x7f649c03bb70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f64a8006fd0 tx=0x7f64a8006e40 comp rx=0 tx=0).stop 2024-04-26T18:26:21.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:21.310+0000 7f64b9e1d700 1 -- 172.21.15.80:0/2449068348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64b4103090 msgr2=0x7f64b419e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:21.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:21.310+0000 7f64b9e1d700 1 --2- 172.21.15.80:0/2449068348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64b4103090 0x7f64b419e5b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f64a40056d0 tx=0x7f64a40057b0 comp rx=0 tx=0).stop 2024-04-26T18:26:21.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:21.310+0000 7f64b9e1d700 1 -- 172.21.15.80:0/2449068348 shutdown_connections 2024-04-26T18:26:21.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:21.310+0000 7f64b9e1d700 1 --2- 172.21.15.80:0/2449068348 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f649c0396b0 0x7f649c03bb70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:21.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:21.310+0000 7f64b9e1d700 1 --2- 172.21.15.80:0/2449068348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64b4103090 0x7f64b419e5b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:21.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:21.310+0000 7f64b9e1d700 1 -- 172.21.15.80:0/2449068348 >> 172.21.15.80:0/2449068348 conn(0x7f64b40fe960 msgr2=0x7f64b4104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:21.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:21.310+0000 7f64b9e1d700 1 -- 172.21.15.80:0/2449068348 shutdown_connections 2024-04-26T18:26:21.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:21.310+0000 7f64b9e1d700 1 -- 172.21.15.80:0/2449068348 wait complete. 2024-04-26T18:26:21.672 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:21 smithi080 ceph-mon[29135]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:21.672 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:21 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:21.672 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:21 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:21.672 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:21 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:21.672 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:21 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:21.672 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:21 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:26:22.016 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-26T18:26:22.248 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:26:22.657 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:22 smithi080 ceph-mon[29135]: Updating smithi082:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T18:26:22.657 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:22 smithi080 ceph-mon[29135]: Added host smithi192 2024-04-26T18:26:22.657 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:22 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:22.657 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:22 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:23.683 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:23 smithi080 ceph-mon[29135]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:23.684 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:23 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:23.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.709+0000 7fdc17520700 1 -- 172.21.15.80:0/1489616072 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc10104070 msgr2=0x7fdc10104450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:23.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.709+0000 7fdc17520700 1 --2- 172.21.15.80:0/1489616072 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc10104070 0x7fdc10104450 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c009910 tx=0x7fdc0c009c20 comp rx=0 tx=0).stop 2024-04-26T18:26:23.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.709+0000 7fdc17520700 1 -- 172.21.15.80:0/1489616072 shutdown_connections 2024-04-26T18:26:23.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.709+0000 7fdc17520700 1 --2- 172.21.15.80:0/1489616072 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc10104070 0x7fdc10104450 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:23.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.709+0000 7fdc17520700 1 -- 172.21.15.80:0/1489616072 >> 172.21.15.80:0/1489616072 conn(0x7fdc100fd840 msgr2=0x7fdc100ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:23.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.709+0000 7fdc17520700 1 -- 172.21.15.80:0/1489616072 shutdown_connections 2024-04-26T18:26:23.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.709+0000 7fdc17520700 1 -- 172.21.15.80:0/1489616072 wait complete. 2024-04-26T18:26:23.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.710+0000 7fdc17520700 1 Processor -- start 2024-04-26T18:26:23.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.710+0000 7fdc17520700 1 -- start start 2024-04-26T18:26:23.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.710+0000 7fdc17520700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc10104070 0x7fdc1019e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:23.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.710+0000 7fdc17520700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1010d380 con 0x7fdc10104070 2024-04-26T18:26:23.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.710+0000 7fdc152bc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc10104070 0x7fdc1019e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:23.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.710+0000 7fdc152bc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc10104070 0x7fdc1019e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52414/0 (socket says 172.21.15.80:52414) 2024-04-26T18:26:23.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.710+0000 7fdc152bc700 1 -- 172.21.15.80:0/445797478 learned_addr learned my addr 172.21.15.80:0/445797478 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:26:23.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.711+0000 7fdc152bc700 1 -- 172.21.15.80:0/445797478 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc1019ebd0 con 0x7fdc10104070 2024-04-26T18:26:23.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.711+0000 7fdc152bc700 1 --2- 172.21.15.80:0/445797478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc10104070 0x7fdc1019e690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c006010 tx=0x7fdc0c005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:23.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.711+0000 7fdc067fc700 1 -- 172.21.15.80:0/445797478 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc0c026070 con 0x7fdc10104070 2024-04-26T18:26:23.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.711+0000 7fdc067fc700 1 -- 172.21.15.80:0/445797478 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc0c00bc00 con 0x7fdc10104070 2024-04-26T18:26:23.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.711+0000 7fdc067fc700 1 -- 172.21.15.80:0/445797478 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc0c003910 con 0x7fdc10104070 2024-04-26T18:26:23.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.711+0000 7fdc17520700 1 -- 172.21.15.80:0/445797478 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc1019ee60 con 0x7fdc10104070 2024-04-26T18:26:23.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.711+0000 7fdc17520700 1 -- 172.21.15.80:0/445797478 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc10198760 con 0x7fdc10104070 2024-04-26T18:26:23.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.712+0000 7fdc17520700 1 -- 172.21.15.80:0/445797478 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc1006bb30 con 0x7fdc10104070 2024-04-26T18:26:23.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.712+0000 7fdc067fc700 1 -- 172.21.15.80:0/445797478 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fdc0c029070 con 0x7fdc10104070 2024-04-26T18:26:23.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.712+0000 7fdc067fc700 1 --2- 172.21.15.80:0/445797478 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fdbfc0396b0 0x7fdbfc03bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:23.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.712+0000 7fdc067fc700 1 -- 172.21.15.80:0/445797478 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fdc0c01e070 con 0x7fdc10104070 2024-04-26T18:26:23.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.712+0000 7fdc14abb700 1 --2- 172.21.15.80:0/445797478 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fdbfc0396b0 0x7fdbfc03bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:23.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.712+0000 7fdc14abb700 1 --2- 172.21.15.80:0/445797478 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fdbfc0396b0 0x7fdbfc03bb70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdc00006fd0 tx=0x7fdc00006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:23.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.717+0000 7fdc067fc700 1 -- 172.21.15.80:0/445797478 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdc0c013070 con 0x7fdc10104070 2024-04-26T18:26:23.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.919+0000 7fdc17520700 1 -- 172.21.15.80:0/445797478 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdc10064a80 con 0x7fdbfc0396b0 2024-04-26T18:26:23.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.920+0000 7fdc067fc700 1 -- 172.21.15.80:0/445797478 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7fdc10064a80 con 0x7fdbfc0396b0 2024-04-26T18:26:23.920 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:26:23.920 INFO:teuthology.orchestra.run.smithi080.stdout:[{"addr": "172.21.15.80", "hostname": "smithi080", "labels": [], "status": ""}, {"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}, {"addr": "172.21.15.192", "hostname": "smithi192", "labels": [], "status": ""}] 2024-04-26T18:26:23.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.922+0000 7fdc17520700 1 -- 172.21.15.80:0/445797478 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fdbfc0396b0 msgr2=0x7fdbfc03bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:23.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.922+0000 7fdc17520700 1 --2- 172.21.15.80:0/445797478 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fdbfc0396b0 0x7fdbfc03bb70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdc00006fd0 tx=0x7fdc00006e40 comp rx=0 tx=0).stop 2024-04-26T18:26:23.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.922+0000 7fdc17520700 1 -- 172.21.15.80:0/445797478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc10104070 msgr2=0x7fdc1019e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:23.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.922+0000 7fdc17520700 1 --2- 172.21.15.80:0/445797478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc10104070 0x7fdc1019e690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c006010 tx=0x7fdc0c005780 comp rx=0 tx=0).stop 2024-04-26T18:26:23.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.922+0000 7fdc17520700 1 -- 172.21.15.80:0/445797478 shutdown_connections 2024-04-26T18:26:23.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.922+0000 7fdc17520700 1 --2- 172.21.15.80:0/445797478 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fdbfc0396b0 0x7fdbfc03bb70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:23.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.922+0000 7fdc17520700 1 --2- 172.21.15.80:0/445797478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc10104070 0x7fdc1019e690 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:23.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.922+0000 7fdc17520700 1 -- 172.21.15.80:0/445797478 >> 172.21.15.80:0/445797478 conn(0x7fdc100fd840 msgr2=0x7fdc10104e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:23.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.922+0000 7fdc17520700 1 -- 172.21.15.80:0/445797478 shutdown_connections 2024-04-26T18:26:23.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:23.922+0000 7fdc17520700 1 -- 172.21.15.80:0/445797478 wait complete. 2024-04-26T18:26:24.516 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-26T18:26:24.516 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd crush tunables default 2024-04-26T18:26:24.748 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:26:25.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:25 smithi080 ceph-mon[29135]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T18:26:25.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:25 smithi080 ceph-mon[29135]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:26.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.207+0000 7f91780f8700 1 -- 172.21.15.80:0/4244882040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9170101de0 msgr2=0x7f91701021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:26.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.207+0000 7f91780f8700 1 --2- 172.21.15.80:0/4244882040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9170101de0 0x7f91701021c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f916c009910 tx=0x7f916c009c20 comp rx=0 tx=0).stop 2024-04-26T18:26:26.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.207+0000 7f91780f8700 1 -- 172.21.15.80:0/4244882040 shutdown_connections 2024-04-26T18:26:26.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.207+0000 7f91780f8700 1 --2- 172.21.15.80:0/4244882040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9170101de0 0x7f91701021c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:26.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.207+0000 7f91780f8700 1 -- 172.21.15.80:0/4244882040 >> 172.21.15.80:0/4244882040 conn(0x7f91700fd820 msgr2=0x7f91700ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:26.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.207+0000 7f91780f8700 1 -- 172.21.15.80:0/4244882040 shutdown_connections 2024-04-26T18:26:26.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.207+0000 7f91780f8700 1 -- 172.21.15.80:0/4244882040 wait complete. 2024-04-26T18:26:26.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.207+0000 7f91780f8700 1 Processor -- start 2024-04-26T18:26:26.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.207+0000 7f91780f8700 1 -- start start 2024-04-26T18:26:26.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.208+0000 7f91780f8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9170101de0 0x7f917019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:26.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.208+0000 7f91780f8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9170113990 con 0x7f9170101de0 2024-04-26T18:26:26.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.208+0000 7f9175e94700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9170101de0 0x7f917019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:26.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.208+0000 7f9175e94700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9170101de0 0x7f917019ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52428/0 (socket says 172.21.15.80:52428) 2024-04-26T18:26:26.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.208+0000 7f9175e94700 1 -- 172.21.15.80:0/1288113618 learned_addr learned my addr 172.21.15.80:0/1288113618 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:26:26.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.208+0000 7f9175e94700 1 -- 172.21.15.80:0/1288113618 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f917019f440 con 0x7f9170101de0 2024-04-26T18:26:26.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.208+0000 7f9175e94700 1 --2- 172.21.15.80:0/1288113618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9170101de0 0x7f917019ef00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f916c0056d0 tx=0x7f916c0057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:26.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.208+0000 7f9166ffd700 1 -- 172.21.15.80:0/1288113618 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f916c026070 con 0x7f9170101de0 2024-04-26T18:26:26.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.208+0000 7f91780f8700 1 -- 172.21.15.80:0/1288113618 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f917019f6d0 con 0x7f9170101de0 2024-04-26T18:26:26.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.208+0000 7f9166ffd700 1 -- 172.21.15.80:0/1288113618 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f916c004370 con 0x7f9170101de0 2024-04-26T18:26:26.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.208+0000 7f9166ffd700 1 -- 172.21.15.80:0/1288113618 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f916c0039b0 con 0x7f9170101de0 2024-04-26T18:26:26.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.208+0000 7f91780f8700 1 -- 172.21.15.80:0/1288113618 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f917019fb30 con 0x7f9170101de0 2024-04-26T18:26:26.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.209+0000 7f9166ffd700 1 -- 172.21.15.80:0/1288113618 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f916c029070 con 0x7f9170101de0 2024-04-26T18:26:26.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.209+0000 7f91780f8700 1 -- 172.21.15.80:0/1288113618 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f917006bb70 con 0x7f9170101de0 2024-04-26T18:26:26.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.210+0000 7f9166ffd700 1 --2- 172.21.15.80:0/1288113618 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f915c039650 0x7f915c03bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:26.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.210+0000 7f9166ffd700 1 -- 172.21.15.80:0/1288113618 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f916c01e070 con 0x7f9170101de0 2024-04-26T18:26:26.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.210+0000 7f9175693700 1 --2- 172.21.15.80:0/1288113618 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f915c039650 0x7f915c03bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:26.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.210+0000 7f9175693700 1 --2- 172.21.15.80:0/1288113618 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f915c039650 0x7f915c03bb10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9160006fd0 tx=0x7f9160006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:26.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.214+0000 7f9166ffd700 1 -- 172.21.15.80:0/1288113618 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f916c013070 con 0x7f9170101de0 2024-04-26T18:26:26.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.415+0000 7f91780f8700 1 -- 172.21.15.80:0/1288113618 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f91701a0260 con 0x7f9170101de0 2024-04-26T18:26:26.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.476+0000 7f9166ffd700 1 -- 172.21.15.80:0/1288113618 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f916c00f980 con 0x7f9170101de0 2024-04-26T18:26:26.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.478+0000 7f91780f8700 1 -- 172.21.15.80:0/1288113618 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f915c039650 msgr2=0x7f915c03bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:26.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.478+0000 7f91780f8700 1 --2- 172.21.15.80:0/1288113618 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f915c039650 0x7f915c03bb10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9160006fd0 tx=0x7f9160006e40 comp rx=0 tx=0).stop 2024-04-26T18:26:26.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.478+0000 7f91780f8700 1 -- 172.21.15.80:0/1288113618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9170101de0 msgr2=0x7f917019ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:26.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.478+0000 7f91780f8700 1 --2- 172.21.15.80:0/1288113618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9170101de0 0x7f917019ef00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f916c0056d0 tx=0x7f916c0057b0 comp rx=0 tx=0).stop 2024-04-26T18:26:26.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.478+0000 7f91780f8700 1 -- 172.21.15.80:0/1288113618 shutdown_connections 2024-04-26T18:26:26.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.478+0000 7f91780f8700 1 --2- 172.21.15.80:0/1288113618 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f915c039650 0x7f915c03bb10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:26.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.478+0000 7f91780f8700 1 --2- 172.21.15.80:0/1288113618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9170101de0 0x7f917019ef00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:26.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.479+0000 7f91780f8700 1 -- 172.21.15.80:0/1288113618 >> 172.21.15.80:0/1288113618 conn(0x7f91700fd820 msgr2=0x7f91700ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:26.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.479+0000 7f91780f8700 1 -- 172.21.15.80:0/1288113618 shutdown_connections 2024-04-26T18:26:26.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:26.479+0000 7f91780f8700 1 -- 172.21.15.80:0/1288113618 wait complete. 2024-04-26T18:26:26.480 INFO:teuthology.orchestra.run.smithi080.stderr:adjusted tunables profile to default 2024-04-26T18:26:26.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:26 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1288113618' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-26T18:26:27.077 INFO:tasks.cephadm:Adding mon.a on smithi080 2024-04-26T18:26:27.078 INFO:tasks.cephadm:Adding mon.b on smithi082 2024-04-26T18:26:27.078 INFO:tasks.cephadm:Adding mon.c on smithi192 2024-04-26T18:26:27.078 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph orch apply mon '3;smithi080:172.21.15.80=a;smithi082:172.21.15.82=b;smithi192:172.21.15.192=c' 2024-04-26T18:26:27.310 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T18:26:27.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:27 smithi080 ceph-mon[29135]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:27.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:27 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1288113618' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-26T18:26:27.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:27 smithi080 ceph-mon[29135]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T18:26:27.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:27.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:27.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:27.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:27.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi192", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:27.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:27.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:26:28.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.826+0000 7f708923c700 1 -- 172.21.15.192:0/3150704116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7084103090 msgr2=0x7f7084103470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:28.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.826+0000 7f708923c700 1 --2- 172.21.15.192:0/3150704116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7084103090 0x7f7084103470 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7074009910 tx=0x7f7074009c20 comp rx=0 tx=0).stop 2024-04-26T18:26:28.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.826+0000 7f708923c700 1 -- 172.21.15.192:0/3150704116 shutdown_connections 2024-04-26T18:26:28.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.826+0000 7f708923c700 1 --2- 172.21.15.192:0/3150704116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7084103090 0x7f7084103470 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:28.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.826+0000 7f708923c700 1 -- 172.21.15.192:0/3150704116 >> 172.21.15.192:0/3150704116 conn(0x7f70840fe960 msgr2=0x7f7084100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:28.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.826+0000 7f708923c700 1 -- 172.21.15.192:0/3150704116 shutdown_connections 2024-04-26T18:26:28.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.826+0000 7f708923c700 1 -- 172.21.15.192:0/3150704116 wait complete. 2024-04-26T18:26:28.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.827+0000 7f708923c700 1 Processor -- start 2024-04-26T18:26:28.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.827+0000 7f708923c700 1 -- start start 2024-04-26T18:26:28.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.827+0000 7f708923c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7084103090 0x7f708419e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:28.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.827+0000 7f708923c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f708410d310 con 0x7f7084103090 2024-04-26T18:26:28.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.828+0000 7f7082d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7084103090 0x7f708419e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:28.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.828+0000 7f7082d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7084103090 0x7f708419e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.192:35512/0 (socket says 172.21.15.192:35512) 2024-04-26T18:26:28.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.828+0000 7f7082d9d700 1 -- 172.21.15.192:0/810283197 learned_addr learned my addr 172.21.15.192:0/810283197 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-04-26T18:26:28.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.828+0000 7f7082d9d700 1 -- 172.21.15.192:0/810283197 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f708419eb10 con 0x7f7084103090 2024-04-26T18:26:28.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.828+0000 7f7082d9d700 1 --2- 172.21.15.192:0/810283197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7084103090 0x7f708419e5d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f70740056d0 tx=0x7f70740057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:28.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.828+0000 7f7080d99700 1 -- 172.21.15.192:0/810283197 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7074026070 con 0x7f7084103090 2024-04-26T18:26:28.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.828+0000 7f708923c700 1 -- 172.21.15.192:0/810283197 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f708419ee00 con 0x7f7084103090 2024-04-26T18:26:28.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.828+0000 7f7080d99700 1 -- 172.21.15.192:0/810283197 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f707400bba0 con 0x7f7084103090 2024-04-26T18:26:28.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.828+0000 7f7080d99700 1 -- 172.21.15.192:0/810283197 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7074003920 con 0x7f7084103090 2024-04-26T18:26:28.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.829+0000 7f708923c700 1 -- 172.21.15.192:0/810283197 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7084198870 con 0x7f7084103090 2024-04-26T18:26:28.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.829+0000 7f708923c700 1 -- 172.21.15.192:0/810283197 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7084104570 con 0x7f7084103090 2024-04-26T18:26:28.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.829+0000 7f7080d99700 1 -- 172.21.15.192:0/810283197 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f7074029070 con 0x7f7084103090 2024-04-26T18:26:28.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.830+0000 7f7080d99700 1 --2- 172.21.15.192:0/810283197 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f7070039650 0x7f707003bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:28.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.830+0000 7f7080d99700 1 -- 172.21.15.192:0/810283197 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f707401e070 con 0x7f7084103090 2024-04-26T18:26:28.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.830+0000 7f707a59c700 1 --2- 172.21.15.192:0/810283197 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f7070039650 0x7f707003bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:28.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.830+0000 7f707a59c700 1 --2- 172.21.15.192:0/810283197 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f7070039650 0x7f707003bb10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f706c006fd0 tx=0x7f706c006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:28.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:28.835+0000 7f7080d99700 1 -- 172.21.15.192:0/810283197 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7074013070 con 0x7f7084103090 2024-04-26T18:26:28.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:28 smithi080 ceph-mon[29135]: Updating smithi192:/etc/ceph/ceph.conf 2024-04-26T18:26:28.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:28 smithi080 ceph-mon[29135]: Updating smithi192:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T18:26:28.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:28 smithi080 ceph-mon[29135]: Updating smithi192:/etc/ceph/ceph.client.admin.keyring 2024-04-26T18:26:28.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:28 smithi080 ceph-mon[29135]: Updating smithi192:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T18:26:28.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:28 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:28.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:28 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:28.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:28 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:29.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:29.041+0000 7f708923c700 1 -- 172.21.15.192:0/810283197 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi080:172.21.15.80=a;smithi082:172.21.15.82=b;smithi192:172.21.15.192=c", "target": ["mon-mgr", ""]}) -- 0x7f70840008d0 con 0x7f7070039650 2024-04-26T18:26:29.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:29.048+0000 7f7080d99700 1 -- 172.21.15.192:0/810283197 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f70840008d0 con 0x7f7070039650 2024-04-26T18:26:29.048 INFO:teuthology.orchestra.run.smithi192.stdout:Scheduled mon update... 2024-04-26T18:26:29.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:29.050+0000 7f708923c700 1 -- 172.21.15.192:0/810283197 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f7070039650 msgr2=0x7f707003bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:29.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:29.050+0000 7f708923c700 1 --2- 172.21.15.192:0/810283197 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f7070039650 0x7f707003bb10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f706c006fd0 tx=0x7f706c006e40 comp rx=0 tx=0).stop 2024-04-26T18:26:29.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:29.050+0000 7f708923c700 1 -- 172.21.15.192:0/810283197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7084103090 msgr2=0x7f708419e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:29.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:29.050+0000 7f708923c700 1 --2- 172.21.15.192:0/810283197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7084103090 0x7f708419e5d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f70740056d0 tx=0x7f70740057b0 comp rx=0 tx=0).stop 2024-04-26T18:26:29.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:29.050+0000 7f708923c700 1 -- 172.21.15.192:0/810283197 shutdown_connections 2024-04-26T18:26:29.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:29.050+0000 7f708923c700 1 --2- 172.21.15.192:0/810283197 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f7070039650 0x7f707003bb10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:29.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:29.050+0000 7f708923c700 1 --2- 172.21.15.192:0/810283197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7084103090 0x7f708419e5d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:29.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:29.050+0000 7f708923c700 1 -- 172.21.15.192:0/810283197 >> 172.21.15.192:0/810283197 conn(0x7f70840fe960 msgr2=0x7f7084104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:29.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:29.050+0000 7f708923c700 1 -- 172.21.15.192:0/810283197 shutdown_connections 2024-04-26T18:26:29.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:29.050+0000 7f708923c700 1 -- 172.21.15.192:0/810283197 wait complete. 2024-04-26T18:26:29.677 DEBUG:teuthology.orchestra.run.smithi082:mon.b> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mon.b.service 2024-04-26T18:26:29.680 DEBUG:teuthology.orchestra.run.smithi192:mon.c> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mon.c.service 2024-04-26T18:26:29.682 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-26T18:26:29.683 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T18:26:29.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:29 smithi080 ceph-mon[29135]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:29.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:29 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:29.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:29 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:26:29.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:29 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:29.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:29 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:26:29.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:29 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:29.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:29 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T18:26:29.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:29 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:30.451 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T18:26:30.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:30 smithi080 ceph-mon[29135]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi080:172.21.15.80=a;smithi082:172.21.15.82=b;smithi192:172.21.15.192=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:26:30.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:30 smithi080 ceph-mon[29135]: Saving service mon spec with placement smithi080:172.21.15.80=a;smithi082:172.21.15.82=b;smithi192:172.21.15.192=c;count:3 2024-04-26T18:26:30.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:30 smithi080 ceph-mon[29135]: Deploying daemon mon.c on smithi192 2024-04-26T18:26:31.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:31 smithi080 ceph-mon[29135]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:33.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.568+0000 7f8be390b700 1 -- 172.21.15.192:0/3697404671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bdc104030 msgr2=0x7f8bdc104410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:33.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.568+0000 7f8be390b700 1 --2- 172.21.15.192:0/3697404671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bdc104030 0x7f8bdc104410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8009910 tx=0x7f8bd8009c20 comp rx=0 tx=0).stop 2024-04-26T18:26:33.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.568+0000 7f8be390b700 1 -- 172.21.15.192:0/3697404671 shutdown_connections 2024-04-26T18:26:33.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.568+0000 7f8be390b700 1 --2- 172.21.15.192:0/3697404671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bdc104030 0x7f8bdc104410 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:33.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.568+0000 7f8be390b700 1 -- 172.21.15.192:0/3697404671 >> 172.21.15.192:0/3697404671 conn(0x7f8bdc0fd820 msgr2=0x7f8bdc0ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:33.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.568+0000 7f8be390b700 1 -- 172.21.15.192:0/3697404671 shutdown_connections 2024-04-26T18:26:33.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.568+0000 7f8be390b700 1 -- 172.21.15.192:0/3697404671 wait complete. 2024-04-26T18:26:33.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.568+0000 7f8be390b700 1 Processor -- start 2024-04-26T18:26:33.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.568+0000 7f8be390b700 1 -- start start 2024-04-26T18:26:33.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.569+0000 7f8be390b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bdc104030 0x7f8bdc19e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:33.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.569+0000 7f8be390b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc10d360 con 0x7f8bdc104030 2024-04-26T18:26:33.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.569+0000 7f8be16a7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bdc104030 0x7f8bdc19e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:33.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.569+0000 7f8be16a7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bdc104030 0x7f8bdc19e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.192:34664/0 (socket says 172.21.15.192:34664) 2024-04-26T18:26:33.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.569+0000 7f8be16a7700 1 -- 172.21.15.192:0/3541440984 learned_addr learned my addr 172.21.15.192:0/3541440984 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-04-26T18:26:33.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.569+0000 7f8be16a7700 1 -- 172.21.15.192:0/3541440984 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bdc19eb70 con 0x7f8bdc104030 2024-04-26T18:26:33.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.569+0000 7f8be16a7700 1 --2- 172.21.15.192:0/3541440984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bdc104030 0x7f8bdc19e630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80056d0 tx=0x7f8bd80057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:33.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.569+0000 7f8bd27fc700 1 -- 172.21.15.192:0/3541440984 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bd8026070 con 0x7f8bdc104030 2024-04-26T18:26:33.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.569+0000 7f8be390b700 1 -- 172.21.15.192:0/3541440984 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bdc19ee00 con 0x7f8bdc104030 2024-04-26T18:26:33.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.570+0000 7f8bd27fc700 1 -- 172.21.15.192:0/3541440984 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bd8004370 con 0x7f8bdc104030 2024-04-26T18:26:33.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.570+0000 7f8bd27fc700 1 -- 172.21.15.192:0/3541440984 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bd80039b0 con 0x7f8bdc104030 2024-04-26T18:26:33.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.570+0000 7f8be390b700 1 -- 172.21.15.192:0/3541440984 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bdc198700 con 0x7f8bdc104030 2024-04-26T18:26:33.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.570+0000 7f8bd27fc700 1 -- 172.21.15.192:0/3541440984 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f8bd8029070 con 0x7f8bdc104030 2024-04-26T18:26:33.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.571+0000 7f8bd27fc700 1 --2- 172.21.15.192:0/3541440984 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8bc8039650 0x7f8bc803bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:33.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.571+0000 7f8be390b700 1 -- 172.21.15.192:0/3541440984 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bdc06b950 con 0x7f8bdc104030 2024-04-26T18:26:33.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.571+0000 7f8bd27fc700 1 -- 172.21.15.192:0/3541440984 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8bd801e070 con 0x7f8bdc104030 2024-04-26T18:26:33.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.571+0000 7f8be0ea6700 1 --2- 172.21.15.192:0/3541440984 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8bc8039650 0x7f8bc803bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:33.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.571+0000 7f8be0ea6700 1 --2- 172.21.15.192:0/3541440984 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8bc8039650 0x7f8bc803bb10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc006fd0 tx=0x7f8bcc006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:33.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.576+0000 7f8bd27fc700 1 -- 172.21.15.192:0/3541440984 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8bd8030020 con 0x7f8bdc104030 2024-04-26T18:26:33.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.868+0000 7f8be390b700 1 -- 172.21.15.192:0/3541440984 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f8bdc199c30 con 0x7f8bdc104030 2024-04-26T18:26:33.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.869+0000 7f8bd27fc700 1 -- 172.21.15.192:0/3541440984 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f8bd8013070 con 0x7f8bdc104030 2024-04-26T18:26:33.870 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T18:26:33.870 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"2187ca98-03fa-11ef-bc93-c7b262605968","modified":"2024-04-26T18:24:55.824625Z","created":"2024-04-26T18:24:55.824625Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:3300","nonce":0},{"type":"v1","addr":"172.21.15.80:6789","nonce":0}]},"addr":"172.21.15.80:6789/0","public_addr":"172.21.15.80:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T18:26:33.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.871+0000 7f8be390b700 1 -- 172.21.15.192:0/3541440984 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8bc8039650 msgr2=0x7f8bc803bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:33.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.871+0000 7f8be390b700 1 --2- 172.21.15.192:0/3541440984 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8bc8039650 0x7f8bc803bb10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc006fd0 tx=0x7f8bcc006e40 comp rx=0 tx=0).stop 2024-04-26T18:26:33.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.871+0000 7f8be390b700 1 -- 172.21.15.192:0/3541440984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bdc104030 msgr2=0x7f8bdc19e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:33.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.871+0000 7f8be390b700 1 --2- 172.21.15.192:0/3541440984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bdc104030 0x7f8bdc19e630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80056d0 tx=0x7f8bd80057b0 comp rx=0 tx=0).stop 2024-04-26T18:26:33.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.871+0000 7f8be390b700 1 -- 172.21.15.192:0/3541440984 shutdown_connections 2024-04-26T18:26:33.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.871+0000 7f8be390b700 1 --2- 172.21.15.192:0/3541440984 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8bc8039650 0x7f8bc803bb10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:33.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.871+0000 7f8be390b700 1 --2- 172.21.15.192:0/3541440984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bdc104030 0x7f8bdc19e630 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:33.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.871+0000 7f8be390b700 1 -- 172.21.15.192:0/3541440984 >> 172.21.15.192:0/3541440984 conn(0x7f8bdc0fd820 msgr2=0x7f8bdc104de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:33.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.871+0000 7f8be390b700 1 -- 172.21.15.192:0/3541440984 shutdown_connections 2024-04-26T18:26:33.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:33.871+0000 7f8be390b700 1 -- 172.21.15.192:0/3541440984 wait complete. 2024-04-26T18:26:33.872 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-04-26T18:26:33.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:33 smithi080 ceph-mon[29135]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:35.661 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-26T18:26:35.662 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T18:26:35.906 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T18:26:39.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:39 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:39.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T18:26:39.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T18:26:39.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: mon.a calling monitor election 2024-04-26T18:26:39.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:39.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T18:26:39.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T18:26:39.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: mon.c calling monitor election 2024-04-26T18:26:39.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:39.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T18:26:39.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T18:26:39.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:39.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T18:26:39.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T18:26:39.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: monmap epoch 2 2024-04-26T18:26:39.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: fsid 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:26:39.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: last_changed 2024-04-26T18:26:34.206442+0000 2024-04-26T18:26:39.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: created 2024-04-26T18:24:55.824625+0000 2024-04-26T18:26:39.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: min_mon_release 19 (squid) 2024-04-26T18:26:39.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: election_strategy: 1 2024-04-26T18:26:39.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: 0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-04-26T18:26:39.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-04-26T18:26:39.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: fsmap 2024-04-26T18:26:39.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T18:26:39.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: mgrmap e13: x(active, since 48s) 2024-04-26T18:26:39.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: overall HEALTH_OK 2024-04-26T18:26:39.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:39.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:39.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:39.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T18:26:39.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:40.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.479+0000 7f4e3542e700 1 -- 172.21.15.192:0/3290291219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1c0035c0 msgr2=0x7f4e1c005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:40.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.479+0000 7f4e3542e700 1 --2- 172.21.15.192:0/3290291219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1c0035c0 0x7f4e1c005a50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4e30102e70 tx=0x7f4e2000feb0 comp rx=0 tx=0).stop 2024-04-26T18:26:40.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.479+0000 7f4e3542e700 1 -- 172.21.15.192:0/3290291219 shutdown_connections 2024-04-26T18:26:40.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.479+0000 7f4e3542e700 1 --2- 172.21.15.192:0/3290291219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1c0035c0 0x7f4e1c005a50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:40.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.479+0000 7f4e3542e700 1 -- 172.21.15.192:0/3290291219 >> 172.21.15.192:0/3290291219 conn(0x7f4e300fea30 msgr2=0x7f4e30100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:40.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.479+0000 7f4e3542e700 1 -- 172.21.15.192:0/3290291219 shutdown_connections 2024-04-26T18:26:40.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.479+0000 7f4e3542e700 1 -- 172.21.15.192:0/3290291219 wait complete. 2024-04-26T18:26:40.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.480+0000 7f4e3542e700 1 Processor -- start 2024-04-26T18:26:40.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.480+0000 7f4e3542e700 1 -- start start 2024-04-26T18:26:40.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.481+0000 7f4e3542e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e1c0035c0 0x7f4e3019efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:40.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.481+0000 7f4e3542e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e3019f500 0x7f4e301a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:40.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.481+0000 7f4e3542e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3010ae90 con 0x7f4e3019f500 2024-04-26T18:26:40.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.481+0000 7f4e3542e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3010ad10 con 0x7f4e1c0035c0 2024-04-26T18:26:40.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.481+0000 7f4e2effd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e1c0035c0 0x7f4e3019efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:40.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.481+0000 7f4e2effd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e1c0035c0 0x7f4e3019efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36344/0 (socket says 172.21.15.192:36344) 2024-04-26T18:26:40.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.481+0000 7f4e2effd700 1 -- 172.21.15.192:0/722252634 learned_addr learned my addr 172.21.15.192:0/722252634 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-04-26T18:26:40.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.481+0000 7f4e267fc700 1 --2- 172.21.15.192:0/722252634 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e3019f500 0x7f4e301a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:40.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.481+0000 7f4e2effd700 1 -- 172.21.15.192:0/722252634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e1c0035c0 msgr2=0x7f4e3019efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-26T18:26:40.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.481+0000 7f4e2effd700 1 -- 172.21.15.192:0/722252634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e1c0035c0 msgr2=0x7f4e3019efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T18:26:40.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.481+0000 7f4e2effd700 1 --2- 172.21.15.192:0/722252634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e1c0035c0 0x7f4e3019efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T18:26:40.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.481+0000 7f4e2effd700 1 --2- 172.21.15.192:0/722252634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e1c0035c0 0x7f4e3019efc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T18:26:40.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.481+0000 7f4e267fc700 1 -- 172.21.15.192:0/722252634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e1c0035c0 msgr2=0x7f4e3019efc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T18:26:40.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.481+0000 7f4e267fc700 1 --2- 172.21.15.192:0/722252634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e1c0035c0 0x7f4e3019efc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:40.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.481+0000 7f4e267fc700 1 -- 172.21.15.192:0/722252634 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e3019fb40 con 0x7f4e3019f500 2024-04-26T18:26:40.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.482+0000 7f4e267fc700 1 --2- 172.21.15.192:0/722252634 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e3019f500 0x7f4e301a3890 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800b4d0 tx=0x7f4e1800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:40.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.482+0000 7f4e2cff9700 1 -- 172.21.15.192:0/722252634 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f4e18011630 con 0x7f4e3019f500 2024-04-26T18:26:40.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.482+0000 7f4e2cff9700 1 -- 172.21.15.192:0/722252634 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e18011c80 con 0x7f4e3019f500 2024-04-26T18:26:40.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.482+0000 7f4e3542e700 1 -- 172.21.15.192:0/722252634 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e301a3dd0 con 0x7f4e3019f500 2024-04-26T18:26:40.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.482+0000 7f4e2cff9700 1 -- 172.21.15.192:0/722252634 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f4e18010da0 con 0x7f4e3019f500 2024-04-26T18:26:40.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.482+0000 7f4e3542e700 1 -- 172.21.15.192:0/722252634 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e301a4330 con 0x7f4e3019f500 2024-04-26T18:26:40.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.483+0000 7f4e2cff9700 1 -- 172.21.15.192:0/722252634 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f4e18018020 con 0x7f4e3019f500 2024-04-26T18:26:40.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.483+0000 7f4e2cff9700 1 --2- 172.21.15.192:0/722252634 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f4e100393f0 0x7f4e1003b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:40.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.483+0000 7f4e2cff9700 1 -- 172.21.15.192:0/722252634 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4e1804d130 con 0x7f4e3019f500 2024-04-26T18:26:40.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.483+0000 7f4e2effd700 1 --2- 172.21.15.192:0/722252634 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f4e100393f0 0x7f4e1003b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:40.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.483+0000 7f4e3542e700 1 -- 172.21.15.192:0/722252634 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e30104680 con 0x7f4e3019f500 2024-04-26T18:26:40.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.484+0000 7f4e2effd700 1 --2- 172.21.15.192:0/722252634 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f4e100393f0 0x7f4e1003b8b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000fa60 tx=0x7f4e20005960 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:40.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.489+0000 7f4e2cff9700 1 -- 172.21.15.192:0/722252634 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4e1801f020 con 0x7f4e3019f500 2024-04-26T18:26:40.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:40 smithi192 ceph-mon[32842]: Deploying daemon mon.b on smithi082 2024-04-26T18:26:40.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:40 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T18:26:40.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:40 smithi080 ceph-mon[29135]: Deploying daemon mon.b on smithi082 2024-04-26T18:26:40.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:40 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T18:26:40.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.772+0000 7f4e3542e700 1 -- 172.21.15.192:0/722252634 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f4e30064a80 con 0x7f4e3019f500 2024-04-26T18:26:40.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.773+0000 7f4e2cff9700 1 -- 172.21.15.192:0/722252634 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f4e18010410 con 0x7f4e3019f500 2024-04-26T18:26:40.773 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T18:26:40.773 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":2,"fsid":"2187ca98-03fa-11ef-bc93-c7b262605968","modified":"2024-04-26T18:26:34.206442Z","created":"2024-04-26T18:24:55.824625Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:3300","nonce":0},{"type":"v1","addr":"172.21.15.80:6789","nonce":0}]},"addr":"172.21.15.80:6789/0","public_addr":"172.21.15.80:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:3300","nonce":0},{"type":"v1","addr":"172.21.15.192:6789","nonce":0}]},"addr":"172.21.15.192:6789/0","public_addr":"172.21.15.192:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-26T18:26:40.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.775+0000 7f4e3542e700 1 -- 172.21.15.192:0/722252634 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f4e100393f0 msgr2=0x7f4e1003b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:40.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.775+0000 7f4e3542e700 1 --2- 172.21.15.192:0/722252634 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f4e100393f0 0x7f4e1003b8b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000fa60 tx=0x7f4e20005960 comp rx=0 tx=0).stop 2024-04-26T18:26:40.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.775+0000 7f4e3542e700 1 -- 172.21.15.192:0/722252634 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e3019f500 msgr2=0x7f4e301a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:40.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.775+0000 7f4e3542e700 1 --2- 172.21.15.192:0/722252634 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e3019f500 0x7f4e301a3890 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800b4d0 tx=0x7f4e1800b890 comp rx=0 tx=0).stop 2024-04-26T18:26:40.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.775+0000 7f4e3542e700 1 -- 172.21.15.192:0/722252634 shutdown_connections 2024-04-26T18:26:40.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.775+0000 7f4e3542e700 1 --2- 172.21.15.192:0/722252634 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f4e100393f0 0x7f4e1003b8b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:40.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.775+0000 7f4e3542e700 1 --2- 172.21.15.192:0/722252634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e1c0035c0 0x7f4e3019efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:40.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.775+0000 7f4e3542e700 1 --2- 172.21.15.192:0/722252634 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e3019f500 0x7f4e301a3890 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:40.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.775+0000 7f4e3542e700 1 -- 172.21.15.192:0/722252634 >> 172.21.15.192:0/722252634 conn(0x7f4e300fea30 msgr2=0x7f4e300ffd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:40.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.775+0000 7f4e3542e700 1 -- 172.21.15.192:0/722252634 shutdown_connections 2024-04-26T18:26:40.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:40.775+0000 7f4e3542e700 1 -- 172.21.15.192:0/722252634 wait complete. 2024-04-26T18:26:40.777 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 2 2024-04-26T18:26:41.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:41 smithi192 ceph-mon[32842]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:41.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:41 smithi192 ceph-mon[32842]: from='client.? 172.21.15.192:0/722252634' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T18:26:41.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:41 smithi080 ceph-mon[29135]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:41.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:41 smithi080 ceph-mon[29135]: from='client.? 172.21.15.192:0/722252634' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T18:26:42.366 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-26T18:26:42.366 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T18:26:42.629 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T18:26:43.411 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:43 smithi082 ceph-mon[32808]: created 2024-04-26T18:24:55.824625+0000 2024-04-26T18:26:43.411 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:43 smithi082 ceph-mon[32808]: min_mon_release 19 (squid) 2024-04-26T18:26:43.411 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:43 smithi082 ceph-mon[32808]: election_strategy: 1 2024-04-26T18:26:43.412 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:43 smithi082 ceph-mon[32808]: 0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-04-26T18:26:43.412 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:43 smithi082 ceph-mon[32808]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-04-26T18:26:43.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:43 smithi082 ceph-mon[32808]: fsmap 2024-04-26T18:26:43.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:43 smithi082 ceph-mon[32808]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T18:26:43.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:43 smithi082 ceph-mon[32808]: mgrmap e13: x(active, since 48s) 2024-04-26T18:26:43.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:43 smithi082 ceph-mon[32808]: overall HEALTH_OK 2024-04-26T18:26:43.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:43 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:43.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:43 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:43.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:43 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:43.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:43 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T18:26:43.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:43 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:43.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:43 smithi082 ceph-mon[32808]: Deploying daemon mon.b on smithi082 2024-04-26T18:26:43.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:43 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T18:26:43.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:43 smithi082 ceph-mon[32808]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:43.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:43 smithi082 ceph-mon[32808]: from='client.? 172.21.15.192:0/722252634' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T18:26:43.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:43 smithi082 ceph-mon[32808]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-26T18:26:43.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:43 smithi082 bash[32789]: a31eaa4ff132c70812714a7ab30862fc88e6c09c13b14640ae0dadc3e1a7d49c 2024-04-26T18:26:43.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:43 smithi082 systemd[1]: Started Ceph mon.b for 2187ca98-03fa-11ef-bc93-c7b262605968. 2024-04-26T18:26:48.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.510+0000 7f1b913b9700 1 -- 172.21.15.192:0/3457187720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b780035c0 msgr2=0x7f1b78005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:48.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.510+0000 7f1b913b9700 1 --2- 172.21.15.192:0/3457187720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b780035c0 0x7f1b78005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c06b710 tx=0x7f1b7c00fe60 comp rx=0 tx=0).stop 2024-04-26T18:26:48.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.510+0000 7f1b913b9700 1 -- 172.21.15.192:0/3457187720 shutdown_connections 2024-04-26T18:26:48.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.510+0000 7f1b913b9700 1 --2- 172.21.15.192:0/3457187720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b780035c0 0x7f1b78005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:48.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.510+0000 7f1b913b9700 1 -- 172.21.15.192:0/3457187720 >> 172.21.15.192:0/3457187720 conn(0x7f1b8c0fd8d0 msgr2=0x7f1b8c0ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:48.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.510+0000 7f1b913b9700 1 -- 172.21.15.192:0/3457187720 shutdown_connections 2024-04-26T18:26:48.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.510+0000 7f1b913b9700 1 -- 172.21.15.192:0/3457187720 wait complete. 2024-04-26T18:26:48.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.511+0000 7f1b913b9700 1 Processor -- start 2024-04-26T18:26:48.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.512+0000 7f1b913b9700 1 -- start start 2024-04-26T18:26:48.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.512+0000 7f1b913b9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b780035c0 0x7f1b8c19e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:48.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.512+0000 7f1b913b9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b8c19ed20 0x7f1b8c1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:48.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.512+0000 7f1b913b9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b8c198ee0 0x7f1b8c199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.512+0000 7f1b913b9700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c10ae00 con 0x7f1b8c19ed20 2024-04-26T18:26:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.512+0000 7f1b913b9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c10ac80 con 0x7f1b8c198ee0 2024-04-26T18:26:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.512+0000 7f1b913b9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c10af80 con 0x7f1b780035c0 2024-04-26T18:26:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.512+0000 7f1b8affd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b780035c0 0x7f1b8c19e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.512+0000 7f1b8affd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b780035c0 0x7f1b8c19e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40028/0 (socket says 172.21.15.192:40028) 2024-04-26T18:26:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.512+0000 7f1b8affd700 1 -- 172.21.15.192:0/1032591334 learned_addr learned my addr 172.21.15.192:0/1032591334 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-04-26T18:26:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.512+0000 7f1b827fc700 1 --2- 172.21.15.192:0/1032591334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b8c19ed20 0x7f1b8c1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.512+0000 7f1b8affd700 1 -- 172.21.15.192:0/1032591334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b780035c0 msgr2=0x7f1b8c19e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-26T18:26:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.512+0000 7f1b8affd700 1 -- 172.21.15.192:0/1032591334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b780035c0 msgr2=0x7f1b8c19e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T18:26:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.512+0000 7f1b8affd700 1 --2- 172.21.15.192:0/1032591334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b780035c0 0x7f1b8c19e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T18:26:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.512+0000 7f1b8b7fe700 1 --2- 172.21.15.192:0/1032591334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b8c198ee0 0x7f1b8c199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.512+0000 7f1b8affd700 1 --2- 172.21.15.192:0/1032591334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b780035c0 0x7f1b8c19e7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T18:26:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.512+0000 7f1b8b7fe700 1 -- 172.21.15.192:0/1032591334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b8c198ee0 msgr2=0x7f1b8c199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-04-26T18:26:48.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.512+0000 7f1b8b7fe700 1 -- 172.21.15.192:0/1032591334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b8c198ee0 msgr2=0x7f1b8c199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T18:26:48.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.512+0000 7f1b8b7fe700 1 --2- 172.21.15.192:0/1032591334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b8c198ee0 0x7f1b8c199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T18:26:48.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.512+0000 7f1b8b7fe700 1 --2- 172.21.15.192:0/1032591334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b8c198ee0 0x7f1b8c199390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T18:26:48.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.513+0000 7f1b827fc700 1 -- 172.21.15.192:0/1032591334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b780035c0 msgr2=0x7f1b8c19e7e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T18:26:48.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.513+0000 7f1b827fc700 1 --2- 172.21.15.192:0/1032591334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b780035c0 0x7f1b8c19e7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:48.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.513+0000 7f1b827fc700 1 -- 172.21.15.192:0/1032591334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b8c198ee0 msgr2=0x7f1b8c199390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T18:26:48.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.513+0000 7f1b827fc700 1 --2- 172.21.15.192:0/1032591334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b8c198ee0 0x7f1b8c199390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:48.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.513+0000 7f1b827fc700 1 -- 172.21.15.192:0/1032591334 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b8c1a56b0 con 0x7f1b8c19ed20 2024-04-26T18:26:48.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.513+0000 7f1b827fc700 1 --2- 172.21.15.192:0/1032591334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b8c19ed20 0x7f1b8c1989a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400b550 tx=0x7f1b7400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:48.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.513+0000 7f1b88ff9700 1 -- 172.21.15.192:0/1032591334 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b74004230 con 0x7f1b8c19ed20 2024-04-26T18:26:48.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.513+0000 7f1b88ff9700 1 -- 172.21.15.192:0/1032591334 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b740043d0 con 0x7f1b8c19ed20 2024-04-26T18:26:48.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.513+0000 7f1b913b9700 1 -- 172.21.15.192:0/1032591334 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b8c1a58e0 con 0x7f1b8c19ed20 2024-04-26T18:26:48.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.513+0000 7f1b88ff9700 1 -- 172.21.15.192:0/1032591334 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b74011b90 con 0x7f1b8c19ed20 2024-04-26T18:26:48.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.513+0000 7f1b913b9700 1 -- 172.21.15.192:0/1032591334 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b8c1a5e70 con 0x7f1b8c19ed20 2024-04-26T18:26:48.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.514+0000 7f1b88ff9700 1 -- 172.21.15.192:0/1032591334 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f1b7401a400 con 0x7f1b8c19ed20 2024-04-26T18:26:48.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.514+0000 7f1b913b9700 1 -- 172.21.15.192:0/1032591334 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b8c064a80 con 0x7f1b8c19ed20 2024-04-26T18:26:48.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.514+0000 7f1b88ff9700 1 --2- 172.21.15.192:0/1032591334 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f1b6c039ae0 0x7f1b6c03bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:48.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.514+0000 7f1b88ff9700 1 -- 172.21.15.192:0/1032591334 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1b7404c450 con 0x7f1b8c19ed20 2024-04-26T18:26:48.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.515+0000 7f1b8affd700 1 --2- 172.21.15.192:0/1032591334 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f1b6c039ae0 0x7f1b6c03bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:48.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.515+0000 7f1b8affd700 1 --2- 172.21.15.192:0/1032591334 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f1b6c039ae0 0x7f1b6c03bfa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00fa10 tx=0x7f1b7c005a90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:48.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.520+0000 7f1b88ff9700 1 -- 172.21.15.192:0/1032591334 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1b740151c0 con 0x7f1b8c19ed20 2024-04-26T18:26:48.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T18:26:48.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: mon.a calling monitor election 2024-04-26T18:26:48.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: mon.c calling monitor election 2024-04-26T18:26:48.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:26:48.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T18:26:48.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:26:48.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:48.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:26:48.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:26:48.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:48.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:26:48.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:26:48.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T18:26:48.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: monmap epoch 3 2024-04-26T18:26:48.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: fsid 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:26:48.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: last_changed 2024-04-26T18:26:43.415397+0000 2024-04-26T18:26:48.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: created 2024-04-26T18:24:55.824625+0000 2024-04-26T18:26:48.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: min_mon_release 19 (squid) 2024-04-26T18:26:48.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: election_strategy: 1 2024-04-26T18:26:48.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: 0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-04-26T18:26:48.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-04-26T18:26:48.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: 2: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-04-26T18:26:48.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: fsmap 2024-04-26T18:26:48.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T18:26:48.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: mgrmap e13: x(active, since 58s) 2024-04-26T18:26:48.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: overall HEALTH_OK 2024-04-26T18:26:48.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:48.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:48.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:48.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:48 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:48.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.812+0000 7f1b913b9700 1 -- 172.21.15.192:0/1032591334 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f1b8c1a6160 con 0x7f1b8c19ed20 2024-04-26T18:26:48.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.812+0000 7f1b88ff9700 1 -- 172.21.15.192:0/1032591334 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1279 (secure 0 0 0) 0x7f1b7401a840 con 0x7f1b8c19ed20 2024-04-26T18:26:48.812 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T18:26:48.813 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":3,"fsid":"2187ca98-03fa-11ef-bc93-c7b262605968","modified":"2024-04-26T18:26:43.415397Z","created":"2024-04-26T18:24:55.824625Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:3300","nonce":0},{"type":"v1","addr":"172.21.15.80:6789","nonce":0}]},"addr":"172.21.15.80:6789/0","public_addr":"172.21.15.80:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:3300","nonce":0},{"type":"v1","addr":"172.21.15.192:6789","nonce":0}]},"addr":"172.21.15.192:6789/0","public_addr":"172.21.15.192:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-26T18:26:48.813 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T18:26:48.813 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: mon.a calling monitor election 2024-04-26T18:26:48.813 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: mon.c calling monitor election 2024-04-26T18:26:48.813 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:26:48.813 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T18:26:48.813 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:26:48.813 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:48.813 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:26:48.813 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:26:48.814 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:48.814 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:26:48.814 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:26:48.814 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T18:26:48.814 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: monmap epoch 3 2024-04-26T18:26:48.814 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: fsid 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:26:48.814 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: last_changed 2024-04-26T18:26:43.415397+0000 2024-04-26T18:26:48.814 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: created 2024-04-26T18:24:55.824625+0000 2024-04-26T18:26:48.814 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: min_mon_release 19 (squid) 2024-04-26T18:26:48.814 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: election_strategy: 1 2024-04-26T18:26:48.814 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: 0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-04-26T18:26:48.814 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-04-26T18:26:48.814 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: 2: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-04-26T18:26:48.815 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: fsmap 2024-04-26T18:26:48.815 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T18:26:48.815 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: mgrmap e13: x(active, since 58s) 2024-04-26T18:26:48.815 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: overall HEALTH_OK 2024-04-26T18:26:48.815 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:48.815 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:48.815 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:48.815 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:48 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:48.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.815+0000 7f1b913b9700 1 -- 172.21.15.192:0/1032591334 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f1b6c039ae0 msgr2=0x7f1b6c03bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:48.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.815+0000 7f1b913b9700 1 --2- 172.21.15.192:0/1032591334 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f1b6c039ae0 0x7f1b6c03bfa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00fa10 tx=0x7f1b7c005a90 comp rx=0 tx=0).stop 2024-04-26T18:26:48.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.815+0000 7f1b913b9700 1 -- 172.21.15.192:0/1032591334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b8c19ed20 msgr2=0x7f1b8c1989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:48.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.815+0000 7f1b913b9700 1 --2- 172.21.15.192:0/1032591334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b8c19ed20 0x7f1b8c1989a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400b550 tx=0x7f1b7400b910 comp rx=0 tx=0).stop 2024-04-26T18:26:48.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.815+0000 7f1b913b9700 1 -- 172.21.15.192:0/1032591334 shutdown_connections 2024-04-26T18:26:48.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.815+0000 7f1b913b9700 1 --2- 172.21.15.192:0/1032591334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b8c198ee0 0x7f1b8c199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:48.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.815+0000 7f1b913b9700 1 --2- 172.21.15.192:0/1032591334 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f1b6c039ae0 0x7f1b6c03bfa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:48.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.815+0000 7f1b913b9700 1 --2- 172.21.15.192:0/1032591334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b780035c0 0x7f1b8c19e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:48.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.815+0000 7f1b913b9700 1 --2- 172.21.15.192:0/1032591334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b8c19ed20 0x7f1b8c1989a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:48.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.815+0000 7f1b913b9700 1 -- 172.21.15.192:0/1032591334 >> 172.21.15.192:0/1032591334 conn(0x7f1b8c0fd8d0 msgr2=0x7f1b8c104e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:48.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.815+0000 7f1b913b9700 1 -- 172.21.15.192:0/1032591334 shutdown_connections 2024-04-26T18:26:48.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:48.815+0000 7f1b913b9700 1 -- 172.21.15.192:0/1032591334 wait complete. 2024-04-26T18:26:48.817 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 3 2024-04-26T18:26:49.409 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-26T18:26:49.409 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph config generate-minimal-conf 2024-04-26T18:26:49.650 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:26:49.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:49 smithi080 ceph-mon[29135]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:49.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:49 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:26:49.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:49 smithi080 ceph-mon[29135]: from='client.? 172.21.15.192:0/1032591334' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T18:26:49.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:49 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:26:49.798 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:49 smithi192 ceph-mon[32842]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:49.798 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:49 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:26:49.798 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:49 smithi192 ceph-mon[32842]: from='client.? 172.21.15.192:0/1032591334' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T18:26:49.798 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:49 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:26:50.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T18:26:50.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: mon.a calling monitor election 2024-04-26T18:26:50.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: mon.c calling monitor election 2024-04-26T18:26:50.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:26:50.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T18:26:50.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:26:50.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:50.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:26:50.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:26:50.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:50.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:26:50.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:26:50.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T18:26:50.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: monmap epoch 3 2024-04-26T18:26:50.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: fsid 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:26:50.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: last_changed 2024-04-26T18:26:43.415397+0000 2024-04-26T18:26:50.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: created 2024-04-26T18:24:55.824625+0000 2024-04-26T18:26:50.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: min_mon_release 19 (squid) 2024-04-26T18:26:50.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: election_strategy: 1 2024-04-26T18:26:50.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: 0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-04-26T18:26:50.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-04-26T18:26:50.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: 2: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-04-26T18:26:50.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: fsmap 2024-04-26T18:26:50.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T18:26:50.722 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: mgrmap e13: x(active, since 58s) 2024-04-26T18:26:50.722 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: overall HEALTH_OK 2024-04-26T18:26:50.722 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:50.722 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:50.722 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:50.722 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:50.722 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:50.722 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:26:50.722 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: from='client.? 172.21.15.192:0/1032591334' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T18:26:50.722 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:26:51.311 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: mon.b calling monitor election 2024-04-26T18:26:51.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: Updating smithi080:/etc/ceph/ceph.conf 2024-04-26T18:26:51.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-26T18:26:51.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: Updating smithi192:/etc/ceph/ceph.conf 2024-04-26T18:26:51.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: Updating smithi080:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T18:26:51.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: Updating smithi192:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T18:26:51.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: Updating smithi082:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T18:26:51.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: mon.b calling monitor election 2024-04-26T18:26:51.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: mon.c calling monitor election 2024-04-26T18:26:51.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: mon.a calling monitor election 2024-04-26T18:26:51.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:51.312 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-26T18:26:51.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: monmap epoch 3 2024-04-26T18:26:51.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: fsid 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:26:51.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: last_changed 2024-04-26T18:26:43.415397+0000 2024-04-26T18:26:51.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: created 2024-04-26T18:24:55.824625+0000 2024-04-26T18:26:51.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: min_mon_release 19 (squid) 2024-04-26T18:26:51.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: election_strategy: 1 2024-04-26T18:26:51.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: 0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-04-26T18:26:51.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-04-26T18:26:51.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: 2: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-04-26T18:26:51.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: fsmap 2024-04-26T18:26:51.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T18:26:51.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: mgrmap e13: x(active, since 60s) 2024-04-26T18:26:51.313 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: overall HEALTH_OK 2024-04-26T18:26:51.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T18:26:51.314 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T18:26:51.315 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:51.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.345+0000 7f2bc3f04700 1 -- 172.21.15.80:0/2711097484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bbc101fd0 msgr2=0x7f2bbc1023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:51.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.345+0000 7f2bc3f04700 1 --2- 172.21.15.80:0/2711097484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bbc101fd0 0x7f2bbc1023b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4009910 tx=0x7f2bb4009c20 comp rx=0 tx=0).stop 2024-04-26T18:26:51.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.345+0000 7f2bc3f04700 1 -- 172.21.15.80:0/2711097484 shutdown_connections 2024-04-26T18:26:51.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.345+0000 7f2bc3f04700 1 --2- 172.21.15.80:0/2711097484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bbc101fd0 0x7f2bbc1023b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:51.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.345+0000 7f2bc3f04700 1 -- 172.21.15.80:0/2711097484 >> 172.21.15.80:0/2711097484 conn(0x7f2bbc077880 msgr2=0x7f2bbc077c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:51.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.345+0000 7f2bc3f04700 1 -- 172.21.15.80:0/2711097484 shutdown_connections 2024-04-26T18:26:51.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.345+0000 7f2bc3f04700 1 -- 172.21.15.80:0/2711097484 wait complete. 2024-04-26T18:26:51.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.346+0000 7f2bc3f04700 1 Processor -- start 2024-04-26T18:26:51.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.346+0000 7f2bc3f04700 1 -- start start 2024-04-26T18:26:51.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.346+0000 7f2bc3f04700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bbc101fd0 0x7f2bbc19c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:51.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.346+0000 7f2bc3f04700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bbc19cb50 0x7f2bbc197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:51.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.346+0000 7f2bc3f04700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bbc197eb0 0x7f2bbc198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:51.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.346+0000 7f2bc3f04700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc10c200 con 0x7f2bbc101fd0 2024-04-26T18:26:51.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.346+0000 7f2bc3f04700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc10c080 con 0x7f2bbc197eb0 2024-04-26T18:26:51.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.346+0000 7f2bc3f04700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc10c380 con 0x7f2bbc19cb50 2024-04-26T18:26:51.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.346+0000 7f2bc1ca0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bbc101fd0 0x7f2bbc19c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:51.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.346+0000 7f2bc1ca0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bbc101fd0 0x7f2bbc19c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48486/0 (socket says 172.21.15.80:48486) 2024-04-26T18:26:51.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.346+0000 7f2bc1ca0700 1 -- 172.21.15.80:0/3410859865 learned_addr learned my addr 172.21.15.80:0/3410859865 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:26:51.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.346+0000 7f2bc149f700 1 --2- 172.21.15.80:0/3410859865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bbc19cb50 0x7f2bbc197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:51.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.346+0000 7f2bc24a1700 1 --2- 172.21.15.80:0/3410859865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bbc197eb0 0x7f2bbc198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:51.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.346+0000 7f2bc1ca0700 1 -- 172.21.15.80:0/3410859865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bbc19cb50 msgr2=0x7f2bbc197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:51.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.346+0000 7f2bc1ca0700 1 --2- 172.21.15.80:0/3410859865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bbc19cb50 0x7f2bbc197970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:51.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.346+0000 7f2bc1ca0700 1 -- 172.21.15.80:0/3410859865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bbc197eb0 msgr2=0x7f2bbc198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:51.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.346+0000 7f2bc1ca0700 1 --2- 172.21.15.80:0/3410859865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bbc197eb0 0x7f2bbc198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:51.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.346+0000 7f2bc1ca0700 1 -- 172.21.15.80:0/3410859865 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bbc06a840 con 0x7f2bbc101fd0 2024-04-26T18:26:51.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.346+0000 7f2bc149f700 1 --2- 172.21.15.80:0/3410859865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bbc19cb50 0x7f2bbc197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:26:51.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.346+0000 7f2bc24a1700 1 --2- 172.21.15.80:0/3410859865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bbc197eb0 0x7f2bbc198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:26:51.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.347+0000 7f2bc1ca0700 1 --2- 172.21.15.80:0/3410859865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bbc101fd0 0x7f2bbc19c610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4005b40 tx=0x7f2bb4005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:51.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.347+0000 7f2bb2ffd700 1 -- 172.21.15.80:0/3410859865 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4026070 con 0x7f2bbc101fd0 2024-04-26T18:26:51.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.347+0000 7f2bc3f04700 1 -- 172.21.15.80:0/3410859865 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bbc06aad0 con 0x7f2bbc101fd0 2024-04-26T18:26:51.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.347+0000 7f2bb2ffd700 1 -- 172.21.15.80:0/3410859865 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bb400b6f0 con 0x7f2bbc101fd0 2024-04-26T18:26:51.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.347+0000 7f2bb2ffd700 1 -- 172.21.15.80:0/3410859865 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb40038e0 con 0x7f2bbc101fd0 2024-04-26T18:26:51.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.347+0000 7f2bc3f04700 1 -- 172.21.15.80:0/3410859865 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bbc06afe0 con 0x7f2bbc101fd0 2024-04-26T18:26:51.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.348+0000 7f2bb2ffd700 1 -- 172.21.15.80:0/3410859865 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f2bb4029070 con 0x7f2bbc101fd0 2024-04-26T18:26:51.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.348+0000 7f2bc3f04700 1 -- 172.21.15.80:0/3410859865 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bbc064a80 con 0x7f2bbc101fd0 2024-04-26T18:26:51.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.348+0000 7f2bb2ffd700 1 --2- 172.21.15.80:0/3410859865 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f2ba8039ae0 0x7f2ba803bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:51.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.348+0000 7f2bb2ffd700 1 -- 172.21.15.80:0/3410859865 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2bb404d7f0 con 0x7f2bbc101fd0 2024-04-26T18:26:51.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.348+0000 7f2bc149f700 1 --2- 172.21.15.80:0/3410859865 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f2ba8039ae0 0x7f2ba803bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:51.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.349+0000 7f2bc149f700 1 --2- 172.21.15.80:0/3410859865 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f2ba8039ae0 0x7f2ba803bfa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0079b0 tx=0x7f2bac008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:51.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.353+0000 7f2bb2ffd700 1 -- 172.21.15.80:0/3410859865 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2bb4013070 con 0x7f2bbc101fd0 2024-04-26T18:26:51.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: mon.b calling monitor election 2024-04-26T18:26:51.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: Updating smithi080:/etc/ceph/ceph.conf 2024-04-26T18:26:51.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-26T18:26:51.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: Updating smithi192:/etc/ceph/ceph.conf 2024-04-26T18:26:51.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: Updating smithi080:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T18:26:51.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: Updating smithi192:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T18:26:51.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: Updating smithi082:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T18:26:51.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: mon.b calling monitor election 2024-04-26T18:26:51.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: mon.c calling monitor election 2024-04-26T18:26:51.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: mon.a calling monitor election 2024-04-26T18:26:51.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:51.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-26T18:26:51.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: monmap epoch 3 2024-04-26T18:26:51.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: fsid 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:26:51.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: last_changed 2024-04-26T18:26:43.415397+0000 2024-04-26T18:26:51.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: created 2024-04-26T18:24:55.824625+0000 2024-04-26T18:26:51.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: min_mon_release 19 (squid) 2024-04-26T18:26:51.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: election_strategy: 1 2024-04-26T18:26:51.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: 0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-04-26T18:26:51.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-04-26T18:26:51.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: 2: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-04-26T18:26:51.472 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: fsmap 2024-04-26T18:26:51.472 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T18:26:51.472 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: mgrmap e13: x(active, since 60s) 2024-04-26T18:26:51.472 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: overall HEALTH_OK 2024-04-26T18:26:51.472 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.472 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.472 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.472 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.472 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.472 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.472 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.472 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.472 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.472 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.473 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.473 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.473 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T18:26:51.473 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T18:26:51.473 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:51 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:51.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.559+0000 7f2bc3f04700 1 -- 172.21.15.80:0/3410859865 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f2bbc06b240 con 0x7f2bbc101fd0 2024-04-26T18:26:51.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.560+0000 7f2bb2ffd700 1 -- 172.21.15.80:0/3410859865 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7f2bb4030020 con 0x7f2bbc101fd0 2024-04-26T18:26:51.560 INFO:teuthology.orchestra.run.smithi080.stdout:# minimal ceph.conf for 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:26:51.560 INFO:teuthology.orchestra.run.smithi080.stdout:[global] 2024-04-26T18:26:51.561 INFO:teuthology.orchestra.run.smithi080.stdout: fsid = 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:26:51.561 INFO:teuthology.orchestra.run.smithi080.stdout: mon_host = [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] 2024-04-26T18:26:51.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.562+0000 7f2bc3f04700 1 -- 172.21.15.80:0/3410859865 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f2ba8039ae0 msgr2=0x7f2ba803bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:51.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.562+0000 7f2bc3f04700 1 --2- 172.21.15.80:0/3410859865 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f2ba8039ae0 0x7f2ba803bfa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0079b0 tx=0x7f2bac008040 comp rx=0 tx=0).stop 2024-04-26T18:26:51.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.562+0000 7f2bc3f04700 1 -- 172.21.15.80:0/3410859865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bbc101fd0 msgr2=0x7f2bbc19c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:51.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.562+0000 7f2bc3f04700 1 --2- 172.21.15.80:0/3410859865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bbc101fd0 0x7f2bbc19c610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4005b40 tx=0x7f2bb4005030 comp rx=0 tx=0).stop 2024-04-26T18:26:51.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.562+0000 7f2bc3f04700 1 -- 172.21.15.80:0/3410859865 shutdown_connections 2024-04-26T18:26:51.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.562+0000 7f2bc3f04700 1 --2- 172.21.15.80:0/3410859865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bbc197eb0 0x7f2bbc198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:51.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.562+0000 7f2bc3f04700 1 --2- 172.21.15.80:0/3410859865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bbc101fd0 0x7f2bbc19c610 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:51.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.562+0000 7f2bc3f04700 1 --2- 172.21.15.80:0/3410859865 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f2ba8039ae0 0x7f2ba803bfa0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:51.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.562+0000 7f2bc3f04700 1 --2- 172.21.15.80:0/3410859865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bbc19cb50 0x7f2bbc197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:51.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.562+0000 7f2bc3f04700 1 -- 172.21.15.80:0/3410859865 >> 172.21.15.80:0/3410859865 conn(0x7f2bbc077880 msgr2=0x7f2bbc103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:51.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.562+0000 7f2bc3f04700 1 -- 172.21.15.80:0/3410859865 shutdown_connections 2024-04-26T18:26:51.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:26:51.562+0000 7f2bc3f04700 1 -- 172.21.15.80:0/3410859865 wait complete. 2024-04-26T18:26:51.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: mon.b calling monitor election 2024-04-26T18:26:51.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: Updating smithi080:/etc/ceph/ceph.conf 2024-04-26T18:26:51.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-26T18:26:51.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: Updating smithi192:/etc/ceph/ceph.conf 2024-04-26T18:26:51.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: Updating smithi080:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T18:26:51.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: Updating smithi192:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T18:26:51.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: Updating smithi082:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T18:26:51.614 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: mon.b calling monitor election 2024-04-26T18:26:51.614 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: mon.c calling monitor election 2024-04-26T18:26:51.614 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: mon.a calling monitor election 2024-04-26T18:26:51.614 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:51.614 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-26T18:26:51.614 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: monmap epoch 3 2024-04-26T18:26:51.614 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: fsid 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:26:51.614 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: last_changed 2024-04-26T18:26:43.415397+0000 2024-04-26T18:26:51.614 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: created 2024-04-26T18:24:55.824625+0000 2024-04-26T18:26:51.614 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: min_mon_release 19 (squid) 2024-04-26T18:26:51.614 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: election_strategy: 1 2024-04-26T18:26:51.614 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: 0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-04-26T18:26:51.614 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-04-26T18:26:51.615 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: 2: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-04-26T18:26:51.615 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: fsmap 2024-04-26T18:26:51.615 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T18:26:51.615 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: mgrmap e13: x(active, since 60s) 2024-04-26T18:26:51.615 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: overall HEALTH_OK 2024-04-26T18:26:51.615 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.615 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.615 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.615 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.615 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.615 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.615 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.615 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.615 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.616 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.616 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.616 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:51.616 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T18:26:51.616 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T18:26:51.616 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:51 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:52.176 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:52 smithi080 ceph-mon[29135]: Reconfiguring mon.a (unknown last config time)... 2024-04-26T18:26:52.176 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:52 smithi080 ceph-mon[29135]: Reconfiguring daemon mon.a on smithi080 2024-04-26T18:26:52.176 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:52 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:26:52.176 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:52 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3410859865' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:52.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:52 smithi082 ceph-mon[32808]: Reconfiguring mon.a (unknown last config time)... 2024-04-26T18:26:52.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:52 smithi082 ceph-mon[32808]: Reconfiguring daemon mon.a on smithi080 2024-04-26T18:26:52.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:52 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:26:52.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:52 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3410859865' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:52.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:52 smithi192 ceph-mon[32842]: Reconfiguring mon.a (unknown last config time)... 2024-04-26T18:26:52.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:52 smithi192 ceph-mon[32842]: Reconfiguring daemon mon.a on smithi080 2024-04-26T18:26:52.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:52 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:26:52.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:52 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3410859865' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:52.857 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-26T18:26:52.857 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T18:26:52.857 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.conf 2024-04-26T18:26:52.883 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T18:26:52.884 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T18:26:52.948 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T18:26:52.948 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.conf 2024-04-26T18:26:52.975 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T18:26:52.975 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T18:26:53.040 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T18:26:53.040 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.conf 2024-04-26T18:26:53.071 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T18:26:53.071 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T18:26:53.140 INFO:tasks.cephadm:Adding mgr.x on smithi080 2024-04-26T18:26:53.140 INFO:tasks.cephadm:Adding mgr.y on smithi082 2024-04-26T18:26:53.140 INFO:tasks.cephadm:Adding mgr.z on smithi192 2024-04-26T18:26:53.140 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph orch apply mgr '3;smithi080=x;smithi082=y;smithi192=z' 2024-04-26T18:26:53.414 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T18:26:53.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:53 smithi082 ceph-mon[32808]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:53.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:53 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:53.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:53 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:53.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:53 smithi082 ceph-mon[32808]: Reconfiguring mon.b (monmap changed)... 2024-04-26T18:26:53.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:53 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T18:26:53.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:53 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T18:26:53.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:53 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:53.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:53 smithi082 ceph-mon[32808]: Reconfiguring daemon mon.b on smithi082 2024-04-26T18:26:53.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:53 smithi080 ceph-mon[29135]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:53.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:53 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:53.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:53 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:53.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:53 smithi080 ceph-mon[29135]: Reconfiguring mon.b (monmap changed)... 2024-04-26T18:26:53.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:53 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T18:26:53.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:53 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T18:26:53.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:53 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:53.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:53 smithi080 ceph-mon[29135]: Reconfiguring daemon mon.b on smithi082 2024-04-26T18:26:53.773 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:53 smithi192 ceph-mon[32842]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:53.774 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:53 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:53.774 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:53 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:53.774 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:53 smithi192 ceph-mon[32842]: Reconfiguring mon.b (monmap changed)... 2024-04-26T18:26:53.774 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:53 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T18:26:53.774 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:53 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T18:26:53.774 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:53 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:53.774 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:53 smithi192 ceph-mon[32842]: Reconfiguring daemon mon.b on smithi082 2024-04-26T18:26:54.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.840+0000 7fd149989700 1 -- 172.21.15.192:0/611399582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd144102fc0 msgr2=0x7fd1441033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:54.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.840+0000 7fd149989700 1 --2- 172.21.15.192:0/611399582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd144102fc0 0x7fd1441033e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd134009910 tx=0x7fd134009c20 comp rx=0 tx=0).stop 2024-04-26T18:26:54.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.840+0000 7fd149989700 1 -- 172.21.15.192:0/611399582 shutdown_connections 2024-04-26T18:26:54.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.840+0000 7fd149989700 1 --2- 172.21.15.192:0/611399582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd144102fc0 0x7fd1441033e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:54.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.840+0000 7fd149989700 1 -- 172.21.15.192:0/611399582 >> 172.21.15.192:0/611399582 conn(0x7fd1440fe560 msgr2=0x7fd1441009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:54.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.840+0000 7fd149989700 1 -- 172.21.15.192:0/611399582 shutdown_connections 2024-04-26T18:26:54.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.840+0000 7fd149989700 1 -- 172.21.15.192:0/611399582 wait complete. 2024-04-26T18:26:54.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.841+0000 7fd149989700 1 Processor -- start 2024-04-26T18:26:54.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.841+0000 7fd149989700 1 -- start start 2024-04-26T18:26:54.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.841+0000 7fd149989700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd144102fc0 0x7fd1440771c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:54.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.841+0000 7fd149989700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd144075810 0x7fd144075c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:54.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.841+0000 7fd149989700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1440761d0 0x7fd1441a27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:54.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.841+0000 7fd149989700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd144108f00 con 0x7fd1440761d0 2024-04-26T18:26:54.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.841+0000 7fd149989700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd144108d80 con 0x7fd144102fc0 2024-04-26T18:26:54.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.841+0000 7fd149989700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd144109080 con 0x7fd144075810 2024-04-26T18:26:54.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.841+0000 7fd13a7fc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd144075810 0x7fd144075c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:54.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.841+0000 7fd13a7fc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd144075810 0x7fd144075c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53884/0 (socket says 172.21.15.192:53884) 2024-04-26T18:26:54.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.841+0000 7fd13a7fc700 1 -- 172.21.15.192:0/3416572229 learned_addr learned my addr 172.21.15.192:0/3416572229 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-04-26T18:26:54.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.841+0000 7fd1437fe700 1 --2- 172.21.15.192:0/3416572229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1440761d0 0x7fd1441a27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:54.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.841+0000 7fd142ffd700 1 --2- 172.21.15.192:0/3416572229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd144102fc0 0x7fd1440771c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:54.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.842+0000 7fd13a7fc700 1 -- 172.21.15.192:0/3416572229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd144102fc0 msgr2=0x7fd1440771c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:54.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.842+0000 7fd13a7fc700 1 --2- 172.21.15.192:0/3416572229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd144102fc0 0x7fd1440771c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:54.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.842+0000 7fd13a7fc700 1 -- 172.21.15.192:0/3416572229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1440761d0 msgr2=0x7fd1441a27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:54.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.842+0000 7fd13a7fc700 1 --2- 172.21.15.192:0/3416572229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1440761d0 0x7fd1441a27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:54.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.842+0000 7fd13a7fc700 1 -- 172.21.15.192:0/3416572229 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1441a2da0 con 0x7fd144075810 2024-04-26T18:26:54.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.842+0000 7fd1437fe700 1 --2- 172.21.15.192:0/3416572229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1440761d0 0x7fd1441a27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:26:54.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.842+0000 7fd13a7fc700 1 --2- 172.21.15.192:0/3416572229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd144075810 0x7fd144075c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00b780 tx=0x7fd12c00ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:54.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.842+0000 7fd148987700 1 -- 172.21.15.192:0/3416572229 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c016070 con 0x7fd144075810 2024-04-26T18:26:54.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.842+0000 7fd148987700 1 -- 172.21.15.192:0/3416572229 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd12c0036a0 con 0x7fd144075810 2024-04-26T18:26:54.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.842+0000 7fd149989700 1 -- 172.21.15.192:0/3416572229 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1441a3090 con 0x7fd144075810 2024-04-26T18:26:54.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.842+0000 7fd148987700 1 -- 172.21.15.192:0/3416572229 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c0119c0 con 0x7fd144075810 2024-04-26T18:26:54.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.842+0000 7fd149989700 1 -- 172.21.15.192:0/3416572229 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1441a3620 con 0x7fd144075810 2024-04-26T18:26:54.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.843+0000 7fd148987700 1 -- 172.21.15.192:0/3416572229 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fd12c019070 con 0x7fd144075810 2024-04-26T18:26:54.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.843+0000 7fd148987700 1 --2- 172.21.15.192:0/3416572229 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd130039ae0 0x7fd13003bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:54.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.843+0000 7fd148987700 1 -- 172.21.15.192:0/3416572229 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd12c04c290 con 0x7fd144075810 2024-04-26T18:26:54.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.843+0000 7fd149989700 1 -- 172.21.15.192:0/3416572229 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd14402e490 con 0x7fd144075810 2024-04-26T18:26:54.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.843+0000 7fd142ffd700 1 --2- 172.21.15.192:0/3416572229 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd130039ae0 0x7fd13003bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:54.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.844+0000 7fd142ffd700 1 --2- 172.21.15.192:0/3416572229 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd130039ae0 0x7fd13003bfa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd134005190 tx=0x7fd13401a040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:54.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:54.849+0000 7fd148987700 1 -- 172.21.15.192:0/3416572229 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd12c003850 con 0x7fd144075810 2024-04-26T18:26:55.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:55.066+0000 7fd149989700 1 -- 172.21.15.192:0/3416572229 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi080=x;smithi082=y;smithi192=z", "target": ["mon-mgr", ""]}) -- 0x7fd144063860 con 0x7fd130039ae0 2024-04-26T18:26:55.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:55.072+0000 7fd148987700 1 -- 172.21.15.192:0/3416572229 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fd144063860 con 0x7fd130039ae0 2024-04-26T18:26:55.073 INFO:teuthology.orchestra.run.smithi192.stdout:Scheduled mgr update... 2024-04-26T18:26:55.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:55.075+0000 7fd149989700 1 -- 172.21.15.192:0/3416572229 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd130039ae0 msgr2=0x7fd13003bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:55.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:55.075+0000 7fd149989700 1 --2- 172.21.15.192:0/3416572229 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd130039ae0 0x7fd13003bfa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd134005190 tx=0x7fd13401a040 comp rx=0 tx=0).stop 2024-04-26T18:26:55.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:55.075+0000 7fd149989700 1 -- 172.21.15.192:0/3416572229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd144075810 msgr2=0x7fd144075c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:55.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:55.075+0000 7fd149989700 1 --2- 172.21.15.192:0/3416572229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd144075810 0x7fd144075c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00b780 tx=0x7fd12c00ba90 comp rx=0 tx=0).stop 2024-04-26T18:26:55.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:55.075+0000 7fd149989700 1 -- 172.21.15.192:0/3416572229 shutdown_connections 2024-04-26T18:26:55.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:55.075+0000 7fd149989700 1 --2- 172.21.15.192:0/3416572229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1440761d0 0x7fd1441a27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:55.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:55.075+0000 7fd149989700 1 --2- 172.21.15.192:0/3416572229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd144102fc0 0x7fd1440771c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:55.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:55.075+0000 7fd149989700 1 --2- 172.21.15.192:0/3416572229 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd130039ae0 0x7fd13003bfa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:55.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:55.075+0000 7fd149989700 1 --2- 172.21.15.192:0/3416572229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd144075810 0x7fd144075c90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:55.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:55.075+0000 7fd149989700 1 -- 172.21.15.192:0/3416572229 >> 172.21.15.192:0/3416572229 conn(0x7fd1440fe560 msgr2=0x7fd1440ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:55.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:55.075+0000 7fd149989700 1 -- 172.21.15.192:0/3416572229 shutdown_connections 2024-04-26T18:26:55.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:26:55.075+0000 7fd149989700 1 -- 172.21.15.192:0/3416572229 wait complete. 2024-04-26T18:26:55.275 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:55 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:55.275 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:55 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:55.275 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:55 smithi192 ceph-mon[32842]: Reconfiguring mon.c (monmap changed)... 2024-04-26T18:26:55.275 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:55 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T18:26:55.275 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:55 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T18:26:55.275 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:55 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:55.275 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:55 smithi192 ceph-mon[32842]: Reconfiguring daemon mon.c on smithi192 2024-04-26T18:26:55.275 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:55 smithi192 ceph-mon[32842]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:55.275 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:55 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:55.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:55 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:55.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:55 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:55.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:55 smithi082 ceph-mon[32808]: Reconfiguring mon.c (monmap changed)... 2024-04-26T18:26:55.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:55 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T18:26:55.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:55 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T18:26:55.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:55 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:55.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:55 smithi082 ceph-mon[32808]: Reconfiguring daemon mon.c on smithi192 2024-04-26T18:26:55.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:55 smithi082 ceph-mon[32808]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:55.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:55 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:55.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:55 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:55.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:55 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:55.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:55 smithi080 ceph-mon[29135]: Reconfiguring mon.c (monmap changed)... 2024-04-26T18:26:55.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:55 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T18:26:55.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:55 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T18:26:55.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:55 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:55.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:55 smithi080 ceph-mon[29135]: Reconfiguring daemon mon.c on smithi192 2024-04-26T18:26:55.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:55 smithi080 ceph-mon[29135]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:55.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:55 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:56.127 DEBUG:teuthology.orchestra.run.smithi082:mgr.y> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mgr.y.service 2024-04-26T18:26:56.130 DEBUG:teuthology.orchestra.run.smithi192:mgr.z> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mgr.z.service 2024-04-26T18:26:56.132 INFO:tasks.cephadm:Deploying OSDs... 2024-04-26T18:26:56.133 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T18:26:56.133 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T18:26:56.151 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T18:26:56.152 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_1 2024-04-26T18:26:56.209 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T18:26:56.209 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T18:26:56.210 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-26T18:26:56.210 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T18:26:56.210 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T18:26:56.210 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-26 18:26:00.613069449 +0000 2024-04-26T18:26:56.210 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-26 18:21:24.893008298 +0000 2024-04-26T18:26:56.210 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-26 18:21:24.893008298 +0000 2024-04-26T18:26:56.210 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-26 18:21:24.893008298 +0000 2024-04-26T18:26:56.210 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T18:26:56.277 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-04-26T18:26:56.277 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-04-26T18:26:56.277 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000210937 s, 2.4 MB/s 2024-04-26T18:26:56.278 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T18:26:56.337 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_2 2024-04-26T18:26:56.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:56 smithi192 ceph-mon[32842]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi080=x;smithi082=y;smithi192=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:26:56.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:56 smithi192 ceph-mon[32842]: Saving service mgr spec with placement smithi080=x;smithi082=y;smithi192=z;count:3 2024-04-26T18:26:56.394 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T18:26:56.394 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T18:26:56.394 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-26T18:26:56.394 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T18:26:56.394 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T18:26:56.394 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-26 18:26:00.643068766 +0000 2024-04-26T18:26:56.394 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-26 18:21:25.238000307 +0000 2024-04-26T18:26:56.394 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-26 18:21:25.238000307 +0000 2024-04-26T18:26:56.394 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-26 18:21:25.238000307 +0000 2024-04-26T18:26:56.395 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T18:26:56.457 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:56 smithi080 ceph-mon[29135]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi080=x;smithi082=y;smithi192=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:26:56.457 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:56 smithi080 ceph-mon[29135]: Saving service mgr spec with placement smithi080=x;smithi082=y;smithi192=z;count:3 2024-04-26T18:26:56.460 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-04-26T18:26:56.460 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-04-26T18:26:56.460 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000221642 s, 2.3 MB/s 2024-04-26T18:26:56.461 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T18:26:56.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:56 smithi082 ceph-mon[32808]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi080=x;smithi082=y;smithi192=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:26:56.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:56 smithi082 ceph-mon[32808]: Saving service mgr spec with placement smithi080=x;smithi082=y;smithi192=z;count:3 2024-04-26T18:26:56.519 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_3 2024-04-26T18:26:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T18:26:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T18:26:56.576 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-26T18:26:56.576 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T18:26:56.576 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T18:26:56.576 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-26 18:26:00.667068220 +0000 2024-04-26T18:26:56.576 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-26 18:21:25.578992410 +0000 2024-04-26T18:26:56.576 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-26 18:21:25.578992410 +0000 2024-04-26T18:26:56.576 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-26 18:21:25.578992410 +0000 2024-04-26T18:26:56.577 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T18:26:56.638 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-04-26T18:26:56.639 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-04-26T18:26:56.639 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000181935 s, 2.8 MB/s 2024-04-26T18:26:56.640 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T18:26:56.696 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_4 2024-04-26T18:26:56.752 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T18:26:56.752 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T18:26:56.753 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-04-26T18:26:56.753 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T18:26:56.753 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T18:26:56.753 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-26 18:26:00.692067651 +0000 2024-04-26T18:26:56.753 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-26 18:21:25.910984721 +0000 2024-04-26T18:26:56.753 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-26 18:21:25.910984721 +0000 2024-04-26T18:26:56.753 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-26 18:21:25.910984721 +0000 2024-04-26T18:26:56.753 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T18:26:56.815 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-04-26T18:26:56.815 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-04-26T18:26:56.815 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.00023538 s, 2.2 MB/s 2024-04-26T18:26:56.816 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T18:26:56.872 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T18:26:56.872 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T18:26:56.890 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T18:26:56.890 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2024-04-26T18:26:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T18:26:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T18:26:56.948 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-26T18:26:56.948 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T18:26:56.948 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T18:26:56.948 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-26 18:26:42.857559789 +0000 2024-04-26T18:26:56.949 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-26 18:21:46.370846824 +0000 2024-04-26T18:26:56.949 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-26 18:21:46.370846824 +0000 2024-04-26T18:26:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-04-26 18:21:46.370846824 +0000 2024-04-26T18:26:56.949 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T18:26:57.014 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-26T18:26:57.014 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-26T18:26:57.014 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000289914 s, 1.8 MB/s 2024-04-26T18:26:57.015 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T18:26:57.073 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2024-04-26T18:26:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T18:26:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T18:26:57.130 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-26T18:26:57.130 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T18:26:57.130 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T18:26:57.130 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-26 18:26:42.858559770 +0000 2024-04-26T18:26:57.131 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-26 18:21:46.702840257 +0000 2024-04-26T18:26:57.131 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-26 18:21:46.702840257 +0000 2024-04-26T18:26:57.131 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-04-26 18:21:46.702840257 +0000 2024-04-26T18:26:57.131 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T18:26:57.194 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-26T18:26:57.194 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-26T18:26:57.195 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000279902 s, 1.8 MB/s 2024-04-26T18:26:57.196 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T18:26:57.253 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2024-04-26T18:26:57.310 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T18:26:57.310 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T18:26:57.310 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-26T18:26:57.310 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T18:26:57.310 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T18:26:57.311 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-26 18:26:42.858559770 +0000 2024-04-26T18:26:57.311 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-26 18:21:47.040833570 +0000 2024-04-26T18:26:57.311 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-26 18:21:47.040833570 +0000 2024-04-26T18:26:57.311 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-04-26 18:21:47.040833570 +0000 2024-04-26T18:26:57.311 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T18:26:57.374 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-26T18:26:57.378 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-26T18:26:57.378 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.00026882 s, 1.9 MB/s 2024-04-26T18:26:57.379 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T18:26:57.436 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2024-04-26T18:26:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T18:26:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T18:26:57.494 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-26T18:26:57.494 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T18:26:57.494 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T18:26:57.494 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-26 18:26:42.858559770 +0000 2024-04-26T18:26:57.494 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-26 18:21:47.390826646 +0000 2024-04-26T18:26:57.494 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-26 18:21:47.390826646 +0000 2024-04-26T18:26:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-04-26 18:21:47.390826646 +0000 2024-04-26T18:26:57.495 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T18:26:57.557 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-26T18:26:57.557 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-26T18:26:57.557 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000216508 s, 2.4 MB/s 2024-04-26T18:26:57.558 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T18:26:57.613 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T18:26:57.614 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T18:26:57.629 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T18:26:57.629 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_1 2024-04-26T18:26:57.684 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T18:26:57.685 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T18:26:57.685 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-26T18:26:57.685 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T18:26:57.685 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T18:26:57.685 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-04-26 18:26:33.495010360 +0000 2024-04-26T18:26:57.685 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-04-26 18:21:47.063262160 +0000 2024-04-26T18:26:57.685 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-04-26 18:21:47.063262160 +0000 2024-04-26T18:26:57.685 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-04-26 18:21:47.063262160 +0000 2024-04-26T18:26:57.686 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T18:26:57.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:57 smithi082 ceph-mon[32808]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:57.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:57 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:57.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:57 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:57.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:57 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:26:57.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:57 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:57.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:57 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:26:57.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:57 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:57.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:57 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T18:26:57.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:57 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T18:26:57.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:57 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T18:26:57.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:57 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:57.734 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:57 smithi192 ceph-mon[32842]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:57.735 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:57 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:57.735 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:57 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:57.735 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:57 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:26:57.735 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:57 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:57.735 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:57 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:26:57.736 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:57 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:57.736 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:57 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T18:26:57.736 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:57 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T18:26:57.736 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:57 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T18:26:57.736 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:57 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:57.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:57 smithi080 ceph-mon[29135]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:57.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:57 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:57.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:57 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:57.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:57 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:26:57.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:57 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:57.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:57 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:26:57.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:57 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:26:57.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:57 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T18:26:57.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:57 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T18:26:57.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:57 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T18:26:57.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:57 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:57.746 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-04-26T18:26:57.746 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-04-26T18:26:57.746 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.00026235 s, 2.0 MB/s 2024-04-26T18:26:57.747 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T18:26:57.803 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_2 2024-04-26T18:26:57.858 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T18:26:57.858 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T18:26:57.858 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-26T18:26:57.858 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T18:26:57.858 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T18:26:57.858 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-04-26 18:26:33.495010360 +0000 2024-04-26T18:26:57.858 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-04-26 18:21:47.413255184 +0000 2024-04-26T18:26:57.858 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-04-26 18:21:47.413255184 +0000 2024-04-26T18:26:57.858 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-04-26 18:21:47.413255184 +0000 2024-04-26T18:26:57.858 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T18:26:57.921 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-04-26T18:26:57.921 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-04-26T18:26:57.921 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000188913 s, 2.7 MB/s 2024-04-26T18:26:57.922 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T18:26:57.980 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_3 2024-04-26T18:26:58.037 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T18:26:58.037 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T18:26:58.037 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-26T18:26:58.037 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T18:26:58.037 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T18:26:58.037 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-04-26 18:26:33.496010340 +0000 2024-04-26T18:26:58.038 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-04-26 18:21:47.763248208 +0000 2024-04-26T18:26:58.038 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-04-26 18:21:47.763248208 +0000 2024-04-26T18:26:58.038 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-04-26 18:21:47.763248208 +0000 2024-04-26T18:26:58.038 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T18:26:58.100 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-04-26T18:26:58.100 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-04-26T18:26:58.100 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000196784 s, 2.6 MB/s 2024-04-26T18:26:58.101 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T18:26:58.157 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_4 2024-04-26T18:26:58.211 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T18:26:58.211 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T18:26:58.211 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-26T18:26:58.211 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T18:26:58.211 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T18:26:58.212 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-04-26 18:26:33.496010340 +0000 2024-04-26T18:26:58.212 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-04-26 18:21:48.109241312 +0000 2024-04-26T18:26:58.212 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-04-26 18:21:48.109241312 +0000 2024-04-26T18:26:58.212 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-04-26 18:21:48.109241312 +0000 2024-04-26T18:26:58.212 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T18:26:58.274 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-04-26T18:26:58.274 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-04-26T18:26:58.274 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000221671 s, 2.3 MB/s 2024-04-26T18:26:58.275 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T18:26:58.331 INFO:tasks.cephadm:Deploying osd.0 on smithi080 with /dev/vg_nvme/lv_4... 2024-04-26T18:26:58.331 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-26T18:26:58.570 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:26:58.688 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:58 smithi080 ceph-mon[29135]: Deploying daemon mgr.z on smithi192 2024-04-26T18:26:58.753 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:58 smithi192 ceph-mon[32842]: Deploying daemon mgr.z on smithi192 2024-04-26T18:26:58.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:58 smithi082 ceph-mon[32808]: Deploying daemon mgr.z on smithi192 2024-04-26T18:26:59.362 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:26:59 smithi192 podman[34680]: 2024-04-26 18:26:59.307170373 +0000 UTC m=+0.117824794 container create 879b3597ad7d639529ae082d77a8d8feb154076767c8e86079981eeb4b93b7cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2) 2024-04-26T18:26:59.560 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:26:59 smithi080 ceph-mon[29135]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:59.671 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:26:59 smithi192 ceph-mon[32842]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:26:59.672 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:26:59 smithi192 podman[34680]: 2024-04-26 18:26:59.509343789 +0000 UTC m=+0.319998208 container init 879b3597ad7d639529ae082d77a8d8feb154076767c8e86079981eeb4b93b7cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-26T18:26:59.672 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:26:59 smithi192 podman[34680]: 2024-04-26 18:26:59.512000798 +0000 UTC m=+0.322655218 container start 879b3597ad7d639529ae082d77a8d8feb154076767c8e86079981eeb4b93b7cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-26T18:26:59.672 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:26:59 smithi192 ceph-mgr[34699]: -- 172.21.15.192:0/384114186 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55710f5865a0 con 0x55710f55a800 2024-04-26T18:26:59.672 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:26:59 smithi192 bash[34680]: 879b3597ad7d639529ae082d77a8d8feb154076767c8e86079981eeb4b93b7cc 2024-04-26T18:26:59.672 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:26:59 smithi192 systemd[1]: Started Ceph mgr.z for 2187ca98-03fa-11ef-bc93-c7b262605968. 2024-04-26T18:26:59.672 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:26:59 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:26:59.671+0000 7fe9e1f86200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T18:26:59.956 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:26:59 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:26:59.855+0000 7fe9e1f86200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T18:26:59.956 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:26:59 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:26:59.956+0000 7fe9e1f86200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T18:26:59.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:26:59 smithi082 ceph-mon[32808]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:00.401 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-26T18:27:00.401 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-26T18:27:00.401 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-04-26T18:27:00.401 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-04-26T18:27:00.401 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112996 s, 928 MB/s 2024-04-26T18:27:00.401 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-04-26T18:27:00.613 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:27:00 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:27:00.260+0000 7fe9e1f86200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T18:27:00.613 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:27:00 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:27:00.344+0000 7fe9e1f86200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T18:27:00.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:00 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:00.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:00 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:00.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:00 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:00.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:00 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T18:27:00.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:00 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T18:27:00.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:00 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T18:27:00.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:00 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:00.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:00 smithi080 ceph-mon[29135]: Deploying daemon mgr.y on smithi082 2024-04-26T18:27:00.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:00 smithi080 ceph-mon[29135]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:00.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:00 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:00.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:00 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:00.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:00 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:00.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:00 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T18:27:00.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:00 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T18:27:00.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:00 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T18:27:00.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:00 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:00.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:00 smithi082 ceph-mon[32808]: Deploying daemon mgr.y on smithi082 2024-04-26T18:27:00.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:00 smithi082 ceph-mon[32808]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:00.988 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi080:vg_nvme/lv_4 2024-04-26T18:27:01.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:00 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:01.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:00 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:01.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:00 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:01.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:00 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T18:27:01.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:00 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T18:27:01.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:00 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T18:27:01.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:00 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:01.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:00 smithi192 ceph-mon[32842]: Deploying daemon mgr.y on smithi082 2024-04-26T18:27:01.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:00 smithi192 ceph-mon[32842]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:01.218 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:27:01.862 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:27:01 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:27:01.545+0000 7fe9e1f86200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T18:27:01.862 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:27:01 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:27:01.713+0000 7fe9e1f86200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T18:27:01.970 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:01 smithi082 systemd[1]: Starting Ceph mgr.y for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:27:02.189 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:27:01 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:27:01.890+0000 7fe9e1f86200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T18:27:02.189 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:27:02 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:27:02.188+0000 7fe9e1f86200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T18:27:02.301 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:02 smithi082 podman[34175]: 2024-04-26 18:27:01.943117588 +0000 UTC m=+0.017443034 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:27:02.301 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:02 smithi082 podman[34175]: 2024-04-26 18:27:02.048976329 +0000 UTC m=+0.123318925 container create f32946a0fdec753a5f1be542008a16b17e91acae7508d727aac4b9ad6d3441fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True) 2024-04-26T18:27:02.301 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:02 smithi082 podman[34175]: 2024-04-26 18:27:02.21778265 +0000 UTC m=+0.292108084 container init f32946a0fdec753a5f1be542008a16b17e91acae7508d727aac4b9ad6d3441fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:27:02.301 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:02 smithi082 podman[34175]: 2024-04-26 18:27:02.220327396 +0000 UTC m=+0.294652833 container start f32946a0fdec753a5f1be542008a16b17e91acae7508d727aac4b9ad6d3441fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-04-26T18:27:02.301 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:02 smithi082 ceph-mgr[34195]: -- 172.21.15.82:0/704777172 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5587af5325a0 con 0x5587af507000 2024-04-26T18:27:02.301 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:02 smithi082 bash[34175]: f32946a0fdec753a5f1be542008a16b17e91acae7508d727aac4b9ad6d3441fb 2024-04-26T18:27:02.498 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:27:02 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:27:02.284+0000 7fe9e1f86200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T18:27:02.499 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:27:02 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:27:02.498+0000 7fe9e1f86200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T18:27:02.558 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:02 smithi082 systemd[1]: Started Ceph mgr.y for 2187ca98-03fa-11ef-bc93-c7b262605968. 2024-04-26T18:27:02.558 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:02 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:02.371+0000 7f4458304200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T18:27:02.558 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:02 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:02.558+0000 7f4458304200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T18:27:02.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.773+0000 7fd534bff700 1 -- 172.21.15.80:0/2579641112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd530103480 msgr2=0x7fd5301038a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:02.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.773+0000 7fd534bff700 1 --2- 172.21.15.80:0/2579641112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd530103480 0x7fd5301038a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd52800b0d0 tx=0x7fd52800b3e0 comp rx=0 tx=0).stop 2024-04-26T18:27:02.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.773+0000 7fd534bff700 1 -- 172.21.15.80:0/2579641112 shutdown_connections 2024-04-26T18:27:02.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.773+0000 7fd534bff700 1 --2- 172.21.15.80:0/2579641112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd530105020 0x7fd53010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:02.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.773+0000 7fd534bff700 1 --2- 172.21.15.80:0/2579641112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd530103480 0x7fd5301038a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:02.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.773+0000 7fd534bff700 1 --2- 172.21.15.80:0/2579641112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd530104680 0x7fd530104ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:02.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.773+0000 7fd534bff700 1 -- 172.21.15.80:0/2579641112 >> 172.21.15.80:0/2579641112 conn(0x7fd5300fea20 msgr2=0x7fd530100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:02.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.773+0000 7fd534bff700 1 -- 172.21.15.80:0/2579641112 shutdown_connections 2024-04-26T18:27:02.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.773+0000 7fd534bff700 1 -- 172.21.15.80:0/2579641112 wait complete. 2024-04-26T18:27:02.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.774+0000 7fd534bff700 1 Processor -- start 2024-04-26T18:27:02.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.774+0000 7fd534bff700 1 -- start start 2024-04-26T18:27:02.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.774+0000 7fd534bff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd530103480 0x7fd530199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:02.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.774+0000 7fd534bff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd530104680 0x7fd530199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:02.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.774+0000 7fd534bff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd530105020 0x7fd5301a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:02.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.774+0000 7fd534bff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd53010ef30 con 0x7fd530105020 2024-04-26T18:27:02.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.774+0000 7fd534bff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd53010edb0 con 0x7fd530103480 2024-04-26T18:27:02.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.774+0000 7fd534bff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd53010f0b0 con 0x7fd530104680 2024-04-26T18:27:02.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.774+0000 7fd52e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd530103480 0x7fd530199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:02.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.774+0000 7fd52ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd530105020 0x7fd5301a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:02.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.774+0000 7fd52e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd530103480 0x7fd530199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:52196/0 (socket says 172.21.15.80:52196) 2024-04-26T18:27:02.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.774+0000 7fd52ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd530105020 0x7fd5301a0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41602/0 (socket says 172.21.15.80:41602) 2024-04-26T18:27:02.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.774+0000 7fd52e59c700 1 -- 172.21.15.80:0/3249249990 learned_addr learned my addr 172.21.15.80:0/3249249990 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:27:02.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.774+0000 7fd52dd9b700 1 --2- 172.21.15.80:0/3249249990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd530104680 0x7fd530199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:02.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.774+0000 7fd52ed9d700 1 -- 172.21.15.80:0/3249249990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd530104680 msgr2=0x7fd530199b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:02.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.774+0000 7fd52ed9d700 1 --2- 172.21.15.80:0/3249249990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd530104680 0x7fd530199b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:02.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.774+0000 7fd52ed9d700 1 -- 172.21.15.80:0/3249249990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd530103480 msgr2=0x7fd530199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:02.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.774+0000 7fd52ed9d700 1 --2- 172.21.15.80:0/3249249990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd530103480 0x7fd530199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:02.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.774+0000 7fd52ed9d700 1 -- 172.21.15.80:0/3249249990 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5301a1290 con 0x7fd530105020 2024-04-26T18:27:02.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.775+0000 7fd52ed9d700 1 --2- 172.21.15.80:0/3249249990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd530105020 0x7fd5301a0bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd52000d780 tx=0x7fd52000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:02.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.775+0000 7fd51f7fe700 1 -- 172.21.15.80:0/3249249990 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd520014030 con 0x7fd530105020 2024-04-26T18:27:02.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.775+0000 7fd534bff700 1 -- 172.21.15.80:0/3249249990 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5301a1580 con 0x7fd530105020 2024-04-26T18:27:02.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.775+0000 7fd51f7fe700 1 -- 172.21.15.80:0/3249249990 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5200044d0 con 0x7fd530105020 2024-04-26T18:27:02.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.775+0000 7fd51f7fe700 1 -- 172.21.15.80:0/3249249990 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd520005420 con 0x7fd530105020 2024-04-26T18:27:02.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.775+0000 7fd534bff700 1 -- 172.21.15.80:0/3249249990 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd530075650 con 0x7fd530105020 2024-04-26T18:27:02.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.776+0000 7fd51f7fe700 1 -- 172.21.15.80:0/3249249990 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fd5200055c0 con 0x7fd530105020 2024-04-26T18:27:02.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.776+0000 7fd51f7fe700 1 --2- 172.21.15.80:0/3249249990 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd51803dca0 0x7fd518040160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:02.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.776+0000 7fd51f7fe700 1 -- 172.21.15.80:0/3249249990 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd52004c1c0 con 0x7fd530105020 2024-04-26T18:27:02.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.776+0000 7fd52e59c700 1 --2- 172.21.15.80:0/3249249990 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd51803dca0 0x7fd518040160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:02.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.776+0000 7fd534bff700 1 -- 172.21.15.80:0/3249249990 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd53006a110 con 0x7fd530105020 2024-04-26T18:27:02.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.777+0000 7fd52e59c700 1 --2- 172.21.15.80:0/3249249990 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd51803dca0 0x7fd518040160 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd528009e60 tx=0x7fd52800b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:02.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.781+0000 7fd51f7fe700 1 -- 172.21.15.80:0/3249249990 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd5200162d0 con 0x7fd530105020 2024-04-26T18:27:02.862 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:27:02 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:27:02.698+0000 7fe9e1f86200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T18:27:02.969 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:02 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:02.662+0000 7f4458304200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T18:27:02.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:02.988+0000 7fd534bff700 1 -- 172.21.15.80:0/3249249990 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fd530063860 con 0x7fd51803dca0 2024-04-26T18:27:03.366 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:02 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:02.981+0000 7f4458304200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T18:27:03.366 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:03 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:03.073+0000 7f4458304200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T18:27:03.612 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:27:03 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:27:03.335+0000 7fe9e1f86200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T18:27:03.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:03 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:03.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:03 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:03.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:03 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:03.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:03 smithi192 ceph-mon[32842]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:03.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:03 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:03.614 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:03 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:27:03.614 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:03 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:27:03.614 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:03 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:27:03.614 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:03 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:03.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:03 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:03.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:03 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:03.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:03 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:03.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:03 smithi080 ceph-mon[29135]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:03.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:03 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:03.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:03 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:27:03.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:03 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:27:03.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:03 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:27:03.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:03 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:03.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:03 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:03.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:03 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:03.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:03 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:03.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:03 smithi082 ceph-mon[32808]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:03.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:03 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:03.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:03 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:27:03.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:03 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:27:03.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:03 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:27:03.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:03 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:04.061 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:27:03 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:27:03.757+0000 7fe9e1f86200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T18:27:04.061 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:27:03 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:27:03.858+0000 7fe9e1f86200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T18:27:04.061 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:27:04 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:27:04.061+0000 7fe9e1f86200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T18:27:04.646 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:04 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:04.306+0000 7f4458304200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T18:27:04.646 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:04 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:04.478+0000 7f4458304200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T18:27:04.646 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:04 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:04.647+0000 7f4458304200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T18:27:04.647 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:04 smithi082 ceph-mon[32808]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:27:04.647 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:04 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:04.647 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:04 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:04.647 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:04 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:04.647 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:04 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:04.647 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:04 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:04.647 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:04 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:27:04.647 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:04 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:04.688 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:04 smithi080 ceph-mon[29135]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:27:04.688 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:04 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:04.688 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:04 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:04.688 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:04 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:04.688 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:04 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:04.688 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:04 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:04.688 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:04 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:27:04.688 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:04 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:04.692 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:27:04 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:27:04.601+0000 7fe9e1f86200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T18:27:04.692 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:27:04 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:27:04.692+0000 7fe9e1f86200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T18:27:04.692 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:04 smithi192 ceph-mon[32842]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:27:04.693 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:04 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:04.693 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:04 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:04.693 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:04 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:04.693 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:04 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:04.693 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:04 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:04.693 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:04 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:27:04.693 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:04 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:05.065 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:27:04 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:27:04.933+0000 7fe9e1f86200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T18:27:05.065 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:27:05 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:27:05.065+0000 7fe9e1f86200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T18:27:05.219 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:04 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:04.934+0000 7f4458304200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T18:27:05.219 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:05 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:05.026+0000 7f4458304200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T18:27:05.362 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:27:05 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:27:05.159+0000 7fe9e1f86200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T18:27:05.362 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:27:05 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:27:05.276+0000 7fe9e1f86200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T18:27:05.719 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:05 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:05.228+0000 7f4458304200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T18:27:05.719 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:05 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:05.423+0000 7f4458304200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T18:27:05.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:05 smithi082 ceph-mon[32808]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:05.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:05 smithi082 ceph-mon[32808]: Reconfiguring mgr.x (unknown last config time)... 2024-04-26T18:27:05.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:05 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T18:27:05.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:05 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T18:27:05.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:05 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:05.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:05 smithi082 ceph-mon[32808]: Reconfiguring daemon mgr.x on smithi080 2024-04-26T18:27:05.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:05 smithi080 ceph-mon[29135]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:05.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:05 smithi080 ceph-mon[29135]: Reconfiguring mgr.x (unknown last config time)... 2024-04-26T18:27:05.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:05 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T18:27:05.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:05 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T18:27:05.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:05 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:05.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:05 smithi080 ceph-mon[29135]: Reconfiguring daemon mgr.x on smithi080 2024-04-26T18:27:05.862 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:27:05 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:27:05.583+0000 7fe9e1f86200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T18:27:05.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:05 smithi192 ceph-mon[32842]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:05.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:05 smithi192 ceph-mon[32842]: Reconfiguring mgr.x (unknown last config time)... 2024-04-26T18:27:05.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:05 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T18:27:05.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:05 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T18:27:05.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:05 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:05.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:05 smithi192 ceph-mon[32842]: Reconfiguring daemon mgr.x on smithi080 2024-04-26T18:27:06.453 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:06 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:06.032+0000 7f4458304200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T18:27:06.474 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:27:06 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:27:06.179+0000 7fe9e1f86200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T18:27:06.474 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:27:06 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:27:06.397+0000 7fe9e1f86200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T18:27:06.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:06.690+0000 7fd51f7fe700 1 -- 172.21.15.80:0/3249249990 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mgrmap(e 14) ==== 92602+0+0 (secure 0 0 0) 0x7fd520003680 con 0x7fd530105020 2024-04-26T18:27:06.719 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:06 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:06.454+0000 7f4458304200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T18:27:06.719 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:06 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:06.550+0000 7f4458304200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T18:27:06.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:06 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:06.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:06 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1008706383' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a01cfe6-d13a-4828-8c20-ad7fee7e87ba"}]: dispatch 2024-04-26T18:27:06.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:06 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1008706383' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a01cfe6-d13a-4828-8c20-ad7fee7e87ba"}]': finished 2024-04-26T18:27:06.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:06 smithi082 ceph-mon[32808]: osdmap e5: 1 total, 0 up, 1 in 2024-04-26T18:27:06.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:06 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T18:27:06.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:06 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1179787439' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:27:06.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:06 smithi082 ceph-mon[32808]: Standby manager daemon z started 2024-04-26T18:27:06.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:06 smithi082 ceph-mon[32808]: from='mgr.? 172.21.15.192:0/3256890028' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T18:27:06.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:06 smithi082 ceph-mon[32808]: from='mgr.? 172.21.15.192:0/3256890028' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T18:27:06.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:06 smithi082 ceph-mon[32808]: from='mgr.? 172.21.15.192:0/3256890028' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T18:27:06.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:06 smithi082 ceph-mon[32808]: from='mgr.? 172.21.15.192:0/3256890028' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T18:27:06.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:06.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:06 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1008706383' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a01cfe6-d13a-4828-8c20-ad7fee7e87ba"}]: dispatch 2024-04-26T18:27:06.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:06 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1008706383' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a01cfe6-d13a-4828-8c20-ad7fee7e87ba"}]': finished 2024-04-26T18:27:06.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:06 smithi080 ceph-mon[29135]: osdmap e5: 1 total, 0 up, 1 in 2024-04-26T18:27:06.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T18:27:06.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:06 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1179787439' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:27:06.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:06 smithi080 ceph-mon[29135]: Standby manager daemon z started 2024-04-26T18:27:06.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:06 smithi080 ceph-mon[29135]: from='mgr.? 172.21.15.192:0/3256890028' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T18:27:06.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:06 smithi080 ceph-mon[29135]: from='mgr.? 172.21.15.192:0/3256890028' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T18:27:06.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:06 smithi080 ceph-mon[29135]: from='mgr.? 172.21.15.192:0/3256890028' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T18:27:06.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:06 smithi080 ceph-mon[29135]: from='mgr.? 172.21.15.192:0/3256890028' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T18:27:06.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:06 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:06.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:06 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1008706383' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a01cfe6-d13a-4828-8c20-ad7fee7e87ba"}]: dispatch 2024-04-26T18:27:06.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:06 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1008706383' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a01cfe6-d13a-4828-8c20-ad7fee7e87ba"}]': finished 2024-04-26T18:27:06.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:06 smithi192 ceph-mon[32842]: osdmap e5: 1 total, 0 up, 1 in 2024-04-26T18:27:06.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:06 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T18:27:06.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:06 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1179787439' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:27:06.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:06 smithi192 ceph-mon[32842]: Standby manager daemon z started 2024-04-26T18:27:06.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:06 smithi192 ceph-mon[32842]: from='mgr.? 172.21.15.192:0/3256890028' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T18:27:06.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:06 smithi192 ceph-mon[32842]: from='mgr.? 172.21.15.192:0/3256890028' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T18:27:06.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:06 smithi192 ceph-mon[32842]: from='mgr.? 172.21.15.192:0/3256890028' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T18:27:06.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:06 smithi192 ceph-mon[32842]: from='mgr.? 172.21.15.192:0/3256890028' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T18:27:07.219 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:06 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:06.754+0000 7f4458304200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T18:27:07.625 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:07 smithi082 ceph-mon[32808]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:07.625 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:07 smithi082 ceph-mon[32808]: mgrmap e14: x(active, since 76s), standbys: z 2024-04-26T18:27:07.626 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:07 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T18:27:07.626 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:07 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:07.293+0000 7f4458304200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T18:27:07.626 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:07 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:07.384+0000 7f4458304200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T18:27:07.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:07 smithi080 ceph-mon[29135]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:07.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:07 smithi080 ceph-mon[29135]: mgrmap e14: x(active, since 76s), standbys: z 2024-04-26T18:27:07.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:07 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T18:27:07.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:07 smithi192 ceph-mon[32842]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:07.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:07 smithi192 ceph-mon[32842]: mgrmap e14: x(active, since 76s), standbys: z 2024-04-26T18:27:07.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:07 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T18:27:07.965 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:07 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:07.626+0000 7f4458304200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T18:27:07.966 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:07 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:07.757+0000 7f4458304200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T18:27:07.966 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:07 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:07.852+0000 7f4458304200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T18:27:07.966 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:07 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:07.966+0000 7f4458304200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T18:27:08.719 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:08 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:08.263+0000 7f4458304200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T18:27:09.219 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:08 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:08.858+0000 7f4458304200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T18:27:09.219 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:27:09 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:27:09.071+0000 7f4458304200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T18:27:09.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:09.489+0000 7fd51f7fe700 1 -- 172.21.15.80:0/3249249990 <== mon.0 v2:172.21.15.80:3300/0 8 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7fd520004b50 con 0x7fd530105020 2024-04-26T18:27:09.661 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:09 smithi080 ceph-mon[29135]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:09.661 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:09 smithi080 ceph-mon[29135]: Standby manager daemon y started 2024-04-26T18:27:09.661 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:09 smithi080 ceph-mon[29135]: from='mgr.? 172.21.15.82:0/3320632158' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T18:27:09.661 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:09 smithi080 ceph-mon[29135]: from='mgr.? 172.21.15.82:0/3320632158' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T18:27:09.662 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:09 smithi080 ceph-mon[29135]: from='mgr.? 172.21.15.82:0/3320632158' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T18:27:09.662 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:09 smithi080 ceph-mon[29135]: from='mgr.? 172.21.15.82:0/3320632158' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T18:27:09.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:09 smithi192 ceph-mon[32842]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:09.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:09 smithi192 ceph-mon[32842]: Standby manager daemon y started 2024-04-26T18:27:09.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:09 smithi192 ceph-mon[32842]: from='mgr.? 172.21.15.82:0/3320632158' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T18:27:09.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:09 smithi192 ceph-mon[32842]: from='mgr.? 172.21.15.82:0/3320632158' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T18:27:09.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:09 smithi192 ceph-mon[32842]: from='mgr.? 172.21.15.82:0/3320632158' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T18:27:09.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:09 smithi192 ceph-mon[32842]: from='mgr.? 172.21.15.82:0/3320632158' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T18:27:09.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:09 smithi082 ceph-mon[32808]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:09.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:09 smithi082 ceph-mon[32808]: Standby manager daemon y started 2024-04-26T18:27:09.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:09 smithi082 ceph-mon[32808]: from='mgr.? 172.21.15.82:0/3320632158' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T18:27:09.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:09 smithi082 ceph-mon[32808]: from='mgr.? 172.21.15.82:0/3320632158' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T18:27:09.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:09 smithi082 ceph-mon[32808]: from='mgr.? 172.21.15.82:0/3320632158' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T18:27:09.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:09 smithi082 ceph-mon[32808]: from='mgr.? 172.21.15.82:0/3320632158' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T18:27:10.685 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:10 smithi080 ceph-mon[29135]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-04-26T18:27:10.685 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:10 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T18:27:10.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:10 smithi082 ceph-mon[32808]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-04-26T18:27:10.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:10 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T18:27:10.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:10 smithi192 ceph-mon[32842]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-04-26T18:27:10.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:10 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T18:27:11.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:11 smithi192 ceph-mon[32842]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:11.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:11.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:11.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:27:11.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:11.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:27:11.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:11.883 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:11 smithi080 ceph-mon[29135]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:11.883 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:11.883 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:11.883 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:27:11.883 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:11.883 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:27:11.883 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:11.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:11 smithi082 ceph-mon[32808]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:11.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:11.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:11.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:27:11.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:11.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:27:11.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:13.822 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:13 smithi080 ceph-mon[29135]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:13.822 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T18:27:13.822 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:13.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:13 smithi192 ceph-mon[32842]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:13.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T18:27:13.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:13.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:13 smithi082 ceph-mon[32808]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:13.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T18:27:13.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:14.819 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:14 smithi080 ceph-mon[29135]: Deploying daemon osd.0 on smithi080 2024-04-26T18:27:14.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:14 smithi192 ceph-mon[32842]: Deploying daemon osd.0 on smithi080 2024-04-26T18:27:14.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:14 smithi082 ceph-mon[32808]: Deploying daemon osd.0 on smithi080 2024-04-26T18:27:15.820 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:15 smithi080 ceph-mon[29135]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:15.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:15 smithi192 ceph-mon[32842]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:15.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:15 smithi082 ceph-mon[32808]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:17.595 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:17 smithi080 ceph-mon[29135]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:17.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:17 smithi192 ceph-mon[32842]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:17.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:17 smithi082 ceph-mon[32808]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:19.645 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:19 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:19.645 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:19 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:19.645 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:19 smithi080 ceph-mon[29135]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:19.645 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:19 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:27:19.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:19 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:19.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:19 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:19.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:19 smithi082 ceph-mon[32808]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:19.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:19 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:27:19.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:19 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:19.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:19 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:19.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:19 smithi192 ceph-mon[32842]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:19.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:19 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:27:21.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:21.709+0000 7fd51f7fe700 1 -- 172.21.15.80:0/3249249990 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd530063860 con 0x7fd51803dca0 2024-04-26T18:27:21.710 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 0 on host 'smithi080' 2024-04-26T18:27:21.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:21.711+0000 7fd534bff700 1 -- 172.21.15.80:0/3249249990 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd51803dca0 msgr2=0x7fd518040160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:21.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:21.711+0000 7fd534bff700 1 --2- 172.21.15.80:0/3249249990 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd51803dca0 0x7fd518040160 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd528009e60 tx=0x7fd52800b040 comp rx=0 tx=0).stop 2024-04-26T18:27:21.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:21.711+0000 7fd534bff700 1 -- 172.21.15.80:0/3249249990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd530105020 msgr2=0x7fd5301a0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:21.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:21.711+0000 7fd534bff700 1 --2- 172.21.15.80:0/3249249990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd530105020 0x7fd5301a0bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd52000d780 tx=0x7fd52000da90 comp rx=0 tx=0).stop 2024-04-26T18:27:21.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:21.711+0000 7fd534bff700 1 -- 172.21.15.80:0/3249249990 shutdown_connections 2024-04-26T18:27:21.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:21.711+0000 7fd534bff700 1 --2- 172.21.15.80:0/3249249990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd530105020 0x7fd5301a0bf0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:21.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:21.711+0000 7fd534bff700 1 --2- 172.21.15.80:0/3249249990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd530103480 0x7fd530199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:21.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:21.711+0000 7fd534bff700 1 --2- 172.21.15.80:0/3249249990 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd51803dca0 0x7fd518040160 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:21.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:21.711+0000 7fd534bff700 1 --2- 172.21.15.80:0/3249249990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd530104680 0x7fd530199b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:21.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:21.711+0000 7fd534bff700 1 -- 172.21.15.80:0/3249249990 >> 172.21.15.80:0/3249249990 conn(0x7fd5300fea20 msgr2=0x7fd530107a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:21.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:21.711+0000 7fd534bff700 1 -- 172.21.15.80:0/3249249990 shutdown_connections 2024-04-26T18:27:21.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:27:21.711+0000 7fd534bff700 1 -- 172.21.15.80:0/3249249990 wait complete. 2024-04-26T18:27:21.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:21 smithi080 ceph-mon[29135]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:21.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:21 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:21.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:21 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:21.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:21 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:21.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:21 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:27:21.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:21 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:21.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:21 smithi192 ceph-mon[32842]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:21.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:21 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:21.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:21 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:21.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:21 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:21.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:21 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:27:21.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:21 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:21.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:21 smithi082 ceph-mon[32808]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:21.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:21 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:21.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:21 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:21.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:21 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:21.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:21 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:27:21.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:21 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:22.304 DEBUG:teuthology.orchestra.run.smithi080:osd.0> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.0.service 2024-04-26T18:27:22.306 INFO:tasks.cephadm:Deploying osd.1 on smithi082 with /dev/vg_nvme/lv_4... 2024-04-26T18:27:22.306 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-26T18:27:22.548 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T18:27:22.604 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:27:22 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-0[41147]: 2024-04-26T18:27:22.346+0000 7f4dae5b27c0 -1 osd.0 0 log_to_monitors true 2024-04-26T18:27:22.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:22 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:22.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:22 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:22.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:22 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:27:22.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:22 smithi082 ceph-mon[32808]: from='osd.0 [v2:172.21.15.80:6802/429487384,v1:172.21.15.80:6803/429487384]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T18:27:22.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:22 smithi082 ceph-mon[32808]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:22.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:22 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:22.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:22 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:22.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:22 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:27:22.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:22 smithi080 ceph-mon[29135]: from='osd.0 [v2:172.21.15.80:6802/429487384,v1:172.21.15.80:6803/429487384]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T18:27:22.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:22 smithi080 ceph-mon[29135]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:23.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:22 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:23.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:22 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:23.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:22 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:27:23.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:22 smithi192 ceph-mon[32842]: from='osd.0 [v2:172.21.15.80:6802/429487384,v1:172.21.15.80:6803/429487384]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T18:27:23.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:22 smithi192 ceph-mon[32842]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:23.855 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:23 smithi082 ceph-mon[32808]: from='osd.0 [v2:172.21.15.80:6802/429487384,v1:172.21.15.80:6803/429487384]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-26T18:27:23.855 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:23 smithi082 ceph-mon[32808]: osdmap e6: 1 total, 0 up, 1 in 2024-04-26T18:27:23.855 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:23 smithi082 ceph-mon[32808]: from='osd.0 [v2:172.21.15.80:6802/429487384,v1:172.21.15.80:6803/429487384]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T18:27:23.855 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:23 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T18:27:23.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:23 smithi080 ceph-mon[29135]: from='osd.0 [v2:172.21.15.80:6802/429487384,v1:172.21.15.80:6803/429487384]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-26T18:27:23.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:23 smithi080 ceph-mon[29135]: osdmap e6: 1 total, 0 up, 1 in 2024-04-26T18:27:23.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:23 smithi080 ceph-mon[29135]: from='osd.0 [v2:172.21.15.80:6802/429487384,v1:172.21.15.80:6803/429487384]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T18:27:23.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:23 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T18:27:23.994 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:27:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-0[41147]: 2024-04-26T18:27:23.703+0000 7f4da3c17700 -1 osd.0 0 waiting for initial osdmap 2024-04-26T18:27:23.994 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:27:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-0[41147]: 2024-04-26T18:27:23.709+0000 7f4d9fa0a700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T18:27:24.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:23 smithi192 ceph-mon[32842]: from='osd.0 [v2:172.21.15.80:6802/429487384,v1:172.21.15.80:6803/429487384]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-26T18:27:24.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:23 smithi192 ceph-mon[32842]: osdmap e6: 1 total, 0 up, 1 in 2024-04-26T18:27:24.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:23 smithi192 ceph-mon[32842]: from='osd.0 [v2:172.21.15.80:6802/429487384,v1:172.21.15.80:6803/429487384]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T18:27:24.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:23 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T18:27:24.414 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-26T18:27:24.414 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-26T18:27:24.415 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-04-26T18:27:24.415 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-04-26T18:27:24.415 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113637 s, 923 MB/s 2024-04-26T18:27:24.415 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-04-26T18:27:24.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:24 smithi080 ceph-mon[29135]: from='osd.0 [v2:172.21.15.80:6802/429487384,v1:172.21.15.80:6803/429487384]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-26T18:27:24.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:24 smithi080 ceph-mon[29135]: osdmap e7: 1 total, 0 up, 1 in 2024-04-26T18:27:24.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:24 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T18:27:24.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:24 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T18:27:24.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:24 smithi080 ceph-mon[29135]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:24.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:24 smithi082 ceph-mon[32808]: from='osd.0 [v2:172.21.15.80:6802/429487384,v1:172.21.15.80:6803/429487384]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-26T18:27:24.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:24 smithi082 ceph-mon[32808]: osdmap e7: 1 total, 0 up, 1 in 2024-04-26T18:27:24.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:24 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T18:27:24.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:24 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T18:27:24.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:24 smithi082 ceph-mon[32808]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:25.040 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_4 2024-04-26T18:27:25.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:24 smithi192 ceph-mon[32842]: from='osd.0 [v2:172.21.15.80:6802/429487384,v1:172.21.15.80:6803/429487384]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-26T18:27:25.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:24 smithi192 ceph-mon[32842]: osdmap e7: 1 total, 0 up, 1 in 2024-04-26T18:27:25.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:24 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T18:27:25.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:24 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T18:27:25.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:24 smithi192 ceph-mon[32842]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T18:27:25.287 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T18:27:25.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:25 smithi082 ceph-mon[32808]: purged_snaps scrub starts 2024-04-26T18:27:25.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:25 smithi082 ceph-mon[32808]: purged_snaps scrub ok 2024-04-26T18:27:25.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:25 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T18:27:25.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:25 smithi082 ceph-mon[32808]: osd.0 [v2:172.21.15.80:6802/429487384,v1:172.21.15.80:6803/429487384] boot 2024-04-26T18:27:25.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:25 smithi082 ceph-mon[32808]: osdmap e8: 1 total, 1 up, 1 in 2024-04-26T18:27:25.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:25 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T18:27:25.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:25 smithi082 ceph-mon[32808]: Detected new or changed devices on smithi080 2024-04-26T18:27:25.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:25 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:25.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:25 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:25.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:25 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:27:25.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:25 smithi082 ceph-mon[32808]: Adjusting osd_memory_target on smithi080 to 17088M 2024-04-26T18:27:25.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:25 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:25.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:25 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:25.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:25 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:27:25.972 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:25 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:25.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:25 smithi080 ceph-mon[29135]: purged_snaps scrub starts 2024-04-26T18:27:25.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:25 smithi080 ceph-mon[29135]: purged_snaps scrub ok 2024-04-26T18:27:25.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:25 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T18:27:25.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:25 smithi080 ceph-mon[29135]: osd.0 [v2:172.21.15.80:6802/429487384,v1:172.21.15.80:6803/429487384] boot 2024-04-26T18:27:25.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:25 smithi080 ceph-mon[29135]: osdmap e8: 1 total, 1 up, 1 in 2024-04-26T18:27:25.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:25 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T18:27:25.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:25 smithi080 ceph-mon[29135]: Detected new or changed devices on smithi080 2024-04-26T18:27:25.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:25 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:25.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:25 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:25.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:25 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:27:25.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:25 smithi080 ceph-mon[29135]: Adjusting osd_memory_target on smithi080 to 17088M 2024-04-26T18:27:25.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:25 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:25.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:25 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:25.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:25 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:27:25.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:25 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:26.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:25 smithi192 ceph-mon[32842]: purged_snaps scrub starts 2024-04-26T18:27:26.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:25 smithi192 ceph-mon[32842]: purged_snaps scrub ok 2024-04-26T18:27:26.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:25 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T18:27:26.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:25 smithi192 ceph-mon[32842]: osd.0 [v2:172.21.15.80:6802/429487384,v1:172.21.15.80:6803/429487384] boot 2024-04-26T18:27:26.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:25 smithi192 ceph-mon[32842]: osdmap e8: 1 total, 1 up, 1 in 2024-04-26T18:27:26.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:25 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T18:27:26.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:25 smithi192 ceph-mon[32842]: Detected new or changed devices on smithi080 2024-04-26T18:27:26.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:25 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:26.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:25 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:26.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:25 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:27:26.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:25 smithi192 ceph-mon[32842]: Adjusting osd_memory_target on smithi080 to 17088M 2024-04-26T18:27:26.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:25 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:26.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:25 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:26.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:25 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:27:26.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:25 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:26.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.664+0000 7f0c72930700 1 -- 172.21.15.82:0/927287175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c6c1036b0 msgr2=0x7f0c6c109f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:26.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.664+0000 7f0c72930700 1 --2- 172.21.15.82:0/927287175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c6c1036b0 0x7f0c6c109f60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0c6400b0d0 tx=0x7f0c6400b3e0 comp rx=0 tx=0).stop 2024-04-26T18:27:26.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.664+0000 7f0c72930700 1 -- 172.21.15.82:0/927287175 shutdown_connections 2024-04-26T18:27:26.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.664+0000 7f0c72930700 1 --2- 172.21.15.82:0/927287175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c6c1036b0 0x7f0c6c109f60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:26.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.664+0000 7f0c72930700 1 --2- 172.21.15.82:0/927287175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c6c101b10 0x7f0c6c101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:26.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.664+0000 7f0c72930700 1 --2- 172.21.15.82:0/927287175 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c6c102d10 0x7f0c6c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:26.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.664+0000 7f0c72930700 1 -- 172.21.15.82:0/927287175 >> 172.21.15.82:0/927287175 conn(0x7f0c6c0fd090 msgr2=0x7f0c6c0ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:26.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.664+0000 7f0c72930700 1 -- 172.21.15.82:0/927287175 shutdown_connections 2024-04-26T18:27:26.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.664+0000 7f0c72930700 1 -- 172.21.15.82:0/927287175 wait complete. 2024-04-26T18:27:26.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.665+0000 7f0c72930700 1 Processor -- start 2024-04-26T18:27:26.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.665+0000 7f0c72930700 1 -- start start 2024-04-26T18:27:26.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.665+0000 7f0c72930700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c6c101b10 0x7f0c6c105aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:26.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.665+0000 7f0c72930700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c6c102d10 0x7f0c6c1040f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.665+0000 7f0c72930700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c6c1036b0 0x7f0c6c104630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.665+0000 7f0c72930700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c10d600 con 0x7f0c6c101b10 2024-04-26T18:27:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.665+0000 7f0c72930700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c10d480 con 0x7f0c6c102d10 2024-04-26T18:27:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.665+0000 7f0c72930700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c10d780 con 0x7f0c6c1036b0 2024-04-26T18:27:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.665+0000 7f0c6b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c6c102d10 0x7f0c6c1040f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.665+0000 7f0c6b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c6c102d10 0x7f0c6c1040f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38232/0 (socket says 172.21.15.82:38232) 2024-04-26T18:27:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.665+0000 7f0c6b7fe700 1 -- 172.21.15.82:0/2409447710 learned_addr learned my addr 172.21.15.82:0/2409447710 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T18:27:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.665+0000 7f0c6bfff700 1 --2- 172.21.15.82:0/2409447710 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c6c101b10 0x7f0c6c105aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.665+0000 7f0c70ecd700 1 --2- 172.21.15.82:0/2409447710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c6c1036b0 0x7f0c6c104630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.666+0000 7f0c6b7fe700 1 -- 172.21.15.82:0/2409447710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c6c1036b0 msgr2=0x7f0c6c104630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.666+0000 7f0c6b7fe700 1 --2- 172.21.15.82:0/2409447710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c6c1036b0 0x7f0c6c104630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.666+0000 7f0c6b7fe700 1 -- 172.21.15.82:0/2409447710 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c6c101b10 msgr2=0x7f0c6c105aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.666+0000 7f0c6b7fe700 1 --2- 172.21.15.82:0/2409447710 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c6c101b10 0x7f0c6c105aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.666+0000 7f0c6b7fe700 1 -- 172.21.15.82:0/2409447710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c6c104ee0 con 0x7f0c6c102d10 2024-04-26T18:27:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.666+0000 7f0c6bfff700 1 --2- 172.21.15.82:0/2409447710 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c6c101b10 0x7f0c6c105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:27:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.666+0000 7f0c6b7fe700 1 --2- 172.21.15.82:0/2409447710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c6c102d10 0x7f0c6c1040f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000b530 tx=0x7f0c6000b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.666+0000 7f0c697fa700 1 -- 172.21.15.82:0/2409447710 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c60015020 con 0x7f0c6c102d10 2024-04-26T18:27:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.666+0000 7f0c72930700 1 -- 172.21.15.82:0/2409447710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c6c1a36e0 con 0x7f0c6c102d10 2024-04-26T18:27:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.666+0000 7f0c697fa700 1 -- 172.21.15.82:0/2409447710 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c60011ce0 con 0x7f0c6c102d10 2024-04-26T18:27:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.666+0000 7f0c697fa700 1 -- 172.21.15.82:0/2409447710 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c60010dd0 con 0x7f0c6c102d10 2024-04-26T18:27:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.666+0000 7f0c72930700 1 -- 172.21.15.82:0/2409447710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c6c1a3c20 con 0x7f0c6c102d10 2024-04-26T18:27:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.667+0000 7f0c72930700 1 -- 172.21.15.82:0/2409447710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c6c06a110 con 0x7f0c6c102d10 2024-04-26T18:27:26.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.668+0000 7f0c697fa700 1 -- 172.21.15.82:0/2409447710 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7f0c60018020 con 0x7f0c6c102d10 2024-04-26T18:27:26.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.669+0000 7f0c697fa700 1 --2- 172.21.15.82:0/2409447710 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f0c540a3bb0 0x7f0c540a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:26.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.669+0000 7f0c697fa700 1 -- 172.21.15.82:0/2409447710 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f0c600ce010 con 0x7f0c6c102d10 2024-04-26T18:27:26.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.669+0000 7f0c6bfff700 1 --2- 172.21.15.82:0/2409447710 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f0c540a3bb0 0x7f0c540a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:26.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.670+0000 7f0c6bfff700 1 --2- 172.21.15.82:0/2409447710 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f0c540a3bb0 0x7f0c540a6070 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c102b70 tx=0x7f0c5c00b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:26.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.674+0000 7f0c697fa700 1 -- 172.21.15.82:0/2409447710 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0c6001f020 con 0x7f0c6c102d10 2024-04-26T18:27:26.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:26.878+0000 7f0c72930700 1 -- 172.21.15.82:0/2409447710 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f0c6c1a3ee0 con 0x7f0c540a3bb0 2024-04-26T18:27:27.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:27 smithi082 ceph-mon[32808]: osdmap e9: 1 total, 1 up, 1 in 2024-04-26T18:27:27.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:27 smithi082 ceph-mon[32808]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:27.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:27 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:27:27.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:27 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:27:27.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:27 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:27.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:27 smithi080 ceph-mon[29135]: osdmap e9: 1 total, 1 up, 1 in 2024-04-26T18:27:27.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:27 smithi080 ceph-mon[29135]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:27.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:27:27.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:27:27.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:27.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:27 smithi192 ceph-mon[32842]: osdmap e9: 1 total, 1 up, 1 in 2024-04-26T18:27:27.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:27 smithi192 ceph-mon[32842]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:27.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:27 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:27:27.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:27 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:27:27.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:27 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:28.360 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:28 smithi082 ceph-mon[32808]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:27:28.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:28 smithi080 ceph-mon[29135]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:27:28.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:28 smithi192 ceph-mon[32842]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:27:29.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:29 smithi082 ceph-mon[32808]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:29.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:29 smithi080 ceph-mon[29135]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:29.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:29 smithi192 ceph-mon[32842]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:30.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:30 smithi082 ceph-mon[32808]: from='client.? 172.21.15.82:0/1920179212' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f815d88-30b1-4540-b4f5-cc3d62707318"}]: dispatch 2024-04-26T18:27:30.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:30 smithi082 ceph-mon[32808]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f815d88-30b1-4540-b4f5-cc3d62707318"}]: dispatch 2024-04-26T18:27:30.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:30 smithi082 ceph-mon[32808]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f815d88-30b1-4540-b4f5-cc3d62707318"}]': finished 2024-04-26T18:27:30.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:30 smithi082 ceph-mon[32808]: osdmap e10: 2 total, 1 up, 2 in 2024-04-26T18:27:30.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:30 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T18:27:30.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:30 smithi082 ceph-mon[32808]: from='client.? 172.21.15.82:0/1399844552' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:27:30.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:30 smithi080 ceph-mon[29135]: from='client.? 172.21.15.82:0/1920179212' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f815d88-30b1-4540-b4f5-cc3d62707318"}]: dispatch 2024-04-26T18:27:30.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:30 smithi080 ceph-mon[29135]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f815d88-30b1-4540-b4f5-cc3d62707318"}]: dispatch 2024-04-26T18:27:30.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:30 smithi080 ceph-mon[29135]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f815d88-30b1-4540-b4f5-cc3d62707318"}]': finished 2024-04-26T18:27:30.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:30 smithi080 ceph-mon[29135]: osdmap e10: 2 total, 1 up, 2 in 2024-04-26T18:27:30.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:30 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T18:27:30.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:30 smithi080 ceph-mon[29135]: from='client.? 172.21.15.82:0/1399844552' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:27:30.513 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:30 smithi192 ceph-mon[32842]: from='client.? 172.21.15.82:0/1920179212' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f815d88-30b1-4540-b4f5-cc3d62707318"}]: dispatch 2024-04-26T18:27:30.513 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:30 smithi192 ceph-mon[32842]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f815d88-30b1-4540-b4f5-cc3d62707318"}]: dispatch 2024-04-26T18:27:30.514 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:30 smithi192 ceph-mon[32842]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f815d88-30b1-4540-b4f5-cc3d62707318"}]': finished 2024-04-26T18:27:30.514 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:30 smithi192 ceph-mon[32842]: osdmap e10: 2 total, 1 up, 2 in 2024-04-26T18:27:30.514 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:30 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T18:27:30.514 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:30 smithi192 ceph-mon[32842]: from='client.? 172.21.15.82:0/1399844552' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:27:31.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:31 smithi082 ceph-mon[32808]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:31.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:31 smithi080 ceph-mon[29135]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:31.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:31 smithi192 ceph-mon[32842]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:33.618 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:33 smithi082 ceph-mon[32808]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:33.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:33 smithi080 ceph-mon[29135]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:33.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:33 smithi192 ceph-mon[32842]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:35.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:35 smithi082 ceph-mon[32808]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:35.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:35 smithi080 ceph-mon[29135]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:35.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:35 smithi192 ceph-mon[32842]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:36.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:36 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T18:27:36.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:36 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:36.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:36 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T18:27:36.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:36 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:36.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:36 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T18:27:36.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:36 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:37.698 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:37 smithi082 ceph-mon[32808]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:37.698 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:37 smithi082 ceph-mon[32808]: Deploying daemon osd.1 on smithi082 2024-04-26T18:27:37.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:37 smithi192 ceph-mon[32842]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:37.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:37 smithi192 ceph-mon[32842]: Deploying daemon osd.1 on smithi082 2024-04-26T18:27:37.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:37 smithi080 ceph-mon[29135]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:37.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:37 smithi080 ceph-mon[29135]: Deploying daemon osd.1 on smithi082 2024-04-26T18:27:39.812 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:39 smithi082 ceph-mon[32808]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:39.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:39 smithi192 ceph-mon[32842]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:39.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:39 smithi080 ceph-mon[29135]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:41.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:41 smithi082 ceph-mon[32808]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:41.775 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:41 smithi192 ceph-mon[32842]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:41.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:41 smithi080 ceph-mon[29135]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:42.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:42 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:42.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:42 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:42.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:42 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:27:42.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:42 smithi082 ceph-mon[32808]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:42.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:42 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:42.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:42 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:42.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:42 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:27:42.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:42 smithi080 ceph-mon[29135]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:43.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:42 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:43.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:42 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:43.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:42 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:27:43.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:42 smithi192 ceph-mon[32842]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:45.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:45.047+0000 7f0c697fa700 1 -- 172.21.15.82:0/2409447710 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0c6c1a3ee0 con 0x7f0c540a3bb0 2024-04-26T18:27:45.048 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 1 on host 'smithi082' 2024-04-26T18:27:45.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:45.049+0000 7f0c72930700 1 -- 172.21.15.82:0/2409447710 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f0c540a3bb0 msgr2=0x7f0c540a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:45.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:45.049+0000 7f0c72930700 1 --2- 172.21.15.82:0/2409447710 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f0c540a3bb0 0x7f0c540a6070 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c102b70 tx=0x7f0c5c00b410 comp rx=0 tx=0).stop 2024-04-26T18:27:45.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:45.049+0000 7f0c72930700 1 -- 172.21.15.82:0/2409447710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c6c102d10 msgr2=0x7f0c6c1040f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:45.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:45.049+0000 7f0c72930700 1 --2- 172.21.15.82:0/2409447710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c6c102d10 0x7f0c6c1040f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000b530 tx=0x7f0c6000b840 comp rx=0 tx=0).stop 2024-04-26T18:27:45.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:45.049+0000 7f0c72930700 1 -- 172.21.15.82:0/2409447710 shutdown_connections 2024-04-26T18:27:45.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:45.049+0000 7f0c72930700 1 --2- 172.21.15.82:0/2409447710 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f0c540a3bb0 0x7f0c540a6070 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:45.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:45.049+0000 7f0c72930700 1 --2- 172.21.15.82:0/2409447710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c6c1036b0 0x7f0c6c104630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:45.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:45.049+0000 7f0c72930700 1 --2- 172.21.15.82:0/2409447710 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c6c101b10 0x7f0c6c105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:45.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:45.049+0000 7f0c72930700 1 --2- 172.21.15.82:0/2409447710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c6c102d10 0x7f0c6c1040f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:45.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:45.049+0000 7f0c72930700 1 -- 172.21.15.82:0/2409447710 >> 172.21.15.82:0/2409447710 conn(0x7f0c6c0fd090 msgr2=0x7f0c6c0feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:45.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:45.049+0000 7f0c72930700 1 -- 172.21.15.82:0/2409447710 shutdown_connections 2024-04-26T18:27:45.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:27:45.049+0000 7f0c72930700 1 -- 172.21.15.82:0/2409447710 wait complete. 2024-04-26T18:27:45.347 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:45 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:45.348 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:45 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:45.348 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:45 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:45.348 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:45 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:27:45.348 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:45 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:45.348 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:45 smithi082 ceph-mon[32808]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:45.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:45 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:45.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:45 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:45.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:45 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:45.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:45 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:27:45.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:45 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:45.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:45 smithi192 ceph-mon[32842]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:45.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:45 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:45.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:45 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:45.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:45 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:45.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:45 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:27:45.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:45 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:45.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:45 smithi080 ceph-mon[29135]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:45.666 DEBUG:teuthology.orchestra.run.smithi082:osd.1> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.1.service 2024-04-26T18:27:45.668 INFO:tasks.cephadm:Deploying osd.2 on smithi192 with /dev/vg_nvme/lv_4... 2024-04-26T18:27:45.669 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-26T18:27:45.910 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T18:27:46.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:46 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:46.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:46 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:46.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:46 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:27:46.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:46 smithi082 ceph-mon[32808]: from='osd.1 [v2:172.21.15.82:6800/3913033849,v1:172.21.15.82:6801/3913033849]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T18:27:46.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:46 smithi082 ceph-mon[32808]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T18:27:46.266 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:46 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:46.266 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:46 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:46.266 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:46 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:27:46.266 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:46 smithi192 ceph-mon[32842]: from='osd.1 [v2:172.21.15.82:6800/3913033849,v1:172.21.15.82:6801/3913033849]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T18:27:46.266 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:46 smithi192 ceph-mon[32842]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T18:27:46.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:46 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:46.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:46 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:46.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:46 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:27:46.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:46 smithi080 ceph-mon[29135]: from='osd.1 [v2:172.21.15.82:6800/3913033849,v1:172.21.15.82:6801/3913033849]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T18:27:46.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:46 smithi080 ceph-mon[29135]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T18:27:47.091 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:47 smithi082 ceph-mon[32808]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-26T18:27:47.091 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:47 smithi082 ceph-mon[32808]: from='osd.1 [v2:172.21.15.82:6800/3913033849,v1:172.21.15.82:6801/3913033849]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T18:27:47.091 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:47 smithi082 ceph-mon[32808]: osdmap e11: 2 total, 1 up, 2 in 2024-04-26T18:27:47.092 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:47 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T18:27:47.092 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:47 smithi082 ceph-mon[32808]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T18:27:47.092 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:47 smithi082 ceph-mon[32808]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:47.260 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:47 smithi192 ceph-mon[32842]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-26T18:27:47.260 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:47 smithi192 ceph-mon[32842]: from='osd.1 [v2:172.21.15.82:6800/3913033849,v1:172.21.15.82:6801/3913033849]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T18:27:47.260 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:47 smithi192 ceph-mon[32842]: osdmap e11: 2 total, 1 up, 2 in 2024-04-26T18:27:47.260 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:47 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T18:27:47.260 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:47 smithi192 ceph-mon[32842]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T18:27:47.260 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:47 smithi192 ceph-mon[32842]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:47.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:47 smithi080 ceph-mon[29135]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-26T18:27:47.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:47 smithi080 ceph-mon[29135]: from='osd.1 [v2:172.21.15.82:6800/3913033849,v1:172.21.15.82:6801/3913033849]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T18:27:47.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:47 smithi080 ceph-mon[29135]: osdmap e11: 2 total, 1 up, 2 in 2024-04-26T18:27:47.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:47 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T18:27:47.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:47 smithi080 ceph-mon[29135]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T18:27:47.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:47 smithi080 ceph-mon[29135]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:47.826 INFO:teuthology.orchestra.run.smithi192.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-26T18:27:47.826 INFO:teuthology.orchestra.run.smithi192.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-26T18:27:47.826 INFO:teuthology.orchestra.run.smithi192.stderr: stderr: 10+0 records in 2024-04-26T18:27:47.826 INFO:teuthology.orchestra.run.smithi192.stderr:10+0 records out 2024-04-26T18:27:47.826 INFO:teuthology.orchestra.run.smithi192.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113153 s, 927 MB/s 2024-04-26T18:27:47.826 INFO:teuthology.orchestra.run.smithi192.stderr:--> Zapping successful for: 2024-04-26T18:27:47.962 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 26 18:27:47 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-1[37421]: 2024-04-26T18:27:47.511+0000 7f5a76995700 -1 osd.1 0 waiting for initial osdmap 2024-04-26T18:27:47.963 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 26 18:27:47 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-1[37421]: 2024-04-26T18:27:47.514+0000 7f5a6df7f700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T18:27:48.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:48 smithi082 ceph-mon[32808]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-26T18:27:48.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:48 smithi082 ceph-mon[32808]: osdmap e12: 2 total, 1 up, 2 in 2024-04-26T18:27:48.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:48 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T18:27:48.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:48 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T18:27:48.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:48 smithi082 ceph-mon[32808]: from='osd.1 ' entity='osd.1' 2024-04-26T18:27:48.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:48 smithi192 ceph-mon[32842]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-26T18:27:48.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:48 smithi192 ceph-mon[32842]: osdmap e12: 2 total, 1 up, 2 in 2024-04-26T18:27:48.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:48 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T18:27:48.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:48 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T18:27:48.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:48 smithi192 ceph-mon[32842]: from='osd.1 ' entity='osd.1' 2024-04-26T18:27:48.394 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:48 smithi080 ceph-mon[29135]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-26T18:27:48.394 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:48 smithi080 ceph-mon[29135]: osdmap e12: 2 total, 1 up, 2 in 2024-04-26T18:27:48.395 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:48 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T18:27:48.395 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:48 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T18:27:48.395 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:48 smithi080 ceph-mon[29135]: from='osd.1 ' entity='osd.1' 2024-04-26T18:27:48.482 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi192:vg_nvme/lv_4 2024-04-26T18:27:48.723 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T18:27:49.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:49 smithi192 ceph-mon[32842]: purged_snaps scrub starts 2024-04-26T18:27:49.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:49 smithi192 ceph-mon[32842]: purged_snaps scrub ok 2024-04-26T18:27:49.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:49 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T18:27:49.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:49 smithi192 ceph-mon[32842]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:49.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:49 smithi192 ceph-mon[32842]: osd.1 [v2:172.21.15.82:6800/3913033849,v1:172.21.15.82:6801/3913033849] boot 2024-04-26T18:27:49.364 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:49 smithi192 ceph-mon[32842]: osdmap e13: 2 total, 2 up, 2 in 2024-04-26T18:27:49.364 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:49 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T18:27:49.364 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:49 smithi192 ceph-mon[32842]: Detected new or changed devices on smithi082 2024-04-26T18:27:49.364 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:49 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:49.364 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:49 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:49.364 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:49 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:27:49.364 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:49 smithi192 ceph-mon[32842]: Adjusting osd_memory_target on smithi082 to 17088M 2024-04-26T18:27:49.365 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:49 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:49.365 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:49 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:49.365 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:49 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:27:49.365 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:49 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:49.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:49 smithi082 ceph-mon[32808]: purged_snaps scrub starts 2024-04-26T18:27:49.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:49 smithi082 ceph-mon[32808]: purged_snaps scrub ok 2024-04-26T18:27:49.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:49 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T18:27:49.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:49 smithi082 ceph-mon[32808]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:49.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:49 smithi082 ceph-mon[32808]: osd.1 [v2:172.21.15.82:6800/3913033849,v1:172.21.15.82:6801/3913033849] boot 2024-04-26T18:27:49.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:49 smithi082 ceph-mon[32808]: osdmap e13: 2 total, 2 up, 2 in 2024-04-26T18:27:49.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:49 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T18:27:49.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:49 smithi082 ceph-mon[32808]: Detected new or changed devices on smithi082 2024-04-26T18:27:49.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:49 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:49.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:49 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:49.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:49 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:27:49.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:49 smithi082 ceph-mon[32808]: Adjusting osd_memory_target on smithi082 to 17088M 2024-04-26T18:27:49.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:49 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:49.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:49 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:49.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:49 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:27:49.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:49 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:49.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:49 smithi080 ceph-mon[29135]: purged_snaps scrub starts 2024-04-26T18:27:49.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:49 smithi080 ceph-mon[29135]: purged_snaps scrub ok 2024-04-26T18:27:49.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:49 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T18:27:49.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:49 smithi080 ceph-mon[29135]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T18:27:49.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:49 smithi080 ceph-mon[29135]: osd.1 [v2:172.21.15.82:6800/3913033849,v1:172.21.15.82:6801/3913033849] boot 2024-04-26T18:27:49.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:49 smithi080 ceph-mon[29135]: osdmap e13: 2 total, 2 up, 2 in 2024-04-26T18:27:49.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:49 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T18:27:49.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:49 smithi080 ceph-mon[29135]: Detected new or changed devices on smithi082 2024-04-26T18:27:49.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:49 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:49.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:49 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:49.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:49 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:27:49.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:49 smithi080 ceph-mon[29135]: Adjusting osd_memory_target on smithi082 to 17088M 2024-04-26T18:27:49.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:49 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:49.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:49 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:49.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:49 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:27:49.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:49 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:27:50.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.291+0000 7fa27f46a700 1 -- 172.21.15.192:0/3338684285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa278104690 msgr2=0x7fa278104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:50.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.291+0000 7fa27f46a700 1 --2- 172.21.15.192:0/3338684285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa278104690 0x7fa278104af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa268009990 tx=0x7fa268009ca0 comp rx=0 tx=0).stop 2024-04-26T18:27:50.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.291+0000 7fa27f46a700 1 -- 172.21.15.192:0/3338684285 shutdown_connections 2024-04-26T18:27:50.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.291+0000 7fa27f46a700 1 --2- 172.21.15.192:0/3338684285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa278105030 0x7fa27810b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:50.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.291+0000 7fa27f46a700 1 --2- 172.21.15.192:0/3338684285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa278103490 0x7fa2781038b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:50.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.291+0000 7fa27f46a700 1 --2- 172.21.15.192:0/3338684285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa278104690 0x7fa278104af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:50.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.291+0000 7fa27f46a700 1 -- 172.21.15.192:0/3338684285 >> 172.21.15.192:0/3338684285 conn(0x7fa2780fe9f0 msgr2=0x7fa278100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:50.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.291+0000 7fa27f46a700 1 -- 172.21.15.192:0/3338684285 shutdown_connections 2024-04-26T18:27:50.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.291+0000 7fa27f46a700 1 -- 172.21.15.192:0/3338684285 wait complete. 2024-04-26T18:27:50.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.292+0000 7fa27f46a700 1 Processor -- start 2024-04-26T18:27:50.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.292+0000 7fa27f46a700 1 -- start start 2024-04-26T18:27:50.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.292+0000 7fa27f46a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa278103490 0x7fa278199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:50.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.292+0000 7fa27f46a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa278104690 0x7fa278199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:50.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.292+0000 7fa27f46a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa278105030 0x7fa2781a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:50.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.292+0000 7fa27f46a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa27810ef60 con 0x7fa278105030 2024-04-26T18:27:50.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.292+0000 7fa27f46a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa27810ede0 con 0x7fa278103490 2024-04-26T18:27:50.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.292+0000 7fa27f46a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa27810f0e0 con 0x7fa278104690 2024-04-26T18:27:50.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.292+0000 7fa27ca05700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa278104690 0x7fa278199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:50.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.292+0000 7fa27ca05700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa278104690 0x7fa278199ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:60234/0 (socket says 172.21.15.192:60234) 2024-04-26T18:27:50.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.292+0000 7fa27ca05700 1 -- 172.21.15.192:0/1257742278 learned_addr learned my addr 172.21.15.192:0/1257742278 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-04-26T18:27:50.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.292+0000 7fa27da07700 1 --2- 172.21.15.192:0/1257742278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa278105030 0x7fa2781a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:50.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.292+0000 7fa27d206700 1 --2- 172.21.15.192:0/1257742278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa278103490 0x7fa278199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:50.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.292+0000 7fa27ca05700 1 -- 172.21.15.192:0/1257742278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa278103490 msgr2=0x7fa278199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:50.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.292+0000 7fa27ca05700 1 --2- 172.21.15.192:0/1257742278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa278103490 0x7fa278199570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:50.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.292+0000 7fa27ca05700 1 -- 172.21.15.192:0/1257742278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa278105030 msgr2=0x7fa2781a0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:50.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.292+0000 7fa27ca05700 1 --2- 172.21.15.192:0/1257742278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa278105030 0x7fa2781a0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:50.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.292+0000 7fa27ca05700 1 -- 172.21.15.192:0/1257742278 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2781a11d0 con 0x7fa278104690 2024-04-26T18:27:50.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.292+0000 7fa27da07700 1 --2- 172.21.15.192:0/1257742278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa278105030 0x7fa2781a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:27:50.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.293+0000 7fa27ca05700 1 --2- 172.21.15.192:0/1257742278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa278104690 0x7fa278199ab0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa2680036f0 tx=0x7fa268005ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:50.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.293+0000 7fa26e7fc700 1 -- 172.21.15.192:0/1257742278 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa268027070 con 0x7fa278104690 2024-04-26T18:27:50.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.293+0000 7fa27f46a700 1 -- 172.21.15.192:0/1257742278 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2781a1460 con 0x7fa278104690 2024-04-26T18:27:50.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.293+0000 7fa26e7fc700 1 -- 172.21.15.192:0/1257742278 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa268004180 con 0x7fa278104690 2024-04-26T18:27:50.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.293+0000 7fa26e7fc700 1 -- 172.21.15.192:0/1257742278 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa268022e30 con 0x7fa278104690 2024-04-26T18:27:50.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.293+0000 7fa27f46a700 1 -- 172.21.15.192:0/1257742278 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2781a1910 con 0x7fa278104690 2024-04-26T18:27:50.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.294+0000 7fa27f46a700 1 -- 172.21.15.192:0/1257742278 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa27806a110 con 0x7fa278104690 2024-04-26T18:27:50.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.295+0000 7fa26e7fc700 1 -- 172.21.15.192:0/1257742278 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7fa26802a070 con 0x7fa278104690 2024-04-26T18:27:50.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.295+0000 7fa26e7fc700 1 --2- 172.21.15.192:0/1257742278 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fa2640a3bb0 0x7fa2640a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:50.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.296+0000 7fa26e7fc700 1 -- 172.21.15.192:0/1257742278 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7fa2680cffa0 con 0x7fa278104690 2024-04-26T18:27:50.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.296+0000 7fa27d206700 1 --2- 172.21.15.192:0/1257742278 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fa2640a3bb0 0x7fa2640a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:50.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.296+0000 7fa27d206700 1 --2- 172.21.15.192:0/1257742278 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fa2640a3bb0 0x7fa2640a6070 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa274005fd0 tx=0x7fa274005e50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:50.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.299+0000 7fa26e7fc700 1 -- 172.21.15.192:0/1257742278 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa268013070 con 0x7fa278104690 2024-04-26T18:27:50.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:27:50.506+0000 7fa27f46a700 1 -- 172.21.15.192:0/1257742278 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fa278063860 con 0x7fa2640a3bb0 2024-04-26T18:27:50.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:50 smithi192 ceph-mon[32842]: osdmap e14: 2 total, 2 up, 2 in 2024-04-26T18:27:50.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:50 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:27:50.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:50 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:27:50.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:50 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:50.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:50 smithi082 ceph-mon[32808]: osdmap e14: 2 total, 2 up, 2 in 2024-04-26T18:27:50.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:27:50.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:27:50.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:50.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:50 smithi080 ceph-mon[29135]: osdmap e14: 2 total, 2 up, 2 in 2024-04-26T18:27:50.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:50 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:27:50.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:50 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:27:50.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:50 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:51.685 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:51 smithi192 ceph-mon[32842]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:27:51.685 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:51 smithi192 ceph-mon[32842]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:27:51.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:51 smithi082 ceph-mon[32808]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:27:51.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:51 smithi082 ceph-mon[32808]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:27:51.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:51 smithi080 ceph-mon[29135]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:27:51.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:51 smithi080 ceph-mon[29135]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:27:53.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:53 smithi192 ceph-mon[32842]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:27:53.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:53 smithi192 ceph-mon[32842]: from='client.? 172.21.15.192:0/1505482569' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8625dd7-4c1d-4258-ac2b-463ff96f4cf0"}]: dispatch 2024-04-26T18:27:53.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:53 smithi192 ceph-mon[32842]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8625dd7-4c1d-4258-ac2b-463ff96f4cf0"}]: dispatch 2024-04-26T18:27:53.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:53 smithi192 ceph-mon[32842]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8625dd7-4c1d-4258-ac2b-463ff96f4cf0"}]': finished 2024-04-26T18:27:53.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:53 smithi192 ceph-mon[32842]: osdmap e15: 3 total, 2 up, 3 in 2024-04-26T18:27:53.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:53 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T18:27:53.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:53 smithi082 ceph-mon[32808]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:27:53.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:53 smithi082 ceph-mon[32808]: from='client.? 172.21.15.192:0/1505482569' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8625dd7-4c1d-4258-ac2b-463ff96f4cf0"}]: dispatch 2024-04-26T18:27:53.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:53 smithi082 ceph-mon[32808]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8625dd7-4c1d-4258-ac2b-463ff96f4cf0"}]: dispatch 2024-04-26T18:27:53.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:53 smithi082 ceph-mon[32808]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8625dd7-4c1d-4258-ac2b-463ff96f4cf0"}]': finished 2024-04-26T18:27:53.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:53 smithi082 ceph-mon[32808]: osdmap e15: 3 total, 2 up, 3 in 2024-04-26T18:27:53.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:53 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T18:27:53.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:53 smithi080 ceph-mon[29135]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:27:53.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:53 smithi080 ceph-mon[29135]: from='client.? 172.21.15.192:0/1505482569' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8625dd7-4c1d-4258-ac2b-463ff96f4cf0"}]: dispatch 2024-04-26T18:27:53.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:53 smithi080 ceph-mon[29135]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8625dd7-4c1d-4258-ac2b-463ff96f4cf0"}]: dispatch 2024-04-26T18:27:53.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:53 smithi080 ceph-mon[29135]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8625dd7-4c1d-4258-ac2b-463ff96f4cf0"}]': finished 2024-04-26T18:27:53.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:53 smithi080 ceph-mon[29135]: osdmap e15: 3 total, 2 up, 3 in 2024-04-26T18:27:53.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:53 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T18:27:54.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:54 smithi192 ceph-mon[32842]: from='client.? 172.21.15.192:0/3941487564' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:27:54.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:54 smithi082 ceph-mon[32808]: from='client.? 172.21.15.192:0/3941487564' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:27:54.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:54 smithi080 ceph-mon[29135]: from='client.? 172.21.15.192:0/3941487564' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:27:55.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:55 smithi192 ceph-mon[32842]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:27:55.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:55 smithi082 ceph-mon[32808]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:27:55.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:55 smithi080 ceph-mon[29135]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:27:56.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:56 smithi192 ceph-mon[32842]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:27:56.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:56 smithi082 ceph-mon[32808]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:27:56.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:56 smithi080 ceph-mon[29135]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:27:59.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:27:59 smithi192 ceph-mon[32842]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:27:59.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:27:59 smithi080 ceph-mon[29135]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:27:59.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:27:59 smithi082 ceph-mon[32808]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:28:00.800 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:00 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T18:28:00.800 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:00 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:00.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:00 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T18:28:00.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:00 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:00.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:00 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T18:28:00.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:00 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:01.736 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:01 smithi192 ceph-mon[32842]: Deploying daemon osd.2 on smithi192 2024-04-26T18:28:01.737 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:01 smithi192 ceph-mon[32842]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:28:01.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:01 smithi082 ceph-mon[32808]: Deploying daemon osd.2 on smithi192 2024-04-26T18:28:01.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:01 smithi082 ceph-mon[32808]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:28:01.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:01 smithi080 ceph-mon[29135]: Deploying daemon osd.2 on smithi192 2024-04-26T18:28:01.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:01 smithi080 ceph-mon[29135]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:28:03.795 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:03 smithi192 ceph-mon[32842]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:28:03.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:03 smithi082 ceph-mon[32808]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:28:03.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:03 smithi080 ceph-mon[29135]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:28:05.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:05 smithi192 ceph-mon[32842]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:28:05.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:05 smithi082 ceph-mon[32808]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:28:05.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:05 smithi080 ceph-mon[29135]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:28:06.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:06 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:06.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:06 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:06.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:06 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:28:06.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:06 smithi082 ceph-mon[32808]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:28:06.985 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:06 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:06.985 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:06 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:06.985 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:06 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:28:06.985 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:06 smithi192 ceph-mon[32842]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:28:06.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:06.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:06.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:28:06.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:06 smithi080 ceph-mon[29135]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:28:09.019 INFO:teuthology.orchestra.run.smithi192.stdout:Created osd(s) 2 on host 'smithi192' 2024-04-26T18:28:09.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:28:09.018+0000 7fa26e7fc700 1 -- 172.21.15.192:0/1257742278 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa278063860 con 0x7fa2640a3bb0 2024-04-26T18:28:09.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:28:09.020+0000 7fa27f46a700 1 -- 172.21.15.192:0/1257742278 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fa2640a3bb0 msgr2=0x7fa2640a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:09.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:28:09.020+0000 7fa27f46a700 1 --2- 172.21.15.192:0/1257742278 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fa2640a3bb0 0x7fa2640a6070 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa274005fd0 tx=0x7fa274005e50 comp rx=0 tx=0).stop 2024-04-26T18:28:09.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:28:09.020+0000 7fa27f46a700 1 -- 172.21.15.192:0/1257742278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa278104690 msgr2=0x7fa278199ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:09.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:28:09.020+0000 7fa27f46a700 1 --2- 172.21.15.192:0/1257742278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa278104690 0x7fa278199ab0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa2680036f0 tx=0x7fa268005ef0 comp rx=0 tx=0).stop 2024-04-26T18:28:09.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:28:09.020+0000 7fa27f46a700 1 -- 172.21.15.192:0/1257742278 shutdown_connections 2024-04-26T18:28:09.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:28:09.021+0000 7fa27f46a700 1 --2- 172.21.15.192:0/1257742278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa278105030 0x7fa2781a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:09.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:28:09.021+0000 7fa27f46a700 1 --2- 172.21.15.192:0/1257742278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa278103490 0x7fa278199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:09.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:28:09.021+0000 7fa27f46a700 1 --2- 172.21.15.192:0/1257742278 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fa2640a3bb0 0x7fa2640a6070 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:09.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:28:09.021+0000 7fa27f46a700 1 --2- 172.21.15.192:0/1257742278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa278104690 0x7fa278199ab0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:09.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:28:09.021+0000 7fa27f46a700 1 -- 172.21.15.192:0/1257742278 >> 172.21.15.192:0/1257742278 conn(0x7fa2780fe9f0 msgr2=0x7fa278107a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:09.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:28:09.021+0000 7fa27f46a700 1 -- 172.21.15.192:0/1257742278 shutdown_connections 2024-04-26T18:28:09.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:28:09.021+0000 7fa27f46a700 1 -- 172.21.15.192:0/1257742278 wait complete. 2024-04-26T18:28:09.664 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:09 smithi192 ceph-mon[32842]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:28:09.664 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:09 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:09.664 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:09 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:09.666 DEBUG:teuthology.orchestra.run.smithi192:osd.2> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.2.service 2024-04-26T18:28:09.668 INFO:tasks.cephadm:Deploying osd.3 on smithi080 with /dev/vg_nvme/lv_3... 2024-04-26T18:28:09.669 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-26T18:28:09.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:09 smithi080 ceph-mon[29135]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:28:09.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:09 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:09.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:09 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:09.920 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:28:09.942 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:09 smithi082 ceph-mon[32808]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:28:09.942 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:09 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:09.942 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:09 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:10.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:10 smithi192 ceph-mon[32842]: from='osd.2 [v2:172.21.15.192:6800/503427508,v1:172.21.15.192:6801/503427508]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T18:28:10.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:10 smithi192 ceph-mon[32842]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T18:28:10.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:10 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:10.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:10 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:10.711 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:10 smithi080 ceph-mon[29135]: from='osd.2 [v2:172.21.15.192:6800/503427508,v1:172.21.15.192:6801/503427508]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T18:28:10.712 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:10 smithi080 ceph-mon[29135]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T18:28:10.712 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:10 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:10.712 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:10 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:10.854 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:10 smithi082 ceph-mon[32808]: from='osd.2 [v2:172.21.15.192:6800/503427508,v1:172.21.15.192:6801/503427508]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T18:28:10.855 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:10 smithi082 ceph-mon[32808]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T18:28:10.855 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:10 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:10.855 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:10 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:11.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:11 smithi192 ceph-mon[32842]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:28:11.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:11 smithi192 ceph-mon[32842]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-26T18:28:11.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:11 smithi192 ceph-mon[32842]: osdmap e16: 3 total, 2 up, 3 in 2024-04-26T18:28:11.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T18:28:11.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:11 smithi192 ceph-mon[32842]: from='osd.2 [v2:172.21.15.192:6800/503427508,v1:172.21.15.192:6801/503427508]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-04-26T18:28:11.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:11 smithi192 ceph-mon[32842]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-04-26T18:28:11.613 INFO:journalctl@ceph.osd.2.smithi192.stdout:Apr 26 18:28:11 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-2[38012]: 2024-04-26T18:28:11.509+0000 7f16ce76d700 -1 osd.2 0 waiting for initial osdmap 2024-04-26T18:28:11.613 INFO:journalctl@ceph.osd.2.smithi192.stdout:Apr 26 18:28:11 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-2[38012]: 2024-04-26T18:28:11.512+0000 7f16ca560700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T18:28:11.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:11 smithi080 ceph-mon[29135]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:28:11.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:11 smithi080 ceph-mon[29135]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-26T18:28:11.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:11 smithi080 ceph-mon[29135]: osdmap e16: 3 total, 2 up, 3 in 2024-04-26T18:28:11.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T18:28:11.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:11 smithi080 ceph-mon[29135]: from='osd.2 [v2:172.21.15.192:6800/503427508,v1:172.21.15.192:6801/503427508]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-04-26T18:28:11.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:11 smithi080 ceph-mon[29135]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-04-26T18:28:11.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:11 smithi082 ceph-mon[32808]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:28:11.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:11 smithi082 ceph-mon[32808]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-26T18:28:11.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:11 smithi082 ceph-mon[32808]: osdmap e16: 3 total, 2 up, 3 in 2024-04-26T18:28:11.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T18:28:11.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:11 smithi082 ceph-mon[32808]: from='osd.2 [v2:172.21.15.192:6800/503427508,v1:172.21.15.192:6801/503427508]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-04-26T18:28:11.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:11 smithi082 ceph-mon[32808]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-04-26T18:28:12.018 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-26T18:28:12.018 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-26T18:28:12.018 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-04-26T18:28:12.018 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-04-26T18:28:12.018 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0116536 s, 900 MB/s 2024-04-26T18:28:12.018 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-04-26T18:28:12.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:12 smithi192 ceph-mon[32842]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-04-26T18:28:12.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:12 smithi192 ceph-mon[32842]: osdmap e17: 3 total, 2 up, 3 in 2024-04-26T18:28:12.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:12 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T18:28:12.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:12 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T18:28:12.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:12 smithi080 ceph-mon[29135]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-04-26T18:28:12.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:12 smithi080 ceph-mon[29135]: osdmap e17: 3 total, 2 up, 3 in 2024-04-26T18:28:12.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:12 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T18:28:12.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:12 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T18:28:12.701 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi080:vg_nvme/lv_3 2024-04-26T18:28:12.951 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:28:12.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:12 smithi082 ceph-mon[32808]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-04-26T18:28:12.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:12 smithi082 ceph-mon[32808]: osdmap e17: 3 total, 2 up, 3 in 2024-04-26T18:28:12.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:12 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T18:28:12.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:12 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T18:28:13.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:13 smithi080 ceph-mon[29135]: purged_snaps scrub starts 2024-04-26T18:28:13.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:13 smithi080 ceph-mon[29135]: purged_snaps scrub ok 2024-04-26T18:28:13.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:13 smithi080 ceph-mon[29135]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:28:13.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T18:28:13.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:13 smithi080 ceph-mon[29135]: osd.2 [v2:172.21.15.192:6800/503427508,v1:172.21.15.192:6801/503427508] boot 2024-04-26T18:28:13.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:13 smithi080 ceph-mon[29135]: osdmap e18: 3 total, 3 up, 3 in 2024-04-26T18:28:13.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T18:28:13.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:13.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:13.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:28:13.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:13.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:13.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:28:13.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:13.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:28:13.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:13.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:28:13.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:13.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:13 smithi192 ceph-mon[32842]: purged_snaps scrub starts 2024-04-26T18:28:13.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:13 smithi192 ceph-mon[32842]: purged_snaps scrub ok 2024-04-26T18:28:13.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:13 smithi192 ceph-mon[32842]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:28:13.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T18:28:13.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:13 smithi192 ceph-mon[32842]: osd.2 [v2:172.21.15.192:6800/503427508,v1:172.21.15.192:6801/503427508] boot 2024-04-26T18:28:13.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:13 smithi192 ceph-mon[32842]: osdmap e18: 3 total, 3 up, 3 in 2024-04-26T18:28:13.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T18:28:13.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:13.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:13.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:28:13.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:13.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:13.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:28:13.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:13.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:28:13.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:13.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:28:13.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:13.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:13 smithi082 ceph-mon[32808]: purged_snaps scrub starts 2024-04-26T18:28:13.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:13 smithi082 ceph-mon[32808]: purged_snaps scrub ok 2024-04-26T18:28:13.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:13 smithi082 ceph-mon[32808]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T18:28:13.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T18:28:13.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:13 smithi082 ceph-mon[32808]: osd.2 [v2:172.21.15.192:6800/503427508,v1:172.21.15.192:6801/503427508] boot 2024-04-26T18:28:13.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:13 smithi082 ceph-mon[32808]: osdmap e18: 3 total, 3 up, 3 in 2024-04-26T18:28:13.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T18:28:13.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:13.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:13.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:28:13.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:13.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:13.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:28:13.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:13.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:28:13.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:13.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:28:13.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:14.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.589+0000 7f6d69b1d700 1 -- 172.21.15.80:0/3103272711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d641034a0 msgr2=0x7f6d641038c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:14.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.589+0000 7f6d69b1d700 1 --2- 172.21.15.80:0/3103272711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d641034a0 0x7f6d641038c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6d540099c0 tx=0x7f6d54009cd0 comp rx=0 tx=0).stop 2024-04-26T18:28:14.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.589+0000 7f6d69b1d700 1 -- 172.21.15.80:0/3103272711 shutdown_connections 2024-04-26T18:28:14.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.589+0000 7f6d69b1d700 1 --2- 172.21.15.80:0/3103272711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d64105040 0x7f6d6410b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:14.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.589+0000 7f6d69b1d700 1 --2- 172.21.15.80:0/3103272711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d641034a0 0x7f6d641038c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:14.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.589+0000 7f6d69b1d700 1 --2- 172.21.15.80:0/3103272711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d641046a0 0x7f6d64104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:14.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.589+0000 7f6d69b1d700 1 -- 172.21.15.80:0/3103272711 >> 172.21.15.80:0/3103272711 conn(0x7f6d640fea40 msgr2=0x7f6d64100e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:14.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.589+0000 7f6d69b1d700 1 -- 172.21.15.80:0/3103272711 shutdown_connections 2024-04-26T18:28:14.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.589+0000 7f6d69b1d700 1 -- 172.21.15.80:0/3103272711 wait complete. 2024-04-26T18:28:14.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.589+0000 7f6d69b1d700 1 Processor -- start 2024-04-26T18:28:14.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.589+0000 7f6d69b1d700 1 -- start start 2024-04-26T18:28:14.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.590+0000 7f6d69b1d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d641034a0 0x7f6d641994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:14.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.590+0000 7f6d69b1d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d641046a0 0x7f6d64199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:14.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.590+0000 7f6d69b1d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d64105040 0x7f6d641a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:14.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.590+0000 7f6d69b1d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6410ef30 con 0x7f6d641034a0 2024-04-26T18:28:14.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.590+0000 7f6d69b1d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6410edb0 con 0x7f6d64105040 2024-04-26T18:28:14.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.590+0000 7f6d69b1d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6410f0b0 con 0x7f6d641046a0 2024-04-26T18:28:14.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.590+0000 7f6d637fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d641034a0 0x7f6d641994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:14.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.590+0000 7f6d637fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d641034a0 0x7f6d641994c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33286/0 (socket says 172.21.15.80:33286) 2024-04-26T18:28:14.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.590+0000 7f6d637fe700 1 -- 172.21.15.80:0/3388173625 learned_addr learned my addr 172.21.15.80:0/3388173625 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:28:14.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.590+0000 7f6d63fff700 1 --2- 172.21.15.80:0/3388173625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d64105040 0x7f6d641a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:14.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.590+0000 7f6d637fe700 1 -- 172.21.15.80:0/3388173625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d641046a0 msgr2=0x7f6d64199a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.590+0000 7f6d62ffd700 1 --2- 172.21.15.80:0/3388173625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d641046a0 0x7f6d64199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.590+0000 7f6d637fe700 1 --2- 172.21.15.80:0/3388173625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d641046a0 0x7f6d64199a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.590+0000 7f6d637fe700 1 -- 172.21.15.80:0/3388173625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d64105040 msgr2=0x7f6d641a0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.590+0000 7f6d637fe700 1 --2- 172.21.15.80:0/3388173625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d64105040 0x7f6d641a0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.590+0000 7f6d637fe700 1 -- 172.21.15.80:0/3388173625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d641a1120 con 0x7f6d641034a0 2024-04-26T18:28:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.590+0000 7f6d63fff700 1 --2- 172.21.15.80:0/3388173625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d64105040 0x7f6d641a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:28:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.590+0000 7f6d637fe700 1 --2- 172.21.15.80:0/3388173625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d641034a0 0x7f6d641994c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6d54003790 tx=0x7f6d54003a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.590+0000 7f6d60ff9700 1 -- 172.21.15.80:0/3388173625 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d54027070 con 0x7f6d641034a0 2024-04-26T18:28:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.590+0000 7f6d60ff9700 1 -- 172.21.15.80:0/3388173625 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d54022470 con 0x7f6d641034a0 2024-04-26T18:28:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.590+0000 7f6d69b1d700 1 -- 172.21.15.80:0/3388173625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d641a13b0 con 0x7f6d641034a0 2024-04-26T18:28:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.590+0000 7f6d60ff9700 1 -- 172.21.15.80:0/3388173625 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5400f6c0 con 0x7f6d641034a0 2024-04-26T18:28:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.590+0000 7f6d69b1d700 1 -- 172.21.15.80:0/3388173625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d641a1890 con 0x7f6d641034a0 2024-04-26T18:28:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.591+0000 7f6d69b1d700 1 -- 172.21.15.80:0/3388173625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d6406a110 con 0x7f6d641034a0 2024-04-26T18:28:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.592+0000 7f6d60ff9700 1 -- 172.21.15.80:0/3388173625 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7f6d5402a070 con 0x7f6d641034a0 2024-04-26T18:28:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.593+0000 7f6d60ff9700 1 --2- 172.21.15.80:0/3388173625 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6d4c0a3bb0 0x7f6d4c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:14.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.593+0000 7f6d62ffd700 1 --2- 172.21.15.80:0/3388173625 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6d4c0a3bb0 0x7f6d4c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:14.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.593+0000 7f6d60ff9700 1 -- 172.21.15.80:0/3388173625 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3226+0+0 (secure 0 0 0) 0x7f6d540d0130 con 0x7f6d641034a0 2024-04-26T18:28:14.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.593+0000 7f6d62ffd700 1 --2- 172.21.15.80:0/3388173625 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6d4c0a3bb0 0x7f6d4c0a6070 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800ba60 tx=0x7f6d58005d50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:14.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.597+0000 7f6d60ff9700 1 -- 172.21.15.80:0/3388173625 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6d54013070 con 0x7f6d641034a0 2024-04-26T18:28:14.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:14 smithi080 ceph-mon[29135]: Detected new or changed devices on smithi192 2024-04-26T18:28:14.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:14 smithi080 ceph-mon[29135]: Adjusting osd_memory_target on smithi192 to 17088M 2024-04-26T18:28:14.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:14 smithi080 ceph-mon[29135]: osdmap e19: 3 total, 3 up, 3 in 2024-04-26T18:28:14.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:14 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-26T18:28:14.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:14.803+0000 7f6d69b1d700 1 -- 172.21.15.80:0/3388173625 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6d64063860 con 0x7f6d4c0a3bb0 2024-04-26T18:28:14.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:14 smithi192 ceph-mon[32842]: Detected new or changed devices on smithi192 2024-04-26T18:28:14.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:14 smithi192 ceph-mon[32842]: Adjusting osd_memory_target on smithi192 to 17088M 2024-04-26T18:28:14.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:14 smithi192 ceph-mon[32842]: osdmap e19: 3 total, 3 up, 3 in 2024-04-26T18:28:14.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:14 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-26T18:28:14.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:14 smithi082 ceph-mon[32808]: Detected new or changed devices on smithi192 2024-04-26T18:28:14.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:14 smithi082 ceph-mon[32808]: Adjusting osd_memory_target on smithi192 to 17088M 2024-04-26T18:28:14.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:14 smithi082 ceph-mon[32808]: osdmap e19: 3 total, 3 up, 3 in 2024-04-26T18:28:14.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:14 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-26T18:28:15.654 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:15 smithi080 ceph-mon[29135]: pgmap v81: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:15.654 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:15 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-26T18:28:15.654 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:15 smithi080 ceph-mon[29135]: osdmap e20: 3 total, 3 up, 3 in 2024-04-26T18:28:15.654 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:15 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T18:28:15.655 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:15 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:28:15.655 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:15 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:28:15.655 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:15 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:15.655 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:28:15 smithi080 sudo[45990]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T18:28:15.655 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:28:15 smithi080 sudo[45990]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T18:28:15.655 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:28:15 smithi080 sudo[45990]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T18:28:15.782 INFO:journalctl@ceph.osd.2.smithi192.stdout:Apr 26 18:28:15 smithi192 sudo[41924]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T18:28:15.783 INFO:journalctl@ceph.osd.2.smithi192.stdout:Apr 26 18:28:15 smithi192 sudo[41924]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T18:28:15.783 INFO:journalctl@ceph.osd.2.smithi192.stdout:Apr 26 18:28:15 smithi192 sudo[41924]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T18:28:15.783 INFO:journalctl@ceph.osd.2.smithi192.stdout:Apr 26 18:28:15 smithi192 sudo[41924]: pam_unix(sudo:session): session closed for user root 2024-04-26T18:28:15.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:15 smithi192 ceph-mon[32842]: pgmap v81: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:15.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:15 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-26T18:28:15.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:15 smithi192 ceph-mon[32842]: osdmap e20: 3 total, 3 up, 3 in 2024-04-26T18:28:15.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:15 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T18:28:15.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:15 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:28:15.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:15 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:28:15.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:15 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:15.901 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:15 smithi082 ceph-mon[32808]: pgmap v81: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:15.901 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:15 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-26T18:28:15.901 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:15 smithi082 ceph-mon[32808]: osdmap e20: 3 total, 3 up, 3 in 2024-04-26T18:28:15.901 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:15 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T18:28:15.901 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:15 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:28:15.901 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:15 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:28:15.902 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:15 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:15.902 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 26 18:28:15 smithi082 sudo[41552]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T18:28:15.902 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 26 18:28:15 smithi082 sudo[41552]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T18:28:15.902 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 26 18:28:15 smithi082 sudo[41552]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T18:28:15.902 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 26 18:28:15 smithi082 sudo[41552]: pam_unix(sudo:session): session closed for user root 2024-04-26T18:28:15.902 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 26 18:28:15 smithi082 sudo[41555]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T18:28:15.902 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 26 18:28:15 smithi082 sudo[41555]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T18:28:15.902 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 26 18:28:15 smithi082 sudo[41555]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T18:28:15.902 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 26 18:28:15 smithi082 sudo[41555]: pam_unix(sudo:session): session closed for user root 2024-04-26T18:28:15.993 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:28:15 smithi080 sudo[45990]: pam_unix(sudo:session): session closed for user root 2024-04-26T18:28:15.993 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:28:15 smithi080 sudo[45996]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T18:28:15.993 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:28:15 smithi080 sudo[45996]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T18:28:15.993 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:28:15 smithi080 sudo[45996]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T18:28:15.993 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:28:15 smithi080 sudo[45996]: pam_unix(sudo:session): session closed for user root 2024-04-26T18:28:15.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:15 smithi080 sudo[46011]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T18:28:15.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:15 smithi080 sudo[46011]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T18:28:15.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:15 smithi080 sudo[46011]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T18:28:15.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:15 smithi080 sudo[46011]: pam_unix(sudo:session): session closed for user root 2024-04-26T18:28:15.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:15 smithi080 sudo[46014]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T18:28:15.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:15 smithi080 sudo[46014]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T18:28:15.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:15 smithi080 sudo[46014]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T18:28:15.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:15 smithi080 sudo[46014]: pam_unix(sudo:session): session closed for user root 2024-04-26T18:28:16.112 INFO:journalctl@ceph.osd.2.smithi192.stdout:Apr 26 18:28:15 smithi192 sudo[41927]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T18:28:16.112 INFO:journalctl@ceph.osd.2.smithi192.stdout:Apr 26 18:28:15 smithi192 sudo[41927]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T18:28:16.113 INFO:journalctl@ceph.osd.2.smithi192.stdout:Apr 26 18:28:15 smithi192 sudo[41927]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T18:28:16.113 INFO:journalctl@ceph.osd.2.smithi192.stdout:Apr 26 18:28:15 smithi192 sudo[41927]: pam_unix(sudo:session): session closed for user root 2024-04-26T18:28:16.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:15 smithi192 sudo[41930]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T18:28:16.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:15 smithi192 sudo[41930]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T18:28:16.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:15 smithi192 sudo[41930]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T18:28:16.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:15 smithi192 sudo[41930]: pam_unix(sudo:session): session closed for user root 2024-04-26T18:28:16.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:15 smithi192 sudo[41933]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T18:28:16.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:15 smithi192 sudo[41933]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T18:28:16.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:15 smithi192 sudo[41933]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T18:28:16.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:15 smithi192 sudo[41933]: pam_unix(sudo:session): session closed for user root 2024-04-26T18:28:16.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:15 smithi082 sudo[41558]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T18:28:16.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:15 smithi082 sudo[41558]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T18:28:16.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:15 smithi082 sudo[41558]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T18:28:16.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:15 smithi082 sudo[41558]: pam_unix(sudo:session): session closed for user root 2024-04-26T18:28:16.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:15 smithi082 sudo[41561]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T18:28:16.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:15 smithi082 sudo[41561]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T18:28:16.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:15 smithi082 sudo[41561]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T18:28:16.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:15 smithi082 sudo[41561]: pam_unix(sudo:session): session closed for user root 2024-04-26T18:28:16.732 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:16 smithi080 ceph-mon[29135]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:28:16.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:16 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-26T18:28:16.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:16 smithi080 ceph-mon[29135]: osdmap e21: 3 total, 3 up, 3 in 2024-04-26T18:28:16.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:16 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:16.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:16 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:16.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:16 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:16.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:16 smithi080 ceph-mon[29135]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T18:28:16.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:16 smithi080 ceph-mon[29135]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T18:28:16.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:16 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T18:28:16.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:16 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:28:16.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:16 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T18:28:16.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:16 smithi080 ceph-mon[29135]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T18:28:16.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:16 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T18:28:16.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:16 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:28:16.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:16 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T18:28:16.734 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:16 smithi080 ceph-mon[29135]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T18:28:16.734 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:16 smithi080 ceph-mon[29135]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T18:28:16.734 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:16 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T18:28:16.734 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:16 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:28:16.734 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:16 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T18:28:16.734 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:16 smithi080 ceph-mon[29135]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T18:28:16.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:16.831+0000 7f6d60ff9700 1 -- 172.21.15.80:0/3388173625 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f6d54099fd0 con 0x7f6d641034a0 2024-04-26T18:28:16.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:16 smithi192 ceph-mon[32842]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:28:16.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:16 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-26T18:28:16.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:16 smithi192 ceph-mon[32842]: osdmap e21: 3 total, 3 up, 3 in 2024-04-26T18:28:16.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:16 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:16.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:16 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:16.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:16 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:16.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:16 smithi192 ceph-mon[32842]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T18:28:16.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:16 smithi192 ceph-mon[32842]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T18:28:16.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:16 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T18:28:16.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:16 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:28:16.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:16 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T18:28:16.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:16 smithi192 ceph-mon[32842]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T18:28:16.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:16 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T18:28:16.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:16 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:28:16.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:16 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T18:28:16.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:16 smithi192 ceph-mon[32842]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T18:28:16.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:16 smithi192 ceph-mon[32842]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T18:28:16.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:16 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T18:28:16.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:16 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:28:16.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:16 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T18:28:16.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:16 smithi192 ceph-mon[32842]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T18:28:16.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:16 smithi082 ceph-mon[32808]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:28:16.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:16 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-26T18:28:16.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:16 smithi082 ceph-mon[32808]: osdmap e21: 3 total, 3 up, 3 in 2024-04-26T18:28:16.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:16 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:16.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:16 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:16.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:16 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:16.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:16 smithi082 ceph-mon[32808]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T18:28:16.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:16 smithi082 ceph-mon[32808]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T18:28:16.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:16 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T18:28:16.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:16 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:28:16.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:16 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T18:28:16.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:16 smithi082 ceph-mon[32808]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T18:28:16.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:16 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T18:28:16.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:16 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:28:16.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:16 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T18:28:16.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:16 smithi082 ceph-mon[32808]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T18:28:16.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:16 smithi082 ceph-mon[32808]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T18:28:16.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:16 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T18:28:16.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:16 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:28:16.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:16 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T18:28:16.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:16 smithi082 ceph-mon[32808]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T18:28:17.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:17 smithi080 ceph-mon[29135]: pgmap v84: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:17.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:17 smithi080 ceph-mon[29135]: osdmap e22: 3 total, 3 up, 3 in 2024-04-26T18:28:17.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:17 smithi080 ceph-mon[29135]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-26T18:28:17.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:17 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/4015631014' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3068321a-3070-44ae-9bbd-a3faac8c21fa"}]: dispatch 2024-04-26T18:28:17.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:17 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/4015631014' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3068321a-3070-44ae-9bbd-a3faac8c21fa"}]': finished 2024-04-26T18:28:17.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:17 smithi080 ceph-mon[29135]: osdmap e23: 4 total, 3 up, 4 in 2024-04-26T18:28:17.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:17 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T18:28:17.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:17 smithi192 ceph-mon[32842]: pgmap v84: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:17.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:17 smithi192 ceph-mon[32842]: osdmap e22: 3 total, 3 up, 3 in 2024-04-26T18:28:17.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:17 smithi192 ceph-mon[32842]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-26T18:28:17.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:17 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/4015631014' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3068321a-3070-44ae-9bbd-a3faac8c21fa"}]: dispatch 2024-04-26T18:28:17.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:17 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/4015631014' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3068321a-3070-44ae-9bbd-a3faac8c21fa"}]': finished 2024-04-26T18:28:17.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:17 smithi192 ceph-mon[32842]: osdmap e23: 4 total, 3 up, 4 in 2024-04-26T18:28:17.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:17 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T18:28:17.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:17 smithi082 ceph-mon[32808]: pgmap v84: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:17.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:17 smithi082 ceph-mon[32808]: osdmap e22: 3 total, 3 up, 3 in 2024-04-26T18:28:17.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:17 smithi082 ceph-mon[32808]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-26T18:28:17.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:17 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/4015631014' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3068321a-3070-44ae-9bbd-a3faac8c21fa"}]: dispatch 2024-04-26T18:28:17.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:17 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/4015631014' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3068321a-3070-44ae-9bbd-a3faac8c21fa"}]': finished 2024-04-26T18:28:17.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:17 smithi082 ceph-mon[32808]: osdmap e23: 4 total, 3 up, 4 in 2024-04-26T18:28:17.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:17 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T18:28:18.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:18 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3794317482' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:28:18.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:18 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3794317482' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:28:18.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:18 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3794317482' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:28:19.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:19 smithi192 ceph-mon[32842]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:19.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:19 smithi082 ceph-mon[32808]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:19.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:19 smithi080 ceph-mon[29135]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:21.862 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:21 smithi080 ceph-mon[29135]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:21.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:21 smithi192 ceph-mon[32842]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:21.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:21 smithi082 ceph-mon[32808]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:23.644 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:23 smithi080 ceph-mon[29135]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:23.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:23 smithi192 ceph-mon[32842]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:23.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:23 smithi082 ceph-mon[32808]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:25.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:25 smithi192 ceph-mon[32842]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:25.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:25 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T18:28:25.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:25 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:25.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:25 smithi080 ceph-mon[29135]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:25.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:25 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T18:28:25.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:25 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:25.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:25 smithi082 ceph-mon[32808]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:25.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:25 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T18:28:25.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:25 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:26.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:26 smithi192 ceph-mon[32842]: Deploying daemon osd.3 on smithi080 2024-04-26T18:28:26.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:26 smithi080 ceph-mon[29135]: Deploying daemon osd.3 on smithi080 2024-04-26T18:28:26.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:26 smithi082 ceph-mon[32808]: Deploying daemon osd.3 on smithi080 2024-04-26T18:28:27.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:27 smithi192 ceph-mon[32842]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:27.864 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:27 smithi080 ceph-mon[29135]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:27.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:27 smithi082 ceph-mon[32808]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:29.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:29 smithi080 ceph-mon[29135]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:29.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:29 smithi192 ceph-mon[32842]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:29.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:29 smithi082 ceph-mon[32808]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:31.362 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:31 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:31.362 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:31 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:31.362 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:31 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:28:31.362 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:31 smithi080 ceph-mon[29135]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:31.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:31 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:31.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:31 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:31.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:31 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:28:31.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:31 smithi192 ceph-mon[32842]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:31.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:31 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:31.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:31 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:31.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:31 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:28:31.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:31 smithi082 ceph-mon[32808]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:33.157 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 3 on host 'smithi080' 2024-04-26T18:28:33.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:33.156+0000 7f6d60ff9700 1 -- 172.21.15.80:0/3388173625 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6d64063860 con 0x7f6d4c0a3bb0 2024-04-26T18:28:33.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:33.158+0000 7f6d69b1d700 1 -- 172.21.15.80:0/3388173625 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6d4c0a3bb0 msgr2=0x7f6d4c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:33.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:33.158+0000 7f6d69b1d700 1 --2- 172.21.15.80:0/3388173625 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6d4c0a3bb0 0x7f6d4c0a6070 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800ba60 tx=0x7f6d58005d50 comp rx=0 tx=0).stop 2024-04-26T18:28:33.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:33.158+0000 7f6d69b1d700 1 -- 172.21.15.80:0/3388173625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d641034a0 msgr2=0x7f6d641994c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:33.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:33.158+0000 7f6d69b1d700 1 --2- 172.21.15.80:0/3388173625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d641034a0 0x7f6d641994c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6d54003790 tx=0x7f6d54003a10 comp rx=0 tx=0).stop 2024-04-26T18:28:33.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:33.158+0000 7f6d69b1d700 1 -- 172.21.15.80:0/3388173625 shutdown_connections 2024-04-26T18:28:33.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:33.158+0000 7f6d69b1d700 1 --2- 172.21.15.80:0/3388173625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d64105040 0x7f6d641a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:33.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:33.158+0000 7f6d69b1d700 1 --2- 172.21.15.80:0/3388173625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d641034a0 0x7f6d641994c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:33.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:33.158+0000 7f6d69b1d700 1 --2- 172.21.15.80:0/3388173625 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6d4c0a3bb0 0x7f6d4c0a6070 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:33.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:33.158+0000 7f6d69b1d700 1 --2- 172.21.15.80:0/3388173625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d641046a0 0x7f6d64199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:33.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:33.158+0000 7f6d69b1d700 1 -- 172.21.15.80:0/3388173625 >> 172.21.15.80:0/3388173625 conn(0x7f6d640fea40 msgr2=0x7f6d641079a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:33.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:33.158+0000 7f6d69b1d700 1 -- 172.21.15.80:0/3388173625 shutdown_connections 2024-04-26T18:28:33.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:28:33.158+0000 7f6d69b1d700 1 -- 172.21.15.80:0/3388173625 wait complete. 2024-04-26T18:28:33.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:33 smithi192 ceph-mon[32842]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:33.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:33 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:33.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:33 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:33.923 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:33 smithi080 ceph-mon[29135]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:33.923 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:33 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:33.923 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:33 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:33.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:33 smithi082 ceph-mon[32808]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:33.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:33 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:33.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:33 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:33.995 DEBUG:teuthology.orchestra.run.smithi080:osd.3> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.3.service 2024-04-26T18:28:33.997 INFO:tasks.cephadm:Deploying osd.4 on smithi082 with /dev/vg_nvme/lv_3... 2024-04-26T18:28:33.998 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-26T18:28:34.244 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T18:28:34.709 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:34 smithi082 ceph-mon[32808]: from='osd.3 [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T18:28:34.709 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:34 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:34.710 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:34 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:34.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:34 smithi080 ceph-mon[29135]: from='osd.3 [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T18:28:34.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:34 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:34.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:34 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:34.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:34 smithi192 ceph-mon[32842]: from='osd.3 [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T18:28:34.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:34 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:34.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:34 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:35.673 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:35 smithi082 ceph-mon[32808]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:35.673 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:35 smithi082 ceph-mon[32808]: from='osd.3 [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-26T18:28:35.673 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:35 smithi082 ceph-mon[32808]: osdmap e24: 4 total, 3 up, 4 in 2024-04-26T18:28:35.674 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:35 smithi082 ceph-mon[32808]: from='osd.3 [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T18:28:35.674 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:35 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T18:28:35.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:35 smithi080 ceph-mon[29135]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:35.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:35 smithi080 ceph-mon[29135]: from='osd.3 [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-26T18:28:35.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:35 smithi080 ceph-mon[29135]: osdmap e24: 4 total, 3 up, 4 in 2024-04-26T18:28:35.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:35 smithi080 ceph-mon[29135]: from='osd.3 [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T18:28:35.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:35 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T18:28:35.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:35 smithi192 ceph-mon[32842]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:35.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:35 smithi192 ceph-mon[32842]: from='osd.3 [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-26T18:28:35.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:35 smithi192 ceph-mon[32842]: osdmap e24: 4 total, 3 up, 4 in 2024-04-26T18:28:35.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:35 smithi192 ceph-mon[32842]: from='osd.3 [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T18:28:35.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:35 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T18:28:36.045 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 26 18:28:35 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-3[48122]: 2024-04-26T18:28:35.948+0000 7f9347d88700 -1 osd.3 0 waiting for initial osdmap 2024-04-26T18:28:36.046 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 26 18:28:35 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-3[48122]: 2024-04-26T18:28:35.954+0000 7f933fb73700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T18:28:36.209 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-26T18:28:36.210 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-26T18:28:36.210 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-04-26T18:28:36.210 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-04-26T18:28:36.210 INFO:teuthology.orchestra.run.smithi082.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0128766 s, 814 MB/s 2024-04-26T18:28:36.210 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-04-26T18:28:36.764 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:36 smithi082 ceph-mon[32808]: from='osd.3 [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-26T18:28:36.765 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:36 smithi082 ceph-mon[32808]: osdmap e25: 4 total, 3 up, 4 in 2024-04-26T18:28:36.765 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:36 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T18:28:36.765 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:36 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T18:28:36.765 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:36 smithi082 ceph-mon[32808]: from='osd.3 [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066]' entity='osd.3' 2024-04-26T18:28:36.790 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_3 2024-04-26T18:28:36.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:36 smithi192 ceph-mon[32842]: from='osd.3 [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-26T18:28:36.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:36 smithi192 ceph-mon[32842]: osdmap e25: 4 total, 3 up, 4 in 2024-04-26T18:28:36.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:36 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T18:28:36.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:36 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T18:28:36.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:36 smithi192 ceph-mon[32842]: from='osd.3 [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066]' entity='osd.3' 2024-04-26T18:28:36.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:36 smithi080 ceph-mon[29135]: from='osd.3 [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-26T18:28:36.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:36 smithi080 ceph-mon[29135]: osdmap e25: 4 total, 3 up, 4 in 2024-04-26T18:28:36.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:36 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T18:28:36.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:36 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T18:28:36.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:36 smithi080 ceph-mon[29135]: from='osd.3 [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066]' entity='osd.3' 2024-04-26T18:28:37.034 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T18:28:37.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:37 smithi080 ceph-mon[29135]: purged_snaps scrub starts 2024-04-26T18:28:37.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:37 smithi080 ceph-mon[29135]: purged_snaps scrub ok 2024-04-26T18:28:37.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:37 smithi080 ceph-mon[29135]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:37.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:37 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T18:28:37.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:37 smithi080 ceph-mon[29135]: osd.3 [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066] boot 2024-04-26T18:28:37.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:37 smithi080 ceph-mon[29135]: osdmap e26: 4 total, 4 up, 4 in 2024-04-26T18:28:37.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:37 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T18:28:37.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:37 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:37.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:37 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:37.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:37 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:28:37.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:37 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:28:37.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:37 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:37.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:37 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:37.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:37 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:28:37.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:37 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:37.827 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:37 smithi082 ceph-mon[32808]: purged_snaps scrub starts 2024-04-26T18:28:37.827 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:37 smithi082 ceph-mon[32808]: purged_snaps scrub ok 2024-04-26T18:28:37.827 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:37 smithi082 ceph-mon[32808]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:37.827 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:37 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T18:28:37.827 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:37 smithi082 ceph-mon[32808]: osd.3 [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066] boot 2024-04-26T18:28:37.827 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:37 smithi082 ceph-mon[32808]: osdmap e26: 4 total, 4 up, 4 in 2024-04-26T18:28:37.827 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:37 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T18:28:37.827 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:37 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:37.827 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:37 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:37.828 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:37 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:28:37.828 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:37 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:28:37.828 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:37 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:37.828 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:37 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:37.828 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:37 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:28:37.828 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:37 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:37.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:37 smithi192 ceph-mon[32842]: purged_snaps scrub starts 2024-04-26T18:28:37.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:37 smithi192 ceph-mon[32842]: purged_snaps scrub ok 2024-04-26T18:28:37.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:37 smithi192 ceph-mon[32842]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T18:28:37.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:37 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T18:28:37.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:37 smithi192 ceph-mon[32842]: osd.3 [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066] boot 2024-04-26T18:28:37.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:37 smithi192 ceph-mon[32842]: osdmap e26: 4 total, 4 up, 4 in 2024-04-26T18:28:37.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:37 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T18:28:37.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:37 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:37.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:37 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:37.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:37 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:28:37.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:37 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:28:37.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:37 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:37.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:37 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:37.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:37 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:28:37.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:37 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:38.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.618+0000 7ff1192f7700 1 -- 172.21.15.82:0/2035806472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff114102390 msgr2=0x7ff1141027b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:38.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.618+0000 7ff1192f7700 1 --2- 172.21.15.82:0/2035806472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff114102390 0x7ff1141027b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff1040099c0 tx=0x7ff104009cd0 comp rx=0 tx=0).stop 2024-04-26T18:28:38.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.618+0000 7ff1192f7700 1 -- 172.21.15.82:0/2035806472 shutdown_connections 2024-04-26T18:28:38.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.618+0000 7ff1192f7700 1 --2- 172.21.15.82:0/2035806472 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff114103f30 0x7ff11410a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:38.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.618+0000 7ff1192f7700 1 --2- 172.21.15.82:0/2035806472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff114102390 0x7ff1141027b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:38.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.618+0000 7ff1192f7700 1 --2- 172.21.15.82:0/2035806472 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff114103590 0x7ff1141039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:38.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.618+0000 7ff1192f7700 1 -- 172.21.15.82:0/2035806472 >> 172.21.15.82:0/2035806472 conn(0x7ff1140fd950 msgr2=0x7ff1140ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:38.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.618+0000 7ff1192f7700 1 -- 172.21.15.82:0/2035806472 shutdown_connections 2024-04-26T18:28:38.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.618+0000 7ff1192f7700 1 -- 172.21.15.82:0/2035806472 wait complete. 2024-04-26T18:28:38.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.618+0000 7ff1192f7700 1 Processor -- start 2024-04-26T18:28:38.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.619+0000 7ff1192f7700 1 -- start start 2024-04-26T18:28:38.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.619+0000 7ff1192f7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff114102390 0x7ff114199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:38.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.619+0000 7ff1192f7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff114103590 0x7ff114199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:38.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.619+0000 7ff1192f7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff114103f30 0x7ff1141a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:38.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.619+0000 7ff1192f7700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff11410de80 con 0x7ff114103590 2024-04-26T18:28:38.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.619+0000 7ff1192f7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff11410dd00 con 0x7ff114103f30 2024-04-26T18:28:38.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.619+0000 7ff1192f7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff11410e000 con 0x7ff114102390 2024-04-26T18:28:38.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.619+0000 7ff1137fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff114103f30 0x7ff1141a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:38.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.619+0000 7ff1137fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff114103f30 0x7ff1141a0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36836/0 (socket says 172.21.15.82:36836) 2024-04-26T18:28:38.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.619+0000 7ff1137fe700 1 -- 172.21.15.82:0/3631573631 learned_addr learned my addr 172.21.15.82:0/3631573631 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T18:28:38.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.619+0000 7ff112ffd700 1 --2- 172.21.15.82:0/3631573631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff114102390 0x7ff114199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:38.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.619+0000 7ff10a7fc700 1 --2- 172.21.15.82:0/3631573631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff114103590 0x7ff114199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:38.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.619+0000 7ff1137fe700 1 -- 172.21.15.82:0/3631573631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff114102390 msgr2=0x7ff114199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:38.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.619+0000 7ff1137fe700 1 --2- 172.21.15.82:0/3631573631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff114102390 0x7ff114199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:38.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.619+0000 7ff1137fe700 1 -- 172.21.15.82:0/3631573631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff114103590 msgr2=0x7ff114199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:38.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.619+0000 7ff1137fe700 1 --2- 172.21.15.82:0/3631573631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff114103590 0x7ff114199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:38.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.619+0000 7ff1137fe700 1 -- 172.21.15.82:0/3631573631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1141a12a0 con 0x7ff114103f30 2024-04-26T18:28:38.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.619+0000 7ff10a7fc700 1 --2- 172.21.15.82:0/3631573631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff114103590 0x7ff114199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:28:38.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.619+0000 7ff1137fe700 1 --2- 172.21.15.82:0/3631573631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff114103f30 0x7ff1141a0c00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff10c007d70 tx=0x7ff10c00a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:38.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.620+0000 7ff110ff9700 1 -- 172.21.15.82:0/3631573631 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c016020 con 0x7ff114103f30 2024-04-26T18:28:38.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.620+0000 7ff110ff9700 1 -- 172.21.15.82:0/3631573631 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff10c00ad40 con 0x7ff114103f30 2024-04-26T18:28:38.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.620+0000 7ff1192f7700 1 -- 172.21.15.82:0/3631573631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1141a1590 con 0x7ff114103f30 2024-04-26T18:28:38.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.620+0000 7ff110ff9700 1 -- 172.21.15.82:0/3631573631 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c0115e0 con 0x7ff114103f30 2024-04-26T18:28:38.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.620+0000 7ff1192f7700 1 -- 172.21.15.82:0/3631573631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1141a1b20 con 0x7ff114103f30 2024-04-26T18:28:38.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.621+0000 7ff1192f7700 1 -- 172.21.15.82:0/3631573631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff11406a110 con 0x7ff114103f30 2024-04-26T18:28:38.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.622+0000 7ff110ff9700 1 -- 172.21.15.82:0/3631573631 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7ff10c019020 con 0x7ff114103f30 2024-04-26T18:28:38.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.622+0000 7ff110ff9700 1 --2- 172.21.15.82:0/3631573631 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff1000a3cc0 0x7ff1000a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:38.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.623+0000 7ff110ff9700 1 -- 172.21.15.82:0/3631573631 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3698+0+0 (secure 0 0 0) 0x7ff10c0cf0a0 con 0x7ff114103f30 2024-04-26T18:28:38.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.623+0000 7ff112ffd700 1 --2- 172.21.15.82:0/3631573631 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff1000a3cc0 0x7ff1000a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:38.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.623+0000 7ff112ffd700 1 --2- 172.21.15.82:0/3631573631 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff1000a3cc0 0x7ff1000a6180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff104006010 tx=0x7ff104005c00 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:38.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.627+0000 7ff110ff9700 1 -- 172.21.15.82:0/3631573631 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff10c020020 con 0x7ff114103f30 2024-04-26T18:28:38.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:38 smithi082 ceph-mon[32808]: Detected new or changed devices on smithi080 2024-04-26T18:28:38.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:38 smithi082 ceph-mon[32808]: Adjusting osd_memory_target on smithi080 to 8544M 2024-04-26T18:28:38.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:38 smithi082 ceph-mon[32808]: osdmap e27: 4 total, 4 up, 4 in 2024-04-26T18:28:38.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:38 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:28:38.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:38 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:38.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:38 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:28:38.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:38 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:38.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:38.835+0000 7ff1192f7700 1 -- 172.21.15.82:0/3631573631 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7ff11406c280 con 0x7ff1000a3cc0 2024-04-26T18:28:38.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:38 smithi192 ceph-mon[32842]: Detected new or changed devices on smithi080 2024-04-26T18:28:38.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:38 smithi192 ceph-mon[32842]: Adjusting osd_memory_target on smithi080 to 8544M 2024-04-26T18:28:38.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:38 smithi192 ceph-mon[32842]: osdmap e27: 4 total, 4 up, 4 in 2024-04-26T18:28:38.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:38 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:28:38.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:38 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:38.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:38 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:28:38.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:38 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:38.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:38 smithi080 ceph-mon[29135]: Detected new or changed devices on smithi080 2024-04-26T18:28:38.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:38 smithi080 ceph-mon[29135]: Adjusting osd_memory_target on smithi080 to 8544M 2024-04-26T18:28:38.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:38 smithi080 ceph-mon[29135]: osdmap e27: 4 total, 4 up, 4 in 2024-04-26T18:28:38.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:38 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:28:38.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:38 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:38.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:38 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:28:38.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:38 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:39.776 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:39 smithi082 ceph-mon[32808]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-26T18:28:39.776 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:39 smithi082 ceph-mon[32808]: osdmap e28: 4 total, 4 up, 4 in 2024-04-26T18:28:39.776 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:39 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:28:39.776 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:39 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:28:39.776 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:39 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:39.776 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:39 smithi082 ceph-mon[32808]: osdmap e29: 4 total, 4 up, 4 in 2024-04-26T18:28:39.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:39 smithi192 ceph-mon[32842]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-26T18:28:39.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:39 smithi192 ceph-mon[32842]: osdmap e28: 4 total, 4 up, 4 in 2024-04-26T18:28:39.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:39 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:28:39.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:39 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:28:39.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:39 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:39.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:39 smithi192 ceph-mon[32842]: osdmap e29: 4 total, 4 up, 4 in 2024-04-26T18:28:39.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:39 smithi080 ceph-mon[29135]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-26T18:28:39.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:39 smithi080 ceph-mon[29135]: osdmap e28: 4 total, 4 up, 4 in 2024-04-26T18:28:39.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:28:39.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:28:39.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:39.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:39 smithi080 ceph-mon[29135]: osdmap e29: 4 total, 4 up, 4 in 2024-04-26T18:28:40.706 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:40 smithi082 ceph-mon[32808]: from='client.24200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:28:40.706 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:40 smithi082 ceph-mon[32808]: osdmap e30: 4 total, 4 up, 4 in 2024-04-26T18:28:40.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:40 smithi192 ceph-mon[32842]: from='client.24200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:28:40.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:40 smithi192 ceph-mon[32842]: osdmap e30: 4 total, 4 up, 4 in 2024-04-26T18:28:40.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:40 smithi080 ceph-mon[29135]: from='client.24200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:28:40.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:40 smithi080 ceph-mon[29135]: osdmap e30: 4 total, 4 up, 4 in 2024-04-26T18:28:41.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:41 smithi192 ceph-mon[32842]: pgmap v105: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-04-26T18:28:41.875 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:41 smithi082 ceph-mon[32808]: pgmap v105: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-04-26T18:28:41.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:41 smithi080 ceph-mon[29135]: pgmap v105: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-04-26T18:28:42.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:42 smithi192 ceph-mon[32842]: from='client.? 172.21.15.82:0/3528165585' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b3d6455-9495-435b-8193-a260b63504ec"}]: dispatch 2024-04-26T18:28:42.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:42 smithi192 ceph-mon[32842]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b3d6455-9495-435b-8193-a260b63504ec"}]: dispatch 2024-04-26T18:28:42.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:42 smithi192 ceph-mon[32842]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b3d6455-9495-435b-8193-a260b63504ec"}]': finished 2024-04-26T18:28:42.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:42 smithi192 ceph-mon[32842]: osdmap e31: 5 total, 4 up, 5 in 2024-04-26T18:28:42.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:42 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T18:28:42.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:42 smithi192 ceph-mon[32842]: from='client.? 172.21.15.82:0/2076851424' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:28:42.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:42 smithi082 ceph-mon[32808]: from='client.? 172.21.15.82:0/3528165585' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b3d6455-9495-435b-8193-a260b63504ec"}]: dispatch 2024-04-26T18:28:42.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:42 smithi082 ceph-mon[32808]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b3d6455-9495-435b-8193-a260b63504ec"}]: dispatch 2024-04-26T18:28:42.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:42 smithi082 ceph-mon[32808]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b3d6455-9495-435b-8193-a260b63504ec"}]': finished 2024-04-26T18:28:42.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:42 smithi082 ceph-mon[32808]: osdmap e31: 5 total, 4 up, 5 in 2024-04-26T18:28:42.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:42 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T18:28:42.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:42 smithi082 ceph-mon[32808]: from='client.? 172.21.15.82:0/2076851424' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:28:42.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:42 smithi080 ceph-mon[29135]: from='client.? 172.21.15.82:0/3528165585' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b3d6455-9495-435b-8193-a260b63504ec"}]: dispatch 2024-04-26T18:28:42.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:42 smithi080 ceph-mon[29135]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b3d6455-9495-435b-8193-a260b63504ec"}]: dispatch 2024-04-26T18:28:42.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:42 smithi080 ceph-mon[29135]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b3d6455-9495-435b-8193-a260b63504ec"}]': finished 2024-04-26T18:28:42.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:42 smithi080 ceph-mon[29135]: osdmap e31: 5 total, 4 up, 5 in 2024-04-26T18:28:42.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:42 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T18:28:42.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:42 smithi080 ceph-mon[29135]: from='client.? 172.21.15.82:0/2076851424' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:28:43.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:43 smithi192 ceph-mon[32842]: pgmap v107: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T18:28:43.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:43 smithi082 ceph-mon[32808]: pgmap v107: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T18:28:43.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:43 smithi080 ceph-mon[29135]: pgmap v107: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T18:28:45.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:45 smithi192 ceph-mon[32842]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-26T18:28:45.889 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:45 smithi082 ceph-mon[32808]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-26T18:28:45.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:45 smithi080 ceph-mon[29135]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-26T18:28:47.805 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:47 smithi082 ceph-mon[32808]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-04-26T18:28:47.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:47 smithi192 ceph-mon[32842]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-04-26T18:28:47.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:47 smithi080 ceph-mon[29135]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-04-26T18:28:49.763 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:49 smithi082 ceph-mon[32808]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-26T18:28:49.763 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:49 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T18:28:49.763 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:49 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:49.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:49 smithi192 ceph-mon[32842]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-26T18:28:49.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:49 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T18:28:49.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:49 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:49.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:49 smithi080 ceph-mon[29135]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-26T18:28:49.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:49 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T18:28:49.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:49 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:50.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:50 smithi082 ceph-mon[32808]: Deploying daemon osd.4 on smithi082 2024-04-26T18:28:50.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:50 smithi192 ceph-mon[32842]: Deploying daemon osd.4 on smithi082 2024-04-26T18:28:50.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:50 smithi080 ceph-mon[29135]: Deploying daemon osd.4 on smithi082 2024-04-26T18:28:51.855 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:51 smithi082 ceph-mon[32808]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-26T18:28:51.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:51 smithi192 ceph-mon[32842]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-26T18:28:51.991 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:51 smithi080 ceph-mon[29135]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-26T18:28:53.717 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:53 smithi082 ceph-mon[32808]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-26T18:28:53.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:53 smithi192 ceph-mon[32842]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-26T18:28:53.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:53 smithi080 ceph-mon[29135]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-26T18:28:54.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:54 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:28:54.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:54 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:54.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:54 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:54.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:54 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:28:54.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:54 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:54.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:54 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:54.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:54 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:28:54.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:54 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:54.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:54 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:55.860 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:55 smithi082 ceph-mon[32808]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-26T18:28:55.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:55 smithi192 ceph-mon[32842]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-26T18:28:55.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:55 smithi080 ceph-mon[29135]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-26T18:28:57.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:57.594+0000 7ff110ff9700 1 -- 172.21.15.82:0/3631573631 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff11406c280 con 0x7ff1000a3cc0 2024-04-26T18:28:57.595 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 4 on host 'smithi082' 2024-04-26T18:28:57.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:57.597+0000 7ff1192f7700 1 -- 172.21.15.82:0/3631573631 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff1000a3cc0 msgr2=0x7ff1000a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:57.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:57.597+0000 7ff1192f7700 1 --2- 172.21.15.82:0/3631573631 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff1000a3cc0 0x7ff1000a6180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff104006010 tx=0x7ff104005c00 comp rx=0 tx=0).stop 2024-04-26T18:28:57.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:57.597+0000 7ff1192f7700 1 -- 172.21.15.82:0/3631573631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff114103f30 msgr2=0x7ff1141a0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:57.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:57.597+0000 7ff1192f7700 1 --2- 172.21.15.82:0/3631573631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff114103f30 0x7ff1141a0c00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff10c007d70 tx=0x7ff10c00a340 comp rx=0 tx=0).stop 2024-04-26T18:28:57.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:57.597+0000 7ff1192f7700 1 -- 172.21.15.82:0/3631573631 shutdown_connections 2024-04-26T18:28:57.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:57.597+0000 7ff1192f7700 1 --2- 172.21.15.82:0/3631573631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff114103f30 0x7ff1141a0c00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:57.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:57.597+0000 7ff1192f7700 1 --2- 172.21.15.82:0/3631573631 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff1000a3cc0 0x7ff1000a6180 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:57.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:57.597+0000 7ff1192f7700 1 --2- 172.21.15.82:0/3631573631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff114102390 0x7ff114199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:57.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:57.597+0000 7ff1192f7700 1 --2- 172.21.15.82:0/3631573631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff114103590 0x7ff114199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:57.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:57.597+0000 7ff1192f7700 1 -- 172.21.15.82:0/3631573631 >> 172.21.15.82:0/3631573631 conn(0x7ff1140fd950 msgr2=0x7ff11406bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:57.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:57.597+0000 7ff1192f7700 1 -- 172.21.15.82:0/3631573631 shutdown_connections 2024-04-26T18:28:57.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:28:57.597+0000 7ff1192f7700 1 -- 172.21.15.82:0/3631573631 wait complete. 2024-04-26T18:28:57.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:57 smithi192 ceph-mon[32842]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-26T18:28:57.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:57 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:57.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:57 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:57.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:57 smithi082 ceph-mon[32808]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-26T18:28:57.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:57 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:57.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:57 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:57.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:57 smithi080 ceph-mon[29135]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-26T18:28:57.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:57 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:57.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:57 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:58.285 DEBUG:teuthology.orchestra.run.smithi082:osd.4> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.4.service 2024-04-26T18:28:58.288 INFO:tasks.cephadm:Deploying osd.5 on smithi192 with /dev/vg_nvme/lv_3... 2024-04-26T18:28:58.288 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-26T18:28:58.532 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T18:28:59.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:58 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:59.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:58 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:59.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:58 smithi082 ceph-mon[32808]: from='osd.4 [v2:172.21.15.82:6808/2068291934,v1:172.21.15.82:6809/2068291934]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T18:28:59.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:58 smithi082 ceph-mon[32808]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T18:28:59.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:58 smithi082 ceph-mon[32808]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-26T18:28:59.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:58 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:59.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:58 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:59.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:58 smithi080 ceph-mon[29135]: from='osd.4 [v2:172.21.15.82:6808/2068291934,v1:172.21.15.82:6809/2068291934]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T18:28:59.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:58 smithi080 ceph-mon[29135]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T18:28:59.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:58 smithi080 ceph-mon[29135]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-26T18:28:59.301 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:58 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:59.301 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:58 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:28:59.301 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:58 smithi192 ceph-mon[32842]: from='osd.4 [v2:172.21.15.82:6808/2068291934,v1:172.21.15.82:6809/2068291934]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T18:28:59.301 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:58 smithi192 ceph-mon[32842]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T18:28:59.301 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:58 smithi192 ceph-mon[32842]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-26T18:29:00.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:59 smithi082 ceph-mon[32808]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-26T18:29:00.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:59 smithi082 ceph-mon[32808]: from='osd.4 [v2:172.21.15.82:6808/2068291934,v1:172.21.15.82:6809/2068291934]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T18:29:00.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:59 smithi082 ceph-mon[32808]: osdmap e32: 5 total, 4 up, 5 in 2024-04-26T18:29:00.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:59 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T18:29:00.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:28:59 smithi082 ceph-mon[32808]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T18:29:00.220 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 26 18:28:59 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-4[44374]: 2024-04-26T18:28:59.964+0000 7f2cf0f33700 -1 osd.4 0 waiting for initial osdmap 2024-04-26T18:29:00.220 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 26 18:28:59 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-4[44374]: 2024-04-26T18:28:59.975+0000 7f2cecd26700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T18:29:00.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:59 smithi080 ceph-mon[29135]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-26T18:29:00.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:59 smithi080 ceph-mon[29135]: from='osd.4 [v2:172.21.15.82:6808/2068291934,v1:172.21.15.82:6809/2068291934]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T18:29:00.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:59 smithi080 ceph-mon[29135]: osdmap e32: 5 total, 4 up, 5 in 2024-04-26T18:29:00.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:59 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T18:29:00.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:28:59 smithi080 ceph-mon[29135]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T18:29:00.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:59 smithi192 ceph-mon[32842]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-26T18:29:00.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:59 smithi192 ceph-mon[32842]: from='osd.4 [v2:172.21.15.82:6808/2068291934,v1:172.21.15.82:6809/2068291934]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T18:29:00.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:59 smithi192 ceph-mon[32842]: osdmap e32: 5 total, 4 up, 5 in 2024-04-26T18:29:00.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:59 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T18:29:00.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:28:59 smithi192 ceph-mon[32842]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T18:29:00.504 INFO:teuthology.orchestra.run.smithi192.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-26T18:29:00.504 INFO:teuthology.orchestra.run.smithi192.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-26T18:29:00.504 INFO:teuthology.orchestra.run.smithi192.stderr: stderr: 10+0 records in 2024-04-26T18:29:00.504 INFO:teuthology.orchestra.run.smithi192.stderr:10+0 records out 2024-04-26T18:29:00.504 INFO:teuthology.orchestra.run.smithi192.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113753 s, 922 MB/s 2024-04-26T18:29:00.505 INFO:teuthology.orchestra.run.smithi192.stderr:--> Zapping successful for: 2024-04-26T18:29:01.210 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:00 smithi192 ceph-mon[32842]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-26T18:29:01.210 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:00 smithi192 ceph-mon[32842]: osdmap e33: 5 total, 4 up, 5 in 2024-04-26T18:29:01.210 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:00 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T18:29:01.210 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:00 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T18:29:01.210 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:00 smithi192 ceph-mon[32842]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-26T18:29:01.238 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi192:vg_nvme/lv_3 2024-04-26T18:29:01.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:00 smithi080 ceph-mon[29135]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-26T18:29:01.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:00 smithi080 ceph-mon[29135]: osdmap e33: 5 total, 4 up, 5 in 2024-04-26T18:29:01.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:00 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T18:29:01.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:00 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T18:29:01.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:00 smithi080 ceph-mon[29135]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-26T18:29:01.379 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:00 smithi082 ceph-mon[32808]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-26T18:29:01.380 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:00 smithi082 ceph-mon[32808]: osdmap e33: 5 total, 4 up, 5 in 2024-04-26T18:29:01.380 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:00 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T18:29:01.380 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:00 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T18:29:01.380 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:00 smithi082 ceph-mon[32808]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-26T18:29:01.485 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T18:29:02.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:01 smithi192 ceph-mon[32842]: purged_snaps scrub starts 2024-04-26T18:29:02.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:01 smithi192 ceph-mon[32842]: purged_snaps scrub ok 2024-04-26T18:29:02.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:01 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T18:29:02.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:01 smithi192 ceph-mon[32842]: osd.4 [v2:172.21.15.82:6808/2068291934,v1:172.21.15.82:6809/2068291934] boot 2024-04-26T18:29:02.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:01 smithi192 ceph-mon[32842]: osdmap e34: 5 total, 5 up, 5 in 2024-04-26T18:29:02.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:01 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T18:29:02.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:01 smithi192 ceph-mon[32842]: Detected new or changed devices on smithi082 2024-04-26T18:29:02.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:01 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:02.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:01 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:02.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:01 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:29:02.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:01 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:29:02.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:01 smithi192 ceph-mon[32842]: Adjusting osd_memory_target on smithi082 to 8544M 2024-04-26T18:29:02.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:01 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:02.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:01 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:02.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:01 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:29:02.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:01 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:02.114 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:01 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:29:02.114 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:01 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:02.114 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:01 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:29:02.114 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:01 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:02.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:01 smithi080 ceph-mon[29135]: purged_snaps scrub starts 2024-04-26T18:29:02.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:01 smithi080 ceph-mon[29135]: purged_snaps scrub ok 2024-04-26T18:29:02.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:01 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T18:29:02.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:01 smithi080 ceph-mon[29135]: osd.4 [v2:172.21.15.82:6808/2068291934,v1:172.21.15.82:6809/2068291934] boot 2024-04-26T18:29:02.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:01 smithi080 ceph-mon[29135]: osdmap e34: 5 total, 5 up, 5 in 2024-04-26T18:29:02.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:01 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T18:29:02.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:01 smithi080 ceph-mon[29135]: Detected new or changed devices on smithi082 2024-04-26T18:29:02.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:01 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:02.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:01 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:02.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:01 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:29:02.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:01 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:29:02.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:01 smithi080 ceph-mon[29135]: Adjusting osd_memory_target on smithi082 to 8544M 2024-04-26T18:29:02.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:01 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:02.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:01 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:02.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:01 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:29:02.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:01 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:02.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:01 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:29:02.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:01 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:02.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:01 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:29:02.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:01 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:02.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:01 smithi082 ceph-mon[32808]: purged_snaps scrub starts 2024-04-26T18:29:02.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:01 smithi082 ceph-mon[32808]: purged_snaps scrub ok 2024-04-26T18:29:02.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:01 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T18:29:02.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:01 smithi082 ceph-mon[32808]: osd.4 [v2:172.21.15.82:6808/2068291934,v1:172.21.15.82:6809/2068291934] boot 2024-04-26T18:29:02.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:01 smithi082 ceph-mon[32808]: osdmap e34: 5 total, 5 up, 5 in 2024-04-26T18:29:02.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:01 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T18:29:02.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:01 smithi082 ceph-mon[32808]: Detected new or changed devices on smithi082 2024-04-26T18:29:02.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:01 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:02.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:01 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:02.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:01 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:29:02.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:01 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:29:02.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:01 smithi082 ceph-mon[32808]: Adjusting osd_memory_target on smithi082 to 8544M 2024-04-26T18:29:02.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:01 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:02.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:01 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:02.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:01 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:29:02.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:01 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:02.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:01 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:29:02.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:01 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:02.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:01 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:29:02.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:01 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:03.187 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:02 smithi192 ceph-mon[32842]: osdmap e35: 5 total, 5 up, 5 in 2024-04-26T18:29:03.188 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:02 smithi192 ceph-mon[32842]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:03.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.191+0000 7f96a3a28700 1 -- 172.21.15.192:0/3655993442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f969c103f20 msgr2=0x7f969c10a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:29:03.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.191+0000 7f96a3a28700 1 --2- 172.21.15.192:0/3655993442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f969c103f20 0x7f969c10a7d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f969400b0a0 tx=0x7f969400b3b0 comp rx=0 tx=0).stop 2024-04-26T18:29:03.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.191+0000 7f96a3a28700 1 -- 172.21.15.192:0/3655993442 shutdown_connections 2024-04-26T18:29:03.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.191+0000 7f96a3a28700 1 --2- 172.21.15.192:0/3655993442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f969c103f20 0x7f969c10a7d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:29:03.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.191+0000 7f96a3a28700 1 --2- 172.21.15.192:0/3655993442 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f969c102380 0x7f969c1027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:29:03.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.191+0000 7f96a3a28700 1 --2- 172.21.15.192:0/3655993442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f969c103580 0x7f969c1039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:29:03.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.191+0000 7f96a3a28700 1 -- 172.21.15.192:0/3655993442 >> 172.21.15.192:0/3655993442 conn(0x7f969c0fd920 msgr2=0x7f969c0ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:29:03.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.191+0000 7f96a3a28700 1 -- 172.21.15.192:0/3655993442 shutdown_connections 2024-04-26T18:29:03.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.191+0000 7f96a3a28700 1 -- 172.21.15.192:0/3655993442 wait complete. 2024-04-26T18:29:03.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.191+0000 7f96a3a28700 1 Processor -- start 2024-04-26T18:29:03.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.192+0000 7f96a3a28700 1 -- start start 2024-04-26T18:29:03.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.192+0000 7f96a3a28700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f969c102380 0x7f969c1062c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:29:03.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.192+0000 7f96a3a28700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f969c103580 0x7f969c104960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:29:03.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.192+0000 7f96a3a28700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f969c103f20 0x7f969c104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:29:03.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.192+0000 7f96a3a28700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f969c10de70 con 0x7f969c102380 2024-04-26T18:29:03.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.192+0000 7f96a3a28700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f969c10dcf0 con 0x7f969c103580 2024-04-26T18:29:03.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.192+0000 7f96a3a28700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f969c10dff0 con 0x7f969c103f20 2024-04-26T18:29:03.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.192+0000 7f96a1fc5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f969c103f20 0x7f969c104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:29:03.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.192+0000 7f96a1fc5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f969c103f20 0x7f969c104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37736/0 (socket says 172.21.15.192:37736) 2024-04-26T18:29:03.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.192+0000 7f96a1fc5700 1 -- 172.21.15.192:0/898770354 learned_addr learned my addr 172.21.15.192:0/898770354 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-04-26T18:29:03.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.192+0000 7f96a17c4700 1 --2- 172.21.15.192:0/898770354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f969c102380 0x7f969c1062c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:29:03.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.192+0000 7f96a0fc3700 1 --2- 172.21.15.192:0/898770354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f969c103580 0x7f969c104960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:29:03.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.192+0000 7f96a1fc5700 1 -- 172.21.15.192:0/898770354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f969c103580 msgr2=0x7f969c104960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:29:03.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.192+0000 7f96a1fc5700 1 --2- 172.21.15.192:0/898770354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f969c103580 0x7f969c104960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:29:03.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.192+0000 7f96a1fc5700 1 -- 172.21.15.192:0/898770354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f969c102380 msgr2=0x7f969c1062c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:29:03.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.192+0000 7f96a1fc5700 1 --2- 172.21.15.192:0/898770354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f969c102380 0x7f969c1062c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:29:03.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.192+0000 7f96a1fc5700 1 -- 172.21.15.192:0/898770354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f969c105770 con 0x7f969c103f20 2024-04-26T18:29:03.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.192+0000 7f96a1fc5700 1 --2- 172.21.15.192:0/898770354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f969c103f20 0x7f969c104ea0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f96940062a0 tx=0x7f9694004e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:29:03.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.192+0000 7f96927fc700 1 -- 172.21.15.192:0/898770354 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9694021070 con 0x7f969c103f20 2024-04-26T18:29:03.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.192+0000 7f96927fc700 1 -- 172.21.15.192:0/898770354 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9694007c80 con 0x7f969c103f20 2024-04-26T18:29:03.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.192+0000 7f96a3a28700 1 -- 172.21.15.192:0/898770354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f969c1a3710 con 0x7f969c103f20 2024-04-26T18:29:03.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.192+0000 7f96927fc700 1 -- 172.21.15.192:0/898770354 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969401d450 con 0x7f969c103f20 2024-04-26T18:29:03.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.193+0000 7f96a3a28700 1 -- 172.21.15.192:0/898770354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f969c1a3cf0 con 0x7f969c103f20 2024-04-26T18:29:03.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.193+0000 7f96a3a28700 1 -- 172.21.15.192:0/898770354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f969c06a110 con 0x7f969c103f20 2024-04-26T18:29:03.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.194+0000 7f96927fc700 1 -- 172.21.15.192:0/898770354 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f9694003a00 con 0x7f969c103f20 2024-04-26T18:29:03.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.195+0000 7f96927fc700 1 --2- 172.21.15.192:0/898770354 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f96880a3cc0 0x7f96880a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:29:03.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.195+0000 7f96927fc700 1 -- 172.21.15.192:0/898770354 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4101+0+0 (secure 0 0 0) 0x7f969400f020 con 0x7f969c103f20 2024-04-26T18:29:03.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.195+0000 7f96a17c4700 1 --2- 172.21.15.192:0/898770354 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f96880a3cc0 0x7f96880a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:29:03.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.196+0000 7f96a17c4700 1 --2- 172.21.15.192:0/898770354 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f96880a3cc0 0x7f96880a6180 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f969c1033e0 tx=0x7f969800b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:29:03.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.200+0000 7f96927fc700 1 -- 172.21.15.192:0/898770354 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f969402a020 con 0x7f969c103f20 2024-04-26T18:29:03.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:02 smithi080 ceph-mon[29135]: osdmap e35: 5 total, 5 up, 5 in 2024-04-26T18:29:03.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:02 smithi080 ceph-mon[29135]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:03.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:03.405+0000 7f96a3a28700 1 -- 172.21.15.192:0/898770354 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f969c0ffb10 con 0x7f96880a3cc0 2024-04-26T18:29:03.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:02 smithi082 ceph-mon[32808]: osdmap e35: 5 total, 5 up, 5 in 2024-04-26T18:29:03.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:02 smithi082 ceph-mon[32808]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:04.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:03 smithi080 ceph-mon[29135]: from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:29:04.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:03 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:29:04.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:03 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:29:04.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:03 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:04.341 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:03 smithi192 ceph-mon[32842]: from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:29:04.341 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:03 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:29:04.341 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:03 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:29:04.342 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:03 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:04.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:03 smithi082 ceph-mon[32808]: from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:29:04.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:03 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:29:04.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:03 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:29:04.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:03 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:05.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:04 smithi080 ceph-mon[29135]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:05.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:04 smithi192 ceph-mon[32842]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:05.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:04 smithi082 ceph-mon[32808]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:06.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:06 smithi192 ceph-mon[32842]: from='client.? 172.21.15.192:0/3545634254' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "538863f1-1486-45b5-a675-ecb1d3035599"}]: dispatch 2024-04-26T18:29:06.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:06 smithi192 ceph-mon[32842]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "538863f1-1486-45b5-a675-ecb1d3035599"}]: dispatch 2024-04-26T18:29:06.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:06 smithi192 ceph-mon[32842]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "538863f1-1486-45b5-a675-ecb1d3035599"}]': finished 2024-04-26T18:29:06.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:06 smithi192 ceph-mon[32842]: osdmap e36: 6 total, 5 up, 6 in 2024-04-26T18:29:06.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:06 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T18:29:06.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:06 smithi082 ceph-mon[32808]: from='client.? 172.21.15.192:0/3545634254' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "538863f1-1486-45b5-a675-ecb1d3035599"}]: dispatch 2024-04-26T18:29:06.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:06 smithi082 ceph-mon[32808]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "538863f1-1486-45b5-a675-ecb1d3035599"}]: dispatch 2024-04-26T18:29:06.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:06 smithi082 ceph-mon[32808]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "538863f1-1486-45b5-a675-ecb1d3035599"}]': finished 2024-04-26T18:29:06.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:06 smithi082 ceph-mon[32808]: osdmap e36: 6 total, 5 up, 6 in 2024-04-26T18:29:06.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:06 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T18:29:06.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:06 smithi080 ceph-mon[29135]: from='client.? 172.21.15.192:0/3545634254' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "538863f1-1486-45b5-a675-ecb1d3035599"}]: dispatch 2024-04-26T18:29:06.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:06 smithi080 ceph-mon[29135]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "538863f1-1486-45b5-a675-ecb1d3035599"}]: dispatch 2024-04-26T18:29:06.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:06 smithi080 ceph-mon[29135]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "538863f1-1486-45b5-a675-ecb1d3035599"}]': finished 2024-04-26T18:29:06.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:06 smithi080 ceph-mon[29135]: osdmap e36: 6 total, 5 up, 6 in 2024-04-26T18:29:06.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T18:29:07.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:07 smithi192 ceph-mon[32842]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:07.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:07 smithi192 ceph-mon[32842]: from='client.? 172.21.15.192:0/685027868' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:29:07.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:07 smithi082 ceph-mon[32808]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:07.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:07 smithi082 ceph-mon[32808]: from='client.? 172.21.15.192:0/685027868' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:29:07.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:07 smithi080 ceph-mon[29135]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:07.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:07 smithi080 ceph-mon[29135]: from='client.? 172.21.15.192:0/685027868' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:29:09.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:09 smithi192 ceph-mon[32842]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:09.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:09 smithi082 ceph-mon[32808]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:09.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:09 smithi080 ceph-mon[29135]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:11.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:11 smithi192 ceph-mon[32842]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:11.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:11 smithi082 ceph-mon[32808]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:11.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:11 smithi080 ceph-mon[29135]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:13.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:13 smithi192 ceph-mon[32842]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:13.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:13 smithi082 ceph-mon[32808]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:13.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:13 smithi080 ceph-mon[29135]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:14.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:14 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T18:29:14.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:14 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:14.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:14 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T18:29:14.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:14 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:14.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:14 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T18:29:14.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:14 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:15.751 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:15 smithi192 ceph-mon[32842]: Deploying daemon osd.5 on smithi192 2024-04-26T18:29:15.751 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:15 smithi192 ceph-mon[32842]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:15.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:15 smithi082 ceph-mon[32808]: Deploying daemon osd.5 on smithi192 2024-04-26T18:29:15.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:15 smithi082 ceph-mon[32808]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:15.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:15 smithi080 ceph-mon[29135]: Deploying daemon osd.5 on smithi192 2024-04-26T18:29:15.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:15 smithi080 ceph-mon[29135]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:17.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:17 smithi192 ceph-mon[32842]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:17.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:17 smithi082 ceph-mon[32808]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:17.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:17 smithi080 ceph-mon[29135]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:19.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:19 smithi192 ceph-mon[32842]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:19.795 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:19 smithi080 ceph-mon[29135]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:19.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:19 smithi082 ceph-mon[32808]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:20.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:20 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:20.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:20 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:20.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:20 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:29:20.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:20 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:20.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:20 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:20.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:20 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:29:20.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:20 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:20.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:20 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:20.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:20 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:29:21.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:21 smithi192 ceph-mon[32842]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:21.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:21 smithi082 ceph-mon[32808]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:21.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:21 smithi080 ceph-mon[29135]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:23.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:23.571+0000 7f96927fc700 1 -- 172.21.15.192:0/898770354 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f969c0ffb10 con 0x7f96880a3cc0 2024-04-26T18:29:23.572 INFO:teuthology.orchestra.run.smithi192.stdout:Created osd(s) 5 on host 'smithi192' 2024-04-26T18:29:23.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:23.573+0000 7f96a3a28700 1 -- 172.21.15.192:0/898770354 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f96880a3cc0 msgr2=0x7f96880a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:29:23.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:23.573+0000 7f96a3a28700 1 --2- 172.21.15.192:0/898770354 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f96880a3cc0 0x7f96880a6180 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f969c1033e0 tx=0x7f969800b410 comp rx=0 tx=0).stop 2024-04-26T18:29:23.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:23.573+0000 7f96a3a28700 1 -- 172.21.15.192:0/898770354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f969c103f20 msgr2=0x7f969c104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:29:23.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:23.573+0000 7f96a3a28700 1 --2- 172.21.15.192:0/898770354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f969c103f20 0x7f969c104ea0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f96940062a0 tx=0x7f9694004e40 comp rx=0 tx=0).stop 2024-04-26T18:29:23.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:23.573+0000 7f96a3a28700 1 -- 172.21.15.192:0/898770354 shutdown_connections 2024-04-26T18:29:23.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:23.573+0000 7f96a3a28700 1 --2- 172.21.15.192:0/898770354 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f96880a3cc0 0x7f96880a6180 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:29:23.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:23.573+0000 7f96a3a28700 1 --2- 172.21.15.192:0/898770354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f969c103f20 0x7f969c104ea0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:29:23.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:23.573+0000 7f96a3a28700 1 --2- 172.21.15.192:0/898770354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f969c102380 0x7f969c1062c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:29:23.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:23.573+0000 7f96a3a28700 1 --2- 172.21.15.192:0/898770354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f969c103580 0x7f969c104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:29:23.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:23.573+0000 7f96a3a28700 1 -- 172.21.15.192:0/898770354 >> 172.21.15.192:0/898770354 conn(0x7f969c0fd920 msgr2=0x7f969c0ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:29:23.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:23.573+0000 7f96a3a28700 1 -- 172.21.15.192:0/898770354 shutdown_connections 2024-04-26T18:29:23.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:29:23.573+0000 7f96a3a28700 1 -- 172.21.15.192:0/898770354 wait complete. 2024-04-26T18:29:23.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:23 smithi192 ceph-mon[32842]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:23.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:23 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:23.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:23 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:23.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:23 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:23.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:23 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:29:23.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:23 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:23.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:23 smithi192 ceph-mon[32842]: from='osd.5 [v2:172.21.15.192:6808/1770809727,v1:172.21.15.192:6809/1770809727]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T18:29:23.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:23 smithi192 ceph-mon[32842]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T18:29:23.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:23 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:23.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:23 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:23.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:23 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:29:23.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:23 smithi082 ceph-mon[32808]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:23.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:23 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:23.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:23 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:23.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:23 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:23.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:23 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:29:23.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:23 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:23.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:23 smithi082 ceph-mon[32808]: from='osd.5 [v2:172.21.15.192:6808/1770809727,v1:172.21.15.192:6809/1770809727]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T18:29:23.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:23 smithi082 ceph-mon[32808]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T18:29:23.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:23 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:23.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:23 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:23.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:23 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:29:23.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:23 smithi080 ceph-mon[29135]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:23.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:23 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:23.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:23 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:23.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:23 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:23.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:23 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:29:23.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:23 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:23.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:23 smithi080 ceph-mon[29135]: from='osd.5 [v2:172.21.15.192:6808/1770809727,v1:172.21.15.192:6809/1770809727]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T18:29:23.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:23 smithi080 ceph-mon[29135]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T18:29:23.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:23 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:23.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:23 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:23.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:23 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:29:24.279 DEBUG:teuthology.orchestra.run.smithi192:osd.5> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.5.service 2024-04-26T18:29:24.281 INFO:tasks.cephadm:Deploying osd.6 on smithi080 with /dev/vg_nvme/lv_2... 2024-04-26T18:29:24.281 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-26T18:29:24.527 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:29:24.806 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:24 smithi192 ceph-mon[32842]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-26T18:29:24.807 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:24 smithi192 ceph-mon[32842]: osdmap e37: 6 total, 5 up, 6 in 2024-04-26T18:29:24.807 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:24 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T18:29:24.807 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:24 smithi192 ceph-mon[32842]: from='osd.5 [v2:172.21.15.192:6808/1770809727,v1:172.21.15.192:6809/1770809727]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-04-26T18:29:24.807 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:24 smithi192 ceph-mon[32842]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-04-26T18:29:24.807 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:24 smithi192 ceph-mon[32842]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:24.807 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:29:24 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:29:24.687+0000 7fed5bfe4700 -1 osd.5 0 waiting for initial osdmap 2024-04-26T18:29:24.807 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:29:24 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:29:24.693+0000 7fed57dd7700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T18:29:24.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:24 smithi082 ceph-mon[32808]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-26T18:29:24.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:24 smithi082 ceph-mon[32808]: osdmap e37: 6 total, 5 up, 6 in 2024-04-26T18:29:24.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:24 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T18:29:24.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:24 smithi082 ceph-mon[32808]: from='osd.5 [v2:172.21.15.192:6808/1770809727,v1:172.21.15.192:6809/1770809727]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-04-26T18:29:24.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:24 smithi082 ceph-mon[32808]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-04-26T18:29:24.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:24 smithi082 ceph-mon[32808]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:24.989 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:24 smithi080 ceph-mon[29135]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-26T18:29:24.990 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:24 smithi080 ceph-mon[29135]: osdmap e37: 6 total, 5 up, 6 in 2024-04-26T18:29:24.990 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:24 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T18:29:24.990 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:24 smithi080 ceph-mon[29135]: from='osd.5 [v2:172.21.15.192:6808/1770809727,v1:172.21.15.192:6809/1770809727]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-04-26T18:29:24.990 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:24 smithi080 ceph-mon[29135]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-04-26T18:29:24.990 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:24 smithi080 ceph-mon[29135]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-26T18:29:25.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:25 smithi192 ceph-mon[32842]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-04-26T18:29:25.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:25 smithi192 ceph-mon[32842]: osdmap e38: 6 total, 5 up, 6 in 2024-04-26T18:29:25.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:25 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T18:29:25.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:25 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T18:29:25.938 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:25 smithi080 ceph-mon[29135]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-04-26T18:29:25.939 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:25 smithi080 ceph-mon[29135]: osdmap e38: 6 total, 5 up, 6 in 2024-04-26T18:29:25.939 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:25 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T18:29:25.939 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:25 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T18:29:25.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:25 smithi082 ceph-mon[32808]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-04-26T18:29:25.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:25 smithi082 ceph-mon[32808]: osdmap e38: 6 total, 5 up, 6 in 2024-04-26T18:29:25.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:25 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T18:29:25.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:25 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T18:29:26.529 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-26T18:29:26.529 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-26T18:29:26.529 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-04-26T18:29:26.529 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-04-26T18:29:26.529 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0116418 s, 901 MB/s 2024-04-26T18:29:26.529 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-04-26T18:29:26.834 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:26 smithi080 ceph-mon[29135]: purged_snaps scrub starts 2024-04-26T18:29:26.834 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:26 smithi080 ceph-mon[29135]: purged_snaps scrub ok 2024-04-26T18:29:26.834 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:26 smithi080 ceph-mon[29135]: osd.5 [v2:172.21.15.192:6808/1770809727,v1:172.21.15.192:6809/1770809727] boot 2024-04-26T18:29:26.835 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:26 smithi080 ceph-mon[29135]: osdmap e39: 6 total, 6 up, 6 in 2024-04-26T18:29:26.835 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:26 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T18:29:26.835 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:26 smithi080 ceph-mon[29135]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:26.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:26 smithi082 ceph-mon[32808]: purged_snaps scrub starts 2024-04-26T18:29:26.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:26 smithi082 ceph-mon[32808]: purged_snaps scrub ok 2024-04-26T18:29:26.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:26 smithi082 ceph-mon[32808]: osd.5 [v2:172.21.15.192:6808/1770809727,v1:172.21.15.192:6809/1770809727] boot 2024-04-26T18:29:26.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:26 smithi082 ceph-mon[32808]: osdmap e39: 6 total, 6 up, 6 in 2024-04-26T18:29:26.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:26 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T18:29:26.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:26 smithi082 ceph-mon[32808]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:27.059 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:26 smithi192 ceph-mon[32842]: purged_snaps scrub starts 2024-04-26T18:29:27.060 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:26 smithi192 ceph-mon[32842]: purged_snaps scrub ok 2024-04-26T18:29:27.060 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:26 smithi192 ceph-mon[32842]: osd.5 [v2:172.21.15.192:6808/1770809727,v1:172.21.15.192:6809/1770809727] boot 2024-04-26T18:29:27.060 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:26 smithi192 ceph-mon[32842]: osdmap e39: 6 total, 6 up, 6 in 2024-04-26T18:29:27.060 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:26 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T18:29:27.060 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:26 smithi192 ceph-mon[32842]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:27.162 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi080:vg_nvme/lv_2 2024-04-26T18:29:27.402 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:29:27.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:27 smithi080 ceph-mon[29135]: osdmap e40: 6 total, 6 up, 6 in 2024-04-26T18:29:27.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:27 smithi080 ceph-mon[29135]: Detected new or changed devices on smithi192 2024-04-26T18:29:27.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:27.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:27.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:29:27.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:29:27.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:27 smithi080 ceph-mon[29135]: Adjusting osd_memory_target on smithi192 to 8544M 2024-04-26T18:29:27.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:27.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:27.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:29:27.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:27.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:27 smithi082 ceph-mon[32808]: osdmap e40: 6 total, 6 up, 6 in 2024-04-26T18:29:27.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:27 smithi082 ceph-mon[32808]: Detected new or changed devices on smithi192 2024-04-26T18:29:27.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:27 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:27.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:27 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:27.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:27 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:29:27.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:27 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:29:27.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:27 smithi082 ceph-mon[32808]: Adjusting osd_memory_target on smithi192 to 8544M 2024-04-26T18:29:27.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:27 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:27.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:27 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:27.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:27 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:29:27.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:27 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:28.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:27 smithi192 ceph-mon[32842]: osdmap e40: 6 total, 6 up, 6 in 2024-04-26T18:29:28.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:27 smithi192 ceph-mon[32842]: Detected new or changed devices on smithi192 2024-04-26T18:29:28.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:27 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:28.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:27 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:28.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:27 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:29:28.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:27 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:29:28.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:27 smithi192 ceph-mon[32842]: Adjusting osd_memory_target on smithi192 to 8544M 2024-04-26T18:29:28.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:27 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:28.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:27 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:28.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:27 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:29:28.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:27 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:28.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:28 smithi080 ceph-mon[29135]: osdmap e41: 6 total, 6 up, 6 in 2024-04-26T18:29:28.809 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:28 smithi080 ceph-mon[29135]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:28.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:28 smithi082 ceph-mon[32808]: osdmap e41: 6 total, 6 up, 6 in 2024-04-26T18:29:28.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:28 smithi082 ceph-mon[32808]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:29.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.008+0000 7fbecb246700 1 -- 172.21.15.80:0/4059841976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbec4102380 msgr2=0x7fbec41027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:29:29.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.008+0000 7fbecb246700 1 --2- 172.21.15.80:0/4059841976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbec4102380 0x7fbec41027a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbeb80099c0 tx=0x7fbeb8009cd0 comp rx=0 tx=0).stop 2024-04-26T18:29:29.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.008+0000 7fbecb246700 1 -- 172.21.15.80:0/4059841976 shutdown_connections 2024-04-26T18:29:29.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.008+0000 7fbecb246700 1 --2- 172.21.15.80:0/4059841976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec4103f20 0x7fbec410a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:29:29.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.008+0000 7fbecb246700 1 --2- 172.21.15.80:0/4059841976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbec4102380 0x7fbec41027a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:29:29.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.008+0000 7fbecb246700 1 --2- 172.21.15.80:0/4059841976 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec4103580 0x7fbec41039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:29:29.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.008+0000 7fbecb246700 1 -- 172.21.15.80:0/4059841976 >> 172.21.15.80:0/4059841976 conn(0x7fbec40fd920 msgr2=0x7fbec40ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:29:29.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.008+0000 7fbecb246700 1 -- 172.21.15.80:0/4059841976 shutdown_connections 2024-04-26T18:29:29.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.008+0000 7fbecb246700 1 -- 172.21.15.80:0/4059841976 wait complete. 2024-04-26T18:29:29.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.009+0000 7fbecb246700 1 Processor -- start 2024-04-26T18:29:29.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.009+0000 7fbecb246700 1 -- start start 2024-04-26T18:29:29.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.009+0000 7fbecb246700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbec4102380 0x7fbec4199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:29:29.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.009+0000 7fbecb246700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec4103580 0x7fbec4199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:29:29.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.009+0000 7fbecb246700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec4103f20 0x7fbec41a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:29:29.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.009+0000 7fbecb246700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fbec410ef10 con 0x7fbec4102380 2024-04-26T18:29:29.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.009+0000 7fbecb246700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbec410ed90 con 0x7fbec4103580 2024-04-26T18:29:29.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.009+0000 7fbecb246700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbec410f090 con 0x7fbec4103f20 2024-04-26T18:29:29.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.009+0000 7fbec8fe2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbec4102380 0x7fbec4199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:29:29.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.009+0000 7fbec8fe2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbec4102380 0x7fbec4199610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39118/0 (socket says 172.21.15.80:39118) 2024-04-26T18:29:29.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.009+0000 7fbec8fe2700 1 -- 172.21.15.80:0/1723932071 learned_addr learned my addr 172.21.15.80:0/1723932071 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:29:29.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.009+0000 7fbec97e3700 1 --2- 172.21.15.80:0/1723932071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec4103f20 0x7fbec41a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:29:29.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.010+0000 7fbec3fff700 1 --2- 172.21.15.80:0/1723932071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec4103580 0x7fbec4199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:29:29.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.010+0000 7fbec8fe2700 1 -- 172.21.15.80:0/1723932071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec4103f20 msgr2=0x7fbec41a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:29:29.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.010+0000 7fbec8fe2700 1 --2- 172.21.15.80:0/1723932071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec4103f20 0x7fbec41a0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:29:29.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.010+0000 7fbec8fe2700 1 -- 172.21.15.80:0/1723932071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec4103580 msgr2=0x7fbec4199b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:29:29.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.010+0000 7fbec8fe2700 1 --2- 172.21.15.80:0/1723932071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec4103580 0x7fbec4199b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:29:29.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.010+0000 7fbec8fe2700 1 -- 172.21.15.80:0/1723932071 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec41a1270 con 0x7fbec4102380 2024-04-26T18:29:29.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.010+0000 7fbec3fff700 1 --2- 172.21.15.80:0/1723932071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec4103580 0x7fbec4199b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:29:29.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.010+0000 7fbec8fe2700 1 --2- 172.21.15.80:0/1723932071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbec4102380 0x7fbec4199610 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800b580 tx=0x7fbeb8009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:29:29.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.010+0000 7fbec1ffb700 1 -- 172.21.15.80:0/1723932071 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8027070 con 0x7fbec4102380 2024-04-26T18:29:29.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.010+0000 7fbecb246700 1 -- 172.21.15.80:0/1723932071 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec41a1500 con 0x7fbec4102380 2024-04-26T18:29:29.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.010+0000 7fbec1ffb700 1 -- 172.21.15.80:0/1723932071 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbeb80040a0 con 0x7fbec4102380 2024-04-26T18:29:29.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.010+0000 7fbec1ffb700 1 -- 172.21.15.80:0/1723932071 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8022da0 con 0x7fbec4102380 2024-04-26T18:29:29.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.010+0000 7fbecb246700 1 -- 172.21.15.80:0/1723932071 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec41a1a30 con 0x7fbec4102380 2024-04-26T18:29:29.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.011+0000 7fbecb246700 1 -- 172.21.15.80:0/1723932071 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec406a110 con 0x7fbec4102380 2024-04-26T18:29:29.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.012+0000 7fbec1ffb700 1 -- 172.21.15.80:0/1723932071 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fbeb802a070 con 0x7fbec4102380 2024-04-26T18:29:29.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.013+0000 7fbec1ffb700 1 --2- 172.21.15.80:0/1723932071 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fbeb40a3cc0 0x7fbeb40a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:29:29.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.013+0000 7fbec1ffb700 1 -- 172.21.15.80:0/1723932071 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4533+0+0 (secure 0 0 0) 0x7fbeb80d07f0 con 0x7fbec4102380 2024-04-26T18:29:29.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.013+0000 7fbec3fff700 1 --2- 172.21.15.80:0/1723932071 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fbeb40a3cc0 0x7fbeb40a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:29:29.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.013+0000 7fbec3fff700 1 --2- 172.21.15.80:0/1723932071 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fbeb40a3cc0 0x7fbeb40a6180 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0005fd0 tx=0x7fbeb0005ee0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:29:29.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.017+0000 7fbec1ffb700 1 -- 172.21.15.80:0/1723932071 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbeb8031020 con 0x7fbec4102380 2024-04-26T18:29:29.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:28 smithi192 ceph-mon[32842]: osdmap e41: 6 total, 6 up, 6 in 2024-04-26T18:29:29.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:28 smithi192 ceph-mon[32842]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:29.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:29.224+0000 7fbecb246700 1 -- 172.21.15.80:0/1723932071 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fbec4063860 con 0x7fbeb40a3cc0 2024-04-26T18:29:29.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:29 smithi082 ceph-mon[32808]: osdmap e42: 6 total, 6 up, 6 in 2024-04-26T18:29:29.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:29 smithi082 ceph-mon[32808]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:29:29.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:29 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:29:29.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:29 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:29:29.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:29 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:29.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:29 smithi080 ceph-mon[29135]: osdmap e42: 6 total, 6 up, 6 in 2024-04-26T18:29:29.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:29 smithi080 ceph-mon[29135]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:29:29.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:29 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:29:29.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:29 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:29:29.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:29 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:30.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:29 smithi192 ceph-mon[32842]: osdmap e42: 6 total, 6 up, 6 in 2024-04-26T18:29:30.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:29 smithi192 ceph-mon[32842]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:29:30.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:29 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:29:30.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:29 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:29:30.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:29 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:30.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:30 smithi080 ceph-mon[29135]: osdmap e43: 6 total, 6 up, 6 in 2024-04-26T18:29:30.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:30 smithi080 ceph-mon[29135]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T18:29:31.014 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:30 smithi192 ceph-mon[32842]: osdmap e43: 6 total, 6 up, 6 in 2024-04-26T18:29:31.014 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:30 smithi192 ceph-mon[32842]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T18:29:31.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:30 smithi082 ceph-mon[32808]: osdmap e43: 6 total, 6 up, 6 in 2024-04-26T18:29:31.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:30 smithi082 ceph-mon[32808]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T18:29:32.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:32 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/880165425' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b4374d8-98e6-48e1-924b-c9b70a4baf28"}]: dispatch 2024-04-26T18:29:32.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:32 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/880165425' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b4374d8-98e6-48e1-924b-c9b70a4baf28"}]': finished 2024-04-26T18:29:32.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:32 smithi192 ceph-mon[32842]: osdmap e44: 7 total, 6 up, 7 in 2024-04-26T18:29:32.289 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:32 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T18:29:32.297 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:32 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/880165425' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b4374d8-98e6-48e1-924b-c9b70a4baf28"}]: dispatch 2024-04-26T18:29:32.297 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:32 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/880165425' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b4374d8-98e6-48e1-924b-c9b70a4baf28"}]': finished 2024-04-26T18:29:32.297 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:32 smithi080 ceph-mon[29135]: osdmap e44: 7 total, 6 up, 7 in 2024-04-26T18:29:32.297 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:32 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T18:29:32.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:32 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/880165425' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b4374d8-98e6-48e1-924b-c9b70a4baf28"}]: dispatch 2024-04-26T18:29:32.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:32 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/880165425' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b4374d8-98e6-48e1-924b-c9b70a4baf28"}]': finished 2024-04-26T18:29:32.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:32 smithi082 ceph-mon[32808]: osdmap e44: 7 total, 6 up, 7 in 2024-04-26T18:29:32.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:32 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T18:29:33.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:33 smithi192 ceph-mon[32842]: pgmap v145: 1 pgs: 1 peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-04-26T18:29:33.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:33 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3352587606' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:29:33.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:33 smithi082 ceph-mon[32808]: pgmap v145: 1 pgs: 1 peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-04-26T18:29:33.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:33 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3352587606' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:29:33.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:33 smithi080 ceph-mon[29135]: pgmap v145: 1 pgs: 1 peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-04-26T18:29:33.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:33 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3352587606' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:29:35.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:35 smithi192 ceph-mon[32842]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-26T18:29:35.964 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:35 smithi080 ceph-mon[29135]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-26T18:29:35.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:35 smithi082 ceph-mon[32808]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-26T18:29:37.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:37 smithi192 ceph-mon[32842]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-04-26T18:29:37.921 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:37 smithi080 ceph-mon[29135]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-04-26T18:29:37.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:37 smithi082 ceph-mon[32808]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-04-26T18:29:39.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:39 smithi080 ceph-mon[29135]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:39.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-26T18:29:39.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:39.771 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:39 smithi082 ceph-mon[32808]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:39.771 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:39 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-26T18:29:39.771 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:39 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:39.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:39 smithi192 ceph-mon[32842]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:39.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:39 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-26T18:29:39.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:39 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:40.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:40 smithi192 ceph-mon[32842]: Deploying daemon osd.6 on smithi080 2024-04-26T18:29:40.969 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:40 smithi080 ceph-mon[29135]: Deploying daemon osd.6 on smithi080 2024-04-26T18:29:40.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:40 smithi082 ceph-mon[32808]: Deploying daemon osd.6 on smithi080 2024-04-26T18:29:41.645 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:41 smithi080 ceph-mon[29135]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:41.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:41 smithi192 ceph-mon[32842]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:41.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:41 smithi082 ceph-mon[32808]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:43.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:43 smithi192 ceph-mon[32842]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:43.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:43 smithi082 ceph-mon[32808]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:43.970 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:43 smithi080 ceph-mon[29135]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:45.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:45 smithi080 ceph-mon[29135]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:45.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:45 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:45.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:45 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:45.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:45 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:29:45.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:45 smithi192 ceph-mon[32842]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:45.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:45 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:45.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:45 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:45.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:45 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:29:45.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:45 smithi082 ceph-mon[32808]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:45.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:45 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:45.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:45 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:45.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:45 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:29:47.578 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:47 smithi080 ceph-mon[29135]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:47.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:47 smithi192 ceph-mon[32842]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:47.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:47 smithi082 ceph-mon[32808]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:48.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:48.684+0000 7fbec1ffb700 1 -- 172.21.15.80:0/1723932071 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbec4063860 con 0x7fbeb40a3cc0 2024-04-26T18:29:48.685 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 6 on host 'smithi080' 2024-04-26T18:29:48.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:48.688+0000 7fbecb246700 1 -- 172.21.15.80:0/1723932071 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fbeb40a3cc0 msgr2=0x7fbeb40a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:29:48.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:48.688+0000 7fbecb246700 1 --2- 172.21.15.80:0/1723932071 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fbeb40a3cc0 0x7fbeb40a6180 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0005fd0 tx=0x7fbeb0005ee0 comp rx=0 tx=0).stop 2024-04-26T18:29:48.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:48.688+0000 7fbecb246700 1 -- 172.21.15.80:0/1723932071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbec4102380 msgr2=0x7fbec4199610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:29:48.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:48.688+0000 7fbecb246700 1 --2- 172.21.15.80:0/1723932071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbec4102380 0x7fbec4199610 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800b580 tx=0x7fbeb8009580 comp rx=0 tx=0).stop 2024-04-26T18:29:48.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:48.688+0000 7fbecb246700 1 -- 172.21.15.80:0/1723932071 shutdown_connections 2024-04-26T18:29:48.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:48.688+0000 7fbecb246700 1 --2- 172.21.15.80:0/1723932071 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fbeb40a3cc0 0x7fbeb40a6180 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:29:48.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:48.688+0000 7fbecb246700 1 --2- 172.21.15.80:0/1723932071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec4103f20 0x7fbec41a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:29:48.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:48.688+0000 7fbecb246700 1 --2- 172.21.15.80:0/1723932071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbec4102380 0x7fbec4199610 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:29:48.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:48.688+0000 7fbecb246700 1 --2- 172.21.15.80:0/1723932071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec4103580 0x7fbec4199b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:29:48.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:48.688+0000 7fbecb246700 1 -- 172.21.15.80:0/1723932071 >> 172.21.15.80:0/1723932071 conn(0x7fbec40fd920 msgr2=0x7fbec41069c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:29:48.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:48.688+0000 7fbecb246700 1 -- 172.21.15.80:0/1723932071 shutdown_connections 2024-04-26T18:29:48.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:29:48.688+0000 7fbecb246700 1 -- 172.21.15.80:0/1723932071 wait complete. 2024-04-26T18:29:48.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:48 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:48.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:48 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:48.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:48 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:48.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:48 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:29:48.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:48 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:48.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:48 smithi080 ceph-mon[29135]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:48.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:48 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:48.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:48 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:48.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:48 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:29:48.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:48 smithi080 ceph-mon[29135]: from='osd.6 [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-26T18:29:49.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:48 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:49.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:48 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:49.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:48 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:49.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:48 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:29:49.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:48 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:49.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:48 smithi192 ceph-mon[32842]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:49.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:48 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:49.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:48 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:49.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:48 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:29:49.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:48 smithi192 ceph-mon[32842]: from='osd.6 [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-26T18:29:49.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:48 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:49.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:48 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:49.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:48 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:49.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:48 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:29:49.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:48 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:49.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:48 smithi082 ceph-mon[32808]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:49.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:48 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:49.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:48 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:49.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:48 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:29:49.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:48 smithi082 ceph-mon[32808]: from='osd.6 [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-26T18:29:49.442 DEBUG:teuthology.orchestra.run.smithi080:osd.6> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.6.service 2024-04-26T18:29:49.445 INFO:tasks.cephadm:Deploying osd.7 on smithi082 with /dev/vg_nvme/lv_2... 2024-04-26T18:29:49.445 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-26T18:29:49.693 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T18:29:50.955 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:50 smithi080 ceph-mon[29135]: from='osd.6 [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-26T18:29:50.955 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:50 smithi080 ceph-mon[29135]: osdmap e45: 7 total, 6 up, 7 in 2024-04-26T18:29:50.955 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:50 smithi080 ceph-mon[29135]: from='osd.6 [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T18:29:50.955 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:50 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T18:29:50.955 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:50 smithi080 ceph-mon[29135]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:50.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:50 smithi082 ceph-mon[32808]: from='osd.6 [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-26T18:29:50.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:50 smithi082 ceph-mon[32808]: osdmap e45: 7 total, 6 up, 7 in 2024-04-26T18:29:50.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:50 smithi082 ceph-mon[32808]: from='osd.6 [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T18:29:50.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T18:29:50.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:50 smithi082 ceph-mon[32808]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:51.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:50 smithi192 ceph-mon[32842]: from='osd.6 [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-26T18:29:51.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:50 smithi192 ceph-mon[32842]: osdmap e45: 7 total, 6 up, 7 in 2024-04-26T18:29:51.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:50 smithi192 ceph-mon[32842]: from='osd.6 [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T18:29:51.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:50 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T18:29:51.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:50 smithi192 ceph-mon[32842]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:51.243 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:29:51 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:29:51.148+0000 7f355f822700 -1 osd.6 0 waiting for initial osdmap 2024-04-26T18:29:51.243 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:29:51 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:29:51.160+0000 7f355760d700 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T18:29:51.799 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-26T18:29:51.799 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-26T18:29:51.800 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-04-26T18:29:51.800 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-04-26T18:29:51.800 INFO:teuthology.orchestra.run.smithi082.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0170451 s, 615 MB/s 2024-04-26T18:29:51.800 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-04-26T18:29:51.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:51 smithi082 ceph-mon[32808]: from='osd.6 [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-26T18:29:51.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:51 smithi082 ceph-mon[32808]: osdmap e46: 7 total, 6 up, 7 in 2024-04-26T18:29:51.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:51 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T18:29:51.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:51 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T18:29:51.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:51 smithi082 ceph-mon[32808]: from='osd.6 [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490]' entity='osd.6' 2024-04-26T18:29:51.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:51 smithi080 ceph-mon[29135]: from='osd.6 [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-26T18:29:51.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:51 smithi080 ceph-mon[29135]: osdmap e46: 7 total, 6 up, 7 in 2024-04-26T18:29:51.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T18:29:51.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T18:29:51.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:51 smithi080 ceph-mon[29135]: from='osd.6 [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490]' entity='osd.6' 2024-04-26T18:29:52.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:51 smithi192 ceph-mon[32842]: from='osd.6 [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-26T18:29:52.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:51 smithi192 ceph-mon[32842]: osdmap e46: 7 total, 6 up, 7 in 2024-04-26T18:29:52.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:51 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T18:29:52.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:51 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T18:29:52.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:51 smithi192 ceph-mon[32842]: from='osd.6 [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490]' entity='osd.6' 2024-04-26T18:29:52.407 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_2 2024-04-26T18:29:52.654 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T18:29:52.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:52 smithi082 ceph-mon[32808]: purged_snaps scrub starts 2024-04-26T18:29:52.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:52 smithi082 ceph-mon[32808]: purged_snaps scrub ok 2024-04-26T18:29:52.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:52 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T18:29:52.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:52 smithi082 ceph-mon[32808]: osd.6 [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490] boot 2024-04-26T18:29:52.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:52 smithi082 ceph-mon[32808]: osdmap e47: 7 total, 7 up, 7 in 2024-04-26T18:29:52.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:52 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T18:29:52.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:52 smithi082 ceph-mon[32808]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:52.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:52 smithi080 ceph-mon[29135]: purged_snaps scrub starts 2024-04-26T18:29:52.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:52 smithi080 ceph-mon[29135]: purged_snaps scrub ok 2024-04-26T18:29:52.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:52 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T18:29:52.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:52 smithi080 ceph-mon[29135]: osd.6 [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490] boot 2024-04-26T18:29:52.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:52 smithi080 ceph-mon[29135]: osdmap e47: 7 total, 7 up, 7 in 2024-04-26T18:29:52.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:52 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T18:29:52.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:52 smithi080 ceph-mon[29135]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:53.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:52 smithi192 ceph-mon[32842]: purged_snaps scrub starts 2024-04-26T18:29:53.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:52 smithi192 ceph-mon[32842]: purged_snaps scrub ok 2024-04-26T18:29:53.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:52 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T18:29:53.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:52 smithi192 ceph-mon[32842]: osd.6 [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490] boot 2024-04-26T18:29:53.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:52 smithi192 ceph-mon[32842]: osdmap e47: 7 total, 7 up, 7 in 2024-04-26T18:29:53.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:52 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T18:29:53.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:52 smithi192 ceph-mon[32842]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-04-26T18:29:54.090 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:53 smithi082 ceph-mon[32808]: Detected new or changed devices on smithi080 2024-04-26T18:29:54.090 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:53 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:54.090 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:53 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:54.090 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:53 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:29:54.090 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:53 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:29:54.090 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:53 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:29:54.090 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:53 smithi082 ceph-mon[32808]: Adjusting osd_memory_target on smithi080 to 5696M 2024-04-26T18:29:54.090 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:53 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:54.090 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:53 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:54.090 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:53 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:29:54.090 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:53 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:54.090 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:53 smithi082 ceph-mon[32808]: osdmap e48: 7 total, 7 up, 7 in 2024-04-26T18:29:54.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:53 smithi192 ceph-mon[32842]: Detected new or changed devices on smithi080 2024-04-26T18:29:54.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:53 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:54.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:53 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:54.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:53 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:29:54.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:53 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:29:54.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:53 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:29:54.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:53 smithi192 ceph-mon[32842]: Adjusting osd_memory_target on smithi080 to 5696M 2024-04-26T18:29:54.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:53 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:54.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:53 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:54.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:53 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:29:54.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:53 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:54.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:53 smithi192 ceph-mon[32842]: osdmap e48: 7 total, 7 up, 7 in 2024-04-26T18:29:54.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:53 smithi080 ceph-mon[29135]: Detected new or changed devices on smithi080 2024-04-26T18:29:54.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:53 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:54.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:53 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:54.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:53 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:29:54.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:53 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:29:54.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:53 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:29:54.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:53 smithi080 ceph-mon[29135]: Adjusting osd_memory_target on smithi080 to 5696M 2024-04-26T18:29:54.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:53 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:54.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:53 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:54.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:53 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:29:54.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:53 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:29:54.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:53 smithi080 ceph-mon[29135]: osdmap e48: 7 total, 7 up, 7 in 2024-04-26T18:29:54.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.316+0000 7fad287cd700 1 -- 172.21.15.82:0/2449258179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad20103f20 msgr2=0x7fad2010a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:29:54.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.316+0000 7fad287cd700 1 --2- 172.21.15.82:0/2449258179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad20103f20 0x7fad2010a7d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fad1800b0d0 tx=0x7fad1800b3e0 comp rx=0 tx=0).stop 2024-04-26T18:29:54.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.317+0000 7fad287cd700 1 -- 172.21.15.82:0/2449258179 shutdown_connections 2024-04-26T18:29:54.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.317+0000 7fad287cd700 1 --2- 172.21.15.82:0/2449258179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad20103f20 0x7fad2010a7d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:29:54.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.317+0000 7fad287cd700 1 --2- 172.21.15.82:0/2449258179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad20102380 0x7fad201027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:29:54.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.317+0000 7fad287cd700 1 --2- 172.21.15.82:0/2449258179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad20103580 0x7fad201039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:29:54.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.317+0000 7fad287cd700 1 -- 172.21.15.82:0/2449258179 >> 172.21.15.82:0/2449258179 conn(0x7fad200fd920 msgr2=0x7fad200ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:29:54.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.317+0000 7fad287cd700 1 -- 172.21.15.82:0/2449258179 shutdown_connections 2024-04-26T18:29:54.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.317+0000 7fad287cd700 1 -- 172.21.15.82:0/2449258179 wait complete. 2024-04-26T18:29:54.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.317+0000 7fad287cd700 1 Processor -- start 2024-04-26T18:29:54.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.317+0000 7fad287cd700 1 -- start start 2024-04-26T18:29:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.317+0000 7fad287cd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad20102380 0x7fad201995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:29:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.317+0000 7fad287cd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad20103580 0x7fad20199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:29:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.317+0000 7fad287cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad20103f20 0x7fad201a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:29:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.317+0000 7fad287cd700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fad2010de90 con 0x7fad20103580 2024-04-26T18:29:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.317+0000 7fad287cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fad2010dd10 con 0x7fad20103f20 2024-04-26T18:29:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.317+0000 7fad287cd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fad2010e010 con 0x7fad20102380 2024-04-26T18:29:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.317+0000 7fad26d6a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad20103f20 0x7fad201a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:29:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.317+0000 7fad26d6a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad20103f20 0x7fad201a0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44938/0 (socket says 172.21.15.82:44938) 2024-04-26T18:29:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.318+0000 7fad26d6a700 1 -- 172.21.15.82:0/2465387537 learned_addr learned my addr 172.21.15.82:0/2465387537 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T18:29:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.318+0000 7fad25d68700 1 --2- 172.21.15.82:0/2465387537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad20103580 0x7fad20199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:29:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.318+0000 7fad26569700 1 --2- 172.21.15.82:0/2465387537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad20102380 0x7fad201995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:29:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.318+0000 7fad26d6a700 1 -- 172.21.15.82:0/2465387537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad20102380 msgr2=0x7fad201995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:29:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.318+0000 7fad26d6a700 1 --2- 172.21.15.82:0/2465387537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad20102380 0x7fad201995a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:29:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.318+0000 7fad26d6a700 1 -- 172.21.15.82:0/2465387537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad20103580 msgr2=0x7fad20199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:29:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.318+0000 7fad26d6a700 1 --2- 172.21.15.82:0/2465387537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad20103580 0x7fad20199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:29:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.318+0000 7fad26d6a700 1 -- 172.21.15.82:0/2465387537 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad201a1200 con 0x7fad20103f20 2024-04-26T18:29:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.318+0000 7fad26d6a700 1 --2- 172.21.15.82:0/2465387537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad20103f20 0x7fad201a0b60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fad18009040 tx=0x7fad18004d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:29:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.318+0000 7fad177fe700 1 -- 172.21.15.82:0/2465387537 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1801f030 con 0x7fad20103f20 2024-04-26T18:29:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.318+0000 7fad177fe700 1 -- 172.21.15.82:0/2465387537 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad18003a00 con 0x7fad20103f20 2024-04-26T18:29:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.318+0000 7fad287cd700 1 -- 172.21.15.82:0/2465387537 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad201a1490 con 0x7fad20103f20 2024-04-26T18:29:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.318+0000 7fad177fe700 1 -- 172.21.15.82:0/2465387537 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad180047b0 con 0x7fad20103f20 2024-04-26T18:29:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.318+0000 7fad287cd700 1 -- 172.21.15.82:0/2465387537 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad201a1960 con 0x7fad20103f20 2024-04-26T18:29:54.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.319+0000 7fad287cd700 1 -- 172.21.15.82:0/2465387537 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad2006a110 con 0x7fad20103f20 2024-04-26T18:29:54.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.320+0000 7fad177fe700 1 -- 172.21.15.82:0/2465387537 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fad18003bb0 con 0x7fad20103f20 2024-04-26T18:29:54.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.321+0000 7fad177fe700 1 --2- 172.21.15.82:0/2465387537 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fad0c0a3c40 0x7fad0c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:29:54.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.321+0000 7fad177fe700 1 -- 172.21.15.82:0/2465387537 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4965+0+0 (secure 0 0 0) 0x7fad1800f020 con 0x7fad20103f20 2024-04-26T18:29:54.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.321+0000 7fad26569700 1 --2- 172.21.15.82:0/2465387537 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fad0c0a3c40 0x7fad0c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:29:54.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.322+0000 7fad26569700 1 --2- 172.21.15.82:0/2465387537 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fad0c0a3c40 0x7fad0c0a6100 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fad1c006fd0 tx=0x7fad1c008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:29:54.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.325+0000 7fad177fe700 1 -- 172.21.15.82:0/2465387537 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fad18029020 con 0x7fad20103f20 2024-04-26T18:29:54.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:29:54.532+0000 7fad287cd700 1 -- 172.21.15.82:0/2465387537 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fad200ffac0 con 0x7fad0c0a3c40 2024-04-26T18:29:55.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:54 smithi192 ceph-mon[32842]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:29:55.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:54 smithi192 ceph-mon[32842]: from='client.24254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:29:55.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:54 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:29:55.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:54 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:29:55.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:54 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:55.141 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:54 smithi082 ceph-mon[32808]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:29:55.141 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:54 smithi082 ceph-mon[32808]: from='client.24254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:29:55.141 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:54 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:29:55.141 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:54 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:29:55.142 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:54 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:55.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:54 smithi080 ceph-mon[29135]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:29:55.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:54 smithi080 ceph-mon[29135]: from='client.24254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:29:55.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:54 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:29:55.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:54 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:29:55.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:54 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:57.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:57 smithi192 ceph-mon[32842]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:29:57.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:57 smithi192 ceph-mon[32842]: from='client.? 172.21.15.82:0/1147228184' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3bb3c7d-4cce-4f49-b924-72ebbaad58ff"}]: dispatch 2024-04-26T18:29:57.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:57 smithi192 ceph-mon[32842]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3bb3c7d-4cce-4f49-b924-72ebbaad58ff"}]: dispatch 2024-04-26T18:29:57.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:57 smithi192 ceph-mon[32842]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3bb3c7d-4cce-4f49-b924-72ebbaad58ff"}]': finished 2024-04-26T18:29:57.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:57 smithi192 ceph-mon[32842]: osdmap e49: 8 total, 7 up, 8 in 2024-04-26T18:29:57.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:57 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T18:29:57.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:57 smithi082 ceph-mon[32808]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:29:57.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:57 smithi082 ceph-mon[32808]: from='client.? 172.21.15.82:0/1147228184' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3bb3c7d-4cce-4f49-b924-72ebbaad58ff"}]: dispatch 2024-04-26T18:29:57.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:57 smithi082 ceph-mon[32808]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3bb3c7d-4cce-4f49-b924-72ebbaad58ff"}]: dispatch 2024-04-26T18:29:57.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:57 smithi082 ceph-mon[32808]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3bb3c7d-4cce-4f49-b924-72ebbaad58ff"}]': finished 2024-04-26T18:29:57.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:57 smithi082 ceph-mon[32808]: osdmap e49: 8 total, 7 up, 8 in 2024-04-26T18:29:57.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:57 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T18:29:57.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:57 smithi080 ceph-mon[29135]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:29:57.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:57 smithi080 ceph-mon[29135]: from='client.? 172.21.15.82:0/1147228184' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3bb3c7d-4cce-4f49-b924-72ebbaad58ff"}]: dispatch 2024-04-26T18:29:57.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:57 smithi080 ceph-mon[29135]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3bb3c7d-4cce-4f49-b924-72ebbaad58ff"}]: dispatch 2024-04-26T18:29:57.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:57 smithi080 ceph-mon[29135]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3bb3c7d-4cce-4f49-b924-72ebbaad58ff"}]': finished 2024-04-26T18:29:57.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:57 smithi080 ceph-mon[29135]: osdmap e49: 8 total, 7 up, 8 in 2024-04-26T18:29:57.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:57 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T18:29:58.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:58 smithi192 ceph-mon[32842]: from='client.? 172.21.15.82:0/3663535172' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:29:58.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:58 smithi082 ceph-mon[32808]: from='client.? 172.21.15.82:0/3663535172' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:29:58.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:58 smithi080 ceph-mon[29135]: from='client.? 172.21.15.82:0/3663535172' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:29:59.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:29:59 smithi192 ceph-mon[32842]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:29:59.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:29:59 smithi082 ceph-mon[32808]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:29:59.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:29:59 smithi080 ceph-mon[29135]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:00.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:00 smithi192 ceph-mon[32842]: overall HEALTH_OK 2024-04-26T18:30:00.895 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:00 smithi082 ceph-mon[32808]: overall HEALTH_OK 2024-04-26T18:30:00.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:00 smithi080 ceph-mon[29135]: overall HEALTH_OK 2024-04-26T18:30:01.606 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:01 smithi082 ceph-mon[32808]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:01.777 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:01 smithi192 ceph-mon[32842]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:01.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:01 smithi080 ceph-mon[29135]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:03.717 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:03 smithi082 ceph-mon[32808]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:03.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:03 smithi192 ceph-mon[32842]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:03.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:03 smithi080 ceph-mon[29135]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:05.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:05 smithi192 ceph-mon[32842]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:05.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:05 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-26T18:30:05.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:05 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:05.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:05 smithi082 ceph-mon[32808]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:05.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:05 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-26T18:30:05.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:05 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:05.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:05 smithi080 ceph-mon[29135]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:05.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:05 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-26T18:30:05.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:05 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:06.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:06 smithi192 ceph-mon[32842]: Deploying daemon osd.7 on smithi082 2024-04-26T18:30:06.881 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:06 smithi082 ceph-mon[32808]: Deploying daemon osd.7 on smithi082 2024-04-26T18:30:06.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:06 smithi080 ceph-mon[29135]: Deploying daemon osd.7 on smithi082 2024-04-26T18:30:07.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:07 smithi082 ceph-mon[32808]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:07.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:07 smithi192 ceph-mon[32842]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:07.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:07 smithi080 ceph-mon[29135]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:09.700 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:09 smithi082 ceph-mon[32808]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:09.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:09 smithi192 ceph-mon[32842]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:09.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:09 smithi080 ceph-mon[29135]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:11.521 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:11.522 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:11.522 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:30:11.522 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:11 smithi082 ceph-mon[32808]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:11.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:11.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:11.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:30:11.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:11 smithi192 ceph-mon[32842]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:11.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:11.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:11.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:30:11.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:11 smithi080 ceph-mon[29135]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:13.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:13 smithi082 ceph-mon[32808]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:13.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:13.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:13.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:13.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:30:13.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:13.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:13 smithi192 ceph-mon[32842]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:13.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:13.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:13.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:13.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:30:13.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:13.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:13 smithi080 ceph-mon[29135]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:13.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:13.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:13.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:13.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:30:13.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:14.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:30:14.148+0000 7fad177fe700 1 -- 172.21.15.82:0/2465387537 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fad200ffac0 con 0x7fad0c0a3c40 2024-04-26T18:30:14.149 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 7 on host 'smithi082' 2024-04-26T18:30:14.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:30:14.150+0000 7fad287cd700 1 -- 172.21.15.82:0/2465387537 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fad0c0a3c40 msgr2=0x7fad0c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:14.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:30:14.150+0000 7fad287cd700 1 --2- 172.21.15.82:0/2465387537 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fad0c0a3c40 0x7fad0c0a6100 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fad1c006fd0 tx=0x7fad1c008040 comp rx=0 tx=0).stop 2024-04-26T18:30:14.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:30:14.150+0000 7fad287cd700 1 -- 172.21.15.82:0/2465387537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad20103f20 msgr2=0x7fad201a0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:14.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:30:14.150+0000 7fad287cd700 1 --2- 172.21.15.82:0/2465387537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad20103f20 0x7fad201a0b60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fad18009040 tx=0x7fad18004d50 comp rx=0 tx=0).stop 2024-04-26T18:30:14.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:30:14.151+0000 7fad287cd700 1 -- 172.21.15.82:0/2465387537 shutdown_connections 2024-04-26T18:30:14.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:30:14.151+0000 7fad287cd700 1 --2- 172.21.15.82:0/2465387537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad20103f20 0x7fad201a0b60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:14.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:30:14.151+0000 7fad287cd700 1 --2- 172.21.15.82:0/2465387537 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fad0c0a3c40 0x7fad0c0a6100 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:14.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:30:14.151+0000 7fad287cd700 1 --2- 172.21.15.82:0/2465387537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad20102380 0x7fad201995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:14.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:30:14.151+0000 7fad287cd700 1 --2- 172.21.15.82:0/2465387537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad20103580 0x7fad20199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:14.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:30:14.151+0000 7fad287cd700 1 -- 172.21.15.82:0/2465387537 >> 172.21.15.82:0/2465387537 conn(0x7fad200fd920 msgr2=0x7fad200ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:30:14.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:30:14.151+0000 7fad287cd700 1 -- 172.21.15.82:0/2465387537 shutdown_connections 2024-04-26T18:30:14.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:30:14.151+0000 7fad287cd700 1 -- 172.21.15.82:0/2465387537 wait complete. 2024-04-26T18:30:14.838 DEBUG:teuthology.orchestra.run.smithi082:osd.7> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.7.service 2024-04-26T18:30:14.840 INFO:tasks.cephadm:Deploying osd.8 on smithi192 with /dev/vg_nvme/lv_2... 2024-04-26T18:30:14.840 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-26T18:30:15.084 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T18:30:15.421 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:15 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:15.421 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:15 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:15.421 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:15 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:30:15.421 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:15 smithi192 ceph-mon[32842]: from='osd.7 [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T18:30:15.421 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:15 smithi192 ceph-mon[32842]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:15.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:15 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:15.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:15 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:15.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:15 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:30:15.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:15 smithi082 ceph-mon[32808]: from='osd.7 [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T18:30:15.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:15 smithi082 ceph-mon[32808]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:15.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:15 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:15.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:15 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:15.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:15 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:30:15.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:15 smithi080 ceph-mon[29135]: from='osd.7 [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T18:30:15.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:15 smithi080 ceph-mon[29135]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:16.322 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:16 smithi082 ceph-mon[32808]: from='osd.7 [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-26T18:30:16.322 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:16 smithi082 ceph-mon[32808]: osdmap e50: 8 total, 7 up, 8 in 2024-04-26T18:30:16.323 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:16 smithi082 ceph-mon[32808]: from='osd.7 [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T18:30:16.323 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:16 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T18:30:16.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:16 smithi192 ceph-mon[32842]: from='osd.7 [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-26T18:30:16.426 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:16 smithi192 ceph-mon[32842]: osdmap e50: 8 total, 7 up, 8 in 2024-04-26T18:30:16.426 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:16 smithi192 ceph-mon[32842]: from='osd.7 [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T18:30:16.426 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:16 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T18:30:16.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:16 smithi080 ceph-mon[29135]: from='osd.7 [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-26T18:30:16.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:16 smithi080 ceph-mon[29135]: osdmap e50: 8 total, 7 up, 8 in 2024-04-26T18:30:16.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:16 smithi080 ceph-mon[29135]: from='osd.7 [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T18:30:16.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:16 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T18:30:16.720 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:30:16 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:30:16.557+0000 7ffa678c5700 -1 osd.7 0 waiting for initial osdmap 2024-04-26T18:30:16.720 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:30:16 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:30:16.567+0000 7ffa5f6b0700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T18:30:17.298 INFO:teuthology.orchestra.run.smithi192.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-26T18:30:17.298 INFO:teuthology.orchestra.run.smithi192.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-26T18:30:17.298 INFO:teuthology.orchestra.run.smithi192.stderr: stderr: 10+0 records in 2024-04-26T18:30:17.298 INFO:teuthology.orchestra.run.smithi192.stderr:10+0 records out 2024-04-26T18:30:17.298 INFO:teuthology.orchestra.run.smithi192.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112277 s, 934 MB/s 2024-04-26T18:30:17.298 INFO:teuthology.orchestra.run.smithi192.stderr: stderr: 2024-04-26T18:30:17.298 INFO:teuthology.orchestra.run.smithi192.stderr:--> Zapping successful for: 2024-04-26T18:30:17.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:17 smithi082 ceph-mon[32808]: from='osd.7 [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447]' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-26T18:30:17.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:17 smithi082 ceph-mon[32808]: osdmap e51: 8 total, 7 up, 8 in 2024-04-26T18:30:17.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:17 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T18:30:17.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:17 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T18:30:17.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:17 smithi082 ceph-mon[32808]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:17.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:17 smithi082 ceph-mon[32808]: from='osd.7 [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447]' entity='osd.7' 2024-04-26T18:30:17.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:17 smithi080 ceph-mon[29135]: from='osd.7 [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447]' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-26T18:30:17.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:17 smithi080 ceph-mon[29135]: osdmap e51: 8 total, 7 up, 8 in 2024-04-26T18:30:17.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:17 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T18:30:17.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:17 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T18:30:17.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:17 smithi080 ceph-mon[29135]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:17.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:17 smithi080 ceph-mon[29135]: from='osd.7 [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447]' entity='osd.7' 2024-04-26T18:30:17.595 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:17 smithi192 ceph-mon[32842]: from='osd.7 [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447]' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-26T18:30:17.595 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:17 smithi192 ceph-mon[32842]: osdmap e51: 8 total, 7 up, 8 in 2024-04-26T18:30:17.595 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:17 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T18:30:17.595 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:17 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T18:30:17.595 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:17 smithi192 ceph-mon[32842]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-26T18:30:17.595 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:17 smithi192 ceph-mon[32842]: from='osd.7 [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447]' entity='osd.7' 2024-04-26T18:30:17.989 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi192:vg_nvme/lv_2 2024-04-26T18:30:18.237 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T18:30:18.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:18 smithi192 ceph-mon[32842]: purged_snaps scrub starts 2024-04-26T18:30:18.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:18 smithi192 ceph-mon[32842]: purged_snaps scrub ok 2024-04-26T18:30:18.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:18 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T18:30:18.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:18 smithi192 ceph-mon[32842]: osd.7 [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447] boot 2024-04-26T18:30:18.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:18 smithi192 ceph-mon[32842]: osdmap e52: 8 total, 8 up, 8 in 2024-04-26T18:30:18.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:18 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T18:30:18.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:18 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:18.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:18 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:18.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:18 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:18.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:18 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:18.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:18 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:18.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:18 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:18.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:18 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:18.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:18 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:30:18.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:18 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:18.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:18 smithi082 ceph-mon[32808]: purged_snaps scrub starts 2024-04-26T18:30:18.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:18 smithi082 ceph-mon[32808]: purged_snaps scrub ok 2024-04-26T18:30:18.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:18 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T18:30:18.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:18 smithi082 ceph-mon[32808]: osd.7 [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447] boot 2024-04-26T18:30:18.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:18 smithi082 ceph-mon[32808]: osdmap e52: 8 total, 8 up, 8 in 2024-04-26T18:30:18.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:18 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T18:30:18.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:18 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:18.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:18 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:18.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:18 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:18.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:18 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:18.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:18 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:18.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:18 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:18.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:18 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:18.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:18 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:30:18.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:18 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:18.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:18 smithi080 ceph-mon[29135]: purged_snaps scrub starts 2024-04-26T18:30:18.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:18 smithi080 ceph-mon[29135]: purged_snaps scrub ok 2024-04-26T18:30:18.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T18:30:18.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:18 smithi080 ceph-mon[29135]: osd.7 [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447] boot 2024-04-26T18:30:18.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:18 smithi080 ceph-mon[29135]: osdmap e52: 8 total, 8 up, 8 in 2024-04-26T18:30:18.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T18:30:18.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:18.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:18.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:18.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:18.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:18.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:18.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:18.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:30:18.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:19.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:19 smithi082 ceph-mon[32808]: Detected new or changed devices on smithi082 2024-04-26T18:30:19.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:19 smithi082 ceph-mon[32808]: Adjusting osd_memory_target on smithi082 to 5696M 2024-04-26T18:30:19.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:19 smithi082 ceph-mon[32808]: osdmap e53: 8 total, 8 up, 8 in 2024-04-26T18:30:19.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:19 smithi082 ceph-mon[32808]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:19.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:19 smithi080 ceph-mon[29135]: Detected new or changed devices on smithi082 2024-04-26T18:30:19.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:19 smithi080 ceph-mon[29135]: Adjusting osd_memory_target on smithi082 to 5696M 2024-04-26T18:30:19.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:19 smithi080 ceph-mon[29135]: osdmap e53: 8 total, 8 up, 8 in 2024-04-26T18:30:19.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:19 smithi080 ceph-mon[29135]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:19.567 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:19 smithi192 ceph-mon[32842]: Detected new or changed devices on smithi082 2024-04-26T18:30:19.567 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:19 smithi192 ceph-mon[32842]: Adjusting osd_memory_target on smithi082 to 5696M 2024-04-26T18:30:19.567 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:19 smithi192 ceph-mon[32842]: osdmap e53: 8 total, 8 up, 8 in 2024-04-26T18:30:19.568 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:19 smithi192 ceph-mon[32842]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:20.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.091+0000 7ff475988700 1 -- 172.21.15.192:0/2870172576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff470103580 msgr2=0x7ff4701039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:20.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.091+0000 7ff475988700 1 --2- 172.21.15.192:0/2870172576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff470103580 0x7ff4701039e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff458009990 tx=0x7ff458009ca0 comp rx=0 tx=0).stop 2024-04-26T18:30:20.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.091+0000 7ff475988700 1 -- 172.21.15.192:0/2870172576 shutdown_connections 2024-04-26T18:30:20.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.091+0000 7ff475988700 1 --2- 172.21.15.192:0/2870172576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff470103f20 0x7ff47010a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:20.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.091+0000 7ff475988700 1 --2- 172.21.15.192:0/2870172576 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff470102380 0x7ff4701027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:20.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.091+0000 7ff475988700 1 --2- 172.21.15.192:0/2870172576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff470103580 0x7ff4701039e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:20.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.091+0000 7ff475988700 1 -- 172.21.15.192:0/2870172576 >> 172.21.15.192:0/2870172576 conn(0x7ff4700fd920 msgr2=0x7ff4700ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:30:20.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.091+0000 7ff475988700 1 -- 172.21.15.192:0/2870172576 shutdown_connections 2024-04-26T18:30:20.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.091+0000 7ff475988700 1 -- 172.21.15.192:0/2870172576 wait complete. 2024-04-26T18:30:20.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.091+0000 7ff475988700 1 Processor -- start 2024-04-26T18:30:20.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.092+0000 7ff475988700 1 -- start start 2024-04-26T18:30:20.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.092+0000 7ff475988700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff470102380 0x7ff470199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:20.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.092+0000 7ff475988700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff470103580 0x7ff470199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:20.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.092+0000 7ff475988700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff470103f20 0x7ff4701a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:20.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.092+0000 7ff475988700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff47010de10 con 0x7ff470103580 2024-04-26T18:30:20.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.092+0000 7ff475988700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff47010dc90 con 0x7ff470102380 2024-04-26T18:30:20.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.092+0000 7ff475988700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff47010df90 con 0x7ff470103f20 2024-04-26T18:30:20.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.092+0000 7ff46f7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff470103f20 0x7ff4701a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:20.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.092+0000 7ff46f7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff470103f20 0x7ff4701a0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:60542/0 (socket says 172.21.15.192:60542) 2024-04-26T18:30:20.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.092+0000 7ff46f7fe700 1 -- 172.21.15.192:0/1572322993 learned_addr learned my addr 172.21.15.192:0/1572322993 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-04-26T18:30:20.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.092+0000 7ff46effd700 1 --2- 172.21.15.192:0/1572322993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff470102380 0x7ff470199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:20.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.092+0000 7ff4667fc700 1 --2- 172.21.15.192:0/1572322993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff470103580 0x7ff470199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:20.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.092+0000 7ff46f7fe700 1 -- 172.21.15.192:0/1572322993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff470102380 msgr2=0x7ff470199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:20.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.092+0000 7ff46f7fe700 1 --2- 172.21.15.192:0/1572322993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff470102380 0x7ff470199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:20.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.092+0000 7ff46f7fe700 1 -- 172.21.15.192:0/1572322993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff470103580 msgr2=0x7ff470199b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:20.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.092+0000 7ff46f7fe700 1 --2- 172.21.15.192:0/1572322993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff470103580 0x7ff470199b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:20.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.092+0000 7ff46f7fe700 1 -- 172.21.15.192:0/1572322993 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4701a1270 con 0x7ff470103f20 2024-04-26T18:30:20.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.092+0000 7ff46effd700 1 --2- 172.21.15.192:0/1572322993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff470102380 0x7ff470199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:30:20.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.092+0000 7ff4667fc700 1 --2- 172.21.15.192:0/1572322993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff470103580 0x7ff470199b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:30:20.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.092+0000 7ff46f7fe700 1 --2- 172.21.15.192:0/1572322993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff470103f20 0x7ff4701a0bd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff46800d9b0 tx=0x7ff46800dd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:30:20.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.093+0000 7ff474986700 1 -- 172.21.15.192:0/1572322993 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff468017070 con 0x7ff470103f20 2024-04-26T18:30:20.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.093+0000 7ff474986700 1 -- 172.21.15.192:0/1572322993 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff468009df0 con 0x7ff470103f20 2024-04-26T18:30:20.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.093+0000 7ff474986700 1 -- 172.21.15.192:0/1572322993 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4680053a0 con 0x7ff470103f20 2024-04-26T18:30:20.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.093+0000 7ff475988700 1 -- 172.21.15.192:0/1572322993 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4701a1560 con 0x7ff470103f20 2024-04-26T18:30:20.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.093+0000 7ff475988700 1 -- 172.21.15.192:0/1572322993 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4701a1aa0 con 0x7ff470103f20 2024-04-26T18:30:20.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.094+0000 7ff475988700 1 -- 172.21.15.192:0/1572322993 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff47006a110 con 0x7ff470103f20 2024-04-26T18:30:20.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.095+0000 7ff474986700 1 -- 172.21.15.192:0/1572322993 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7ff468005540 con 0x7ff470103f20 2024-04-26T18:30:20.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.095+0000 7ff474986700 1 --2- 172.21.15.192:0/1572322993 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff45c0a3c40 0x7ff45c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:20.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.096+0000 7ff46effd700 1 --2- 172.21.15.192:0/1572322993 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff45c0a3c40 0x7ff45c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:20.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.096+0000 7ff474986700 1 -- 172.21.15.192:0/1572322993 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5426+0+0 (secure 0 0 0) 0x7ff4680cfb20 con 0x7ff470103f20 2024-04-26T18:30:20.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.096+0000 7ff46effd700 1 --2- 172.21.15.192:0/1572322993 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff45c0a3c40 0x7ff45c0a6100 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff4701033e0 tx=0x7ff460009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:30:20.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.100+0000 7ff474986700 1 -- 172.21.15.192:0/1572322993 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff468020020 con 0x7ff470103f20 2024-04-26T18:30:20.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:20.308+0000 7ff475988700 1 -- 172.21.15.192:0/1572322993 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7ff47006b810 con 0x7ff45c0a3c40 2024-04-26T18:30:20.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:20 smithi082 ceph-mon[32808]: osdmap e54: 8 total, 8 up, 8 in 2024-04-26T18:30:20.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:20 smithi080 ceph-mon[29135]: osdmap e54: 8 total, 8 up, 8 in 2024-04-26T18:30:20.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:20 smithi192 ceph-mon[32842]: osdmap e54: 8 total, 8 up, 8 in 2024-04-26T18:30:21.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:21 smithi082 ceph-mon[32808]: osdmap e55: 8 total, 8 up, 8 in 2024-04-26T18:30:21.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:21 smithi082 ceph-mon[32808]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:30:21.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:21 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:30:21.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:21 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:30:21.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:21 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:21.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:21 smithi082 ceph-mon[32808]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:21.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:21 smithi082 ceph-mon[32808]: osdmap e56: 8 total, 8 up, 8 in 2024-04-26T18:30:21.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:21 smithi080 ceph-mon[29135]: osdmap e55: 8 total, 8 up, 8 in 2024-04-26T18:30:21.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:21 smithi080 ceph-mon[29135]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:30:21.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:21 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:30:21.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:21 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:30:21.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:21 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:21.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:21 smithi080 ceph-mon[29135]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:21.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:21 smithi080 ceph-mon[29135]: osdmap e56: 8 total, 8 up, 8 in 2024-04-26T18:30:21.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:21 smithi192 ceph-mon[32842]: osdmap e55: 8 total, 8 up, 8 in 2024-04-26T18:30:21.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:21 smithi192 ceph-mon[32842]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:30:21.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:21 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:30:21.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:21 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:30:21.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:21 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:21.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:21 smithi192 ceph-mon[32842]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:21.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:21 smithi192 ceph-mon[32842]: osdmap e56: 8 total, 8 up, 8 in 2024-04-26T18:30:23.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:23 smithi192 ceph-mon[32842]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:23.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:23 smithi192 ceph-mon[32842]: from='client.? 172.21.15.192:0/727885813' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6557b536-a516-4b01-a607-7981620fb2a2"}]: dispatch 2024-04-26T18:30:23.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:23 smithi192 ceph-mon[32842]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6557b536-a516-4b01-a607-7981620fb2a2"}]: dispatch 2024-04-26T18:30:23.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:23 smithi192 ceph-mon[32842]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6557b536-a516-4b01-a607-7981620fb2a2"}]': finished 2024-04-26T18:30:23.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:23 smithi192 ceph-mon[32842]: osdmap e57: 9 total, 8 up, 9 in 2024-04-26T18:30:23.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:23 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T18:30:23.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:23 smithi082 ceph-mon[32808]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:23.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:23 smithi082 ceph-mon[32808]: from='client.? 172.21.15.192:0/727885813' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6557b536-a516-4b01-a607-7981620fb2a2"}]: dispatch 2024-04-26T18:30:23.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:23 smithi082 ceph-mon[32808]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6557b536-a516-4b01-a607-7981620fb2a2"}]: dispatch 2024-04-26T18:30:23.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:23 smithi082 ceph-mon[32808]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6557b536-a516-4b01-a607-7981620fb2a2"}]': finished 2024-04-26T18:30:23.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:23 smithi082 ceph-mon[32808]: osdmap e57: 9 total, 8 up, 9 in 2024-04-26T18:30:23.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:23 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T18:30:23.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:23 smithi080 ceph-mon[29135]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:23.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:23 smithi080 ceph-mon[29135]: from='client.? 172.21.15.192:0/727885813' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6557b536-a516-4b01-a607-7981620fb2a2"}]: dispatch 2024-04-26T18:30:23.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:23 smithi080 ceph-mon[29135]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6557b536-a516-4b01-a607-7981620fb2a2"}]: dispatch 2024-04-26T18:30:23.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:23 smithi080 ceph-mon[29135]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6557b536-a516-4b01-a607-7981620fb2a2"}]': finished 2024-04-26T18:30:23.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:23 smithi080 ceph-mon[29135]: osdmap e57: 9 total, 8 up, 9 in 2024-04-26T18:30:23.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:23 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T18:30:24.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:24 smithi192 ceph-mon[32842]: from='client.? 172.21.15.192:0/1085840588' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:30:24.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:24 smithi082 ceph-mon[32808]: from='client.? 172.21.15.192:0/1085840588' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:30:24.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:24 smithi080 ceph-mon[29135]: from='client.? 172.21.15.192:0/1085840588' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:30:25.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:25 smithi192 ceph-mon[32842]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:25.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:25 smithi082 ceph-mon[32808]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:25.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:25 smithi080 ceph-mon[29135]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:27.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:27 smithi192 ceph-mon[32842]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:27.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:27 smithi082 ceph-mon[32808]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:27.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:27 smithi080 ceph-mon[29135]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:29.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:29 smithi192 ceph-mon[32842]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:29.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:29 smithi082 ceph-mon[32808]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:29.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:29 smithi080 ceph-mon[29135]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:31.780 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:31 smithi192 ceph-mon[32842]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:31.781 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:31 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-26T18:30:31.781 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:31 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:31.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:31 smithi082 ceph-mon[32808]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:31.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:31 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-26T18:30:31.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:31 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:31.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:31 smithi080 ceph-mon[29135]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:31.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:31 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-26T18:30:31.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:31 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:32.801 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:32 smithi192 ceph-mon[32842]: Deploying daemon osd.8 on smithi192 2024-04-26T18:30:32.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:32 smithi082 ceph-mon[32808]: Deploying daemon osd.8 on smithi192 2024-04-26T18:30:32.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:32 smithi080 ceph-mon[29135]: Deploying daemon osd.8 on smithi192 2024-04-26T18:30:33.805 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:33 smithi192 ceph-mon[32842]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:33.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:33 smithi082 ceph-mon[32808]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:33.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:33 smithi080 ceph-mon[29135]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:35.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:35 smithi192 ceph-mon[32842]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:35.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:35 smithi082 ceph-mon[32808]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:35.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:35 smithi080 ceph-mon[29135]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:37.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:37 smithi192 ceph-mon[32842]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:37.868 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:37 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:37.868 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:37 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:37.868 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:37 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:30:37.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:37 smithi082 ceph-mon[32808]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:37.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:37 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:37.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:37 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:37.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:37 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:30:37.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:37 smithi080 ceph-mon[29135]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:37.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:37 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:37.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:37 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:37.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:37 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:30:39.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:39 smithi192 ceph-mon[32842]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:39.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:39 smithi082 ceph-mon[32808]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:39.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:39 smithi080 ceph-mon[29135]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:40.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:40.473+0000 7ff474986700 1 -- 172.21.15.192:0/1572322993 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff47006b810 con 0x7ff45c0a3c40 2024-04-26T18:30:40.474 INFO:teuthology.orchestra.run.smithi192.stdout:Created osd(s) 8 on host 'smithi192' 2024-04-26T18:30:40.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:40.476+0000 7ff475988700 1 -- 172.21.15.192:0/1572322993 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff45c0a3c40 msgr2=0x7ff45c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:40.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:40.476+0000 7ff475988700 1 --2- 172.21.15.192:0/1572322993 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff45c0a3c40 0x7ff45c0a6100 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff4701033e0 tx=0x7ff460009040 comp rx=0 tx=0).stop 2024-04-26T18:30:40.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:40.476+0000 7ff475988700 1 -- 172.21.15.192:0/1572322993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff470103f20 msgr2=0x7ff4701a0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:40.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:40.476+0000 7ff475988700 1 --2- 172.21.15.192:0/1572322993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff470103f20 0x7ff4701a0bd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff46800d9b0 tx=0x7ff46800dd70 comp rx=0 tx=0).stop 2024-04-26T18:30:40.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:40.476+0000 7ff475988700 1 -- 172.21.15.192:0/1572322993 shutdown_connections 2024-04-26T18:30:40.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:40.476+0000 7ff475988700 1 --2- 172.21.15.192:0/1572322993 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff45c0a3c40 0x7ff45c0a6100 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:40.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:40.476+0000 7ff475988700 1 --2- 172.21.15.192:0/1572322993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff470103f20 0x7ff4701a0bd0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:40.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:40.476+0000 7ff475988700 1 --2- 172.21.15.192:0/1572322993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff470102380 0x7ff470199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:40.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:40.476+0000 7ff475988700 1 --2- 172.21.15.192:0/1572322993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff470103580 0x7ff470199b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:40.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:40.476+0000 7ff475988700 1 -- 172.21.15.192:0/1572322993 >> 172.21.15.192:0/1572322993 conn(0x7ff4700fd920 msgr2=0x7ff47006b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:30:40.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:40.476+0000 7ff475988700 1 -- 172.21.15.192:0/1572322993 shutdown_connections 2024-04-26T18:30:40.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:30:40.476+0000 7ff475988700 1 -- 172.21.15.192:0/1572322993 wait complete. 2024-04-26T18:30:41.124 DEBUG:teuthology.orchestra.run.smithi192:osd.8> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.8.service 2024-04-26T18:30:41.126 INFO:tasks.cephadm:Deploying osd.9 on smithi080 with /dev/vg_nvme/lv_1... 2024-04-26T18:30:41.126 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-26T18:30:41.373 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:30:41.711 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:41 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:41.711 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:41 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:41.711 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:41 smithi080 ceph-mon[29135]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:41.711 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:41 smithi080 ceph-mon[29135]: from='osd.8 [v2:172.21.15.192:6816/3763069187,v1:172.21.15.192:6817/3763069187]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T18:30:41.711 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:41 smithi080 ceph-mon[29135]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T18:30:41.711 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:41 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:41.711 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:41 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:41.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:41 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:41.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:41 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:41.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:41 smithi082 ceph-mon[32808]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:41.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:41 smithi082 ceph-mon[32808]: from='osd.8 [v2:172.21.15.192:6816/3763069187,v1:172.21.15.192:6817/3763069187]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T18:30:41.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:41 smithi082 ceph-mon[32808]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T18:30:41.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:41 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:41.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:41 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:41.806 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:41 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:41.807 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:41 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:41.807 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:41 smithi192 ceph-mon[32842]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:41.807 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:41 smithi192 ceph-mon[32842]: from='osd.8 [v2:172.21.15.192:6816/3763069187,v1:172.21.15.192:6817/3763069187]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T18:30:41.807 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:41 smithi192 ceph-mon[32842]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T18:30:41.807 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:41 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:41.807 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:41 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:42.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:42 smithi082 ceph-mon[32808]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-26T18:30:42.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:42 smithi082 ceph-mon[32808]: from='osd.8 [v2:172.21.15.192:6816/3763069187,v1:172.21.15.192:6817/3763069187]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-04-26T18:30:42.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:42 smithi082 ceph-mon[32808]: osdmap e58: 9 total, 8 up, 9 in 2024-04-26T18:30:42.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:42 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T18:30:42.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:42 smithi082 ceph-mon[32808]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-04-26T18:30:42.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:42 smithi080 ceph-mon[29135]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-26T18:30:42.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:42 smithi080 ceph-mon[29135]: from='osd.8 [v2:172.21.15.192:6816/3763069187,v1:172.21.15.192:6817/3763069187]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-04-26T18:30:42.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:42 smithi080 ceph-mon[29135]: osdmap e58: 9 total, 8 up, 9 in 2024-04-26T18:30:42.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:42 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T18:30:42.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:42 smithi080 ceph-mon[29135]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-04-26T18:30:42.790 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:42 smithi192 ceph-mon[32842]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-26T18:30:42.790 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:42 smithi192 ceph-mon[32842]: from='osd.8 [v2:172.21.15.192:6816/3763069187,v1:172.21.15.192:6817/3763069187]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-04-26T18:30:42.790 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:42 smithi192 ceph-mon[32842]: osdmap e58: 9 total, 8 up, 9 in 2024-04-26T18:30:42.790 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:42 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T18:30:42.790 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:42 smithi192 ceph-mon[32842]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-04-26T18:30:42.791 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:30:42 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:30:42.466+0000 7f4b01efc700 -1 osd.8 0 waiting for initial osdmap 2024-04-26T18:30:42.791 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:30:42 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:30:42.475+0000 7f4afdcef700 -1 osd.8 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T18:30:43.657 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-26T18:30:43.657 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-26T18:30:43.657 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-04-26T18:30:43.657 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-04-26T18:30:43.657 INFO:teuthology.orchestra.run.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113342 s, 925 MB/s 2024-04-26T18:30:43.657 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-04-26T18:30:43.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:43 smithi082 ceph-mon[32808]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-04-26T18:30:43.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:43 smithi082 ceph-mon[32808]: osdmap e59: 9 total, 8 up, 9 in 2024-04-26T18:30:43.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:43 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T18:30:43.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:43 smithi082 ceph-mon[32808]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:43.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:43 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T18:30:43.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:43 smithi080 ceph-mon[29135]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-04-26T18:30:43.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:43 smithi080 ceph-mon[29135]: osdmap e59: 9 total, 8 up, 9 in 2024-04-26T18:30:43.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:43 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T18:30:43.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:43 smithi080 ceph-mon[29135]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:43.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:43 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T18:30:43.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:43 smithi192 ceph-mon[32842]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-04-26T18:30:43.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:43 smithi192 ceph-mon[32842]: osdmap e59: 9 total, 8 up, 9 in 2024-04-26T18:30:43.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:43 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T18:30:43.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:43 smithi192 ceph-mon[32842]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-04-26T18:30:43.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:43 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T18:30:44.415 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi080:vg_nvme/lv_1 2024-04-26T18:30:44.656 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:30:44.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:44 smithi080 ceph-mon[29135]: purged_snaps scrub starts 2024-04-26T18:30:44.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:44 smithi080 ceph-mon[29135]: purged_snaps scrub ok 2024-04-26T18:30:44.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:44 smithi080 ceph-mon[29135]: osd.8 [v2:172.21.15.192:6816/3763069187,v1:172.21.15.192:6817/3763069187] boot 2024-04-26T18:30:44.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:44 smithi080 ceph-mon[29135]: osdmap e60: 9 total, 9 up, 9 in 2024-04-26T18:30:44.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:44 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T18:30:44.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:44 smithi080 ceph-mon[29135]: osdmap e61: 9 total, 9 up, 9 in 2024-04-26T18:30:44.805 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:44 smithi192 ceph-mon[32842]: purged_snaps scrub starts 2024-04-26T18:30:44.805 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:44 smithi192 ceph-mon[32842]: purged_snaps scrub ok 2024-04-26T18:30:44.805 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:44 smithi192 ceph-mon[32842]: osd.8 [v2:172.21.15.192:6816/3763069187,v1:172.21.15.192:6817/3763069187] boot 2024-04-26T18:30:44.805 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:44 smithi192 ceph-mon[32842]: osdmap e60: 9 total, 9 up, 9 in 2024-04-26T18:30:44.805 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:44 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T18:30:44.805 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:44 smithi192 ceph-mon[32842]: osdmap e61: 9 total, 9 up, 9 in 2024-04-26T18:30:44.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:44 smithi082 ceph-mon[32808]: purged_snaps scrub starts 2024-04-26T18:30:44.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:44 smithi082 ceph-mon[32808]: purged_snaps scrub ok 2024-04-26T18:30:44.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:44 smithi082 ceph-mon[32808]: osd.8 [v2:172.21.15.192:6816/3763069187,v1:172.21.15.192:6817/3763069187] boot 2024-04-26T18:30:44.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:44 smithi082 ceph-mon[32808]: osdmap e60: 9 total, 9 up, 9 in 2024-04-26T18:30:44.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:44 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T18:30:44.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:44 smithi082 ceph-mon[32808]: osdmap e61: 9 total, 9 up, 9 in 2024-04-26T18:30:45.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:45 smithi080 ceph-mon[29135]: pgmap v198: 1 pgs: 1 peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-04-26T18:30:45.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:45 smithi080 ceph-mon[29135]: osdmap e62: 9 total, 9 up, 9 in 2024-04-26T18:30:45.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:45 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:45.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:45 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:45.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:45 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:45.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:45 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:45.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:45 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:45.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:45 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:45.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:45 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:45.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:45 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:30:45.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:45 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:45.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:45 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:30:45.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:45 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:45.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:45 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:30:45.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:45 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:45.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:45 smithi192 ceph-mon[32842]: pgmap v198: 1 pgs: 1 peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-04-26T18:30:45.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:45 smithi192 ceph-mon[32842]: osdmap e62: 9 total, 9 up, 9 in 2024-04-26T18:30:45.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:45 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:45.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:45 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:45.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:45 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:45.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:45 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:45.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:45 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:45.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:45 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:45.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:45 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:45.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:45 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:30:45.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:45 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:45.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:45 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:30:45.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:45 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:45.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:45 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:30:45.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:45 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:45.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:45 smithi082 ceph-mon[32808]: pgmap v198: 1 pgs: 1 peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-04-26T18:30:45.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:45 smithi082 ceph-mon[32808]: osdmap e62: 9 total, 9 up, 9 in 2024-04-26T18:30:45.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:45 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:45.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:45 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:45.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:45 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:45.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:45 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:45.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:45 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:45.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:45 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:45.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:45 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:45.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:45 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:30:45.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:45 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:45.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:45 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:30:45.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:45 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:45.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:45 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:30:45.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:45 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:30:46.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.346+0000 7fb467cd9700 1 -- 172.21.15.80:0/1883330171 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb460102380 msgr2=0x7fb4601027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:46.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.346+0000 7fb467cd9700 1 --2- 172.21.15.80:0/1883330171 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb460102380 0x7fb4601027a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb4500099c0 tx=0x7fb450009cd0 comp rx=0 tx=0).stop 2024-04-26T18:30:46.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.346+0000 7fb467cd9700 1 -- 172.21.15.80:0/1883330171 shutdown_connections 2024-04-26T18:30:46.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.346+0000 7fb467cd9700 1 --2- 172.21.15.80:0/1883330171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb460103f20 0x7fb46010a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:46.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.346+0000 7fb467cd9700 1 --2- 172.21.15.80:0/1883330171 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb460102380 0x7fb4601027a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:46.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.346+0000 7fb467cd9700 1 --2- 172.21.15.80:0/1883330171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb460103580 0x7fb4601039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:46.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.346+0000 7fb467cd9700 1 -- 172.21.15.80:0/1883330171 >> 172.21.15.80:0/1883330171 conn(0x7fb4600fd920 msgr2=0x7fb4600ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:30:46.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.346+0000 7fb467cd9700 1 -- 172.21.15.80:0/1883330171 shutdown_connections 2024-04-26T18:30:46.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.346+0000 7fb467cd9700 1 -- 172.21.15.80:0/1883330171 wait complete. 2024-04-26T18:30:46.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.347+0000 7fb467cd9700 1 Processor -- start 2024-04-26T18:30:46.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.347+0000 7fb467cd9700 1 -- start start 2024-04-26T18:30:46.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.347+0000 7fb467cd9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb460102380 0x7fb4601997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:46.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.347+0000 7fb467cd9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb460103580 0x7fb460199cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:46.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.347+0000 7fb467cd9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb460103f20 0x7fb4601a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:46.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.347+0000 7fb467cd9700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb46010df40 con 0x7fb460103f20 2024-04-26T18:30:46.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.347+0000 7fb467cd9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb46010ddc0 con 0x7fb460103580 2024-04-26T18:30:46.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.347+0000 7fb467cd9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb46010e0c0 con 0x7fb460102380 2024-04-26T18:30:46.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.347+0000 7fb466276700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb460103f20 0x7fb4601a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:46.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.347+0000 7fb466276700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb460103f20 0x7fb4601a0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58542/0 (socket says 172.21.15.80:58542) 2024-04-26T18:30:46.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.347+0000 7fb466276700 1 -- 172.21.15.80:0/3174450373 learned_addr learned my addr 172.21.15.80:0/3174450373 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:30:46.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.347+0000 7fb465274700 1 --2- 172.21.15.80:0/3174450373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb460103580 0x7fb460199cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:46.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.347+0000 7fb465a75700 1 --2- 172.21.15.80:0/3174450373 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb460102380 0x7fb4601997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:46.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.347+0000 7fb466276700 1 -- 172.21.15.80:0/3174450373 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb460102380 msgr2=0x7fb4601997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:46.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.347+0000 7fb466276700 1 --2- 172.21.15.80:0/3174450373 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb460102380 0x7fb4601997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:46.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.347+0000 7fb466276700 1 -- 172.21.15.80:0/3174450373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb460103580 msgr2=0x7fb460199cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:46.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.347+0000 7fb466276700 1 --2- 172.21.15.80:0/3174450373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb460103580 0x7fb460199cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:46.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.347+0000 7fb466276700 1 -- 172.21.15.80:0/3174450373 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4601a13c0 con 0x7fb460103f20 2024-04-26T18:30:46.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.348+0000 7fb466276700 1 --2- 172.21.15.80:0/3174450373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb460103f20 0x7fb4601a0d20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb45800b9a0 tx=0x7fb45800bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:30:46.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.348+0000 7fb456ffd700 1 -- 172.21.15.80:0/3174450373 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb458019070 con 0x7fb460103f20 2024-04-26T18:30:46.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.348+0000 7fb467cd9700 1 -- 172.21.15.80:0/3174450373 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4601a16b0 con 0x7fb460103f20 2024-04-26T18:30:46.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.348+0000 7fb456ffd700 1 -- 172.21.15.80:0/3174450373 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb45800cde0 con 0x7fb460103f20 2024-04-26T18:30:46.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.348+0000 7fb456ffd700 1 -- 172.21.15.80:0/3174450373 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb458007370 con 0x7fb460103f20 2024-04-26T18:30:46.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.348+0000 7fb467cd9700 1 -- 172.21.15.80:0/3174450373 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4601a1c70 con 0x7fb460103f20 2024-04-26T18:30:46.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.349+0000 7fb467cd9700 1 -- 172.21.15.80:0/3174450373 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb46006a110 con 0x7fb460103f20 2024-04-26T18:30:46.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.350+0000 7fb456ffd700 1 -- 172.21.15.80:0/3174450373 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fb45801c070 con 0x7fb460103f20 2024-04-26T18:30:46.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.350+0000 7fb456ffd700 1 --2- 172.21.15.80:0/3174450373 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb44c0a3c40 0x7fb44c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:46.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.351+0000 7fb465a75700 1 --2- 172.21.15.80:0/3174450373 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb44c0a3c40 0x7fb44c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:46.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.351+0000 7fb456ffd700 1 -- 172.21.15.80:0/3174450373 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5829+0+0 (secure 0 0 0) 0x7fb4580cf740 con 0x7fb460103f20 2024-04-26T18:30:46.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.351+0000 7fb465a75700 1 --2- 172.21.15.80:0/3174450373 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb44c0a3c40 0x7fb44c0a6100 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb450000c00 tx=0x7fb450003860 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:30:46.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.354+0000 7fb456ffd700 1 -- 172.21.15.80:0/3174450373 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb458023070 con 0x7fb460103f20 2024-04-26T18:30:46.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:30:46.564+0000 7fb467cd9700 1 -- 172.21.15.80:0/3174450373 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb46006b810 con 0x7fb44c0a3c40 2024-04-26T18:30:46.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:46 smithi080 ceph-mon[29135]: Detected new or changed devices on smithi192 2024-04-26T18:30:46.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:46 smithi080 ceph-mon[29135]: Adjusting osd_memory_target on smithi192 to 5696M 2024-04-26T18:30:46.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:46 smithi080 ceph-mon[29135]: osdmap e63: 9 total, 9 up, 9 in 2024-04-26T18:30:46.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:46 smithi192 ceph-mon[32842]: Detected new or changed devices on smithi192 2024-04-26T18:30:46.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:46 smithi192 ceph-mon[32842]: Adjusting osd_memory_target on smithi192 to 5696M 2024-04-26T18:30:46.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:46 smithi192 ceph-mon[32842]: osdmap e63: 9 total, 9 up, 9 in 2024-04-26T18:30:46.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:46 smithi082 ceph-mon[32808]: Detected new or changed devices on smithi192 2024-04-26T18:30:46.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:46 smithi082 ceph-mon[32808]: Adjusting osd_memory_target on smithi192 to 5696M 2024-04-26T18:30:46.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:46 smithi082 ceph-mon[32808]: osdmap e63: 9 total, 9 up, 9 in 2024-04-26T18:30:47.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:47 smithi080 ceph-mon[29135]: pgmap v201: 1 pgs: 1 peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-04-26T18:30:47.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:47 smithi080 ceph-mon[29135]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:30:47.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:47 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:30:47.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:47 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:30:47.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:47 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:47.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:47 smithi080 ceph-mon[29135]: osdmap e64: 9 total, 9 up, 9 in 2024-04-26T18:30:47.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:47 smithi192 ceph-mon[32842]: pgmap v201: 1 pgs: 1 peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-04-26T18:30:47.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:47 smithi192 ceph-mon[32842]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:30:47.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:47 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:30:47.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:47 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:30:47.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:47 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:47.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:47 smithi192 ceph-mon[32842]: osdmap e64: 9 total, 9 up, 9 in 2024-04-26T18:30:47.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:47 smithi082 ceph-mon[32808]: pgmap v201: 1 pgs: 1 peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-04-26T18:30:47.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:47 smithi082 ceph-mon[32808]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:30:47.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:47 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:30:47.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:47 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:30:47.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:47 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:47.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:47 smithi082 ceph-mon[32808]: osdmap e64: 9 total, 9 up, 9 in 2024-04-26T18:30:49.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:49 smithi080 ceph-mon[29135]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-04-26T18:30:49.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:49 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1476313089' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "838615a7-1e68-4e81-8b3a-fba0ea75f7e1"}]: dispatch 2024-04-26T18:30:49.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:49 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1476313089' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "838615a7-1e68-4e81-8b3a-fba0ea75f7e1"}]': finished 2024-04-26T18:30:49.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:49 smithi080 ceph-mon[29135]: osdmap e65: 10 total, 9 up, 10 in 2024-04-26T18:30:49.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:49 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T18:30:49.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:49 smithi192 ceph-mon[32842]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-04-26T18:30:49.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:49 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1476313089' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "838615a7-1e68-4e81-8b3a-fba0ea75f7e1"}]: dispatch 2024-04-26T18:30:49.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:49 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1476313089' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "838615a7-1e68-4e81-8b3a-fba0ea75f7e1"}]': finished 2024-04-26T18:30:49.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:49 smithi192 ceph-mon[32842]: osdmap e65: 10 total, 9 up, 10 in 2024-04-26T18:30:49.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:49 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T18:30:49.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:49 smithi082 ceph-mon[32808]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-04-26T18:30:49.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:49 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1476313089' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "838615a7-1e68-4e81-8b3a-fba0ea75f7e1"}]: dispatch 2024-04-26T18:30:49.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:49 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1476313089' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "838615a7-1e68-4e81-8b3a-fba0ea75f7e1"}]': finished 2024-04-26T18:30:49.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:49 smithi082 ceph-mon[32808]: osdmap e65: 10 total, 9 up, 10 in 2024-04-26T18:30:49.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:49 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T18:30:50.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:50 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/682997161' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:30:50.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:50 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/682997161' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:30:50.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:50 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/682997161' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:30:51.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:51 smithi080 ceph-mon[29135]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-04-26T18:30:51.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:51 smithi192 ceph-mon[32842]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-04-26T18:30:51.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:51 smithi082 ceph-mon[32808]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-04-26T18:30:53.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:53 smithi080 ceph-mon[29135]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-04-26T18:30:53.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:53 smithi192 ceph-mon[32842]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-04-26T18:30:53.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:53 smithi082 ceph-mon[32808]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-04-26T18:30:55.673 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:55 smithi080 ceph-mon[29135]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T18:30:55.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:55 smithi192 ceph-mon[32842]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T18:30:55.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:55 smithi082 ceph-mon[32808]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T18:30:57.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:57 smithi080 ceph-mon[29135]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-04-26T18:30:57.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:57 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-26T18:30:57.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:57 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:57.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:57 smithi192 ceph-mon[32842]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-04-26T18:30:57.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:57 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-26T18:30:57.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:57 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:57.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:57 smithi082 ceph-mon[32808]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-04-26T18:30:57.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:57 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-26T18:30:57.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:57 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:58.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:58 smithi080 ceph-mon[29135]: Deploying daemon osd.9 on smithi080 2024-04-26T18:30:58.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:58 smithi192 ceph-mon[32842]: Deploying daemon osd.9 on smithi080 2024-04-26T18:30:58.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:58 smithi082 ceph-mon[32808]: Deploying daemon osd.9 on smithi080 2024-04-26T18:30:59.682 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:30:59 smithi080 ceph-mon[29135]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T18:30:59.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:30:59 smithi192 ceph-mon[32842]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T18:30:59.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:30:59 smithi082 ceph-mon[32808]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T18:31:01.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:01 smithi080 ceph-mon[29135]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T18:31:01.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:01 smithi192 ceph-mon[32842]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T18:31:01.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:01 smithi082 ceph-mon[32808]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T18:31:03.611 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:03 smithi080 ceph-mon[29135]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T18:31:03.611 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:03 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:03.611 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:03 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:03.611 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:03 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:31:03.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:03 smithi192 ceph-mon[32842]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T18:31:03.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:03 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:03.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:03 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:03.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:03 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:31:03.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:03 smithi082 ceph-mon[32808]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T18:31:03.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:03 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:03.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:03 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:03.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:03 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:31:05.561 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:05 smithi080 ceph-mon[29135]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T18:31:05.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:05 smithi192 ceph-mon[32842]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T18:31:05.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:05 smithi082 ceph-mon[32808]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T18:31:06.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:31:06.824+0000 7fb456ffd700 1 -- 172.21.15.80:0/3174450373 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb46006b810 con 0x7fb44c0a3c40 2024-04-26T18:31:06.824 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 9 on host 'smithi080' 2024-04-26T18:31:06.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:31:06.826+0000 7fb467cd9700 1 -- 172.21.15.80:0/3174450373 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb44c0a3c40 msgr2=0x7fb44c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:06.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:31:06.826+0000 7fb467cd9700 1 --2- 172.21.15.80:0/3174450373 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb44c0a3c40 0x7fb44c0a6100 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb450000c00 tx=0x7fb450003860 comp rx=0 tx=0).stop 2024-04-26T18:31:06.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:31:06.826+0000 7fb467cd9700 1 -- 172.21.15.80:0/3174450373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb460103f20 msgr2=0x7fb4601a0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:06.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:31:06.826+0000 7fb467cd9700 1 --2- 172.21.15.80:0/3174450373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb460103f20 0x7fb4601a0d20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb45800b9a0 tx=0x7fb45800bcb0 comp rx=0 tx=0).stop 2024-04-26T18:31:06.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:31:06.826+0000 7fb467cd9700 1 -- 172.21.15.80:0/3174450373 shutdown_connections 2024-04-26T18:31:06.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:31:06.826+0000 7fb467cd9700 1 --2- 172.21.15.80:0/3174450373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb460103f20 0x7fb4601a0d20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:06.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:31:06.826+0000 7fb467cd9700 1 --2- 172.21.15.80:0/3174450373 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb44c0a3c40 0x7fb44c0a6100 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:06.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:31:06.826+0000 7fb467cd9700 1 --2- 172.21.15.80:0/3174450373 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb460102380 0x7fb4601997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:06.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:31:06.826+0000 7fb467cd9700 1 --2- 172.21.15.80:0/3174450373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb460103580 0x7fb460199cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:06.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:31:06.826+0000 7fb467cd9700 1 -- 172.21.15.80:0/3174450373 >> 172.21.15.80:0/3174450373 conn(0x7fb4600fd920 msgr2=0x7fb46006b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:06.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:31:06.826+0000 7fb467cd9700 1 -- 172.21.15.80:0/3174450373 shutdown_connections 2024-04-26T18:31:06.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:31:06.826+0000 7fb467cd9700 1 -- 172.21.15.80:0/3174450373 wait complete. 2024-04-26T18:31:06.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:06.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:06.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:06.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:31:06.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:06.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:06 smithi080 ceph-mon[29135]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T18:31:06.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:06 smithi080 ceph-mon[29135]: from='osd.9 [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-26T18:31:06.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:06.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:06.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:31:07.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:06 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:07.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:06 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:07.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:06 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:07.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:06 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:31:07.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:06 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:07.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:06 smithi192 ceph-mon[32842]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T18:31:07.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:06 smithi192 ceph-mon[32842]: from='osd.9 [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-26T18:31:07.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:06 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:07.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:06 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:07.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:06 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:31:07.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:06 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:07.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:06 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:07.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:06 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:07.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:06 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:31:07.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:06 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:07.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:06 smithi082 ceph-mon[32808]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T18:31:07.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:06 smithi082 ceph-mon[32808]: from='osd.9 [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-26T18:31:07.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:06 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:07.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:06 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:07.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:06 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:31:07.508 DEBUG:teuthology.orchestra.run.smithi080:osd.9> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.9.service 2024-04-26T18:31:07.511 INFO:tasks.cephadm:Deploying osd.10 on smithi082 with /dev/vg_nvme/lv_1... 2024-04-26T18:31:07.511 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-26T18:31:07.757 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T18:31:08.020 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:07 smithi080 ceph-mon[29135]: from='osd.9 [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-26T18:31:08.020 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:07 smithi080 ceph-mon[29135]: osdmap e66: 10 total, 9 up, 10 in 2024-04-26T18:31:08.020 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:07 smithi080 ceph-mon[29135]: from='osd.9 [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T18:31:08.020 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:07 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T18:31:08.146 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:07 smithi082 ceph-mon[32808]: from='osd.9 [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-26T18:31:08.146 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:07 smithi082 ceph-mon[32808]: osdmap e66: 10 total, 9 up, 10 in 2024-04-26T18:31:08.146 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:07 smithi082 ceph-mon[32808]: from='osd.9 [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T18:31:08.146 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:07 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T18:31:08.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:07 smithi192 ceph-mon[32842]: from='osd.9 [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-26T18:31:08.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:07 smithi192 ceph-mon[32842]: osdmap e66: 10 total, 9 up, 10 in 2024-04-26T18:31:08.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:07 smithi192 ceph-mon[32842]: from='osd.9 [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-04-26T18:31:08.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:07 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T18:31:08.743 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:31:08 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:31:08.307+0000 7f3d72fdc700 -1 osd.9 0 waiting for initial osdmap 2024-04-26T18:31:08.744 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:31:08 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:31:08.318+0000 7f3d6a5c6700 -1 osd.9 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T18:31:09.075 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:08 smithi080 ceph-mon[29135]: from='osd.9 [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-26T18:31:09.075 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:08 smithi080 ceph-mon[29135]: osdmap e67: 10 total, 9 up, 10 in 2024-04-26T18:31:09.075 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:08 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T18:31:09.075 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:08 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T18:31:09.075 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:08 smithi080 ceph-mon[29135]: from='osd.9 [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993]' entity='osd.9' 2024-04-26T18:31:09.075 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:08 smithi080 ceph-mon[29135]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T18:31:09.125 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:08 smithi082 ceph-mon[32808]: from='osd.9 [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-26T18:31:09.126 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:08 smithi082 ceph-mon[32808]: osdmap e67: 10 total, 9 up, 10 in 2024-04-26T18:31:09.126 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:08 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T18:31:09.126 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:08 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T18:31:09.126 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:08 smithi082 ceph-mon[32808]: from='osd.9 [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993]' entity='osd.9' 2024-04-26T18:31:09.126 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:08 smithi082 ceph-mon[32808]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T18:31:09.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:08 smithi192 ceph-mon[32842]: from='osd.9 [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-04-26T18:31:09.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:08 smithi192 ceph-mon[32842]: osdmap e67: 10 total, 9 up, 10 in 2024-04-26T18:31:09.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:08 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T18:31:09.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:08 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T18:31:09.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:08 smithi192 ceph-mon[32842]: from='osd.9 [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993]' entity='osd.9' 2024-04-26T18:31:09.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:08 smithi192 ceph-mon[32842]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-26T18:31:09.798 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-26T18:31:09.798 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-26T18:31:09.798 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-04-26T18:31:09.798 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-04-26T18:31:09.798 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0134612 s, 779 MB/s 2024-04-26T18:31:09.798 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-04-26T18:31:10.173 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:09 smithi082 ceph-mon[32808]: purged_snaps scrub starts 2024-04-26T18:31:10.173 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:09 smithi082 ceph-mon[32808]: purged_snaps scrub ok 2024-04-26T18:31:10.173 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:09 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T18:31:10.173 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:09 smithi082 ceph-mon[32808]: osd.9 [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993] boot 2024-04-26T18:31:10.174 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:09 smithi082 ceph-mon[32808]: osdmap e68: 10 total, 10 up, 10 in 2024-04-26T18:31:10.174 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:09 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T18:31:10.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:09 smithi080 ceph-mon[29135]: purged_snaps scrub starts 2024-04-26T18:31:10.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:09 smithi080 ceph-mon[29135]: purged_snaps scrub ok 2024-04-26T18:31:10.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:09 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T18:31:10.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:09 smithi080 ceph-mon[29135]: osd.9 [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993] boot 2024-04-26T18:31:10.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:09 smithi080 ceph-mon[29135]: osdmap e68: 10 total, 10 up, 10 in 2024-04-26T18:31:10.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:09 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T18:31:10.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:09 smithi192 ceph-mon[32842]: purged_snaps scrub starts 2024-04-26T18:31:10.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:09 smithi192 ceph-mon[32842]: purged_snaps scrub ok 2024-04-26T18:31:10.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:09 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T18:31:10.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:09 smithi192 ceph-mon[32842]: osd.9 [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993] boot 2024-04-26T18:31:10.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:09 smithi192 ceph-mon[32842]: osdmap e68: 10 total, 10 up, 10 in 2024-04-26T18:31:10.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:09 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T18:31:10.520 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_1 2024-04-26T18:31:10.778 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T18:31:11.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:11 smithi082 ceph-mon[32808]: osdmap e69: 10 total, 10 up, 10 in 2024-04-26T18:31:11.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:11 smithi082 ceph-mon[32808]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:11.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:11 smithi082 ceph-mon[32808]: Detected new or changed devices on smithi080 2024-04-26T18:31:11.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:11.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:11.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:31:11.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:31:11.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:31:11.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:31:11.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:11 smithi082 ceph-mon[32808]: Adjusting osd_memory_target on smithi080 to 4272M 2024-04-26T18:31:11.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:11.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:11.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:31:11.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:11.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:11 smithi192 ceph-mon[32842]: osdmap e69: 10 total, 10 up, 10 in 2024-04-26T18:31:11.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:11 smithi192 ceph-mon[32842]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:11.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:11 smithi192 ceph-mon[32842]: Detected new or changed devices on smithi080 2024-04-26T18:31:11.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:11.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:11.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:31:11.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:31:11.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:31:11.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:31:11.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:11 smithi192 ceph-mon[32842]: Adjusting osd_memory_target on smithi080 to 4272M 2024-04-26T18:31:11.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:11.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:11.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:31:11.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:11.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:11 smithi080 ceph-mon[29135]: osdmap e69: 10 total, 10 up, 10 in 2024-04-26T18:31:11.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:11 smithi080 ceph-mon[29135]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:11.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:11 smithi080 ceph-mon[29135]: Detected new or changed devices on smithi080 2024-04-26T18:31:11.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:11.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:11.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:31:11.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:31:11.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:31:11.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:31:11.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:11 smithi080 ceph-mon[29135]: Adjusting osd_memory_target on smithi080 to 4272M 2024-04-26T18:31:11.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:11.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:11.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:31:11.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:12.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.355+0000 7f0a0bbab700 1 -- 172.21.15.82:0/3859395244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a04102380 msgr2=0x7f0a041027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:12.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.355+0000 7f0a0bbab700 1 --2- 172.21.15.82:0/3859395244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a04102380 0x7f0a041027a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f09f40099c0 tx=0x7f09f4009cd0 comp rx=0 tx=0).stop 2024-04-26T18:31:12.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.355+0000 7f0a0bbab700 1 -- 172.21.15.82:0/3859395244 shutdown_connections 2024-04-26T18:31:12.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.355+0000 7f0a0bbab700 1 --2- 172.21.15.82:0/3859395244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a04103f20 0x7f0a0410a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:12.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.355+0000 7f0a0bbab700 1 --2- 172.21.15.82:0/3859395244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a04102380 0x7f0a041027a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:12.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.355+0000 7f0a0bbab700 1 --2- 172.21.15.82:0/3859395244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a04103580 0x7f0a041039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:12.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.355+0000 7f0a0bbab700 1 -- 172.21.15.82:0/3859395244 >> 172.21.15.82:0/3859395244 conn(0x7f0a040fd940 msgr2=0x7f0a040ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:12.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.355+0000 7f0a0bbab700 1 -- 172.21.15.82:0/3859395244 shutdown_connections 2024-04-26T18:31:12.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.355+0000 7f0a0bbab700 1 -- 172.21.15.82:0/3859395244 wait complete. 2024-04-26T18:31:12.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.356+0000 7f0a0bbab700 1 Processor -- start 2024-04-26T18:31:12.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.356+0000 7f0a0bbab700 1 -- start start 2024-04-26T18:31:12.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.356+0000 7f0a0bbab700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a04102380 0x7f0a0406c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:12.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.356+0000 7f0a0bbab700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a04103580 0x7f0a0419e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:12.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.356+0000 7f0a0bbab700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a04103f20 0x7f0a041a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:12.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.356+0000 7f0a0bbab700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0a0410def0 con 0x7f0a04102380 2024-04-26T18:31:12.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.356+0000 7f0a0bbab700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0a0410dd70 con 0x7f0a04103f20 2024-04-26T18:31:12.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.356+0000 7f0a0bbab700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0a0410e070 con 0x7f0a04103580 2024-04-26T18:31:12.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.356+0000 7f0a0a148700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a04103f20 0x7f0a041a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:12.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.356+0000 7f0a0a148700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a04103f20 0x7f0a041a0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53056/0 (socket says 172.21.15.82:53056) 2024-04-26T18:31:12.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.356+0000 7f0a0a148700 1 -- 172.21.15.82:0/207180226 learned_addr learned my addr 172.21.15.82:0/207180226 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T18:31:12.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.356+0000 7f0a09947700 1 --2- 172.21.15.82:0/207180226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a04102380 0x7f0a0406c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:12.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.356+0000 7f0a09146700 1 --2- 172.21.15.82:0/207180226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a04103580 0x7f0a0419e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:12.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.356+0000 7f0a0a148700 1 -- 172.21.15.82:0/207180226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a04103580 msgr2=0x7f0a0419e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:12.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.356+0000 7f0a0a148700 1 --2- 172.21.15.82:0/207180226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a04103580 0x7f0a0419e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:12.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.356+0000 7f0a0a148700 1 -- 172.21.15.82:0/207180226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a04102380 msgr2=0x7f0a0406c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:12.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.356+0000 7f0a0a148700 1 --2- 172.21.15.82:0/207180226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a04102380 0x7f0a0406c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:12.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.356+0000 7f0a0a148700 1 -- 172.21.15.82:0/207180226 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a041a1320 con 0x7f0a04103f20 2024-04-26T18:31:12.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.357+0000 7f0a0a148700 1 --2- 172.21.15.82:0/207180226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a04103f20 0x7f0a041a0a50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00b970 tx=0x7f09fc00bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:12.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.357+0000 7f09faffd700 1 -- 172.21.15.82:0/207180226 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09fc00d860 con 0x7f0a04103f20 2024-04-26T18:31:12.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.357+0000 7f09faffd700 1 -- 172.21.15.82:0/207180226 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09fc00e430 con 0x7f0a04103f20 2024-04-26T18:31:12.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.357+0000 7f0a0bbab700 1 -- 172.21.15.82:0/207180226 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a041a1610 con 0x7f0a04103f20 2024-04-26T18:31:12.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.357+0000 7f09faffd700 1 -- 172.21.15.82:0/207180226 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09fc017660 con 0x7f0a04103f20 2024-04-26T18:31:12.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.357+0000 7f0a0bbab700 1 -- 172.21.15.82:0/207180226 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a041a1b80 con 0x7f0a04103f20 2024-04-26T18:31:12.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.358+0000 7f0a0bbab700 1 -- 172.21.15.82:0/207180226 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a0406a110 con 0x7f0a04103f20 2024-04-26T18:31:12.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.359+0000 7f09faffd700 1 -- 172.21.15.82:0/207180226 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f09fc00da00 con 0x7f0a04103f20 2024-04-26T18:31:12.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.359+0000 7f09faffd700 1 --2- 172.21.15.82:0/207180226 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f09f00a3c40 0x7f09f00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:12.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.359+0000 7f09faffd700 1 -- 172.21.15.82:0/207180226 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6261+0+0 (secure 0 0 0) 0x7f09fc0cf810 con 0x7f0a04103f20 2024-04-26T18:31:12.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.359+0000 7f0a09947700 1 --2- 172.21.15.82:0/207180226 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f09f00a3c40 0x7f09f00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:12.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.360+0000 7f0a09947700 1 --2- 172.21.15.82:0/207180226 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f09f00a3c40 0x7f09f00a6100 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f09f40038c0 tx=0x7f09f400b540 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:12.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.364+0000 7f09faffd700 1 -- 172.21.15.82:0/207180226 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f09fc013030 con 0x7f0a04103f20 2024-04-26T18:31:12.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:12.571+0000 7f0a0bbab700 1 -- 172.21.15.82:0/207180226 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f0a04063860 con 0x7f09f00a3c40 2024-04-26T18:31:13.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:13 smithi192 ceph-mon[32842]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:13.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:13 smithi192 ceph-mon[32842]: from='client.24317 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:31:13.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:31:13.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:31:13.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:13.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:13 smithi082 ceph-mon[32808]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:13.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:13 smithi082 ceph-mon[32808]: from='client.24317 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:31:13.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:31:13.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:31:13.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:13.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:13 smithi080 ceph-mon[29135]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:13.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:13 smithi080 ceph-mon[29135]: from='client.24317 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:31:13.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:31:13.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:31:13.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:15.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:15 smithi192 ceph-mon[32842]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:15.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:15 smithi192 ceph-mon[32842]: from='client.? 172.21.15.82:0/1579884032' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd664e50-3217-453d-9a89-6e26d717e6be"}]: dispatch 2024-04-26T18:31:15.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:15 smithi192 ceph-mon[32842]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd664e50-3217-453d-9a89-6e26d717e6be"}]: dispatch 2024-04-26T18:31:15.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:15 smithi192 ceph-mon[32842]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd664e50-3217-453d-9a89-6e26d717e6be"}]': finished 2024-04-26T18:31:15.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:15 smithi192 ceph-mon[32842]: osdmap e70: 11 total, 10 up, 11 in 2024-04-26T18:31:15.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:15 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T18:31:15.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:15 smithi082 ceph-mon[32808]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:15.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:15 smithi082 ceph-mon[32808]: from='client.? 172.21.15.82:0/1579884032' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd664e50-3217-453d-9a89-6e26d717e6be"}]: dispatch 2024-04-26T18:31:15.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:15 smithi082 ceph-mon[32808]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd664e50-3217-453d-9a89-6e26d717e6be"}]: dispatch 2024-04-26T18:31:15.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:15 smithi082 ceph-mon[32808]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd664e50-3217-453d-9a89-6e26d717e6be"}]': finished 2024-04-26T18:31:15.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:15 smithi082 ceph-mon[32808]: osdmap e70: 11 total, 10 up, 11 in 2024-04-26T18:31:15.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:15 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T18:31:15.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:15 smithi080 ceph-mon[29135]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:15.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:15 smithi080 ceph-mon[29135]: from='client.? 172.21.15.82:0/1579884032' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd664e50-3217-453d-9a89-6e26d717e6be"}]: dispatch 2024-04-26T18:31:15.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:15 smithi080 ceph-mon[29135]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd664e50-3217-453d-9a89-6e26d717e6be"}]: dispatch 2024-04-26T18:31:15.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:15 smithi080 ceph-mon[29135]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd664e50-3217-453d-9a89-6e26d717e6be"}]': finished 2024-04-26T18:31:15.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:15 smithi080 ceph-mon[29135]: osdmap e70: 11 total, 10 up, 11 in 2024-04-26T18:31:15.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:15 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T18:31:16.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:16 smithi192 ceph-mon[32842]: from='client.? 172.21.15.82:0/1146188146' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:31:16.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:16 smithi082 ceph-mon[32808]: from='client.? 172.21.15.82:0/1146188146' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:31:16.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:16 smithi080 ceph-mon[29135]: from='client.? 172.21.15.82:0/1146188146' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:31:17.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:17 smithi192 ceph-mon[32842]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:17.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:17 smithi082 ceph-mon[32808]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:17.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:17 smithi080 ceph-mon[29135]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:19.795 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:19 smithi080 ceph-mon[29135]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:19.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:19 smithi192 ceph-mon[32842]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:19.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:19 smithi082 ceph-mon[32808]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:21.798 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:21 smithi082 ceph-mon[32808]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:21.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:21 smithi192 ceph-mon[32842]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:21.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:21 smithi080 ceph-mon[29135]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:23.657 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:23 smithi082 ceph-mon[32808]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:23.657 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:23 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-26T18:31:23.657 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:23 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:23.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:23 smithi192 ceph-mon[32842]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:23.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:23 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-26T18:31:23.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:23 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:23.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:23 smithi080 ceph-mon[29135]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:23.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:23 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-26T18:31:23.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:23 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:24.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:24 smithi082 ceph-mon[32808]: Deploying daemon osd.10 on smithi082 2024-04-26T18:31:24.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:24 smithi192 ceph-mon[32842]: Deploying daemon osd.10 on smithi082 2024-04-26T18:31:24.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:24 smithi080 ceph-mon[29135]: Deploying daemon osd.10 on smithi082 2024-04-26T18:31:25.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:25 smithi082 ceph-mon[32808]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:25.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:25 smithi192 ceph-mon[32842]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:25.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:25 smithi080 ceph-mon[29135]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:27.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:27 smithi192 ceph-mon[32842]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:27.941 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:27 smithi082 ceph-mon[32808]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:27.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:27 smithi080 ceph-mon[29135]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:29.571 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:29 smithi080 ceph-mon[29135]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:29.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:29 smithi192 ceph-mon[32842]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:29.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:29 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:29.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:29 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:29.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:29 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:31:29.912 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:29 smithi082 ceph-mon[32808]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:29.913 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:29 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:29.913 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:29 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:29.913 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:29 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:31:29.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:29 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:29.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:29 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:29.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:29 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:31:31.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:31 smithi080 ceph-mon[29135]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:31.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:31 smithi192 ceph-mon[32842]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:31.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:31 smithi082 ceph-mon[32808]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:32.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:32.390+0000 7f09faffd700 1 -- 172.21.15.82:0/207180226 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f0a04063860 con 0x7f09f00a3c40 2024-04-26T18:31:32.391 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 10 on host 'smithi082' 2024-04-26T18:31:32.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:32.392+0000 7f0a0bbab700 1 -- 172.21.15.82:0/207180226 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f09f00a3c40 msgr2=0x7f09f00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:32.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:32.392+0000 7f0a0bbab700 1 --2- 172.21.15.82:0/207180226 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f09f00a3c40 0x7f09f00a6100 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f09f40038c0 tx=0x7f09f400b540 comp rx=0 tx=0).stop 2024-04-26T18:31:32.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:32.392+0000 7f0a0bbab700 1 -- 172.21.15.82:0/207180226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a04103f20 msgr2=0x7f0a041a0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:32.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:32.392+0000 7f0a0bbab700 1 --2- 172.21.15.82:0/207180226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a04103f20 0x7f0a041a0a50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00b970 tx=0x7f09fc00bc80 comp rx=0 tx=0).stop 2024-04-26T18:31:32.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:32.393+0000 7f0a0bbab700 1 -- 172.21.15.82:0/207180226 shutdown_connections 2024-04-26T18:31:32.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:32.393+0000 7f0a0bbab700 1 --2- 172.21.15.82:0/207180226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a04103f20 0x7f0a041a0a50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:32.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:32.393+0000 7f0a0bbab700 1 --2- 172.21.15.82:0/207180226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a04102380 0x7f0a0406c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:32.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:32.393+0000 7f0a0bbab700 1 --2- 172.21.15.82:0/207180226 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f09f00a3c40 0x7f09f00a6100 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:32.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:32.393+0000 7f0a0bbab700 1 --2- 172.21.15.82:0/207180226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a04103580 0x7f0a0419e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:32.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:32.393+0000 7f0a0bbab700 1 -- 172.21.15.82:0/207180226 >> 172.21.15.82:0/207180226 conn(0x7f0a040fd940 msgr2=0x7f0a041069a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:32.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:32.393+0000 7f0a0bbab700 1 -- 172.21.15.82:0/207180226 shutdown_connections 2024-04-26T18:31:32.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T18:31:32.393+0000 7f0a0bbab700 1 -- 172.21.15.82:0/207180226 wait complete. 2024-04-26T18:31:32.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:32 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:32.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:32 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:32.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:32 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:32.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:32 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:31:32.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:32 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:32.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:32 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:32.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:32 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:32.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:32 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:31:32.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:32 smithi082 ceph-mon[32808]: from='osd.10 [v2:172.21.15.82:6824/2877220993,v1:172.21.15.82:6825/2877220993]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T18:31:32.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:32 smithi082 ceph-mon[32808]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T18:31:32.860 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:32 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:32.860 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:32 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:32.860 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:32 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:32.860 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:32 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:31:32.860 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:32 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:32.860 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:32 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:32.860 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:32 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:32.860 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:32 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:31:32.860 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:32 smithi192 ceph-mon[32842]: from='osd.10 [v2:172.21.15.82:6824/2877220993,v1:172.21.15.82:6825/2877220993]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T18:31:32.860 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:32 smithi192 ceph-mon[32842]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T18:31:32.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:32 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:32.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:32 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:32.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:32 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:32.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:32 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:31:32.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:32 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:32.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:32 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:32.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:32 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:32.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:32 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:31:32.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:32 smithi080 ceph-mon[29135]: from='osd.10 [v2:172.21.15.82:6824/2877220993,v1:172.21.15.82:6825/2877220993]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T18:31:32.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:32 smithi080 ceph-mon[29135]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T18:31:33.075 DEBUG:teuthology.orchestra.run.smithi082:osd.10> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.10.service 2024-04-26T18:31:33.078 INFO:tasks.cephadm:Deploying osd.11 on smithi192 with /dev/vg_nvme/lv_1... 2024-04-26T18:31:33.078 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-26T18:31:33.310 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T18:31:33.730 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:33 smithi192 ceph-mon[32842]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:33.730 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:33 smithi192 ceph-mon[32842]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-26T18:31:33.730 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:33 smithi192 ceph-mon[32842]: from='osd.10 [v2:172.21.15.82:6824/2877220993,v1:172.21.15.82:6825/2877220993]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T18:31:33.730 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:33 smithi192 ceph-mon[32842]: osdmap e71: 11 total, 10 up, 11 in 2024-04-26T18:31:33.730 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:33 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T18:31:33.731 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:33 smithi192 ceph-mon[32842]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T18:31:33.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:33 smithi082 ceph-mon[32808]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:33.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:33 smithi082 ceph-mon[32808]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-26T18:31:33.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:33 smithi082 ceph-mon[32808]: from='osd.10 [v2:172.21.15.82:6824/2877220993,v1:172.21.15.82:6825/2877220993]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T18:31:33.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:33 smithi082 ceph-mon[32808]: osdmap e71: 11 total, 10 up, 11 in 2024-04-26T18:31:33.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:33 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T18:31:33.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:33 smithi082 ceph-mon[32808]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T18:31:33.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:33 smithi080 ceph-mon[29135]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:33.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:33 smithi080 ceph-mon[29135]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-26T18:31:33.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:33 smithi080 ceph-mon[29135]: from='osd.10 [v2:172.21.15.82:6824/2877220993,v1:172.21.15.82:6825/2877220993]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T18:31:33.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:33 smithi080 ceph-mon[29135]: osdmap e71: 11 total, 10 up, 11 in 2024-04-26T18:31:33.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:33 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T18:31:33.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:33 smithi080 ceph-mon[29135]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T18:31:34.970 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:31:34 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:31:34.827+0000 7f9cf96e1700 -1 osd.10 0 waiting for initial osdmap 2024-04-26T18:31:34.970 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:31:34 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:31:34.841+0000 7f9cf0ccb700 -1 osd.10 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T18:31:35.535 INFO:teuthology.orchestra.run.smithi192.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-26T18:31:35.536 INFO:teuthology.orchestra.run.smithi192.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-26T18:31:35.536 INFO:teuthology.orchestra.run.smithi192.stderr: stderr: 10+0 records in 2024-04-26T18:31:35.536 INFO:teuthology.orchestra.run.smithi192.stderr:10+0 records out 2024-04-26T18:31:35.536 INFO:teuthology.orchestra.run.smithi192.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112727 s, 930 MB/s 2024-04-26T18:31:35.536 INFO:teuthology.orchestra.run.smithi192.stderr: stderr: 2024-04-26T18:31:35.536 INFO:teuthology.orchestra.run.smithi192.stderr:--> Zapping successful for: 2024-04-26T18:31:35.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:35 smithi082 ceph-mon[32808]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-26T18:31:35.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:35 smithi082 ceph-mon[32808]: osdmap e72: 11 total, 10 up, 11 in 2024-04-26T18:31:35.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:35 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T18:31:35.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:35 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T18:31:35.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:35 smithi082 ceph-mon[32808]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:35.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:35 smithi082 ceph-mon[32808]: from='osd.10 ' entity='osd.10' 2024-04-26T18:31:35.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:35 smithi080 ceph-mon[29135]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-26T18:31:35.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:35 smithi080 ceph-mon[29135]: osdmap e72: 11 total, 10 up, 11 in 2024-04-26T18:31:35.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:35 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T18:31:35.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:35 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T18:31:35.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:35 smithi080 ceph-mon[29135]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:35.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:35 smithi080 ceph-mon[29135]: from='osd.10 ' entity='osd.10' 2024-04-26T18:31:35.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:35 smithi192 ceph-mon[32842]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-26T18:31:35.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:35 smithi192 ceph-mon[32842]: osdmap e72: 11 total, 10 up, 11 in 2024-04-26T18:31:35.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:35 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T18:31:35.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:35 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T18:31:35.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:35 smithi192 ceph-mon[32842]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-04-26T18:31:35.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:35 smithi192 ceph-mon[32842]: from='osd.10 ' entity='osd.10' 2024-04-26T18:31:36.449 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi192:vg_nvme/lv_1 2024-04-26T18:31:36.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:36 smithi082 ceph-mon[32808]: purged_snaps scrub starts 2024-04-26T18:31:36.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:36 smithi082 ceph-mon[32808]: purged_snaps scrub ok 2024-04-26T18:31:36.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:36 smithi082 ceph-mon[32808]: osd.10 [v2:172.21.15.82:6824/2877220993,v1:172.21.15.82:6825/2877220993] boot 2024-04-26T18:31:36.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:36 smithi082 ceph-mon[32808]: osdmap e73: 11 total, 11 up, 11 in 2024-04-26T18:31:36.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:36 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T18:31:36.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:36 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:36.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:36 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:36.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:36 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:31:36.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:36 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:31:36.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:36 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:31:36.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:36 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:31:36.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:36 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:36.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:36 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:36.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:36 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:31:36.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:36 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:36.685 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T18:31:36.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:36 smithi080 ceph-mon[29135]: purged_snaps scrub starts 2024-04-26T18:31:36.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:36 smithi080 ceph-mon[29135]: purged_snaps scrub ok 2024-04-26T18:31:36.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:36 smithi080 ceph-mon[29135]: osd.10 [v2:172.21.15.82:6824/2877220993,v1:172.21.15.82:6825/2877220993] boot 2024-04-26T18:31:36.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:36 smithi080 ceph-mon[29135]: osdmap e73: 11 total, 11 up, 11 in 2024-04-26T18:31:36.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:36 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T18:31:36.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:36 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:36.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:36 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:36.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:36 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:31:36.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:36 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:31:36.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:36 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:31:36.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:36 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:31:36.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:36 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:36.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:36 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:36.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:36 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:31:36.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:36 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:36.807 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:36 smithi192 ceph-mon[32842]: purged_snaps scrub starts 2024-04-26T18:31:36.807 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:36 smithi192 ceph-mon[32842]: purged_snaps scrub ok 2024-04-26T18:31:36.807 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:36 smithi192 ceph-mon[32842]: osd.10 [v2:172.21.15.82:6824/2877220993,v1:172.21.15.82:6825/2877220993] boot 2024-04-26T18:31:36.807 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:36 smithi192 ceph-mon[32842]: osdmap e73: 11 total, 11 up, 11 in 2024-04-26T18:31:36.808 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:36 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T18:31:36.808 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:36 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:36.808 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:36 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:36.808 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:36 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:31:36.808 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:36 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:31:36.808 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:36 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:31:36.808 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:36 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:31:36.808 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:36 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:36.808 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:36 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:36.808 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:36 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:31:36.808 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:36 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:37.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:37 smithi082 ceph-mon[32808]: Detected new or changed devices on smithi082 2024-04-26T18:31:37.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:37 smithi082 ceph-mon[32808]: Adjusting osd_memory_target on smithi082 to 4272M 2024-04-26T18:31:37.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:37 smithi082 ceph-mon[32808]: osdmap e74: 11 total, 11 up, 11 in 2024-04-26T18:31:37.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:37 smithi082 ceph-mon[32808]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:37.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:37 smithi082 ceph-mon[32808]: osdmap e75: 11 total, 11 up, 11 in 2024-04-26T18:31:37.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:37 smithi080 ceph-mon[29135]: Detected new or changed devices on smithi082 2024-04-26T18:31:37.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:37 smithi080 ceph-mon[29135]: Adjusting osd_memory_target on smithi082 to 4272M 2024-04-26T18:31:37.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:37 smithi080 ceph-mon[29135]: osdmap e74: 11 total, 11 up, 11 in 2024-04-26T18:31:37.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:37 smithi080 ceph-mon[29135]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:37.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:37 smithi080 ceph-mon[29135]: osdmap e75: 11 total, 11 up, 11 in 2024-04-26T18:31:37.800 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:37 smithi192 ceph-mon[32842]: Detected new or changed devices on smithi082 2024-04-26T18:31:37.801 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:37 smithi192 ceph-mon[32842]: Adjusting osd_memory_target on smithi082 to 4272M 2024-04-26T18:31:37.801 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:37 smithi192 ceph-mon[32842]: osdmap e74: 11 total, 11 up, 11 in 2024-04-26T18:31:37.801 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:37 smithi192 ceph-mon[32842]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:37.801 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:37 smithi192 ceph-mon[32842]: osdmap e75: 11 total, 11 up, 11 in 2024-04-26T18:31:38.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.361+0000 7f49b5e9c700 1 -- 172.21.15.192:0/1072329981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49b0104680 msgr2=0x7f49b0104ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:38.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.361+0000 7f49b5e9c700 1 --2- 172.21.15.192:0/1072329981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49b0104680 0x7f49b0104ae0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f49a4009990 tx=0x7f49a4009ca0 comp rx=0 tx=0).stop 2024-04-26T18:31:38.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.361+0000 7f49b5e9c700 1 -- 172.21.15.192:0/1072329981 shutdown_connections 2024-04-26T18:31:38.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.361+0000 7f49b5e9c700 1 --2- 172.21.15.192:0/1072329981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49b0105020 0x7f49b010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:38.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.361+0000 7f49b5e9c700 1 --2- 172.21.15.192:0/1072329981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49b0103480 0x7f49b01038a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:38.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.361+0000 7f49b5e9c700 1 --2- 172.21.15.192:0/1072329981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49b0104680 0x7f49b0104ae0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:38.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.361+0000 7f49b5e9c700 1 -- 172.21.15.192:0/1072329981 >> 172.21.15.192:0/1072329981 conn(0x7f49b00fea20 msgr2=0x7f49b0100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:38.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.361+0000 7f49b5e9c700 1 -- 172.21.15.192:0/1072329981 shutdown_connections 2024-04-26T18:31:38.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.361+0000 7f49b5e9c700 1 -- 172.21.15.192:0/1072329981 wait complete. 2024-04-26T18:31:38.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.361+0000 7f49b5e9c700 1 Processor -- start 2024-04-26T18:31:38.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.362+0000 7f49b5e9c700 1 -- start start 2024-04-26T18:31:38.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.362+0000 7f49b5e9c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49b0103480 0x7f49b01996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:38.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.362+0000 7f49b5e9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49b0104680 0x7f49b0199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:38.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.362+0000 7f49b5e9c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49b0105020 0x7f49b01a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:38.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.362+0000 7f49b5e9c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f49b010f010 con 0x7f49b0103480 2024-04-26T18:31:38.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.362+0000 7f49b5e9c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f49b010ee90 con 0x7f49b0104680 2024-04-26T18:31:38.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.362+0000 7f49b5e9c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f49b010f190 con 0x7f49b0105020 2024-04-26T18:31:38.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.362+0000 7f49affff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49b0105020 0x7f49b01a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:38.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.362+0000 7f49af7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49b0103480 0x7f49b01996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:38.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.362+0000 7f49affff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49b0105020 0x7f49b01a0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41176/0 (socket says 172.21.15.192:41176) 2024-04-26T18:31:38.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.362+0000 7f49affff700 1 -- 172.21.15.192:0/460472795 learned_addr learned my addr 172.21.15.192:0/460472795 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-04-26T18:31:38.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.362+0000 7f49aeffd700 1 --2- 172.21.15.192:0/460472795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49b0104680 0x7f49b0199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:38.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.362+0000 7f49affff700 1 -- 172.21.15.192:0/460472795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49b0104680 msgr2=0x7f49b0199c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:38.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.362+0000 7f49affff700 1 --2- 172.21.15.192:0/460472795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49b0104680 0x7f49b0199c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:38.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.362+0000 7f49affff700 1 -- 172.21.15.192:0/460472795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49b0103480 msgr2=0x7f49b01996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:38.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.362+0000 7f49affff700 1 --2- 172.21.15.192:0/460472795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49b0103480 0x7f49b01996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:38.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.362+0000 7f49affff700 1 -- 172.21.15.192:0/460472795 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b01a12f0 con 0x7f49b0105020 2024-04-26T18:31:38.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.362+0000 7f49affff700 1 --2- 172.21.15.192:0/460472795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49b0105020 0x7f49b01a0c50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f49a800b580 tx=0x7f49a800b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:38.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.363+0000 7f49acff9700 1 -- 172.21.15.192:0/460472795 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a8015020 con 0x7f49b0105020 2024-04-26T18:31:38.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.363+0000 7f49b5e9c700 1 -- 172.21.15.192:0/460472795 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49b01a15e0 con 0x7f49b0105020 2024-04-26T18:31:38.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.363+0000 7f49acff9700 1 -- 172.21.15.192:0/460472795 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49a8011ce0 con 0x7f49b0105020 2024-04-26T18:31:38.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.363+0000 7f49acff9700 1 -- 172.21.15.192:0/460472795 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a8010c90 con 0x7f49b0105020 2024-04-26T18:31:38.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.363+0000 7f49b5e9c700 1 -- 172.21.15.192:0/460472795 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49b01a1b50 con 0x7f49b0105020 2024-04-26T18:31:38.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.364+0000 7f49b5e9c700 1 -- 172.21.15.192:0/460472795 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49b006a110 con 0x7f49b0105020 2024-04-26T18:31:38.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.365+0000 7f49acff9700 1 -- 172.21.15.192:0/460472795 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f49a8018020 con 0x7f49b0105020 2024-04-26T18:31:38.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.365+0000 7f49acff9700 1 --2- 172.21.15.192:0/460472795 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f49980a3c40 0x7f49980a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:38.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.365+0000 7f49acff9700 1 -- 172.21.15.192:0/460472795 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6723+0+0 (secure 0 0 0) 0x7f49a80cf4b0 con 0x7f49b0105020 2024-04-26T18:31:38.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.365+0000 7f49af7fe700 1 --2- 172.21.15.192:0/460472795 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f49980a3c40 0x7f49980a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:38.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.366+0000 7f49af7fe700 1 --2- 172.21.15.192:0/460472795 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f49980a3c40 0x7f49980a6100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f49b01044e0 tx=0x7f49a000d040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:38.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.370+0000 7f49acff9700 1 -- 172.21.15.192:0/460472795 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f49a801f020 con 0x7f49b0105020 2024-04-26T18:31:38.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:31:38.578+0000 7f49b5e9c700 1 -- 172.21.15.192:0/460472795 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f49b0063860 con 0x7f49980a3c40 2024-04-26T18:31:39.441 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:39 smithi192 ceph-mon[32842]: osdmap e76: 11 total, 11 up, 11 in 2024-04-26T18:31:39.490 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:39 smithi192 ceph-mon[32842]: pgmap v240: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T18:31:39.490 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:39 smithi192 ceph-mon[32842]: from='client.24334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:31:39.491 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:39 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:31:39.491 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:39 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:31:39.491 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:39 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:39.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:39 smithi082 ceph-mon[32808]: osdmap e76: 11 total, 11 up, 11 in 2024-04-26T18:31:39.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:39 smithi082 ceph-mon[32808]: pgmap v240: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T18:31:39.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:39 smithi082 ceph-mon[32808]: from='client.24334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:31:39.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:39 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:31:39.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:39 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:31:39.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:39 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:39.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:39 smithi080 ceph-mon[29135]: osdmap e76: 11 total, 11 up, 11 in 2024-04-26T18:31:39.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:39 smithi080 ceph-mon[29135]: pgmap v240: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T18:31:39.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:39 smithi080 ceph-mon[29135]: from='client.24334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:31:39.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T18:31:39.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T18:31:39.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:40.523 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:40 smithi192 ceph-mon[32842]: osdmap e77: 11 total, 11 up, 11 in 2024-04-26T18:31:40.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:40 smithi082 ceph-mon[32808]: osdmap e77: 11 total, 11 up, 11 in 2024-04-26T18:31:40.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:40 smithi080 ceph-mon[29135]: osdmap e77: 11 total, 11 up, 11 in 2024-04-26T18:31:41.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:41 smithi192 ceph-mon[32842]: pgmap v242: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 141 KiB/s, 0 objects/s recovering 2024-04-26T18:31:41.714 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:41 smithi082 ceph-mon[32808]: pgmap v242: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 141 KiB/s, 0 objects/s recovering 2024-04-26T18:31:41.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:41 smithi080 ceph-mon[29135]: pgmap v242: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 141 KiB/s, 0 objects/s recovering 2024-04-26T18:31:42.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:42 smithi082 ceph-mon[32808]: from='client.? 172.21.15.192:0/427111295' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e52807c6-8890-4df7-a8c6-51a7ff4b467b"}]: dispatch 2024-04-26T18:31:42.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:42 smithi082 ceph-mon[32808]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e52807c6-8890-4df7-a8c6-51a7ff4b467b"}]: dispatch 2024-04-26T18:31:42.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:42 smithi082 ceph-mon[32808]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e52807c6-8890-4df7-a8c6-51a7ff4b467b"}]': finished 2024-04-26T18:31:42.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:42 smithi082 ceph-mon[32808]: osdmap e78: 12 total, 11 up, 12 in 2024-04-26T18:31:42.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:42 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T18:31:42.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:42 smithi082 ceph-mon[32808]: from='client.? 172.21.15.192:0/635480053' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:31:42.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:42 smithi080 ceph-mon[29135]: from='client.? 172.21.15.192:0/427111295' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e52807c6-8890-4df7-a8c6-51a7ff4b467b"}]: dispatch 2024-04-26T18:31:42.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:42 smithi080 ceph-mon[29135]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e52807c6-8890-4df7-a8c6-51a7ff4b467b"}]: dispatch 2024-04-26T18:31:42.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:42 smithi080 ceph-mon[29135]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e52807c6-8890-4df7-a8c6-51a7ff4b467b"}]': finished 2024-04-26T18:31:42.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:42 smithi080 ceph-mon[29135]: osdmap e78: 12 total, 11 up, 12 in 2024-04-26T18:31:42.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:42 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T18:31:42.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:42 smithi080 ceph-mon[29135]: from='client.? 172.21.15.192:0/635480053' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:31:42.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:42 smithi192 ceph-mon[32842]: from='client.? 172.21.15.192:0/427111295' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e52807c6-8890-4df7-a8c6-51a7ff4b467b"}]: dispatch 2024-04-26T18:31:42.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:42 smithi192 ceph-mon[32842]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e52807c6-8890-4df7-a8c6-51a7ff4b467b"}]: dispatch 2024-04-26T18:31:42.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:42 smithi192 ceph-mon[32842]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e52807c6-8890-4df7-a8c6-51a7ff4b467b"}]': finished 2024-04-26T18:31:42.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:42 smithi192 ceph-mon[32842]: osdmap e78: 12 total, 11 up, 12 in 2024-04-26T18:31:42.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:42 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T18:31:42.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:42 smithi192 ceph-mon[32842]: from='client.? 172.21.15.192:0/635480053' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T18:31:43.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:43 smithi082 ceph-mon[32808]: pgmap v244: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-04-26T18:31:43.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:43 smithi080 ceph-mon[29135]: pgmap v244: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-04-26T18:31:43.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:43 smithi192 ceph-mon[32842]: pgmap v244: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-04-26T18:31:45.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:45 smithi192 ceph-mon[32842]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:45.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:45 smithi082 ceph-mon[32808]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:45.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:45 smithi080 ceph-mon[29135]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:47.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:47 smithi192 ceph-mon[32842]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:47.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:47 smithi082 ceph-mon[32808]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:47.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:47 smithi080 ceph-mon[29135]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:49.795 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:49 smithi080 ceph-mon[29135]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:49.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:49 smithi192 ceph-mon[32842]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:49.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:49 smithi082 ceph-mon[32808]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:50.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:50 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-26T18:31:50.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:50 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:50.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:50 smithi192 ceph-mon[32842]: Deploying daemon osd.11 on smithi192 2024-04-26T18:31:50.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-26T18:31:50.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:50.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:50 smithi082 ceph-mon[32808]: Deploying daemon osd.11 on smithi192 2024-04-26T18:31:50.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:50 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-26T18:31:50.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:50 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:50.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:50 smithi080 ceph-mon[29135]: Deploying daemon osd.11 on smithi192 2024-04-26T18:31:51.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:51 smithi192 ceph-mon[32842]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:51.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:51 smithi082 ceph-mon[32808]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:51.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:51 smithi080 ceph-mon[29135]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:53.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:53 smithi192 ceph-mon[32842]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:53.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:53 smithi082 ceph-mon[32808]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:53.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:53 smithi080 ceph-mon[29135]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:55.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:55 smithi192 ceph-mon[32842]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:55.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:55 smithi082 ceph-mon[32808]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:55.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:55 smithi080 ceph-mon[29135]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:56.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:56 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:56.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:56 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:56.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:56 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:31:56.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:56 smithi080 ceph-mon[29135]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:57.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:56 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:57.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:56 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:57.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:56 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:31:57.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:56 smithi192 ceph-mon[32842]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:57.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:56 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:57.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:56 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:57.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:56 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:31:57.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:56 smithi082 ceph-mon[32808]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:59.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:59 smithi192 ceph-mon[32842]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:59.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:59 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:59.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:59 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:59.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:59 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:59.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:59 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:31:59.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:31:59 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:59.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:59 smithi082 ceph-mon[32808]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:59.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:59 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:59.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:59 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:59.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:59 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:59.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:59 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:31:59.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:31:59 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:59.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:59 smithi080 ceph-mon[29135]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:31:59.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:59 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:59.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:59 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:31:59.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:59 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:59.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:59 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:31:59.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:31:59 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:00.000 INFO:teuthology.orchestra.run.smithi192.stdout:Created osd(s) 11 on host 'smithi192' 2024-04-26T18:32:00.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:00.000+0000 7f49acff9700 1 -- 172.21.15.192:0/460472795 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f49b0063860 con 0x7f49980a3c40 2024-04-26T18:32:00.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:00.002+0000 7f49b5e9c700 1 -- 172.21.15.192:0/460472795 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f49980a3c40 msgr2=0x7f49980a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:00.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:00.002+0000 7f49b5e9c700 1 --2- 172.21.15.192:0/460472795 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f49980a3c40 0x7f49980a6100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f49b01044e0 tx=0x7f49a000d040 comp rx=0 tx=0).stop 2024-04-26T18:32:00.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:00.002+0000 7f49b5e9c700 1 -- 172.21.15.192:0/460472795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49b0105020 msgr2=0x7f49b01a0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:00.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:00.002+0000 7f49b5e9c700 1 --2- 172.21.15.192:0/460472795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49b0105020 0x7f49b01a0c50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f49a800b580 tx=0x7f49a800b890 comp rx=0 tx=0).stop 2024-04-26T18:32:00.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:00.002+0000 7f49b5e9c700 1 -- 172.21.15.192:0/460472795 shutdown_connections 2024-04-26T18:32:00.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:00.002+0000 7f49b5e9c700 1 --2- 172.21.15.192:0/460472795 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f49980a3c40 0x7f49980a6100 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:00.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:00.002+0000 7f49b5e9c700 1 --2- 172.21.15.192:0/460472795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49b0105020 0x7f49b01a0c50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:00.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:00.002+0000 7f49b5e9c700 1 --2- 172.21.15.192:0/460472795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49b0103480 0x7f49b01996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:00.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:00.002+0000 7f49b5e9c700 1 --2- 172.21.15.192:0/460472795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49b0104680 0x7f49b0199c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:00.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:00.002+0000 7f49b5e9c700 1 -- 172.21.15.192:0/460472795 >> 172.21.15.192:0/460472795 conn(0x7f49b00fea20 msgr2=0x7f49b0107aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:00.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:00.002+0000 7f49b5e9c700 1 -- 172.21.15.192:0/460472795 shutdown_connections 2024-04-26T18:32:00.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:00.002+0000 7f49b5e9c700 1 -- 172.21.15.192:0/460472795 wait complete. 2024-04-26T18:32:00.685 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:00 smithi192 ceph-mon[32842]: from='osd.11 [v2:172.21.15.192:6824/3466865106,v1:172.21.15.192:6825/3466865106]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T18:32:00.685 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:00 smithi192 ceph-mon[32842]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T18:32:00.686 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:00 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:00.686 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:00 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:00.686 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:00 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:32:00.711 DEBUG:teuthology.orchestra.run.smithi192:osd.11> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.11.service 2024-04-26T18:32:00.713 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-04-26T18:32:00.713 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-26T18:32:00.964 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:32:00.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:00 smithi082 ceph-mon[32808]: from='osd.11 [v2:172.21.15.192:6824/3466865106,v1:172.21.15.192:6825/3466865106]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T18:32:00.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:00 smithi082 ceph-mon[32808]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T18:32:00.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:00 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:00.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:00 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:00.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:00 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:32:00.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:00 smithi080 ceph-mon[29135]: from='osd.11 [v2:172.21.15.192:6824/3466865106,v1:172.21.15.192:6825/3466865106]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T18:32:00.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:00 smithi080 ceph-mon[29135]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T18:32:00.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:00 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:00.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:00 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:00.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:00 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:32:01.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:01 smithi080 ceph-mon[29135]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:32:01.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:01 smithi080 ceph-mon[29135]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-26T18:32:01.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:01 smithi080 ceph-mon[29135]: from='osd.11 [v2:172.21.15.192:6824/3466865106,v1:172.21.15.192:6825/3466865106]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-04-26T18:32:01.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:01 smithi080 ceph-mon[29135]: osdmap e79: 12 total, 11 up, 12 in 2024-04-26T18:32:01.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:01 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T18:32:01.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:01 smithi080 ceph-mon[29135]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-04-26T18:32:01.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:01 smithi192 ceph-mon[32842]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:32:01.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:01 smithi192 ceph-mon[32842]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-26T18:32:01.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:01 smithi192 ceph-mon[32842]: from='osd.11 [v2:172.21.15.192:6824/3466865106,v1:172.21.15.192:6825/3466865106]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-04-26T18:32:01.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:01 smithi192 ceph-mon[32842]: osdmap e79: 12 total, 11 up, 12 in 2024-04-26T18:32:01.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:01 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T18:32:01.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:01 smithi192 ceph-mon[32842]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-04-26T18:32:01.863 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:32:01 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:32:01.550+0000 7fa4d672d700 -1 osd.11 0 waiting for initial osdmap 2024-04-26T18:32:01.863 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:32:01 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:32:01.565+0000 7fa4d2520700 -1 osd.11 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T18:32:01.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:01 smithi082 ceph-mon[32808]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:32:01.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:01 smithi082 ceph-mon[32808]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-26T18:32:01.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:01 smithi082 ceph-mon[32808]: from='osd.11 [v2:172.21.15.192:6824/3466865106,v1:172.21.15.192:6825/3466865106]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-04-26T18:32:01.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:01 smithi082 ceph-mon[32808]: osdmap e79: 12 total, 11 up, 12 in 2024-04-26T18:32:01.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:01 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T18:32:01.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:01 smithi082 ceph-mon[32808]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-04-26T18:32:02.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.600+0000 7f879d298700 1 -- 172.21.15.80:0/1993876823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87981023c0 msgr2=0x7f87981027e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.600+0000 7f879d298700 1 --2- 172.21.15.80:0/1993876823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87981023c0 0x7f87981027e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f87880099c0 tx=0x7f8788009cd0 comp rx=0 tx=0).stop 2024-04-26T18:32:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.600+0000 7f879d298700 1 -- 172.21.15.80:0/1993876823 shutdown_connections 2024-04-26T18:32:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.600+0000 7f879d298700 1 --2- 172.21.15.80:0/1993876823 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8798103f60 0x7f879810a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.600+0000 7f879d298700 1 --2- 172.21.15.80:0/1993876823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87981023c0 0x7f87981027e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.600+0000 7f879d298700 1 --2- 172.21.15.80:0/1993876823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87981035c0 0x7f8798103a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.600+0000 7f879d298700 1 -- 172.21.15.80:0/1993876823 >> 172.21.15.80:0/1993876823 conn(0x7f87980fd980 msgr2=0x7f87980ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.600+0000 7f879d298700 1 -- 172.21.15.80:0/1993876823 shutdown_connections 2024-04-26T18:32:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.600+0000 7f879d298700 1 -- 172.21.15.80:0/1993876823 wait complete. 2024-04-26T18:32:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.601+0000 7f879d298700 1 Processor -- start 2024-04-26T18:32:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.601+0000 7f879d298700 1 -- start start 2024-04-26T18:32:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.601+0000 7f879d298700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87981023c0 0x7f879806c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:02.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.601+0000 7f879d298700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87981035c0 0x7f879819e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:02.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.601+0000 7f879d298700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8798103f60 0x7f87981a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:02.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.601+0000 7f879d298700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f879810dea0 con 0x7f87981023c0 2024-04-26T18:32:02.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.601+0000 7f879d298700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f879810dd20 con 0x7f8798103f60 2024-04-26T18:32:02.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.601+0000 7f879d298700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f879810e020 con 0x7f87981035c0 2024-04-26T18:32:02.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.602+0000 7f8796ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87981023c0 0x7f879806c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:02.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.602+0000 7f8796ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87981023c0 0x7f879806c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43208/0 (socket says 172.21.15.80:43208) 2024-04-26T18:32:02.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.602+0000 7f8796ffd700 1 -- 172.21.15.80:0/1560130350 learned_addr learned my addr 172.21.15.80:0/1560130350 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:32:02.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.602+0000 7f87977fe700 1 --2- 172.21.15.80:0/1560130350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8798103f60 0x7f87981a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:02.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.602+0000 7f87967fc700 1 --2- 172.21.15.80:0/1560130350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87981035c0 0x7f879819e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:02.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.602+0000 7f8796ffd700 1 -- 172.21.15.80:0/1560130350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87981035c0 msgr2=0x7f879819e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:02.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.602+0000 7f8796ffd700 1 --2- 172.21.15.80:0/1560130350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87981035c0 0x7f879819e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:02.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.602+0000 7f8796ffd700 1 -- 172.21.15.80:0/1560130350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8798103f60 msgr2=0x7f87981a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:02.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.602+0000 7f8796ffd700 1 --2- 172.21.15.80:0/1560130350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8798103f60 0x7f87981a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:02.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.602+0000 7f8796ffd700 1 -- 172.21.15.80:0/1560130350 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87981a1270 con 0x7f87981023c0 2024-04-26T18:32:02.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.602+0000 7f8796ffd700 1 --2- 172.21.15.80:0/1560130350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87981023c0 0x7f879806c6b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8788000c00 tx=0x7f8788009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:02.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.602+0000 7f877ffff700 1 -- 172.21.15.80:0/1560130350 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8788027070 con 0x7f87981023c0 2024-04-26T18:32:02.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.602+0000 7f879d298700 1 -- 172.21.15.80:0/1560130350 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87981a1500 con 0x7f87981023c0 2024-04-26T18:32:02.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.602+0000 7f877ffff700 1 -- 172.21.15.80:0/1560130350 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8788004120 con 0x7f87981023c0 2024-04-26T18:32:02.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.602+0000 7f879d298700 1 -- 172.21.15.80:0/1560130350 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87981a19b0 con 0x7f87981023c0 2024-04-26T18:32:02.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.602+0000 7f877ffff700 1 -- 172.21.15.80:0/1560130350 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8788022c60 con 0x7f87981023c0 2024-04-26T18:32:02.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.603+0000 7f879d298700 1 -- 172.21.15.80:0/1560130350 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f879806a110 con 0x7f87981023c0 2024-04-26T18:32:02.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.604+0000 7f877ffff700 1 -- 172.21.15.80:0/1560130350 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f878802a070 con 0x7f87981023c0 2024-04-26T18:32:02.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.605+0000 7f877ffff700 1 --2- 172.21.15.80:0/1560130350 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f87800a3c40 0x7f87800a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:02.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.605+0000 7f87967fc700 1 --2- 172.21.15.80:0/1560130350 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f87800a3c40 0x7f87800a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:02.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.605+0000 7f877ffff700 1 -- 172.21.15.80:0/1560130350 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f87880d1040 con 0x7f87981023c0 2024-04-26T18:32:02.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.605+0000 7f87967fc700 1 --2- 172.21.15.80:0/1560130350 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f87800a3c40 0x7f87800a6100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f879806cc10 tx=0x7f878c00b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:02.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.609+0000 7f877ffff700 1 -- 172.21.15.80:0/1560130350 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8788022e20 con 0x7f87981023c0 2024-04-26T18:32:02.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:02 smithi080 ceph-mon[29135]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-04-26T18:32:02.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:02 smithi080 ceph-mon[29135]: osdmap e80: 12 total, 11 up, 12 in 2024-04-26T18:32:02.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:02 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T18:32:02.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:02 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T18:32:02.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.810+0000 7f879d298700 1 -- 172.21.15.80:0/1560130350 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f879802e490 con 0x7f87981023c0 2024-04-26T18:32:02.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.810+0000 7f877ffff700 1 -- 172.21.15.80:0/1560130350 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) ==== 74+0+133 (secure 0 0 0) 0x7f8788013070 con 0x7f87981023c0 2024-04-26T18:32:02.811 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:32:02.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.813+0000 7f879d298700 1 -- 172.21.15.80:0/1560130350 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f87800a3c40 msgr2=0x7f87800a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:02.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.813+0000 7f879d298700 1 --2- 172.21.15.80:0/1560130350 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f87800a3c40 0x7f87800a6100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f879806cc10 tx=0x7f878c00b410 comp rx=0 tx=0).stop 2024-04-26T18:32:02.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.813+0000 7f879d298700 1 -- 172.21.15.80:0/1560130350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87981023c0 msgr2=0x7f879806c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:02.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.813+0000 7f879d298700 1 --2- 172.21.15.80:0/1560130350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87981023c0 0x7f879806c6b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8788000c00 tx=0x7f8788009580 comp rx=0 tx=0).stop 2024-04-26T18:32:02.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.813+0000 7f879d298700 1 -- 172.21.15.80:0/1560130350 shutdown_connections 2024-04-26T18:32:02.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.813+0000 7f879d298700 1 --2- 172.21.15.80:0/1560130350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8798103f60 0x7f87981a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:02.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.813+0000 7f879d298700 1 --2- 172.21.15.80:0/1560130350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87981023c0 0x7f879806c6b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:02.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.813+0000 7f879d298700 1 --2- 172.21.15.80:0/1560130350 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f87800a3c40 0x7f87800a6100 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:02.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.813+0000 7f879d298700 1 --2- 172.21.15.80:0/1560130350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87981035c0 0x7f879819e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:02.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.813+0000 7f879d298700 1 -- 172.21.15.80:0/1560130350 >> 172.21.15.80:0/1560130350 conn(0x7f87980fd980 msgr2=0x7f8798106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:02.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.813+0000 7f879d298700 1 -- 172.21.15.80:0/1560130350 shutdown_connections 2024-04-26T18:32:02.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:02.813+0000 7f879d298700 1 -- 172.21.15.80:0/1560130350 wait complete. 2024-04-26T18:32:02.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:02 smithi192 ceph-mon[32842]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-04-26T18:32:02.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:02 smithi192 ceph-mon[32842]: osdmap e80: 12 total, 11 up, 12 in 2024-04-26T18:32:02.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:02 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T18:32:02.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:02 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T18:32:02.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:02 smithi082 ceph-mon[32808]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-04-26T18:32:02.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:02 smithi082 ceph-mon[32808]: osdmap e80: 12 total, 11 up, 12 in 2024-04-26T18:32:02.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:02 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T18:32:02.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:02 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T18:32:03.550 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1714156322,"num_in_osds":12,"osd_in_since":1714156301,"num_remapped_pgs":0} 2024-04-26T18:32:03.550 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T18:32:03.796 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:32:03.842 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:03 smithi080 ceph-mon[29135]: purged_snaps scrub starts 2024-04-26T18:32:03.842 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:03 smithi080 ceph-mon[29135]: purged_snaps scrub ok 2024-04-26T18:32:03.842 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:03 smithi080 ceph-mon[29135]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:32:03.842 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:03 smithi080 ceph-mon[29135]: osd.11 [v2:172.21.15.192:6824/3466865106,v1:172.21.15.192:6825/3466865106] boot 2024-04-26T18:32:03.842 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:03 smithi080 ceph-mon[29135]: osdmap e81: 12 total, 12 up, 12 in 2024-04-26T18:32:03.843 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:03 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T18:32:03.843 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:03 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1560130350' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T18:32:03.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:03 smithi192 ceph-mon[32842]: purged_snaps scrub starts 2024-04-26T18:32:03.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:03 smithi192 ceph-mon[32842]: purged_snaps scrub ok 2024-04-26T18:32:03.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:03 smithi192 ceph-mon[32842]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:32:03.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:03 smithi192 ceph-mon[32842]: osd.11 [v2:172.21.15.192:6824/3466865106,v1:172.21.15.192:6825/3466865106] boot 2024-04-26T18:32:03.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:03 smithi192 ceph-mon[32842]: osdmap e81: 12 total, 12 up, 12 in 2024-04-26T18:32:03.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:03 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T18:32:03.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:03 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1560130350' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T18:32:03.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:03 smithi082 ceph-mon[32808]: purged_snaps scrub starts 2024-04-26T18:32:03.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:03 smithi082 ceph-mon[32808]: purged_snaps scrub ok 2024-04-26T18:32:03.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:03 smithi082 ceph-mon[32808]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-04-26T18:32:03.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:03 smithi082 ceph-mon[32808]: osd.11 [v2:172.21.15.192:6824/3466865106,v1:172.21.15.192:6825/3466865106] boot 2024-04-26T18:32:03.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:03 smithi082 ceph-mon[32808]: osdmap e81: 12 total, 12 up, 12 in 2024-04-26T18:32:03.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:03 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T18:32:03.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:03 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1560130350' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T18:32:04.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:04 smithi192 ceph-mon[32842]: osdmap e82: 12 total, 12 up, 12 in 2024-04-26T18:32:04.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:04 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:04.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:04 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:04.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:04 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:32:04.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:04 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:32:04.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:04 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:32:04.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:04 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:32:04.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:04 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:04.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:04 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:04.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:04 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:32:04.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:04 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:04.889 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:04 smithi080 ceph-mon[29135]: osdmap e82: 12 total, 12 up, 12 in 2024-04-26T18:32:04.889 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:04 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:04.889 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:04 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:04.889 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:04 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:32:04.889 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:04 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:32:04.889 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:04 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:32:04.889 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:04 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:32:04.889 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:04 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:04.889 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:04 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:04.890 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:04 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:32:04.890 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:04 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:04.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:04 smithi082 ceph-mon[32808]: osdmap e82: 12 total, 12 up, 12 in 2024-04-26T18:32:04.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:04 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:04.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:04 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:04.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:04 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:32:04.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:04 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:32:04.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:04 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:32:04.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:04 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:32:04.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:04 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:04.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:04 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:04.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:04 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:32:04.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:04 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:05.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.418+0000 7f84544de700 1 -- 172.21.15.80:0/4098559119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f844c102d10 msgr2=0x7f844c10f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:05.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.418+0000 7f84544de700 1 --2- 172.21.15.80:0/4098559119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f844c102d10 0x7f844c10f1d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f844400b0a0 tx=0x7f844400b3b0 comp rx=0 tx=0).stop 2024-04-26T18:32:05.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.418+0000 7f84544de700 1 -- 172.21.15.80:0/4098559119 shutdown_connections 2024-04-26T18:32:05.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.418+0000 7f84544de700 1 --2- 172.21.15.80:0/4098559119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f844c102d10 0x7f844c10f1d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:05.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.418+0000 7f84544de700 1 --2- 172.21.15.80:0/4098559119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f844c1083d0 0x7f844c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:05.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.418+0000 7f84544de700 1 --2- 172.21.15.80:0/4098559119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f844c102350 0x7f844c1027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:05.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.418+0000 7f84544de700 1 -- 172.21.15.80:0/4098559119 >> 172.21.15.80:0/4098559119 conn(0x7f844c078390 msgr2=0x7f844c0787a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:05.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.418+0000 7f84544de700 1 -- 172.21.15.80:0/4098559119 shutdown_connections 2024-04-26T18:32:05.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.418+0000 7f84544de700 1 -- 172.21.15.80:0/4098559119 wait complete. 2024-04-26T18:32:05.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.419+0000 7f84544de700 1 Processor -- start 2024-04-26T18:32:05.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.419+0000 7f84544de700 1 -- start start 2024-04-26T18:32:05.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.419+0000 7f84544de700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f844c102350 0x7f844c19f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:05.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.419+0000 7f84544de700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f844c102d10 0x7f844c19fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:05.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.419+0000 7f84544de700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f844c1083d0 0x7f844c199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:05.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.419+0000 7f84544de700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f844c112520 con 0x7f844c102d10 2024-04-26T18:32:05.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.419+0000 7f84544de700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f844c1123a0 con 0x7f844c102350 2024-04-26T18:32:05.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.419+0000 7f84544de700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f844c1126a0 con 0x7f844c1083d0 2024-04-26T18:32:05.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.419+0000 7f8451a79700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f844c102d10 0x7f844c19fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:05.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.419+0000 7f8451a79700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f844c102d10 0x7f844c19fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46160/0 (socket says 172.21.15.80:46160) 2024-04-26T18:32:05.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.419+0000 7f8451a79700 1 -- 172.21.15.80:0/1292317891 learned_addr learned my addr 172.21.15.80:0/1292317891 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:32:05.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.419+0000 7f845227a700 1 --2- 172.21.15.80:0/1292317891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f844c102350 0x7f844c19f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:05.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.419+0000 7f8452a7b700 1 --2- 172.21.15.80:0/1292317891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f844c1083d0 0x7f844c199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:05.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.419+0000 7f8451a79700 1 -- 172.21.15.80:0/1292317891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f844c1083d0 msgr2=0x7f844c199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:05.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.419+0000 7f8451a79700 1 --2- 172.21.15.80:0/1292317891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f844c1083d0 0x7f844c199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:05.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.419+0000 7f8451a79700 1 -- 172.21.15.80:0/1292317891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f844c102350 msgr2=0x7f844c19f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:05.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.419+0000 7f8451a79700 1 --2- 172.21.15.80:0/1292317891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f844c102350 0x7f844c19f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:05.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.419+0000 7f8451a79700 1 -- 172.21.15.80:0/1292317891 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f844c199fc0 con 0x7f844c102d10 2024-04-26T18:32:05.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.419+0000 7f845227a700 1 --2- 172.21.15.80:0/1292317891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f844c102350 0x7f844c19f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:32:05.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.419+0000 7f8451a79700 1 --2- 172.21.15.80:0/1292317891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f844c102d10 0x7f844c19fbe0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f843c00c9b0 tx=0x7f843c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:05.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.420+0000 7f84437fe700 1 -- 172.21.15.80:0/1292317891 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c007b00 con 0x7f844c102d10 2024-04-26T18:32:05.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.420+0000 7f84437fe700 1 -- 172.21.15.80:0/1292317891 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f843c007ca0 con 0x7f844c102d10 2024-04-26T18:32:05.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.420+0000 7f84544de700 1 -- 172.21.15.80:0/1292317891 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f844c19a2b0 con 0x7f844c102d10 2024-04-26T18:32:05.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.420+0000 7f84437fe700 1 -- 172.21.15.80:0/1292317891 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c018730 con 0x7f844c102d10 2024-04-26T18:32:05.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.420+0000 7f84544de700 1 -- 172.21.15.80:0/1292317891 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f844c1a6570 con 0x7f844c102d10 2024-04-26T18:32:05.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.421+0000 7f84544de700 1 -- 172.21.15.80:0/1292317891 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f844c103a40 con 0x7f844c102d10 2024-04-26T18:32:05.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.422+0000 7f84437fe700 1 -- 172.21.15.80:0/1292317891 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f843c00f450 con 0x7f844c102d10 2024-04-26T18:32:05.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.423+0000 7f84437fe700 1 --2- 172.21.15.80:0/1292317891 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f84380a3c40 0x7f84380a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:05.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.423+0000 7f845227a700 1 --2- 172.21.15.80:0/1292317891 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f84380a3c40 0x7f84380a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:05.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.423+0000 7f84437fe700 1 -- 172.21.15.80:0/1292317891 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f843c0d03b0 con 0x7f844c102d10 2024-04-26T18:32:05.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.423+0000 7f845227a700 1 --2- 172.21.15.80:0/1292317891 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f84380a3c40 0x7f84380a6100 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f844c19a9a0 tx=0x7f8448008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:05.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.426+0000 7f84437fe700 1 -- 172.21.15.80:0/1292317891 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f843c014030 con 0x7f844c102d10 2024-04-26T18:32:05.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.634+0000 7f84544de700 1 -- 172.21.15.80:0/1292317891 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f844c06a110 con 0x7f844c102d10 2024-04-26T18:32:05.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.635+0000 7f84437fe700 1 -- 172.21.15.80:0/1292317891 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+18384 (secure 0 0 0) 0x7f844c06a110 con 0x7f844c102d10 2024-04-26T18:32:05.636 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:32:05.636 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":82,"fsid":"2187ca98-03fa-11ef-bc93-c7b262605968","created":"2024-04-26T18:24:58.809431+0000","modified":"2024-04-26T18:32:03.556676+0000","last_up_change":"2024-04-26T18:32:02.550187+0000","last_in_change":"2024-04-26T18:31:41.630932+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T18:28:14.502290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a01cfe6-d13a-4828-8c20-ad7fee7e87ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6803","nonce":429487384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6805","nonce":429487384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6809","nonce":429487384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6807","nonce":429487384}]},"public_addr":"172.21.15.80:6803/429487384","cluster_addr":"172.21.15.80:6805/429487384","heartbeat_back_addr":"172.21.15.80:6809/429487384","heartbeat_front_addr":"172.21.15.80:6807/429487384","state":["exists","up"]},{"osd":1,"uuid":"1f815d88-30b1-4540-b4f5-cc3d62707318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913033849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913033849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913033849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913033849}]},"public_addr":"172.21.15.82:6801/3913033849","cluster_addr":"172.21.15.82:6803/3913033849","heartbeat_back_addr":"172.21.15.82:6807/3913033849","heartbeat_front_addr":"172.21.15.82:6805/3913033849","state":["exists","up"]},{"osd":2,"uuid":"b8625dd7-4c1d-4258-ac2b-463ff96f4cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6801","nonce":503427508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6803","nonce":503427508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6807","nonce":503427508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6805","nonce":503427508}]},"public_addr":"172.21.15.192:6801/503427508","cluster_addr":"172.21.15.192:6803/503427508","heartbeat_back_addr":"172.21.15.192:6807/503427508","heartbeat_front_addr":"172.21.15.192:6805/503427508","state":["exists","up"]},{"osd":3,"uuid":"3068321a-3070-44ae-9bbd-a3faac8c21fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6811","nonce":407817066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6813","nonce":407817066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6817","nonce":407817066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6815","nonce":407817066}]},"public_addr":"172.21.15.80:6811/407817066","cluster_addr":"172.21.15.80:6813/407817066","heartbeat_back_addr":"172.21.15.80:6817/407817066","heartbeat_front_addr":"172.21.15.80:6815/407817066","state":["exists","up"]},{"osd":4,"uuid":"6b3d6455-9495-435b-8193-a260b63504ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6809","nonce":2068291934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6811","nonce":2068291934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6815","nonce":2068291934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6813","nonce":2068291934}]},"public_addr":"172.21.15.82:6809/2068291934","cluster_addr":"172.21.15.82:6811/2068291934","heartbeat_back_addr":"172.21.15.82:6815/2068291934","heartbeat_front_addr":"172.21.15.82:6813/2068291934","state":["exists","up"]},{"osd":5,"uuid":"538863f1-1486-45b5-a675-ecb1d3035599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6809","nonce":1770809727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6811","nonce":1770809727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6815","nonce":1770809727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6813","nonce":1770809727}]},"public_addr":"172.21.15.192:6809/1770809727","cluster_addr":"172.21.15.192:6811/1770809727","heartbeat_back_addr":"172.21.15.192:6815/1770809727","heartbeat_front_addr":"172.21.15.192:6813/1770809727","state":["exists","up"]},{"osd":6,"uuid":"7b4374d8-98e6-48e1-924b-c9b70a4baf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6819","nonce":145064490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6821","nonce":145064490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6825","nonce":145064490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6823","nonce":145064490}]},"public_addr":"172.21.15.80:6819/145064490","cluster_addr":"172.21.15.80:6821/145064490","heartbeat_back_addr":"172.21.15.80:6825/145064490","heartbeat_front_addr":"172.21.15.80:6823/145064490","state":["exists","up"]},{"osd":7,"uuid":"f3bb3c7d-4cce-4f49-b924-72ebbaad58ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6817","nonce":208047447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6819","nonce":208047447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6823","nonce":208047447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6821","nonce":208047447}]},"public_addr":"172.21.15.82:6817/208047447","cluster_addr":"172.21.15.82:6819/208047447","heartbeat_back_addr":"172.21.15.82:6823/208047447","heartbeat_front_addr":"172.21.15.82:6821/208047447","state":["exists","up"]},{"osd":8,"uuid":"6557b536-a516-4b01-a607-7981620fb2a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6817","nonce":3763069187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6819","nonce":3763069187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6823","nonce":3763069187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6821","nonce":3763069187}]},"public_addr":"172.21.15.192:6817/3763069187","cluster_addr":"172.21.15.192:6819/3763069187","heartbeat_back_addr":"172.21.15.192:6823/3763069187","heartbeat_front_addr":"172.21.15.192:6821/3763069187","state":["exists","up"]},{"osd":9,"uuid":"838615a7-1e68-4e81-8b3a-fba0ea75f7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6827","nonce":2109877993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6829","nonce":2109877993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6833","nonce":2109877993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6831","nonce":2109877993}]},"public_addr":"172.21.15.80:6827/2109877993","cluster_addr":"172.21.15.80:6829/2109877993","heartbeat_back_addr":"172.21.15.80:6833/2109877993","heartbeat_front_addr":"172.21.15.80:6831/2109877993","state":["exists","up"]},{"osd":10,"uuid":"cd664e50-3217-453d-9a89-6e26d717e6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6825","nonce":2877220993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6827","nonce":2877220993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6831","nonce":2877220993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6829","nonce":2877220993}]},"public_addr":"172.21.15.82:6825/2877220993","cluster_addr":"172.21.15.82:6827/2877220993","heartbeat_back_addr":"172.21.15.82:6831/2877220993","heartbeat_front_addr":"172.21.15.82:6829/2877220993","state":["exists","up"]},{"osd":11,"uuid":"e52807c6-8890-4df7-a8c6-51a7ff4b467b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6825","nonce":3466865106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6827","nonce":3466865106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6831","nonce":3466865106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6829","nonce":3466865106}]},"public_addr":"172.21.15.192:6825/3466865106","cluster_addr":"172.21.15.192:6827/3466865106","heartbeat_back_addr":"172.21.15.192:6831/3466865106","heartbeat_front_addr":"172.21.15.192:6829/3466865106","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:27:23.385471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:27:46.648232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:10.578970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:34.922048+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:59.142838+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:29:24.492250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:29:49.721803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:30:15.177027+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:30:41.544775+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:31:07.562401+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:31:33.498042+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:32:00.584085+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/1997155783":"2024-04-27T18:25:50.413207+0000","172.21.15.80:0/323607684":"2024-04-27T18:25:50.413207+0000","172.21.15.80:0/586397709":"2024-04-27T18:25:50.413207+0000","172.21.15.80:6801/4208962819":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/1353083127":"2024-04-27T18:25:24.440373+0000","172.21.15.80:6800/1997155783":"2024-04-27T18:25:50.413207+0000","172.21.15.80:6800/4208962819":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2644175019":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/1853513470":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2122929159":"2024-04-27T18:25:50.413207+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T18:32:05.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.637+0000 7f84544de700 1 -- 172.21.15.80:0/1292317891 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f84380a3c40 msgr2=0x7f84380a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:05.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.637+0000 7f84544de700 1 --2- 172.21.15.80:0/1292317891 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f84380a3c40 0x7f84380a6100 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f844c19a9a0 tx=0x7f8448008040 comp rx=0 tx=0).stop 2024-04-26T18:32:05.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.637+0000 7f84544de700 1 -- 172.21.15.80:0/1292317891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f844c102d10 msgr2=0x7f844c19fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:05.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.637+0000 7f84544de700 1 --2- 172.21.15.80:0/1292317891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f844c102d10 0x7f844c19fbe0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f843c00c9b0 tx=0x7f843c00cd70 comp rx=0 tx=0).stop 2024-04-26T18:32:05.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.637+0000 7f84544de700 1 -- 172.21.15.80:0/1292317891 shutdown_connections 2024-04-26T18:32:05.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.637+0000 7f84544de700 1 --2- 172.21.15.80:0/1292317891 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f84380a3c40 0x7f84380a6100 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:05.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.637+0000 7f84544de700 1 --2- 172.21.15.80:0/1292317891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f844c1083d0 0x7f844c199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:05.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.637+0000 7f84544de700 1 --2- 172.21.15.80:0/1292317891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f844c102350 0x7f844c19f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:05.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.638+0000 7f84544de700 1 --2- 172.21.15.80:0/1292317891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f844c102d10 0x7f844c19fbe0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:05.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.638+0000 7f84544de700 1 -- 172.21.15.80:0/1292317891 >> 172.21.15.80:0/1292317891 conn(0x7f844c078390 msgr2=0x7f844c1015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:05.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.638+0000 7f84544de700 1 -- 172.21.15.80:0/1292317891 shutdown_connections 2024-04-26T18:32:05.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:05.638+0000 7f84544de700 1 -- 172.21.15.80:0/1292317891 wait complete. 2024-04-26T18:32:05.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:05 smithi192 ceph-mon[32842]: Detected new or changed devices on smithi192 2024-04-26T18:32:05.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:05 smithi192 ceph-mon[32842]: Adjusting osd_memory_target on smithi192 to 4272M 2024-04-26T18:32:05.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:05 smithi192 ceph-mon[32842]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:05.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:05 smithi082 ceph-mon[32808]: Detected new or changed devices on smithi192 2024-04-26T18:32:05.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:05 smithi082 ceph-mon[32808]: Adjusting osd_memory_target on smithi192 to 4272M 2024-04-26T18:32:05.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:05 smithi082 ceph-mon[32808]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:05.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:05 smithi080 ceph-mon[29135]: Detected new or changed devices on smithi192 2024-04-26T18:32:05.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:05 smithi080 ceph-mon[29135]: Adjusting osd_memory_target on smithi192 to 4272M 2024-04-26T18:32:05.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:05 smithi080 ceph-mon[29135]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:06.376 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T18:28:14.502290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T18:32:06.377 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-26T18:32:06.613 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:32:06.735 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:06 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1292317891' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:32:06.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:06 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1292317891' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:32:06.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:06 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1292317891' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:32:07.838 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:07 smithi080 ceph-mon[29135]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:07.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:07 smithi192 ceph-mon[32842]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:07.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:07 smithi082 ceph-mon[32808]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:08.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.179+0000 7f282ea38700 1 -- 172.21.15.80:0/3334428284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28281025b0 msgr2=0x7f2828102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:08.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.179+0000 7f282ea38700 1 --2- 172.21.15.80:0/3334428284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28281025b0 0x7f2828102990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f28180099c0 tx=0x7f2818009cd0 comp rx=0 tx=0).stop 2024-04-26T18:32:08.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.179+0000 7f282ea38700 1 -- 172.21.15.80:0/3334428284 shutdown_connections 2024-04-26T18:32:08.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.179+0000 7f282ea38700 1 --2- 172.21.15.80:0/3334428284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2828107640 0x7f282810f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:08.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.179+0000 7f282ea38700 1 --2- 172.21.15.80:0/3334428284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28281025b0 0x7f2828102990 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:08.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.179+0000 7f282ea38700 1 --2- 172.21.15.80:0/3334428284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2828102f60 0x7f2828106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:08.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.179+0000 7f282ea38700 1 -- 172.21.15.80:0/3334428284 >> 172.21.15.80:0/3334428284 conn(0x7f28280792f0 msgr2=0x7f2828079700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:08.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.179+0000 7f282ea38700 1 -- 172.21.15.80:0/3334428284 shutdown_connections 2024-04-26T18:32:08.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.180+0000 7f282ea38700 1 -- 172.21.15.80:0/3334428284 wait complete. 2024-04-26T18:32:08.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.180+0000 7f282ea38700 1 Processor -- start 2024-04-26T18:32:08.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.180+0000 7f282ea38700 1 -- start start 2024-04-26T18:32:08.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.181+0000 7f282ea38700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28281025b0 0x7f282819e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:08.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.181+0000 7f282ea38700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2828102f60 0x7f282819ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:08.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.181+0000 7f282ea38700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2828107640 0x7f2828198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:08.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.181+0000 7f282ea38700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f28281124f0 con 0x7f28281025b0 2024-04-26T18:32:08.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.181+0000 7f282ea38700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2828112370 con 0x7f2828102f60 2024-04-26T18:32:08.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.181+0000 7f282ea38700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2828112670 con 0x7f2828107640 2024-04-26T18:32:08.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.181+0000 7f2827fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28281025b0 0x7f282819e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:08.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.181+0000 7f2827fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28281025b0 0x7f282819e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46174/0 (socket says 172.21.15.80:46174) 2024-04-26T18:32:08.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.181+0000 7f2827fff700 1 -- 172.21.15.80:0/3772997123 learned_addr learned my addr 172.21.15.80:0/3772997123 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:32:08.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.181+0000 7f28277fe700 1 --2- 172.21.15.80:0/3772997123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2828102f60 0x7f282819ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:08.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.181+0000 7f2827fff700 1 -- 172.21.15.80:0/3772997123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2828107640 msgr2=0x7f2828198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:08.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.181+0000 7f2827fff700 1 --2- 172.21.15.80:0/3772997123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2828107640 0x7f2828198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:08.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.181+0000 7f2827fff700 1 -- 172.21.15.80:0/3772997123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2828102f60 msgr2=0x7f282819ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:08.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.181+0000 7f2827fff700 1 --2- 172.21.15.80:0/3772997123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2828102f60 0x7f282819ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:08.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.181+0000 7f2827fff700 1 -- 172.21.15.80:0/3772997123 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2828198fd0 con 0x7f28281025b0 2024-04-26T18:32:08.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.181+0000 7f2827fff700 1 --2- 172.21.15.80:0/3772997123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28281025b0 0x7f282819e6b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f281800b580 tx=0x7f28180037c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:08.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.181+0000 7f28257fa700 1 -- 172.21.15.80:0/3772997123 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281802a070 con 0x7f28281025b0 2024-04-26T18:32:08.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.181+0000 7f282ea38700 1 -- 172.21.15.80:0/3772997123 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2828199260 con 0x7f28281025b0 2024-04-26T18:32:08.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.181+0000 7f28257fa700 1 -- 172.21.15.80:0/3772997123 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f281801acb0 con 0x7f28281025b0 2024-04-26T18:32:08.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.181+0000 7f28257fa700 1 -- 172.21.15.80:0/3772997123 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281800f460 con 0x7f28281025b0 2024-04-26T18:32:08.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.181+0000 7f282ea38700 1 -- 172.21.15.80:0/3772997123 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f282806bb70 con 0x7f28281025b0 2024-04-26T18:32:08.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.182+0000 7f282ea38700 1 -- 172.21.15.80:0/3772997123 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f282806a110 con 0x7f28281025b0 2024-04-26T18:32:08.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.183+0000 7f28257fa700 1 -- 172.21.15.80:0/3772997123 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f281802d070 con 0x7f28281025b0 2024-04-26T18:32:08.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.184+0000 7f28257fa700 1 --2- 172.21.15.80:0/3772997123 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f28100a3c40 0x7f28100a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:08.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.184+0000 7f28277fe700 1 --2- 172.21.15.80:0/3772997123 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f28100a3c40 0x7f28100a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:08.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.184+0000 7f28257fa700 1 -- 172.21.15.80:0/3772997123 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f28180d33e0 con 0x7f28281025b0 2024-04-26T18:32:08.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.184+0000 7f28277fe700 1 --2- 172.21.15.80:0/3772997123 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f28100a3c40 0x7f28100a6100 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2828101fe0 tx=0x7f281c005eb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:08.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.187+0000 7f28257fa700 1 -- 172.21.15.80:0/3772997123 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2818034070 con 0x7f28281025b0 2024-04-26T18:32:08.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.382+0000 7f282ea38700 1 -- 172.21.15.80:0/3772997123 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f282806c5a0 con 0x7f28281025b0 2024-04-26T18:32:08.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.383+0000 7f28257fa700 1 -- 172.21.15.80:0/3772997123 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f2818013070 con 0x7f28281025b0 2024-04-26T18:32:08.383 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-26T18:32:08.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.385+0000 7f282ea38700 1 -- 172.21.15.80:0/3772997123 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f28100a3c40 msgr2=0x7f28100a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:08.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.385+0000 7f282ea38700 1 --2- 172.21.15.80:0/3772997123 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f28100a3c40 0x7f28100a6100 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2828101fe0 tx=0x7f281c005eb0 comp rx=0 tx=0).stop 2024-04-26T18:32:08.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.385+0000 7f282ea38700 1 -- 172.21.15.80:0/3772997123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28281025b0 msgr2=0x7f282819e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:08.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.385+0000 7f282ea38700 1 --2- 172.21.15.80:0/3772997123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28281025b0 0x7f282819e6b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f281800b580 tx=0x7f28180037c0 comp rx=0 tx=0).stop 2024-04-26T18:32:08.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.385+0000 7f282ea38700 1 -- 172.21.15.80:0/3772997123 shutdown_connections 2024-04-26T18:32:08.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.385+0000 7f282ea38700 1 --2- 172.21.15.80:0/3772997123 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f28100a3c40 0x7f28100a6100 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:08.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.385+0000 7f282ea38700 1 --2- 172.21.15.80:0/3772997123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2828107640 0x7f2828198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:08.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.385+0000 7f282ea38700 1 --2- 172.21.15.80:0/3772997123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28281025b0 0x7f282819e6b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:08.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.385+0000 7f282ea38700 1 --2- 172.21.15.80:0/3772997123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2828102f60 0x7f282819ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:08.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.385+0000 7f282ea38700 1 -- 172.21.15.80:0/3772997123 >> 172.21.15.80:0/3772997123 conn(0x7f28280792f0 msgr2=0x7f28281067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:08.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.385+0000 7f282ea38700 1 -- 172.21.15.80:0/3772997123 shutdown_connections 2024-04-26T18:32:08.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:08.385+0000 7f282ea38700 1 -- 172.21.15.80:0/3772997123 wait complete. 2024-04-26T18:32:08.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:08 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3772997123' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T18:32:08.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:08 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3772997123' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T18:32:08.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:08 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3772997123' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T18:32:09.040 INFO:tasks.cephadm:Adding mds.a on smithi080 2024-04-26T18:32:09.040 INFO:tasks.cephadm:Adding mds.d on smithi080 2024-04-26T18:32:09.040 INFO:tasks.cephadm:Adding mds.g on smithi080 2024-04-26T18:32:09.040 INFO:tasks.cephadm:Adding mds.j on smithi080 2024-04-26T18:32:09.040 INFO:tasks.cephadm:Adding mds.b on smithi082 2024-04-26T18:32:09.040 INFO:tasks.cephadm:Adding mds.e on smithi082 2024-04-26T18:32:09.040 INFO:tasks.cephadm:Adding mds.h on smithi082 2024-04-26T18:32:09.041 INFO:tasks.cephadm:Adding mds.k on smithi082 2024-04-26T18:32:09.041 INFO:tasks.cephadm:Adding mds.c on smithi192 2024-04-26T18:32:09.041 INFO:tasks.cephadm:Adding mds.f on smithi192 2024-04-26T18:32:09.041 INFO:tasks.cephadm:Adding mds.i on smithi192 2024-04-26T18:32:09.041 INFO:tasks.cephadm:Adding mds.l on smithi192 2024-04-26T18:32:09.041 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph orch apply mds all '12;smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l' 2024-04-26T18:32:09.290 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T18:32:09.707 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:09 smithi192 ceph-mon[32842]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:09.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:09 smithi082 ceph-mon[32808]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:09.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:09 smithi080 ceph-mon[29135]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:11.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.051+0000 7f3bf6791700 1 -- 172.21.15.192:0/4279684234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bf0104680 msgr2=0x7f3bf0104ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:11.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.051+0000 7f3bf6791700 1 --2- 172.21.15.192:0/4279684234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bf0104680 0x7f3bf0104ae0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009990 tx=0x7f3be4009ca0 comp rx=0 tx=0).stop 2024-04-26T18:32:11.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.051+0000 7f3bf6791700 1 -- 172.21.15.192:0/4279684234 shutdown_connections 2024-04-26T18:32:11.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.051+0000 7f3bf6791700 1 --2- 172.21.15.192:0/4279684234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bf0105020 0x7f3bf010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:11.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.051+0000 7f3bf6791700 1 --2- 172.21.15.192:0/4279684234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bf0103480 0x7f3bf01038a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:11.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.051+0000 7f3bf6791700 1 --2- 172.21.15.192:0/4279684234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bf0104680 0x7f3bf0104ae0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:11.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.051+0000 7f3bf6791700 1 -- 172.21.15.192:0/4279684234 >> 172.21.15.192:0/4279684234 conn(0x7f3bf00fea20 msgr2=0x7f3bf0100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:11.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.051+0000 7f3bf6791700 1 -- 172.21.15.192:0/4279684234 shutdown_connections 2024-04-26T18:32:11.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.051+0000 7f3bf6791700 1 -- 172.21.15.192:0/4279684234 wait complete. 2024-04-26T18:32:11.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.051+0000 7f3bf6791700 1 Processor -- start 2024-04-26T18:32:11.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.051+0000 7f3bf6791700 1 -- start start 2024-04-26T18:32:11.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.052+0000 7f3bf6791700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bf0103480 0x7f3bf0199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:11.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.052+0000 7f3bf6791700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bf0104680 0x7f3bf0199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:11.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.052+0000 7f3bf6791700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bf0105020 0x7f3bf01a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:11.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.052+0000 7f3bf6791700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf010ef90 con 0x7f3bf0105020 2024-04-26T18:32:11.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.052+0000 7f3bf6791700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf010ee10 con 0x7f3bf0103480 2024-04-26T18:32:11.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.052+0000 7f3bf6791700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf010f110 con 0x7f3bf0104680 2024-04-26T18:32:11.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.052+0000 7f3bef7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bf0104680 0x7f3bf0199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:11.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.052+0000 7f3bef7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bf0104680 0x7f3bf0199b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44186/0 (socket says 172.21.15.192:44186) 2024-04-26T18:32:11.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.052+0000 7f3bef7fe700 1 -- 172.21.15.192:0/3187200660 learned_addr learned my addr 172.21.15.192:0/3187200660 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-04-26T18:32:11.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.052+0000 7f3bf4d2e700 1 --2- 172.21.15.192:0/3187200660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bf0105020 0x7f3bf01a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:11.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.052+0000 7f3bef7fe700 1 -- 172.21.15.192:0/3187200660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bf0103480 msgr2=0x7f3bf0199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:11.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.052+0000 7f3beffff700 1 --2- 172.21.15.192:0/3187200660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bf0103480 0x7f3bf0199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:11.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.052+0000 7f3bef7fe700 1 --2- 172.21.15.192:0/3187200660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bf0103480 0x7f3bf0199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:11.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.052+0000 7f3bef7fe700 1 -- 172.21.15.192:0/3187200660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bf0105020 msgr2=0x7f3bf01a0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:11.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.052+0000 7f3bef7fe700 1 --2- 172.21.15.192:0/3187200660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bf0105020 0x7f3bf01a0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:11.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.052+0000 7f3bef7fe700 1 -- 172.21.15.192:0/3187200660 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf01a12a0 con 0x7f3bf0104680 2024-04-26T18:32:11.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.052+0000 7f3beffff700 1 --2- 172.21.15.192:0/3187200660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bf0103480 0x7f3bf0199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:32:11.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.052+0000 7f3bef7fe700 1 --2- 172.21.15.192:0/3187200660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bf0104680 0x7f3bf0199b80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3be40036f0 tx=0x7f3be40047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:11.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.053+0000 7f3bed7fa700 1 -- 172.21.15.192:0/3187200660 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be4027070 con 0x7f3bf0104680 2024-04-26T18:32:11.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.053+0000 7f3bf6791700 1 -- 172.21.15.192:0/3187200660 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bf01a1530 con 0x7f3bf0104680 2024-04-26T18:32:11.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.053+0000 7f3bed7fa700 1 -- 172.21.15.192:0/3187200660 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3be4004100 con 0x7f3bf0104680 2024-04-26T18:32:11.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.053+0000 7f3bed7fa700 1 -- 172.21.15.192:0/3187200660 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be4022d10 con 0x7f3bf0104680 2024-04-26T18:32:11.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.053+0000 7f3bf6791700 1 -- 172.21.15.192:0/3187200660 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bf01a1980 con 0x7f3bf0104680 2024-04-26T18:32:11.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.054+0000 7f3bf6791700 1 -- 172.21.15.192:0/3187200660 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bf006a110 con 0x7f3bf0104680 2024-04-26T18:32:11.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.055+0000 7f3bed7fa700 1 -- 172.21.15.192:0/3187200660 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f3be402a070 con 0x7f3bf0104680 2024-04-26T18:32:11.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.055+0000 7f3bed7fa700 1 --2- 172.21.15.192:0/3187200660 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f3bd80a3c40 0x7f3bd80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:11.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.055+0000 7f3bed7fa700 1 -- 172.21.15.192:0/3187200660 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f3be40d0f50 con 0x7f3bf0104680 2024-04-26T18:32:11.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.055+0000 7f3beffff700 1 --2- 172.21.15.192:0/3187200660 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f3bd80a3c40 0x7f3bd80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:11.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.056+0000 7f3beffff700 1 --2- 172.21.15.192:0/3187200660 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f3bd80a3c40 0x7f3bd80a6100 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3bf01044e0 tx=0x7f3be0008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:11.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.060+0000 7f3bed7fa700 1 -- 172.21.15.192:0/3187200660 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3be405eff0 con 0x7f3bf0104680 2024-04-26T18:32:11.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.267+0000 7f3bf6791700 1 -- 172.21.15.192:0/3187200660 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l", "target": ["mon-mgr", ""]}) -- 0x7f3bf0063b20 con 0x7f3bd80a3c40 2024-04-26T18:32:11.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.275+0000 7f3bed7fa700 1 -- 172.21.15.192:0/3187200660 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f3bf0063b20 con 0x7f3bd80a3c40 2024-04-26T18:32:11.275 INFO:teuthology.orchestra.run.smithi192.stdout:Scheduled mds.all update... 2024-04-26T18:32:11.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.277+0000 7f3bf6791700 1 -- 172.21.15.192:0/3187200660 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f3bd80a3c40 msgr2=0x7f3bd80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:11.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.277+0000 7f3bf6791700 1 --2- 172.21.15.192:0/3187200660 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f3bd80a3c40 0x7f3bd80a6100 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3bf01044e0 tx=0x7f3be0008040 comp rx=0 tx=0).stop 2024-04-26T18:32:11.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.277+0000 7f3bf6791700 1 -- 172.21.15.192:0/3187200660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bf0104680 msgr2=0x7f3bf0199b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:11.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.277+0000 7f3bf6791700 1 --2- 172.21.15.192:0/3187200660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bf0104680 0x7f3bf0199b80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3be40036f0 tx=0x7f3be40047b0 comp rx=0 tx=0).stop 2024-04-26T18:32:11.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.278+0000 7f3bf6791700 1 -- 172.21.15.192:0/3187200660 shutdown_connections 2024-04-26T18:32:11.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.278+0000 7f3bf6791700 1 --2- 172.21.15.192:0/3187200660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bf0105020 0x7f3bf01a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:11.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.278+0000 7f3bf6791700 1 --2- 172.21.15.192:0/3187200660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bf0103480 0x7f3bf0199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:11.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.278+0000 7f3bf6791700 1 --2- 172.21.15.192:0/3187200660 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f3bd80a3c40 0x7f3bd80a6100 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:11.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.278+0000 7f3bf6791700 1 --2- 172.21.15.192:0/3187200660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bf0104680 0x7f3bf0199b80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:11.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.278+0000 7f3bf6791700 1 -- 172.21.15.192:0/3187200660 >> 172.21.15.192:0/3187200660 conn(0x7f3bf00fea20 msgr2=0x7f3bf0107ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:11.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.278+0000 7f3bf6791700 1 -- 172.21.15.192:0/3187200660 shutdown_connections 2024-04-26T18:32:11.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T18:32:11.278+0000 7f3bf6791700 1 -- 172.21.15.192:0/3187200660 wait complete. 2024-04-26T18:32:11.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:11 smithi192 ceph-mon[32842]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:11.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:11.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:32:11.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:11 smithi082 ceph-mon[32808]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:11.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:11.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:32:11.981 DEBUG:teuthology.orchestra.run.smithi080:mds.a> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.a.service 2024-04-26T18:32:11.983 DEBUG:teuthology.orchestra.run.smithi080:mds.d> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.d.service 2024-04-26T18:32:11.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:11 smithi080 ceph-mon[29135]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:11.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:11.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:32:11.994 DEBUG:teuthology.orchestra.run.smithi080:mds.g> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.g.service 2024-04-26T18:32:12.037 DEBUG:teuthology.orchestra.run.smithi080:mds.j> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.j.service 2024-04-26T18:32:12.080 DEBUG:teuthology.orchestra.run.smithi082:mds.b> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.b.service 2024-04-26T18:32:12.082 DEBUG:teuthology.orchestra.run.smithi082:mds.e> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.e.service 2024-04-26T18:32:12.125 DEBUG:teuthology.orchestra.run.smithi082:mds.h> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.h.service 2024-04-26T18:32:12.168 DEBUG:teuthology.orchestra.run.smithi082:mds.k> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.k.service 2024-04-26T18:32:12.211 DEBUG:teuthology.orchestra.run.smithi192:mds.c> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.c.service 2024-04-26T18:32:12.214 DEBUG:teuthology.orchestra.run.smithi192:mds.f> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.f.service 2024-04-26T18:32:12.256 DEBUG:teuthology.orchestra.run.smithi192:mds.i> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.i.service 2024-04-26T18:32:12.299 DEBUG:teuthology.orchestra.run.smithi192:mds.l> sudo journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.l.service 2024-04-26T18:32:12.343 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-04-26T18:32:12.344 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:32:12.578 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:32:12.700 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:12 smithi080 ceph-mon[29135]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:32:12.700 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:12 smithi080 ceph-mon[29135]: Saving service mds.all spec with placement smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l;count:12 2024-04-26T18:32:12.700 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:12 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:12.700 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:12 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:32:12.700 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:12 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:12.700 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:12 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:12.700 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:12 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:12.700 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:12 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:12.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:12 smithi192 ceph-mon[32842]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:32:12.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:12 smithi192 ceph-mon[32842]: Saving service mds.all spec with placement smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l;count:12 2024-04-26T18:32:12.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:12 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:12.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:12 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:32:12.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:12 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:12.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:12 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:12.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:12 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:12.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:12 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:12.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:12 smithi082 ceph-mon[32808]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:32:12.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:12 smithi082 ceph-mon[32808]: Saving service mds.all spec with placement smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l;count:12 2024-04-26T18:32:12.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:12 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:12.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:12 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:32:12.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:12 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:12.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:12 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:12.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:12 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:12.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:12 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:13.836 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:13 smithi192 ceph-mon[32842]: Deploying daemon mds.l on smithi192 2024-04-26T18:32:13.836 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:13 smithi192 ceph-mon[32842]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:13.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:13 smithi082 ceph-mon[32808]: Deploying daemon mds.l on smithi192 2024-04-26T18:32:13.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:13 smithi082 ceph-mon[32808]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:13.976 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:13 smithi080 ceph-mon[29135]: Deploying daemon mds.l on smithi192 2024-04-26T18:32:13.976 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:13 smithi080 ceph-mon[29135]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:14.112 INFO:journalctl@ceph.mds.l.smithi192.stdout:Apr 26 18:32:14 smithi192 systemd[1]: Starting Ceph mds.l for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:32:14.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.373+0000 7f472a139700 1 -- 172.21.15.80:0/2642714296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f472406c510 msgr2=0x7f47241102e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.373+0000 7f472a139700 1 --2- 172.21.15.80:0/2642714296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f472406c510 0x7f47241102e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f471c00b0a0 tx=0x7f471c00b3b0 comp rx=0 tx=0).stop 2024-04-26T18:32:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.373+0000 7f472a139700 1 -- 172.21.15.80:0/2642714296 shutdown_connections 2024-04-26T18:32:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.373+0000 7f472a139700 1 --2- 172.21.15.80:0/2642714296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f472406c510 0x7f47241102e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.373+0000 7f472a139700 1 --2- 172.21.15.80:0/2642714296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47241094a0 0x7f4724109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.373+0000 7f472a139700 1 --2- 172.21.15.80:0/2642714296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f472406bb70 0x7f472406bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.373+0000 7f472a139700 1 -- 172.21.15.80:0/2642714296 >> 172.21.15.80:0/2642714296 conn(0x7f47240792f0 msgr2=0x7f4724079700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.373+0000 7f472a139700 1 -- 172.21.15.80:0/2642714296 shutdown_connections 2024-04-26T18:32:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.373+0000 7f472a139700 1 -- 172.21.15.80:0/2642714296 wait complete. 2024-04-26T18:32:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.373+0000 7f472a139700 1 Processor -- start 2024-04-26T18:32:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.373+0000 7f472a139700 1 -- start start 2024-04-26T18:32:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.374+0000 7f472a139700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f472406bb70 0x7f4724102420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.374+0000 7f472a139700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f472406c510 0x7f4724102960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.374+0000 7f472a139700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47241094a0 0x7f4724102ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.374+0000 7f472a139700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f47241135c0 con 0x7f47241094a0 2024-04-26T18:32:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.374+0000 7f472a139700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4724113440 con 0x7f472406bb70 2024-04-26T18:32:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.374+0000 7f472a139700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4724113740 con 0x7f472406c510 2024-04-26T18:32:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.374+0000 7f4723fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47241094a0 0x7f4724102ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.374+0000 7f4723fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47241094a0 0x7f4724102ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51372/0 (socket says 172.21.15.80:51372) 2024-04-26T18:32:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.374+0000 7f4723fff700 1 -- 172.21.15.80:0/3408678828 learned_addr learned my addr 172.21.15.80:0/3408678828 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:32:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.374+0000 7f4722ffd700 1 --2- 172.21.15.80:0/3408678828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f472406c510 0x7f4724102960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.374+0000 7f47237fe700 1 --2- 172.21.15.80:0/3408678828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f472406bb70 0x7f4724102420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.374+0000 7f4723fff700 1 -- 172.21.15.80:0/3408678828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f472406c510 msgr2=0x7f4724102960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.374+0000 7f4723fff700 1 --2- 172.21.15.80:0/3408678828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f472406c510 0x7f4724102960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.374+0000 7f4723fff700 1 -- 172.21.15.80:0/3408678828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f472406bb70 msgr2=0x7f4724102420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:14.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.374+0000 7f4723fff700 1 --2- 172.21.15.80:0/3408678828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f472406bb70 0x7f4724102420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:14.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.374+0000 7f4723fff700 1 -- 172.21.15.80:0/3408678828 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47241a8000 con 0x7f47241094a0 2024-04-26T18:32:14.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.374+0000 7f47237fe700 1 --2- 172.21.15.80:0/3408678828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f472406bb70 0x7f4724102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:32:14.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.374+0000 7f4723fff700 1 --2- 172.21.15.80:0/3408678828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47241094a0 0x7f4724102ea0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f471c0062a0 tx=0x7f471c004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:14.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.374+0000 7f4720ff9700 1 -- 172.21.15.80:0/3408678828 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471c021070 con 0x7f47241094a0 2024-04-26T18:32:14.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.374+0000 7f4720ff9700 1 -- 172.21.15.80:0/3408678828 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f471c007e30 con 0x7f47241094a0 2024-04-26T18:32:14.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.374+0000 7f472a139700 1 -- 172.21.15.80:0/3408678828 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47241a8290 con 0x7f47241094a0 2024-04-26T18:32:14.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.374+0000 7f4720ff9700 1 -- 172.21.15.80:0/3408678828 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471c004780 con 0x7f47241094a0 2024-04-26T18:32:14.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.374+0000 7f472a139700 1 -- 172.21.15.80:0/3408678828 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47241a8740 con 0x7f47241094a0 2024-04-26T18:32:14.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.375+0000 7f472a139700 1 -- 172.21.15.80:0/3408678828 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f472406a110 con 0x7f47241094a0 2024-04-26T18:32:14.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.376+0000 7f4720ff9700 1 -- 172.21.15.80:0/3408678828 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f471c007980 con 0x7f47241094a0 2024-04-26T18:32:14.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.377+0000 7f4720ff9700 1 --2- 172.21.15.80:0/3408678828 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f470c0a3c40 0x7f470c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:14.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.377+0000 7f47237fe700 1 --2- 172.21.15.80:0/3408678828 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f470c0a3c40 0x7f470c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:14.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.377+0000 7f4720ff9700 1 -- 172.21.15.80:0/3408678828 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f471c00f020 con 0x7f47241094a0 2024-04-26T18:32:14.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.377+0000 7f47237fe700 1 --2- 172.21.15.80:0/3408678828 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f470c0a3c40 0x7f470c0a6100 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4714009bc0 tx=0x7f4714009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:14.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.382+0000 7f4720ff9700 1 -- 172.21.15.80:0/3408678828 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f471c02a020 con 0x7f47241094a0 2024-04-26T18:32:14.571 INFO:journalctl@ceph.mds.l.smithi192.stdout:Apr 26 18:32:14 smithi192 podman[62328]: 2024-04-26 18:32:14.135998743 +0000 UTC m=+0.018061074 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:32:14.571 INFO:journalctl@ceph.mds.l.smithi192.stdout:Apr 26 18:32:14 smithi192 podman[62328]: 2024-04-26 18:32:14.28270006 +0000 UTC m=+0.164762430 container create ffca76a06a7cf7d0330cee0e4f5b6c48edab412108669860d406bf12ddef6c8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-l, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-04-26T18:32:14.571 INFO:journalctl@ceph.mds.l.smithi192.stdout:Apr 26 18:32:14 smithi192 podman[62328]: 2024-04-26 18:32:14.571572458 +0000 UTC m=+0.453634785 container init ffca76a06a7cf7d0330cee0e4f5b6c48edab412108669860d406bf12ddef6c8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-l, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True) 2024-04-26T18:32:14.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.631+0000 7f472a139700 1 -- 172.21.15.80:0/3408678828 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f472402e650 con 0x7f47241094a0 2024-04-26T18:32:14.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.631+0000 7f4720ff9700 1 -- 172.21.15.80:0/3408678828 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7f471c09e310 con 0x7f47241094a0 2024-04-26T18:32:14.631 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:32:14.631 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24379,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T18:32:14.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.633+0000 7f472a139700 1 -- 172.21.15.80:0/3408678828 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f470c0a3c40 msgr2=0x7f470c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:14.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.633+0000 7f472a139700 1 --2- 172.21.15.80:0/3408678828 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f470c0a3c40 0x7f470c0a6100 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4714009bc0 tx=0x7f4714009260 comp rx=0 tx=0).stop 2024-04-26T18:32:14.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.633+0000 7f472a139700 1 -- 172.21.15.80:0/3408678828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47241094a0 msgr2=0x7f4724102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:14.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.633+0000 7f472a139700 1 --2- 172.21.15.80:0/3408678828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47241094a0 0x7f4724102ea0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f471c0062a0 tx=0x7f471c004c80 comp rx=0 tx=0).stop 2024-04-26T18:32:14.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.633+0000 7f472a139700 1 -- 172.21.15.80:0/3408678828 shutdown_connections 2024-04-26T18:32:14.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.633+0000 7f472a139700 1 --2- 172.21.15.80:0/3408678828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47241094a0 0x7f4724102ea0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:14.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.633+0000 7f472a139700 1 --2- 172.21.15.80:0/3408678828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f472406bb70 0x7f4724102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:14.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.633+0000 7f472a139700 1 --2- 172.21.15.80:0/3408678828 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f470c0a3c40 0x7f470c0a6100 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:14.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.633+0000 7f472a139700 1 --2- 172.21.15.80:0/3408678828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f472406c510 0x7f4724102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:14.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.633+0000 7f472a139700 1 -- 172.21.15.80:0/3408678828 >> 172.21.15.80:0/3408678828 conn(0x7f47240792f0 msgr2=0x7f47241004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:14.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.633+0000 7f472a139700 1 -- 172.21.15.80:0/3408678828 shutdown_connections 2024-04-26T18:32:14.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:14.633+0000 7f472a139700 1 -- 172.21.15.80:0/3408678828 wait complete. 2024-04-26T18:32:14.634 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 2 2024-04-26T18:32:14.862 INFO:journalctl@ceph.mds.l.smithi192.stdout:Apr 26 18:32:14 smithi192 podman[62328]: 2024-04-26 18:32:14.574306694 +0000 UTC m=+0.456369027 container start ffca76a06a7cf7d0330cee0e4f5b6c48edab412108669860d406bf12ddef6c8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=) 2024-04-26T18:32:14.862 INFO:journalctl@ceph.mds.l.smithi192.stdout:Apr 26 18:32:14 smithi192 ceph-mds[62347]: -- 172.21.15.192:0/3671283509 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b6b7073a40 con 0x55b6b7046c00 2024-04-26T18:32:14.862 INFO:journalctl@ceph.mds.l.smithi192.stdout:Apr 26 18:32:14 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-l[62343]: starting mds.l at 2024-04-26T18:32:14.862 INFO:journalctl@ceph.mds.l.smithi192.stdout:Apr 26 18:32:14 smithi192 bash[62328]: ffca76a06a7cf7d0330cee0e4f5b6c48edab412108669860d406bf12ddef6c8f 2024-04-26T18:32:14.863 INFO:journalctl@ceph.mds.l.smithi192.stdout:Apr 26 18:32:14 smithi192 systemd[1]: Started Ceph mds.l for 2187ca98-03fa-11ef-bc93-c7b262605968. 2024-04-26T18:32:15.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:15 smithi082 ceph-mon[32808]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:15.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:15 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.192:6832/2905926211,v1:172.21.15.192:6833/2905926211] up:boot 2024-04-26T18:32:15.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:15 smithi082 ceph-mon[32808]: fsmap 1 up:standby 2024-04-26T18:32:15.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:15 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T18:32:15.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:15 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3408678828' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:15.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:15 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:15.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:15 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:15.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:15 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:15.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:15 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:15.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:15 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:15.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:15 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:15.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:15 smithi080 ceph-mon[29135]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:15.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:15 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.192:6832/2905926211,v1:172.21.15.192:6833/2905926211] up:boot 2024-04-26T18:32:15.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:15 smithi080 ceph-mon[29135]: fsmap 1 up:standby 2024-04-26T18:32:15.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:15 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T18:32:15.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:15 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3408678828' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:15.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:15 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:15.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:15 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:15.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:15 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:15.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:15 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:15.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:15 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:15.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:15 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:15.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:15 smithi192 ceph-mon[32842]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:15.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:15 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.192:6832/2905926211,v1:172.21.15.192:6833/2905926211] up:boot 2024-04-26T18:32:15.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:15 smithi192 ceph-mon[32842]: fsmap 1 up:standby 2024-04-26T18:32:15.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:15 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T18:32:15.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:15 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3408678828' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:15.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:15 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:15.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:15 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:15.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:15 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:15.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:15 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:15.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:15 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:15.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:15 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:16.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:16 smithi082 ceph-mon[32808]: Deploying daemon mds.k on smithi082 2024-04-26T18:32:16.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:16 smithi080 ceph-mon[29135]: Deploying daemon mds.k on smithi082 2024-04-26T18:32:17.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:16 smithi192 ceph-mon[32842]: Deploying daemon mds.k on smithi082 2024-04-26T18:32:17.390 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 26 18:32:17 smithi082 systemd[1]: Starting Ceph mds.k for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:32:17.395 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:32:17.639 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:32:17.651 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:17 smithi082 ceph-mon[32808]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:17.652 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 26 18:32:17 smithi082 podman[62564]: 2024-04-26 18:32:17.390446139 +0000 UTC m=+0.112513198 container create b9baf38284bf1bf4d1ed6bb73e1665abcf9cfdb23c0d5242d01fdac10ed09336 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True) 2024-04-26T18:32:17.652 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 26 18:32:17 smithi082 podman[62564]: 2024-04-26 18:32:17.295897109 +0000 UTC m=+0.017964193 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:32:17.652 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 26 18:32:17 smithi082 podman[62564]: 2024-04-26 18:32:17.626464173 +0000 UTC m=+0.348531235 container init b9baf38284bf1bf4d1ed6bb73e1665abcf9cfdb23c0d5242d01fdac10ed09336 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-k, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-26T18:32:17.652 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 26 18:32:17 smithi082 podman[62564]: 2024-04-26 18:32:17.629290669 +0000 UTC m=+0.351357743 container start b9baf38284bf1bf4d1ed6bb73e1665abcf9cfdb23c0d5242d01fdac10ed09336 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-k, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.schema-version=1.0) 2024-04-26T18:32:17.652 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 26 18:32:17 smithi082 ceph-mds[62583]: -- 172.21.15.82:0/1777714620 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f4baed7a40 con 0x55f4baeaac00 2024-04-26T18:32:17.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:17 smithi080 ceph-mon[29135]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:17.969 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 26 18:32:17 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-k[62579]: starting mds.k at 2024-04-26T18:32:17.970 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 26 18:32:17 smithi082 bash[62564]: b9baf38284bf1bf4d1ed6bb73e1665abcf9cfdb23c0d5242d01fdac10ed09336 2024-04-26T18:32:17.970 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 26 18:32:17 smithi082 systemd[1]: Started Ceph mds.k for 2187ca98-03fa-11ef-bc93-c7b262605968. 2024-04-26T18:32:18.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:17 smithi192 ceph-mon[32842]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:19.045 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:19.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:19.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:19.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:19.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:19.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:19.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:18 smithi080 ceph-mon[29135]: Deploying daemon mds.j on smithi080 2024-04-26T18:32:19.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:18 smithi080 ceph-mon[29135]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:19.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:18 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.82:6832/3564539039,v1:172.21.15.82:6833/3564539039] up:boot 2024-04-26T18:32:19.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:18 smithi080 ceph-mon[29135]: fsmap 2 up:standby 2024-04-26T18:32:19.046 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:18 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T18:32:19.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:18 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:19.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:18 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:19.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:18 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:19.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:18 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:19.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:18 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:19.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:18 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:19.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:18 smithi192 ceph-mon[32842]: Deploying daemon mds.j on smithi080 2024-04-26T18:32:19.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:18 smithi192 ceph-mon[32842]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:19.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:18 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.82:6832/3564539039,v1:172.21.15.82:6833/3564539039] up:boot 2024-04-26T18:32:19.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:18 smithi192 ceph-mon[32842]: fsmap 2 up:standby 2024-04-26T18:32:19.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:18 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T18:32:19.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:18 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:19.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:18 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:19.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:18 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:19.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:18 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:19.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:18 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:19.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:18 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:19.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:18 smithi082 ceph-mon[32808]: Deploying daemon mds.j on smithi080 2024-04-26T18:32:19.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:18 smithi082 ceph-mon[32808]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:19.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:18 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.82:6832/3564539039,v1:172.21.15.82:6833/3564539039] up:boot 2024-04-26T18:32:19.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:18 smithi082 ceph-mon[32808]: fsmap 2 up:standby 2024-04-26T18:32:19.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:18 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T18:32:20.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.087+0000 7fb7a81dd700 1 -- 172.21.15.80:0/102564671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a01094a0 msgr2=0x7fb7a0109880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:20.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.087+0000 7fb7a81dd700 1 --2- 172.21.15.80:0/102564671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a01094a0 0x7fb7a0109880 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb79c009990 tx=0x7fb79c009ca0 comp rx=0 tx=0).stop 2024-04-26T18:32:20.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.087+0000 7fb7a81dd700 1 -- 172.21.15.80:0/102564671 shutdown_connections 2024-04-26T18:32:20.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.087+0000 7fb7a81dd700 1 --2- 172.21.15.80:0/102564671 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a006c510 0x7fb7a01102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:20.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.087+0000 7fb7a81dd700 1 --2- 172.21.15.80:0/102564671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a01094a0 0x7fb7a0109880 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:20.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.087+0000 7fb7a81dd700 1 --2- 172.21.15.80:0/102564671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7a006bb70 0x7fb7a006bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:20.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.087+0000 7fb7a81dd700 1 -- 172.21.15.80:0/102564671 >> 172.21.15.80:0/102564671 conn(0x7fb7a00792f0 msgr2=0x7fb7a0079700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:20.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.087+0000 7fb7a81dd700 1 -- 172.21.15.80:0/102564671 shutdown_connections 2024-04-26T18:32:20.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.087+0000 7fb7a81dd700 1 -- 172.21.15.80:0/102564671 wait complete. 2024-04-26T18:32:20.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.088+0000 7fb7a81dd700 1 Processor -- start 2024-04-26T18:32:20.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.088+0000 7fb7a81dd700 1 -- start start 2024-04-26T18:32:20.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.088+0000 7fb7a81dd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a006bb70 0x7fb7a019f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:20.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.088+0000 7fb7a81dd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7a006c510 0x7fb7a019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:20.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.088+0000 7fb7a81dd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a01094a0 0x7fb7a0199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:20.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.088+0000 7fb7a81dd700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a0113610 con 0x7fb7a01094a0 2024-04-26T18:32:20.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.088+0000 7fb7a81dd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a0113490 con 0x7fb7a006c510 2024-04-26T18:32:20.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.088+0000 7fb7a81dd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a0113790 con 0x7fb7a006bb70 2024-04-26T18:32:20.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.088+0000 7fb7a677a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a01094a0 0x7fb7a0199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:20.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.088+0000 7fb7a5778700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7a006c510 0x7fb7a019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:20.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.088+0000 7fb7a677a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a01094a0 0x7fb7a0199950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51384/0 (socket says 172.21.15.80:51384) 2024-04-26T18:32:20.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.088+0000 7fb7a677a700 1 -- 172.21.15.80:0/1071070299 learned_addr learned my addr 172.21.15.80:0/1071070299 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:32:20.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.088+0000 7fb7a5f79700 1 --2- 172.21.15.80:0/1071070299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a006bb70 0x7fb7a019f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:20.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.089+0000 7fb7a677a700 1 -- 172.21.15.80:0/1071070299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a006bb70 msgr2=0x7fb7a019f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:20.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.089+0000 7fb7a677a700 1 --2- 172.21.15.80:0/1071070299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a006bb70 0x7fb7a019f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:20.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.089+0000 7fb7a677a700 1 -- 172.21.15.80:0/1071070299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7a006c510 msgr2=0x7fb7a019fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:20.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.089+0000 7fb7a677a700 1 --2- 172.21.15.80:0/1071070299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7a006c510 0x7fb7a019fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:20.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.089+0000 7fb7a677a700 1 -- 172.21.15.80:0/1071070299 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a019a0b0 con 0x7fb7a01094a0 2024-04-26T18:32:20.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.089+0000 7fb7a5f79700 1 --2- 172.21.15.80:0/1071070299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a006bb70 0x7fb7a019f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:32:20.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.089+0000 7fb7a677a700 1 --2- 172.21.15.80:0/1071070299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a01094a0 0x7fb7a0199950 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb79800b970 tx=0x7fb79800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:20.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.089+0000 7fb796ffd700 1 -- 172.21.15.80:0/1071070299 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb798019070 con 0x7fb7a01094a0 2024-04-26T18:32:20.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.089+0000 7fb796ffd700 1 -- 172.21.15.80:0/1071070299 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb79800cde0 con 0x7fb7a01094a0 2024-04-26T18:32:20.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.089+0000 7fb7a81dd700 1 -- 172.21.15.80:0/1071070299 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a019a3a0 con 0x7fb7a01094a0 2024-04-26T18:32:20.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.089+0000 7fb796ffd700 1 -- 172.21.15.80:0/1071070299 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb798007370 con 0x7fb7a01094a0 2024-04-26T18:32:20.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.089+0000 7fb7a81dd700 1 -- 172.21.15.80:0/1071070299 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a01a6660 con 0x7fb7a01094a0 2024-04-26T18:32:20.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.090+0000 7fb7a81dd700 1 -- 172.21.15.80:0/1071070299 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7a006a110 con 0x7fb7a01094a0 2024-04-26T18:32:20.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.091+0000 7fb796ffd700 1 -- 172.21.15.80:0/1071070299 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fb79801c070 con 0x7fb7a01094a0 2024-04-26T18:32:20.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.092+0000 7fb796ffd700 1 --2- 172.21.15.80:0/1071070299 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb78c0a3c40 0x7fb78c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:20.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.092+0000 7fb7a5f79700 1 --2- 172.21.15.80:0/1071070299 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb78c0a3c40 0x7fb78c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:20.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.092+0000 7fb796ffd700 1 -- 172.21.15.80:0/1071070299 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fb7980cfbb0 con 0x7fb7a01094a0 2024-04-26T18:32:20.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.092+0000 7fb7a5f79700 1 --2- 172.21.15.80:0/1071070299 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb78c0a3c40 0x7fb78c0a6100 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb79c000c00 tx=0x7fb79c005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:20.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.096+0000 7fb796ffd700 1 -- 172.21.15.80:0/1071070299 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb798023070 con 0x7fb7a01094a0 2024-04-26T18:32:20.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.348+0000 7fb7a81dd700 1 -- 172.21.15.80:0/1071070299 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7a019ae80 con 0x7fb7a01094a0 2024-04-26T18:32:20.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.349+0000 7fb796ffd700 1 -- 172.21.15.80:0/1071070299 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2221 (secure 0 0 0) 0x7fb79809ca10 con 0x7fb7a01094a0 2024-04-26T18:32:20.350 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:32:20.350 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24371,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3564539039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3564539039},{"type":"v1","addr":"172.21.15.82:6833","nonce":3564539039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24379,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T18:32:20.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.351+0000 7fb7a81dd700 1 -- 172.21.15.80:0/1071070299 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb78c0a3c40 msgr2=0x7fb78c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:20.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.351+0000 7fb7a81dd700 1 --2- 172.21.15.80:0/1071070299 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb78c0a3c40 0x7fb78c0a6100 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb79c000c00 tx=0x7fb79c005fb0 comp rx=0 tx=0).stop 2024-04-26T18:32:20.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.351+0000 7fb7a81dd700 1 -- 172.21.15.80:0/1071070299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a01094a0 msgr2=0x7fb7a0199950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:20.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.351+0000 7fb7a81dd700 1 --2- 172.21.15.80:0/1071070299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a01094a0 0x7fb7a0199950 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb79800b970 tx=0x7fb79800bc80 comp rx=0 tx=0).stop 2024-04-26T18:32:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.351+0000 7fb7a81dd700 1 -- 172.21.15.80:0/1071070299 shutdown_connections 2024-04-26T18:32:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.351+0000 7fb7a81dd700 1 --2- 172.21.15.80:0/1071070299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a01094a0 0x7fb7a0199950 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.351+0000 7fb7a81dd700 1 --2- 172.21.15.80:0/1071070299 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb78c0a3c40 0x7fb78c0a6100 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.351+0000 7fb7a81dd700 1 --2- 172.21.15.80:0/1071070299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a006bb70 0x7fb7a019f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.351+0000 7fb7a81dd700 1 --2- 172.21.15.80:0/1071070299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7a006c510 0x7fb7a019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.351+0000 7fb7a81dd700 1 -- 172.21.15.80:0/1071070299 >> 172.21.15.80:0/1071070299 conn(0x7fb7a00792f0 msgr2=0x7fb7a0100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.351+0000 7fb7a81dd700 1 -- 172.21.15.80:0/1071070299 shutdown_connections 2024-04-26T18:32:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:20.351+0000 7fb7a81dd700 1 -- 172.21.15.80:0/1071070299 wait complete. 2024-04-26T18:32:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 3 2024-04-26T18:32:20.626 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:20 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1071070299' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:20.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:20 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1071070299' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:20.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:20 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1071070299' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:21.243 INFO:journalctl@ceph.mds.j.smithi080.stdout:Apr 26 18:32:21 smithi080 systemd[1]: Starting Ceph mds.j for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:32:21.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:21 smithi082 ceph-mon[32808]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:21.734 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:21 smithi080 ceph-mon[29135]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:21.734 INFO:journalctl@ceph.mds.j.smithi080.stdout:Apr 26 18:32:21 smithi080 podman[67303]: 2024-04-26 18:32:21.49184667 +0000 UTC m=+0.018092918 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:32:21.734 INFO:journalctl@ceph.mds.j.smithi080.stdout:Apr 26 18:32:21 smithi080 podman[67303]: 2024-04-26 18:32:21.625501347 +0000 UTC m=+0.151747581 container create 74b184685213e3aaabdbbabc8e4c0bf037a23271a66c61e7a4c7bf0d4fd87177 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424) 2024-04-26T18:32:21.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:21 smithi192 ceph-mon[32842]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:21.986 INFO:journalctl@ceph.mds.j.smithi080.stdout:Apr 26 18:32:21 smithi080 podman[67303]: 2024-04-26 18:32:21.886808415 +0000 UTC m=+0.413054649 container init 74b184685213e3aaabdbbabc8e4c0bf037a23271a66c61e7a4c7bf0d4fd87177 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-26T18:32:21.986 INFO:journalctl@ceph.mds.j.smithi080.stdout:Apr 26 18:32:21 smithi080 podman[67303]: 2024-04-26 18:32:21.889304147 +0000 UTC m=+0.415550385 container start 74b184685213e3aaabdbbabc8e4c0bf037a23271a66c61e7a4c7bf0d4fd87177 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-j, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD) 2024-04-26T18:32:21.987 INFO:journalctl@ceph.mds.j.smithi080.stdout:Apr 26 18:32:21 smithi080 ceph-mds[67323]: -- 172.21.15.80:0/187307204 <== mon.0 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560055275a40 con 0x560055248c00 2024-04-26T18:32:21.987 INFO:journalctl@ceph.mds.j.smithi080.stdout:Apr 26 18:32:21 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-j[67319]: starting mds.j at 2024-04-26T18:32:21.987 INFO:journalctl@ceph.mds.j.smithi080.stdout:Apr 26 18:32:21 smithi080 bash[67303]: 74b184685213e3aaabdbbabc8e4c0bf037a23271a66c61e7a4c7bf0d4fd87177 2024-04-26T18:32:22.243 INFO:journalctl@ceph.mds.j.smithi080.stdout:Apr 26 18:32:21 smithi080 systemd[1]: Started Ceph mds.j for 2187ca98-03fa-11ef-bc93-c7b262605968. 2024-04-26T18:32:23.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:23 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:23.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:23 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:23.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:23 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:23.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:23 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:23.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:23 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:23.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:23 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:23.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:23 smithi192 ceph-mon[32842]: Deploying daemon mds.d on smithi080 2024-04-26T18:32:23.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:23 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.80:6834/1967550873,v1:172.21.15.80:6835/1967550873] up:boot 2024-04-26T18:32:23.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:23 smithi192 ceph-mon[32842]: fsmap 3 up:standby 2024-04-26T18:32:23.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:23 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T18:32:23.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:23 smithi192 ceph-mon[32842]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:23.428 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:32:23.452 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:23 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:23.452 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:23 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:23.452 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:23 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:23.452 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:23 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:23.452 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:23 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:23.452 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:23 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:23.452 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:23 smithi080 ceph-mon[29135]: Deploying daemon mds.d on smithi080 2024-04-26T18:32:23.452 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:23 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.80:6834/1967550873,v1:172.21.15.80:6835/1967550873] up:boot 2024-04-26T18:32:23.452 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:23 smithi080 ceph-mon[29135]: fsmap 3 up:standby 2024-04-26T18:32:23.453 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:23 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T18:32:23.453 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:23 smithi080 ceph-mon[29135]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:23.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:23 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:23.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:23 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:23.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:23 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:23.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:23 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:23.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:23 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:23.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:23 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:23.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:23 smithi082 ceph-mon[32808]: Deploying daemon mds.d on smithi080 2024-04-26T18:32:23.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:23 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.80:6834/1967550873,v1:172.21.15.80:6835/1967550873] up:boot 2024-04-26T18:32:23.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:23 smithi082 ceph-mon[32808]: fsmap 3 up:standby 2024-04-26T18:32:23.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:23 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T18:32:23.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:23 smithi082 ceph-mon[32808]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:23.908 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:32:25.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.744+0000 7ff2ffc5e700 1 -- 172.21.15.80:0/2939295519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2f81034d0 msgr2=0x7ff2f8103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:25.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.744+0000 7ff2ffc5e700 1 --2- 172.21.15.80:0/2939295519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2f81034d0 0x7ff2f8103950 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40099c0 tx=0x7ff2f4009cd0 comp rx=0 tx=0).stop 2024-04-26T18:32:25.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.744+0000 7ff2ffc5e700 1 -- 172.21.15.80:0/2939295519 shutdown_connections 2024-04-26T18:32:25.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.744+0000 7ff2ffc5e700 1 --2- 172.21.15.80:0/2939295519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2f8103e90 0x7ff2f8110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:25.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.744+0000 7ff2ffc5e700 1 --2- 172.21.15.80:0/2939295519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f81083b0 0x7ff2f8108790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:25.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.744+0000 7ff2ffc5e700 1 --2- 172.21.15.80:0/2939295519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2f81034d0 0x7ff2f8103950 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:25.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.744+0000 7ff2ffc5e700 1 -- 172.21.15.80:0/2939295519 >> 172.21.15.80:0/2939295519 conn(0x7ff2f807a580 msgr2=0x7ff2f807a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:25.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.744+0000 7ff2ffc5e700 1 -- 172.21.15.80:0/2939295519 shutdown_connections 2024-04-26T18:32:25.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.744+0000 7ff2ffc5e700 1 -- 172.21.15.80:0/2939295519 wait complete. 2024-04-26T18:32:25.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.745+0000 7ff2ffc5e700 1 Processor -- start 2024-04-26T18:32:25.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.745+0000 7ff2ffc5e700 1 -- start start 2024-04-26T18:32:25.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.745+0000 7ff2ffc5e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2f81034d0 0x7ff2f819f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:25.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.745+0000 7ff2ffc5e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2f8103e90 0x7ff2f819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:25.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.745+0000 7ff2ffc5e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f81083b0 0x7ff2f81999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:25.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.745+0000 7ff2ffc5e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f81136a0 con 0x7ff2f8103e90 2024-04-26T18:32:25.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.745+0000 7ff2ffc5e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f8113520 con 0x7ff2f81083b0 2024-04-26T18:32:25.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.745+0000 7ff2ffc5e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f8113820 con 0x7ff2f81034d0 2024-04-26T18:32:25.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.745+0000 7ff2fd1f9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2f8103e90 0x7ff2f819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:25.769 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:25 smithi080 ceph-mon[29135]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:25.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.746+0000 7ff2fd1f9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2f8103e90 0x7ff2f819fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48068/0 (socket says 172.21.15.80:48068) 2024-04-26T18:32:25.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.746+0000 7ff2fd1f9700 1 -- 172.21.15.80:0/2848277520 learned_addr learned my addr 172.21.15.80:0/2848277520 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:32:25.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.746+0000 7ff2fe1fb700 1 --2- 172.21.15.80:0/2848277520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f81083b0 0x7ff2f81999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:25.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.746+0000 7ff2fd9fa700 1 --2- 172.21.15.80:0/2848277520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2f81034d0 0x7ff2f819f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:25.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.746+0000 7ff2fd1f9700 1 -- 172.21.15.80:0/2848277520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2f81034d0 msgr2=0x7ff2f819f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:25.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.746+0000 7ff2fd1f9700 1 --2- 172.21.15.80:0/2848277520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2f81034d0 0x7ff2f819f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:25.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.746+0000 7ff2fd1f9700 1 -- 172.21.15.80:0/2848277520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f81083b0 msgr2=0x7ff2f81999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:25.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.746+0000 7ff2fd1f9700 1 --2- 172.21.15.80:0/2848277520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f81083b0 0x7ff2f81999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:25.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.746+0000 7ff2fd1f9700 1 -- 172.21.15.80:0/2848277520 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f819a100 con 0x7ff2f8103e90 2024-04-26T18:32:25.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.746+0000 7ff2fd9fa700 1 --2- 172.21.15.80:0/2848277520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2f81034d0 0x7ff2f819f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:32:25.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.746+0000 7ff2fd1f9700 1 --2- 172.21.15.80:0/2848277520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2f8103e90 0x7ff2f819fd20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400b580 tx=0x7ff2f40047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:25.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.746+0000 7ff2eeffd700 1 -- 172.21.15.80:0/2848277520 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4027070 con 0x7ff2f8103e90 2024-04-26T18:32:25.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.746+0000 7ff2eeffd700 1 -- 172.21.15.80:0/2848277520 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2f4004020 con 0x7ff2f8103e90 2024-04-26T18:32:25.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.746+0000 7ff2ffc5e700 1 -- 172.21.15.80:0/2848277520 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f819a390 con 0x7ff2f8103e90 2024-04-26T18:32:25.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.746+0000 7ff2eeffd700 1 -- 172.21.15.80:0/2848277520 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4022e30 con 0x7ff2f8103e90 2024-04-26T18:32:25.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.746+0000 7ff2ffc5e700 1 -- 172.21.15.80:0/2848277520 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f81a66b0 con 0x7ff2f8103e90 2024-04-26T18:32:25.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.747+0000 7ff2ffc5e700 1 -- 172.21.15.80:0/2848277520 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2f8104b90 con 0x7ff2f8103e90 2024-04-26T18:32:25.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.749+0000 7ff2eeffd700 1 -- 172.21.15.80:0/2848277520 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7ff2f4022590 con 0x7ff2f8103e90 2024-04-26T18:32:25.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.749+0000 7ff2eeffd700 1 --2- 172.21.15.80:0/2848277520 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff2e40a3c40 0x7ff2e40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:25.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.749+0000 7ff2fd9fa700 1 --2- 172.21.15.80:0/2848277520 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff2e40a3c40 0x7ff2e40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:25.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.749+0000 7ff2eeffd700 1 -- 172.21.15.80:0/2848277520 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7ff2f40d1090 con 0x7ff2f8103e90 2024-04-26T18:32:25.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.750+0000 7ff2fd9fa700 1 --2- 172.21.15.80:0/2848277520 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff2e40a3c40 0x7ff2e40a6100 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8005fd0 tx=0x7ff2e8005f00 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:25.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:25.753+0000 7ff2eeffd700 1 -- 172.21.15.80:0/2848277520 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff2f4030070 con 0x7ff2f8103e90 2024-04-26T18:32:25.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:25 smithi192 ceph-mon[32842]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:25.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:25 smithi082 ceph-mon[32808]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:26.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:26.010+0000 7ff2ffc5e700 1 -- 172.21.15.80:0/2848277520 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2f802e490 con 0x7ff2f8103e90 2024-04-26T18:32:26.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:26.011+0000 7ff2eeffd700 1 -- 172.21.15.80:0/2848277520 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3046 (secure 0 0 0) 0x7ff2f4013070 con 0x7ff2f8103e90 2024-04-26T18:32:26.011 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:32:26.011 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1967550873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1967550873},{"type":"v1","addr":"172.21.15.80:6835","nonce":1967550873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24371,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3564539039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3564539039},{"type":"v1","addr":"172.21.15.82:6833","nonce":3564539039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24379,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T18:32:26.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:26.013+0000 7ff2ffc5e700 1 -- 172.21.15.80:0/2848277520 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff2e40a3c40 msgr2=0x7ff2e40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:26.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:26.013+0000 7ff2ffc5e700 1 --2- 172.21.15.80:0/2848277520 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff2e40a3c40 0x7ff2e40a6100 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8005fd0 tx=0x7ff2e8005f00 comp rx=0 tx=0).stop 2024-04-26T18:32:26.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:26.013+0000 7ff2ffc5e700 1 -- 172.21.15.80:0/2848277520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2f8103e90 msgr2=0x7ff2f819fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:26.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:26.013+0000 7ff2ffc5e700 1 --2- 172.21.15.80:0/2848277520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2f8103e90 0x7ff2f819fd20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400b580 tx=0x7ff2f40047b0 comp rx=0 tx=0).stop 2024-04-26T18:32:26.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:26.013+0000 7ff2ffc5e700 1 -- 172.21.15.80:0/2848277520 shutdown_connections 2024-04-26T18:32:26.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:26.013+0000 7ff2ffc5e700 1 --2- 172.21.15.80:0/2848277520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f81083b0 0x7ff2f81999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:26.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:26.013+0000 7ff2ffc5e700 1 --2- 172.21.15.80:0/2848277520 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff2e40a3c40 0x7ff2e40a6100 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:26.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:26.013+0000 7ff2ffc5e700 1 --2- 172.21.15.80:0/2848277520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2f81034d0 0x7ff2f819f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:26.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:26.014+0000 7ff2ffc5e700 1 --2- 172.21.15.80:0/2848277520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2f8103e90 0x7ff2f819fd20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:26.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:26.014+0000 7ff2ffc5e700 1 -- 172.21.15.80:0/2848277520 >> 172.21.15.80:0/2848277520 conn(0x7ff2f807a580 msgr2=0x7ff2f8101620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:26.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:26.014+0000 7ff2ffc5e700 1 -- 172.21.15.80:0/2848277520 shutdown_connections 2024-04-26T18:32:26.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:26.014+0000 7ff2ffc5e700 1 -- 172.21.15.80:0/2848277520 wait complete. 2024-04-26T18:32:26.015 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 4 2024-04-26T18:32:26.714 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:26 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2848277520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:26.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:26 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/2848277520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:26.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:26 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/2848277520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:26.993 INFO:journalctl@ceph.mds.d.smithi080.stdout:Apr 26 18:32:26 smithi080 systemd[1]: Started Ceph mds.d for 2187ca98-03fa-11ef-bc93-c7b262605968. 2024-04-26T18:32:27.822 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:27 smithi082 ceph-mon[32808]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:27.822 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:27 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.80:6836/559541830,v1:172.21.15.80:6837/559541830] up:boot 2024-04-26T18:32:27.823 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:27 smithi082 ceph-mon[32808]: fsmap 4 up:standby 2024-04-26T18:32:27.823 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:27 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T18:32:27.823 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:27 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:27.823 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:27 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:27.823 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:27 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:27.823 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:27 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:27.823 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:27 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:27.823 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:27 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:27.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:27 smithi192 ceph-mon[32842]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:27.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:27 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.80:6836/559541830,v1:172.21.15.80:6837/559541830] up:boot 2024-04-26T18:32:27.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:27 smithi192 ceph-mon[32842]: fsmap 4 up:standby 2024-04-26T18:32:27.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:27 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T18:32:27.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:27 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:27.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:27 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:27.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:27 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:27.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:27 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:27.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:27 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:27.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:27 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:27.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:27 smithi080 ceph-mon[29135]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:27.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:27 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.80:6836/559541830,v1:172.21.15.80:6837/559541830] up:boot 2024-04-26T18:32:27.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:27 smithi080 ceph-mon[29135]: fsmap 4 up:standby 2024-04-26T18:32:27.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T18:32:27.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:27.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:27.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:27.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:27.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:27.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:27 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:28.829 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:32:28.856 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:28 smithi080 ceph-mon[29135]: Deploying daemon mds.e on smithi082 2024-04-26T18:32:28.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:28 smithi192 ceph-mon[32842]: Deploying daemon mds.e on smithi082 2024-04-26T18:32:28.884 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:28 smithi082 ceph-mon[32808]: Deploying daemon mds.e on smithi082 2024-04-26T18:32:29.079 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:32:29.568 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 26 18:32:29 smithi082 podman[62880]: 2024-04-26 18:32:29.495367592 +0000 UTC m=+0.129489937 container create 3558e8b965d56d0aa1916720075d01a87a8f94e6d3ac4417babbd97cad69ec89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-e, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-26T18:32:29.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:29 smithi080 ceph-mon[29135]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:29.847 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:29 smithi082 ceph-mon[32808]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:29.848 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 26 18:32:29 smithi082 podman[62880]: 2024-04-26 18:32:29.739643615 +0000 UTC m=+0.373765968 container init 3558e8b965d56d0aa1916720075d01a87a8f94e6d3ac4417babbd97cad69ec89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-e, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-26T18:32:29.848 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 26 18:32:29 smithi082 podman[62880]: 2024-04-26 18:32:29.742176514 +0000 UTC m=+0.376298856 container start 3558e8b965d56d0aa1916720075d01a87a8f94e6d3ac4417babbd97cad69ec89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-e, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T18:32:29.848 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 26 18:32:29 smithi082 ceph-mds[62899]: -- 172.21.15.82:0/1245700622 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5564d9189a40 con 0x5564d915cc00 2024-04-26T18:32:29.848 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 26 18:32:29 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-e[62895]: starting mds.e at 2024-04-26T18:32:29.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:29 smithi192 ceph-mon[32842]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:30.219 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 26 18:32:29 smithi082 bash[62880]: 3558e8b965d56d0aa1916720075d01a87a8f94e6d3ac4417babbd97cad69ec89 2024-04-26T18:32:30.220 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 26 18:32:29 smithi082 systemd[1]: Started Ceph mds.e for 2187ca98-03fa-11ef-bc93-c7b262605968. 2024-04-26T18:32:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.738+0000 7f8ce4f21700 1 -- 172.21.15.80:0/346223795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ce0103e30 msgr2=0x7f8ce0110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.738+0000 7f8ce4f21700 1 --2- 172.21.15.80:0/346223795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ce0103e30 0x7f8ce0110290 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800b0a0 tx=0x7f8cd800b3b0 comp rx=0 tx=0).stop 2024-04-26T18:32:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.738+0000 7f8ce4f21700 1 -- 172.21.15.80:0/346223795 shutdown_connections 2024-04-26T18:32:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.738+0000 7f8ce4f21700 1 --2- 172.21.15.80:0/346223795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ce0103e30 0x7f8ce0110290 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.738+0000 7f8ce4f21700 1 --2- 172.21.15.80:0/346223795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ce01094c0 0x7f8ce01098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.738+0000 7f8ce4f21700 1 --2- 172.21.15.80:0/346223795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ce0103470 0x7f8ce01038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.738+0000 7f8ce4f21700 1 -- 172.21.15.80:0/346223795 >> 172.21.15.80:0/346223795 conn(0x7f8ce007a580 msgr2=0x7f8ce007a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.738+0000 7f8ce4f21700 1 -- 172.21.15.80:0/346223795 shutdown_connections 2024-04-26T18:32:30.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.738+0000 7f8ce4f21700 1 -- 172.21.15.80:0/346223795 wait complete. 2024-04-26T18:32:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.739+0000 7f8ce4f21700 1 Processor -- start 2024-04-26T18:32:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.739+0000 7f8ce4f21700 1 -- start start 2024-04-26T18:32:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.740+0000 7f8ce4f21700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ce0103470 0x7f8ce019f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.740+0000 7f8ce4f21700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ce0103e30 0x7f8ce019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.740+0000 7f8ce4f21700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ce01094c0 0x7f8ce01999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.740+0000 7f8ce4f21700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce01136c0 con 0x7f8ce0103e30 2024-04-26T18:32:30.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.740+0000 7f8ce4f21700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce0113540 con 0x7f8ce01094c0 2024-04-26T18:32:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.740+0000 7f8ce4f21700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce0113840 con 0x7f8ce0103470 2024-04-26T18:32:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.740+0000 7f8cddd9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ce0103e30 0x7f8ce019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.740+0000 7f8cddd9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ce0103e30 0x7f8ce019fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48094/0 (socket says 172.21.15.80:48094) 2024-04-26T18:32:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.740+0000 7f8cddd9b700 1 -- 172.21.15.80:0/3471426469 learned_addr learned my addr 172.21.15.80:0/3471426469 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:32:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.740+0000 7f8cddd9b700 1 -- 172.21.15.80:0/3471426469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ce0103470 msgr2=0x7f8ce019f7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T18:32:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.740+0000 7f8cddd9b700 1 --2- 172.21.15.80:0/3471426469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ce0103470 0x7f8ce019f7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.740+0000 7f8cded9d700 1 --2- 172.21.15.80:0/3471426469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ce01094c0 0x7f8ce01999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.740+0000 7f8cddd9b700 1 -- 172.21.15.80:0/3471426469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ce01094c0 msgr2=0x7f8ce01999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.740+0000 7f8cddd9b700 1 --2- 172.21.15.80:0/3471426469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ce01094c0 0x7f8ce01999a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.740+0000 7f8cddd9b700 1 -- 172.21.15.80:0/3471426469 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce019a100 con 0x7f8ce0103e30 2024-04-26T18:32:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.740+0000 7f8cddd9b700 1 --2- 172.21.15.80:0/3471426469 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ce0103e30 0x7f8ce019fd20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000d980 tx=0x7f8cd000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.740+0000 7f8ccf7fe700 1 -- 172.21.15.80:0/3471426469 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0017070 con 0x7f8ce0103e30 2024-04-26T18:32:30.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.740+0000 7f8ccf7fe700 1 -- 172.21.15.80:0/3471426469 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cd0004830 con 0x7f8ce0103e30 2024-04-26T18:32:30.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.740+0000 7f8ce4f21700 1 -- 172.21.15.80:0/3471426469 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce019a3f0 con 0x7f8ce0103e30 2024-04-26T18:32:30.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.740+0000 7f8ccf7fe700 1 -- 172.21.15.80:0/3471426469 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0005440 con 0x7f8ce0103e30 2024-04-26T18:32:30.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.740+0000 7f8ce4f21700 1 -- 172.21.15.80:0/3471426469 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce01a66b0 con 0x7f8ce0103e30 2024-04-26T18:32:30.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.741+0000 7f8ce4f21700 1 -- 172.21.15.80:0/3471426469 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ce010b930 con 0x7f8ce0103e30 2024-04-26T18:32:30.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.743+0000 7f8ccf7fe700 1 -- 172.21.15.80:0/3471426469 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f8cd00055e0 con 0x7f8ce0103e30 2024-04-26T18:32:30.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.743+0000 7f8ccf7fe700 1 --2- 172.21.15.80:0/3471426469 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8cc80a3cc0 0x7f8cc80a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:30.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.743+0000 7f8cde59c700 1 --2- 172.21.15.80:0/3471426469 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8cc80a3cc0 0x7f8cc80a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:30.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.744+0000 7f8ccf7fe700 1 -- 172.21.15.80:0/3471426469 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f8cd00cfe50 con 0x7f8ce0103e30 2024-04-26T18:32:30.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.744+0000 7f8cde59c700 1 --2- 172.21.15.80:0/3471426469 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8cc80a3cc0 0x7f8cc80a6180 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8ce019aae0 tx=0x7f8cd4006cb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:30.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.748+0000 7f8ccf7fe700 1 -- 172.21.15.80:0/3471426469 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8cd0020020 con 0x7f8ce0103e30 2024-04-26T18:32:30.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.998+0000 7f8ce4f21700 1 -- 172.21.15.80:0/3471426469 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ce006a110 con 0x7f8ce0103e30 2024-04-26T18:32:30.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:30.999+0000 7f8ccf7fe700 1 -- 172.21.15.80:0/3471426469 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4690 (secure 0 0 0) 0x7f8cd009ccd0 con 0x7f8ce0103e30 2024-04-26T18:32:30.999 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:32:30.999 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1967550873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1967550873},{"type":"v1","addr":"172.21.15.80:6835","nonce":1967550873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/559541830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":559541830},{"type":"v1","addr":"172.21.15.80:6837","nonce":559541830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24371,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3564539039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3564539039},{"type":"v1","addr":"172.21.15.82:6833","nonce":3564539039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24379,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24392,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/572065563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":572065563},{"type":"v1","addr":"172.21.15.82:6835","nonce":572065563}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-04-26T18:32:31.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:31.001+0000 7f8ce4f21700 1 -- 172.21.15.80:0/3471426469 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8cc80a3cc0 msgr2=0x7f8cc80a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:31.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:31.001+0000 7f8ce4f21700 1 --2- 172.21.15.80:0/3471426469 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8cc80a3cc0 0x7f8cc80a6180 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8ce019aae0 tx=0x7f8cd4006cb0 comp rx=0 tx=0).stop 2024-04-26T18:32:31.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:31.001+0000 7f8ce4f21700 1 -- 172.21.15.80:0/3471426469 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ce0103e30 msgr2=0x7f8ce019fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:31.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:31.001+0000 7f8ce4f21700 1 --2- 172.21.15.80:0/3471426469 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ce0103e30 0x7f8ce019fd20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000d980 tx=0x7f8cd000dd40 comp rx=0 tx=0).stop 2024-04-26T18:32:31.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:31.001+0000 7f8ce4f21700 1 -- 172.21.15.80:0/3471426469 shutdown_connections 2024-04-26T18:32:31.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:31.001+0000 7f8ce4f21700 1 --2- 172.21.15.80:0/3471426469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ce01094c0 0x7f8ce01999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:31.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:31.001+0000 7f8ce4f21700 1 --2- 172.21.15.80:0/3471426469 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8cc80a3cc0 0x7f8cc80a6180 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:31.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:31.001+0000 7f8ce4f21700 1 --2- 172.21.15.80:0/3471426469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ce0103470 0x7f8ce019f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:31.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:31.001+0000 7f8ce4f21700 1 --2- 172.21.15.80:0/3471426469 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ce0103e30 0x7f8ce019fd20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:31.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:31.001+0000 7f8ce4f21700 1 -- 172.21.15.80:0/3471426469 >> 172.21.15.80:0/3471426469 conn(0x7f8ce007a580 msgr2=0x7f8ce0102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:31.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:31.001+0000 7f8ce4f21700 1 -- 172.21.15.80:0/3471426469 shutdown_connections 2024-04-26T18:32:31.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:31.001+0000 7f8ce4f21700 1 -- 172.21.15.80:0/3471426469 wait complete. 2024-04-26T18:32:31.002 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 6 2024-04-26T18:32:31.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:30 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:31.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:30 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:31.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:30 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:31.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:30 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:31.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:30 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:31.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:30 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:31.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:30 smithi192 ceph-mon[32842]: Deploying daemon mds.f on smithi192 2024-04-26T18:32:31.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:30 smithi192 ceph-mon[32842]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:31.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:30 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.82:6834/572065563,v1:172.21.15.82:6835/572065563] up:boot 2024-04-26T18:32:31.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:30 smithi192 ceph-mon[32842]: fsmap 5 up:standby 2024-04-26T18:32:31.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:30 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T18:32:31.209 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:30 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:31.209 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:30 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:31.210 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:30 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:31.210 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:30 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:31.210 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:30 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:31.210 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:30 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:31.210 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:30 smithi080 ceph-mon[29135]: Deploying daemon mds.f on smithi192 2024-04-26T18:32:31.210 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:30 smithi080 ceph-mon[29135]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:31.210 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:30 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.82:6834/572065563,v1:172.21.15.82:6835/572065563] up:boot 2024-04-26T18:32:31.210 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:30 smithi080 ceph-mon[29135]: fsmap 5 up:standby 2024-04-26T18:32:31.210 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:30 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T18:32:31.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:30 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:31.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:30 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:31.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:30 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:31.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:30 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:31.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:30 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:31.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:30 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:31.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:30 smithi082 ceph-mon[32808]: Deploying daemon mds.f on smithi192 2024-04-26T18:32:31.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:30 smithi082 ceph-mon[32808]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:31.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:30 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.82:6834/572065563,v1:172.21.15.82:6835/572065563] up:boot 2024-04-26T18:32:31.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:30 smithi082 ceph-mon[32808]: fsmap 5 up:standby 2024-04-26T18:32:31.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:30 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T18:32:32.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:31 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3471426469' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:32.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:31 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3471426469' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:32.318 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:31 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3471426469' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:32.318 INFO:journalctl@ceph.mds.f.smithi192.stdout:Apr 26 18:32:32 smithi192 systemd[1]: Starting Ceph mds.f for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:32:32.613 INFO:journalctl@ceph.mds.f.smithi192.stdout:Apr 26 18:32:32 smithi192 podman[62634]: 2024-04-26 18:32:32.221005389 +0000 UTC m=+0.017572441 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:32:32.613 INFO:journalctl@ceph.mds.f.smithi192.stdout:Apr 26 18:32:32 smithi192 podman[62634]: 2024-04-26 18:32:32.362115697 +0000 UTC m=+0.158682740 container create 0c5011581cc1a04ecf17795feedf9147066e7b873942121bfec2e92c23fcb662 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-f, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5) 2024-04-26T18:32:32.944 INFO:journalctl@ceph.mds.f.smithi192.stdout:Apr 26 18:32:32 smithi192 podman[62634]: 2024-04-26 18:32:32.615332341 +0000 UTC m=+0.411899384 container init 0c5011581cc1a04ecf17795feedf9147066e7b873942121bfec2e92c23fcb662 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-f, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-26T18:32:32.944 INFO:journalctl@ceph.mds.f.smithi192.stdout:Apr 26 18:32:32 smithi192 podman[62634]: 2024-04-26 18:32:32.618754917 +0000 UTC m=+0.415321961 container start 0c5011581cc1a04ecf17795feedf9147066e7b873942121bfec2e92c23fcb662 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-f, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5) 2024-04-26T18:32:32.944 INFO:journalctl@ceph.mds.f.smithi192.stdout:Apr 26 18:32:32 smithi192 ceph-mds[62660]: -- 172.21.15.192:0/3945766435 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555f236f3a40 con 0x555f236c6c00 2024-04-26T18:32:32.944 INFO:journalctl@ceph.mds.f.smithi192.stdout:Apr 26 18:32:32 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-f[62651]: starting mds.f at 2024-04-26T18:32:32.944 INFO:journalctl@ceph.mds.f.smithi192.stdout:Apr 26 18:32:32 smithi192 bash[62634]: 0c5011581cc1a04ecf17795feedf9147066e7b873942121bfec2e92c23fcb662 2024-04-26T18:32:32.945 INFO:journalctl@ceph.mds.f.smithi192.stdout:Apr 26 18:32:32 smithi192 systemd[1]: Started Ceph mds.f for 2187ca98-03fa-11ef-bc93-c7b262605968. 2024-04-26T18:32:33.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:32 smithi082 ceph-mon[32808]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:33.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:32 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:33.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:32 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:33.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:32 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:33.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:32 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:33.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:32 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:33.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:32 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:33.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:32 smithi080 ceph-mon[29135]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:33.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:32 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:33.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:32 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:33.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:32 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:33.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:32 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:33.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:32 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:33.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:32 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:33.325 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:32 smithi192 ceph-mon[32842]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:33.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:32 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:33.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:32 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:33.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:32 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:33.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:32 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:33.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:32 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:33.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:32 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:33.670 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:32:33.917 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:32:33.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:33 smithi080 ceph-mon[29135]: Deploying daemon mds.c on smithi192 2024-04-26T18:32:33.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:33 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] up:boot 2024-04-26T18:32:33.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:33 smithi080 ceph-mon[29135]: fsmap 6 up:standby 2024-04-26T18:32:33.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:33 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T18:32:34.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:33 smithi082 ceph-mon[32808]: Deploying daemon mds.c on smithi192 2024-04-26T18:32:34.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:33 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] up:boot 2024-04-26T18:32:34.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:33 smithi082 ceph-mon[32808]: fsmap 6 up:standby 2024-04-26T18:32:34.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:33 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T18:32:34.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:33 smithi192 ceph-mon[32842]: Deploying daemon mds.c on smithi192 2024-04-26T18:32:34.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:33 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] up:boot 2024-04-26T18:32:34.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:33 smithi192 ceph-mon[32842]: fsmap 6 up:standby 2024-04-26T18:32:34.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:33 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T18:32:35.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:34 smithi192 ceph-mon[32842]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:35.113 INFO:journalctl@ceph.mds.c.smithi192.stdout:Apr 26 18:32:34 smithi192 systemd[1]: Starting Ceph mds.c for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:32:35.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:34 smithi082 ceph-mon[32808]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:35.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:34 smithi080 ceph-mon[29135]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:35.487 INFO:journalctl@ceph.mds.c.smithi192.stdout:Apr 26 18:32:35 smithi192 podman[62952]: 2024-04-26 18:32:35.090241294 +0000 UTC m=+0.018366230 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:32:35.487 INFO:journalctl@ceph.mds.c.smithi192.stdout:Apr 26 18:32:35 smithi192 podman[62952]: 2024-04-26 18:32:35.226087638 +0000 UTC m=+0.154212560 container create 23af43080fd68406273a76118cb1d4afa69dd2bf92ee98167143acb212d49b6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T18:32:35.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.606+0000 7f095e0da700 1 -- 172.21.15.80:0/3508660163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0958103470 msgr2=0x7f09581038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:35.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.606+0000 7f095e0da700 1 --2- 172.21.15.80:0/3508660163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0958103470 0x7f09581038f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0948009990 tx=0x7f0948009ca0 comp rx=0 tx=0).stop 2024-04-26T18:32:35.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.606+0000 7f095e0da700 1 -- 172.21.15.80:0/3508660163 shutdown_connections 2024-04-26T18:32:35.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.606+0000 7f095e0da700 1 --2- 172.21.15.80:0/3508660163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0958103e30 0x7f0958110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:35.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.606+0000 7f095e0da700 1 --2- 172.21.15.80:0/3508660163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09581094c0 0x7f09581098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:35.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.606+0000 7f095e0da700 1 --2- 172.21.15.80:0/3508660163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0958103470 0x7f09581038f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:35.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.606+0000 7f095e0da700 1 -- 172.21.15.80:0/3508660163 >> 172.21.15.80:0/3508660163 conn(0x7f095807a580 msgr2=0x7f095807a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:35.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.606+0000 7f095e0da700 1 -- 172.21.15.80:0/3508660163 shutdown_connections 2024-04-26T18:32:35.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.606+0000 7f095e0da700 1 -- 172.21.15.80:0/3508660163 wait complete. 2024-04-26T18:32:35.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.607+0000 7f095e0da700 1 Processor -- start 2024-04-26T18:32:35.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.607+0000 7f095e0da700 1 -- start start 2024-04-26T18:32:35.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.607+0000 7f095e0da700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0958103470 0x7f095819f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:35.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.607+0000 7f095e0da700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0958103e30 0x7f095819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:35.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.607+0000 7f095e0da700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09581094c0 0x7f0958199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:35.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.607+0000 7f095e0da700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f09581135f0 con 0x7f0958103470 2024-04-26T18:32:35.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.607+0000 7f095e0da700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0958113470 con 0x7f09581094c0 2024-04-26T18:32:35.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.607+0000 7f095e0da700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0958113770 con 0x7f0958103e30 2024-04-26T18:32:35.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.608+0000 7f09577fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0958103470 0x7f095819f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:35.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.608+0000 7f0956ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0958103e30 0x7f095819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:35.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.608+0000 7f0956ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0958103e30 0x7f095819fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.80:47726/0 (socket says 172.21.15.80:47726) 2024-04-26T18:32:35.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.608+0000 7f0956ffd700 1 -- 172.21.15.80:0/3537454361 learned_addr learned my addr 172.21.15.80:0/3537454361 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:32:35.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.608+0000 7f09577fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0958103470 0x7f095819f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42222/0 (socket says 172.21.15.80:42222) 2024-04-26T18:32:35.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.608+0000 7f09577fe700 1 -- 172.21.15.80:0/3537454361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0958103e30 msgr2=0x7f095819fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:35.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.608+0000 7f0957fff700 1 --2- 172.21.15.80:0/3537454361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09581094c0 0x7f0958199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:35.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.608+0000 7f09577fe700 1 --2- 172.21.15.80:0/3537454361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0958103e30 0x7f095819fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:35.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.608+0000 7f09577fe700 1 -- 172.21.15.80:0/3537454361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09581094c0 msgr2=0x7f0958199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:35.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.608+0000 7f09577fe700 1 --2- 172.21.15.80:0/3537454361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09581094c0 0x7f0958199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:35.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.608+0000 7f09577fe700 1 -- 172.21.15.80:0/3537454361 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0958199ff0 con 0x7f0958103470 2024-04-26T18:32:35.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.608+0000 7f0956ffd700 1 --2- 172.21.15.80:0/3537454361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0958103e30 0x7f095819fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:32:35.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.608+0000 7f0957fff700 1 --2- 172.21.15.80:0/3537454361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09581094c0 0x7f0958199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:32:35.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.608+0000 7f09577fe700 1 --2- 172.21.15.80:0/3537454361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0958103470 0x7f095819f6d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f094c00c970 tx=0x7f094c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:35.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.608+0000 7f0954ff9700 1 -- 172.21.15.80:0/3537454361 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094c014070 con 0x7f0958103470 2024-04-26T18:32:35.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.608+0000 7f095e0da700 1 -- 172.21.15.80:0/3537454361 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f095819a2e0 con 0x7f0958103470 2024-04-26T18:32:35.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.608+0000 7f0954ff9700 1 -- 172.21.15.80:0/3537454361 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f094c004440 con 0x7f0958103470 2024-04-26T18:32:35.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.608+0000 7f0954ff9700 1 -- 172.21.15.80:0/3537454361 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094c003b40 con 0x7f0958103470 2024-04-26T18:32:35.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.608+0000 7f095e0da700 1 -- 172.21.15.80:0/3537454361 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09581a65a0 con 0x7f0958103470 2024-04-26T18:32:35.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.609+0000 7f095e0da700 1 -- 172.21.15.80:0/3537454361 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f095810b930 con 0x7f0958103470 2024-04-26T18:32:35.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.610+0000 7f0954ff9700 1 -- 172.21.15.80:0/3537454361 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f094c017070 con 0x7f0958103470 2024-04-26T18:32:35.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.611+0000 7f0954ff9700 1 --2- 172.21.15.80:0/3537454361 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f09400a3c40 0x7f09400a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:35.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.611+0000 7f0956ffd700 1 --2- 172.21.15.80:0/3537454361 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f09400a3c40 0x7f09400a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:35.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.611+0000 7f0954ff9700 1 -- 172.21.15.80:0/3537454361 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f094c0d0080 con 0x7f0958103470 2024-04-26T18:32:35.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.611+0000 7f0956ffd700 1 --2- 172.21.15.80:0/3537454361 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f09400a3c40 0x7f09400a6100 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0948009750 tx=0x7f094801a040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:35.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.615+0000 7f0954ff9700 1 -- 172.21.15.80:0/3537454361 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f094c01e020 con 0x7f0958103470 2024-04-26T18:32:35.862 INFO:journalctl@ceph.mds.c.smithi192.stdout:Apr 26 18:32:35 smithi192 podman[62952]: 2024-04-26 18:32:35.487304282 +0000 UTC m=+0.415429204 container init 23af43080fd68406273a76118cb1d4afa69dd2bf92ee98167143acb212d49b6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-c, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-04-26T18:32:35.862 INFO:journalctl@ceph.mds.c.smithi192.stdout:Apr 26 18:32:35 smithi192 podman[62952]: 2024-04-26 18:32:35.490520726 +0000 UTC m=+0.418645659 container start 23af43080fd68406273a76118cb1d4afa69dd2bf92ee98167143acb212d49b6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-c, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-26T18:32:35.863 INFO:journalctl@ceph.mds.c.smithi192.stdout:Apr 26 18:32:35 smithi192 ceph-mds[62971]: -- 172.21.15.192:0/1121114488 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5590bfb1ba40 con 0x5590bfaeec00 2024-04-26T18:32:35.863 INFO:journalctl@ceph.mds.c.smithi192.stdout:Apr 26 18:32:35 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-c[62967]: starting mds.c at 2024-04-26T18:32:35.863 INFO:journalctl@ceph.mds.c.smithi192.stdout:Apr 26 18:32:35 smithi192 bash[62952]: 23af43080fd68406273a76118cb1d4afa69dd2bf92ee98167143acb212d49b6f 2024-04-26T18:32:35.863 INFO:journalctl@ceph.mds.c.smithi192.stdout:Apr 26 18:32:35 smithi192 systemd[1]: Started Ceph mds.c for 2187ca98-03fa-11ef-bc93-c7b262605968. 2024-04-26T18:32:35.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.865+0000 7f095e0da700 1 -- 172.21.15.80:0/3537454361 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f095806a110 con 0x7f0958103470 2024-04-26T18:32:35.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.866+0000 7f0954ff9700 1 -- 172.21.15.80:0/3537454361 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5515 (secure 0 0 0) 0x7f094c09ce60 con 0x7f0958103470 2024-04-26T18:32:35.866 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:32:35.866 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1967550873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1967550873},{"type":"v1","addr":"172.21.15.80:6835","nonce":1967550873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/559541830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":559541830},{"type":"v1","addr":"172.21.15.80:6837","nonce":559541830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24371,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3564539039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3564539039},{"type":"v1","addr":"172.21.15.82:6833","nonce":3564539039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24379,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24392,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/572065563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":572065563},{"type":"v1","addr":"172.21.15.82:6835","nonce":572065563}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24394,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/719058020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":719058020},{"type":"v1","addr":"172.21.15.192:6835","nonce":719058020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-04-26T18:32:35.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.868+0000 7f095e0da700 1 -- 172.21.15.80:0/3537454361 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f09400a3c40 msgr2=0x7f09400a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:35.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.868+0000 7f095e0da700 1 --2- 172.21.15.80:0/3537454361 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f09400a3c40 0x7f09400a6100 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0948009750 tx=0x7f094801a040 comp rx=0 tx=0).stop 2024-04-26T18:32:35.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.868+0000 7f095e0da700 1 -- 172.21.15.80:0/3537454361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0958103470 msgr2=0x7f095819f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:35.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.868+0000 7f095e0da700 1 --2- 172.21.15.80:0/3537454361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0958103470 0x7f095819f6d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f094c00c970 tx=0x7f094c00cc80 comp rx=0 tx=0).stop 2024-04-26T18:32:35.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.868+0000 7f095e0da700 1 -- 172.21.15.80:0/3537454361 shutdown_connections 2024-04-26T18:32:35.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.868+0000 7f095e0da700 1 --2- 172.21.15.80:0/3537454361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09581094c0 0x7f0958199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:35.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.868+0000 7f095e0da700 1 --2- 172.21.15.80:0/3537454361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0958103470 0x7f095819f6d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:35.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.868+0000 7f095e0da700 1 --2- 172.21.15.80:0/3537454361 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f09400a3c40 0x7f09400a6100 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:35.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.868+0000 7f095e0da700 1 --2- 172.21.15.80:0/3537454361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0958103e30 0x7f095819fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:35.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.868+0000 7f095e0da700 1 -- 172.21.15.80:0/3537454361 >> 172.21.15.80:0/3537454361 conn(0x7f095807a580 msgr2=0x7f0958102120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:35.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.868+0000 7f095e0da700 1 -- 172.21.15.80:0/3537454361 shutdown_connections 2024-04-26T18:32:35.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:35.868+0000 7f095e0da700 1 -- 172.21.15.80:0/3537454361 wait complete. 2024-04-26T18:32:35.870 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 7 2024-04-26T18:32:36.709 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:36 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:36.709 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:36 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:36.709 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:36 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:36.709 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:36 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:36.709 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:36 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:36.709 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:36 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:36.709 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:36 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3537454361' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:36.709 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:36 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] up:boot 2024-04-26T18:32:36.710 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:36 smithi082 ceph-mon[32808]: fsmap 7 up:standby 2024-04-26T18:32:36.710 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:36 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T18:32:36.790 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:36 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:36.790 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:36 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:36.791 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:36 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:36.791 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:36 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:36.791 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:36 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:36.791 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:36 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:36.791 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:36 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3537454361' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:36.791 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:36 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] up:boot 2024-04-26T18:32:36.791 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:36 smithi080 ceph-mon[29135]: fsmap 7 up:standby 2024-04-26T18:32:36.791 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:36 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T18:32:37.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:36 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:37.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:36 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:37.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:36 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:37.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:36 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:37.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:36 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:37.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:36 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:37.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:36 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3537454361' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:37.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:36 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] up:boot 2024-04-26T18:32:37.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:36 smithi192 ceph-mon[32842]: fsmap 7 up:standby 2024-04-26T18:32:37.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:36 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T18:32:37.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:37 smithi082 ceph-mon[32808]: Deploying daemon mds.h on smithi082 2024-04-26T18:32:37.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:37 smithi082 ceph-mon[32808]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:37.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:37 smithi080 ceph-mon[29135]: Deploying daemon mds.h on smithi082 2024-04-26T18:32:37.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:37 smithi080 ceph-mon[29135]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:38.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:37 smithi192 ceph-mon[32842]: Deploying daemon mds.h on smithi082 2024-04-26T18:32:38.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:37 smithi192 ceph-mon[32842]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:38.220 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 26 18:32:38 smithi082 systemd[1]: Starting Ceph mds.h for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:32:38.523 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:32:38.569 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 26 18:32:38 smithi082 podman[63195]: 2024-04-26 18:32:38.175720232 +0000 UTC m=+0.018130714 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:32:38.569 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 26 18:32:38 smithi082 podman[63195]: 2024-04-26 18:32:38.292165402 +0000 UTC m=+0.134575864 container create 5b4e2b0588079e1561eac610f7ba3cdef429660743192c6b43c0f2794a4aae9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-h, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T18:32:38.569 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 26 18:32:38 smithi082 podman[63195]: 2024-04-26 18:32:38.570009205 +0000 UTC m=+0.412419678 container init 5b4e2b0588079e1561eac610f7ba3cdef429660743192c6b43c0f2794a4aae9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-h, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424) 2024-04-26T18:32:38.775 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:32:38.969 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 26 18:32:38 smithi082 podman[63195]: 2024-04-26 18:32:38.572750171 +0000 UTC m=+0.415160640 container start 5b4e2b0588079e1561eac610f7ba3cdef429660743192c6b43c0f2794a4aae9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-h, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-26T18:32:38.970 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 26 18:32:38 smithi082 ceph-mds[63214]: -- 172.21.15.82:0/1593861421 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55798e855a40 con 0x55798e828800 2024-04-26T18:32:38.970 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 26 18:32:38 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-h[63210]: starting mds.h at 2024-04-26T18:32:38.970 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 26 18:32:38 smithi082 bash[63195]: 5b4e2b0588079e1561eac610f7ba3cdef429660743192c6b43c0f2794a4aae9e 2024-04-26T18:32:38.970 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 26 18:32:38 smithi082 systemd[1]: Started Ceph mds.h for 2187ca98-03fa-11ef-bc93-c7b262605968. 2024-04-26T18:32:39.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:39 smithi192 ceph-mon[32842]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:39.682 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:39 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] up:boot 2024-04-26T18:32:39.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:39 smithi192 ceph-mon[32842]: fsmap 8 up:standby 2024-04-26T18:32:39.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:39 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T18:32:39.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:39 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:39.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:39 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:39.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:39 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:39.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:39 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:39.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:39 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:39.683 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:39 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:39.917 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:39 smithi080 ceph-mon[29135]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:39.917 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:39 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] up:boot 2024-04-26T18:32:39.918 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:39 smithi080 ceph-mon[29135]: fsmap 8 up:standby 2024-04-26T18:32:39.918 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T18:32:39.918 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:39.918 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:39.918 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:39.918 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:39.918 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:39.918 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:39 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:39.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:39 smithi082 ceph-mon[32808]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:39.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:39 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] up:boot 2024-04-26T18:32:39.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:39 smithi082 ceph-mon[32808]: fsmap 8 up:standby 2024-04-26T18:32:39.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:39 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T18:32:39.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:39 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:39.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:39 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:39.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:39 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:39.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:39 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:39.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:39 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:39.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:39 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:40.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.489+0000 7f80e8db3700 1 -- 172.21.15.80:0/2459176761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80e4103e30 msgr2=0x7f80e4110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.489+0000 7f80e8db3700 1 --2- 172.21.15.80:0/2459176761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80e4103e30 0x7f80e4110290 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f80dc00b0a0 tx=0x7f80dc00b3b0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.489+0000 7f80e8db3700 1 -- 172.21.15.80:0/2459176761 shutdown_connections 2024-04-26T18:32:40.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.489+0000 7f80e8db3700 1 --2- 172.21.15.80:0/2459176761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80e4103e30 0x7f80e4110290 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.489+0000 7f80e8db3700 1 --2- 172.21.15.80:0/2459176761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80e41094c0 0x7f80e41098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.489+0000 7f80e8db3700 1 --2- 172.21.15.80:0/2459176761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80e4103470 0x7f80e41038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.489+0000 7f80e8db3700 1 -- 172.21.15.80:0/2459176761 >> 172.21.15.80:0/2459176761 conn(0x7f80e407a580 msgr2=0x7f80e407a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:40.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.489+0000 7f80e8db3700 1 -- 172.21.15.80:0/2459176761 shutdown_connections 2024-04-26T18:32:40.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.489+0000 7f80e8db3700 1 -- 172.21.15.80:0/2459176761 wait complete. 2024-04-26T18:32:40.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.490+0000 7f80e8db3700 1 Processor -- start 2024-04-26T18:32:40.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.490+0000 7f80e8db3700 1 -- start start 2024-04-26T18:32:40.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.490+0000 7f80e8db3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80e4103470 0x7f80e4075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:40.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.490+0000 7f80e8db3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80e4103e30 0x7f80e4075c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:40.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.490+0000 7f80e8db3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80e41094c0 0x7f80e40761a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:40.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.490+0000 7f80e8db3700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f80e41136c0 con 0x7f80e4103470 2024-04-26T18:32:40.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.490+0000 7f80e8db3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f80e4113540 con 0x7f80e41094c0 2024-04-26T18:32:40.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.490+0000 7f80e8db3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f80e4113840 con 0x7f80e4103e30 2024-04-26T18:32:40.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.490+0000 7f80e259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80e4103470 0x7f80e4075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:40.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.490+0000 7f80e259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80e4103470 0x7f80e4075720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42232/0 (socket says 172.21.15.80:42232) 2024-04-26T18:32:40.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.490+0000 7f80e259c700 1 -- 172.21.15.80:0/1161157232 learned_addr learned my addr 172.21.15.80:0/1161157232 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:32:40.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.490+0000 7f80e1d9b700 1 --2- 172.21.15.80:0/1161157232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80e4103e30 0x7f80e4075c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:40.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.490+0000 7f80e2d9d700 1 --2- 172.21.15.80:0/1161157232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80e41094c0 0x7f80e40761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:40.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.491+0000 7f80e259c700 1 -- 172.21.15.80:0/1161157232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80e4103e30 msgr2=0x7f80e4075c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.491+0000 7f80e259c700 1 --2- 172.21.15.80:0/1161157232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80e4103e30 0x7f80e4075c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.491+0000 7f80e259c700 1 -- 172.21.15.80:0/1161157232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80e41094c0 msgr2=0x7f80e40761a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.491+0000 7f80e259c700 1 --2- 172.21.15.80:0/1161157232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80e41094c0 0x7f80e40761a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.491+0000 7f80e259c700 1 -- 172.21.15.80:0/1161157232 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e41a80c0 con 0x7f80e4103470 2024-04-26T18:32:40.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.491+0000 7f80e259c700 1 --2- 172.21.15.80:0/1161157232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80e4103470 0x7f80e4075720 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f80d400b530 tx=0x7f80d400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:40.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.491+0000 7f80d37fe700 1 -- 172.21.15.80:0/1161157232 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d4015020 con 0x7f80e4103470 2024-04-26T18:32:40.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.491+0000 7f80d37fe700 1 -- 172.21.15.80:0/1161157232 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80d4011ce0 con 0x7f80e4103470 2024-04-26T18:32:40.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.491+0000 7f80e8db3700 1 -- 172.21.15.80:0/1161157232 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e41a83b0 con 0x7f80e4103470 2024-04-26T18:32:40.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.491+0000 7f80d37fe700 1 -- 172.21.15.80:0/1161157232 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d4010dd0 con 0x7f80e4103470 2024-04-26T18:32:40.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.491+0000 7f80e8db3700 1 -- 172.21.15.80:0/1161157232 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e41a88f0 con 0x7f80e4103470 2024-04-26T18:32:40.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.492+0000 7f80e8db3700 1 -- 172.21.15.80:0/1161157232 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80e410b930 con 0x7f80e4103470 2024-04-26T18:32:40.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.493+0000 7f80d37fe700 1 -- 172.21.15.80:0/1161157232 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f80d4018020 con 0x7f80e4103470 2024-04-26T18:32:40.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.494+0000 7f80d37fe700 1 --2- 172.21.15.80:0/1161157232 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f80cc0a3c40 0x7f80cc0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:40.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.494+0000 7f80e1d9b700 1 --2- 172.21.15.80:0/1161157232 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f80cc0a3c40 0x7f80cc0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:40.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.494+0000 7f80d37fe700 1 -- 172.21.15.80:0/1161157232 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f80d40cf620 con 0x7f80e4103470 2024-04-26T18:32:40.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.494+0000 7f80e1d9b700 1 --2- 172.21.15.80:0/1161157232 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f80cc0a3c40 0x7f80cc0a6100 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f80e407ac60 tx=0x7f80d800b3c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:40.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.498+0000 7f80d37fe700 1 -- 172.21.15.80:0/1161157232 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f80d401f020 con 0x7f80e4103470 2024-04-26T18:32:40.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:40 smithi080 ceph-mon[29135]: Deploying daemon mds.i on smithi192 2024-04-26T18:32:40.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.749+0000 7f80e8db3700 1 -- 172.21.15.80:0/1161157232 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80e410b310 con 0x7f80e4103470 2024-04-26T18:32:40.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.749+0000 7f80d37fe700 1 -- 172.21.15.80:0/1161157232 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7168 (secure 0 0 0) 0x7f80d409c4a0 con 0x7f80e4103470 2024-04-26T18:32:40.750 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:32:40.750 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1967550873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1967550873},{"type":"v1","addr":"172.21.15.80:6835","nonce":1967550873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/559541830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":559541830},{"type":"v1","addr":"172.21.15.80:6837","nonce":559541830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24371,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3564539039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3564539039},{"type":"v1","addr":"172.21.15.82:6833","nonce":3564539039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24379,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24392,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/572065563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":572065563},{"type":"v1","addr":"172.21.15.82:6835","nonce":572065563}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24394,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/719058020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":719058020},{"type":"v1","addr":"172.21.15.192:6835","nonce":719058020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2361996920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2361996920},{"type":"v1","addr":"172.21.15.192:6837","nonce":2361996920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24404,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2084055551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2084055551},{"type":"v1","addr":"172.21.15.82:6837","nonce":2084055551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-04-26T18:32:40.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.751+0000 7f80e8db3700 1 -- 172.21.15.80:0/1161157232 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f80cc0a3c40 msgr2=0x7f80cc0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.751+0000 7f80e8db3700 1 --2- 172.21.15.80:0/1161157232 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f80cc0a3c40 0x7f80cc0a6100 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f80e407ac60 tx=0x7f80d800b3c0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.751+0000 7f80e8db3700 1 -- 172.21.15.80:0/1161157232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80e4103470 msgr2=0x7f80e4075720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.751+0000 7f80e8db3700 1 --2- 172.21.15.80:0/1161157232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80e4103470 0x7f80e4075720 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f80d400b530 tx=0x7f80d400b840 comp rx=0 tx=0).stop 2024-04-26T18:32:40.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.751+0000 7f80e8db3700 1 -- 172.21.15.80:0/1161157232 shutdown_connections 2024-04-26T18:32:40.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.751+0000 7f80e8db3700 1 --2- 172.21.15.80:0/1161157232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80e41094c0 0x7f80e40761a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.751+0000 7f80e8db3700 1 --2- 172.21.15.80:0/1161157232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80e4103470 0x7f80e4075720 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.752+0000 7f80e8db3700 1 --2- 172.21.15.80:0/1161157232 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f80cc0a3c40 0x7f80cc0a6100 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.752+0000 7f80e8db3700 1 --2- 172.21.15.80:0/1161157232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80e4103e30 0x7f80e4075c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.752+0000 7f80e8db3700 1 -- 172.21.15.80:0/1161157232 >> 172.21.15.80:0/1161157232 conn(0x7f80e407a580 msgr2=0x7f80e4102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:40.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.752+0000 7f80e8db3700 1 -- 172.21.15.80:0/1161157232 shutdown_connections 2024-04-26T18:32:40.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:40.752+0000 7f80e8db3700 1 -- 172.21.15.80:0/1161157232 wait complete. 2024-04-26T18:32:40.753 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 9 2024-04-26T18:32:40.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:40 smithi192 ceph-mon[32842]: Deploying daemon mds.i on smithi192 2024-04-26T18:32:40.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:40 smithi082 ceph-mon[32808]: Deploying daemon mds.i on smithi192 2024-04-26T18:32:41.280 INFO:journalctl@ceph.mds.i.smithi192.stdout:Apr 26 18:32:41 smithi192 systemd[1]: Starting Ceph mds.i for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:32:41.534 INFO:journalctl@ceph.mds.i.smithi192.stdout:Apr 26 18:32:41 smithi192 podman[63261]: 2024-04-26 18:32:41.183288773 +0000 UTC m=+0.018184939 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:32:41.534 INFO:journalctl@ceph.mds.i.smithi192.stdout:Apr 26 18:32:41 smithi192 podman[63261]: 2024-04-26 18:32:41.289961438 +0000 UTC m=+0.124857592 container create af8838215a112750d7ab5753c895b783908394eb8060c4ad78518eb7b35520d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-i, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-26T18:32:41.534 INFO:journalctl@ceph.mds.i.smithi192.stdout:Apr 26 18:32:41 smithi192 podman[63261]: 2024-04-26 18:32:41.534591678 +0000 UTC m=+0.369487833 container init af8838215a112750d7ab5753c895b783908394eb8060c4ad78518eb7b35520d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-i, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-26T18:32:41.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:41 smithi080 ceph-mon[29135]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:41.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:41 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1161157232' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:41.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:41 smithi192 ceph-mon[32842]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:41.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:41 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1161157232' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:41.863 INFO:journalctl@ceph.mds.i.smithi192.stdout:Apr 26 18:32:41 smithi192 podman[63261]: 2024-04-26 18:32:41.537300271 +0000 UTC m=+0.372196429 container start af8838215a112750d7ab5753c895b783908394eb8060c4ad78518eb7b35520d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-i, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-26T18:32:41.863 INFO:journalctl@ceph.mds.i.smithi192.stdout:Apr 26 18:32:41 smithi192 ceph-mds[63281]: -- 172.21.15.192:0/2275801791 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ad1b357a40 con 0x55ad1b32a800 2024-04-26T18:32:41.863 INFO:journalctl@ceph.mds.i.smithi192.stdout:Apr 26 18:32:41 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-i[63277]: starting mds.i at 2024-04-26T18:32:41.863 INFO:journalctl@ceph.mds.i.smithi192.stdout:Apr 26 18:32:41 smithi192 bash[63261]: af8838215a112750d7ab5753c895b783908394eb8060c4ad78518eb7b35520d5 2024-04-26T18:32:41.863 INFO:journalctl@ceph.mds.i.smithi192.stdout:Apr 26 18:32:41 smithi192 systemd[1]: Started Ceph mds.i for 2187ca98-03fa-11ef-bc93-c7b262605968. 2024-04-26T18:32:41.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:41 smithi082 ceph-mon[32808]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:41.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:41 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1161157232' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:42.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:42 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] up:boot 2024-04-26T18:32:42.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:42 smithi082 ceph-mon[32808]: fsmap 9 up:standby 2024-04-26T18:32:42.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:42 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T18:32:42.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:42 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:42.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:42 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:42.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:42 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:42.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:42 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:42.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:42 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:42.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:42 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:42.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:42 smithi082 ceph-mon[32808]: Deploying daemon mds.g on smithi080 2024-04-26T18:32:42.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:42 smithi082 ceph-mon[32808]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:42.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:42 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] up:boot 2024-04-26T18:32:42.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:42 smithi080 ceph-mon[29135]: fsmap 9 up:standby 2024-04-26T18:32:42.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:42 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T18:32:42.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:42 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:42.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:42 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:42.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:42 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:42.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:42 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:42.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:42 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:42.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:42 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:42.995 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:42 smithi080 ceph-mon[29135]: Deploying daemon mds.g on smithi080 2024-04-26T18:32:42.995 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:42 smithi080 ceph-mon[29135]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:43.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:42 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] up:boot 2024-04-26T18:32:43.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:42 smithi192 ceph-mon[32842]: fsmap 9 up:standby 2024-04-26T18:32:43.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:42 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T18:32:43.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:42 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:43.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:42 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:43.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:42 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:43.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:42 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:43.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:42 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:43.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:42 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:43.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:42 smithi192 ceph-mon[32842]: Deploying daemon mds.g on smithi080 2024-04-26T18:32:43.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:42 smithi192 ceph-mon[32842]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:43.472 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:32:43.908 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:32:43.993 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 26 18:32:43 smithi080 systemd[1]: Starting Ceph mds.g for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:32:45.587 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:45 smithi080 ceph-mon[29135]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:45.588 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 26 18:32:45 smithi080 podman[68681]: 2024-04-26 18:32:45.35428372 +0000 UTC m=+0.029122140 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:32:45.588 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 26 18:32:45 smithi080 podman[68681]: 2024-04-26 18:32:45.464045232 +0000 UTC m=+0.138883621 container create ece91e277231034aaa8c91edc74092ff7cab7b36d39da23e663576d3579f4783 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-04-26T18:32:45.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.792+0000 7fbfe00e6700 1 -- 172.21.15.80:0/2976656086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfd8102ce0 msgr2=0x7fbfd810f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:45.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.792+0000 7fbfe00e6700 1 --2- 172.21.15.80:0/2976656086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfd8102ce0 0x7fbfd810f1d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbfd000b0a0 tx=0x7fbfd000b3b0 comp rx=0 tx=0).stop 2024-04-26T18:32:45.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.792+0000 7fbfe00e6700 1 -- 172.21.15.80:0/2976656086 shutdown_connections 2024-04-26T18:32:45.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.792+0000 7fbfe00e6700 1 --2- 172.21.15.80:0/2976656086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfd8102ce0 0x7fbfd810f1d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:45.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.792+0000 7fbfe00e6700 1 --2- 172.21.15.80:0/2976656086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfd8108390 0x7fbfd8108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:45.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.792+0000 7fbfe00e6700 1 --2- 172.21.15.80:0/2976656086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfd8102320 0x7fbfd81027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:45.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.792+0000 7fbfe00e6700 1 -- 172.21.15.80:0/2976656086 >> 172.21.15.80:0/2976656086 conn(0x7fbfd80792d0 msgr2=0x7fbfd80796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:45.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.792+0000 7fbfe00e6700 1 -- 172.21.15.80:0/2976656086 shutdown_connections 2024-04-26T18:32:45.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.792+0000 7fbfe00e6700 1 -- 172.21.15.80:0/2976656086 wait complete. 2024-04-26T18:32:45.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.793+0000 7fbfe00e6700 1 Processor -- start 2024-04-26T18:32:45.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.793+0000 7fbfe00e6700 1 -- start start 2024-04-26T18:32:45.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.793+0000 7fbfe00e6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfd8102320 0x7fbfd819f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:45.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.793+0000 7fbfe00e6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfd8102ce0 0x7fbfd819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:45.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.793+0000 7fbfe00e6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfd8108390 0x7fbfd81998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:45.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.793+0000 7fbfe00e6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd8112530 con 0x7fbfd8108390 2024-04-26T18:32:45.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.793+0000 7fbfe00e6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd81123b0 con 0x7fbfd8102320 2024-04-26T18:32:45.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.793+0000 7fbfe00e6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd81126b0 con 0x7fbfd8102ce0 2024-04-26T18:32:45.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.793+0000 7fbfde683700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfd8108390 0x7fbfd81998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:45.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.793+0000 7fbfde683700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfd8108390 0x7fbfd81998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41828/0 (socket says 172.21.15.80:41828) 2024-04-26T18:32:45.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.793+0000 7fbfde683700 1 -- 172.21.15.80:0/1415235908 learned_addr learned my addr 172.21.15.80:0/1415235908 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:32:45.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.793+0000 7fbfdde82700 1 --2- 172.21.15.80:0/1415235908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfd8102320 0x7fbfd819f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:45.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.793+0000 7fbfdd681700 1 --2- 172.21.15.80:0/1415235908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfd8102ce0 0x7fbfd819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:45.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.793+0000 7fbfde683700 1 -- 172.21.15.80:0/1415235908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfd8102ce0 msgr2=0x7fbfd819fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:45.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.793+0000 7fbfde683700 1 --2- 172.21.15.80:0/1415235908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfd8102ce0 0x7fbfd819fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:45.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.793+0000 7fbfde683700 1 -- 172.21.15.80:0/1415235908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfd8102320 msgr2=0x7fbfd819f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:45.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.793+0000 7fbfde683700 1 --2- 172.21.15.80:0/1415235908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfd8102320 0x7fbfd819f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:45.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.793+0000 7fbfde683700 1 -- 172.21.15.80:0/1415235908 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd819a080 con 0x7fbfd8108390 2024-04-26T18:32:45.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.794+0000 7fbfde683700 1 --2- 172.21.15.80:0/1415235908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfd8108390 0x7fbfd81998a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbfd000b070 tx=0x7fbfd000cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:45.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.794+0000 7fbfceffd700 1 -- 172.21.15.80:0/1415235908 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0021070 con 0x7fbfd8108390 2024-04-26T18:32:45.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.794+0000 7fbfceffd700 1 -- 172.21.15.80:0/1415235908 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfd0007cf0 con 0x7fbfd8108390 2024-04-26T18:32:45.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.794+0000 7fbfe00e6700 1 -- 172.21.15.80:0/1415235908 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfd819a310 con 0x7fbfd8108390 2024-04-26T18:32:45.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.794+0000 7fbfceffd700 1 -- 172.21.15.80:0/1415235908 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0005440 con 0x7fbfd8108390 2024-04-26T18:32:45.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.794+0000 7fbfe00e6700 1 -- 172.21.15.80:0/1415235908 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfd81a6530 con 0x7fbfd8108390 2024-04-26T18:32:45.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.795+0000 7fbfe00e6700 1 -- 172.21.15.80:0/1415235908 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfd8103a40 con 0x7fbfd8108390 2024-04-26T18:32:45.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.796+0000 7fbfceffd700 1 -- 172.21.15.80:0/1415235908 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fbfd0024070 con 0x7fbfd8108390 2024-04-26T18:32:45.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.796+0000 7fbfceffd700 1 --2- 172.21.15.80:0/1415235908 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fbfc40a3cc0 0x7fbfc40a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:45.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.797+0000 7fbfdde82700 1 --2- 172.21.15.80:0/1415235908 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fbfc40a3cc0 0x7fbfc40a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:45.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.797+0000 7fbfceffd700 1 -- 172.21.15.80:0/1415235908 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fbfd00d11a0 con 0x7fbfd8108390 2024-04-26T18:32:45.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.797+0000 7fbfdde82700 1 --2- 172.21.15.80:0/1415235908 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fbfc40a3cc0 0x7fbfc40a6180 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8005fd0 tx=0x7fbfc800af20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:45.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:45.801+0000 7fbfceffd700 1 -- 172.21.15.80:0/1415235908 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbfd009e0b0 con 0x7fbfd8108390 2024-04-26T18:32:45.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:45 smithi192 ceph-mon[32842]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:45.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:45 smithi082 ceph-mon[32808]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:45.976 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 26 18:32:45 smithi080 podman[68681]: 2024-04-26 18:32:45.885261661 +0000 UTC m=+0.560100070 container init ece91e277231034aaa8c91edc74092ff7cab7b36d39da23e663576d3579f4783 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-g, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-04-26T18:32:45.976 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 26 18:32:45 smithi080 podman[68681]: 2024-04-26 18:32:45.888403467 +0000 UTC m=+0.563241855 container start ece91e277231034aaa8c91edc74092ff7cab7b36d39da23e663576d3579f4783 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-g, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-26T18:32:45.976 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 26 18:32:45 smithi080 ceph-mds[68725]: -- 172.21.15.80:0/446331492 <== mon.0 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dcf4227a40 con 0x55dcf41fac00 2024-04-26T18:32:45.976 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 26 18:32:45 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-g[68699]: starting mds.g at 2024-04-26T18:32:45.976 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 26 18:32:45 smithi080 bash[68681]: ece91e277231034aaa8c91edc74092ff7cab7b36d39da23e663576d3579f4783 2024-04-26T18:32:46.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:46.067+0000 7fbfe00e6700 1 -- 172.21.15.80:0/1415235908 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbfd81a6700 con 0x7fbfd8108390 2024-04-26T18:32:46.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:46.068+0000 7fbfceffd700 1 -- 172.21.15.80:0/1415235908 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+7998 (secure 0 0 0) 0x7fbfd009d9b0 con 0x7fbfd8108390 2024-04-26T18:32:46.068 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:32:46.068 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1967550873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1967550873},{"type":"v1","addr":"172.21.15.80:6835","nonce":1967550873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/559541830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":559541830},{"type":"v1","addr":"172.21.15.80:6837","nonce":559541830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24371,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3564539039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3564539039},{"type":"v1","addr":"172.21.15.82:6833","nonce":3564539039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24379,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24392,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/572065563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":572065563},{"type":"v1","addr":"172.21.15.82:6835","nonce":572065563}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24394,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/719058020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":719058020},{"type":"v1","addr":"172.21.15.192:6835","nonce":719058020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2361996920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2361996920},{"type":"v1","addr":"172.21.15.192:6837","nonce":2361996920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24404,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2084055551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2084055551},{"type":"v1","addr":"172.21.15.82:6837","nonce":2084055551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24421,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/2735406056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":2735406056},{"type":"v1","addr":"172.21.15.192:6839","nonce":2735406056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-26T18:32:46.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:46.070+0000 7fbfe00e6700 1 -- 172.21.15.80:0/1415235908 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fbfc40a3cc0 msgr2=0x7fbfc40a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:46.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:46.070+0000 7fbfe00e6700 1 --2- 172.21.15.80:0/1415235908 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fbfc40a3cc0 0x7fbfc40a6180 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8005fd0 tx=0x7fbfc800af20 comp rx=0 tx=0).stop 2024-04-26T18:32:46.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:46.070+0000 7fbfe00e6700 1 -- 172.21.15.80:0/1415235908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfd8108390 msgr2=0x7fbfd81998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:46.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:46.070+0000 7fbfe00e6700 1 --2- 172.21.15.80:0/1415235908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfd8108390 0x7fbfd81998a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbfd000b070 tx=0x7fbfd000cf00 comp rx=0 tx=0).stop 2024-04-26T18:32:46.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:46.070+0000 7fbfe00e6700 1 -- 172.21.15.80:0/1415235908 shutdown_connections 2024-04-26T18:32:46.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:46.070+0000 7fbfe00e6700 1 --2- 172.21.15.80:0/1415235908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfd8108390 0x7fbfd81998a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:46.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:46.070+0000 7fbfe00e6700 1 --2- 172.21.15.80:0/1415235908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfd8102320 0x7fbfd819f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:46.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:46.070+0000 7fbfe00e6700 1 --2- 172.21.15.80:0/1415235908 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fbfc40a3cc0 0x7fbfc40a6180 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:46.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:46.070+0000 7fbfe00e6700 1 --2- 172.21.15.80:0/1415235908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfd8102ce0 0x7fbfd819fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:46.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:46.070+0000 7fbfe00e6700 1 -- 172.21.15.80:0/1415235908 >> 172.21.15.80:0/1415235908 conn(0x7fbfd80792d0 msgr2=0x7fbfd8101530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:46.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:46.070+0000 7fbfe00e6700 1 -- 172.21.15.80:0/1415235908 shutdown_connections 2024-04-26T18:32:46.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:46.070+0000 7fbfe00e6700 1 -- 172.21.15.80:0/1415235908 wait complete. 2024-04-26T18:32:46.071 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 10 2024-04-26T18:32:46.243 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 26 18:32:45 smithi080 systemd[1]: Started Ceph mds.g for 2187ca98-03fa-11ef-bc93-c7b262605968. 2024-04-26T18:32:47.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:47 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:47.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:47 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:47.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:47 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:47.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:47 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:47.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:47 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:47.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:47 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:47.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:47 smithi080 ceph-mon[29135]: Deploying daemon mds.a on smithi080 2024-04-26T18:32:47.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:47 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1415235908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:47.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:47 smithi080 ceph-mon[29135]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:47.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:47 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.80:6838/2137993298,v1:172.21.15.80:6839/2137993298] up:boot 2024-04-26T18:32:47.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:47 smithi080 ceph-mon[29135]: fsmap 10 up:standby 2024-04-26T18:32:47.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:47 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T18:32:47.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:47 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:47.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:47 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:47.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:47 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:47.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:47 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:47.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:47 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:47.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:47 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:47.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:47 smithi192 ceph-mon[32842]: Deploying daemon mds.a on smithi080 2024-04-26T18:32:47.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:47 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1415235908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:47.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:47 smithi192 ceph-mon[32842]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:47.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:47 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.80:6838/2137993298,v1:172.21.15.80:6839/2137993298] up:boot 2024-04-26T18:32:47.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:47 smithi192 ceph-mon[32842]: fsmap 10 up:standby 2024-04-26T18:32:47.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:47 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T18:32:47.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:47 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:47.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:47 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:47.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:47 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:47.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:47 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:47.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:47 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:47.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:47 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:47.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:47 smithi082 ceph-mon[32808]: Deploying daemon mds.a on smithi080 2024-04-26T18:32:47.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:47 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1415235908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:47.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:47 smithi082 ceph-mon[32808]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:47.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:47 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.80:6838/2137993298,v1:172.21.15.80:6839/2137993298] up:boot 2024-04-26T18:32:47.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:47 smithi082 ceph-mon[32808]: fsmap 10 up:standby 2024-04-26T18:32:47.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:47 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T18:32:48.734 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 26 18:32:48 smithi080 systemd[1]: Starting Ceph mds.a for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:32:48.765 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:32:48.993 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 26 18:32:48 smithi080 podman[69024]: 2024-04-26 18:32:48.636946703 +0000 UTC m=+0.017490835 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:32:48.993 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 26 18:32:48 smithi080 podman[69024]: 2024-04-26 18:32:48.759644707 +0000 UTC m=+0.140188822 container create 3de5c21d2b3fa11d9a4de87cef9190aea8e2d703808e4827acb7b9edc4f7e43f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-a, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5) 2024-04-26T18:32:49.194 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:32:49.316 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 26 18:32:49 smithi080 podman[69024]: 2024-04-26 18:32:49.00395614 +0000 UTC m=+0.384500256 container init 3de5c21d2b3fa11d9a4de87cef9190aea8e2d703808e4827acb7b9edc4f7e43f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, ceph=True) 2024-04-26T18:32:49.316 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 26 18:32:49 smithi080 podman[69024]: 2024-04-26 18:32:49.007259795 +0000 UTC m=+0.387803913 container start 3de5c21d2b3fa11d9a4de87cef9190aea8e2d703808e4827acb7b9edc4f7e43f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-a, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-04-26T18:32:49.316 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 26 18:32:49 smithi080 ceph-mds[69076]: -- 172.21.15.80:0/2663345079 <== mon.0 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560e67f79a40 con 0x560e67f4cc00 2024-04-26T18:32:49.316 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 26 18:32:49 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-a[69058]: starting mds.a at 2024-04-26T18:32:49.316 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 26 18:32:49 smithi080 bash[69024]: 3de5c21d2b3fa11d9a4de87cef9190aea8e2d703808e4827acb7b9edc4f7e43f 2024-04-26T18:32:49.316 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 26 18:32:49 smithi080 systemd[1]: Started Ceph mds.a for 2187ca98-03fa-11ef-bc93-c7b262605968. 2024-04-26T18:32:49.574 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:49 smithi080 ceph-mon[29135]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:49.574 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:49 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:49.574 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:49 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:49.574 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:49 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:49.574 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:49 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:49.574 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:49 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:49.574 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:49 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:49.811 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:49 smithi082 ceph-mon[32808]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:49.812 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:49 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:49.812 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:49 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:49.812 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:49 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:49.812 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:49 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:49.812 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:49 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:49.812 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:49 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:49.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:49 smithi192 ceph-mon[32842]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:49.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:49 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:49.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:49 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:49.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:49 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:49.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:49 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T18:32:49.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:49 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T18:32:49.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:49 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:50.609 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:50 smithi080 ceph-mon[29135]: Deploying daemon mds.b on smithi082 2024-04-26T18:32:50.609 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:50 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.80:6840/1544670,v1:172.21.15.80:6841/1544670] up:boot 2024-04-26T18:32:50.609 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:50 smithi080 ceph-mon[29135]: fsmap 11 up:standby 2024-04-26T18:32:50.610 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:50 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T18:32:50.815 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:50 smithi082 ceph-mon[32808]: Deploying daemon mds.b on smithi082 2024-04-26T18:32:50.815 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:50 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.80:6840/1544670,v1:172.21.15.80:6841/1544670] up:boot 2024-04-26T18:32:50.815 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:50 smithi082 ceph-mon[32808]: fsmap 11 up:standby 2024-04-26T18:32:50.816 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T18:32:50.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:50 smithi192 ceph-mon[32842]: Deploying daemon mds.b on smithi082 2024-04-26T18:32:50.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:50 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.80:6840/1544670,v1:172.21.15.80:6841/1544670] up:boot 2024-04-26T18:32:50.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:50 smithi192 ceph-mon[32842]: fsmap 11 up:standby 2024-04-26T18:32:50.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:50 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T18:32:50.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.947+0000 7fe6484fa700 1 -- 172.21.15.80:0/2471233777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6401094a0 msgr2=0x7fe640109880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:50.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.947+0000 7fe6484fa700 1 --2- 172.21.15.80:0/2471233777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6401094a0 0x7fe640109880 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe630009990 tx=0x7fe630009ca0 comp rx=0 tx=0).stop 2024-04-26T18:32:50.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.947+0000 7fe6484fa700 1 -- 172.21.15.80:0/2471233777 shutdown_connections 2024-04-26T18:32:50.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.947+0000 7fe6484fa700 1 --2- 172.21.15.80:0/2471233777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe64006c510 0x7fe6401102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:50.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.947+0000 7fe6484fa700 1 --2- 172.21.15.80:0/2471233777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6401094a0 0x7fe640109880 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:50.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.947+0000 7fe6484fa700 1 --2- 172.21.15.80:0/2471233777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe64006bb70 0x7fe64006bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:50.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.947+0000 7fe6484fa700 1 -- 172.21.15.80:0/2471233777 >> 172.21.15.80:0/2471233777 conn(0x7fe6400792f0 msgr2=0x7fe640079700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:50.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.947+0000 7fe6484fa700 1 -- 172.21.15.80:0/2471233777 shutdown_connections 2024-04-26T18:32:50.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.947+0000 7fe6484fa700 1 -- 172.21.15.80:0/2471233777 wait complete. 2024-04-26T18:32:50.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.948+0000 7fe6484fa700 1 Processor -- start 2024-04-26T18:32:50.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.948+0000 7fe6484fa700 1 -- start start 2024-04-26T18:32:50.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.948+0000 7fe6484fa700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe64006bb70 0x7fe64019bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:50.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.948+0000 7fe6484fa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe64006c510 0x7fe64019c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:50.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.948+0000 7fe6484fa700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6401094a0 0x7fe6401a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:50.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.948+0000 7fe6484fa700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe6401135e0 con 0x7fe6401094a0 2024-04-26T18:32:50.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.948+0000 7fe6484fa700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe640113460 con 0x7fe64006c510 2024-04-26T18:32:50.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.948+0000 7fe6484fa700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe640113760 con 0x7fe64006bb70 2024-04-26T18:32:50.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.948+0000 7fe646a97700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6401094a0 0x7fe6401a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:50.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.948+0000 7fe646a97700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6401094a0 0x7fe6401a0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41894/0 (socket says 172.21.15.80:41894) 2024-04-26T18:32:50.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.948+0000 7fe646a97700 1 -- 172.21.15.80:0/207536 learned_addr learned my addr 172.21.15.80:0/207536 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:32:50.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.948+0000 7fe646296700 1 --2- 172.21.15.80:0/207536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe64006bb70 0x7fe64019bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:50.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.948+0000 7fe645a95700 1 --2- 172.21.15.80:0/207536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe64006c510 0x7fe64019c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:50.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.948+0000 7fe646a97700 1 -- 172.21.15.80:0/207536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe64006bb70 msgr2=0x7fe64019bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:50.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.948+0000 7fe646a97700 1 --2- 172.21.15.80:0/207536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe64006bb70 0x7fe64019bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:50.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.949+0000 7fe646a97700 1 -- 172.21.15.80:0/207536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe64006c510 msgr2=0x7fe64019c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:50.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.949+0000 7fe646a97700 1 --2- 172.21.15.80:0/207536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe64006c510 0x7fe64019c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:50.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.949+0000 7fe646a97700 1 -- 172.21.15.80:0/207536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6401a0da0 con 0x7fe6401094a0 2024-04-26T18:32:50.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.949+0000 7fe646a97700 1 --2- 172.21.15.80:0/207536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6401094a0 0x7fe6401a0660 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe638007ee0 tx=0x7fe63800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:50.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.949+0000 7fe6377fe700 1 -- 172.21.15.80:0/207536 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe638004bb0 con 0x7fe6401094a0 2024-04-26T18:32:50.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.949+0000 7fe6484fa700 1 -- 172.21.15.80:0/207536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6401a1090 con 0x7fe6401094a0 2024-04-26T18:32:50.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.949+0000 7fe6484fa700 1 -- 172.21.15.80:0/207536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6401a8910 con 0x7fe6401094a0 2024-04-26T18:32:50.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.949+0000 7fe6377fe700 1 -- 172.21.15.80:0/207536 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe638004d50 con 0x7fe6401094a0 2024-04-26T18:32:50.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.949+0000 7fe6377fe700 1 -- 172.21.15.80:0/207536 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe638005800 con 0x7fe6401094a0 2024-04-26T18:32:50.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.950+0000 7fe6484fa700 1 -- 172.21.15.80:0/207536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe624005330 con 0x7fe6401094a0 2024-04-26T18:32:50.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.951+0000 7fe6377fe700 1 -- 172.21.15.80:0/207536 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fe63801a020 con 0x7fe6401094a0 2024-04-26T18:32:50.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.952+0000 7fe6377fe700 1 --2- 172.21.15.80:0/207536 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe62c0a3cc0 0x7fe62c0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:50.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.952+0000 7fe646296700 1 --2- 172.21.15.80:0/207536 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe62c0a3cc0 0x7fe62c0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:50.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.952+0000 7fe6377fe700 1 -- 172.21.15.80:0/207536 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fe6380cf6b0 con 0x7fe6401094a0 2024-04-26T18:32:50.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.952+0000 7fe646296700 1 --2- 172.21.15.80:0/207536 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe62c0a3cc0 0x7fe62c0a6180 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe63000b5c0 tx=0x7fe630005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:50.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:50.960+0000 7fe6377fe700 1 -- 172.21.15.80:0/207536 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe638010070 con 0x7fe6401094a0 2024-04-26T18:32:51.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:51.217+0000 7fe6484fa700 1 -- 172.21.15.80:0/207536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe624005620 con 0x7fe6401094a0 2024-04-26T18:32:51.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:51.217+0000 7fe6377fe700 1 -- 172.21.15.80:0/207536 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9641 (secure 0 0 0) 0x7fe63809c530 con 0x7fe6401094a0 2024-04-26T18:32:51.218 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:32:51.218 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1967550873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1967550873},{"type":"v1","addr":"172.21.15.80:6835","nonce":1967550873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/559541830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":559541830},{"type":"v1","addr":"172.21.15.80:6837","nonce":559541830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/2137993298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":2137993298},{"type":"v1","addr":"172.21.15.80:6839","nonce":2137993298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/1544670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1544670},{"type":"v1","addr":"172.21.15.80:6841","nonce":1544670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24371,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3564539039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3564539039},{"type":"v1","addr":"172.21.15.82:6833","nonce":3564539039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24379,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24392,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/572065563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":572065563},{"type":"v1","addr":"172.21.15.82:6835","nonce":572065563}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24394,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/719058020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":719058020},{"type":"v1","addr":"172.21.15.192:6835","nonce":719058020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2361996920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2361996920},{"type":"v1","addr":"172.21.15.192:6837","nonce":2361996920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24404,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2084055551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2084055551},{"type":"v1","addr":"172.21.15.82:6837","nonce":2084055551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24421,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/2735406056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":2735406056},{"type":"v1","addr":"172.21.15.192:6839","nonce":2735406056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-26T18:32:51.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:51.220+0000 7fe6484fa700 1 -- 172.21.15.80:0/207536 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe62c0a3cc0 msgr2=0x7fe62c0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:51.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:51.220+0000 7fe6484fa700 1 --2- 172.21.15.80:0/207536 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe62c0a3cc0 0x7fe62c0a6180 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe63000b5c0 tx=0x7fe630005fd0 comp rx=0 tx=0).stop 2024-04-26T18:32:51.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:51.220+0000 7fe6484fa700 1 -- 172.21.15.80:0/207536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6401094a0 msgr2=0x7fe6401a0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:51.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:51.220+0000 7fe6484fa700 1 --2- 172.21.15.80:0/207536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6401094a0 0x7fe6401a0660 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe638007ee0 tx=0x7fe63800d3b0 comp rx=0 tx=0).stop 2024-04-26T18:32:51.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:51.221+0000 7fe6484fa700 1 -- 172.21.15.80:0/207536 shutdown_connections 2024-04-26T18:32:51.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:51.221+0000 7fe6484fa700 1 --2- 172.21.15.80:0/207536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6401094a0 0x7fe6401a0660 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:51.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:51.221+0000 7fe6484fa700 1 --2- 172.21.15.80:0/207536 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe62c0a3cc0 0x7fe62c0a6180 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:51.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:51.221+0000 7fe6484fa700 1 --2- 172.21.15.80:0/207536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe64006bb70 0x7fe64019bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:51.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:51.221+0000 7fe6484fa700 1 --2- 172.21.15.80:0/207536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe64006c510 0x7fe64019c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:51.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:51.221+0000 7fe6484fa700 1 -- 172.21.15.80:0/207536 >> 172.21.15.80:0/207536 conn(0x7fe6400792f0 msgr2=0x7fe64010e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:51.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:51.221+0000 7fe6484fa700 1 -- 172.21.15.80:0/207536 shutdown_connections 2024-04-26T18:32:51.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:51.221+0000 7fe6484fa700 1 -- 172.21.15.80:0/207536 wait complete. 2024-04-26T18:32:51.222 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 12 2024-04-26T18:32:51.469 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 26 18:32:51 smithi082 systemd[1]: Starting Ceph mds.b for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:32:51.823 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:51 smithi082 ceph-mon[32808]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:51.823 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:51 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/207536' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:51.824 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 26 18:32:51 smithi082 podman[63521]: 2024-04-26 18:32:51.505941496 +0000 UTC m=+0.017774051 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:32:51.824 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 26 18:32:51 smithi082 podman[63521]: 2024-04-26 18:32:51.613616505 +0000 UTC m=+0.125449043 container create cadf56e3235ac1c64e4a078f601ee949c020a203f1d2078f1fe9da4e435ecc9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-26T18:32:51.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:51 smithi080 ceph-mon[29135]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:51.831 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:51 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/207536' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:51.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:51 smithi192 ceph-mon[32842]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:51.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:51 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/207536' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:52.125 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 26 18:32:51 smithi082 podman[63521]: 2024-04-26 18:32:51.824384 +0000 UTC m=+0.336216540 container init cadf56e3235ac1c64e4a078f601ee949c020a203f1d2078f1fe9da4e435ecc9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-b, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0) 2024-04-26T18:32:52.125 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 26 18:32:51 smithi082 podman[63521]: 2024-04-26 18:32:51.827198311 +0000 UTC m=+0.339030862 container start cadf56e3235ac1c64e4a078f601ee949c020a203f1d2078f1fe9da4e435ecc9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-26T18:32:52.125 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 26 18:32:51 smithi082 ceph-mds[63541]: -- 172.21.15.82:0/2438858024 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ccf7db3a40 con 0x55ccf7d87000 2024-04-26T18:32:52.125 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 26 18:32:51 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-b[63537]: starting mds.b at 2024-04-26T18:32:52.126 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 26 18:32:51 smithi082 bash[63521]: cadf56e3235ac1c64e4a078f601ee949c020a203f1d2078f1fe9da4e435ecc9a 2024-04-26T18:32:52.126 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 26 18:32:51 smithi082 systemd[1]: Started Ceph mds.b for 2187ca98-03fa-11ef-bc93-c7b262605968. 2024-04-26T18:32:53.215 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:52 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:53.216 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:52 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:53.216 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:52 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:53.216 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:52 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:53.216 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:52 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:53.216 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:52 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:32:53.216 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:52 smithi082 ceph-mon[32808]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:53.216 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:52 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] up:boot 2024-04-26T18:32:53.216 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:52 smithi082 ceph-mon[32808]: fsmap 12 up:standby 2024-04-26T18:32:53.216 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:52 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T18:32:53.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:52 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:53.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:52 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:53.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:52 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:53.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:52 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:53.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:52 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:53.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:52 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:32:53.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:52 smithi080 ceph-mon[29135]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:53.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:52 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] up:boot 2024-04-26T18:32:53.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:52 smithi080 ceph-mon[29135]: fsmap 12 up:standby 2024-04-26T18:32:53.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:52 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T18:32:53.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:52 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:53.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:52 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:53.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:52 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:53.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:52 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:53.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:52 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:53.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:52 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:32:53.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:52 smithi192 ceph-mon[32842]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:53.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:52 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] up:boot 2024-04-26T18:32:53.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:52 smithi192 ceph-mon[32842]: fsmap 12 up:standby 2024-04-26T18:32:53.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:52 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T18:32:53.935 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:32:54.170 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:32:54.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:54 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:54.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:54 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:54.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:54 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:54.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:54 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:54.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:54 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:54.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:54 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:54.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:54 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:54.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:54 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:32:54.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:54 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:54.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:54 smithi080 ceph-mon[29135]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:54.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:54 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:32:55.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:54 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:55.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:54 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:55.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:54 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:55.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:54 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:55.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:54 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:55.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:54 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:55.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:54 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:55.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:54 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:32:55.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:54 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:55.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:54 smithi192 ceph-mon[32842]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:55.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:54 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:32:55.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:54 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:55.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:54 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:55.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:54 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:55.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:54 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:55.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:54 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:55.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:54 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:55.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:54 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:55.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:54 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:32:55.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:54 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:55.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:54 smithi082 ceph-mon[32808]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:55.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:54 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:32:55.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.815+0000 7f3123fa3700 1 -- 172.21.15.80:0/1598633834 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f311c06bb70 msgr2=0x7f311c06bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:55.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.815+0000 7f3123fa3700 1 --2- 172.21.15.80:0/1598633834 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f311c06bb70 0x7f311c06bfd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f310c0099c0 tx=0x7f310c009cd0 comp rx=0 tx=0).stop 2024-04-26T18:32:55.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.815+0000 7f3123fa3700 1 -- 172.21.15.80:0/1598633834 shutdown_connections 2024-04-26T18:32:55.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.816+0000 7f3123fa3700 1 --2- 172.21.15.80:0/1598633834 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f311c06c510 0x7f311c1102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:55.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.816+0000 7f3123fa3700 1 --2- 172.21.15.80:0/1598633834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f311c1094a0 0x7f311c109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:55.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.816+0000 7f3123fa3700 1 --2- 172.21.15.80:0/1598633834 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f311c06bb70 0x7f311c06bfd0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:55.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.816+0000 7f3123fa3700 1 -- 172.21.15.80:0/1598633834 >> 172.21.15.80:0/1598633834 conn(0x7f311c0792c0 msgr2=0x7f311c0796d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:55.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.816+0000 7f3123fa3700 1 -- 172.21.15.80:0/1598633834 shutdown_connections 2024-04-26T18:32:55.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.816+0000 7f3123fa3700 1 -- 172.21.15.80:0/1598633834 wait complete. 2024-04-26T18:32:55.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.816+0000 7f3123fa3700 1 Processor -- start 2024-04-26T18:32:55.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.816+0000 7f3123fa3700 1 -- start start 2024-04-26T18:32:55.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.816+0000 7f3123fa3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f311c06bb70 0x7f311c102420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:55.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.816+0000 7f3123fa3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f311c06c510 0x7f311c102960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:55.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.816+0000 7f3123fa3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f311c1094a0 0x7f311c102ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:55.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.816+0000 7f3123fa3700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f311c113600 con 0x7f311c1094a0 2024-04-26T18:32:55.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.816+0000 7f3123fa3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f311c113480 con 0x7f311c06c510 2024-04-26T18:32:55.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.816+0000 7f3123fa3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f311c113780 con 0x7f311c06bb70 2024-04-26T18:32:55.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.817+0000 7f3122540700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f311c1094a0 0x7f311c102ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:55.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.817+0000 7f3122540700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f311c1094a0 0x7f311c102ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60198/0 (socket says 172.21.15.80:60198) 2024-04-26T18:32:55.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.817+0000 7f3122540700 1 -- 172.21.15.80:0/3554940227 learned_addr learned my addr 172.21.15.80:0/3554940227 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:32:55.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.817+0000 7f312153e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f311c06c510 0x7f311c102960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:55.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.817+0000 7f3121d3f700 1 --2- 172.21.15.80:0/3554940227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f311c06bb70 0x7f311c102420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:55.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.817+0000 7f3122540700 1 -- 172.21.15.80:0/3554940227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f311c06bb70 msgr2=0x7f311c102420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:55.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.817+0000 7f3122540700 1 --2- 172.21.15.80:0/3554940227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f311c06bb70 0x7f311c102420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:55.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.817+0000 7f3122540700 1 -- 172.21.15.80:0/3554940227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f311c06c510 msgr2=0x7f311c102960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:55.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.817+0000 7f3122540700 1 --2- 172.21.15.80:0/3554940227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f311c06c510 0x7f311c102960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:55.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.817+0000 7f3122540700 1 -- 172.21.15.80:0/3554940227 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311c1a8040 con 0x7f311c1094a0 2024-04-26T18:32:55.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.817+0000 7f3122540700 1 --2- 172.21.15.80:0/3554940227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f311c1094a0 0x7f311c102ea0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3114007ee0 tx=0x7f311400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:55.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.817+0000 7f3112ffd700 1 -- 172.21.15.80:0/3554940227 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3114004bb0 con 0x7f311c1094a0 2024-04-26T18:32:55.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.817+0000 7f3123fa3700 1 -- 172.21.15.80:0/3554940227 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f311c1a8330 con 0x7f311c1094a0 2024-04-26T18:32:55.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.817+0000 7f3112ffd700 1 -- 172.21.15.80:0/3554940227 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3114004d50 con 0x7f311c1094a0 2024-04-26T18:32:55.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.817+0000 7f3112ffd700 1 -- 172.21.15.80:0/3554940227 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3114005920 con 0x7f311c1094a0 2024-04-26T18:32:55.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.817+0000 7f3123fa3700 1 -- 172.21.15.80:0/3554940227 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f311c1a8840 con 0x7f311c1094a0 2024-04-26T18:32:55.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.818+0000 7f3123fa3700 1 -- 172.21.15.80:0/3554940227 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f311c104b50 con 0x7f311c1094a0 2024-04-26T18:32:55.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.819+0000 7f3112ffd700 1 -- 172.21.15.80:0/3554940227 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f311401a020 con 0x7f311c1094a0 2024-04-26T18:32:55.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.820+0000 7f3112ffd700 1 --2- 172.21.15.80:0/3554940227 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f31080a3c40 0x7f31080a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:55.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.820+0000 7f3121d3f700 1 --2- 172.21.15.80:0/3554940227 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f31080a3c40 0x7f31080a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:55.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.820+0000 7f3112ffd700 1 -- 172.21.15.80:0/3554940227 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f31140cfc80 con 0x7f311c1094a0 2024-04-26T18:32:55.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.820+0000 7f3121d3f700 1 --2- 172.21.15.80:0/3554940227 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f31080a3c40 0x7f31080a6100 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3118007b60 tx=0x7f31180073d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:55.823+0000 7f3112ffd700 1 -- 172.21.15.80:0/3554940227 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3114010070 con 0x7f311c1094a0 2024-04-26T18:32:56.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:56.092+0000 7f3123fa3700 1 -- 172.21.15.80:0/3554940227 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f311c02e650 con 0x7f311c1094a0 2024-04-26T18:32:56.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:56.092+0000 7f3112ffd700 1 -- 172.21.15.80:0/3554940227 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10467 (secure 0 0 0) 0x7f311409cb00 con 0x7f311c1094a0 2024-04-26T18:32:56.093 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:32:56.093 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1967550873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1967550873},{"type":"v1","addr":"172.21.15.80:6835","nonce":1967550873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/559541830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":559541830},{"type":"v1","addr":"172.21.15.80:6837","nonce":559541830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/2137993298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":2137993298},{"type":"v1","addr":"172.21.15.80:6839","nonce":2137993298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6841/1544670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1544670},{"type":"v1","addr":"172.21.15.80:6841","nonce":1544670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24371,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3564539039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3564539039},{"type":"v1","addr":"172.21.15.82:6833","nonce":3564539039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24379,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24392,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/572065563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":572065563},{"type":"v1","addr":"172.21.15.82:6835","nonce":572065563}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24394,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/719058020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":719058020},{"type":"v1","addr":"172.21.15.192:6835","nonce":719058020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2361996920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2361996920},{"type":"v1","addr":"172.21.15.192:6837","nonce":2361996920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24404,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2084055551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2084055551},{"type":"v1","addr":"172.21.15.82:6837","nonce":2084055551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24421,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/2735406056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":2735406056},{"type":"v1","addr":"172.21.15.192:6839","nonce":2735406056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24434,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/1482576497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1482576497},{"type":"v1","addr":"172.21.15.82:6839","nonce":1482576497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-04-26T18:32:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:56.094+0000 7f3123fa3700 1 -- 172.21.15.80:0/3554940227 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f31080a3c40 msgr2=0x7f31080a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:56.094+0000 7f3123fa3700 1 --2- 172.21.15.80:0/3554940227 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f31080a3c40 0x7f31080a6100 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3118007b60 tx=0x7f31180073d0 comp rx=0 tx=0).stop 2024-04-26T18:32:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:56.095+0000 7f3123fa3700 1 -- 172.21.15.80:0/3554940227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f311c1094a0 msgr2=0x7f311c102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:56.095+0000 7f3123fa3700 1 --2- 172.21.15.80:0/3554940227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f311c1094a0 0x7f311c102ea0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3114007ee0 tx=0x7f311400d3b0 comp rx=0 tx=0).stop 2024-04-26T18:32:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:56.095+0000 7f3123fa3700 1 -- 172.21.15.80:0/3554940227 shutdown_connections 2024-04-26T18:32:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:56.095+0000 7f3123fa3700 1 --2- 172.21.15.80:0/3554940227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f311c1094a0 0x7f311c102ea0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:56.095+0000 7f3123fa3700 1 --2- 172.21.15.80:0/3554940227 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f31080a3c40 0x7f31080a6100 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:56.095+0000 7f3123fa3700 1 --2- 172.21.15.80:0/3554940227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f311c06bb70 0x7f311c102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:56.095+0000 7f3123fa3700 1 --2- 172.21.15.80:0/3554940227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f311c06c510 0x7f311c102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:56.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:56.095+0000 7f3123fa3700 1 -- 172.21.15.80:0/3554940227 >> 172.21.15.80:0/3554940227 conn(0x7f311c0792c0 msgr2=0x7f311c100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:56.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:56.095+0000 7f3123fa3700 1 -- 172.21.15.80:0/3554940227 shutdown_connections 2024-04-26T18:32:56.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:56.095+0000 7f3123fa3700 1 -- 172.21.15.80:0/3554940227 wait complete. 2024-04-26T18:32:56.096 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 13 2024-04-26T18:32:56.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:56 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:56.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:56 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3554940227' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:56.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:56 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:56.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:56 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:56.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:56 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:56.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:56 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:56.917 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:56 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:56.918 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:56 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3554940227' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:56.918 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:56 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:56.918 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:56 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:56.918 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:56 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:56.918 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:56 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:56.945 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-04-26T18:32:56.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:56 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:56.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:56 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3554940227' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:32:56.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:56 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:56.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:56 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:56.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:56 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:56.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:56 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:57.301 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:32:57.696 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:57 smithi080 ceph-mon[29135]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:57.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:57 smithi192 ceph-mon[32842]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:57.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:57 smithi082 ceph-mon[32808]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:58.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.997+0000 7f23dbe49700 1 -- 172.21.15.80:0/1406109357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23d4102ce0 msgr2=0x7f23d410f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:59.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.997+0000 7f23dbe49700 1 --2- 172.21.15.80:0/1406109357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23d4102ce0 0x7f23d410f1d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f23c4009990 tx=0x7f23c4009ca0 comp rx=0 tx=0).stop 2024-04-26T18:32:59.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.997+0000 7f23dbe49700 1 -- 172.21.15.80:0/1406109357 shutdown_connections 2024-04-26T18:32:59.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.997+0000 7f23dbe49700 1 --2- 172.21.15.80:0/1406109357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23d4102ce0 0x7f23d410f1d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:59.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.997+0000 7f23dbe49700 1 --2- 172.21.15.80:0/1406109357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23d4108390 0x7f23d4108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:59.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.997+0000 7f23dbe49700 1 --2- 172.21.15.80:0/1406109357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d4102320 0x7f23d41027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:59.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.997+0000 7f23dbe49700 1 -- 172.21.15.80:0/1406109357 >> 172.21.15.80:0/1406109357 conn(0x7f23d40792d0 msgr2=0x7f23d40796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:59.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.997+0000 7f23dbe49700 1 -- 172.21.15.80:0/1406109357 shutdown_connections 2024-04-26T18:32:59.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.997+0000 7f23dbe49700 1 -- 172.21.15.80:0/1406109357 wait complete. 2024-04-26T18:32:59.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.998+0000 7f23dbe49700 1 Processor -- start 2024-04-26T18:32:59.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.998+0000 7f23dbe49700 1 -- start start 2024-04-26T18:32:59.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.998+0000 7f23dbe49700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d4102320 0x7f23d419f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:59.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.998+0000 7f23dbe49700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23d4102ce0 0x7f23d419fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:59.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.998+0000 7f23dbe49700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23d4108390 0x7f23d41998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:59.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.998+0000 7f23dbe49700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f23d4112530 con 0x7f23d4102ce0 2024-04-26T18:32:59.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.998+0000 7f23dbe49700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f23d41123b0 con 0x7f23d4102320 2024-04-26T18:32:59.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.998+0000 7f23dbe49700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f23d41126b0 con 0x7f23d4108390 2024-04-26T18:32:59.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.998+0000 7f23d93e4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23d4102ce0 0x7f23d419fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:59.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.998+0000 7f23d93e4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23d4102ce0 0x7f23d419fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60224/0 (socket says 172.21.15.80:60224) 2024-04-26T18:32:59.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.998+0000 7f23d93e4700 1 -- 172.21.15.80:0/4111419757 learned_addr learned my addr 172.21.15.80:0/4111419757 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:32:59.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.999+0000 7f23d9be5700 1 --2- 172.21.15.80:0/4111419757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d4102320 0x7f23d419f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:59.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.999+0000 7f23da3e6700 1 --2- 172.21.15.80:0/4111419757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23d4108390 0x7f23d41998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:59.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.999+0000 7f23d93e4700 1 -- 172.21.15.80:0/4111419757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23d4108390 msgr2=0x7f23d41998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:59.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.999+0000 7f23d93e4700 1 --2- 172.21.15.80:0/4111419757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23d4108390 0x7f23d41998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:59.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.999+0000 7f23d93e4700 1 -- 172.21.15.80:0/4111419757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d4102320 msgr2=0x7f23d419f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:59.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.999+0000 7f23d93e4700 1 --2- 172.21.15.80:0/4111419757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d4102320 0x7f23d419f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:59.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.999+0000 7f23d93e4700 1 -- 172.21.15.80:0/4111419757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d419a010 con 0x7f23d4102ce0 2024-04-26T18:32:59.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.999+0000 7f23da3e6700 1 --2- 172.21.15.80:0/4111419757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23d4108390 0x7f23d41998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:32:59.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.999+0000 7f23d9be5700 1 --2- 172.21.15.80:0/4111419757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d4102320 0x7f23d419f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:32:59.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.999+0000 7f23d93e4700 1 --2- 172.21.15.80:0/4111419757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23d4102ce0 0x7f23d419fbe0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f23c800c9b0 tx=0x7f23c800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:59.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.999+0000 7f23d2ffd700 1 -- 172.21.15.80:0/4111419757 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c8007b00 con 0x7f23d4102ce0 2024-04-26T18:32:59.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.999+0000 7f23dbe49700 1 -- 172.21.15.80:0/4111419757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d419a300 con 0x7f23d4102ce0 2024-04-26T18:32:59.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.999+0000 7f23d2ffd700 1 -- 172.21.15.80:0/4111419757 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23c8007ca0 con 0x7f23d4102ce0 2024-04-26T18:32:59.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.999+0000 7f23d2ffd700 1 -- 172.21.15.80:0/4111419757 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c8018730 con 0x7f23d4102ce0 2024-04-26T18:32:59.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:58.999+0000 7f23dbe49700 1 -- 172.21.15.80:0/4111419757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d41a6570 con 0x7f23d4102ce0 2024-04-26T18:32:59.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:59.000+0000 7f23dbe49700 1 -- 172.21.15.80:0/4111419757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23d406a110 con 0x7f23d4102ce0 2024-04-26T18:32:59.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:59.001+0000 7f23d2ffd700 1 -- 172.21.15.80:0/4111419757 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f23c800f450 con 0x7f23d4102ce0 2024-04-26T18:32:59.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:59.002+0000 7f23d2ffd700 1 --2- 172.21.15.80:0/4111419757 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f23bc0a3cc0 0x7f23bc0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:59.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:59.002+0000 7f23d9be5700 1 --2- 172.21.15.80:0/4111419757 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f23bc0a3cc0 0x7f23bc0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:59.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:59.002+0000 7f23d2ffd700 1 -- 172.21.15.80:0/4111419757 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f23c80d0270 con 0x7f23d4102ce0 2024-04-26T18:32:59.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:59.002+0000 7f23d9be5700 1 --2- 172.21.15.80:0/4111419757 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f23bc0a3cc0 0x7f23bc0a6180 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f23d4107c10 tx=0x7f23cc009570 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:59.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:59.005+0000 7f23d2ffd700 1 -- 172.21.15.80:0/4111419757 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f23c8014030 con 0x7f23d4102ce0 2024-04-26T18:32:59.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:59.278+0000 7f23dbe49700 1 -- 172.21.15.80:0/4111419757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f23d419ad90 con 0x7f23d4102ce0 2024-04-26T18:32:59.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:59.278+0000 7f23d2ffd700 1 -- 172.21.15.80:0/4111419757 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) ==== 84+0+65 (secure 0 0 0) 0x7f23d419ad90 con 0x7f23d4102ce0 2024-04-26T18:32:59.279 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:32:59.279 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2024-04-26T18:32:59.279 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:32:59.279 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2024-04-26T18:32:59.279 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": ".mgr" 2024-04-26T18:32:59.279 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:32:59.279 INFO:teuthology.orchestra.run.smithi080.stdout:] 2024-04-26T18:32:59.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:59.280+0000 7f23dbe49700 1 -- 172.21.15.80:0/4111419757 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f23bc0a3cc0 msgr2=0x7f23bc0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:59.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:59.280+0000 7f23dbe49700 1 --2- 172.21.15.80:0/4111419757 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f23bc0a3cc0 0x7f23bc0a6180 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f23d4107c10 tx=0x7f23cc009570 comp rx=0 tx=0).stop 2024-04-26T18:32:59.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:59.280+0000 7f23dbe49700 1 -- 172.21.15.80:0/4111419757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23d4102ce0 msgr2=0x7f23d419fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:59.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:59.280+0000 7f23dbe49700 1 --2- 172.21.15.80:0/4111419757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23d4102ce0 0x7f23d419fbe0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f23c800c9b0 tx=0x7f23c800cd70 comp rx=0 tx=0).stop 2024-04-26T18:32:59.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:59.281+0000 7f23dbe49700 1 -- 172.21.15.80:0/4111419757 shutdown_connections 2024-04-26T18:32:59.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:59.281+0000 7f23dbe49700 1 --2- 172.21.15.80:0/4111419757 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f23bc0a3cc0 0x7f23bc0a6180 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:59.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:59.281+0000 7f23dbe49700 1 --2- 172.21.15.80:0/4111419757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23d4108390 0x7f23d41998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:59.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:59.281+0000 7f23dbe49700 1 --2- 172.21.15.80:0/4111419757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23d4102320 0x7f23d419f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:59.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:59.281+0000 7f23dbe49700 1 --2- 172.21.15.80:0/4111419757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23d4102ce0 0x7f23d419fbe0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:59.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:59.281+0000 7f23dbe49700 1 -- 172.21.15.80:0/4111419757 >> 172.21.15.80:0/4111419757 conn(0x7f23d40792d0 msgr2=0x7f23d4101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:59.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:59.281+0000 7f23dbe49700 1 -- 172.21.15.80:0/4111419757 shutdown_connections 2024-04-26T18:32:59.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:32:59.281+0000 7f23dbe49700 1 -- 172.21.15.80:0/4111419757 wait complete. 2024-04-26T18:32:59.646 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:59 smithi080 ceph-mon[29135]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:59.647 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:59 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/4111419757' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-26T18:32:59.647 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:59 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:59.647 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:32:59 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:59.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:59 smithi192 ceph-mon[32842]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:59.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:59 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/4111419757' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-26T18:32:59.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:59 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:59.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:32:59 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:59.935 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T18:32:59.936 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T18:32:59.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:59 smithi082 ceph-mon[32808]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:32:59.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:59 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/4111419757' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-26T18:32:59.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:59 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:32:59.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:32:59 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:33:00.179 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:33:00.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:00 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:33:00.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:00 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:33:00.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:00 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:33:00.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:00 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:33:00.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:00 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:33:00.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:00 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:33:00.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:00 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:33:00.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:00 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:33:00.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:00 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:33:01.654 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:01 smithi080 ceph-mon[29135]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:33:01.764 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:01 smithi192 ceph-mon[32842]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:33:01.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.888+0000 7fb7aa598700 1 -- 172.21.15.80:0/379584007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a4102cd0 msgr2=0x7fb7a410f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:01.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.888+0000 7fb7aa598700 1 --2- 172.21.15.80:0/379584007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a4102cd0 0x7fb7a410f1c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00b0a0 tx=0x7fb79c00b3b0 comp rx=0 tx=0).stop 2024-04-26T18:33:01.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.888+0000 7fb7aa598700 1 -- 172.21.15.80:0/379584007 shutdown_connections 2024-04-26T18:33:01.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.888+0000 7fb7aa598700 1 --2- 172.21.15.80:0/379584007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a4102cd0 0x7fb7a410f1c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:01.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.888+0000 7fb7aa598700 1 --2- 172.21.15.80:0/379584007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7a4108380 0x7fb7a4108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:01.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.888+0000 7fb7aa598700 1 --2- 172.21.15.80:0/379584007 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a4102310 0x7fb7a4102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:01.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.888+0000 7fb7aa598700 1 -- 172.21.15.80:0/379584007 >> 172.21.15.80:0/379584007 conn(0x7fb7a4079290 msgr2=0x7fb7a40796a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:01.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.888+0000 7fb7aa598700 1 -- 172.21.15.80:0/379584007 shutdown_connections 2024-04-26T18:33:01.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.888+0000 7fb7aa598700 1 -- 172.21.15.80:0/379584007 wait complete. 2024-04-26T18:33:01.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.889+0000 7fb7aa598700 1 Processor -- start 2024-04-26T18:33:01.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.889+0000 7fb7aa598700 1 -- start start 2024-04-26T18:33:01.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.889+0000 7fb7aa598700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7a4102310 0x7fb7a419a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:01.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.889+0000 7fb7aa598700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a4102cd0 0x7fb7a419ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.889+0000 7fb7aa598700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a4108380 0x7fb7a41a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.889+0000 7fb7aa598700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a41124a0 con 0x7fb7a4108380 2024-04-26T18:33:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.889+0000 7fb7aa598700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a4112320 con 0x7fb7a4102310 2024-04-26T18:33:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.889+0000 7fb7aa598700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a4112620 con 0x7fb7a4102cd0 2024-04-26T18:33:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.889+0000 7fb7a8b35700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a4108380 0x7fb7a41a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.889+0000 7fb7a8b35700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a4108380 0x7fb7a41a58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60232/0 (socket says 172.21.15.80:60232) 2024-04-26T18:33:01.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.889+0000 7fb7a8b35700 1 -- 172.21.15.80:0/2906111303 learned_addr learned my addr 172.21.15.80:0/2906111303 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:33:01.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.889+0000 7fb7a37fe700 1 --2- 172.21.15.80:0/2906111303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a4102cd0 0x7fb7a419ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:01.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.890+0000 7fb7a3fff700 1 --2- 172.21.15.80:0/2906111303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7a4102310 0x7fb7a419a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:01.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.890+0000 7fb7a8b35700 1 -- 172.21.15.80:0/2906111303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a4102cd0 msgr2=0x7fb7a419ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:01.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.890+0000 7fb7a8b35700 1 --2- 172.21.15.80:0/2906111303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a4102cd0 0x7fb7a419ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:01.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.890+0000 7fb7a8b35700 1 -- 172.21.15.80:0/2906111303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7a4102310 msgr2=0x7fb7a419a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:01.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.890+0000 7fb7a8b35700 1 --2- 172.21.15.80:0/2906111303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7a4102310 0x7fb7a419a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:01.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.890+0000 7fb7a8b35700 1 -- 172.21.15.80:0/2906111303 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a41a5de0 con 0x7fb7a4108380 2024-04-26T18:33:01.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.890+0000 7fb7a8b35700 1 --2- 172.21.15.80:0/2906111303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a4108380 0x7fb7a41a58a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00b830 tx=0x7fb79c004ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:01.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.890+0000 7fb7a17fa700 1 -- 172.21.15.80:0/2906111303 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c021070 con 0x7fb7a4108380 2024-04-26T18:33:01.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.890+0000 7fb7a17fa700 1 -- 172.21.15.80:0/2906111303 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb79c007e30 con 0x7fb7a4108380 2024-04-26T18:33:01.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.890+0000 7fb7aa598700 1 -- 172.21.15.80:0/2906111303 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a41a5fb0 con 0x7fb7a4108380 2024-04-26T18:33:01.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.890+0000 7fb7aa598700 1 -- 172.21.15.80:0/2906111303 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a41a6460 con 0x7fb7a4108380 2024-04-26T18:33:01.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.890+0000 7fb7a17fa700 1 -- 172.21.15.80:0/2906111303 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c004700 con 0x7fb7a4108380 2024-04-26T18:33:01.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.891+0000 7fb7aa598700 1 -- 172.21.15.80:0/2906111303 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7a406a110 con 0x7fb7a4108380 2024-04-26T18:33:01.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.893+0000 7fb7a17fa700 1 -- 172.21.15.80:0/2906111303 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fb79c003d70 con 0x7fb7a4108380 2024-04-26T18:33:01.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.894+0000 7fb7a17fa700 1 --2- 172.21.15.80:0/2906111303 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb7900a3c40 0x7fb7900a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:01.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.894+0000 7fb7a3fff700 1 --2- 172.21.15.80:0/2906111303 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb7900a3c40 0x7fb7900a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:01.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.894+0000 7fb7a17fa700 1 -- 172.21.15.80:0/2906111303 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fb79c00f020 con 0x7fb7a4108380 2024-04-26T18:33:01.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.894+0000 7fb7a3fff700 1 --2- 172.21.15.80:0/2906111303 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb7900a3c40 0x7fb7900a6100 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb78c005950 tx=0x7fb78c00b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:01.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:01.898+0000 7fb7a17fa700 1 -- 172.21.15.80:0/2906111303 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb79c02a020 con 0x7fb7a4108380 2024-04-26T18:33:01.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:01 smithi082 ceph-mon[32808]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:33:02.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:02.097+0000 7fb7aa598700 1 -- 172.21.15.80:0/2906111303 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb7a41a6630 con 0x7fb7a4108380 2024-04-26T18:33:02.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:02.511+0000 7fb7a17fa700 1 -- 172.21.15.80:0/2906111303 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) ==== 138+0+0 (secure 0 0 0) 0x7fb79c09e6f0 con 0x7fb7a4108380 2024-04-26T18:33:02.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:02.513+0000 7fb7aa598700 1 -- 172.21.15.80:0/2906111303 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb7900a3c40 msgr2=0x7fb7900a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:02.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:02.513+0000 7fb7aa598700 1 --2- 172.21.15.80:0/2906111303 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb7900a3c40 0x7fb7900a6100 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb78c005950 tx=0x7fb78c00b410 comp rx=0 tx=0).stop 2024-04-26T18:33:02.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:02.513+0000 7fb7aa598700 1 -- 172.21.15.80:0/2906111303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a4108380 msgr2=0x7fb7a41a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:02.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:02.513+0000 7fb7aa598700 1 --2- 172.21.15.80:0/2906111303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a4108380 0x7fb7a41a58a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00b830 tx=0x7fb79c004ce0 comp rx=0 tx=0).stop 2024-04-26T18:33:02.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:02.514+0000 7fb7aa598700 1 -- 172.21.15.80:0/2906111303 shutdown_connections 2024-04-26T18:33:02.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:02.514+0000 7fb7aa598700 1 --2- 172.21.15.80:0/2906111303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a4108380 0x7fb7a41a58a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:02.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:02.514+0000 7fb7aa598700 1 --2- 172.21.15.80:0/2906111303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7a4102310 0x7fb7a419a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:02.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:02.514+0000 7fb7aa598700 1 --2- 172.21.15.80:0/2906111303 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb7900a3c40 0x7fb7900a6100 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:02.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:02.514+0000 7fb7aa598700 1 --2- 172.21.15.80:0/2906111303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a4102cd0 0x7fb7a419ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:02.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:02.514+0000 7fb7aa598700 1 -- 172.21.15.80:0/2906111303 >> 172.21.15.80:0/2906111303 conn(0x7fb7a4079290 msgr2=0x7fb7a4100d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:02.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:02.514+0000 7fb7aa598700 1 -- 172.21.15.80:0/2906111303 shutdown_connections 2024-04-26T18:33:02.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:02.514+0000 7fb7aa598700 1 -- 172.21.15.80:0/2906111303 wait complete. 2024-04-26T18:33:02.516 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2024-04-26T18:33:02.775 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:02 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/2906111303' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-26T18:33:02.843 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:02 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2906111303' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-26T18:33:02.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:02 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/2906111303' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-26T18:33:03.185 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T18:33:03.428 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:33:03.789 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:03 smithi080 ceph-mon[29135]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:33:03.789 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:03 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2906111303' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-26T18:33:03.789 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:03 smithi080 ceph-mon[29135]: osdmap e83: 12 total, 12 up, 12 in 2024-04-26T18:33:03.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:03 smithi192 ceph-mon[32842]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:33:03.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:03 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/2906111303' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-26T18:33:03.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:03 smithi192 ceph-mon[32842]: osdmap e83: 12 total, 12 up, 12 in 2024-04-26T18:33:03.948 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:03 smithi082 ceph-mon[32808]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:33:03.948 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:03 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/2906111303' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-26T18:33:03.948 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:03 smithi082 ceph-mon[32808]: osdmap e83: 12 total, 12 up, 12 in 2024-04-26T18:33:04.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:04 smithi192 ceph-mon[32842]: osdmap e84: 12 total, 12 up, 12 in 2024-04-26T18:33:04.881 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:04 smithi080 ceph-mon[29135]: osdmap e84: 12 total, 12 up, 12 in 2024-04-26T18:33:04.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:04 smithi082 ceph-mon[32808]: osdmap e84: 12 total, 12 up, 12 in 2024-04-26T18:33:05.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.087+0000 7f6de6ba3700 1 -- 172.21.15.80:0/4264542851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6de0102ce0 msgr2=0x7f6de010f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:05.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.087+0000 7f6de6ba3700 1 --2- 172.21.15.80:0/4264542851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6de0102ce0 0x7f6de010f1d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6dd800b0a0 tx=0x7f6dd800b3b0 comp rx=0 tx=0).stop 2024-04-26T18:33:05.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.087+0000 7f6de6ba3700 1 -- 172.21.15.80:0/4264542851 shutdown_connections 2024-04-26T18:33:05.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.087+0000 7f6de6ba3700 1 --2- 172.21.15.80:0/4264542851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6de0102ce0 0x7f6de010f1d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:05.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.087+0000 7f6de6ba3700 1 --2- 172.21.15.80:0/4264542851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de0108390 0x7f6de0108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:05.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.087+0000 7f6de6ba3700 1 --2- 172.21.15.80:0/4264542851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6de0102320 0x7f6de01027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:05.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.087+0000 7f6de6ba3700 1 -- 172.21.15.80:0/4264542851 >> 172.21.15.80:0/4264542851 conn(0x7f6de00792d0 msgr2=0x7f6de00796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:05.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.087+0000 7f6de6ba3700 1 -- 172.21.15.80:0/4264542851 shutdown_connections 2024-04-26T18:33:05.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.087+0000 7f6de6ba3700 1 -- 172.21.15.80:0/4264542851 wait complete. 2024-04-26T18:33:05.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.088+0000 7f6de6ba3700 1 Processor -- start 2024-04-26T18:33:05.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.088+0000 7f6de6ba3700 1 -- start start 2024-04-26T18:33:05.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.088+0000 7f6de6ba3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6de0102320 0x7f6de019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:05.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.088+0000 7f6de6ba3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6de0102ce0 0x7f6de019aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:05.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.088+0000 7f6de6ba3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de0108390 0x7f6de01a5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:05.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.088+0000 7f6de6ba3700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6de01125b0 con 0x7f6de0102320 2024-04-26T18:33:05.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.088+0000 7f6de6ba3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6de0112430 con 0x7f6de0108390 2024-04-26T18:33:05.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.088+0000 7f6de6ba3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6de0112730 con 0x7f6de0102ce0 2024-04-26T18:33:05.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.088+0000 7f6de493f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6de0102320 0x7f6de019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:05.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.088+0000 7f6de493f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6de0102320 0x7f6de019aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60392/0 (socket says 172.21.15.80:60392) 2024-04-26T18:33:05.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.088+0000 7f6de493f700 1 -- 172.21.15.80:0/4127376145 learned_addr learned my addr 172.21.15.80:0/4127376145 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:33:05.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.088+0000 7f6ddffff700 1 --2- 172.21.15.80:0/4127376145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6de0102ce0 0x7f6de019aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:05.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.088+0000 7f6de5140700 1 --2- 172.21.15.80:0/4127376145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de0108390 0x7f6de01a5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:05.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.088+0000 7f6de493f700 1 -- 172.21.15.80:0/4127376145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6de0102ce0 msgr2=0x7f6de019aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:05.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.088+0000 7f6de493f700 1 --2- 172.21.15.80:0/4127376145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6de0102ce0 0x7f6de019aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:05.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.088+0000 7f6de493f700 1 -- 172.21.15.80:0/4127376145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de0108390 msgr2=0x7f6de01a5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:05.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.088+0000 7f6de493f700 1 --2- 172.21.15.80:0/4127376145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de0108390 0x7f6de01a5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:05.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.088+0000 7f6de493f700 1 -- 172.21.15.80:0/4127376145 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de01a6070 con 0x7f6de0102320 2024-04-26T18:33:05.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.088+0000 7f6ddffff700 1 --2- 172.21.15.80:0/4127376145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6de0102ce0 0x7f6de019aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:33:05.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.088+0000 7f6de5140700 1 --2- 172.21.15.80:0/4127376145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de0108390 0x7f6de01a5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:33:05.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.089+0000 7f6de493f700 1 --2- 172.21.15.80:0/4127376145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6de0102320 0x7f6de019aab0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400b530 tx=0x7f6dd400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:05.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.089+0000 7f6dddffb700 1 -- 172.21.15.80:0/4127376145 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4015020 con 0x7f6de0102320 2024-04-26T18:33:05.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.089+0000 7f6de6ba3700 1 -- 172.21.15.80:0/4127376145 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6de01a62a0 con 0x7f6de0102320 2024-04-26T18:33:05.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.089+0000 7f6dddffb700 1 -- 172.21.15.80:0/4127376145 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dd4011ce0 con 0x7f6de0102320 2024-04-26T18:33:05.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.089+0000 7f6dddffb700 1 -- 172.21.15.80:0/4127376145 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4010d20 con 0x7f6de0102320 2024-04-26T18:33:05.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.089+0000 7f6de6ba3700 1 -- 172.21.15.80:0/4127376145 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6de01a6800 con 0x7f6de0102320 2024-04-26T18:33:05.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.090+0000 7f6de6ba3700 1 -- 172.21.15.80:0/4127376145 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6de010a900 con 0x7f6de0102320 2024-04-26T18:33:05.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.091+0000 7f6dddffb700 1 -- 172.21.15.80:0/4127376145 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f6dd4018020 con 0x7f6de0102320 2024-04-26T18:33:05.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.092+0000 7f6dddffb700 1 --2- 172.21.15.80:0/4127376145 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6dd00a3c40 0x7f6dd00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:05.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.092+0000 7f6ddffff700 1 --2- 172.21.15.80:0/4127376145 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6dd00a3c40 0x7f6dd00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:05.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.092+0000 7f6dddffb700 1 -- 172.21.15.80:0/4127376145 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7497+0+0 (secure 0 0 0) 0x7f6dd40cfea0 con 0x7f6de0102320 2024-04-26T18:33:05.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.092+0000 7f6ddffff700 1 --2- 172.21.15.80:0/4127376145 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6dd00a3c40 0x7f6dd00a6100 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6de0079980 tx=0x7f6dcc008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:05.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.096+0000 7f6dddffb700 1 -- 172.21.15.80:0/4127376145 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6dd401f020 con 0x7f6de0102320 2024-04-26T18:33:05.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.296+0000 7f6de6ba3700 1 -- 172.21.15.80:0/4127376145 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f6de006a110 con 0x7f6de0102320 2024-04-26T18:33:05.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.531+0000 7f6dddffb700 1 -- 172.21.15.80:0/4127376145 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v86) ==== 170+0+0 (secure 0 0 0) 0x7f6dd409cb90 con 0x7f6de0102320 2024-04-26T18:33:05.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.533+0000 7f6de6ba3700 1 -- 172.21.15.80:0/4127376145 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6dd00a3c40 msgr2=0x7f6dd00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:05.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.533+0000 7f6de6ba3700 1 --2- 172.21.15.80:0/4127376145 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6dd00a3c40 0x7f6dd00a6100 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6de0079980 tx=0x7f6dcc008040 comp rx=0 tx=0).stop 2024-04-26T18:33:05.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.533+0000 7f6de6ba3700 1 -- 172.21.15.80:0/4127376145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6de0102320 msgr2=0x7f6de019aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:05.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.533+0000 7f6de6ba3700 1 --2- 172.21.15.80:0/4127376145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6de0102320 0x7f6de019aab0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400b530 tx=0x7f6dd400b8f0 comp rx=0 tx=0).stop 2024-04-26T18:33:05.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.533+0000 7f6de6ba3700 1 -- 172.21.15.80:0/4127376145 shutdown_connections 2024-04-26T18:33:05.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.533+0000 7f6de6ba3700 1 --2- 172.21.15.80:0/4127376145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de0108390 0x7f6de01a5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:05.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.533+0000 7f6de6ba3700 1 --2- 172.21.15.80:0/4127376145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6de0102320 0x7f6de019aab0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:05.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.533+0000 7f6de6ba3700 1 --2- 172.21.15.80:0/4127376145 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6dd00a3c40 0x7f6dd00a6100 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:05.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.533+0000 7f6de6ba3700 1 --2- 172.21.15.80:0/4127376145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6de0102ce0 0x7f6de019aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:05.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.533+0000 7f6de6ba3700 1 -- 172.21.15.80:0/4127376145 >> 172.21.15.80:0/4127376145 conn(0x7f6de00792d0 msgr2=0x7f6de0101080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:05.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.534+0000 7f6de6ba3700 1 -- 172.21.15.80:0/4127376145 shutdown_connections 2024-04-26T18:33:05.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:05.534+0000 7f6de6ba3700 1 -- 172.21.15.80:0/4127376145 wait complete. 2024-04-26T18:33:05.535 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2024-04-26T18:33:05.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:05 smithi192 ceph-mon[32842]: pgmap v291: 33 pgs: 1 creating+activating, 14 creating+peering, 14 unknown, 4 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:33:05.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:05 smithi192 ceph-mon[32842]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T18:33:05.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:05 smithi192 ceph-mon[32842]: osdmap e85: 12 total, 12 up, 12 in 2024-04-26T18:33:05.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:05 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/4127376145' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-26T18:33:05.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:05 smithi080 ceph-mon[29135]: pgmap v291: 33 pgs: 1 creating+activating, 14 creating+peering, 14 unknown, 4 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:33:05.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:05 smithi080 ceph-mon[29135]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T18:33:05.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:05 smithi080 ceph-mon[29135]: osdmap e85: 12 total, 12 up, 12 in 2024-04-26T18:33:05.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:05 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/4127376145' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-26T18:33:05.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:05 smithi082 ceph-mon[32808]: pgmap v291: 33 pgs: 1 creating+activating, 14 creating+peering, 14 unknown, 4 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:33:05.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:05 smithi082 ceph-mon[32808]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T18:33:05.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:05 smithi082 ceph-mon[32808]: osdmap e85: 12 total, 12 up, 12 in 2024-04-26T18:33:05.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:05 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/4127376145' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-26T18:33:06.245 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T18:33:06.494 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:33:06.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:06 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/4127376145' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-26T18:33:06.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:06 smithi080 ceph-mon[29135]: osdmap e86: 12 total, 12 up, 12 in 2024-04-26T18:33:06.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:06 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/4127376145' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-26T18:33:06.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:06 smithi192 ceph-mon[32842]: osdmap e86: 12 total, 12 up, 12 in 2024-04-26T18:33:06.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:06 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/4127376145' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-26T18:33:06.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:06 smithi082 ceph-mon[32808]: osdmap e86: 12 total, 12 up, 12 in 2024-04-26T18:33:07.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:07 smithi080 ceph-mon[29135]: pgmap v294: 97 pgs: 1 creating+activating, 31 creating+peering, 50 unknown, 15 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:33:07.580 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:07 smithi080 ceph-mon[29135]: osdmap e87: 12 total, 12 up, 12 in 2024-04-26T18:33:07.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:07 smithi192 ceph-mon[32842]: pgmap v294: 97 pgs: 1 creating+activating, 31 creating+peering, 50 unknown, 15 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:33:07.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:07 smithi192 ceph-mon[32842]: osdmap e87: 12 total, 12 up, 12 in 2024-04-26T18:33:07.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:07 smithi082 ceph-mon[32808]: pgmap v294: 97 pgs: 1 creating+activating, 31 creating+peering, 50 unknown, 15 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:33:07.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:07 smithi082 ceph-mon[32808]: osdmap e87: 12 total, 12 up, 12 in 2024-04-26T18:33:08.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.094+0000 7f9df061d700 1 -- 172.21.15.80:0/4105113377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9de81094c0 msgr2=0x7f9de81098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:08.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.094+0000 7f9df061d700 1 --2- 172.21.15.80:0/4105113377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9de81094c0 0x7f9de81098a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8009990 tx=0x7f9dd8009ca0 comp rx=0 tx=0).stop 2024-04-26T18:33:08.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.094+0000 7f9df061d700 1 -- 172.21.15.80:0/4105113377 shutdown_connections 2024-04-26T18:33:08.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.094+0000 7f9df061d700 1 --2- 172.21.15.80:0/4105113377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9de8103e30 0x7f9de8110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:08.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.094+0000 7f9df061d700 1 --2- 172.21.15.80:0/4105113377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9de81094c0 0x7f9de81098a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:08.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.094+0000 7f9df061d700 1 --2- 172.21.15.80:0/4105113377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9de8103470 0x7f9de81038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:08.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.094+0000 7f9df061d700 1 -- 172.21.15.80:0/4105113377 >> 172.21.15.80:0/4105113377 conn(0x7f9de807a580 msgr2=0x7f9de807a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:08.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.094+0000 7f9df061d700 1 -- 172.21.15.80:0/4105113377 shutdown_connections 2024-04-26T18:33:08.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.094+0000 7f9df061d700 1 -- 172.21.15.80:0/4105113377 wait complete. 2024-04-26T18:33:08.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.095+0000 7f9df061d700 1 Processor -- start 2024-04-26T18:33:08.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.095+0000 7f9df061d700 1 -- start start 2024-04-26T18:33:08.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.095+0000 7f9df061d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9de8103470 0x7f9de8199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:08.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.095+0000 7f9df061d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9de8103e30 0x7f9de819a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:08.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.095+0000 7f9df061d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9de81094c0 0x7f9de819e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:08.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.095+0000 7f9df061d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9de81136c0 con 0x7f9de81094c0 2024-04-26T18:33:08.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.095+0000 7f9df061d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9de8113540 con 0x7f9de8103470 2024-04-26T18:33:08.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.095+0000 7f9df061d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9de8113840 con 0x7f9de8103e30 2024-04-26T18:33:08.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.095+0000 7f9deebba700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9de81094c0 0x7f9de819e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:08.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.095+0000 7f9deebba700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9de81094c0 0x7f9de819e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60412/0 (socket says 172.21.15.80:60412) 2024-04-26T18:33:08.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.095+0000 7f9deebba700 1 -- 172.21.15.80:0/3882568913 learned_addr learned my addr 172.21.15.80:0/3882568913 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:33:08.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.095+0000 7f9dee3b9700 1 --2- 172.21.15.80:0/3882568913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9de8103470 0x7f9de8199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:08.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.095+0000 7f9dedbb8700 1 --2- 172.21.15.80:0/3882568913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9de8103e30 0x7f9de819a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:08.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.096+0000 7f9deebba700 1 -- 172.21.15.80:0/3882568913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9de8103e30 msgr2=0x7f9de819a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:08.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.096+0000 7f9deebba700 1 --2- 172.21.15.80:0/3882568913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9de8103e30 0x7f9de819a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:08.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.096+0000 7f9deebba700 1 -- 172.21.15.80:0/3882568913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9de8103470 msgr2=0x7f9de8199d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:08.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.096+0000 7f9deebba700 1 --2- 172.21.15.80:0/3882568913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9de8103470 0x7f9de8199d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:08.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.096+0000 7f9deebba700 1 -- 172.21.15.80:0/3882568913 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de819ed20 con 0x7f9de81094c0 2024-04-26T18:33:08.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.096+0000 7f9deebba700 1 --2- 172.21.15.80:0/3882568913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9de81094c0 0x7f9de819e5e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9de000b970 tx=0x7f9de000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:08.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.096+0000 7f9ddf7fe700 1 -- 172.21.15.80:0/3882568913 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de0019070 con 0x7f9de81094c0 2024-04-26T18:33:08.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.096+0000 7f9ddf7fe700 1 -- 172.21.15.80:0/3882568913 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9de000cde0 con 0x7f9de81094c0 2024-04-26T18:33:08.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.096+0000 7f9df061d700 1 -- 172.21.15.80:0/3882568913 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9de819f010 con 0x7f9de81094c0 2024-04-26T18:33:08.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.096+0000 7f9ddf7fe700 1 -- 172.21.15.80:0/3882568913 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de0007370 con 0x7f9de81094c0 2024-04-26T18:33:08.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.096+0000 7f9df061d700 1 -- 172.21.15.80:0/3882568913 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9de81a6890 con 0x7f9de81094c0 2024-04-26T18:33:08.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.097+0000 7f9df061d700 1 -- 172.21.15.80:0/3882568913 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9de806a110 con 0x7f9de81094c0 2024-04-26T18:33:08.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.098+0000 7f9ddf7fe700 1 -- 172.21.15.80:0/3882568913 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f9de001c070 con 0x7f9de81094c0 2024-04-26T18:33:08.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.099+0000 7f9ddf7fe700 1 --2- 172.21.15.80:0/3882568913 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f9dd40a3c40 0x7f9dd40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:08.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.099+0000 7f9dee3b9700 1 --2- 172.21.15.80:0/3882568913 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f9dd40a3c40 0x7f9dd40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:08.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.099+0000 7f9ddf7fe700 1 -- 172.21.15.80:0/3882568913 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7879+0+0 (secure 0 0 0) 0x7f9de00cfe80 con 0x7f9de81094c0 2024-04-26T18:33:08.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.099+0000 7f9dee3b9700 1 --2- 172.21.15.80:0/3882568913 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f9dd40a3c40 0x7f9dd40a6100 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9dd800b5c0 tx=0x7f9dd8005960 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:08.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.103+0000 7f9ddf7fe700 1 -- 172.21.15.80:0/3882568913 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9de0023070 con 0x7f9de81094c0 2024-04-26T18:33:08.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.346+0000 7f9df061d700 1 -- 172.21.15.80:0/3882568913 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9de819b070 con 0x7f9de81094c0 2024-04-26T18:33:08.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.551+0000 7f9ddf7fe700 1 -- 172.21.15.80:0/3882568913 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f9de009ca10 con 0x7f9de81094c0 2024-04-26T18:33:08.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.553+0000 7f9df061d700 1 -- 172.21.15.80:0/3882568913 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f9dd40a3c40 msgr2=0x7f9dd40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:08.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.553+0000 7f9df061d700 1 --2- 172.21.15.80:0/3882568913 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f9dd40a3c40 0x7f9dd40a6100 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9dd800b5c0 tx=0x7f9dd8005960 comp rx=0 tx=0).stop 2024-04-26T18:33:08.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.553+0000 7f9df061d700 1 -- 172.21.15.80:0/3882568913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9de81094c0 msgr2=0x7f9de819e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:08.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.553+0000 7f9df061d700 1 --2- 172.21.15.80:0/3882568913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9de81094c0 0x7f9de819e5e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9de000b970 tx=0x7f9de000bc80 comp rx=0 tx=0).stop 2024-04-26T18:33:08.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.553+0000 7f9df061d700 1 -- 172.21.15.80:0/3882568913 shutdown_connections 2024-04-26T18:33:08.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.553+0000 7f9df061d700 1 --2- 172.21.15.80:0/3882568913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9de81094c0 0x7f9de819e5e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:08.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.553+0000 7f9df061d700 1 --2- 172.21.15.80:0/3882568913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9de8103470 0x7f9de8199d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:08.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.553+0000 7f9df061d700 1 --2- 172.21.15.80:0/3882568913 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f9dd40a3c40 0x7f9dd40a6100 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:08.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.553+0000 7f9df061d700 1 --2- 172.21.15.80:0/3882568913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9de8103e30 0x7f9de819a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:08.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.553+0000 7f9df061d700 1 -- 172.21.15.80:0/3882568913 >> 172.21.15.80:0/3882568913 conn(0x7f9de807a580 msgr2=0x7f9de8102310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:08.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.553+0000 7f9df061d700 1 -- 172.21.15.80:0/3882568913 shutdown_connections 2024-04-26T18:33:08.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:08.553+0000 7f9df061d700 1 -- 172.21.15.80:0/3882568913 wait complete. 2024-04-26T18:33:08.555 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 2 and data pool 3 2024-04-26T18:33:08.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:08 smithi080 ceph-mon[29135]: osdmap e88: 12 total, 12 up, 12 in 2024-04-26T18:33:08.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:08 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3882568913' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-26T18:33:08.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:08 smithi080 ceph-mon[29135]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-26T18:33:08.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:08 smithi192 ceph-mon[32842]: osdmap e88: 12 total, 12 up, 12 in 2024-04-26T18:33:08.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:08 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3882568913' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-26T18:33:08.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:08 smithi192 ceph-mon[32842]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-26T18:33:08.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:08 smithi082 ceph-mon[32808]: osdmap e88: 12 total, 12 up, 12 in 2024-04-26T18:33:08.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:08 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3882568913' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-26T18:33:08.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:08 smithi082 ceph-mon[32808]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-26T18:33:09.257 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T18:33:09.497 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:33:09.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:09 smithi080 ceph-mon[29135]: pgmap v297: 97 pgs: 1 creating+activating, 17 creating+peering, 19 unknown, 60 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:33:09.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:09 smithi080 ceph-mon[29135]: osdmap e89: 12 total, 12 up, 12 in 2024-04-26T18:33:09.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:09 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3882568913' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-26T18:33:09.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:09 smithi080 ceph-mon[29135]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-26T18:33:09.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:09 smithi080 ceph-mon[29135]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-26T18:33:09.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:09 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] up:active 2024-04-26T18:33:09.840 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:09 smithi080 ceph-mon[29135]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T18:33:09.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:09 smithi192 ceph-mon[32842]: pgmap v297: 97 pgs: 1 creating+activating, 17 creating+peering, 19 unknown, 60 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:33:09.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:09 smithi192 ceph-mon[32842]: osdmap e89: 12 total, 12 up, 12 in 2024-04-26T18:33:09.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:09 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3882568913' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-26T18:33:09.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:09 smithi192 ceph-mon[32842]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-26T18:33:09.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:09 smithi192 ceph-mon[32842]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-26T18:33:09.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:09 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] up:active 2024-04-26T18:33:09.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:09 smithi192 ceph-mon[32842]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T18:33:09.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:09 smithi082 ceph-mon[32808]: pgmap v297: 97 pgs: 1 creating+activating, 17 creating+peering, 19 unknown, 60 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:33:09.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:09 smithi082 ceph-mon[32808]: osdmap e89: 12 total, 12 up, 12 in 2024-04-26T18:33:09.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:09 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3882568913' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-26T18:33:09.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:09 smithi082 ceph-mon[32808]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-26T18:33:09.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:09 smithi082 ceph-mon[32808]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-26T18:33:09.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:09 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] up:active 2024-04-26T18:33:09.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:09 smithi082 ceph-mon[32808]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T18:33:10.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:10 smithi192 ceph-mon[32842]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-04-26T18:33:10.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:10 smithi192 ceph-mon[32842]: Cluster is now healthy 2024-04-26T18:33:10.958 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:10 smithi080 ceph-mon[29135]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-04-26T18:33:10.958 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:10 smithi080 ceph-mon[29135]: Cluster is now healthy 2024-04-26T18:33:10.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:10 smithi082 ceph-mon[32808]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-04-26T18:33:10.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:10 smithi082 ceph-mon[32808]: Cluster is now healthy 2024-04-26T18:33:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.172+0000 7fc6a6636700 1 -- 172.21.15.80:0/2015443794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6a0103e10 msgr2=0x7fc6a01102a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.172+0000 7fc6a6636700 1 --2- 172.21.15.80:0/2015443794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6a0103e10 0x7fc6a01102a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc69800b0a0 tx=0x7fc69800b3b0 comp rx=0 tx=0).stop 2024-04-26T18:33:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.172+0000 7fc6a6636700 1 -- 172.21.15.80:0/2015443794 shutdown_connections 2024-04-26T18:33:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.172+0000 7fc6a6636700 1 --2- 172.21.15.80:0/2015443794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6a0103e10 0x7fc6a01102a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.172+0000 7fc6a6636700 1 --2- 172.21.15.80:0/2015443794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6a01083a0 0x7fc6a0108780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.172+0000 7fc6a6636700 1 --2- 172.21.15.80:0/2015443794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6a0103470 0x7fc6a01038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.172+0000 7fc6a6636700 1 -- 172.21.15.80:0/2015443794 >> 172.21.15.80:0/2015443794 conn(0x7fc6a007a5d0 msgr2=0x7fc6a007a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.172+0000 7fc6a6636700 1 -- 172.21.15.80:0/2015443794 shutdown_connections 2024-04-26T18:33:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.172+0000 7fc6a6636700 1 -- 172.21.15.80:0/2015443794 wait complete. 2024-04-26T18:33:11.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.173+0000 7fc6a6636700 1 Processor -- start 2024-04-26T18:33:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.173+0000 7fc6a6636700 1 -- start start 2024-04-26T18:33:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.173+0000 7fc6a6636700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6a0103470 0x7fc6a019f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.173+0000 7fc6a6636700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6a0103e10 0x7fc6a019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.173+0000 7fc6a6636700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6a01083a0 0x7fc6a0199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.173+0000 7fc6a6636700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a0113630 con 0x7fc6a0103e10 2024-04-26T18:33:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.173+0000 7fc6a6636700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a01134b0 con 0x7fc6a01083a0 2024-04-26T18:33:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.173+0000 7fc6a6636700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a01137b0 con 0x7fc6a0103470 2024-04-26T18:33:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.173+0000 7fc69f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6a0103e10 0x7fc6a019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.173+0000 7fc69f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6a0103e10 0x7fc6a019fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60432/0 (socket says 172.21.15.80:60432) 2024-04-26T18:33:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.173+0000 7fc69f7fe700 1 -- 172.21.15.80:0/3287587613 learned_addr learned my addr 172.21.15.80:0/3287587613 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:33:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.173+0000 7fc69ffff700 1 --2- 172.21.15.80:0/3287587613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6a0103470 0x7fc6a019f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.174+0000 7fc6a4bd3700 1 --2- 172.21.15.80:0/3287587613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6a01083a0 0x7fc6a0199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.174+0000 7fc69f7fe700 1 -- 172.21.15.80:0/3287587613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6a0103470 msgr2=0x7fc6a019f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.174+0000 7fc69f7fe700 1 --2- 172.21.15.80:0/3287587613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6a0103470 0x7fc6a019f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:11.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.174+0000 7fc69f7fe700 1 -- 172.21.15.80:0/3287587613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6a01083a0 msgr2=0x7fc6a0199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.174+0000 7fc69f7fe700 1 --2- 172.21.15.80:0/3287587613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6a01083a0 0x7fc6a0199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.174+0000 7fc69f7fe700 1 -- 172.21.15.80:0/3287587613 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a019a0b0 con 0x7fc6a0103e10 2024-04-26T18:33:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.174+0000 7fc69f7fe700 1 --2- 172.21.15.80:0/3287587613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6a0103e10 0x7fc6a019fcd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc69400c920 tx=0x7fc69400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.174+0000 7fc69d7fa700 1 -- 172.21.15.80:0/3287587613 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc694004a30 con 0x7fc6a0103e10 2024-04-26T18:33:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.174+0000 7fc6a6636700 1 -- 172.21.15.80:0/3287587613 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6a019a3a0 con 0x7fc6a0103e10 2024-04-26T18:33:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.174+0000 7fc69d7fa700 1 -- 172.21.15.80:0/3287587613 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6940054d0 con 0x7fc6a0103e10 2024-04-26T18:33:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.174+0000 7fc69d7fa700 1 -- 172.21.15.80:0/3287587613 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc694007c70 con 0x7fc6a0103e10 2024-04-26T18:33:11.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.174+0000 7fc6a6636700 1 -- 172.21.15.80:0/3287587613 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6a0075650 con 0x7fc6a0103e10 2024-04-26T18:33:11.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.175+0000 7fc6a6636700 1 -- 172.21.15.80:0/3287587613 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6a010b940 con 0x7fc6a0103e10 2024-04-26T18:33:11.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.176+0000 7fc69d7fa700 1 -- 172.21.15.80:0/3287587613 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fc694004c60 con 0x7fc6a0103e10 2024-04-26T18:33:11.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.177+0000 7fc69d7fa700 1 --2- 172.21.15.80:0/3287587613 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fc6880a3c40 0x7fc6880a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:11.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.177+0000 7fc69ffff700 1 --2- 172.21.15.80:0/3287587613 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fc6880a3c40 0x7fc6880a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:11.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.177+0000 7fc69d7fa700 1 -- 172.21.15.80:0/3287587613 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7fc6940d0160 con 0x7fc6a0103e10 2024-04-26T18:33:11.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.177+0000 7fc69ffff700 1 --2- 172.21.15.80:0/3287587613 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fc6880a3c40 0x7fc6880a6100 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc6a019aa90 tx=0x7fc690009190 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:11.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.182+0000 7fc69d7fa700 1 -- 172.21.15.80:0/3287587613 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc694014030 con 0x7fc6a0103e10 2024-04-26T18:33:11.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.381+0000 7fc6a6636700 1 -- 172.21.15.80:0/3287587613 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc6a010b320 con 0x7fc6a0103e10 2024-04-26T18:33:11.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.383+0000 7fc69d7fa700 1 -- 172.21.15.80:0/3287587613 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+22147 (secure 0 0 0) 0x7fc69409cc90 con 0x7fc6a0103e10 2024-04-26T18:33:11.383 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:33:11.384 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":89,"fsid":"2187ca98-03fa-11ef-bc93-c7b262605968","created":"2024-04-26T18:24:58.809431+0000","modified":"2024-04-26T18:33:08.347435+0000","last_up_change":"2024-04-26T18:32:02.550187+0000","last_in_change":"2024-04-26T18:31:41.630932+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T18:28:14.502290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T18:33:02.102135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T18:33:05.300979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a01cfe6-d13a-4828-8c20-ad7fee7e87ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6803","nonce":429487384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6805","nonce":429487384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6809","nonce":429487384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6807","nonce":429487384}]},"public_addr":"172.21.15.80:6803/429487384","cluster_addr":"172.21.15.80:6805/429487384","heartbeat_back_addr":"172.21.15.80:6809/429487384","heartbeat_front_addr":"172.21.15.80:6807/429487384","state":["exists","up"]},{"osd":1,"uuid":"1f815d88-30b1-4540-b4f5-cc3d62707318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913033849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913033849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913033849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913033849}]},"public_addr":"172.21.15.82:6801/3913033849","cluster_addr":"172.21.15.82:6803/3913033849","heartbeat_back_addr":"172.21.15.82:6807/3913033849","heartbeat_front_addr":"172.21.15.82:6805/3913033849","state":["exists","up"]},{"osd":2,"uuid":"b8625dd7-4c1d-4258-ac2b-463ff96f4cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6801","nonce":503427508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6803","nonce":503427508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6807","nonce":503427508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6805","nonce":503427508}]},"public_addr":"172.21.15.192:6801/503427508","cluster_addr":"172.21.15.192:6803/503427508","heartbeat_back_addr":"172.21.15.192:6807/503427508","heartbeat_front_addr":"172.21.15.192:6805/503427508","state":["exists","up"]},{"osd":3,"uuid":"3068321a-3070-44ae-9bbd-a3faac8c21fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6811","nonce":407817066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6813","nonce":407817066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6817","nonce":407817066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6815","nonce":407817066}]},"public_addr":"172.21.15.80:6811/407817066","cluster_addr":"172.21.15.80:6813/407817066","heartbeat_back_addr":"172.21.15.80:6817/407817066","heartbeat_front_addr":"172.21.15.80:6815/407817066","state":["exists","up"]},{"osd":4,"uuid":"6b3d6455-9495-435b-8193-a260b63504ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6809","nonce":2068291934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6811","nonce":2068291934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6815","nonce":2068291934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6813","nonce":2068291934}]},"public_addr":"172.21.15.82:6809/2068291934","cluster_addr":"172.21.15.82:6811/2068291934","heartbeat_back_addr":"172.21.15.82:6815/2068291934","heartbeat_front_addr":"172.21.15.82:6813/2068291934","state":["exists","up"]},{"osd":5,"uuid":"538863f1-1486-45b5-a675-ecb1d3035599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6809","nonce":1770809727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6811","nonce":1770809727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6815","nonce":1770809727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6813","nonce":1770809727}]},"public_addr":"172.21.15.192:6809/1770809727","cluster_addr":"172.21.15.192:6811/1770809727","heartbeat_back_addr":"172.21.15.192:6815/1770809727","heartbeat_front_addr":"172.21.15.192:6813/1770809727","state":["exists","up"]},{"osd":6,"uuid":"7b4374d8-98e6-48e1-924b-c9b70a4baf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6819","nonce":145064490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6821","nonce":145064490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6825","nonce":145064490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6823","nonce":145064490}]},"public_addr":"172.21.15.80:6819/145064490","cluster_addr":"172.21.15.80:6821/145064490","heartbeat_back_addr":"172.21.15.80:6825/145064490","heartbeat_front_addr":"172.21.15.80:6823/145064490","state":["exists","up"]},{"osd":7,"uuid":"f3bb3c7d-4cce-4f49-b924-72ebbaad58ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6817","nonce":208047447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6819","nonce":208047447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6823","nonce":208047447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6821","nonce":208047447}]},"public_addr":"172.21.15.82:6817/208047447","cluster_addr":"172.21.15.82:6819/208047447","heartbeat_back_addr":"172.21.15.82:6823/208047447","heartbeat_front_addr":"172.21.15.82:6821/208047447","state":["exists","up"]},{"osd":8,"uuid":"6557b536-a516-4b01-a607-7981620fb2a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6817","nonce":3763069187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6819","nonce":3763069187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6823","nonce":3763069187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6821","nonce":3763069187}]},"public_addr":"172.21.15.192:6817/3763069187","cluster_addr":"172.21.15.192:6819/3763069187","heartbeat_back_addr":"172.21.15.192:6823/3763069187","heartbeat_front_addr":"172.21.15.192:6821/3763069187","state":["exists","up"]},{"osd":9,"uuid":"838615a7-1e68-4e81-8b3a-fba0ea75f7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6827","nonce":2109877993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6829","nonce":2109877993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6833","nonce":2109877993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6831","nonce":2109877993}]},"public_addr":"172.21.15.80:6827/2109877993","cluster_addr":"172.21.15.80:6829/2109877993","heartbeat_back_addr":"172.21.15.80:6833/2109877993","heartbeat_front_addr":"172.21.15.80:6831/2109877993","state":["exists","up"]},{"osd":10,"uuid":"cd664e50-3217-453d-9a89-6e26d717e6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6825","nonce":2877220993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6827","nonce":2877220993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6831","nonce":2877220993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6829","nonce":2877220993}]},"public_addr":"172.21.15.82:6825/2877220993","cluster_addr":"172.21.15.82:6827/2877220993","heartbeat_back_addr":"172.21.15.82:6831/2877220993","heartbeat_front_addr":"172.21.15.82:6829/2877220993","state":["exists","up"]},{"osd":11,"uuid":"e52807c6-8890-4df7-a8c6-51a7ff4b467b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6825","nonce":3466865106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6827","nonce":3466865106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6831","nonce":3466865106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6829","nonce":3466865106}]},"public_addr":"172.21.15.192:6825/3466865106","cluster_addr":"172.21.15.192:6827/3466865106","heartbeat_back_addr":"172.21.15.192:6831/3466865106","heartbeat_front_addr":"172.21.15.192:6829/3466865106","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:27:23.385471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:27:46.648232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:10.578970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:34.922048+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:59.142838+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:29:24.492250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:29:49.721803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:30:15.177027+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:30:41.544775+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:31:07.562401+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:31:33.498042+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:32:00.584085+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/1997155783":"2024-04-27T18:25:50.413207+0000","172.21.15.80:0/323607684":"2024-04-27T18:25:50.413207+0000","172.21.15.80:0/586397709":"2024-04-27T18:25:50.413207+0000","172.21.15.80:6801/4208962819":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/1353083127":"2024-04-27T18:25:24.440373+0000","172.21.15.80:6800/1997155783":"2024-04-27T18:25:50.413207+0000","172.21.15.80:6800/4208962819":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2644175019":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/1853513470":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2122929159":"2024-04-27T18:25:50.413207+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T18:33:11.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.385+0000 7fc6a6636700 1 -- 172.21.15.80:0/3287587613 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fc6880a3c40 msgr2=0x7fc6880a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:11.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.385+0000 7fc6a6636700 1 --2- 172.21.15.80:0/3287587613 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fc6880a3c40 0x7fc6880a6100 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc6a019aa90 tx=0x7fc690009190 comp rx=0 tx=0).stop 2024-04-26T18:33:11.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.385+0000 7fc6a6636700 1 -- 172.21.15.80:0/3287587613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6a0103e10 msgr2=0x7fc6a019fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:11.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.385+0000 7fc6a6636700 1 --2- 172.21.15.80:0/3287587613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6a0103e10 0x7fc6a019fcd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc69400c920 tx=0x7fc69400cc30 comp rx=0 tx=0).stop 2024-04-26T18:33:11.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.385+0000 7fc6a6636700 1 -- 172.21.15.80:0/3287587613 shutdown_connections 2024-04-26T18:33:11.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.385+0000 7fc6a6636700 1 --2- 172.21.15.80:0/3287587613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6a01083a0 0x7fc6a0199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:11.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.385+0000 7fc6a6636700 1 --2- 172.21.15.80:0/3287587613 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fc6880a3c40 0x7fc6880a6100 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:11.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.385+0000 7fc6a6636700 1 --2- 172.21.15.80:0/3287587613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6a0103470 0x7fc6a019f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:11.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.385+0000 7fc6a6636700 1 --2- 172.21.15.80:0/3287587613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6a0103e10 0x7fc6a019fcd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:11.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.385+0000 7fc6a6636700 1 -- 172.21.15.80:0/3287587613 >> 172.21.15.80:0/3287587613 conn(0x7fc6a007a5d0 msgr2=0x7fc6a0101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:11.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.385+0000 7fc6a6636700 1 -- 172.21.15.80:0/3287587613 shutdown_connections 2024-04-26T18:33:11.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:11.385+0000 7fc6a6636700 1 -- 172.21.15.80:0/3287587613 wait complete. 2024-04-26T18:33:11.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:11 smithi080 ceph-mon[29135]: pgmap v299: 97 pgs: 17 creating+peering, 80 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 206 B/s wr, 1 op/s 2024-04-26T18:33:11.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:11 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3287587613' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:33:11.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:11 smithi192 ceph-mon[32842]: pgmap v299: 97 pgs: 17 creating+peering, 80 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 206 B/s wr, 1 op/s 2024-04-26T18:33:11.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:11 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3287587613' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:33:11.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:11 smithi082 ceph-mon[32808]: pgmap v299: 97 pgs: 17 creating+peering, 80 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 206 B/s wr, 1 op/s 2024-04-26T18:33:11.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:11 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3287587613' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:33:12.097 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T18:33:12.334 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:33:12.969 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 26 18:33:12 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-b[63537]: 2024-04-26T18:33:12.563+0000 7f69dfc1e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T18:33:13.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:13 smithi080 ceph-mon[29135]: pgmap v300: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 3 op/s 2024-04-26T18:33:13.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:13 smithi192 ceph-mon[32842]: pgmap v300: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 3 op/s 2024-04-26T18:33:13.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:13 smithi082 ceph-mon[32808]: pgmap v300: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 3 op/s 2024-04-26T18:33:14.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.124+0000 7f7ebd455700 1 -- 172.21.15.80:0/2127016312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7eb81094c0 msgr2=0x7f7eb81098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:14.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.124+0000 7f7ebd455700 1 --2- 172.21.15.80:0/2127016312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7eb81094c0 0x7f7eb81098a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8009990 tx=0x7f7ea8009ca0 comp rx=0 tx=0).stop 2024-04-26T18:33:14.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.124+0000 7f7ebd455700 1 -- 172.21.15.80:0/2127016312 shutdown_connections 2024-04-26T18:33:14.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.124+0000 7f7ebd455700 1 --2- 172.21.15.80:0/2127016312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb8103e30 0x7f7eb8110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:14.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.124+0000 7f7ebd455700 1 --2- 172.21.15.80:0/2127016312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7eb81094c0 0x7f7eb81098a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:14.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.124+0000 7f7ebd455700 1 --2- 172.21.15.80:0/2127016312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eb8103470 0x7f7eb81038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:14.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.124+0000 7f7ebd455700 1 -- 172.21.15.80:0/2127016312 >> 172.21.15.80:0/2127016312 conn(0x7f7eb807a580 msgr2=0x7f7eb807a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:14.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.124+0000 7f7ebd455700 1 -- 172.21.15.80:0/2127016312 shutdown_connections 2024-04-26T18:33:14.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.124+0000 7f7ebd455700 1 -- 172.21.15.80:0/2127016312 wait complete. 2024-04-26T18:33:14.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.125+0000 7f7ebd455700 1 Processor -- start 2024-04-26T18:33:14.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.125+0000 7f7ebd455700 1 -- start start 2024-04-26T18:33:14.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.125+0000 7f7ebd455700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb8103470 0x7f7eb819f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:14.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.125+0000 7f7ebd455700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7eb8103e30 0x7f7eb819fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:14.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.125+0000 7f7ebd455700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eb81094c0 0x7f7eb8199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:14.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.125+0000 7f7ebd455700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb81136c0 con 0x7f7eb8103e30 2024-04-26T18:33:14.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.125+0000 7f7ebd455700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb8113540 con 0x7f7eb81094c0 2024-04-26T18:33:14.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.125+0000 7f7ebd455700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb8113840 con 0x7f7eb8103470 2024-04-26T18:33:14.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.125+0000 7f7eb67fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7eb8103e30 0x7f7eb819fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:14.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.126+0000 7f7eb67fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7eb8103e30 0x7f7eb819fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58520/0 (socket says 172.21.15.80:58520) 2024-04-26T18:33:14.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.126+0000 7f7eb67fc700 1 -- 172.21.15.80:0/352996510 learned_addr learned my addr 172.21.15.80:0/352996510 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:33:14.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.126+0000 7f7eb6ffd700 1 --2- 172.21.15.80:0/352996510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb8103470 0x7f7eb819f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:14.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.126+0000 7f7eb77fe700 1 --2- 172.21.15.80:0/352996510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eb81094c0 0x7f7eb8199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:14.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.126+0000 7f7eb67fc700 1 -- 172.21.15.80:0/352996510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb8103470 msgr2=0x7f7eb819f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:14.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.126+0000 7f7eb67fc700 1 --2- 172.21.15.80:0/352996510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb8103470 0x7f7eb819f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:14.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.126+0000 7f7eb67fc700 1 -- 172.21.15.80:0/352996510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eb81094c0 msgr2=0x7f7eb8199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:14.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.126+0000 7f7eb67fc700 1 --2- 172.21.15.80:0/352996510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eb81094c0 0x7f7eb8199aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:14.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.126+0000 7f7eb67fc700 1 -- 172.21.15.80:0/352996510 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb819a200 con 0x7f7eb8103e30 2024-04-26T18:33:14.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.126+0000 7f7eb67fc700 1 --2- 172.21.15.80:0/352996510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7eb8103e30 0x7f7eb819fe20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00b530 tx=0x7f7eac00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:14.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.126+0000 7f7e9ffff700 1 -- 172.21.15.80:0/352996510 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac015020 con 0x7f7eb8103e30 2024-04-26T18:33:14.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.126+0000 7f7e9ffff700 1 -- 172.21.15.80:0/352996510 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7eac011ce0 con 0x7f7eb8103e30 2024-04-26T18:33:14.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.126+0000 7f7ebd455700 1 -- 172.21.15.80:0/352996510 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eb819a4f0 con 0x7f7eb8103e30 2024-04-26T18:33:14.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.126+0000 7f7e9ffff700 1 -- 172.21.15.80:0/352996510 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac010e40 con 0x7f7eb8103e30 2024-04-26T18:33:14.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.126+0000 7f7ebd455700 1 -- 172.21.15.80:0/352996510 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eb81a67b0 con 0x7f7eb8103e30 2024-04-26T18:33:14.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.127+0000 7f7ebd455700 1 -- 172.21.15.80:0/352996510 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eb806a110 con 0x7f7eb8103e30 2024-04-26T18:33:14.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.128+0000 7f7e9ffff700 1 -- 172.21.15.80:0/352996510 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f7eac018020 con 0x7f7eb8103e30 2024-04-26T18:33:14.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.129+0000 7f7e9ffff700 1 --2- 172.21.15.80:0/352996510 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f7ea00a3c40 0x7f7ea00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:14.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.129+0000 7f7eb6ffd700 1 --2- 172.21.15.80:0/352996510 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f7ea00a3c40 0x7f7ea00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:14.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.129+0000 7f7e9ffff700 1 -- 172.21.15.80:0/352996510 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7f7eac0cfb10 con 0x7f7eb8103e30 2024-04-26T18:33:14.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.129+0000 7f7eb6ffd700 1 --2- 172.21.15.80:0/352996510 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f7ea00a3c40 0x7f7ea00a6100 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7eb819abe0 tx=0x7f7ea8005960 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:14.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.134+0000 7f7e9ffff700 1 -- 172.21.15.80:0/352996510 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7eac01f020 con 0x7f7eb8103e30 2024-04-26T18:33:14.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.332+0000 7f7ebd455700 1 -- 172.21.15.80:0/352996510 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7eb802e490 con 0x7f7eb8103e30 2024-04-26T18:33:14.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.333+0000 7f7e9ffff700 1 -- 172.21.15.80:0/352996510 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+22147 (secure 0 0 0) 0x7f7eac09c640 con 0x7f7eb8103e30 2024-04-26T18:33:14.333 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:33:14.334 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":89,"fsid":"2187ca98-03fa-11ef-bc93-c7b262605968","created":"2024-04-26T18:24:58.809431+0000","modified":"2024-04-26T18:33:08.347435+0000","last_up_change":"2024-04-26T18:32:02.550187+0000","last_in_change":"2024-04-26T18:31:41.630932+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T18:28:14.502290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T18:33:02.102135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T18:33:05.300979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a01cfe6-d13a-4828-8c20-ad7fee7e87ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6803","nonce":429487384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6805","nonce":429487384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6809","nonce":429487384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6807","nonce":429487384}]},"public_addr":"172.21.15.80:6803/429487384","cluster_addr":"172.21.15.80:6805/429487384","heartbeat_back_addr":"172.21.15.80:6809/429487384","heartbeat_front_addr":"172.21.15.80:6807/429487384","state":["exists","up"]},{"osd":1,"uuid":"1f815d88-30b1-4540-b4f5-cc3d62707318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913033849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913033849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913033849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913033849}]},"public_addr":"172.21.15.82:6801/3913033849","cluster_addr":"172.21.15.82:6803/3913033849","heartbeat_back_addr":"172.21.15.82:6807/3913033849","heartbeat_front_addr":"172.21.15.82:6805/3913033849","state":["exists","up"]},{"osd":2,"uuid":"b8625dd7-4c1d-4258-ac2b-463ff96f4cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6801","nonce":503427508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6803","nonce":503427508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6807","nonce":503427508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6805","nonce":503427508}]},"public_addr":"172.21.15.192:6801/503427508","cluster_addr":"172.21.15.192:6803/503427508","heartbeat_back_addr":"172.21.15.192:6807/503427508","heartbeat_front_addr":"172.21.15.192:6805/503427508","state":["exists","up"]},{"osd":3,"uuid":"3068321a-3070-44ae-9bbd-a3faac8c21fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6811","nonce":407817066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6813","nonce":407817066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6817","nonce":407817066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6815","nonce":407817066}]},"public_addr":"172.21.15.80:6811/407817066","cluster_addr":"172.21.15.80:6813/407817066","heartbeat_back_addr":"172.21.15.80:6817/407817066","heartbeat_front_addr":"172.21.15.80:6815/407817066","state":["exists","up"]},{"osd":4,"uuid":"6b3d6455-9495-435b-8193-a260b63504ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6809","nonce":2068291934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6811","nonce":2068291934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6815","nonce":2068291934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6813","nonce":2068291934}]},"public_addr":"172.21.15.82:6809/2068291934","cluster_addr":"172.21.15.82:6811/2068291934","heartbeat_back_addr":"172.21.15.82:6815/2068291934","heartbeat_front_addr":"172.21.15.82:6813/2068291934","state":["exists","up"]},{"osd":5,"uuid":"538863f1-1486-45b5-a675-ecb1d3035599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6809","nonce":1770809727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6811","nonce":1770809727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6815","nonce":1770809727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6813","nonce":1770809727}]},"public_addr":"172.21.15.192:6809/1770809727","cluster_addr":"172.21.15.192:6811/1770809727","heartbeat_back_addr":"172.21.15.192:6815/1770809727","heartbeat_front_addr":"172.21.15.192:6813/1770809727","state":["exists","up"]},{"osd":6,"uuid":"7b4374d8-98e6-48e1-924b-c9b70a4baf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6819","nonce":145064490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6821","nonce":145064490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6825","nonce":145064490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6823","nonce":145064490}]},"public_addr":"172.21.15.80:6819/145064490","cluster_addr":"172.21.15.80:6821/145064490","heartbeat_back_addr":"172.21.15.80:6825/145064490","heartbeat_front_addr":"172.21.15.80:6823/145064490","state":["exists","up"]},{"osd":7,"uuid":"f3bb3c7d-4cce-4f49-b924-72ebbaad58ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6817","nonce":208047447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6819","nonce":208047447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6823","nonce":208047447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6821","nonce":208047447}]},"public_addr":"172.21.15.82:6817/208047447","cluster_addr":"172.21.15.82:6819/208047447","heartbeat_back_addr":"172.21.15.82:6823/208047447","heartbeat_front_addr":"172.21.15.82:6821/208047447","state":["exists","up"]},{"osd":8,"uuid":"6557b536-a516-4b01-a607-7981620fb2a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6817","nonce":3763069187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6819","nonce":3763069187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6823","nonce":3763069187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6821","nonce":3763069187}]},"public_addr":"172.21.15.192:6817/3763069187","cluster_addr":"172.21.15.192:6819/3763069187","heartbeat_back_addr":"172.21.15.192:6823/3763069187","heartbeat_front_addr":"172.21.15.192:6821/3763069187","state":["exists","up"]},{"osd":9,"uuid":"838615a7-1e68-4e81-8b3a-fba0ea75f7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6827","nonce":2109877993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6829","nonce":2109877993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6833","nonce":2109877993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6831","nonce":2109877993}]},"public_addr":"172.21.15.80:6827/2109877993","cluster_addr":"172.21.15.80:6829/2109877993","heartbeat_back_addr":"172.21.15.80:6833/2109877993","heartbeat_front_addr":"172.21.15.80:6831/2109877993","state":["exists","up"]},{"osd":10,"uuid":"cd664e50-3217-453d-9a89-6e26d717e6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6825","nonce":2877220993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6827","nonce":2877220993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6831","nonce":2877220993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6829","nonce":2877220993}]},"public_addr":"172.21.15.82:6825/2877220993","cluster_addr":"172.21.15.82:6827/2877220993","heartbeat_back_addr":"172.21.15.82:6831/2877220993","heartbeat_front_addr":"172.21.15.82:6829/2877220993","state":["exists","up"]},{"osd":11,"uuid":"e52807c6-8890-4df7-a8c6-51a7ff4b467b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6825","nonce":3466865106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6827","nonce":3466865106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6831","nonce":3466865106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6829","nonce":3466865106}]},"public_addr":"172.21.15.192:6825/3466865106","cluster_addr":"172.21.15.192:6827/3466865106","heartbeat_back_addr":"172.21.15.192:6831/3466865106","heartbeat_front_addr":"172.21.15.192:6829/3466865106","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:27:23.385471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:27:46.648232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:10.578970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:34.922048+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:59.142838+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:29:24.492250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:29:49.721803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:30:15.177027+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:30:41.544775+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:31:07.562401+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:31:33.498042+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:32:00.584085+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/1997155783":"2024-04-27T18:25:50.413207+0000","172.21.15.80:0/323607684":"2024-04-27T18:25:50.413207+0000","172.21.15.80:0/586397709":"2024-04-27T18:25:50.413207+0000","172.21.15.80:6801/4208962819":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/1353083127":"2024-04-27T18:25:24.440373+0000","172.21.15.80:6800/1997155783":"2024-04-27T18:25:50.413207+0000","172.21.15.80:6800/4208962819":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2644175019":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/1853513470":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2122929159":"2024-04-27T18:25:50.413207+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T18:33:14.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.335+0000 7f7ebd455700 1 -- 172.21.15.80:0/352996510 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f7ea00a3c40 msgr2=0x7f7ea00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:14.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.335+0000 7f7ebd455700 1 --2- 172.21.15.80:0/352996510 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f7ea00a3c40 0x7f7ea00a6100 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7eb819abe0 tx=0x7f7ea8005960 comp rx=0 tx=0).stop 2024-04-26T18:33:14.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.335+0000 7f7ebd455700 1 -- 172.21.15.80:0/352996510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7eb8103e30 msgr2=0x7f7eb819fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:14.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.335+0000 7f7ebd455700 1 --2- 172.21.15.80:0/352996510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7eb8103e30 0x7f7eb819fe20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00b530 tx=0x7f7eac00b840 comp rx=0 tx=0).stop 2024-04-26T18:33:14.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.335+0000 7f7ebd455700 1 -- 172.21.15.80:0/352996510 shutdown_connections 2024-04-26T18:33:14.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.335+0000 7f7ebd455700 1 --2- 172.21.15.80:0/352996510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eb81094c0 0x7f7eb8199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:14.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.335+0000 7f7ebd455700 1 --2- 172.21.15.80:0/352996510 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f7ea00a3c40 0x7f7ea00a6100 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:14.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.335+0000 7f7ebd455700 1 --2- 172.21.15.80:0/352996510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb8103470 0x7f7eb819f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:14.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.335+0000 7f7ebd455700 1 --2- 172.21.15.80:0/352996510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7eb8103e30 0x7f7eb819fe20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:14.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.335+0000 7f7ebd455700 1 -- 172.21.15.80:0/352996510 >> 172.21.15.80:0/352996510 conn(0x7f7eb807a580 msgr2=0x7f7eb81022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:14.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.336+0000 7f7ebd455700 1 -- 172.21.15.80:0/352996510 shutdown_connections 2024-04-26T18:33:14.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:14.336+0000 7f7ebd455700 1 -- 172.21.15.80:0/352996510 wait complete. 2024-04-26T18:33:14.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:14 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/352996510' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:33:14.970 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:14 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/352996510' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:33:14.999 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-04-26T18:33:15.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:14 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/352996510' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:33:15.239 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:33:15.947 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:15 smithi080 ceph-mon[29135]: pgmap v301: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-04-26T18:33:15.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:15 smithi082 ceph-mon[32808]: pgmap v301: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-04-26T18:33:16.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:15 smithi192 ceph-mon[32842]: pgmap v301: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-04-26T18:33:17.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.053+0000 7f6850af6700 1 -- 172.21.15.80:0/2417086306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f684c109540 msgr2=0x7f684c109920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:17.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.053+0000 7f6850af6700 1 --2- 172.21.15.80:0/2417086306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f684c109540 0x7f684c109920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f683c0099c0 tx=0x7f683c009cd0 comp rx=0 tx=0).stop 2024-04-26T18:33:17.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.053+0000 7f6850af6700 1 -- 172.21.15.80:0/2417086306 shutdown_connections 2024-04-26T18:33:17.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.053+0000 7f6850af6700 1 --2- 172.21.15.80:0/2417086306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f684c06c5b0 0x7f684c110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:17.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.053+0000 7f6850af6700 1 --2- 172.21.15.80:0/2417086306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f684c109540 0x7f684c109920 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:17.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.053+0000 7f6850af6700 1 --2- 172.21.15.80:0/2417086306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f684c06bbf0 0x7f684c06c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:17.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.053+0000 7f6850af6700 1 -- 172.21.15.80:0/2417086306 >> 172.21.15.80:0/2417086306 conn(0x7f684c078230 msgr2=0x7f684c078640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:17.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.053+0000 7f6850af6700 1 -- 172.21.15.80:0/2417086306 shutdown_connections 2024-04-26T18:33:17.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.053+0000 7f6850af6700 1 -- 172.21.15.80:0/2417086306 wait complete. 2024-04-26T18:33:17.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.054+0000 7f6850af6700 1 Processor -- start 2024-04-26T18:33:17.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.054+0000 7f6850af6700 1 -- start start 2024-04-26T18:33:17.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.054+0000 7f6850af6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f684c06bbf0 0x7f684c19f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:17.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.054+0000 7f6850af6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f684c06c5b0 0x7f684c19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:17.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.054+0000 7f6850af6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f684c109540 0x7f684c199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:17.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.055+0000 7f6850af6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f684c113720 con 0x7f684c06bbf0 2024-04-26T18:33:17.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.055+0000 7f6850af6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f684c1135a0 con 0x7f684c06c5b0 2024-04-26T18:33:17.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.055+0000 7f6850af6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f684c1138a0 con 0x7f684c109540 2024-04-26T18:33:17.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.055+0000 7f684a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f684c06bbf0 0x7f684c19f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:17.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.055+0000 7f684a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f684c06bbf0 0x7f684c19f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58534/0 (socket says 172.21.15.80:58534) 2024-04-26T18:33:17.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.055+0000 7f684a59c700 1 -- 172.21.15.80:0/3140221222 learned_addr learned my addr 172.21.15.80:0/3140221222 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:33:17.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.055+0000 7f6849d9b700 1 --2- 172.21.15.80:0/3140221222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f684c06c5b0 0x7f684c19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:17.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.055+0000 7f684a59c700 1 -- 172.21.15.80:0/3140221222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f684c109540 msgr2=0x7f684c199a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:17.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.055+0000 7f684a59c700 1 --2- 172.21.15.80:0/3140221222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f684c109540 0x7f684c199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:17.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.055+0000 7f684a59c700 1 -- 172.21.15.80:0/3140221222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f684c06c5b0 msgr2=0x7f684c19fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:17.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.055+0000 7f684a59c700 1 --2- 172.21.15.80:0/3140221222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f684c06c5b0 0x7f684c19fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:17.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.055+0000 7f684a59c700 1 -- 172.21.15.80:0/3140221222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f684c19a180 con 0x7f684c06bbf0 2024-04-26T18:33:17.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.055+0000 7f684a59c700 1 --2- 172.21.15.80:0/3140221222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f684c06bbf0 0x7f684c19f860 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f683c00b580 tx=0x7f683c0037c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:17.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.055+0000 7f683b7fe700 1 -- 172.21.15.80:0/3140221222 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f683c027070 con 0x7f684c06bbf0 2024-04-26T18:33:17.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.055+0000 7f683b7fe700 1 -- 172.21.15.80:0/3140221222 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f683c004110 con 0x7f684c06bbf0 2024-04-26T18:33:17.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.055+0000 7f6850af6700 1 -- 172.21.15.80:0/3140221222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f684c19a410 con 0x7f684c06bbf0 2024-04-26T18:33:17.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.055+0000 7f683b7fe700 1 -- 172.21.15.80:0/3140221222 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f683c00f460 con 0x7f684c06bbf0 2024-04-26T18:33:17.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.055+0000 7f6850af6700 1 -- 172.21.15.80:0/3140221222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f684c1a6730 con 0x7f684c06bbf0 2024-04-26T18:33:17.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.056+0000 7f6850af6700 1 -- 172.21.15.80:0/3140221222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f684c10b9d0 con 0x7f684c06bbf0 2024-04-26T18:33:17.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.057+0000 7f683b7fe700 1 -- 172.21.15.80:0/3140221222 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f683c02a070 con 0x7f684c06bbf0 2024-04-26T18:33:17.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.058+0000 7f683b7fe700 1 --2- 172.21.15.80:0/3140221222 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f68340a3c40 0x7f68340a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:17.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.058+0000 7f6849d9b700 1 --2- 172.21.15.80:0/3140221222 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f68340a3c40 0x7f68340a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:17.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.058+0000 7f683b7fe700 1 -- 172.21.15.80:0/3140221222 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7f683c0d1270 con 0x7f684c06bbf0 2024-04-26T18:33:17.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.058+0000 7f6849d9b700 1 --2- 172.21.15.80:0/3140221222 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f68340a3c40 0x7f68340a6100 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6840006fd0 tx=0x7f6840008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:17.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.062+0000 7f683b7fe700 1 -- 172.21.15.80:0/3140221222 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f683c05eff0 con 0x7f684c06bbf0 2024-04-26T18:33:17.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.306+0000 7f6850af6700 1 -- 172.21.15.80:0/3140221222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f684c104bb0 con 0x7f684c06bbf0 2024-04-26T18:33:17.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.620+0000 7f683b7fe700 1 -- 172.21.15.80:0/3140221222 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f683c013070 con 0x7f684c06bbf0 2024-04-26T18:33:17.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.622+0000 7f6850af6700 1 -- 172.21.15.80:0/3140221222 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f68340a3c40 msgr2=0x7f68340a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:17.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.622+0000 7f6850af6700 1 --2- 172.21.15.80:0/3140221222 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f68340a3c40 0x7f68340a6100 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6840006fd0 tx=0x7f6840008040 comp rx=0 tx=0).stop 2024-04-26T18:33:17.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.622+0000 7f6850af6700 1 -- 172.21.15.80:0/3140221222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f684c06bbf0 msgr2=0x7f684c19f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:17.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.622+0000 7f6850af6700 1 --2- 172.21.15.80:0/3140221222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f684c06bbf0 0x7f684c19f860 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f683c00b580 tx=0x7f683c0037c0 comp rx=0 tx=0).stop 2024-04-26T18:33:17.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.622+0000 7f6850af6700 1 -- 172.21.15.80:0/3140221222 shutdown_connections 2024-04-26T18:33:17.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.622+0000 7f6850af6700 1 --2- 172.21.15.80:0/3140221222 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f68340a3c40 0x7f68340a6100 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:17.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.622+0000 7f6850af6700 1 --2- 172.21.15.80:0/3140221222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f684c109540 0x7f684c199a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:17.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.622+0000 7f6850af6700 1 --2- 172.21.15.80:0/3140221222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f684c06bbf0 0x7f684c19f860 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:17.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.622+0000 7f6850af6700 1 --2- 172.21.15.80:0/3140221222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f684c06c5b0 0x7f684c19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:17.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.622+0000 7f6850af6700 1 -- 172.21.15.80:0/3140221222 >> 172.21.15.80:0/3140221222 conn(0x7f684c078230 msgr2=0x7f684c101090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:17.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.622+0000 7f6850af6700 1 -- 172.21.15.80:0/3140221222 shutdown_connections 2024-04-26T18:33:17.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:17.622+0000 7f6850af6700 1 -- 172.21.15.80:0/3140221222 wait complete. 2024-04-26T18:33:17.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:17 smithi082 ceph-mon[32808]: pgmap v302: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-04-26T18:33:17.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:17 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3140221222' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-26T18:33:17.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:17 smithi080 ceph-mon[29135]: pgmap v302: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-04-26T18:33:17.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:17 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3140221222' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-26T18:33:18.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:17 smithi192 ceph-mon[32842]: pgmap v302: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-04-26T18:33:18.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:17 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3140221222' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-26T18:33:18.192 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-04-26T18:33:18.192 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-04-26T18:33:18.430 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:33:18.802 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:18 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3140221222' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-26T18:33:18.802 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:18 smithi080 ceph-mon[29135]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T18:33:18.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:18 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3140221222' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-26T18:33:18.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:18 smithi082 ceph-mon[32808]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T18:33:19.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:18 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3140221222' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-26T18:33:19.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:18 smithi192 ceph-mon[32842]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T18:33:19.891 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:19 smithi080 ceph-mon[29135]: pgmap v303: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-26T18:33:19.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:19 smithi082 ceph-mon[32808]: pgmap v303: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-26T18:33:20.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:19 smithi192 ceph-mon[32842]: pgmap v303: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-26T18:33:20.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.129+0000 7ff51604a700 1 -- 172.21.15.80:0/2758010680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff510102fc0 msgr2=0x7ff510106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:20.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.129+0000 7ff51604a700 1 --2- 172.21.15.80:0/2758010680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff510102fc0 0x7ff510106f80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff5040099c0 tx=0x7ff504009cd0 comp rx=0 tx=0).stop 2024-04-26T18:33:20.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.130+0000 7ff51604a700 1 -- 172.21.15.80:0/2758010680 shutdown_connections 2024-04-26T18:33:20.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.130+0000 7ff51604a700 1 --2- 172.21.15.80:0/2758010680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff510107660 0x7ff51010f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:20.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.130+0000 7ff51604a700 1 --2- 172.21.15.80:0/2758010680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff510102610 0x7ff5101029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:20.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.130+0000 7ff51604a700 1 --2- 172.21.15.80:0/2758010680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff510102fc0 0x7ff510106f80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:20.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.130+0000 7ff51604a700 1 -- 172.21.15.80:0/2758010680 >> 172.21.15.80:0/2758010680 conn(0x7ff510078370 msgr2=0x7ff510078780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:20.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.130+0000 7ff51604a700 1 -- 172.21.15.80:0/2758010680 shutdown_connections 2024-04-26T18:33:20.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.130+0000 7ff51604a700 1 -- 172.21.15.80:0/2758010680 wait complete. 2024-04-26T18:33:20.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.130+0000 7ff51604a700 1 Processor -- start 2024-04-26T18:33:20.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.130+0000 7ff51604a700 1 -- start start 2024-04-26T18:33:20.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.131+0000 7ff51604a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff510102610 0x7ff51019a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:20.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.131+0000 7ff51604a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff510102fc0 0x7ff51019ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:20.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.131+0000 7ff51604a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff510107660 0x7ff5101a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:20.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.131+0000 7ff51604a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff510112550 con 0x7ff510102fc0 2024-04-26T18:33:20.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.131+0000 7ff51604a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff5101123d0 con 0x7ff510102610 2024-04-26T18:33:20.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.131+0000 7ff51604a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff5101126d0 con 0x7ff510107660 2024-04-26T18:33:20.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.131+0000 7ff50effd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff510102fc0 0x7ff51019ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.131+0000 7ff50f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff510102610 0x7ff51019a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.131+0000 7ff50effd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff510102fc0 0x7ff51019ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58560/0 (socket says 172.21.15.80:58560) 2024-04-26T18:33:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.131+0000 7ff50effd700 1 -- 172.21.15.80:0/1981460540 learned_addr learned my addr 172.21.15.80:0/1981460540 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:33:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.131+0000 7ff50ffff700 1 --2- 172.21.15.80:0/1981460540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff510107660 0x7ff5101a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.131+0000 7ff50effd700 1 -- 172.21.15.80:0/1981460540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff510107660 msgr2=0x7ff5101a5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.131+0000 7ff50effd700 1 --2- 172.21.15.80:0/1981460540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff510107660 0x7ff5101a5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.131+0000 7ff50effd700 1 -- 172.21.15.80:0/1981460540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff510102610 msgr2=0x7ff51019a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.131+0000 7ff50effd700 1 --2- 172.21.15.80:0/1981460540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff510102610 0x7ff51019a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.131+0000 7ff50effd700 1 -- 172.21.15.80:0/1981460540 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5101a5e90 con 0x7ff510102fc0 2024-04-26T18:33:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.131+0000 7ff50ffff700 1 --2- 172.21.15.80:0/1981460540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff510107660 0x7ff5101a5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:33:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.131+0000 7ff50effd700 1 --2- 172.21.15.80:0/1981460540 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff510102fc0 0x7ff51019ae10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff504009f50 tx=0x7ff5040037c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.131+0000 7ff50cff9700 1 -- 172.21.15.80:0/1981460540 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff504027070 con 0x7ff510102fc0 2024-04-26T18:33:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.132+0000 7ff50cff9700 1 -- 172.21.15.80:0/1981460540 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff504004090 con 0x7ff510102fc0 2024-04-26T18:33:20.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.132+0000 7ff51604a700 1 -- 172.21.15.80:0/1981460540 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5101a60c0 con 0x7ff510102fc0 2024-04-26T18:33:20.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.132+0000 7ff50cff9700 1 -- 172.21.15.80:0/1981460540 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff504022e60 con 0x7ff510102fc0 2024-04-26T18:33:20.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.132+0000 7ff51604a700 1 -- 172.21.15.80:0/1981460540 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5101a6510 con 0x7ff510102fc0 2024-04-26T18:33:20.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.132+0000 7ff51604a700 1 -- 172.21.15.80:0/1981460540 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff51006a110 con 0x7ff510102fc0 2024-04-26T18:33:20.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.134+0000 7ff50cff9700 1 -- 172.21.15.80:0/1981460540 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7ff50402a070 con 0x7ff510102fc0 2024-04-26T18:33:20.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.134+0000 7ff50cff9700 1 --2- 172.21.15.80:0/1981460540 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff4f80a3c40 0x7ff4f80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:20.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.134+0000 7ff50f7fe700 1 --2- 172.21.15.80:0/1981460540 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff4f80a3c40 0x7ff4f80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:20.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.134+0000 7ff50cff9700 1 -- 172.21.15.80:0/1981460540 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7ff5040d11c0 con 0x7ff510102fc0 2024-04-26T18:33:20.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.135+0000 7ff50f7fe700 1 --2- 172.21.15.80:0/1981460540 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff4f80a3c40 0x7ff4f80a6100 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff500009a10 tx=0x7ff500009190 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:20.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.138+0000 7ff50cff9700 1 -- 172.21.15.80:0/1981460540 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff504013070 con 0x7ff510102fc0 2024-04-26T18:33:20.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.380+0000 7ff51604a700 1 -- 172.21.15.80:0/1981460540 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7ff51002e490 con 0x7ff510102fc0 2024-04-26T18:33:20.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.635+0000 7ff50cff9700 1 -- 172.21.15.80:0/1981460540 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v17) ==== 105+0+0 (secure 0 0 0) 0x7ff50409dd80 con 0x7ff510102fc0 2024-04-26T18:33:20.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.638+0000 7ff51604a700 1 -- 172.21.15.80:0/1981460540 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff4f80a3c40 msgr2=0x7ff4f80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:20.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.638+0000 7ff51604a700 1 --2- 172.21.15.80:0/1981460540 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff4f80a3c40 0x7ff4f80a6100 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff500009a10 tx=0x7ff500009190 comp rx=0 tx=0).stop 2024-04-26T18:33:20.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.638+0000 7ff51604a700 1 -- 172.21.15.80:0/1981460540 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff510102fc0 msgr2=0x7ff51019ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:20.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.638+0000 7ff51604a700 1 --2- 172.21.15.80:0/1981460540 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff510102fc0 0x7ff51019ae10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff504009f50 tx=0x7ff5040037c0 comp rx=0 tx=0).stop 2024-04-26T18:33:20.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.638+0000 7ff51604a700 1 -- 172.21.15.80:0/1981460540 shutdown_connections 2024-04-26T18:33:20.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.638+0000 7ff51604a700 1 --2- 172.21.15.80:0/1981460540 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff4f80a3c40 0x7ff4f80a6100 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:20.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.638+0000 7ff51604a700 1 --2- 172.21.15.80:0/1981460540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff510107660 0x7ff5101a5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:20.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.638+0000 7ff51604a700 1 --2- 172.21.15.80:0/1981460540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff510102610 0x7ff51019a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:20.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.638+0000 7ff51604a700 1 --2- 172.21.15.80:0/1981460540 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff510102fc0 0x7ff51019ae10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:20.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.638+0000 7ff51604a700 1 -- 172.21.15.80:0/1981460540 >> 172.21.15.80:0/1981460540 conn(0x7ff510078370 msgr2=0x7ff5101003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:20.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.638+0000 7ff51604a700 1 -- 172.21.15.80:0/1981460540 shutdown_connections 2024-04-26T18:33:20.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:20.638+0000 7ff51604a700 1 -- 172.21.15.80:0/1981460540 wait complete. 2024-04-26T18:33:20.932 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:20 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1981460540' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-26T18:33:20.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:20 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1981460540' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-26T18:33:21.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:20 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1981460540' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-26T18:33:21.417 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-04-26T18:33:21.677 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:33:21.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:21 smithi080 ceph-mon[29135]: pgmap v304: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-26T18:33:21.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:21 smithi080 ceph-mon[29135]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-26T18:33:21.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:21 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1981460540' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-26T18:33:21.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:21 smithi080 ceph-mon[29135]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-26T18:33:21.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:21 smithi080 ceph-mon[29135]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T18:33:21.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:21 smithi080 ceph-mon[29135]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-04-26T18:33:21.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:21 smithi080 ceph-mon[29135]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-26T18:33:21.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:21 smithi082 ceph-mon[32808]: pgmap v304: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-26T18:33:21.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:21 smithi082 ceph-mon[32808]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-26T18:33:21.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:21 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1981460540' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-26T18:33:21.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:21 smithi082 ceph-mon[32808]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-26T18:33:21.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:21 smithi082 ceph-mon[32808]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T18:33:21.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:21 smithi082 ceph-mon[32808]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-04-26T18:33:21.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:21 smithi082 ceph-mon[32808]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-26T18:33:22.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:21 smithi192 ceph-mon[32842]: pgmap v304: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-26T18:33:22.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:21 smithi192 ceph-mon[32842]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-26T18:33:22.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:21 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1981460540' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-26T18:33:22.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:21 smithi192 ceph-mon[32842]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-26T18:33:22.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:21 smithi192 ceph-mon[32842]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T18:33:22.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:21 smithi192 ceph-mon[32842]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-04-26T18:33:22.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:21 smithi192 ceph-mon[32842]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-26T18:33:22.948 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:22 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] up:active 2024-04-26T18:33:22.948 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:22 smithi080 ceph-mon[29135]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-26T18:33:22.948 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:22 smithi080 ceph-mon[29135]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-04-26T18:33:22.948 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:22 smithi080 ceph-mon[29135]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-04-26T18:33:22.948 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:22 smithi080 ceph-mon[29135]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-04-26T18:33:22.969 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 26 18:33:22 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-b[63537]: 2024-04-26T18:33:22.563+0000 7f69dfc1e700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-26T18:33:22.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:22 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] up:active 2024-04-26T18:33:22.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:22 smithi082 ceph-mon[32808]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-26T18:33:22.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:22 smithi082 ceph-mon[32808]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-04-26T18:33:22.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:22 smithi082 ceph-mon[32808]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-04-26T18:33:22.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:22 smithi082 ceph-mon[32808]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-04-26T18:33:23.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:22 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] up:active 2024-04-26T18:33:23.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:22 smithi192 ceph-mon[32842]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-26T18:33:23.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:22 smithi192 ceph-mon[32842]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-04-26T18:33:23.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:22 smithi192 ceph-mon[32842]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-04-26T18:33:23.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:22 smithi192 ceph-mon[32842]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-04-26T18:33:23.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.471+0000 7f4d33067700 1 -- 172.21.15.80:0/3060408992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2c102610 msgr2=0x7f4d2c1029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:23.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.471+0000 7f4d33067700 1 --2- 172.21.15.80:0/3060408992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2c102610 0x7f4d2c1029f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4d200099c0 tx=0x7f4d20009cd0 comp rx=0 tx=0).stop 2024-04-26T18:33:23.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.471+0000 7f4d33067700 1 -- 172.21.15.80:0/3060408992 shutdown_connections 2024-04-26T18:33:23.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.471+0000 7f4d33067700 1 --2- 172.21.15.80:0/3060408992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d2c107660 0x7f4d2c10f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:23.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.471+0000 7f4d33067700 1 --2- 172.21.15.80:0/3060408992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2c102610 0x7f4d2c1029f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:23.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.471+0000 7f4d33067700 1 --2- 172.21.15.80:0/3060408992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d2c102fc0 0x7f4d2c106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:23.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.471+0000 7f4d33067700 1 -- 172.21.15.80:0/3060408992 >> 172.21.15.80:0/3060408992 conn(0x7f4d2c078370 msgr2=0x7f4d2c078780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:23.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.471+0000 7f4d33067700 1 -- 172.21.15.80:0/3060408992 shutdown_connections 2024-04-26T18:33:23.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.471+0000 7f4d33067700 1 -- 172.21.15.80:0/3060408992 wait complete. 2024-04-26T18:33:23.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.472+0000 7f4d33067700 1 Processor -- start 2024-04-26T18:33:23.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.472+0000 7f4d33067700 1 -- start start 2024-04-26T18:33:23.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.472+0000 7f4d33067700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2c102610 0x7f4d2c19f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:23.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.472+0000 7f4d33067700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d2c102fc0 0x7f4d2c19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:23.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.472+0000 7f4d33067700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d2c107660 0x7f4d2c199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:23.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.472+0000 7f4d33067700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2c1124f0 con 0x7f4d2c102610 2024-04-26T18:33:23.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.472+0000 7f4d33067700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2c112370 con 0x7f4d2c107660 2024-04-26T18:33:23.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.472+0000 7f4d33067700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2c112670 con 0x7f4d2c102fc0 2024-04-26T18:33:23.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.472+0000 7f4d30e03700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2c102610 0x7f4d2c19f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:23.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.472+0000 7f4d30e03700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2c102610 0x7f4d2c19f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58596/0 (socket says 172.21.15.80:58596) 2024-04-26T18:33:23.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.472+0000 7f4d30e03700 1 -- 172.21.15.80:0/246224119 learned_addr learned my addr 172.21.15.80:0/246224119 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:33:23.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.472+0000 7f4d31604700 1 --2- 172.21.15.80:0/246224119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d2c107660 0x7f4d2c199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:23.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.473+0000 7f4d2bfff700 1 --2- 172.21.15.80:0/246224119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d2c102fc0 0x7f4d2c19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:23.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.473+0000 7f4d30e03700 1 -- 172.21.15.80:0/246224119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d2c102fc0 msgr2=0x7f4d2c19fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:23.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.473+0000 7f4d30e03700 1 --2- 172.21.15.80:0/246224119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d2c102fc0 0x7f4d2c19fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:23.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.473+0000 7f4d30e03700 1 -- 172.21.15.80:0/246224119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d2c107660 msgr2=0x7f4d2c199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:23.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.473+0000 7f4d30e03700 1 --2- 172.21.15.80:0/246224119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d2c107660 0x7f4d2c199990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:23.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.473+0000 7f4d30e03700 1 -- 172.21.15.80:0/246224119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d2c19a0f0 con 0x7f4d2c102610 2024-04-26T18:33:23.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.473+0000 7f4d2bfff700 1 --2- 172.21.15.80:0/246224119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d2c102fc0 0x7f4d2c19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:33:23.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.473+0000 7f4d30e03700 1 --2- 172.21.15.80:0/246224119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2c102610 0x7f4d2c19f780 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4d20006010 tx=0x7f4d200045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:23.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.473+0000 7f4d29ffb700 1 -- 172.21.15.80:0/246224119 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d20026070 con 0x7f4d2c102610 2024-04-26T18:33:23.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.473+0000 7f4d29ffb700 1 -- 172.21.15.80:0/246224119 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d2000f460 con 0x7f4d2c102610 2024-04-26T18:33:23.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.473+0000 7f4d33067700 1 -- 172.21.15.80:0/246224119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d2c19a380 con 0x7f4d2c102610 2024-04-26T18:33:23.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.473+0000 7f4d29ffb700 1 -- 172.21.15.80:0/246224119 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d20009e60 con 0x7f4d2c102610 2024-04-26T18:33:23.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.473+0000 7f4d33067700 1 -- 172.21.15.80:0/246224119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d2c1a6650 con 0x7f4d2c102610 2024-04-26T18:33:23.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.474+0000 7f4d33067700 1 -- 172.21.15.80:0/246224119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d2c103a60 con 0x7f4d2c102610 2024-04-26T18:33:23.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.475+0000 7f4d29ffb700 1 -- 172.21.15.80:0/246224119 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f4d20029070 con 0x7f4d2c102610 2024-04-26T18:33:23.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.476+0000 7f4d29ffb700 1 --2- 172.21.15.80:0/246224119 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f4d1c0a3c40 0x7f4d1c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:23.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.476+0000 7f4d2bfff700 1 --2- 172.21.15.80:0/246224119 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f4d1c0a3c40 0x7f4d1c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:23.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.476+0000 7f4d29ffb700 1 -- 172.21.15.80:0/246224119 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7f4d200d0d40 con 0x7f4d2c102610 2024-04-26T18:33:23.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.476+0000 7f4d2bfff700 1 --2- 172.21.15.80:0/246224119 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f4d1c0a3c40 0x7f4d1c0a6100 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4d18005fd0 tx=0x7f4d18005ee0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:23.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.479+0000 7f4d29ffb700 1 -- 172.21.15.80:0/246224119 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4d20030080 con 0x7f4d2c102610 2024-04-26T18:33:23.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.727+0000 7f4d33067700 1 -- 172.21.15.80:0/246224119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f4d2c02e490 con 0x7f4d2c102610 2024-04-26T18:33:23.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:23 smithi080 ceph-mon[29135]: pgmap v305: 97 pgs: 97 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 5 op/s 2024-04-26T18:33:23.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:23 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] up:active 2024-04-26T18:33:23.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:23 smithi080 ceph-mon[29135]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-26T18:33:23.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:23 smithi080 ceph-mon[29135]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-04-26T18:33:23.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:23 smithi080 ceph-mon[29135]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-04-26T18:33:23.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:23 smithi080 ceph-mon[29135]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-04-26T18:33:23.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.907+0000 7f4d29ffb700 1 -- 172.21.15.80:0/246224119 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f4d20013070 con 0x7f4d2c102610 2024-04-26T18:33:23.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.910+0000 7f4d33067700 1 -- 172.21.15.80:0/246224119 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f4d1c0a3c40 msgr2=0x7f4d1c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:23.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.910+0000 7f4d33067700 1 --2- 172.21.15.80:0/246224119 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f4d1c0a3c40 0x7f4d1c0a6100 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4d18005fd0 tx=0x7f4d18005ee0 comp rx=0 tx=0).stop 2024-04-26T18:33:23.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.910+0000 7f4d33067700 1 -- 172.21.15.80:0/246224119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2c102610 msgr2=0x7f4d2c19f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:23.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.910+0000 7f4d33067700 1 --2- 172.21.15.80:0/246224119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2c102610 0x7f4d2c19f780 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4d20006010 tx=0x7f4d200045e0 comp rx=0 tx=0).stop 2024-04-26T18:33:23.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.910+0000 7f4d33067700 1 -- 172.21.15.80:0/246224119 shutdown_connections 2024-04-26T18:33:23.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.910+0000 7f4d33067700 1 --2- 172.21.15.80:0/246224119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d2c107660 0x7f4d2c199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:23.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.910+0000 7f4d33067700 1 --2- 172.21.15.80:0/246224119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d2c102610 0x7f4d2c19f780 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:23.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.910+0000 7f4d33067700 1 --2- 172.21.15.80:0/246224119 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f4d1c0a3c40 0x7f4d1c0a6100 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:23.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.910+0000 7f4d33067700 1 --2- 172.21.15.80:0/246224119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d2c102fc0 0x7f4d2c19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:23.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.910+0000 7f4d33067700 1 -- 172.21.15.80:0/246224119 >> 172.21.15.80:0/246224119 conn(0x7f4d2c078370 msgr2=0x7f4d2c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:23.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.910+0000 7f4d33067700 1 -- 172.21.15.80:0/246224119 shutdown_connections 2024-04-26T18:33:23.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:23.910+0000 7f4d33067700 1 -- 172.21.15.80:0/246224119 wait complete. 2024-04-26T18:33:23.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:23 smithi082 ceph-mon[32808]: pgmap v305: 97 pgs: 97 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 5 op/s 2024-04-26T18:33:23.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:23 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] up:active 2024-04-26T18:33:23.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:23 smithi082 ceph-mon[32808]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-26T18:33:23.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:23 smithi082 ceph-mon[32808]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-04-26T18:33:23.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:23 smithi082 ceph-mon[32808]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-04-26T18:33:23.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:23 smithi082 ceph-mon[32808]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-04-26T18:33:24.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:23 smithi192 ceph-mon[32842]: pgmap v305: 97 pgs: 97 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 5 op/s 2024-04-26T18:33:24.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:23 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] up:active 2024-04-26T18:33:24.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:23 smithi192 ceph-mon[32842]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-26T18:33:24.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:23 smithi192 ceph-mon[32842]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-04-26T18:33:24.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:23 smithi192 ceph-mon[32842]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-04-26T18:33:24.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:23 smithi192 ceph-mon[32842]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-04-26T18:33:24.747 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-04-26T18:33:24.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:24 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] up:active 2024-04-26T18:33:24.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:24 smithi082 ceph-mon[32808]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-26T18:33:24.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:24 smithi082 ceph-mon[32808]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-26T18:33:24.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:24 smithi082 ceph-mon[32808]: Cluster is now healthy 2024-04-26T18:33:24.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:24 smithi082 ceph-mon[32808]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-04-26T18:33:24.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:24 smithi082 ceph-mon[32808]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-04-26T18:33:24.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:24 smithi082 ceph-mon[32808]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-04-26T18:33:24.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:24 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/246224119' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-26T18:33:24.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:24 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/246224119' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-26T18:33:24.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:24 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] up:active 2024-04-26T18:33:24.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:24 smithi082 ceph-mon[32808]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T18:33:24.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:24 smithi082 ceph-mon[32808]: pgmap v306: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s wr, 8 op/s 2024-04-26T18:33:24.991 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:33:24.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:24 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] up:active 2024-04-26T18:33:24.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:24 smithi080 ceph-mon[29135]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-26T18:33:24.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:24 smithi080 ceph-mon[29135]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-26T18:33:24.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:24 smithi080 ceph-mon[29135]: Cluster is now healthy 2024-04-26T18:33:24.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:24 smithi080 ceph-mon[29135]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-04-26T18:33:24.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:24 smithi080 ceph-mon[29135]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-04-26T18:33:24.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:24 smithi080 ceph-mon[29135]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-04-26T18:33:24.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:24 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/246224119' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-26T18:33:24.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:24 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/246224119' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-26T18:33:24.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:24 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] up:active 2024-04-26T18:33:24.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:24 smithi080 ceph-mon[29135]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T18:33:24.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:24 smithi080 ceph-mon[29135]: pgmap v306: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s wr, 8 op/s 2024-04-26T18:33:25.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:24 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] up:active 2024-04-26T18:33:25.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:24 smithi192 ceph-mon[32842]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-26T18:33:25.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:24 smithi192 ceph-mon[32842]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-26T18:33:25.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:24 smithi192 ceph-mon[32842]: Cluster is now healthy 2024-04-26T18:33:25.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:24 smithi192 ceph-mon[32842]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-04-26T18:33:25.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:24 smithi192 ceph-mon[32842]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-04-26T18:33:25.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:24 smithi192 ceph-mon[32842]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-04-26T18:33:25.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:24 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/246224119' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-26T18:33:25.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:24 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/246224119' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-26T18:33:25.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:24 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] up:active 2024-04-26T18:33:25.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:24 smithi192 ceph-mon[32842]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T18:33:25.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:24 smithi192 ceph-mon[32842]: pgmap v306: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s wr, 8 op/s 2024-04-26T18:33:26.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.773+0000 7fefcdf16700 1 -- 172.21.15.80:0/3448517925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefc81094b0 msgr2=0x7fefc8109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:26.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.773+0000 7fefcdf16700 1 --2- 172.21.15.80:0/3448517925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefc81094b0 0x7fefc8109890 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fefb800b0a0 tx=0x7fefb800b3b0 comp rx=0 tx=0).stop 2024-04-26T18:33:26.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.773+0000 7fefcdf16700 1 -- 172.21.15.80:0/3448517925 shutdown_connections 2024-04-26T18:33:26.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.773+0000 7fefcdf16700 1 --2- 172.21.15.80:0/3448517925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefc8102330 0x7fefc81102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:26.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.773+0000 7fefcdf16700 1 --2- 172.21.15.80:0/3448517925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefc81094b0 0x7fefc8109890 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:26.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.773+0000 7fefcdf16700 1 --2- 172.21.15.80:0/3448517925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefc8101970 0x7fefc8101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:26.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.773+0000 7fefcdf16700 1 -- 172.21.15.80:0/3448517925 >> 172.21.15.80:0/3448517925 conn(0x7fefc8078920 msgr2=0x7fefc80ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:26.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.773+0000 7fefcdf16700 1 -- 172.21.15.80:0/3448517925 shutdown_connections 2024-04-26T18:33:26.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.773+0000 7fefcdf16700 1 -- 172.21.15.80:0/3448517925 wait complete. 2024-04-26T18:33:26.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.773+0000 7fefcdf16700 1 Processor -- start 2024-04-26T18:33:26.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.773+0000 7fefcdf16700 1 -- start start 2024-04-26T18:33:26.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.774+0000 7fefcdf16700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefc8101970 0x7fefc819f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:26.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.774+0000 7fefcdf16700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefc8102330 0x7fefc819fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:26.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.774+0000 7fefcdf16700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefc81094b0 0x7fefc8199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:26.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.774+0000 7fefcdf16700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fefc8113640 con 0x7fefc81094b0 2024-04-26T18:33:26.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.774+0000 7fefcdf16700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fefc81134c0 con 0x7fefc8101970 2024-04-26T18:33:26.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.774+0000 7fefcdf16700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fefc81137c0 con 0x7fefc8102330 2024-04-26T18:33:26.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.774+0000 7fefc7fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefc81094b0 0x7fefc8199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:26.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.774+0000 7fefc7fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefc81094b0 0x7fefc8199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58612/0 (socket says 172.21.15.80:58612) 2024-04-26T18:33:26.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.774+0000 7fefc7fff700 1 -- 172.21.15.80:0/3324640700 learned_addr learned my addr 172.21.15.80:0/3324640700 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:33:26.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.774+0000 7fefc77fe700 1 --2- 172.21.15.80:0/3324640700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefc8101970 0x7fefc819f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:26.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.774+0000 7fefc6ffd700 1 --2- 172.21.15.80:0/3324640700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefc8102330 0x7fefc819fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:26.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.774+0000 7fefc7fff700 1 -- 172.21.15.80:0/3324640700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefc8102330 msgr2=0x7fefc819fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:26.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.774+0000 7fefc7fff700 1 --2- 172.21.15.80:0/3324640700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefc8102330 0x7fefc819fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:26.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.774+0000 7fefc7fff700 1 -- 172.21.15.80:0/3324640700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefc8101970 msgr2=0x7fefc819f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:26.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.774+0000 7fefc7fff700 1 --2- 172.21.15.80:0/3324640700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefc8101970 0x7fefc819f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:26.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.774+0000 7fefc7fff700 1 -- 172.21.15.80:0/3324640700 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc819a080 con 0x7fefc81094b0 2024-04-26T18:33:26.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.774+0000 7fefc6ffd700 1 --2- 172.21.15.80:0/3324640700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefc8102330 0x7fefc819fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:33:26.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.774+0000 7fefc7fff700 1 --2- 172.21.15.80:0/3324640700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefc81094b0 0x7fefc8199920 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fefc000b550 tx=0x7fefc000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:26.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.774+0000 7fefc4ff9700 1 -- 172.21.15.80:0/3324640700 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0015020 con 0x7fefc81094b0 2024-04-26T18:33:26.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.775+0000 7fefcdf16700 1 -- 172.21.15.80:0/3324640700 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefc819a370 con 0x7fefc81094b0 2024-04-26T18:33:26.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.775+0000 7fefc4ff9700 1 -- 172.21.15.80:0/3324640700 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefc0011ce0 con 0x7fefc81094b0 2024-04-26T18:33:26.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.775+0000 7fefc4ff9700 1 -- 172.21.15.80:0/3324640700 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0010dd0 con 0x7fefc81094b0 2024-04-26T18:33:26.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.775+0000 7fefcdf16700 1 -- 172.21.15.80:0/3324640700 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefc81a6630 con 0x7fefc81094b0 2024-04-26T18:33:26.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.776+0000 7fefcdf16700 1 -- 172.21.15.80:0/3324640700 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefc806a110 con 0x7fefc81094b0 2024-04-26T18:33:26.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.777+0000 7fefc4ff9700 1 -- 172.21.15.80:0/3324640700 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fefc0018020 con 0x7fefc81094b0 2024-04-26T18:33:26.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.777+0000 7fefc4ff9700 1 --2- 172.21.15.80:0/3324640700 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fefb00a3c40 0x7fefb00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:26.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.777+0000 7fefc77fe700 1 --2- 172.21.15.80:0/3324640700 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fefb00a3c40 0x7fefb00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:26.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.777+0000 7fefc4ff9700 1 -- 172.21.15.80:0/3324640700 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7fefc00cfa30 con 0x7fefc81094b0 2024-04-26T18:33:26.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.778+0000 7fefc77fe700 1 --2- 172.21.15.80:0/3324640700 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fefb00a3c40 0x7fefb00a6100 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009e60 tx=0x7fefb800b7b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:26.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:26.782+0000 7fefc4ff9700 1 -- 172.21.15.80:0/3324640700 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fefc001f020 con 0x7fefc81094b0 2024-04-26T18:33:27.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:27.034+0000 7fefcdf16700 1 -- 172.21.15.80:0/3324640700 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fefc802e490 con 0x7fefc81094b0 2024-04-26T18:33:27.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:27.571+0000 7fefc4ff9700 1 -- 172.21.15.80:0/3324640700 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7fefc009c560 con 0x7fefc81094b0 2024-04-26T18:33:27.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:27.573+0000 7fefcdf16700 1 -- 172.21.15.80:0/3324640700 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fefb00a3c40 msgr2=0x7fefb00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:27.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:27.573+0000 7fefcdf16700 1 --2- 172.21.15.80:0/3324640700 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fefb00a3c40 0x7fefb00a6100 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009e60 tx=0x7fefb800b7b0 comp rx=0 tx=0).stop 2024-04-26T18:33:27.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:27.573+0000 7fefcdf16700 1 -- 172.21.15.80:0/3324640700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefc81094b0 msgr2=0x7fefc8199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:27.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:27.573+0000 7fefcdf16700 1 --2- 172.21.15.80:0/3324640700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefc81094b0 0x7fefc8199920 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fefc000b550 tx=0x7fefc000b860 comp rx=0 tx=0).stop 2024-04-26T18:33:27.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:27.574+0000 7fefcdf16700 1 -- 172.21.15.80:0/3324640700 shutdown_connections 2024-04-26T18:33:27.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:27.574+0000 7fefcdf16700 1 --2- 172.21.15.80:0/3324640700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefc81094b0 0x7fefc8199920 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:27.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:27.574+0000 7fefcdf16700 1 --2- 172.21.15.80:0/3324640700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefc8101970 0x7fefc819f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:27.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:27.574+0000 7fefcdf16700 1 --2- 172.21.15.80:0/3324640700 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fefb00a3c40 0x7fefb00a6100 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:27.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:27.574+0000 7fefcdf16700 1 --2- 172.21.15.80:0/3324640700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefc8102330 0x7fefc819fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:27.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:27.574+0000 7fefcdf16700 1 -- 172.21.15.80:0/3324640700 >> 172.21.15.80:0/3324640700 conn(0x7fefc8078920 msgr2=0x7fefc8100050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:27.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:27.574+0000 7fefcdf16700 1 -- 172.21.15.80:0/3324640700 shutdown_connections 2024-04-26T18:33:27.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:27.574+0000 7fefcdf16700 1 -- 172.21.15.80:0/3324640700 wait complete. 2024-04-26T18:33:27.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:27 smithi192 ceph-mon[32842]: pgmap v307: 97 pgs: 97 active+clean; 583 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-04-26T18:33:27.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:27 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3324640700' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-26T18:33:27.898 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:27 smithi080 ceph-mon[29135]: pgmap v307: 97 pgs: 97 active+clean; 583 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-04-26T18:33:27.898 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:27 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3324640700' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-26T18:33:27.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:27 smithi082 ceph-mon[32808]: pgmap v307: 97 pgs: 97 active+clean; 583 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-04-26T18:33:27.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:27 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3324640700' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-26T18:33:27.970 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 26 18:33:27 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-b[63537]: 2024-04-26T18:33:27.563+0000 7f69dfc1e700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-04-26T18:33:28.355 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-04-26T18:33:28.355 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-04-26T18:33:28.597 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:33:28.838 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:28 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3324640700' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-26T18:33:28.838 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:28 smithi080 ceph-mon[29135]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T18:33:28.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:28 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3324640700' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-26T18:33:28.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:28 smithi192 ceph-mon[32842]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T18:33:28.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:28 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3324640700' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-26T18:33:28.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:28 smithi082 ceph-mon[32808]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T18:33:29.708 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:29 smithi080 ceph-mon[29135]: pgmap v308: 97 pgs: 97 active+clean; 584 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 4.0 KiB/s wr, 17 op/s 2024-04-26T18:33:29.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:29 smithi192 ceph-mon[32842]: pgmap v308: 97 pgs: 97 active+clean; 584 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 4.0 KiB/s wr, 17 op/s 2024-04-26T18:33:29.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:29 smithi082 ceph-mon[32808]: pgmap v308: 97 pgs: 97 active+clean; 584 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 4.0 KiB/s wr, 17 op/s 2024-04-26T18:33:30.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.267+0000 7f70af1dd700 1 -- 172.21.15.80:0/2723808699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a8103470 msgr2=0x7f70a81038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:30.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.267+0000 7f70af1dd700 1 --2- 172.21.15.80:0/2723808699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a8103470 0x7f70a81038f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7094009990 tx=0x7f7094009ca0 comp rx=0 tx=0).stop 2024-04-26T18:33:30.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.267+0000 7f70af1dd700 1 -- 172.21.15.80:0/2723808699 shutdown_connections 2024-04-26T18:33:30.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.267+0000 7f70af1dd700 1 --2- 172.21.15.80:0/2723808699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a8103e30 0x7f70a8110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:30.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.267+0000 7f70af1dd700 1 --2- 172.21.15.80:0/2723808699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70a81094c0 0x7f70a81098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:30.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.267+0000 7f70af1dd700 1 --2- 172.21.15.80:0/2723808699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a8103470 0x7f70a81038f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:30.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.267+0000 7f70af1dd700 1 -- 172.21.15.80:0/2723808699 >> 172.21.15.80:0/2723808699 conn(0x7f70a807a580 msgr2=0x7f70a807a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:30.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.267+0000 7f70af1dd700 1 -- 172.21.15.80:0/2723808699 shutdown_connections 2024-04-26T18:33:30.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.267+0000 7f70af1dd700 1 -- 172.21.15.80:0/2723808699 wait complete. 2024-04-26T18:33:30.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.268+0000 7f70af1dd700 1 Processor -- start 2024-04-26T18:33:30.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.268+0000 7f70af1dd700 1 -- start start 2024-04-26T18:33:30.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.268+0000 7f70af1dd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a8103470 0x7f70a819f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:30.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.268+0000 7f70af1dd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70a8103e30 0x7f70a819fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:30.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.268+0000 7f70af1dd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a81094c0 0x7f70a8199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:30.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.268+0000 7f70af1dd700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f70a81135e0 con 0x7f70a81094c0 2024-04-26T18:33:30.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.268+0000 7f70af1dd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f70a8113460 con 0x7f70a8103470 2024-04-26T18:33:30.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.268+0000 7f70af1dd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f70a8113760 con 0x7f70a8103e30 2024-04-26T18:33:30.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.268+0000 7f70ad77a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a81094c0 0x7f70a8199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:30.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.268+0000 7f70ad77a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a81094c0 0x7f70a8199960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58624/0 (socket says 172.21.15.80:58624) 2024-04-26T18:33:30.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.268+0000 7f70ad77a700 1 -- 172.21.15.80:0/582933256 learned_addr learned my addr 172.21.15.80:0/582933256 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:33:30.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.268+0000 7f70a7fff700 1 --2- 172.21.15.80:0/582933256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70a8103e30 0x7f70a819fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:30.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.268+0000 7f70acf79700 1 --2- 172.21.15.80:0/582933256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a8103470 0x7f70a819f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:30.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.268+0000 7f70ad77a700 1 -- 172.21.15.80:0/582933256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70a8103e30 msgr2=0x7f70a819fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:30.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.269+0000 7f70ad77a700 1 --2- 172.21.15.80:0/582933256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70a8103e30 0x7f70a819fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:30.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.269+0000 7f70ad77a700 1 -- 172.21.15.80:0/582933256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a8103470 msgr2=0x7f70a819f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:30.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.269+0000 7f70ad77a700 1 --2- 172.21.15.80:0/582933256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a8103470 0x7f70a819f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:30.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.269+0000 7f70ad77a700 1 -- 172.21.15.80:0/582933256 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a819a0c0 con 0x7f70a81094c0 2024-04-26T18:33:30.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.269+0000 7f70ad77a700 1 --2- 172.21.15.80:0/582933256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a81094c0 0x7f70a8199960 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f70a000ada0 tx=0x7f70a000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:30.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.269+0000 7f70a5ffb700 1 -- 172.21.15.80:0/582933256 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a0017020 con 0x7f70a81094c0 2024-04-26T18:33:30.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.269+0000 7f70a5ffb700 1 -- 172.21.15.80:0/582933256 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70a000cd80 con 0x7f70a81094c0 2024-04-26T18:33:30.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.269+0000 7f70af1dd700 1 -- 172.21.15.80:0/582933256 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70a819a3b0 con 0x7f70a81094c0 2024-04-26T18:33:30.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.269+0000 7f70a5ffb700 1 -- 172.21.15.80:0/582933256 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a0005260 con 0x7f70a81094c0 2024-04-26T18:33:30.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.269+0000 7f70af1dd700 1 -- 172.21.15.80:0/582933256 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70a81a6670 con 0x7f70a81094c0 2024-04-26T18:33:30.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.270+0000 7f70af1dd700 1 -- 172.21.15.80:0/582933256 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70a806a110 con 0x7f70a81094c0 2024-04-26T18:33:30.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.271+0000 7f70a5ffb700 1 -- 172.21.15.80:0/582933256 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f70a000c8d0 con 0x7f70a81094c0 2024-04-26T18:33:30.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.272+0000 7f70a5ffb700 1 --2- 172.21.15.80:0/582933256 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f70980a3c40 0x7f70980a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:30.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.272+0000 7f70acf79700 1 --2- 172.21.15.80:0/582933256 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f70980a3c40 0x7f70980a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:30.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.272+0000 7f70a5ffb700 1 -- 172.21.15.80:0/582933256 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7f70a00cf9e0 con 0x7f70a81094c0 2024-04-26T18:33:30.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.272+0000 7f70acf79700 1 --2- 172.21.15.80:0/582933256 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f70980a3c40 0x7f70980a6100 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f70a819aaa0 tx=0x7f709c00b3c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:30.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.276+0000 7f70a5ffb700 1 -- 172.21.15.80:0/582933256 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f70a0021020 con 0x7f70a81094c0 2024-04-26T18:33:30.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.505+0000 7f70af1dd700 1 -- 172.21.15.80:0/582933256 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f70a8063860 con 0x7f70980a3c40 2024-04-26T18:33:30.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.531+0000 7f70a5ffb700 1 -- 172.21.15.80:0/582933256 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f70a8063860 con 0x7f70980a3c40 2024-04-26T18:33:30.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.533+0000 7f70af1dd700 1 -- 172.21.15.80:0/582933256 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f70980a3c40 msgr2=0x7f70980a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:30.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.533+0000 7f70af1dd700 1 --2- 172.21.15.80:0/582933256 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f70980a3c40 0x7f70980a6100 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f70a819aaa0 tx=0x7f709c00b3c0 comp rx=0 tx=0).stop 2024-04-26T18:33:30.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.533+0000 7f70af1dd700 1 -- 172.21.15.80:0/582933256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a81094c0 msgr2=0x7f70a8199960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:30.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.533+0000 7f70af1dd700 1 --2- 172.21.15.80:0/582933256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a81094c0 0x7f70a8199960 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f70a000ada0 tx=0x7f70a000c330 comp rx=0 tx=0).stop 2024-04-26T18:33:30.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.533+0000 7f70af1dd700 1 -- 172.21.15.80:0/582933256 shutdown_connections 2024-04-26T18:33:30.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.533+0000 7f70af1dd700 1 --2- 172.21.15.80:0/582933256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70a81094c0 0x7f70a8199960 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:30.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.533+0000 7f70af1dd700 1 --2- 172.21.15.80:0/582933256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a8103470 0x7f70a819f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:30.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.533+0000 7f70af1dd700 1 --2- 172.21.15.80:0/582933256 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f70980a3c40 0x7f70980a6100 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:30.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.533+0000 7f70af1dd700 1 --2- 172.21.15.80:0/582933256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70a8103e30 0x7f70a819fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:30.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.533+0000 7f70af1dd700 1 -- 172.21.15.80:0/582933256 >> 172.21.15.80:0/582933256 conn(0x7f70a807a580 msgr2=0x7f70a8102310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:30.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.533+0000 7f70af1dd700 1 -- 172.21.15.80:0/582933256 shutdown_connections 2024-04-26T18:33:30.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:30.533+0000 7f70af1dd700 1 -- 172.21.15.80:0/582933256 wait complete. 2024-04-26T18:33:30.928 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:33:30 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:33:30.509+0000 7f61daad4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:33:30.928 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:33:30 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:33:30.509+0000 7f61daad4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:33:30.928 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:33:30 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:33:30.509+0000 7f61daad4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:33:30.928 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:33:30 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:33:30.509+0000 7f61daad4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:33:30.928 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:33:30 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:33:30.509+0000 7f61daad4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:33:31.189 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-04-26T18:33:31.427 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:33:31.801 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:31 smithi080 ceph-mon[29135]: pgmap v309: 97 pgs: 97 active+clean; 584 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-04-26T18:33:31.801 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:31 smithi080 ceph-mon[29135]: from='client.14667 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:33:31.801 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:31 smithi080 ceph-mon[29135]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-26T18:33:31.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:31 smithi192 ceph-mon[32842]: pgmap v309: 97 pgs: 97 active+clean; 584 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-04-26T18:33:31.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:31 smithi192 ceph-mon[32842]: from='client.14667 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:33:31.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:31 smithi192 ceph-mon[32842]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-26T18:33:31.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:31 smithi082 ceph-mon[32808]: pgmap v309: 97 pgs: 97 active+clean; 584 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-04-26T18:33:31.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:31 smithi082 ceph-mon[32808]: from='client.14667 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:33:31.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:31 smithi082 ceph-mon[32808]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-26T18:33:33.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.206+0000 7f8f5dc9b700 1 -- 172.21.15.80:0/3407653703 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f581076b0 msgr2=0x7f8f5810f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:33.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.206+0000 7f8f5dc9b700 1 --2- 172.21.15.80:0/3407653703 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f581076b0 0x7f8f5810f250 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000b0d0 tx=0x7f8f5000b3e0 comp rx=0 tx=0).stop 2024-04-26T18:33:33.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.206+0000 7f8f5dc9b700 1 -- 172.21.15.80:0/3407653703 shutdown_connections 2024-04-26T18:33:33.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.206+0000 7f8f5dc9b700 1 --2- 172.21.15.80:0/3407653703 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f581076b0 0x7f8f5810f250 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:33.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.206+0000 7f8f5dc9b700 1 --2- 172.21.15.80:0/3407653703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f58102960 0x7f8f58102d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:33.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.206+0000 7f8f5dc9b700 1 --2- 172.21.15.80:0/3407653703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f58103310 0x7f8f58106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:33.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.206+0000 7f8f5dc9b700 1 -- 172.21.15.80:0/3407653703 >> 172.21.15.80:0/3407653703 conn(0x7f8f580792d0 msgr2=0x7f8f580796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:33.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.206+0000 7f8f5dc9b700 1 -- 172.21.15.80:0/3407653703 shutdown_connections 2024-04-26T18:33:33.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.206+0000 7f8f5dc9b700 1 -- 172.21.15.80:0/3407653703 wait complete. 2024-04-26T18:33:33.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.207+0000 7f8f5dc9b700 1 Processor -- start 2024-04-26T18:33:33.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.207+0000 7f8f5dc9b700 1 -- start start 2024-04-26T18:33:33.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.207+0000 7f8f5dc9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f58102960 0x7f8f58198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:33.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.207+0000 7f8f5dc9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f58103310 0x7f8f58198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:33.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.207+0000 7f8f5dc9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f581076b0 0x7f8f58199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:33.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.207+0000 7f8f5dc9b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8f581125f0 con 0x7f8f58103310 2024-04-26T18:33:33.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.207+0000 7f8f5dc9b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8f58112470 con 0x7f8f58102960 2024-04-26T18:33:33.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.207+0000 7f8f5dc9b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8f58112770 con 0x7f8f581076b0 2024-04-26T18:33:33.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.207+0000 7f8f4ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f58103310 0x7f8f58198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:33.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.207+0000 7f8f4ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f58103310 0x7f8f58198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58662/0 (socket says 172.21.15.80:58662) 2024-04-26T18:33:33.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.207+0000 7f8f4ffff700 1 -- 172.21.15.80:0/1874226068 learned_addr learned my addr 172.21.15.80:0/1874226068 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:33:33.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.207+0000 7f8f4ffff700 1 -- 172.21.15.80:0/1874226068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f581076b0 msgr2=0x7f8f58199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:33.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.207+0000 7f8f57fff700 1 --2- 172.21.15.80:0/1874226068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f581076b0 0x7f8f58199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:33.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.207+0000 7f8f4ffff700 1 --2- 172.21.15.80:0/1874226068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f581076b0 0x7f8f58199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:33.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.207+0000 7f8f4ffff700 1 -- 172.21.15.80:0/1874226068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f58102960 msgr2=0x7f8f58198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:33.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.207+0000 7f8f577fe700 1 --2- 172.21.15.80:0/1874226068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f58102960 0x7f8f58198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:33.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.208+0000 7f8f4ffff700 1 --2- 172.21.15.80:0/1874226068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f58102960 0x7f8f58198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:33.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.208+0000 7f8f4ffff700 1 -- 172.21.15.80:0/1874226068 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f581a80f0 con 0x7f8f58103310 2024-04-26T18:33:33.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.208+0000 7f8f577fe700 1 --2- 172.21.15.80:0/1874226068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f58102960 0x7f8f58198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:33:33.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.208+0000 7f8f4ffff700 1 --2- 172.21.15.80:0/1874226068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f58103310 0x7f8f58198dc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000b4d0 tx=0x7f8f4000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:33.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.208+0000 7f8f557fa700 1 -- 172.21.15.80:0/1874226068 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40015020 con 0x7f8f58103310 2024-04-26T18:33:33.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.208+0000 7f8f557fa700 1 -- 172.21.15.80:0/1874226068 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f40011ce0 con 0x7f8f58103310 2024-04-26T18:33:33.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.208+0000 7f8f557fa700 1 -- 172.21.15.80:0/1874226068 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40010cd0 con 0x7f8f58103310 2024-04-26T18:33:33.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.208+0000 7f8f5dc9b700 1 -- 172.21.15.80:0/1874226068 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f581a83e0 con 0x7f8f58103310 2024-04-26T18:33:33.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.208+0000 7f8f5dc9b700 1 -- 172.21.15.80:0/1874226068 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f581a8920 con 0x7f8f58103310 2024-04-26T18:33:33.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.209+0000 7f8f5dc9b700 1 -- 172.21.15.80:0/1874226068 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f58103a60 con 0x7f8f58103310 2024-04-26T18:33:33.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.210+0000 7f8f557fa700 1 -- 172.21.15.80:0/1874226068 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f8f40018020 con 0x7f8f58103310 2024-04-26T18:33:33.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.211+0000 7f8f557fa700 1 --2- 172.21.15.80:0/1874226068 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8f440a3cd0 0x7f8f440a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:33.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.211+0000 7f8f577fe700 1 --2- 172.21.15.80:0/1874226068 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8f440a3cd0 0x7f8f440a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:33.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.211+0000 7f8f557fa700 1 -- 172.21.15.80:0/1874226068 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7f8f400d0140 con 0x7f8f58103310 2024-04-26T18:33:33.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.211+0000 7f8f577fe700 1 --2- 172.21.15.80:0/1874226068 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8f440a3cd0 0x7f8f440a6190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8f48007900 tx=0x7f8f48008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:33.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.215+0000 7f8f557fa700 1 -- 172.21.15.80:0/1874226068 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8f4001f020 con 0x7f8f58103310 2024-04-26T18:33:33.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.445+0000 7f8f5dc9b700 1 -- 172.21.15.80:0/1874226068 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f8f58063860 con 0x7f8f440a3cd0 2024-04-26T18:33:33.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.470+0000 7f8f557fa700 1 -- 172.21.15.80:0/1874226068 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8f58063860 con 0x7f8f440a3cd0 2024-04-26T18:33:33.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.472+0000 7f8f5dc9b700 1 -- 172.21.15.80:0/1874226068 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8f440a3cd0 msgr2=0x7f8f440a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:33.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.472+0000 7f8f5dc9b700 1 --2- 172.21.15.80:0/1874226068 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8f440a3cd0 0x7f8f440a6190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8f48007900 tx=0x7f8f48008040 comp rx=0 tx=0).stop 2024-04-26T18:33:33.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.472+0000 7f8f5dc9b700 1 -- 172.21.15.80:0/1874226068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f58103310 msgr2=0x7f8f58198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:33.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.472+0000 7f8f5dc9b700 1 --2- 172.21.15.80:0/1874226068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f58103310 0x7f8f58198dc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000b4d0 tx=0x7f8f4000b890 comp rx=0 tx=0).stop 2024-04-26T18:33:33.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.472+0000 7f8f5dc9b700 1 -- 172.21.15.80:0/1874226068 shutdown_connections 2024-04-26T18:33:33.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.472+0000 7f8f5dc9b700 1 --2- 172.21.15.80:0/1874226068 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8f440a3cd0 0x7f8f440a6190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:33.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.472+0000 7f8f5dc9b700 1 --2- 172.21.15.80:0/1874226068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f581076b0 0x7f8f58199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:33.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.472+0000 7f8f5dc9b700 1 --2- 172.21.15.80:0/1874226068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f58102960 0x7f8f58198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:33.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.472+0000 7f8f5dc9b700 1 --2- 172.21.15.80:0/1874226068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f58103310 0x7f8f58198dc0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:33.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.472+0000 7f8f5dc9b700 1 -- 172.21.15.80:0/1874226068 >> 172.21.15.80:0/1874226068 conn(0x7f8f580792d0 msgr2=0x7f8f581009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:33.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.472+0000 7f8f5dc9b700 1 -- 172.21.15.80:0/1874226068 shutdown_connections 2024-04-26T18:33:33.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:33.472+0000 7f8f5dc9b700 1 -- 172.21.15.80:0/1874226068 wait complete. 2024-04-26T18:33:33.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:33 smithi080 ceph-mon[29135]: pgmap v310: 97 pgs: 97 active+clean; 591 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.8 KiB/s wr, 22 op/s 2024-04-26T18:33:33.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:33 smithi192 ceph-mon[32842]: pgmap v310: 97 pgs: 97 active+clean; 591 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.8 KiB/s wr, 22 op/s 2024-04-26T18:33:33.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:33 smithi082 ceph-mon[32808]: pgmap v310: 97 pgs: 97 active+clean; 591 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.8 KiB/s wr, 22 op/s 2024-04-26T18:33:34.254 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-04-26T18:33:34.494 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:33:34.861 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:34 smithi080 ceph-mon[29135]: from='client.14679 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:33:34.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:34 smithi192 ceph-mon[32842]: from='client.14679 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:33:34.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:34 smithi082 ceph-mon[32808]: from='client.14679 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:33:35.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:35 smithi192 ceph-mon[32842]: pgmap v311: 97 pgs: 97 active+clean; 591 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.8 KiB/s wr, 21 op/s 2024-04-26T18:33:35.862 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:35 smithi080 ceph-mon[29135]: pgmap v311: 97 pgs: 97 active+clean; 591 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.8 KiB/s wr, 21 op/s 2024-04-26T18:33:35.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:35 smithi082 ceph-mon[32808]: pgmap v311: 97 pgs: 97 active+clean; 591 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.8 KiB/s wr, 21 op/s 2024-04-26T18:33:36.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.218+0000 7f78582ae700 1 -- 172.21.15.80:0/1723069041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7850103470 msgr2=0x7f78501038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:36.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.218+0000 7f78582ae700 1 --2- 172.21.15.80:0/1723069041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7850103470 0x7f78501038f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7840009990 tx=0x7f7840009ca0 comp rx=0 tx=0).stop 2024-04-26T18:33:36.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.218+0000 7f78582ae700 1 -- 172.21.15.80:0/1723069041 shutdown_connections 2024-04-26T18:33:36.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.218+0000 7f78582ae700 1 --2- 172.21.15.80:0/1723069041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7850103e30 0x7f7850110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:36.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.218+0000 7f78582ae700 1 --2- 172.21.15.80:0/1723069041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78501094c0 0x7f78501098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:36.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.218+0000 7f78582ae700 1 --2- 172.21.15.80:0/1723069041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7850103470 0x7f78501038f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:36.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.218+0000 7f78582ae700 1 -- 172.21.15.80:0/1723069041 >> 172.21.15.80:0/1723069041 conn(0x7f785007a580 msgr2=0x7f785007a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:36.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.218+0000 7f78582ae700 1 -- 172.21.15.80:0/1723069041 shutdown_connections 2024-04-26T18:33:36.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.218+0000 7f78582ae700 1 -- 172.21.15.80:0/1723069041 wait complete. 2024-04-26T18:33:36.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.219+0000 7f78582ae700 1 Processor -- start 2024-04-26T18:33:36.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.219+0000 7f78582ae700 1 -- start start 2024-04-26T18:33:36.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.219+0000 7f78582ae700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7850103470 0x7f785019fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:36.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.219+0000 7f78582ae700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7850103e30 0x7f785019ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:36.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.219+0000 7f78582ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78501094c0 0x7f7850199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:36.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.219+0000 7f78582ae700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f78501136c0 con 0x7f7850103e30 2024-04-26T18:33:36.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.219+0000 7f78582ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7850113540 con 0x7f78501094c0 2024-04-26T18:33:36.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.219+0000 7f78582ae700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7850113840 con 0x7f7850103470 2024-04-26T18:33:36.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.219+0000 7f7855849700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7850103e30 0x7f785019ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:36.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.219+0000 7f7855849700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7850103e30 0x7f785019ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54900/0 (socket says 172.21.15.80:54900) 2024-04-26T18:33:36.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.219+0000 7f7855849700 1 -- 172.21.15.80:0/1336327431 learned_addr learned my addr 172.21.15.80:0/1336327431 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:33:36.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.219+0000 7f785604a700 1 --2- 172.21.15.80:0/1336327431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7850103470 0x7f785019fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:36.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.219+0000 7f785684b700 1 --2- 172.21.15.80:0/1336327431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78501094c0 0x7f7850199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:36.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.220+0000 7f7855849700 1 -- 172.21.15.80:0/1336327431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7850103470 msgr2=0x7f785019fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:36.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.220+0000 7f7855849700 1 --2- 172.21.15.80:0/1336327431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7850103470 0x7f785019fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:36.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.220+0000 7f7855849700 1 -- 172.21.15.80:0/1336327431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78501094c0 msgr2=0x7f7850199b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:36.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.220+0000 7f7855849700 1 --2- 172.21.15.80:0/1336327431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78501094c0 0x7f7850199b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:36.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.220+0000 7f7855849700 1 -- 172.21.15.80:0/1336327431 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f785019a410 con 0x7f7850103e30 2024-04-26T18:33:36.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.220+0000 7f785604a700 1 --2- 172.21.15.80:0/1336327431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7850103470 0x7f785019fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:33:36.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.220+0000 7f785684b700 1 --2- 172.21.15.80:0/1336327431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78501094c0 0x7f7850199b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:33:36.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.220+0000 7f7855849700 1 --2- 172.21.15.80:0/1336327431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7850103e30 0x7f785019ffa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7840000c00 tx=0x7f78400047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:36.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.220+0000 7f78477fe700 1 -- 172.21.15.80:0/1336327431 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7840027070 con 0x7f7850103e30 2024-04-26T18:33:36.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.220+0000 7f78477fe700 1 -- 172.21.15.80:0/1336327431 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78400041d0 con 0x7f7850103e30 2024-04-26T18:33:36.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.220+0000 7f78582ae700 1 -- 172.21.15.80:0/1336327431 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f785019a6a0 con 0x7f7850103e30 2024-04-26T18:33:36.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.220+0000 7f78477fe700 1 -- 172.21.15.80:0/1336327431 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784000f460 con 0x7f7850103e30 2024-04-26T18:33:36.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.220+0000 7f78582ae700 1 -- 172.21.15.80:0/1336327431 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78501a69e0 con 0x7f7850103e30 2024-04-26T18:33:36.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.221+0000 7f78582ae700 1 -- 172.21.15.80:0/1336327431 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7850104b60 con 0x7f7850103e30 2024-04-26T18:33:36.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.222+0000 7f78477fe700 1 -- 172.21.15.80:0/1336327431 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f784002a070 con 0x7f7850103e30 2024-04-26T18:33:36.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.223+0000 7f78477fe700 1 --2- 172.21.15.80:0/1336327431 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f783c0a3d50 0x7f783c0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:36.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.223+0000 7f785604a700 1 --2- 172.21.15.80:0/1336327431 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f783c0a3d50 0x7f783c0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:36.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.223+0000 7f78477fe700 1 -- 172.21.15.80:0/1336327431 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7f78400d1770 con 0x7f7850103e30 2024-04-26T18:33:36.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.223+0000 7f785604a700 1 --2- 172.21.15.80:0/1336327431 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f783c0a3d50 0x7f783c0a6210 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f784c007900 tx=0x7f784c008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:36.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.226+0000 7f78477fe700 1 -- 172.21.15.80:0/1336327431 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7840031070 con 0x7f7850103e30 2024-04-26T18:33:36.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.455+0000 7f78582ae700 1 -- 172.21.15.80:0/1336327431 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f785019aff0 con 0x7f783c0a3d50 2024-04-26T18:33:36.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.460+0000 7f78477fe700 1 -- 172.21.15.80:0/1336327431 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f785019aff0 con 0x7f783c0a3d50 2024-04-26T18:33:36.460 INFO:teuthology.orchestra.run.smithi080.stdout:/volumes/qa/sv_0/0d978f6c-5699-4aef-ab4f-51d896ea7f90 2024-04-26T18:33:36.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.462+0000 7f78582ae700 1 -- 172.21.15.80:0/1336327431 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f783c0a3d50 msgr2=0x7f783c0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:36.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.462+0000 7f78582ae700 1 --2- 172.21.15.80:0/1336327431 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f783c0a3d50 0x7f783c0a6210 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f784c007900 tx=0x7f784c008040 comp rx=0 tx=0).stop 2024-04-26T18:33:36.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.462+0000 7f78582ae700 1 -- 172.21.15.80:0/1336327431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7850103e30 msgr2=0x7f785019ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:36.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.462+0000 7f78582ae700 1 --2- 172.21.15.80:0/1336327431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7850103e30 0x7f785019ffa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7840000c00 tx=0x7f78400047b0 comp rx=0 tx=0).stop 2024-04-26T18:33:36.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.462+0000 7f78582ae700 1 -- 172.21.15.80:0/1336327431 shutdown_connections 2024-04-26T18:33:36.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.462+0000 7f78582ae700 1 --2- 172.21.15.80:0/1336327431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78501094c0 0x7f7850199b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:36.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.462+0000 7f78582ae700 1 --2- 172.21.15.80:0/1336327431 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f783c0a3d50 0x7f783c0a6210 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:36.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.462+0000 7f78582ae700 1 --2- 172.21.15.80:0/1336327431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7850103470 0x7f785019fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:36.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.462+0000 7f78582ae700 1 --2- 172.21.15.80:0/1336327431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7850103e30 0x7f785019ffa0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:36.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.462+0000 7f78582ae700 1 -- 172.21.15.80:0/1336327431 >> 172.21.15.80:0/1336327431 conn(0x7f785007a580 msgr2=0x7f78501022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:36.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.462+0000 7f78582ae700 1 -- 172.21.15.80:0/1336327431 shutdown_connections 2024-04-26T18:33:36.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:36.462+0000 7f78582ae700 1 -- 172.21.15.80:0/1336327431 wait complete. 2024-04-26T18:33:37.239 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-04-26T18:33:37.484 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:33:37.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:37 smithi192 ceph-mon[32842]: from='client.14685 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:33:37.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:37 smithi192 ceph-mon[32842]: pgmap v312: 97 pgs: 97 active+clean; 605 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.1 KiB/s wr, 20 op/s 2024-04-26T18:33:37.958 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:37 smithi080 ceph-mon[29135]: from='client.14685 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:33:37.958 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:37 smithi080 ceph-mon[29135]: pgmap v312: 97 pgs: 97 active+clean; 605 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.1 KiB/s wr, 20 op/s 2024-04-26T18:33:37.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:37 smithi082 ceph-mon[32808]: from='client.14685 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:33:37.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:37 smithi082 ceph-mon[32808]: pgmap v312: 97 pgs: 97 active+clean; 605 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.1 KiB/s wr, 20 op/s 2024-04-26T18:33:39.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.224+0000 7f7540c47700 1 -- 172.21.15.80:0/4184674514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f753c101970 msgr2=0x7f753c101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:39.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.224+0000 7f7540c47700 1 --2- 172.21.15.80:0/4184674514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f753c101970 0x7f753c101df0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f75300099c0 tx=0x7f7530009cd0 comp rx=0 tx=0).stop 2024-04-26T18:33:39.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.224+0000 7f7540c47700 1 -- 172.21.15.80:0/4184674514 shutdown_connections 2024-04-26T18:33:39.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.224+0000 7f7540c47700 1 --2- 172.21.15.80:0/4184674514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f753c102330 0x7f753c1102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:39.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.224+0000 7f7540c47700 1 --2- 172.21.15.80:0/4184674514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f753c1094d0 0x7f753c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:39.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.224+0000 7f7540c47700 1 --2- 172.21.15.80:0/4184674514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f753c101970 0x7f753c101df0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:39.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.224+0000 7f7540c47700 1 -- 172.21.15.80:0/4184674514 >> 172.21.15.80:0/4184674514 conn(0x7f753c078920 msgr2=0x7f753c0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:39.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.224+0000 7f7540c47700 1 -- 172.21.15.80:0/4184674514 shutdown_connections 2024-04-26T18:33:39.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.224+0000 7f7540c47700 1 -- 172.21.15.80:0/4184674514 wait complete. 2024-04-26T18:33:39.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.225+0000 7f7540c47700 1 Processor -- start 2024-04-26T18:33:39.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.225+0000 7f7540c47700 1 -- start start 2024-04-26T18:33:39.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.225+0000 7f7540c47700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f753c101970 0x7f753c19f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:39.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.225+0000 7f7540c47700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f753c102330 0x7f753c19fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:39.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.225+0000 7f7540c47700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f753c1094d0 0x7f753c199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:39.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.225+0000 7f7540c47700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f753c1136e0 con 0x7f753c101970 2024-04-26T18:33:39.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.225+0000 7f7540c47700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f753c113560 con 0x7f753c1094d0 2024-04-26T18:33:39.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.225+0000 7f7540c47700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f753c113860 con 0x7f753c102330 2024-04-26T18:33:39.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.225+0000 7f753a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f753c101970 0x7f753c19f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:39.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.225+0000 7f753a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f753c101970 0x7f753c19f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54918/0 (socket says 172.21.15.80:54918) 2024-04-26T18:33:39.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.225+0000 7f753a59c700 1 -- 172.21.15.80:0/307255154 learned_addr learned my addr 172.21.15.80:0/307255154 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:33:39.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.225+0000 7f7539d9b700 1 --2- 172.21.15.80:0/307255154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f753c102330 0x7f753c19fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:39.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.225+0000 7f753ad9d700 1 --2- 172.21.15.80:0/307255154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f753c1094d0 0x7f753c199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:39.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.225+0000 7f753a59c700 1 -- 172.21.15.80:0/307255154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f753c102330 msgr2=0x7f753c19fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:39.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.225+0000 7f753a59c700 1 --2- 172.21.15.80:0/307255154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f753c102330 0x7f753c19fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:39.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.225+0000 7f753a59c700 1 -- 172.21.15.80:0/307255154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f753c1094d0 msgr2=0x7f753c199a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:39.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.225+0000 7f753a59c700 1 --2- 172.21.15.80:0/307255154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f753c1094d0 0x7f753c199a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:39.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.225+0000 7f753a59c700 1 -- 172.21.15.80:0/307255154 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753c19a160 con 0x7f753c101970 2024-04-26T18:33:39.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.225+0000 7f7539d9b700 1 --2- 172.21.15.80:0/307255154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f753c102330 0x7f753c19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:33:39.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.225+0000 7f753a59c700 1 --2- 172.21.15.80:0/307255154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f753c101970 0x7f753c19f840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f752c00b530 tx=0x7f752c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:39.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.225+0000 7f752b7fe700 1 -- 172.21.15.80:0/307255154 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c015020 con 0x7f753c101970 2024-04-26T18:33:39.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.226+0000 7f752b7fe700 1 -- 172.21.15.80:0/307255154 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f752c011ce0 con 0x7f753c101970 2024-04-26T18:33:39.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.226+0000 7f7540c47700 1 -- 172.21.15.80:0/307255154 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f753c19a450 con 0x7f753c101970 2024-04-26T18:33:39.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.226+0000 7f752b7fe700 1 -- 172.21.15.80:0/307255154 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c010d20 con 0x7f753c101970 2024-04-26T18:33:39.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.226+0000 7f7540c47700 1 -- 172.21.15.80:0/307255154 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f753c1a6710 con 0x7f753c101970 2024-04-26T18:33:39.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.226+0000 7f7540c47700 1 -- 172.21.15.80:0/307255154 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f753c06a110 con 0x7f753c101970 2024-04-26T18:33:39.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.228+0000 7f752b7fe700 1 -- 172.21.15.80:0/307255154 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f752c018020 con 0x7f753c101970 2024-04-26T18:33:39.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.229+0000 7f752b7fe700 1 --2- 172.21.15.80:0/307255154 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f75240a3d50 0x7f75240a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:39.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.229+0000 7f7539d9b700 1 --2- 172.21.15.80:0/307255154 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f75240a3d50 0x7f75240a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:39.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.229+0000 7f752b7fe700 1 -- 172.21.15.80:0/307255154 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7f752c0cfff0 con 0x7f753c101970 2024-04-26T18:33:39.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.229+0000 7f7539d9b700 1 --2- 172.21.15.80:0/307255154 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f75240a3d50 0x7f75240a6210 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f753c108ba0 tx=0x7f7530005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:39.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.233+0000 7f752b7fe700 1 -- 172.21.15.80:0/307255154 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f752c01f020 con 0x7f753c101970 2024-04-26T18:33:39.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.464+0000 7f7540c47700 1 -- 172.21.15.80:0/307255154 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f753c063860 con 0x7f75240a3d50 2024-04-26T18:33:39.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.489+0000 7f752b7fe700 1 -- 172.21.15.80:0/307255154 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f753c063860 con 0x7f75240a3d50 2024-04-26T18:33:39.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.491+0000 7f7540c47700 1 -- 172.21.15.80:0/307255154 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f75240a3d50 msgr2=0x7f75240a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:39.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.491+0000 7f7540c47700 1 --2- 172.21.15.80:0/307255154 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f75240a3d50 0x7f75240a6210 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f753c108ba0 tx=0x7f7530005fb0 comp rx=0 tx=0).stop 2024-04-26T18:33:39.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.491+0000 7f7540c47700 1 -- 172.21.15.80:0/307255154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f753c101970 msgr2=0x7f753c19f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:39.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.491+0000 7f7540c47700 1 --2- 172.21.15.80:0/307255154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f753c101970 0x7f753c19f840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f752c00b530 tx=0x7f752c00b8f0 comp rx=0 tx=0).stop 2024-04-26T18:33:39.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.491+0000 7f7540c47700 1 -- 172.21.15.80:0/307255154 shutdown_connections 2024-04-26T18:33:39.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.491+0000 7f7540c47700 1 --2- 172.21.15.80:0/307255154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f753c1094d0 0x7f753c199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:39.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.491+0000 7f7540c47700 1 --2- 172.21.15.80:0/307255154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f753c101970 0x7f753c19f840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:39.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.491+0000 7f7540c47700 1 --2- 172.21.15.80:0/307255154 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f75240a3d50 0x7f75240a6210 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:39.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.491+0000 7f7540c47700 1 --2- 172.21.15.80:0/307255154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f753c102330 0x7f753c19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:39.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.491+0000 7f7540c47700 1 -- 172.21.15.80:0/307255154 >> 172.21.15.80:0/307255154 conn(0x7f753c078920 msgr2=0x7f753c100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:39.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.491+0000 7f7540c47700 1 -- 172.21.15.80:0/307255154 shutdown_connections 2024-04-26T18:33:39.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:39.491+0000 7f7540c47700 1 -- 172.21.15.80:0/307255154 wait complete. 2024-04-26T18:33:39.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:39 smithi080 ceph-mon[29135]: pgmap v313: 97 pgs: 97 active+clean; 605 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.2 KiB/s wr, 16 op/s 2024-04-26T18:33:39.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:39 smithi192 ceph-mon[32842]: pgmap v313: 97 pgs: 97 active+clean; 605 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.2 KiB/s wr, 16 op/s 2024-04-26T18:33:39.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:39 smithi082 ceph-mon[32808]: pgmap v313: 97 pgs: 97 active+clean; 605 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.2 KiB/s wr, 16 op/s 2024-04-26T18:33:40.142 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-04-26T18:33:40.380 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:33:40.753 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:40 smithi080 ceph-mon[29135]: from='client.14691 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:33:40.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:40 smithi192 ceph-mon[32842]: from='client.14691 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:33:40.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:40 smithi082 ceph-mon[32808]: from='client.14691 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:33:41.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:41 smithi080 ceph-mon[29135]: pgmap v314: 97 pgs: 97 active+clean; 605 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.4 KiB/s wr, 11 op/s 2024-04-26T18:33:41.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:41 smithi192 ceph-mon[32842]: pgmap v314: 97 pgs: 97 active+clean; 605 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.4 KiB/s wr, 11 op/s 2024-04-26T18:33:41.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:41 smithi082 ceph-mon[32808]: pgmap v314: 97 pgs: 97 active+clean; 605 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.4 KiB/s wr, 11 op/s 2024-04-26T18:33:42.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.073+0000 7fd5f4a64700 1 -- 172.21.15.80:0/4217657265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5f0109480 msgr2=0x7fd5f0109860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:42.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.073+0000 7fd5f4a64700 1 --2- 172.21.15.80:0/4217657265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5f0109480 0x7fd5f0109860 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0009990 tx=0x7fd5e0009ca0 comp rx=0 tx=0).stop 2024-04-26T18:33:42.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.074+0000 7fd5f4a64700 1 -- 172.21.15.80:0/4217657265 shutdown_connections 2024-04-26T18:33:42.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.074+0000 7fd5f4a64700 1 --2- 172.21.15.80:0/4217657265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f0103ea0 0x7fd5f01102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:42.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.074+0000 7fd5f4a64700 1 --2- 172.21.15.80:0/4217657265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5f0109480 0x7fd5f0109860 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:42.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.074+0000 7fd5f4a64700 1 --2- 172.21.15.80:0/4217657265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5f01034e0 0x7fd5f0103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:42.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.074+0000 7fd5f4a64700 1 -- 172.21.15.80:0/4217657265 >> 172.21.15.80:0/4217657265 conn(0x7fd5f007a5e0 msgr2=0x7fd5f007a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:42.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.074+0000 7fd5f4a64700 1 -- 172.21.15.80:0/4217657265 shutdown_connections 2024-04-26T18:33:42.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.074+0000 7fd5f4a64700 1 -- 172.21.15.80:0/4217657265 wait complete. 2024-04-26T18:33:42.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.075+0000 7fd5f4a64700 1 Processor -- start 2024-04-26T18:33:42.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.075+0000 7fd5f4a64700 1 -- start start 2024-04-26T18:33:42.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.075+0000 7fd5f4a64700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5f01034e0 0x7fd5f019f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:42.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.075+0000 7fd5f4a64700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5f0103ea0 0x7fd5f019fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:42.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.075+0000 7fd5f4a64700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f0109480 0x7fd5f0199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:42.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.075+0000 7fd5f4a64700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f01135b0 con 0x7fd5f01034e0 2024-04-26T18:33:42.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.075+0000 7fd5f4a64700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f0113430 con 0x7fd5f0109480 2024-04-26T18:33:42.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.075+0000 7fd5f4a64700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f0113730 con 0x7fd5f0103ea0 2024-04-26T18:33:42.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.075+0000 7fd5ee59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5f01034e0 0x7fd5f019f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:42.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.075+0000 7fd5ee59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5f01034e0 0x7fd5f019f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54930/0 (socket says 172.21.15.80:54930) 2024-04-26T18:33:42.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.075+0000 7fd5ee59c700 1 -- 172.21.15.80:0/2924296498 learned_addr learned my addr 172.21.15.80:0/2924296498 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:33:42.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.075+0000 7fd5e5d9b700 1 --2- 172.21.15.80:0/2924296498 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5f0103ea0 0x7fd5f019fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:42.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.075+0000 7fd5eed9d700 1 --2- 172.21.15.80:0/2924296498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f0109480 0x7fd5f0199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:42.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.076+0000 7fd5ee59c700 1 -- 172.21.15.80:0/2924296498 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5f0103ea0 msgr2=0x7fd5f019fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:42.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.076+0000 7fd5ee59c700 1 --2- 172.21.15.80:0/2924296498 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5f0103ea0 0x7fd5f019fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:42.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.076+0000 7fd5ee59c700 1 -- 172.21.15.80:0/2924296498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f0109480 msgr2=0x7fd5f0199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:42.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.076+0000 7fd5ee59c700 1 --2- 172.21.15.80:0/2924296498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f0109480 0x7fd5f0199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:42.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.076+0000 7fd5ee59c700 1 -- 172.21.15.80:0/2924296498 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f019a070 con 0x7fd5f01034e0 2024-04-26T18:33:42.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.076+0000 7fd5ee59c700 1 --2- 172.21.15.80:0/2924296498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5f01034e0 0x7fd5f019f750 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0000c00 tx=0x7fd5e00047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:42.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.076+0000 7fd5e7fff700 1 -- 172.21.15.80:0/2924296498 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e0027070 con 0x7fd5f01034e0 2024-04-26T18:33:42.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.076+0000 7fd5f4a64700 1 -- 172.21.15.80:0/2924296498 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5f019a300 con 0x7fd5f01034e0 2024-04-26T18:33:42.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.076+0000 7fd5e7fff700 1 -- 172.21.15.80:0/2924296498 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5e0003f20 con 0x7fd5f01034e0 2024-04-26T18:33:42.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.076+0000 7fd5e7fff700 1 -- 172.21.15.80:0/2924296498 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e0022ca0 con 0x7fd5f01034e0 2024-04-26T18:33:42.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.076+0000 7fd5f4a64700 1 -- 172.21.15.80:0/2924296498 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5f0075650 con 0x7fd5f01034e0 2024-04-26T18:33:42.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.077+0000 7fd5f4a64700 1 -- 172.21.15.80:0/2924296498 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5f010b980 con 0x7fd5f01034e0 2024-04-26T18:33:42.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.078+0000 7fd5e7fff700 1 -- 172.21.15.80:0/2924296498 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fd5e002a070 con 0x7fd5f01034e0 2024-04-26T18:33:42.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.079+0000 7fd5e7fff700 1 --2- 172.21.15.80:0/2924296498 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd5dc0a3cd0 0x7fd5dc0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:42.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.079+0000 7fd5e5d9b700 1 --2- 172.21.15.80:0/2924296498 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd5dc0a3cd0 0x7fd5dc0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:42.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.079+0000 7fd5e7fff700 1 -- 172.21.15.80:0/2924296498 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7fd5e00d1210 con 0x7fd5f01034e0 2024-04-26T18:33:42.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.079+0000 7fd5e5d9b700 1 --2- 172.21.15.80:0/2924296498 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd5dc0a3cd0 0x7fd5dc0a6190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd5f007ac50 tx=0x7fd5d800b3c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:42.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.083+0000 7fd5e7fff700 1 -- 172.21.15.80:0/2924296498 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd5e005eff0 con 0x7fd5f01034e0 2024-04-26T18:33:42.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.314+0000 7fd5f4a64700 1 -- 172.21.15.80:0/2924296498 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fd5f019ae40 con 0x7fd5dc0a3cd0 2024-04-26T18:33:42.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.318+0000 7fd5e7fff700 1 -- 172.21.15.80:0/2924296498 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fd5f019ae40 con 0x7fd5dc0a3cd0 2024-04-26T18:33:42.319 INFO:teuthology.orchestra.run.smithi080.stdout:/volumes/qa/sv_1/9d1fbf3d-f487-4990-88c4-35f4a747e017 2024-04-26T18:33:42.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.320+0000 7fd5f4a64700 1 -- 172.21.15.80:0/2924296498 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd5dc0a3cd0 msgr2=0x7fd5dc0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:42.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.321+0000 7fd5f4a64700 1 --2- 172.21.15.80:0/2924296498 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd5dc0a3cd0 0x7fd5dc0a6190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd5f007ac50 tx=0x7fd5d800b3c0 comp rx=0 tx=0).stop 2024-04-26T18:33:42.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.321+0000 7fd5f4a64700 1 -- 172.21.15.80:0/2924296498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5f01034e0 msgr2=0x7fd5f019f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:42.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.321+0000 7fd5f4a64700 1 --2- 172.21.15.80:0/2924296498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5f01034e0 0x7fd5f019f750 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0000c00 tx=0x7fd5e00047b0 comp rx=0 tx=0).stop 2024-04-26T18:33:42.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.321+0000 7fd5f4a64700 1 -- 172.21.15.80:0/2924296498 shutdown_connections 2024-04-26T18:33:42.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.321+0000 7fd5f4a64700 1 --2- 172.21.15.80:0/2924296498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f0109480 0x7fd5f0199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:42.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.321+0000 7fd5f4a64700 1 --2- 172.21.15.80:0/2924296498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5f01034e0 0x7fd5f019f750 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:42.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.321+0000 7fd5f4a64700 1 --2- 172.21.15.80:0/2924296498 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd5dc0a3cd0 0x7fd5dc0a6190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:42.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.321+0000 7fd5f4a64700 1 --2- 172.21.15.80:0/2924296498 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5f0103ea0 0x7fd5f019fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:42.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.321+0000 7fd5f4a64700 1 -- 172.21.15.80:0/2924296498 >> 172.21.15.80:0/2924296498 conn(0x7fd5f007a5e0 msgr2=0x7fd5f01015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:42.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.321+0000 7fd5f4a64700 1 -- 172.21.15.80:0/2924296498 shutdown_connections 2024-04-26T18:33:42.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:42.321+0000 7fd5f4a64700 1 -- 172.21.15.80:0/2924296498 wait complete. 2024-04-26T18:33:42.981 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:33:43.217 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:33:43.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:43 smithi082 ceph-mon[32808]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:33:43.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:43 smithi082 ceph-mon[32808]: pgmap v315: 97 pgs: 97 active+clean; 625 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-04-26T18:33:43.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:43 smithi080 ceph-mon[29135]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:33:43.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:43 smithi080 ceph-mon[29135]: pgmap v315: 97 pgs: 97 active+clean; 625 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-04-26T18:33:44.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:43 smithi192 ceph-mon[32842]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:33:44.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:43 smithi192 ceph-mon[32842]: pgmap v315: 97 pgs: 97 active+clean; 625 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-04-26T18:33:44.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.892+0000 7f20bd55e700 1 -- 172.21.15.80:0/2220785221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b8103470 msgr2=0x7f20b81038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:44.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.892+0000 7f20bd55e700 1 --2- 172.21.15.80:0/2220785221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b8103470 0x7f20b81038f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f20ac009990 tx=0x7f20ac009ca0 comp rx=0 tx=0).stop 2024-04-26T18:33:44.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.892+0000 7f20bd55e700 1 -- 172.21.15.80:0/2220785221 shutdown_connections 2024-04-26T18:33:44.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.892+0000 7f20bd55e700 1 --2- 172.21.15.80:0/2220785221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20b8103e30 0x7f20b8110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:44.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.892+0000 7f20bd55e700 1 --2- 172.21.15.80:0/2220785221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b81094c0 0x7f20b81098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:44.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.892+0000 7f20bd55e700 1 --2- 172.21.15.80:0/2220785221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b8103470 0x7f20b81038f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:44.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.892+0000 7f20bd55e700 1 -- 172.21.15.80:0/2220785221 >> 172.21.15.80:0/2220785221 conn(0x7f20b807a580 msgr2=0x7f20b807a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:44.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.892+0000 7f20bd55e700 1 -- 172.21.15.80:0/2220785221 shutdown_connections 2024-04-26T18:33:44.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.892+0000 7f20bd55e700 1 -- 172.21.15.80:0/2220785221 wait complete. 2024-04-26T18:33:44.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.892+0000 7f20bd55e700 1 Processor -- start 2024-04-26T18:33:44.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.893+0000 7f20bd55e700 1 -- start start 2024-04-26T18:33:44.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.893+0000 7f20bd55e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b8103470 0x7f20b819f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:44.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.893+0000 7f20bd55e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b8103e30 0x7f20b819fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:44.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.893+0000 7f20bd55e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20b81094c0 0x7f20b8199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:44.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.893+0000 7f20bd55e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f20b81135c0 con 0x7f20b8103470 2024-04-26T18:33:44.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.893+0000 7f20bd55e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f20b8113440 con 0x7f20b8103e30 2024-04-26T18:33:44.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.893+0000 7f20bd55e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f20b8113740 con 0x7f20b81094c0 2024-04-26T18:33:44.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.893+0000 7f20b6ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b8103470 0x7f20b819f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:44.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.893+0000 7f20b6ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b8103470 0x7f20b819f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34830/0 (socket says 172.21.15.80:34830) 2024-04-26T18:33:44.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.893+0000 7f20b6ffd700 1 -- 172.21.15.80:0/274909107 learned_addr learned my addr 172.21.15.80:0/274909107 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:33:44.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.893+0000 7f20b67fc700 1 --2- 172.21.15.80:0/274909107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b8103e30 0x7f20b819fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:44.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.893+0000 7f20b6ffd700 1 -- 172.21.15.80:0/274909107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20b81094c0 msgr2=0x7f20b8199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:44.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.893+0000 7f20b77fe700 1 --2- 172.21.15.80:0/274909107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20b81094c0 0x7f20b8199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:44.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.893+0000 7f20b6ffd700 1 --2- 172.21.15.80:0/274909107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20b81094c0 0x7f20b8199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:44.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.893+0000 7f20b6ffd700 1 -- 172.21.15.80:0/274909107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b8103e30 msgr2=0x7f20b819fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:44.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.893+0000 7f20b6ffd700 1 --2- 172.21.15.80:0/274909107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b8103e30 0x7f20b819fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:44.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.893+0000 7f20b6ffd700 1 -- 172.21.15.80:0/274909107 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b819a020 con 0x7f20b8103470 2024-04-26T18:33:44.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.893+0000 7f20b6ffd700 1 --2- 172.21.15.80:0/274909107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b8103470 0x7f20b819f6c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f20a800c9b0 tx=0x7f20a800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:44.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.894+0000 7f209ffff700 1 -- 172.21.15.80:0/274909107 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a8007b00 con 0x7f20b8103470 2024-04-26T18:33:44.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.894+0000 7f209ffff700 1 -- 172.21.15.80:0/274909107 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20a8007ca0 con 0x7f20b8103470 2024-04-26T18:33:44.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.894+0000 7f20bd55e700 1 -- 172.21.15.80:0/274909107 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20b819a310 con 0x7f20b8103470 2024-04-26T18:33:44.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.894+0000 7f209ffff700 1 -- 172.21.15.80:0/274909107 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a8018660 con 0x7f20b8103470 2024-04-26T18:33:44.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.894+0000 7f20bd55e700 1 -- 172.21.15.80:0/274909107 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20b81a6520 con 0x7f20b8103470 2024-04-26T18:33:44.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.895+0000 7f20bd55e700 1 -- 172.21.15.80:0/274909107 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20b8104b60 con 0x7f20b8103470 2024-04-26T18:33:44.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.896+0000 7f209ffff700 1 -- 172.21.15.80:0/274909107 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f20a800f450 con 0x7f20b8103470 2024-04-26T18:33:44.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.896+0000 7f209ffff700 1 --2- 172.21.15.80:0/274909107 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f20a00a3cd0 0x7f20a00a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:44.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.896+0000 7f20b67fc700 1 --2- 172.21.15.80:0/274909107 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f20a00a3cd0 0x7f20a00a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:44.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.896+0000 7f209ffff700 1 -- 172.21.15.80:0/274909107 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7f20a80d0340 con 0x7f20b8103470 2024-04-26T18:33:44.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.897+0000 7f20b67fc700 1 --2- 172.21.15.80:0/274909107 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f20a00a3cd0 0x7f20a00a6190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f20ac00b5c0 tx=0x7f20ac005960 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:44.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:44.901+0000 7f209ffff700 1 -- 172.21.15.80:0/274909107 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f20a8014030 con 0x7f20b8103470 2024-04-26T18:33:45.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:45.151+0000 7f20bd55e700 1 -- 172.21.15.80:0/274909107 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20b802e490 con 0x7f20b8103470 2024-04-26T18:33:45.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:45.152+0000 7f209ffff700 1 -- 172.21.15.80:0/274909107 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11918 (secure 0 0 0) 0x7f20a809cd70 con 0x7f20b8103470 2024-04-26T18:33:45.152 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:33:45.152 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1967550873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1967550873},{"type":"v1","addr":"172.21.15.80:6835","nonce":1967550873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/559541830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":559541830},{"type":"v1","addr":"172.21.15.80:6837","nonce":559541830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T18:33:08.347399+0000","modified":"2024-04-26T18:33:27.036209+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24434,"mds_1":24421,"mds_2":24404,"mds_3":24400,"mds_4":24394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14577":{"gid":14577,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6839/2137993298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":2137993298},{"type":"v1","addr":"172.21.15.80:6839","nonce":2137993298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6841/1544670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1544670},{"type":"v1","addr":"172.21.15.80:6841","nonce":1544670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24371":{"gid":24371,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/3564539039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3564539039},{"type":"v1","addr":"172.21.15.82:6833","nonce":3564539039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24379":{"gid":24379,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/572065563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":572065563},{"type":"v1","addr":"172.21.15.82:6835","nonce":572065563}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.192:6835/719058020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":719058020},{"type":"v1","addr":"172.21.15.192:6835","nonce":719058020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.192:6837/2361996920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2361996920},{"type":"v1","addr":"172.21.15.192:6837","nonce":2361996920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.82:6837/2084055551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2084055551},{"type":"v1","addr":"172.21.15.82:6837","nonce":2084055551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6839/2735406056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":2735406056},{"type":"v1","addr":"172.21.15.192:6839","nonce":2735406056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.82:6839/1482576497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1482576497},{"type":"v1","addr":"172.21.15.82:6839","nonce":1482576497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24434,"qdb_cluster":[24404,24434,24394,24400,24421]},"id":1}]} 2024-04-26T18:33:45.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:45.154+0000 7f20bd55e700 1 -- 172.21.15.80:0/274909107 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f20a00a3cd0 msgr2=0x7f20a00a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:45.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:45.154+0000 7f20bd55e700 1 --2- 172.21.15.80:0/274909107 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f20a00a3cd0 0x7f20a00a6190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f20ac00b5c0 tx=0x7f20ac005960 comp rx=0 tx=0).stop 2024-04-26T18:33:45.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:45.154+0000 7f20bd55e700 1 -- 172.21.15.80:0/274909107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b8103470 msgr2=0x7f20b819f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:45.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:45.154+0000 7f20bd55e700 1 --2- 172.21.15.80:0/274909107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b8103470 0x7f20b819f6c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f20a800c9b0 tx=0x7f20a800ccc0 comp rx=0 tx=0).stop 2024-04-26T18:33:45.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:45.154+0000 7f20bd55e700 1 -- 172.21.15.80:0/274909107 shutdown_connections 2024-04-26T18:33:45.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:45.154+0000 7f20bd55e700 1 --2- 172.21.15.80:0/274909107 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f20a00a3cd0 0x7f20a00a6190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:45.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:45.154+0000 7f20bd55e700 1 --2- 172.21.15.80:0/274909107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20b81094c0 0x7f20b8199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:45.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:45.154+0000 7f20bd55e700 1 --2- 172.21.15.80:0/274909107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b8103470 0x7f20b819f6c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:45.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:45.154+0000 7f20bd55e700 1 --2- 172.21.15.80:0/274909107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b8103e30 0x7f20b819fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:45.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:45.154+0000 7f20bd55e700 1 -- 172.21.15.80:0/274909107 >> 172.21.15.80:0/274909107 conn(0x7f20b807a580 msgr2=0x7f20b8102250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:45.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:45.154+0000 7f20bd55e700 1 -- 172.21.15.80:0/274909107 shutdown_connections 2024-04-26T18:33:45.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:45.154+0000 7f20bd55e700 1 -- 172.21.15.80:0/274909107 wait complete. 2024-04-26T18:33:45.155 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 26 2024-04-26T18:33:45.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:45 smithi080 ceph-mon[29135]: pgmap v316: 97 pgs: 97 active+clean; 625 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.4 KiB/s wr, 11 op/s 2024-04-26T18:33:45.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:45 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/274909107' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:33:45.841 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T18:33:45.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:45 smithi082 ceph-mon[32808]: pgmap v316: 97 pgs: 97 active+clean; 625 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.4 KiB/s wr, 11 op/s 2024-04-26T18:33:45.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:45 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/274909107' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:33:46.079 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:33:46.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:45 smithi192 ceph-mon[32842]: pgmap v316: 97 pgs: 97 active+clean; 625 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.4 KiB/s wr, 11 op/s 2024-04-26T18:33:46.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:45 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/274909107' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:33:47.785 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:47 smithi080 ceph-mon[29135]: pgmap v317: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.6 KiB/s wr, 13 op/s 2024-04-26T18:33:47.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.791+0000 7f7863320700 1 -- 172.21.15.80:0/3883627109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f785c102600 msgr2=0x7f785c102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:47.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.791+0000 7f7863320700 1 --2- 172.21.15.80:0/3883627109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f785c102600 0x7f785c102a80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f784c009990 tx=0x7f784c009ca0 comp rx=0 tx=0).stop 2024-04-26T18:33:47.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.791+0000 7f7863320700 1 -- 172.21.15.80:0/3883627109 shutdown_connections 2024-04-26T18:33:47.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.791+0000 7f7863320700 1 --2- 172.21.15.80:0/3883627109 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f785c102fc0 0x7f785c10f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:47.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.791+0000 7f7863320700 1 --2- 172.21.15.80:0/3883627109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f785c108470 0x7f785c108850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:47.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.791+0000 7f7863320700 1 --2- 172.21.15.80:0/3883627109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f785c102600 0x7f785c102a80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:47.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.791+0000 7f7863320700 1 -- 172.21.15.80:0/3883627109 >> 172.21.15.80:0/3883627109 conn(0x7f785c079210 msgr2=0x7f785c079620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:47.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.791+0000 7f7863320700 1 -- 172.21.15.80:0/3883627109 shutdown_connections 2024-04-26T18:33:47.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.791+0000 7f7863320700 1 -- 172.21.15.80:0/3883627109 wait complete. 2024-04-26T18:33:47.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.791+0000 7f7863320700 1 Processor -- start 2024-04-26T18:33:47.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.791+0000 7f7863320700 1 -- start start 2024-04-26T18:33:47.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.792+0000 7f7863320700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f785c102600 0x7f785c198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:47.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.792+0000 7f7863320700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f785c102fc0 0x7f785c198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:47.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.792+0000 7f7863320700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f785c108470 0x7f785c1991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:47.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.792+0000 7f7863320700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f785c112570 con 0x7f785c108470 2024-04-26T18:33:47.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.792+0000 7f7863320700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f785c1123f0 con 0x7f785c102fc0 2024-04-26T18:33:47.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.792+0000 7f7863320700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f785c1126f0 con 0x7f785c102600 2024-04-26T18:33:47.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.792+0000 7f78618bd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f785c108470 0x7f785c1991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:47.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.792+0000 7f78618bd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f785c108470 0x7f785c1991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34844/0 (socket says 172.21.15.80:34844) 2024-04-26T18:33:47.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.792+0000 7f78618bd700 1 -- 172.21.15.80:0/4206682393 learned_addr learned my addr 172.21.15.80:0/4206682393 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:33:47.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.792+0000 7f78608bb700 1 --2- 172.21.15.80:0/4206682393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f785c102fc0 0x7f785c198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:47.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.792+0000 7f78610bc700 1 --2- 172.21.15.80:0/4206682393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f785c102600 0x7f785c198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:47.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.792+0000 7f78618bd700 1 -- 172.21.15.80:0/4206682393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f785c102600 msgr2=0x7f785c198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:47.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.792+0000 7f78618bd700 1 --2- 172.21.15.80:0/4206682393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f785c102600 0x7f785c198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:47.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.792+0000 7f78618bd700 1 -- 172.21.15.80:0/4206682393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f785c102fc0 msgr2=0x7f785c198c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:47.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.792+0000 7f78618bd700 1 --2- 172.21.15.80:0/4206682393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f785c102fc0 0x7f785c198c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:47.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.792+0000 7f78618bd700 1 -- 172.21.15.80:0/4206682393 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f785c1a7f90 con 0x7f785c108470 2024-04-26T18:33:47.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.792+0000 7f78610bc700 1 --2- 172.21.15.80:0/4206682393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f785c102600 0x7f785c198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:33:47.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.792+0000 7f78618bd700 1 --2- 172.21.15.80:0/4206682393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f785c108470 0x7f785c1991a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7854007ee0 tx=0x7f785400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:47.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.792+0000 7f78527fc700 1 -- 172.21.15.80:0/4206682393 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785400dbd0 con 0x7f785c108470 2024-04-26T18:33:47.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.792+0000 7f7863320700 1 -- 172.21.15.80:0/4206682393 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f785c1a8280 con 0x7f785c108470 2024-04-26T18:33:47.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.793+0000 7f78527fc700 1 -- 172.21.15.80:0/4206682393 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f785400dd70 con 0x7f785c108470 2024-04-26T18:33:47.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.793+0000 7f78527fc700 1 -- 172.21.15.80:0/4206682393 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7854005990 con 0x7f785c108470 2024-04-26T18:33:47.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.793+0000 7f7863320700 1 -- 172.21.15.80:0/4206682393 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f785c1a87e0 con 0x7f785c108470 2024-04-26T18:33:47.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.793+0000 7f7863320700 1 -- 172.21.15.80:0/4206682393 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f785c10a850 con 0x7f785c108470 2024-04-26T18:33:47.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.795+0000 7f78527fc700 1 -- 172.21.15.80:0/4206682393 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f785401a020 con 0x7f785c108470 2024-04-26T18:33:47.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.796+0000 7f78527fc700 1 --2- 172.21.15.80:0/4206682393 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f78480a3cd0 0x7f78480a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:47.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.796+0000 7f78610bc700 1 --2- 172.21.15.80:0/4206682393 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f78480a3cd0 0x7f78480a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:47.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.796+0000 7f78527fc700 1 -- 172.21.15.80:0/4206682393 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7f78540d01d0 con 0x7f785c108470 2024-04-26T18:33:47.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.796+0000 7f78610bc700 1 --2- 172.21.15.80:0/4206682393 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f78480a3cd0 0x7f78480a6190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7858005fd0 tx=0x7f7858005ee0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:47.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:47.800+0000 7f78527fc700 1 -- 172.21.15.80:0/4206682393 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7854010070 con 0x7f785c108470 2024-04-26T18:33:47.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:47 smithi082 ceph-mon[32808]: pgmap v317: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.6 KiB/s wr, 13 op/s 2024-04-26T18:33:47.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:48.000+0000 7f7863320700 1 -- 172.21.15.80:0/4206682393 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f785c103a90 con 0x7f785c108470 2024-04-26T18:33:48.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:48.001+0000 7f78527fc700 1 -- 172.21.15.80:0/4206682393 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+22147 (secure 0 0 0) 0x7f785c103a90 con 0x7f785c108470 2024-04-26T18:33:48.002 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:33:48.002 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":89,"fsid":"2187ca98-03fa-11ef-bc93-c7b262605968","created":"2024-04-26T18:24:58.809431+0000","modified":"2024-04-26T18:33:08.347435+0000","last_up_change":"2024-04-26T18:32:02.550187+0000","last_in_change":"2024-04-26T18:31:41.630932+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T18:28:14.502290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T18:33:02.102135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T18:33:05.300979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a01cfe6-d13a-4828-8c20-ad7fee7e87ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6803","nonce":429487384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6805","nonce":429487384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6809","nonce":429487384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6807","nonce":429487384}]},"public_addr":"172.21.15.80:6803/429487384","cluster_addr":"172.21.15.80:6805/429487384","heartbeat_back_addr":"172.21.15.80:6809/429487384","heartbeat_front_addr":"172.21.15.80:6807/429487384","state":["exists","up"]},{"osd":1,"uuid":"1f815d88-30b1-4540-b4f5-cc3d62707318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913033849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913033849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913033849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913033849}]},"public_addr":"172.21.15.82:6801/3913033849","cluster_addr":"172.21.15.82:6803/3913033849","heartbeat_back_addr":"172.21.15.82:6807/3913033849","heartbeat_front_addr":"172.21.15.82:6805/3913033849","state":["exists","up"]},{"osd":2,"uuid":"b8625dd7-4c1d-4258-ac2b-463ff96f4cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6801","nonce":503427508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6803","nonce":503427508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6807","nonce":503427508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6805","nonce":503427508}]},"public_addr":"172.21.15.192:6801/503427508","cluster_addr":"172.21.15.192:6803/503427508","heartbeat_back_addr":"172.21.15.192:6807/503427508","heartbeat_front_addr":"172.21.15.192:6805/503427508","state":["exists","up"]},{"osd":3,"uuid":"3068321a-3070-44ae-9bbd-a3faac8c21fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6811","nonce":407817066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6813","nonce":407817066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6817","nonce":407817066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6815","nonce":407817066}]},"public_addr":"172.21.15.80:6811/407817066","cluster_addr":"172.21.15.80:6813/407817066","heartbeat_back_addr":"172.21.15.80:6817/407817066","heartbeat_front_addr":"172.21.15.80:6815/407817066","state":["exists","up"]},{"osd":4,"uuid":"6b3d6455-9495-435b-8193-a260b63504ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6809","nonce":2068291934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6811","nonce":2068291934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6815","nonce":2068291934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6813","nonce":2068291934}]},"public_addr":"172.21.15.82:6809/2068291934","cluster_addr":"172.21.15.82:6811/2068291934","heartbeat_back_addr":"172.21.15.82:6815/2068291934","heartbeat_front_addr":"172.21.15.82:6813/2068291934","state":["exists","up"]},{"osd":5,"uuid":"538863f1-1486-45b5-a675-ecb1d3035599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6809","nonce":1770809727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6811","nonce":1770809727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6815","nonce":1770809727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6813","nonce":1770809727}]},"public_addr":"172.21.15.192:6809/1770809727","cluster_addr":"172.21.15.192:6811/1770809727","heartbeat_back_addr":"172.21.15.192:6815/1770809727","heartbeat_front_addr":"172.21.15.192:6813/1770809727","state":["exists","up"]},{"osd":6,"uuid":"7b4374d8-98e6-48e1-924b-c9b70a4baf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6819","nonce":145064490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6821","nonce":145064490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6825","nonce":145064490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6823","nonce":145064490}]},"public_addr":"172.21.15.80:6819/145064490","cluster_addr":"172.21.15.80:6821/145064490","heartbeat_back_addr":"172.21.15.80:6825/145064490","heartbeat_front_addr":"172.21.15.80:6823/145064490","state":["exists","up"]},{"osd":7,"uuid":"f3bb3c7d-4cce-4f49-b924-72ebbaad58ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6817","nonce":208047447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6819","nonce":208047447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6823","nonce":208047447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6821","nonce":208047447}]},"public_addr":"172.21.15.82:6817/208047447","cluster_addr":"172.21.15.82:6819/208047447","heartbeat_back_addr":"172.21.15.82:6823/208047447","heartbeat_front_addr":"172.21.15.82:6821/208047447","state":["exists","up"]},{"osd":8,"uuid":"6557b536-a516-4b01-a607-7981620fb2a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6817","nonce":3763069187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6819","nonce":3763069187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6823","nonce":3763069187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6821","nonce":3763069187}]},"public_addr":"172.21.15.192:6817/3763069187","cluster_addr":"172.21.15.192:6819/3763069187","heartbeat_back_addr":"172.21.15.192:6823/3763069187","heartbeat_front_addr":"172.21.15.192:6821/3763069187","state":["exists","up"]},{"osd":9,"uuid":"838615a7-1e68-4e81-8b3a-fba0ea75f7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6827","nonce":2109877993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6829","nonce":2109877993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6833","nonce":2109877993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6831","nonce":2109877993}]},"public_addr":"172.21.15.80:6827/2109877993","cluster_addr":"172.21.15.80:6829/2109877993","heartbeat_back_addr":"172.21.15.80:6833/2109877993","heartbeat_front_addr":"172.21.15.80:6831/2109877993","state":["exists","up"]},{"osd":10,"uuid":"cd664e50-3217-453d-9a89-6e26d717e6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6825","nonce":2877220993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6827","nonce":2877220993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6831","nonce":2877220993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6829","nonce":2877220993}]},"public_addr":"172.21.15.82:6825/2877220993","cluster_addr":"172.21.15.82:6827/2877220993","heartbeat_back_addr":"172.21.15.82:6831/2877220993","heartbeat_front_addr":"172.21.15.82:6829/2877220993","state":["exists","up"]},{"osd":11,"uuid":"e52807c6-8890-4df7-a8c6-51a7ff4b467b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6825","nonce":3466865106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6827","nonce":3466865106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6831","nonce":3466865106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6829","nonce":3466865106}]},"public_addr":"172.21.15.192:6825/3466865106","cluster_addr":"172.21.15.192:6827/3466865106","heartbeat_back_addr":"172.21.15.192:6831/3466865106","heartbeat_front_addr":"172.21.15.192:6829/3466865106","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:27:23.385471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:27:46.648232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:10.578970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:34.922048+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:59.142838+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:29:24.492250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:29:49.721803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:30:15.177027+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:30:41.544775+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:31:07.562401+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:31:33.498042+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:32:00.584085+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/1997155783":"2024-04-27T18:25:50.413207+0000","172.21.15.80:0/323607684":"2024-04-27T18:25:50.413207+0000","172.21.15.80:0/586397709":"2024-04-27T18:25:50.413207+0000","172.21.15.80:6801/4208962819":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/1353083127":"2024-04-27T18:25:24.440373+0000","172.21.15.80:6800/1997155783":"2024-04-27T18:25:50.413207+0000","172.21.15.80:6800/4208962819":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2644175019":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/1853513470":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2122929159":"2024-04-27T18:25:50.413207+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T18:33:48.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:48.003+0000 7f7863320700 1 -- 172.21.15.80:0/4206682393 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f78480a3cd0 msgr2=0x7f78480a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:48.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:48.003+0000 7f7863320700 1 --2- 172.21.15.80:0/4206682393 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f78480a3cd0 0x7f78480a6190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7858005fd0 tx=0x7f7858005ee0 comp rx=0 tx=0).stop 2024-04-26T18:33:48.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:48.003+0000 7f7863320700 1 -- 172.21.15.80:0/4206682393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f785c108470 msgr2=0x7f785c1991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:48.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:48.003+0000 7f7863320700 1 --2- 172.21.15.80:0/4206682393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f785c108470 0x7f785c1991a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7854007ee0 tx=0x7f785400d3b0 comp rx=0 tx=0).stop 2024-04-26T18:33:48.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:48.004+0000 7f7863320700 1 -- 172.21.15.80:0/4206682393 shutdown_connections 2024-04-26T18:33:48.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:48.004+0000 7f7863320700 1 --2- 172.21.15.80:0/4206682393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f785c108470 0x7f785c1991a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:48.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:48.004+0000 7f7863320700 1 --2- 172.21.15.80:0/4206682393 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f78480a3cd0 0x7f78480a6190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:48.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:48.004+0000 7f7863320700 1 --2- 172.21.15.80:0/4206682393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f785c102600 0x7f785c198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:48.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:48.004+0000 7f7863320700 1 --2- 172.21.15.80:0/4206682393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f785c102fc0 0x7f785c198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:48.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:48.004+0000 7f7863320700 1 -- 172.21.15.80:0/4206682393 >> 172.21.15.80:0/4206682393 conn(0x7f785c079210 msgr2=0x7f785c101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:48.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:48.004+0000 7f7863320700 1 -- 172.21.15.80:0/4206682393 shutdown_connections 2024-04-26T18:33:48.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:48.004+0000 7f7863320700 1 -- 172.21.15.80:0/4206682393 wait complete. 2024-04-26T18:33:48.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:47 smithi192 ceph-mon[32842]: pgmap v317: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.6 KiB/s wr, 13 op/s 2024-04-26T18:33:48.719 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-26T18:33:48.719 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T18:33:48.958 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:33:48.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:48 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/4206682393' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:33:48.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:48 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/4206682393' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:33:49.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:48 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/4206682393' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:33:49.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:49 smithi080 ceph-mon[29135]: pgmap v318: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-04-26T18:33:49.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:49 smithi082 ceph-mon[32808]: pgmap v318: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-04-26T18:33:50.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:49 smithi192 ceph-mon[32842]: pgmap v318: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-04-26T18:33:50.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.589+0000 7f763bc37700 1 -- 172.21.15.80:0/2794116704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76341094c0 msgr2=0x7f76341098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:50.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.589+0000 7f763bc37700 1 --2- 172.21.15.80:0/2794116704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76341094c0 0x7f76341098a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7624009990 tx=0x7f7624009ca0 comp rx=0 tx=0).stop 2024-04-26T18:33:50.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.589+0000 7f763bc37700 1 -- 172.21.15.80:0/2794116704 shutdown_connections 2024-04-26T18:33:50.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.589+0000 7f763bc37700 1 --2- 172.21.15.80:0/2794116704 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7634103e30 0x7f7634110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:50.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.589+0000 7f763bc37700 1 --2- 172.21.15.80:0/2794116704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76341094c0 0x7f76341098a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:50.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.589+0000 7f763bc37700 1 --2- 172.21.15.80:0/2794116704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7634103470 0x7f76341038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:50.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.589+0000 7f763bc37700 1 -- 172.21.15.80:0/2794116704 >> 172.21.15.80:0/2794116704 conn(0x7f763407a580 msgr2=0x7f763407a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:50.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.589+0000 7f763bc37700 1 -- 172.21.15.80:0/2794116704 shutdown_connections 2024-04-26T18:33:50.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.589+0000 7f763bc37700 1 -- 172.21.15.80:0/2794116704 wait complete. 2024-04-26T18:33:50.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.590+0000 7f763bc37700 1 Processor -- start 2024-04-26T18:33:50.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.590+0000 7f763bc37700 1 -- start start 2024-04-26T18:33:50.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.590+0000 7f763bc37700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7634103470 0x7f763419f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:50.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.590+0000 7f763bc37700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7634103e30 0x7f763419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:50.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.590+0000 7f763bc37700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76341094c0 0x7f7634199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:50.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.590+0000 7f763bc37700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f76341135f0 con 0x7f7634103e30 2024-04-26T18:33:50.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.590+0000 7f763bc37700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7634113470 con 0x7f7634103470 2024-04-26T18:33:50.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.590+0000 7f763bc37700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7634113770 con 0x7f76341094c0 2024-04-26T18:33:50.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.590+0000 7f76391d2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7634103e30 0x7f763419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:50.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.590+0000 7f76391d2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7634103e30 0x7f763419fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34872/0 (socket says 172.21.15.80:34872) 2024-04-26T18:33:50.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.590+0000 7f76391d2700 1 -- 172.21.15.80:0/1858075107 learned_addr learned my addr 172.21.15.80:0/1858075107 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:33:50.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.590+0000 7f76399d3700 1 --2- 172.21.15.80:0/1858075107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7634103470 0x7f763419f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:50.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.590+0000 7f76391d2700 1 -- 172.21.15.80:0/1858075107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76341094c0 msgr2=0x7f7634199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:50.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.590+0000 7f763a1d4700 1 --2- 172.21.15.80:0/1858075107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76341094c0 0x7f7634199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:50.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.590+0000 7f76391d2700 1 --2- 172.21.15.80:0/1858075107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76341094c0 0x7f7634199950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:50.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.590+0000 7f76391d2700 1 -- 172.21.15.80:0/1858075107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7634103470 msgr2=0x7f763419f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:50.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.590+0000 7f76391d2700 1 --2- 172.21.15.80:0/1858075107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7634103470 0x7f763419f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:50.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.590+0000 7f76391d2700 1 -- 172.21.15.80:0/1858075107 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f763419a0b0 con 0x7f7634103e30 2024-04-26T18:33:50.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.590+0000 7f76399d3700 1 --2- 172.21.15.80:0/1858075107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7634103470 0x7f763419f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:33:50.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.591+0000 7f76391d2700 1 --2- 172.21.15.80:0/1858075107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7634103e30 0x7f763419fcd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f763000c9b0 tx=0x7f763000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:50.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.591+0000 7f762affd700 1 -- 172.21.15.80:0/1858075107 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7630007b00 con 0x7f7634103e30 2024-04-26T18:33:50.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.591+0000 7f762affd700 1 -- 172.21.15.80:0/1858075107 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7630007ca0 con 0x7f7634103e30 2024-04-26T18:33:50.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.591+0000 7f763bc37700 1 -- 172.21.15.80:0/1858075107 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f763419a3a0 con 0x7f7634103e30 2024-04-26T18:33:50.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.591+0000 7f762affd700 1 -- 172.21.15.80:0/1858075107 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7630018730 con 0x7f7634103e30 2024-04-26T18:33:50.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.591+0000 7f763bc37700 1 -- 172.21.15.80:0/1858075107 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76341a6660 con 0x7f7634103e30 2024-04-26T18:33:50.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.592+0000 7f763bc37700 1 -- 172.21.15.80:0/1858075107 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f763410b930 con 0x7f7634103e30 2024-04-26T18:33:50.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.593+0000 7f762affd700 1 -- 172.21.15.80:0/1858075107 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f763000f450 con 0x7f7634103e30 2024-04-26T18:33:50.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.593+0000 7f762affd700 1 --2- 172.21.15.80:0/1858075107 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f76200a3cd0 0x7f76200a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:50.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.593+0000 7f76399d3700 1 --2- 172.21.15.80:0/1858075107 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f76200a3cd0 0x7f76200a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:50.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.594+0000 7f762affd700 1 -- 172.21.15.80:0/1858075107 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7f76300d0470 con 0x7f7634103e30 2024-04-26T18:33:50.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.594+0000 7f76399d3700 1 --2- 172.21.15.80:0/1858075107 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f76200a3cd0 0x7f76200a6190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7624000c00 tx=0x7f7624005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:50.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.598+0000 7f762affd700 1 -- 172.21.15.80:0/1858075107 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7630014030 con 0x7f7634103e30 2024-04-26T18:33:50.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.799+0000 7f763bc37700 1 -- 172.21.15.80:0/1858075107 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7634063860 con 0x7f76200a3cd0 2024-04-26T18:33:50.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.807+0000 7f762affd700 1 -- 172.21.15.80:0/1858075107 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258896 (secure 0 0 0) 0x7f7624065360 con 0x7f76200a3cd0 2024-04-26T18:33:50.812 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:33:50.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.810+0000 7f763bc37700 1 -- 172.21.15.80:0/1858075107 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f76200a3cd0 msgr2=0x7f76200a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:50.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.810+0000 7f763bc37700 1 --2- 172.21.15.80:0/1858075107 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f76200a3cd0 0x7f76200a6190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7624000c00 tx=0x7f7624005fb0 comp rx=0 tx=0).stop 2024-04-26T18:33:50.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.810+0000 7f763bc37700 1 -- 172.21.15.80:0/1858075107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7634103e30 msgr2=0x7f763419fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:50.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.810+0000 7f763bc37700 1 --2- 172.21.15.80:0/1858075107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7634103e30 0x7f763419fcd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f763000c9b0 tx=0x7f763000cd70 comp rx=0 tx=0).stop 2024-04-26T18:33:50.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.810+0000 7f763bc37700 1 -- 172.21.15.80:0/1858075107 shutdown_connections 2024-04-26T18:33:50.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.810+0000 7f763bc37700 1 --2- 172.21.15.80:0/1858075107 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f76200a3cd0 0x7f76200a6190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:50.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.810+0000 7f763bc37700 1 --2- 172.21.15.80:0/1858075107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76341094c0 0x7f7634199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:50.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.810+0000 7f763bc37700 1 --2- 172.21.15.80:0/1858075107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7634103470 0x7f763419f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:50.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.810+0000 7f763bc37700 1 --2- 172.21.15.80:0/1858075107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7634103e30 0x7f763419fcd0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:50.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.810+0000 7f763bc37700 1 -- 172.21.15.80:0/1858075107 >> 172.21.15.80:0/1858075107 conn(0x7f763407a580 msgr2=0x7f7634102210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:50.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.810+0000 7f763bc37700 1 -- 172.21.15.80:0/1858075107 shutdown_connections 2024-04-26T18:33:50.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:50.810+0000 7f763bc37700 1 -- 172.21.15.80:0/1858075107 wait complete. 2024-04-26T18:33:50.815 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-26T18:33:50.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-04-26T18:33:50.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]: dispatch 2024-04-26T18:33:50.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-04-26T18:33:50.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-04-26T18:33:50.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-04-26T18:33:50.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-04-26T18:33:50.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:50 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-04-26T18:33:50.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:50 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-04-26T18:33:50.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:50 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]: dispatch 2024-04-26T18:33:50.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:50 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-04-26T18:33:50.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:50 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-04-26T18:33:50.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:50 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-04-26T18:33:50.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:50 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-04-26T18:33:50.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:50 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-04-26T18:33:51.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:50 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-04-26T18:33:51.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:50 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]: dispatch 2024-04-26T18:33:51.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:50 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-04-26T18:33:51.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:50 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-04-26T18:33:51.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:50 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-04-26T18:33:51.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:50 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-04-26T18:33:51.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:50 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-04-26T18:33:51.522 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2024-04-26T18:33:50.637435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651858,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":412,"num_read_kb":324,"num_write":424,"num_write_kb":3065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":345,"ondisk_log_size":345,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365252,"kb_used_data":11940,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576572,"statfs":{"total":1151940427776,"available":1151566409728,"internally_reserved":0,"allocated":12226560,"data_stored":7540922,"data_compressed":106677,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":32230,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":82,"num_write":18,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.135095"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.566844+0000","last_change":"2024-04-26T18:33:06.565673+0000","last_active":"2024-04-26T18:33:08.566844+0000","last_peered":"2024-04-26T18:33:08.566844+0000","last_clean":"2024-04-26T18:33:08.566844+0000","last_became_active":"2024-04-26T18:33:06.565065+0000","last_became_peered":"2024-04-26T18:33:06.565065+0000","last_unstale":"2024-04-26T18:33:08.566844+0000","last_undegraded":"2024-04-26T18:33:08.566844+0000","last_fullsized":"2024-04-26T18:33:08.566844+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:54:10.833343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.563895+0000","last_change":"2024-04-26T18:33:06.552350+0000","last_active":"2024-04-26T18:33:08.563895+0000","last_peered":"2024-04-26T18:33:08.563895+0000","last_clean":"2024-04-26T18:33:08.563895+0000","last_became_active":"2024-04-26T18:33:06.551941+0000","last_became_peered":"2024-04-26T18:33:06.551941+0000","last_unstale":"2024-04-26T18:33:08.563895+0000","last_undegraded":"2024-04-26T18:33:08.563895+0000","last_fullsized":"2024-04-26T18:33:08.563895+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:40.702995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.563932+0000","last_change":"2024-04-26T18:33:06.561456+0000","last_active":"2024-04-26T18:33:08.563932+0000","last_peered":"2024-04-26T18:33:08.563932+0000","last_clean":"2024-04-26T18:33:08.563932+0000","last_became_active":"2024-04-26T18:33:06.561032+0000","last_became_peered":"2024-04-26T18:33:06.561032+0000","last_unstale":"2024-04-26T18:33:08.563932+0000","last_undegraded":"2024-04-26T18:33:08.563932+0000","last_fullsized":"2024-04-26T18:33:08.563932+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:56:56.228873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.562480+0000","last_change":"2024-04-26T18:33:06.556597+0000","last_active":"2024-04-26T18:33:08.562480+0000","last_peered":"2024-04-26T18:33:08.562480+0000","last_clean":"2024-04-26T18:33:08.562480+0000","last_became_active":"2024-04-26T18:33:06.555356+0000","last_became_peered":"2024-04-26T18:33:06.555356+0000","last_unstale":"2024-04-26T18:33:08.562480+0000","last_undegraded":"2024-04-26T18:33:08.562480+0000","last_fullsized":"2024-04-26T18:33:08.562480+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:55.860495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.548726+0000","last_change":"2024-04-26T18:33:06.549480+0000","last_active":"2024-04-26T18:33:08.548726+0000","last_peered":"2024-04-26T18:33:08.548726+0000","last_clean":"2024-04-26T18:33:08.548726+0000","last_became_active":"2024-04-26T18:33:06.549086+0000","last_became_peered":"2024-04-26T18:33:06.549086+0000","last_unstale":"2024-04-26T18:33:08.548726+0000","last_undegraded":"2024-04-26T18:33:08.548726+0000","last_fullsized":"2024-04-26T18:33:08.548726+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:13.012745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.562433+0000","last_change":"2024-04-26T18:33:06.558539+0000","last_active":"2024-04-26T18:33:08.562433+0000","last_peered":"2024-04-26T18:33:08.562433+0000","last_clean":"2024-04-26T18:33:08.562433+0000","last_became_active":"2024-04-26T18:33:06.558185+0000","last_became_peered":"2024-04-26T18:33:06.558185+0000","last_unstale":"2024-04-26T18:33:08.562433+0000","last_undegraded":"2024-04-26T18:33:08.562433+0000","last_fullsized":"2024-04-26T18:33:08.562433+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:59:31.299478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561753+0000","last_change":"2024-04-26T18:33:06.557336+0000","last_active":"2024-04-26T18:33:08.561753+0000","last_peered":"2024-04-26T18:33:08.561753+0000","last_clean":"2024-04-26T18:33:08.561753+0000","last_became_active":"2024-04-26T18:33:06.556988+0000","last_became_peered":"2024-04-26T18:33:06.556988+0000","last_unstale":"2024-04-26T18:33:08.561753+0000","last_undegraded":"2024-04-26T18:33:08.561753+0000","last_fullsized":"2024-04-26T18:33:08.561753+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:48.814042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561749+0000","last_change":"2024-04-26T18:33:06.556355+0000","last_active":"2024-04-26T18:33:08.561749+0000","last_peered":"2024-04-26T18:33:08.561749+0000","last_clean":"2024-04-26T18:33:08.561749+0000","last_became_active":"2024-04-26T18:33:06.555947+0000","last_became_peered":"2024-04-26T18:33:06.555947+0000","last_unstale":"2024-04-26T18:33:08.561749+0000","last_undegraded":"2024-04-26T18:33:08.561749+0000","last_fullsized":"2024-04-26T18:33:08.561749+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:36.607305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.552041+0000","last_change":"2024-04-26T18:33:06.569673+0000","last_active":"2024-04-26T18:33:08.552041+0000","last_peered":"2024-04-26T18:33:08.552041+0000","last_clean":"2024-04-26T18:33:08.552041+0000","last_became_active":"2024-04-26T18:33:06.568453+0000","last_became_peered":"2024-04-26T18:33:06.568453+0000","last_unstale":"2024-04-26T18:33:08.552041+0000","last_undegraded":"2024-04-26T18:33:08.552041+0000","last_fullsized":"2024-04-26T18:33:08.552041+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:38.428723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.563956+0000","last_change":"2024-04-26T18:33:06.564286+0000","last_active":"2024-04-26T18:33:08.563956+0000","last_peered":"2024-04-26T18:33:08.563956+0000","last_clean":"2024-04-26T18:33:08.563956+0000","last_became_active":"2024-04-26T18:33:06.563830+0000","last_became_peered":"2024-04-26T18:33:06.563830+0000","last_unstale":"2024-04-26T18:33:08.563956+0000","last_undegraded":"2024-04-26T18:33:08.563956+0000","last_fullsized":"2024-04-26T18:33:08.563956+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:36.518838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561778+0000","last_change":"2024-04-26T18:33:06.560724+0000","last_active":"2024-04-26T18:33:08.561778+0000","last_peered":"2024-04-26T18:33:08.561778+0000","last_clean":"2024-04-26T18:33:08.561778+0000","last_became_active":"2024-04-26T18:33:06.560393+0000","last_became_peered":"2024-04-26T18:33:06.560393+0000","last_unstale":"2024-04-26T18:33:08.561778+0000","last_undegraded":"2024-04-26T18:33:08.561778+0000","last_fullsized":"2024-04-26T18:33:08.561778+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:41.286466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.562212+0000","last_change":"2024-04-26T18:33:06.554476+0000","last_active":"2024-04-26T18:33:08.562212+0000","last_peered":"2024-04-26T18:33:08.562212+0000","last_clean":"2024-04-26T18:33:08.562212+0000","last_became_active":"2024-04-26T18:33:06.554087+0000","last_became_peered":"2024-04-26T18:33:06.554087+0000","last_unstale":"2024-04-26T18:33:08.562212+0000","last_undegraded":"2024-04-26T18:33:08.562212+0000","last_fullsized":"2024-04-26T18:33:08.562212+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:41.392991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.562060+0000","last_change":"2024-04-26T18:33:06.555813+0000","last_active":"2024-04-26T18:33:08.562060+0000","last_peered":"2024-04-26T18:33:08.562060+0000","last_clean":"2024-04-26T18:33:08.562060+0000","last_became_active":"2024-04-26T18:33:06.555498+0000","last_became_peered":"2024-04-26T18:33:06.555498+0000","last_unstale":"2024-04-26T18:33:08.562060+0000","last_undegraded":"2024-04-26T18:33:08.562060+0000","last_fullsized":"2024-04-26T18:33:08.562060+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:21.531142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.564275+0000","last_change":"2024-04-26T18:33:06.551833+0000","last_active":"2024-04-26T18:33:08.564275+0000","last_peered":"2024-04-26T18:33:08.564275+0000","last_clean":"2024-04-26T18:33:08.564275+0000","last_became_active":"2024-04-26T18:33:06.551503+0000","last_became_peered":"2024-04-26T18:33:06.551503+0000","last_unstale":"2024-04-26T18:33:08.564275+0000","last_undegraded":"2024-04-26T18:33:08.564275+0000","last_fullsized":"2024-04-26T18:33:08.564275+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:20.560656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.563493+0000","last_change":"2024-04-26T18:33:06.555971+0000","last_active":"2024-04-26T18:33:08.563493+0000","last_peered":"2024-04-26T18:33:08.563493+0000","last_clean":"2024-04-26T18:33:08.563493+0000","last_became_active":"2024-04-26T18:33:06.555312+0000","last_became_peered":"2024-04-26T18:33:06.555312+0000","last_unstale":"2024-04-26T18:33:08.563493+0000","last_undegraded":"2024-04-26T18:33:08.563493+0000","last_fullsized":"2024-04-26T18:33:08.563493+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:05.066403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.551546+0000","last_change":"2024-04-26T18:33:06.567762+0000","last_active":"2024-04-26T18:33:08.551546+0000","last_peered":"2024-04-26T18:33:08.551546+0000","last_clean":"2024-04-26T18:33:08.551546+0000","last_became_active":"2024-04-26T18:33:06.567368+0000","last_became_peered":"2024-04-26T18:33:06.567368+0000","last_unstale":"2024-04-26T18:33:08.551546+0000","last_undegraded":"2024-04-26T18:33:08.551546+0000","last_fullsized":"2024-04-26T18:33:08.551546+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:27.428529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.567136+0000","last_change":"2024-04-26T18:33:06.565334+0000","last_active":"2024-04-26T18:33:08.567136+0000","last_peered":"2024-04-26T18:33:08.567136+0000","last_clean":"2024-04-26T18:33:08.567136+0000","last_became_active":"2024-04-26T18:33:06.564997+0000","last_became_peered":"2024-04-26T18:33:06.564997+0000","last_unstale":"2024-04-26T18:33:08.567136+0000","last_undegraded":"2024-04-26T18:33:08.567136+0000","last_fullsized":"2024-04-26T18:33:08.567136+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:57.892318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.546257+0000","last_change":"2024-04-26T18:33:06.562242+0000","last_active":"2024-04-26T18:33:08.546257+0000","last_peered":"2024-04-26T18:33:08.546257+0000","last_clean":"2024-04-26T18:33:08.546257+0000","last_became_active":"2024-04-26T18:33:06.561863+0000","last_became_peered":"2024-04-26T18:33:06.561863+0000","last_unstale":"2024-04-26T18:33:08.546257+0000","last_undegraded":"2024-04-26T18:33:08.546257+0000","last_fullsized":"2024-04-26T18:33:08.546257+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:22.745294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.550639+0000","last_change":"2024-04-26T18:33:06.555511+0000","last_active":"2024-04-26T18:33:08.550639+0000","last_peered":"2024-04-26T18:33:08.550639+0000","last_clean":"2024-04-26T18:33:08.550639+0000","last_became_active":"2024-04-26T18:33:06.555201+0000","last_became_peered":"2024-04-26T18:33:06.555201+0000","last_unstale":"2024-04-26T18:33:08.550639+0000","last_undegraded":"2024-04-26T18:33:08.550639+0000","last_fullsized":"2024-04-26T18:33:08.550639+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:09.644167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":61,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:47.943564+0000","last_change":"2024-04-26T18:33:03.527583+0000","last_active":"2024-04-26T18:33:47.943564+0000","last_peered":"2024-04-26T18:33:47.943564+0000","last_clean":"2024-04-26T18:33:47.943564+0000","last_became_active":"2024-04-26T18:33:03.527239+0000","last_became_peered":"2024-04-26T18:33:03.527239+0000","last_unstale":"2024-04-26T18:33:47.943564+0000","last_undegraded":"2024-04-26T18:33:47.943564+0000","last_fullsized":"2024-04-26T18:33:47.943564+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:30:43.989217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561539+0000","last_change":"2024-04-26T18:33:06.560652+0000","last_active":"2024-04-26T18:33:08.561539+0000","last_peered":"2024-04-26T18:33:08.561539+0000","last_clean":"2024-04-26T18:33:08.561539+0000","last_became_active":"2024-04-26T18:33:06.560311+0000","last_became_peered":"2024-04-26T18:33:06.560311+0000","last_unstale":"2024-04-26T18:33:08.561539+0000","last_undegraded":"2024-04-26T18:33:08.561539+0000","last_fullsized":"2024-04-26T18:33:08.561539+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:22.653995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.566923+0000","last_change":"2024-04-26T18:33:03.860585+0000","last_active":"2024-04-26T18:33:08.566923+0000","last_peered":"2024-04-26T18:33:08.566923+0000","last_clean":"2024-04-26T18:33:08.566923+0000","last_became_active":"2024-04-26T18:33:03.860232+0000","last_became_peered":"2024-04-26T18:33:03.860232+0000","last_unstale":"2024-04-26T18:33:08.566923+0000","last_undegraded":"2024-04-26T18:33:08.566923+0000","last_fullsized":"2024-04-26T18:33:08.566923+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:04.685495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.564715+0000","last_change":"2024-04-26T18:33:06.563764+0000","last_active":"2024-04-26T18:33:08.564715+0000","last_peered":"2024-04-26T18:33:08.564715+0000","last_clean":"2024-04-26T18:33:08.564715+0000","last_became_active":"2024-04-26T18:33:06.563322+0000","last_became_peered":"2024-04-26T18:33:06.563322+0000","last_unstale":"2024-04-26T18:33:08.564715+0000","last_undegraded":"2024-04-26T18:33:08.564715+0000","last_fullsized":"2024-04-26T18:33:08.564715+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:17:53.144144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:23.913213+0000","last_change":"2024-04-26T18:33:03.533057+0000","last_active":"2024-04-26T18:33:23.913213+0000","last_peered":"2024-04-26T18:33:23.913213+0000","last_clean":"2024-04-26T18:33:23.913213+0000","last_became_active":"2024-04-26T18:33:03.532665+0000","last_became_peered":"2024-04-26T18:33:03.532665+0000","last_unstale":"2024-04-26T18:33:23.913213+0000","last_undegraded":"2024-04-26T18:33:23.913213+0000","last_fullsized":"2024-04-26T18:33:23.913213+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:29.125064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.551629+0000","last_change":"2024-04-26T18:33:06.567612+0000","last_active":"2024-04-26T18:33:08.551629+0000","last_peered":"2024-04-26T18:33:08.551629+0000","last_clean":"2024-04-26T18:33:08.551629+0000","last_became_active":"2024-04-26T18:33:06.565883+0000","last_became_peered":"2024-04-26T18:33:06.565883+0000","last_unstale":"2024-04-26T18:33:08.551629+0000","last_undegraded":"2024-04-26T18:33:08.551629+0000","last_fullsized":"2024-04-26T18:33:08.551629+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:59.721305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:23.674632+0000","last_change":"2024-04-26T18:33:03.532075+0000","last_active":"2024-04-26T18:33:23.674632+0000","last_peered":"2024-04-26T18:33:23.674632+0000","last_clean":"2024-04-26T18:33:23.674632+0000","last_became_active":"2024-04-26T18:33:03.531729+0000","last_became_peered":"2024-04-26T18:33:03.531729+0000","last_unstale":"2024-04-26T18:33:23.674632+0000","last_undegraded":"2024-04-26T18:33:23.674632+0000","last_fullsized":"2024-04-26T18:33:23.674632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:23.748292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.563345+0000","last_change":"2024-04-26T18:33:06.569377+0000","last_active":"2024-04-26T18:33:08.563345+0000","last_peered":"2024-04-26T18:33:08.563345+0000","last_clean":"2024-04-26T18:33:08.563345+0000","last_became_active":"2024-04-26T18:33:06.569057+0000","last_became_peered":"2024-04-26T18:33:06.569057+0000","last_unstale":"2024-04-26T18:33:08.563345+0000","last_undegraded":"2024-04-26T18:33:08.563345+0000","last_fullsized":"2024-04-26T18:33:08.563345+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:10.968017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:43.940695+0000","last_change":"2024-04-26T18:33:03.525186+0000","last_active":"2024-04-26T18:33:43.940695+0000","last_peered":"2024-04-26T18:33:43.940695+0000","last_clean":"2024-04-26T18:33:43.940695+0000","last_became_active":"2024-04-26T18:33:03.524880+0000","last_became_peered":"2024-04-26T18:33:03.524880+0000","last_unstale":"2024-04-26T18:33:43.940695+0000","last_undegraded":"2024-04-26T18:33:43.940695+0000","last_fullsized":"2024-04-26T18:33:43.940695+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:51:30.130244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.548852+0000","last_change":"2024-04-26T18:33:06.558034+0000","last_active":"2024-04-26T18:33:08.548852+0000","last_peered":"2024-04-26T18:33:08.548852+0000","last_clean":"2024-04-26T18:33:08.548852+0000","last_became_active":"2024-04-26T18:33:06.557694+0000","last_became_peered":"2024-04-26T18:33:06.557694+0000","last_unstale":"2024-04-26T18:33:08.548852+0000","last_undegraded":"2024-04-26T18:33:08.548852+0000","last_fullsized":"2024-04-26T18:33:08.548852+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:02.497601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:22.664930+0000","last_change":"2024-04-26T18:33:03.528750+0000","last_active":"2024-04-26T18:33:22.664930+0000","last_peered":"2024-04-26T18:33:22.664930+0000","last_clean":"2024-04-26T18:33:22.664930+0000","last_became_active":"2024-04-26T18:33:03.528442+0000","last_became_peered":"2024-04-26T18:33:03.528442+0000","last_unstale":"2024-04-26T18:33:22.664930+0000","last_undegraded":"2024-04-26T18:33:22.664930+0000","last_fullsized":"2024-04-26T18:33:22.664930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:13.931280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.563626+0000","last_change":"2024-04-26T18:33:06.561274+0000","last_active":"2024-04-26T18:33:08.563626+0000","last_peered":"2024-04-26T18:33:08.563626+0000","last_clean":"2024-04-26T18:33:08.563626+0000","last_became_active":"2024-04-26T18:33:06.560622+0000","last_became_peered":"2024-04-26T18:33:06.560622+0000","last_unstale":"2024-04-26T18:33:08.563626+0000","last_undegraded":"2024-04-26T18:33:08.563626+0000","last_fullsized":"2024-04-26T18:33:08.563626+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:27.875181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:21.657538+0000","last_change":"2024-04-26T18:33:03.529634+0000","last_active":"2024-04-26T18:33:21.657538+0000","last_peered":"2024-04-26T18:33:21.657538+0000","last_clean":"2024-04-26T18:33:21.657538+0000","last_became_active":"2024-04-26T18:33:03.529303+0000","last_became_peered":"2024-04-26T18:33:03.529303+0000","last_unstale":"2024-04-26T18:33:21.657538+0000","last_undegraded":"2024-04-26T18:33:21.657538+0000","last_fullsized":"2024-04-26T18:33:21.657538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:37.580542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.562269+0000","last_change":"2024-04-26T18:33:06.550896+0000","last_active":"2024-04-26T18:33:08.562269+0000","last_peered":"2024-04-26T18:33:08.562269+0000","last_clean":"2024-04-26T18:33:08.562269+0000","last_became_active":"2024-04-26T18:33:06.550571+0000","last_became_peered":"2024-04-26T18:33:06.550571+0000","last_unstale":"2024-04-26T18:33:08.562269+0000","last_undegraded":"2024-04-26T18:33:08.562269+0000","last_fullsized":"2024-04-26T18:33:08.562269+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:26.715158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:23.674050+0000","last_change":"2024-04-26T18:33:03.530875+0000","last_active":"2024-04-26T18:33:23.674050+0000","last_peered":"2024-04-26T18:33:23.674050+0000","last_clean":"2024-04-26T18:33:23.674050+0000","last_became_active":"2024-04-26T18:33:03.530564+0000","last_became_peered":"2024-04-26T18:33:03.530564+0000","last_unstale":"2024-04-26T18:33:23.674050+0000","last_undegraded":"2024-04-26T18:33:23.674050+0000","last_fullsized":"2024-04-26T18:33:23.674050+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:20.320591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.546287+0000","last_change":"2024-04-26T18:33:06.553434+0000","last_active":"2024-04-26T18:33:08.546287+0000","last_peered":"2024-04-26T18:33:08.546287+0000","last_clean":"2024-04-26T18:33:08.546287+0000","last_became_active":"2024-04-26T18:33:06.551897+0000","last_became_peered":"2024-04-26T18:33:06.551897+0000","last_unstale":"2024-04-26T18:33:08.546287+0000","last_undegraded":"2024-04-26T18:33:08.546287+0000","last_fullsized":"2024-04-26T18:33:08.546287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:56.503266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":71,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:45.941856+0000","last_change":"2024-04-26T18:33:03.524239+0000","last_active":"2024-04-26T18:33:45.941856+0000","last_peered":"2024-04-26T18:33:45.941856+0000","last_clean":"2024-04-26T18:33:45.941856+0000","last_became_active":"2024-04-26T18:33:03.523848+0000","last_became_peered":"2024-04-26T18:33:03.523848+0000","last_unstale":"2024-04-26T18:33:45.941856+0000","last_undegraded":"2024-04-26T18:33:45.941856+0000","last_fullsized":"2024-04-26T18:33:45.941856+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:29.354430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.551984+0000","last_change":"2024-04-26T18:33:06.569557+0000","last_active":"2024-04-26T18:33:08.551984+0000","last_peered":"2024-04-26T18:33:08.551984+0000","last_clean":"2024-04-26T18:33:08.551984+0000","last_became_active":"2024-04-26T18:33:06.568414+0000","last_became_peered":"2024-04-26T18:33:06.568414+0000","last_unstale":"2024-04-26T18:33:08.551984+0000","last_undegraded":"2024-04-26T18:33:08.551984+0000","last_fullsized":"2024-04-26T18:33:08.551984+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:30.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:23.672108+0000","last_change":"2024-04-26T18:33:03.528554+0000","last_active":"2024-04-26T18:33:23.672108+0000","last_peered":"2024-04-26T18:33:23.672108+0000","last_clean":"2024-04-26T18:33:23.672108+0000","last_became_active":"2024-04-26T18:33:03.527611+0000","last_became_peered":"2024-04-26T18:33:03.527611+0000","last_unstale":"2024-04-26T18:33:23.672108+0000","last_undegraded":"2024-04-26T18:33:23.672108+0000","last_fullsized":"2024-04-26T18:33:23.672108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:28.387779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.564707+0000","last_change":"2024-04-26T18:33:06.561415+0000","last_active":"2024-04-26T18:33:08.564707+0000","last_peered":"2024-04-26T18:33:08.564707+0000","last_clean":"2024-04-26T18:33:08.564707+0000","last_became_active":"2024-04-26T18:33:06.560518+0000","last_became_peered":"2024-04-26T18:33:06.560518+0000","last_unstale":"2024-04-26T18:33:08.564707+0000","last_undegraded":"2024-04-26T18:33:08.564707+0000","last_fullsized":"2024-04-26T18:33:08.564707+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:49.824157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:22.664148+0000","last_change":"2024-04-26T18:33:03.861087+0000","last_active":"2024-04-26T18:33:22.664148+0000","last_peered":"2024-04-26T18:33:22.664148+0000","last_clean":"2024-04-26T18:33:22.664148+0000","last_became_active":"2024-04-26T18:33:03.860531+0000","last_became_peered":"2024-04-26T18:33:03.860531+0000","last_unstale":"2024-04-26T18:33:22.664148+0000","last_undegraded":"2024-04-26T18:33:22.664148+0000","last_fullsized":"2024-04-26T18:33:22.664148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:22:07.086887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.551869+0000","last_change":"2024-04-26T18:33:06.565910+0000","last_active":"2024-04-26T18:33:08.551869+0000","last_peered":"2024-04-26T18:33:08.551869+0000","last_clean":"2024-04-26T18:33:08.551869+0000","last_became_active":"2024-04-26T18:33:06.565402+0000","last_became_peered":"2024-04-26T18:33:06.565402+0000","last_unstale":"2024-04-26T18:33:08.551869+0000","last_undegraded":"2024-04-26T18:33:08.551869+0000","last_fullsized":"2024-04-26T18:33:08.551869+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:40.418513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"89'27","reported_seq":101,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:45.944533+0000","last_change":"2024-04-26T18:33:03.527871+0000","last_active":"2024-04-26T18:33:45.944533+0000","last_peered":"2024-04-26T18:33:45.944533+0000","last_clean":"2024-04-26T18:33:45.944533+0000","last_became_active":"2024-04-26T18:33:03.527546+0000","last_became_peered":"2024-04-26T18:33:03.527546+0000","last_unstale":"2024-04-26T18:33:45.944533+0000","last_undegraded":"2024-04-26T18:33:45.944533+0000","last_fullsized":"2024-04-26T18:33:45.944533+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:24.749505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54443,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":78,"num_write":29,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.548762+0000","last_change":"2024-04-26T18:33:06.546735+0000","last_active":"2024-04-26T18:33:08.548762+0000","last_peered":"2024-04-26T18:33:08.548762+0000","last_clean":"2024-04-26T18:33:08.548762+0000","last_became_active":"2024-04-26T18:33:06.546360+0000","last_became_peered":"2024-04-26T18:33:06.546360+0000","last_unstale":"2024-04-26T18:33:08.548762+0000","last_undegraded":"2024-04-26T18:33:08.548762+0000","last_fullsized":"2024-04-26T18:33:08.548762+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:15.736669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:23.913029+0000","last_change":"2024-04-26T18:33:03.526081+0000","last_active":"2024-04-26T18:33:23.913029+0000","last_peered":"2024-04-26T18:33:23.913029+0000","last_clean":"2024-04-26T18:33:23.913029+0000","last_became_active":"2024-04-26T18:33:03.525717+0000","last_became_peered":"2024-04-26T18:33:03.525717+0000","last_unstale":"2024-04-26T18:33:23.913029+0000","last_undegraded":"2024-04-26T18:33:23.913029+0000","last_fullsized":"2024-04-26T18:33:23.913029+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:15.137654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561065+0000","last_change":"2024-04-26T18:33:06.552689+0000","last_active":"2024-04-26T18:33:08.561065+0000","last_peered":"2024-04-26T18:33:08.561065+0000","last_clean":"2024-04-26T18:33:08.561065+0000","last_became_active":"2024-04-26T18:33:06.552404+0000","last_became_peered":"2024-04-26T18:33:06.552404+0000","last_unstale":"2024-04-26T18:33:08.561065+0000","last_undegraded":"2024-04-26T18:33:08.561065+0000","last_fullsized":"2024-04-26T18:33:08.561065+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:58:32.681037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:23.673305+0000","last_change":"2024-04-26T18:33:03.526092+0000","last_active":"2024-04-26T18:33:23.673305+0000","last_peered":"2024-04-26T18:33:23.673305+0000","last_clean":"2024-04-26T18:33:23.673305+0000","last_became_active":"2024-04-26T18:33:03.525782+0000","last_became_peered":"2024-04-26T18:33:03.525782+0000","last_unstale":"2024-04-26T18:33:23.673305+0000","last_undegraded":"2024-04-26T18:33:23.673305+0000","last_fullsized":"2024-04-26T18:33:23.673305+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:56.564484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.562622+0000","last_change":"2024-04-26T18:33:06.555034+0000","last_active":"2024-04-26T18:33:08.562622+0000","last_peered":"2024-04-26T18:33:08.562622+0000","last_clean":"2024-04-26T18:33:08.562622+0000","last_became_active":"2024-04-26T18:33:06.554623+0000","last_became_peered":"2024-04-26T18:33:06.554623+0000","last_unstale":"2024-04-26T18:33:08.562622+0000","last_undegraded":"2024-04-26T18:33:08.562622+0000","last_fullsized":"2024-04-26T18:33:08.562622+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:56.243086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'5","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:45.941865+0000","last_change":"2024-04-26T18:33:03.531232+0000","last_active":"2024-04-26T18:33:45.941865+0000","last_peered":"2024-04-26T18:33:45.941865+0000","last_clean":"2024-04-26T18:33:45.941865+0000","last_became_active":"2024-04-26T18:33:03.530861+0000","last_became_peered":"2024-04-26T18:33:03.530861+0000","last_unstale":"2024-04-26T18:33:45.941865+0000","last_undegraded":"2024-04-26T18:33:45.941865+0000","last_fullsized":"2024-04-26T18:33:45.941865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:07:44.576659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.562081+0000","last_change":"2024-04-26T18:33:06.559471+0000","last_active":"2024-04-26T18:33:08.562081+0000","last_peered":"2024-04-26T18:33:08.562081+0000","last_clean":"2024-04-26T18:33:08.562081+0000","last_became_active":"2024-04-26T18:33:06.559156+0000","last_became_peered":"2024-04-26T18:33:06.559156+0000","last_unstale":"2024-04-26T18:33:08.562081+0000","last_undegraded":"2024-04-26T18:33:08.562081+0000","last_fullsized":"2024-04-26T18:33:08.562081+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:37.624415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:23.674177+0000","last_change":"2024-04-26T18:33:03.860900+0000","last_active":"2024-04-26T18:33:23.674177+0000","last_peered":"2024-04-26T18:33:23.674177+0000","last_clean":"2024-04-26T18:33:23.674177+0000","last_became_active":"2024-04-26T18:33:03.860601+0000","last_became_peered":"2024-04-26T18:33:03.860601+0000","last_unstale":"2024-04-26T18:33:23.674177+0000","last_undegraded":"2024-04-26T18:33:23.674177+0000","last_fullsized":"2024-04-26T18:33:23.674177+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:56.527624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561952+0000","last_change":"2024-04-26T18:33:06.569012+0000","last_active":"2024-04-26T18:33:08.561952+0000","last_peered":"2024-04-26T18:33:08.561952+0000","last_clean":"2024-04-26T18:33:08.561952+0000","last_became_active":"2024-04-26T18:33:06.568628+0000","last_became_peered":"2024-04-26T18:33:06.568628+0000","last_unstale":"2024-04-26T18:33:08.561952+0000","last_undegraded":"2024-04-26T18:33:08.561952+0000","last_fullsized":"2024-04-26T18:33:08.561952+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:34.510828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:23.651775+0000","last_change":"2024-04-26T18:33:03.530623+0000","last_active":"2024-04-26T18:33:23.651775+0000","last_peered":"2024-04-26T18:33:23.651775+0000","last_clean":"2024-04-26T18:33:23.651775+0000","last_became_active":"2024-04-26T18:33:03.530283+0000","last_became_peered":"2024-04-26T18:33:03.530283+0000","last_unstale":"2024-04-26T18:33:23.651775+0000","last_undegraded":"2024-04-26T18:33:23.651775+0000","last_fullsized":"2024-04-26T18:33:23.651775+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:05.798381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.566303+0000","last_change":"2024-04-26T18:33:06.557597+0000","last_active":"2024-04-26T18:33:08.566303+0000","last_peered":"2024-04-26T18:33:08.566303+0000","last_clean":"2024-04-26T18:33:08.566303+0000","last_became_active":"2024-04-26T18:33:06.557249+0000","last_became_peered":"2024-04-26T18:33:06.557249+0000","last_unstale":"2024-04-26T18:33:08.566303+0000","last_undegraded":"2024-04-26T18:33:08.566303+0000","last_fullsized":"2024-04-26T18:33:08.566303+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:22.258691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.546308+0000","last_change":"2024-04-26T18:33:03.861082+0000","last_active":"2024-04-26T18:33:08.546308+0000","last_peered":"2024-04-26T18:33:08.546308+0000","last_clean":"2024-04-26T18:33:08.546308+0000","last_became_active":"2024-04-26T18:33:03.860661+0000","last_became_peered":"2024-04-26T18:33:03.860661+0000","last_unstale":"2024-04-26T18:33:08.546308+0000","last_undegraded":"2024-04-26T18:33:08.546308+0000","last_fullsized":"2024-04-26T18:33:08.546308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:46.653421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"89'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.562722+0000","last_change":"2024-04-26T18:33:06.558268+0000","last_active":"2024-04-26T18:33:08.562722+0000","last_peered":"2024-04-26T18:33:08.562722+0000","last_clean":"2024-04-26T18:33:08.562722+0000","last_became_active":"2024-04-26T18:33:06.557899+0000","last_became_peered":"2024-04-26T18:33:06.557899+0000","last_unstale":"2024-04-26T18:33:08.562722+0000","last_undegraded":"2024-04-26T18:33:08.562722+0000","last_fullsized":"2024-04-26T18:33:08.562722+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:03:47.016288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'5","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:46.942918+0000","last_change":"2024-04-26T18:33:03.528398+0000","last_active":"2024-04-26T18:33:46.942918+0000","last_peered":"2024-04-26T18:33:46.942918+0000","last_clean":"2024-04-26T18:33:46.942918+0000","last_became_active":"2024-04-26T18:33:03.528008+0000","last_became_peered":"2024-04-26T18:33:03.528008+0000","last_unstale":"2024-04-26T18:33:46.942918+0000","last_undegraded":"2024-04-26T18:33:46.942918+0000","last_fullsized":"2024-04-26T18:33:46.942918+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:27.027873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.563464+0000","last_change":"2024-04-26T18:33:06.556035+0000","last_active":"2024-04-26T18:33:08.563464+0000","last_peered":"2024-04-26T18:33:08.563464+0000","last_clean":"2024-04-26T18:33:08.563464+0000","last_became_active":"2024-04-26T18:33:06.555703+0000","last_became_peered":"2024-04-26T18:33:06.555703+0000","last_unstale":"2024-04-26T18:33:08.563464+0000","last_undegraded":"2024-04-26T18:33:08.563464+0000","last_fullsized":"2024-04-26T18:33:08.563464+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:30:02.064205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.562117+0000","last_change":"2024-04-26T18:33:06.556447+0000","last_active":"2024-04-26T18:33:08.562117+0000","last_peered":"2024-04-26T18:33:08.562117+0000","last_clean":"2024-04-26T18:33:08.562117+0000","last_became_active":"2024-04-26T18:33:06.556124+0000","last_became_peered":"2024-04-26T18:33:06.556124+0000","last_unstale":"2024-04-26T18:33:08.562117+0000","last_undegraded":"2024-04-26T18:33:08.562117+0000","last_fullsized":"2024-04-26T18:33:08.562117+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:43:07.915584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:45.941304+0000","last_change":"2024-04-26T18:33:03.860440+0000","last_active":"2024-04-26T18:33:45.941304+0000","last_peered":"2024-04-26T18:33:45.941304+0000","last_clean":"2024-04-26T18:33:45.941304+0000","last_became_active":"2024-04-26T18:33:03.860112+0000","last_became_peered":"2024-04-26T18:33:03.860112+0000","last_unstale":"2024-04-26T18:33:45.941304+0000","last_undegraded":"2024-04-26T18:33:45.941304+0000","last_fullsized":"2024-04-26T18:33:45.941304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:19:05.661597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561961+0000","last_change":"2024-04-26T18:33:06.561688+0000","last_active":"2024-04-26T18:33:08.561961+0000","last_peered":"2024-04-26T18:33:08.561961+0000","last_clean":"2024-04-26T18:33:08.561961+0000","last_became_active":"2024-04-26T18:33:06.561285+0000","last_became_peered":"2024-04-26T18:33:06.561285+0000","last_unstale":"2024-04-26T18:33:08.561961+0000","last_undegraded":"2024-04-26T18:33:08.561961+0000","last_fullsized":"2024-04-26T18:33:08.561961+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:13.272896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:23.912865+0000","last_change":"2024-04-26T18:33:03.531237+0000","last_active":"2024-04-26T18:33:23.912865+0000","last_peered":"2024-04-26T18:33:23.912865+0000","last_clean":"2024-04-26T18:33:23.912865+0000","last_became_active":"2024-04-26T18:33:03.530843+0000","last_became_peered":"2024-04-26T18:33:03.530843+0000","last_unstale":"2024-04-26T18:33:23.912865+0000","last_undegraded":"2024-04-26T18:33:23.912865+0000","last_fullsized":"2024-04-26T18:33:23.912865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:24.454752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":354,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561560+0000","last_change":"2024-04-26T18:31:39.402840+0000","last_active":"2024-04-26T18:33:08.561560+0000","last_peered":"2024-04-26T18:33:08.561560+0000","last_clean":"2024-04-26T18:33:08.561560+0000","last_became_active":"2024-04-26T18:31:39.402341+0000","last_became_peered":"2024-04-26T18:31:39.402341+0000","last_unstale":"2024-04-26T18:33:08.561560+0000","last_undegraded":"2024-04-26T18:33:08.561560+0000","last_fullsized":"2024-04-26T18:33:08.561560+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:28:14.522548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:28:14.522548+0000","last_clean_scrub_stamp":"2024-04-26T18:28:14.522548+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:32.052085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561528+0000","last_change":"2024-04-26T18:33:06.557695+0000","last_active":"2024-04-26T18:33:08.561528+0000","last_peered":"2024-04-26T18:33:08.561528+0000","last_clean":"2024-04-26T18:33:08.561528+0000","last_became_active":"2024-04-26T18:33:06.557369+0000","last_became_peered":"2024-04-26T18:33:06.557369+0000","last_unstale":"2024-04-26T18:33:08.561528+0000","last_undegraded":"2024-04-26T18:33:08.561528+0000","last_fullsized":"2024-04-26T18:33:08.561528+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:35.666232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:21.656675+0000","last_change":"2024-04-26T18:33:03.527897+0000","last_active":"2024-04-26T18:33:21.656675+0000","last_peered":"2024-04-26T18:33:21.656675+0000","last_clean":"2024-04-26T18:33:21.656675+0000","last_became_active":"2024-04-26T18:33:03.527345+0000","last_became_peered":"2024-04-26T18:33:03.527345+0000","last_unstale":"2024-04-26T18:33:21.656675+0000","last_undegraded":"2024-04-26T18:33:21.656675+0000","last_fullsized":"2024-04-26T18:33:21.656675+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:31.144555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:23.674511+0000","last_change":"2024-04-26T18:33:03.860572+0000","last_active":"2024-04-26T18:33:23.674511+0000","last_peered":"2024-04-26T18:33:23.674511+0000","last_clean":"2024-04-26T18:33:23.674511+0000","last_became_active":"2024-04-26T18:33:03.860188+0000","last_became_peered":"2024-04-26T18:33:03.860188+0000","last_unstale":"2024-04-26T18:33:23.674511+0000","last_undegraded":"2024-04-26T18:33:23.674511+0000","last_fullsized":"2024-04-26T18:33:23.674511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:24:34.811572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561002+0000","last_change":"2024-04-26T18:33:06.558075+0000","last_active":"2024-04-26T18:33:08.561002+0000","last_peered":"2024-04-26T18:33:08.561002+0000","last_clean":"2024-04-26T18:33:08.561002+0000","last_became_active":"2024-04-26T18:33:06.557293+0000","last_became_peered":"2024-04-26T18:33:06.557293+0000","last_unstale":"2024-04-26T18:33:08.561002+0000","last_undegraded":"2024-04-26T18:33:08.561002+0000","last_fullsized":"2024-04-26T18:33:08.561002+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:12.635253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"89'16","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:44.563390+0000","last_change":"2024-04-26T18:33:03.528196+0000","last_active":"2024-04-26T18:33:44.563390+0000","last_peered":"2024-04-26T18:33:44.563390+0000","last_clean":"2024-04-26T18:33:44.563390+0000","last_became_active":"2024-04-26T18:33:03.527846+0000","last_became_peered":"2024-04-26T18:33:03.527846+0000","last_unstale":"2024-04-26T18:33:44.563390+0000","last_undegraded":"2024-04-26T18:33:44.563390+0000","last_fullsized":"2024-04-26T18:33:44.563390+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:13:46.073405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.562401+0000","last_change":"2024-04-26T18:33:06.550260+0000","last_active":"2024-04-26T18:33:08.562401+0000","last_peered":"2024-04-26T18:33:08.562401+0000","last_clean":"2024-04-26T18:33:08.562401+0000","last_became_active":"2024-04-26T18:33:06.549925+0000","last_became_peered":"2024-04-26T18:33:06.549925+0000","last_unstale":"2024-04-26T18:33:08.562401+0000","last_undegraded":"2024-04-26T18:33:08.562401+0000","last_fullsized":"2024-04-26T18:33:08.562401+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:17:01.777381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:23.673002+0000","last_change":"2024-04-26T18:33:03.876609+0000","last_active":"2024-04-26T18:33:23.673002+0000","last_peered":"2024-04-26T18:33:23.673002+0000","last_clean":"2024-04-26T18:33:23.673002+0000","last_became_active":"2024-04-26T18:33:03.876284+0000","last_became_peered":"2024-04-26T18:33:03.876284+0000","last_unstale":"2024-04-26T18:33:23.673002+0000","last_undegraded":"2024-04-26T18:33:23.673002+0000","last_fullsized":"2024-04-26T18:33:23.673002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:22.995000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.564041+0000","last_change":"2024-04-26T18:33:06.558735+0000","last_active":"2024-04-26T18:33:08.564041+0000","last_peered":"2024-04-26T18:33:08.564041+0000","last_clean":"2024-04-26T18:33:08.564041+0000","last_became_active":"2024-04-26T18:33:06.558416+0000","last_became_peered":"2024-04-26T18:33:06.558416+0000","last_unstale":"2024-04-26T18:33:08.564041+0000","last_undegraded":"2024-04-26T18:33:08.564041+0000","last_fullsized":"2024-04-26T18:33:08.564041+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:27.627055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:20.652577+0000","last_change":"2024-04-26T18:33:03.861073+0000","last_active":"2024-04-26T18:33:20.652577+0000","last_peered":"2024-04-26T18:33:20.652577+0000","last_clean":"2024-04-26T18:33:20.652577+0000","last_became_active":"2024-04-26T18:33:03.860661+0000","last_became_peered":"2024-04-26T18:33:03.860661+0000","last_unstale":"2024-04-26T18:33:20.652577+0000","last_undegraded":"2024-04-26T18:33:20.652577+0000","last_fullsized":"2024-04-26T18:33:20.652577+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:19.429969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.548480+0000","last_change":"2024-04-26T18:33:06.553160+0000","last_active":"2024-04-26T18:33:08.548480+0000","last_peered":"2024-04-26T18:33:08.548480+0000","last_clean":"2024-04-26T18:33:08.548480+0000","last_became_active":"2024-04-26T18:33:06.552791+0000","last_became_peered":"2024-04-26T18:33:06.552791+0000","last_unstale":"2024-04-26T18:33:08.548480+0000","last_undegraded":"2024-04-26T18:33:08.548480+0000","last_fullsized":"2024-04-26T18:33:08.548480+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:31.675069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:23.672066+0000","last_change":"2024-04-26T18:33:03.524443+0000","last_active":"2024-04-26T18:33:23.672066+0000","last_peered":"2024-04-26T18:33:23.672066+0000","last_clean":"2024-04-26T18:33:23.672066+0000","last_became_active":"2024-04-26T18:33:03.524137+0000","last_became_peered":"2024-04-26T18:33:03.524137+0000","last_unstale":"2024-04-26T18:33:23.672066+0000","last_undegraded":"2024-04-26T18:33:23.672066+0000","last_fullsized":"2024-04-26T18:33:23.672066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:43.021778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.567125+0000","last_change":"2024-04-26T18:33:06.553698+0000","last_active":"2024-04-26T18:33:08.567125+0000","last_peered":"2024-04-26T18:33:08.567125+0000","last_clean":"2024-04-26T18:33:08.567125+0000","last_became_active":"2024-04-26T18:33:06.552995+0000","last_became_peered":"2024-04-26T18:33:06.552995+0000","last_unstale":"2024-04-26T18:33:08.567125+0000","last_undegraded":"2024-04-26T18:33:08.567125+0000","last_fullsized":"2024-04-26T18:33:08.567125+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:27.135435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:22.663653+0000","last_change":"2024-04-26T18:33:03.528134+0000","last_active":"2024-04-26T18:33:22.663653+0000","last_peered":"2024-04-26T18:33:22.663653+0000","last_clean":"2024-04-26T18:33:22.663653+0000","last_became_active":"2024-04-26T18:33:03.527839+0000","last_became_peered":"2024-04-26T18:33:03.527839+0000","last_unstale":"2024-04-26T18:33:22.663653+0000","last_undegraded":"2024-04-26T18:33:22.663653+0000","last_fullsized":"2024-04-26T18:33:22.663653+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:52.658208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.562082+0000","last_change":"2024-04-26T18:33:06.553596+0000","last_active":"2024-04-26T18:33:08.562082+0000","last_peered":"2024-04-26T18:33:08.562082+0000","last_clean":"2024-04-26T18:33:08.562082+0000","last_became_active":"2024-04-26T18:33:06.553284+0000","last_became_peered":"2024-04-26T18:33:06.553284+0000","last_unstale":"2024-04-26T18:33:08.562082+0000","last_undegraded":"2024-04-26T18:33:08.562082+0000","last_fullsized":"2024-04-26T18:33:08.562082+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.245437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:20.652999+0000","last_change":"2024-04-26T18:33:03.533191+0000","last_active":"2024-04-26T18:33:20.652999+0000","last_peered":"2024-04-26T18:33:20.652999+0000","last_clean":"2024-04-26T18:33:20.652999+0000","last_became_active":"2024-04-26T18:33:03.532904+0000","last_became_peered":"2024-04-26T18:33:03.532904+0000","last_unstale":"2024-04-26T18:33:20.652999+0000","last_undegraded":"2024-04-26T18:33:20.652999+0000","last_fullsized":"2024-04-26T18:33:20.652999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:47.916518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.562016+0000","last_change":"2024-04-26T18:33:06.566899+0000","last_active":"2024-04-26T18:33:08.562016+0000","last_peered":"2024-04-26T18:33:08.562016+0000","last_clean":"2024-04-26T18:33:08.562016+0000","last_became_active":"2024-04-26T18:33:06.566548+0000","last_became_peered":"2024-04-26T18:33:06.566548+0000","last_unstale":"2024-04-26T18:33:08.562016+0000","last_undegraded":"2024-04-26T18:33:08.562016+0000","last_fullsized":"2024-04-26T18:33:08.562016+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:07.751063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'5","reported_seq":53,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:46.943554+0000","last_change":"2024-04-26T18:33:03.876589+0000","last_active":"2024-04-26T18:33:46.943554+0000","last_peered":"2024-04-26T18:33:46.943554+0000","last_clean":"2024-04-26T18:33:46.943554+0000","last_became_active":"2024-04-26T18:33:03.876262+0000","last_became_peered":"2024-04-26T18:33:03.876262+0000","last_unstale":"2024-04-26T18:33:46.943554+0000","last_undegraded":"2024-04-26T18:33:46.943554+0000","last_fullsized":"2024-04-26T18:33:46.943554+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:04.959745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.562323+0000","last_change":"2024-04-26T18:33:06.561848+0000","last_active":"2024-04-26T18:33:08.562323+0000","last_peered":"2024-04-26T18:33:08.562323+0000","last_clean":"2024-04-26T18:33:08.562323+0000","last_became_active":"2024-04-26T18:33:06.561514+0000","last_became_peered":"2024-04-26T18:33:06.561514+0000","last_unstale":"2024-04-26T18:33:08.562323+0000","last_undegraded":"2024-04-26T18:33:08.562323+0000","last_fullsized":"2024-04-26T18:33:08.562323+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:46.326261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:23.673230+0000","last_change":"2024-04-26T18:33:03.527237+0000","last_active":"2024-04-26T18:33:23.673230+0000","last_peered":"2024-04-26T18:33:23.673230+0000","last_clean":"2024-04-26T18:33:23.673230+0000","last_became_active":"2024-04-26T18:33:03.526618+0000","last_became_peered":"2024-04-26T18:33:03.526618+0000","last_unstale":"2024-04-26T18:33:23.673230+0000","last_undegraded":"2024-04-26T18:33:23.673230+0000","last_fullsized":"2024-04-26T18:33:23.673230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:28.232597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"89'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561741+0000","last_change":"2024-04-26T18:33:06.555276+0000","last_active":"2024-04-26T18:33:08.561741+0000","last_peered":"2024-04-26T18:33:08.561741+0000","last_clean":"2024-04-26T18:33:08.561741+0000","last_became_active":"2024-04-26T18:33:06.554889+0000","last_became_peered":"2024-04-26T18:33:06.554889+0000","last_unstale":"2024-04-26T18:33:08.561741+0000","last_undegraded":"2024-04-26T18:33:08.561741+0000","last_fullsized":"2024-04-26T18:33:08.561741+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:33:13.614662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:23.672736+0000","last_change":"2024-04-26T18:33:03.527108+0000","last_active":"2024-04-26T18:33:23.672736+0000","last_peered":"2024-04-26T18:33:23.672736+0000","last_clean":"2024-04-26T18:33:23.672736+0000","last_became_active":"2024-04-26T18:33:03.526648+0000","last_became_peered":"2024-04-26T18:33:03.526648+0000","last_unstale":"2024-04-26T18:33:23.672736+0000","last_undegraded":"2024-04-26T18:33:23.672736+0000","last_fullsized":"2024-04-26T18:33:23.672736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:40.915022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.563000+0000","last_change":"2024-04-26T18:33:06.551605+0000","last_active":"2024-04-26T18:33:08.563000+0000","last_peered":"2024-04-26T18:33:08.563000+0000","last_clean":"2024-04-26T18:33:08.563000+0000","last_became_active":"2024-04-26T18:33:06.550772+0000","last_became_peered":"2024-04-26T18:33:06.550772+0000","last_unstale":"2024-04-26T18:33:08.563000+0000","last_undegraded":"2024-04-26T18:33:08.563000+0000","last_fullsized":"2024-04-26T18:33:08.563000+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:33.124989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.567274+0000","last_change":"2024-04-26T18:33:06.558971+0000","last_active":"2024-04-26T18:33:08.567274+0000","last_peered":"2024-04-26T18:33:08.567274+0000","last_clean":"2024-04-26T18:33:08.567274+0000","last_became_active":"2024-04-26T18:33:06.558594+0000","last_became_peered":"2024-04-26T18:33:06.558594+0000","last_unstale":"2024-04-26T18:33:08.567274+0000","last_undegraded":"2024-04-26T18:33:08.567274+0000","last_fullsized":"2024-04-26T18:33:08.567274+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:12.974472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.549996+0000","last_change":"2024-04-26T18:33:06.558928+0000","last_active":"2024-04-26T18:33:08.549996+0000","last_peered":"2024-04-26T18:33:08.549996+0000","last_clean":"2024-04-26T18:33:08.549996+0000","last_became_active":"2024-04-26T18:33:06.558348+0000","last_became_peered":"2024-04-26T18:33:06.558348+0000","last_unstale":"2024-04-26T18:33:08.549996+0000","last_undegraded":"2024-04-26T18:33:08.549996+0000","last_fullsized":"2024-04-26T18:33:08.549996+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:04.266404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.550115+0000","last_change":"2024-04-26T18:33:06.555182+0000","last_active":"2024-04-26T18:33:08.550115+0000","last_peered":"2024-04-26T18:33:08.550115+0000","last_clean":"2024-04-26T18:33:08.550115+0000","last_became_active":"2024-04-26T18:33:06.554830+0000","last_became_peered":"2024-04-26T18:33:06.554830+0000","last_unstale":"2024-04-26T18:33:08.550115+0000","last_undegraded":"2024-04-26T18:33:08.550115+0000","last_fullsized":"2024-04-26T18:33:08.550115+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:48.841634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.563792+0000","last_change":"2024-04-26T18:33:06.558962+0000","last_active":"2024-04-26T18:33:08.563792+0000","last_peered":"2024-04-26T18:33:08.563792+0000","last_clean":"2024-04-26T18:33:08.563792+0000","last_became_active":"2024-04-26T18:33:06.557995+0000","last_became_peered":"2024-04-26T18:33:06.557995+0000","last_unstale":"2024-04-26T18:33:08.563792+0000","last_undegraded":"2024-04-26T18:33:08.563792+0000","last_fullsized":"2024-04-26T18:33:08.563792+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:54.207205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.563283+0000","last_change":"2024-04-26T18:33:06.558055+0000","last_active":"2024-04-26T18:33:08.563283+0000","last_peered":"2024-04-26T18:33:08.563283+0000","last_clean":"2024-04-26T18:33:08.563283+0000","last_became_active":"2024-04-26T18:33:06.557299+0000","last_became_peered":"2024-04-26T18:33:06.557299+0000","last_unstale":"2024-04-26T18:33:08.563283+0000","last_undegraded":"2024-04-26T18:33:08.563283+0000","last_fullsized":"2024-04-26T18:33:08.563283+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:21.143017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.566892+0000","last_change":"2024-04-26T18:33:06.558680+0000","last_active":"2024-04-26T18:33:08.566892+0000","last_peered":"2024-04-26T18:33:08.566892+0000","last_clean":"2024-04-26T18:33:08.566892+0000","last_became_active":"2024-04-26T18:33:06.558139+0000","last_became_peered":"2024-04-26T18:33:06.558139+0000","last_unstale":"2024-04-26T18:33:08.566892+0000","last_undegraded":"2024-04-26T18:33:08.566892+0000","last_fullsized":"2024-04-26T18:33:08.566892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:31.511770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.550836+0000","last_change":"2024-04-26T18:33:06.563832+0000","last_active":"2024-04-26T18:33:08.550836+0000","last_peered":"2024-04-26T18:33:08.550836+0000","last_clean":"2024-04-26T18:33:08.550836+0000","last_became_active":"2024-04-26T18:33:06.562193+0000","last_became_peered":"2024-04-26T18:33:06.562193+0000","last_unstale":"2024-04-26T18:33:08.550836+0000","last_undegraded":"2024-04-26T18:33:08.550836+0000","last_fullsized":"2024-04-26T18:33:08.550836+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:35.384552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561962+0000","last_change":"2024-04-26T18:33:06.562368+0000","last_active":"2024-04-26T18:33:08.561962+0000","last_peered":"2024-04-26T18:33:08.561962+0000","last_clean":"2024-04-26T18:33:08.561962+0000","last_became_active":"2024-04-26T18:33:06.562024+0000","last_became_peered":"2024-04-26T18:33:06.562024+0000","last_unstale":"2024-04-26T18:33:08.561962+0000","last_undegraded":"2024-04-26T18:33:08.561962+0000","last_fullsized":"2024-04-26T18:33:08.561962+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:01.562885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561776+0000","last_change":"2024-04-26T18:33:06.560953+0000","last_active":"2024-04-26T18:33:08.561776+0000","last_peered":"2024-04-26T18:33:08.561776+0000","last_clean":"2024-04-26T18:33:08.561776+0000","last_became_active":"2024-04-26T18:33:06.560593+0000","last_became_peered":"2024-04-26T18:33:06.560593+0000","last_unstale":"2024-04-26T18:33:08.561776+0000","last_undegraded":"2024-04-26T18:33:08.561776+0000","last_fullsized":"2024-04-26T18:33:08.561776+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:18.168564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.562194+0000","last_change":"2024-04-26T18:33:06.555389+0000","last_active":"2024-04-26T18:33:08.562194+0000","last_peered":"2024-04-26T18:33:08.562194+0000","last_clean":"2024-04-26T18:33:08.562194+0000","last_became_active":"2024-04-26T18:33:06.555055+0000","last_became_peered":"2024-04-26T18:33:06.555055+0000","last_unstale":"2024-04-26T18:33:08.562194+0000","last_undegraded":"2024-04-26T18:33:08.562194+0000","last_fullsized":"2024-04-26T18:33:08.562194+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:32.802687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.551949+0000","last_change":"2024-04-26T18:33:06.563791+0000","last_active":"2024-04-26T18:33:08.551949+0000","last_peered":"2024-04-26T18:33:08.551949+0000","last_clean":"2024-04-26T18:33:08.551949+0000","last_became_active":"2024-04-26T18:33:06.561959+0000","last_became_peered":"2024-04-26T18:33:06.561959+0000","last_unstale":"2024-04-26T18:33:08.551949+0000","last_undegraded":"2024-04-26T18:33:08.551949+0000","last_fullsized":"2024-04-26T18:33:08.551949+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:35.280202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561898+0000","last_change":"2024-04-26T18:33:06.554270+0000","last_active":"2024-04-26T18:33:08.561898+0000","last_peered":"2024-04-26T18:33:08.561898+0000","last_clean":"2024-04-26T18:33:08.561898+0000","last_became_active":"2024-04-26T18:33:06.553931+0000","last_became_peered":"2024-04-26T18:33:06.553931+0000","last_unstale":"2024-04-26T18:33:08.561898+0000","last_undegraded":"2024-04-26T18:33:08.561898+0000","last_fullsized":"2024-04-26T18:33:08.561898+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:40.587824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.566485+0000","last_change":"2024-04-26T18:33:06.556766+0000","last_active":"2024-04-26T18:33:08.566485+0000","last_peered":"2024-04-26T18:33:08.566485+0000","last_clean":"2024-04-26T18:33:08.566485+0000","last_became_active":"2024-04-26T18:33:06.556361+0000","last_became_peered":"2024-04-26T18:33:06.556361+0000","last_unstale":"2024-04-26T18:33:08.566485+0000","last_undegraded":"2024-04-26T18:33:08.566485+0000","last_fullsized":"2024-04-26T18:33:08.566485+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:10.101747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":245619,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61256,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":276,"num_read_kb":205,"num_write":241,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":186044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351000,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":466448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612637,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32272,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712880,"statfs":{"total":95995035648,"available":95961989120,"internally_reserved":0,"allocated":1122304,"data_stored":1111920,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776163,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":995328,"data_stored":466378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037799,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":466756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299437,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1044480,"data_stored":1059274,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462962,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":978944,"data_stored":466095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1036288,"data_stored":522589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":467434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":523200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149761,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":995328,"data_stored":465920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888124,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":465956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724597,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":1058952,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33912,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33912,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":57333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":57944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":56179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T18:33:51.527 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T18:33:51.783 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:33:51.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:51 smithi080 ceph-mon[29135]: pgmap v319: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-04-26T18:33:51.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-04-26T18:33:51.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2024-04-26T18:33:51.814 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-04-26T18:33:51.815 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-04-26T18:33:51.815 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-04-26T18:33:51.815 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-04-26T18:33:51.815 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:51 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-04-26T18:33:51.815 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:51 smithi080 ceph-mon[29135]: osdmap e90: 12 total, 12 up, 12 in 2024-04-26T18:33:51.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:51 smithi082 ceph-mon[32808]: pgmap v319: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-04-26T18:33:51.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:51 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-04-26T18:33:51.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:51 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2024-04-26T18:33:51.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:51 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-04-26T18:33:51.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:51 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-04-26T18:33:51.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:51 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-04-26T18:33:51.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:51 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-04-26T18:33:51.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:51 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-04-26T18:33:51.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:51 smithi082 ceph-mon[32808]: osdmap e90: 12 total, 12 up, 12 in 2024-04-26T18:33:52.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:51 smithi192 ceph-mon[32842]: pgmap v319: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-04-26T18:33:52.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:51 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-04-26T18:33:52.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:51 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2024-04-26T18:33:52.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:51 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-04-26T18:33:52.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:51 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-04-26T18:33:52.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:51 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-04-26T18:33:52.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:51 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-04-26T18:33:52.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:51 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-04-26T18:33:52.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:51 smithi192 ceph-mon[32842]: osdmap e90: 12 total, 12 up, 12 in 2024-04-26T18:33:52.946 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:52 smithi080 ceph-mon[29135]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T18:33:52.946 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:52 smithi080 ceph-mon[29135]: osdmap e91: 12 total, 12 up, 12 in 2024-04-26T18:33:52.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:52 smithi082 ceph-mon[32808]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T18:33:52.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:52 smithi082 ceph-mon[32808]: osdmap e91: 12 total, 12 up, 12 in 2024-04-26T18:33:53.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:52 smithi192 ceph-mon[32842]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T18:33:53.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:52 smithi192 ceph-mon[32842]: osdmap e91: 12 total, 12 up, 12 in 2024-04-26T18:33:53.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.473+0000 7f55152b6700 1 -- 172.21.15.80:0/626644881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55101084e0 msgr2=0x7f55101088c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:53.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.473+0000 7f55152b6700 1 --2- 172.21.15.80:0/626644881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55101084e0 0x7f55101088c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5500009990 tx=0x7f5500009ca0 comp rx=0 tx=0).stop 2024-04-26T18:33:53.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.473+0000 7f55152b6700 1 -- 172.21.15.80:0/626644881 shutdown_connections 2024-04-26T18:33:53.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.473+0000 7f55152b6700 1 --2- 172.21.15.80:0/626644881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5510102780 0x7f55101101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:53.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.474+0000 7f55152b6700 1 --2- 172.21.15.80:0/626644881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55101084e0 0x7f55101088c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:53.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.474+0000 7f55152b6700 1 --2- 172.21.15.80:0/626644881 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5510101dc0 0x7f5510102240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:53.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.474+0000 7f55152b6700 1 -- 172.21.15.80:0/626644881 >> 172.21.15.80:0/626644881 conn(0x7f5510077640 msgr2=0x7f5510077a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:53.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.474+0000 7f55152b6700 1 -- 172.21.15.80:0/626644881 shutdown_connections 2024-04-26T18:33:53.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.474+0000 7f55152b6700 1 -- 172.21.15.80:0/626644881 wait complete. 2024-04-26T18:33:53.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.474+0000 7f55152b6700 1 Processor -- start 2024-04-26T18:33:53.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.474+0000 7f55152b6700 1 -- start start 2024-04-26T18:33:53.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.475+0000 7f55152b6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5510101dc0 0x7f551019f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:53.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.475+0000 7f55152b6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5510102780 0x7f551019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:53.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.475+0000 7f55152b6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55101084e0 0x7f5510199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:53.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.475+0000 7f55152b6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f55101135f0 con 0x7f5510102780 2024-04-26T18:33:53.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.475+0000 7f55152b6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5510113470 con 0x7f5510101dc0 2024-04-26T18:33:53.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.475+0000 7f55152b6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5510113770 con 0x7f55101084e0 2024-04-26T18:33:53.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.475+0000 7f550e7fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5510102780 0x7f551019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:53.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.475+0000 7f550e7fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5510102780 0x7f551019fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60384/0 (socket says 172.21.15.80:60384) 2024-04-26T18:33:53.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.475+0000 7f550e7fc700 1 -- 172.21.15.80:0/631236495 learned_addr learned my addr 172.21.15.80:0/631236495 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:33:53.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.475+0000 7f550f7fe700 1 --2- 172.21.15.80:0/631236495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55101084e0 0x7f5510199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:53.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.475+0000 7f550effd700 1 --2- 172.21.15.80:0/631236495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5510101dc0 0x7f551019f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:53.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.475+0000 7f550e7fc700 1 -- 172.21.15.80:0/631236495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55101084e0 msgr2=0x7f5510199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:53.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.475+0000 7f550e7fc700 1 --2- 172.21.15.80:0/631236495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55101084e0 0x7f5510199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:53.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.475+0000 7f550e7fc700 1 -- 172.21.15.80:0/631236495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5510101dc0 msgr2=0x7f551019f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:53.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.475+0000 7f550e7fc700 1 --2- 172.21.15.80:0/631236495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5510101dc0 0x7f551019f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:53.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.475+0000 7f550e7fc700 1 -- 172.21.15.80:0/631236495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f551019a0b0 con 0x7f5510102780 2024-04-26T18:33:53.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.475+0000 7f550effd700 1 --2- 172.21.15.80:0/631236495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5510101dc0 0x7f551019f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:33:53.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.475+0000 7f550f7fe700 1 --2- 172.21.15.80:0/631236495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55101084e0 0x7f5510199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:33:53.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.475+0000 7f550e7fc700 1 --2- 172.21.15.80:0/631236495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5510102780 0x7f551019fcd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f550400d980 tx=0x7f550400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:53.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.475+0000 7f54f7fff700 1 -- 172.21.15.80:0/631236495 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5504017070 con 0x7f5510102780 2024-04-26T18:33:53.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.475+0000 7f55152b6700 1 -- 172.21.15.80:0/631236495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f551019a3a0 con 0x7f5510102780 2024-04-26T18:33:53.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.475+0000 7f54f7fff700 1 -- 172.21.15.80:0/631236495 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5504004830 con 0x7f5510102780 2024-04-26T18:33:53.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.475+0000 7f54f7fff700 1 -- 172.21.15.80:0/631236495 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5504005440 con 0x7f5510102780 2024-04-26T18:33:53.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.475+0000 7f55152b6700 1 -- 172.21.15.80:0/631236495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55101a6660 con 0x7f5510102780 2024-04-26T18:33:53.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.476+0000 7f55152b6700 1 -- 172.21.15.80:0/631236495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f551006a110 con 0x7f5510102780 2024-04-26T18:33:53.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.477+0000 7f54f7fff700 1 -- 172.21.15.80:0/631236495 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f55040055e0 con 0x7f5510102780 2024-04-26T18:33:53.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.478+0000 7f54f7fff700 1 --2- 172.21.15.80:0/631236495 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f54f80a3cd0 0x7f54f80a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:53.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.478+0000 7f550effd700 1 --2- 172.21.15.80:0/631236495 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f54f80a3cd0 0x7f54f80a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:53.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.478+0000 7f54f7fff700 1 -- 172.21.15.80:0/631236495 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f55040d0480 con 0x7f5510102780 2024-04-26T18:33:53.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.478+0000 7f550effd700 1 --2- 172.21.15.80:0/631236495 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f54f80a3cd0 0x7f54f80a6190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5500000c00 tx=0x7f5500005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:53.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.482+0000 7f54f7fff700 1 -- 172.21.15.80:0/631236495 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5504020020 con 0x7f5510102780 2024-04-26T18:33:53.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.682+0000 7f55152b6700 1 -- 172.21.15.80:0/631236495 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5510063860 con 0x7f54f80a3cd0 2024-04-26T18:33:53.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.689+0000 7f54f7fff700 1 -- 172.21.15.80:0/631236495 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258896 (secure 0 0 0) 0x7f5500065360 con 0x7f54f80a3cd0 2024-04-26T18:33:53.692 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:33:53.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.692+0000 7f55152b6700 1 -- 172.21.15.80:0/631236495 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f54f80a3cd0 msgr2=0x7f54f80a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:53.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.692+0000 7f55152b6700 1 --2- 172.21.15.80:0/631236495 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f54f80a3cd0 0x7f54f80a6190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5500000c00 tx=0x7f5500005fb0 comp rx=0 tx=0).stop 2024-04-26T18:33:53.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.692+0000 7f55152b6700 1 -- 172.21.15.80:0/631236495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5510102780 msgr2=0x7f551019fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:53.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.692+0000 7f55152b6700 1 --2- 172.21.15.80:0/631236495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5510102780 0x7f551019fcd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f550400d980 tx=0x7f550400dd40 comp rx=0 tx=0).stop 2024-04-26T18:33:53.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.692+0000 7f55152b6700 1 -- 172.21.15.80:0/631236495 shutdown_connections 2024-04-26T18:33:53.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.692+0000 7f55152b6700 1 --2- 172.21.15.80:0/631236495 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f54f80a3cd0 0x7f54f80a6190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:53.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.692+0000 7f55152b6700 1 --2- 172.21.15.80:0/631236495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55101084e0 0x7f5510199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:53.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.692+0000 7f55152b6700 1 --2- 172.21.15.80:0/631236495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5510101dc0 0x7f551019f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:53.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.692+0000 7f55152b6700 1 --2- 172.21.15.80:0/631236495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5510102780 0x7f551019fcd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:53.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.692+0000 7f55152b6700 1 -- 172.21.15.80:0/631236495 >> 172.21.15.80:0/631236495 conn(0x7f5510077640 msgr2=0x7f55101009d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:53.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.692+0000 7f55152b6700 1 -- 172.21.15.80:0/631236495 shutdown_connections 2024-04-26T18:33:53.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:53.692+0000 7f55152b6700 1 -- 172.21.15.80:0/631236495 wait complete. 2024-04-26T18:33:53.695 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-26T18:33:53.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:53 smithi082 ceph-mon[32808]: pgmap v322: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-04-26T18:33:53.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:53 smithi080 ceph-mon[29135]: pgmap v322: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-04-26T18:33:54.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:53 smithi192 ceph-mon[32842]: pgmap v322: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-04-26T18:33:54.427 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2024-04-26T18:33:52.505410+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652996,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":443,"num_read_kb":341,"num_write":426,"num_write_kb":3068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":347,"ondisk_log_size":347,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365292,"kb_used_data":11972,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576532,"statfs":{"total":1151940427776,"available":1151566368768,"internally_reserved":0,"allocated":12259328,"data_stored":7559731,"data_compressed":106677,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13380,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":59,"num_write":13,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002172"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.566844+0000","last_change":"2024-04-26T18:33:06.565673+0000","last_active":"2024-04-26T18:33:08.566844+0000","last_peered":"2024-04-26T18:33:08.566844+0000","last_clean":"2024-04-26T18:33:08.566844+0000","last_became_active":"2024-04-26T18:33:06.565065+0000","last_became_peered":"2024-04-26T18:33:06.565065+0000","last_unstale":"2024-04-26T18:33:08.566844+0000","last_undegraded":"2024-04-26T18:33:08.566844+0000","last_fullsized":"2024-04-26T18:33:08.566844+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:54:10.833343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T18:33:50.668521+0000","last_change":"2024-04-26T18:33:06.552350+0000","last_active":"2024-04-26T18:33:50.668521+0000","last_peered":"2024-04-26T18:33:50.668521+0000","last_clean":"2024-04-26T18:33:50.668521+0000","last_became_active":"2024-04-26T18:33:06.551941+0000","last_became_peered":"2024-04-26T18:33:06.551941+0000","last_unstale":"2024-04-26T18:33:50.668521+0000","last_undegraded":"2024-04-26T18:33:50.668521+0000","last_fullsized":"2024-04-26T18:33:50.668521+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:40.702995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T18:33:50.668445+0000","last_change":"2024-04-26T18:33:06.561456+0000","last_active":"2024-04-26T18:33:50.668445+0000","last_peered":"2024-04-26T18:33:50.668445+0000","last_clean":"2024-04-26T18:33:50.668445+0000","last_became_active":"2024-04-26T18:33:06.561032+0000","last_became_peered":"2024-04-26T18:33:06.561032+0000","last_unstale":"2024-04-26T18:33:50.668445+0000","last_undegraded":"2024-04-26T18:33:50.668445+0000","last_fullsized":"2024-04-26T18:33:50.668445+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:56:56.228873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.652175+0000","last_change":"2024-04-26T18:33:06.556597+0000","last_active":"2024-04-26T18:33:51.652175+0000","last_peered":"2024-04-26T18:33:51.652175+0000","last_clean":"2024-04-26T18:33:51.652175+0000","last_became_active":"2024-04-26T18:33:06.555356+0000","last_became_peered":"2024-04-26T18:33:06.555356+0000","last_unstale":"2024-04-26T18:33:51.652175+0000","last_undegraded":"2024-04-26T18:33:51.652175+0000","last_fullsized":"2024-04-26T18:33:51.652175+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:55.860495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.548726+0000","last_change":"2024-04-26T18:33:06.549480+0000","last_active":"2024-04-26T18:33:08.548726+0000","last_peered":"2024-04-26T18:33:08.548726+0000","last_clean":"2024-04-26T18:33:08.548726+0000","last_became_active":"2024-04-26T18:33:06.549086+0000","last_became_peered":"2024-04-26T18:33:06.549086+0000","last_unstale":"2024-04-26T18:33:08.548726+0000","last_undegraded":"2024-04-26T18:33:08.548726+0000","last_fullsized":"2024-04-26T18:33:08.548726+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:13.012745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T18:33:50.645831+0000","last_change":"2024-04-26T18:33:06.558539+0000","last_active":"2024-04-26T18:33:50.645831+0000","last_peered":"2024-04-26T18:33:50.645831+0000","last_clean":"2024-04-26T18:33:50.645831+0000","last_became_active":"2024-04-26T18:33:06.558185+0000","last_became_peered":"2024-04-26T18:33:06.558185+0000","last_unstale":"2024-04-26T18:33:50.645831+0000","last_undegraded":"2024-04-26T18:33:50.645831+0000","last_fullsized":"2024-04-26T18:33:50.645831+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:59:31.299478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561753+0000","last_change":"2024-04-26T18:33:06.557336+0000","last_active":"2024-04-26T18:33:08.561753+0000","last_peered":"2024-04-26T18:33:08.561753+0000","last_clean":"2024-04-26T18:33:08.561753+0000","last_became_active":"2024-04-26T18:33:06.556988+0000","last_became_peered":"2024-04-26T18:33:06.556988+0000","last_unstale":"2024-04-26T18:33:08.561753+0000","last_undegraded":"2024-04-26T18:33:08.561753+0000","last_fullsized":"2024-04-26T18:33:08.561753+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:48.814042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561749+0000","last_change":"2024-04-26T18:33:06.556355+0000","last_active":"2024-04-26T18:33:08.561749+0000","last_peered":"2024-04-26T18:33:08.561749+0000","last_clean":"2024-04-26T18:33:08.561749+0000","last_became_active":"2024-04-26T18:33:06.555947+0000","last_became_peered":"2024-04-26T18:33:06.555947+0000","last_unstale":"2024-04-26T18:33:08.561749+0000","last_undegraded":"2024-04-26T18:33:08.561749+0000","last_fullsized":"2024-04-26T18:33:08.561749+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:36.607305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.552041+0000","last_change":"2024-04-26T18:33:06.569673+0000","last_active":"2024-04-26T18:33:08.552041+0000","last_peered":"2024-04-26T18:33:08.552041+0000","last_clean":"2024-04-26T18:33:08.552041+0000","last_became_active":"2024-04-26T18:33:06.568453+0000","last_became_peered":"2024-04-26T18:33:06.568453+0000","last_unstale":"2024-04-26T18:33:08.552041+0000","last_undegraded":"2024-04-26T18:33:08.552041+0000","last_fullsized":"2024-04-26T18:33:08.552041+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:38.428723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T18:33:50.646047+0000","last_change":"2024-04-26T18:33:06.564286+0000","last_active":"2024-04-26T18:33:50.646047+0000","last_peered":"2024-04-26T18:33:50.646047+0000","last_clean":"2024-04-26T18:33:50.646047+0000","last_became_active":"2024-04-26T18:33:06.563830+0000","last_became_peered":"2024-04-26T18:33:06.563830+0000","last_unstale":"2024-04-26T18:33:50.646047+0000","last_undegraded":"2024-04-26T18:33:50.646047+0000","last_fullsized":"2024-04-26T18:33:50.646047+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:36.518838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561778+0000","last_change":"2024-04-26T18:33:06.560724+0000","last_active":"2024-04-26T18:33:08.561778+0000","last_peered":"2024-04-26T18:33:08.561778+0000","last_clean":"2024-04-26T18:33:08.561778+0000","last_became_active":"2024-04-26T18:33:06.560393+0000","last_became_peered":"2024-04-26T18:33:06.560393+0000","last_unstale":"2024-04-26T18:33:08.561778+0000","last_undegraded":"2024-04-26T18:33:08.561778+0000","last_fullsized":"2024-04-26T18:33:08.561778+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:41.286466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.562212+0000","last_change":"2024-04-26T18:33:06.554476+0000","last_active":"2024-04-26T18:33:08.562212+0000","last_peered":"2024-04-26T18:33:08.562212+0000","last_clean":"2024-04-26T18:33:08.562212+0000","last_became_active":"2024-04-26T18:33:06.554087+0000","last_became_peered":"2024-04-26T18:33:06.554087+0000","last_unstale":"2024-04-26T18:33:08.562212+0000","last_undegraded":"2024-04-26T18:33:08.562212+0000","last_fullsized":"2024-04-26T18:33:08.562212+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:41.392991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.562060+0000","last_change":"2024-04-26T18:33:06.555813+0000","last_active":"2024-04-26T18:33:08.562060+0000","last_peered":"2024-04-26T18:33:08.562060+0000","last_clean":"2024-04-26T18:33:08.562060+0000","last_became_active":"2024-04-26T18:33:06.555498+0000","last_became_peered":"2024-04-26T18:33:06.555498+0000","last_unstale":"2024-04-26T18:33:08.562060+0000","last_undegraded":"2024-04-26T18:33:08.562060+0000","last_fullsized":"2024-04-26T18:33:08.562060+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:21.531142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T18:33:50.668325+0000","last_change":"2024-04-26T18:33:06.551833+0000","last_active":"2024-04-26T18:33:50.668325+0000","last_peered":"2024-04-26T18:33:50.668325+0000","last_clean":"2024-04-26T18:33:50.668325+0000","last_became_active":"2024-04-26T18:33:06.551503+0000","last_became_peered":"2024-04-26T18:33:06.551503+0000","last_unstale":"2024-04-26T18:33:50.668325+0000","last_undegraded":"2024-04-26T18:33:50.668325+0000","last_fullsized":"2024-04-26T18:33:50.668325+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:20.560656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T18:33:50.668220+0000","last_change":"2024-04-26T18:33:06.555971+0000","last_active":"2024-04-26T18:33:50.668220+0000","last_peered":"2024-04-26T18:33:50.668220+0000","last_clean":"2024-04-26T18:33:50.668220+0000","last_became_active":"2024-04-26T18:33:06.555312+0000","last_became_peered":"2024-04-26T18:33:06.555312+0000","last_unstale":"2024-04-26T18:33:50.668220+0000","last_undegraded":"2024-04-26T18:33:50.668220+0000","last_fullsized":"2024-04-26T18:33:50.668220+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:05.066403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.551546+0000","last_change":"2024-04-26T18:33:06.567762+0000","last_active":"2024-04-26T18:33:08.551546+0000","last_peered":"2024-04-26T18:33:08.551546+0000","last_clean":"2024-04-26T18:33:08.551546+0000","last_became_active":"2024-04-26T18:33:06.567368+0000","last_became_peered":"2024-04-26T18:33:06.567368+0000","last_unstale":"2024-04-26T18:33:08.551546+0000","last_undegraded":"2024-04-26T18:33:08.551546+0000","last_fullsized":"2024-04-26T18:33:08.551546+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:27.428529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.567136+0000","last_change":"2024-04-26T18:33:06.565334+0000","last_active":"2024-04-26T18:33:08.567136+0000","last_peered":"2024-04-26T18:33:08.567136+0000","last_clean":"2024-04-26T18:33:08.567136+0000","last_became_active":"2024-04-26T18:33:06.564997+0000","last_became_peered":"2024-04-26T18:33:06.564997+0000","last_unstale":"2024-04-26T18:33:08.567136+0000","last_undegraded":"2024-04-26T18:33:08.567136+0000","last_fullsized":"2024-04-26T18:33:08.567136+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:57.892318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.546257+0000","last_change":"2024-04-26T18:33:06.562242+0000","last_active":"2024-04-26T18:33:08.546257+0000","last_peered":"2024-04-26T18:33:08.546257+0000","last_clean":"2024-04-26T18:33:08.546257+0000","last_became_active":"2024-04-26T18:33:06.561863+0000","last_became_peered":"2024-04-26T18:33:06.561863+0000","last_unstale":"2024-04-26T18:33:08.546257+0000","last_undegraded":"2024-04-26T18:33:08.546257+0000","last_fullsized":"2024-04-26T18:33:08.546257+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:22.745294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.550639+0000","last_change":"2024-04-26T18:33:06.555511+0000","last_active":"2024-04-26T18:33:08.550639+0000","last_peered":"2024-04-26T18:33:08.550639+0000","last_clean":"2024-04-26T18:33:08.550639+0000","last_became_active":"2024-04-26T18:33:06.555201+0000","last_became_peered":"2024-04-26T18:33:06.555201+0000","last_unstale":"2024-04-26T18:33:08.550639+0000","last_undegraded":"2024-04-26T18:33:08.550639+0000","last_fullsized":"2024-04-26T18:33:08.550639+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:09.644167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":61,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:47.943564+0000","last_change":"2024-04-26T18:33:03.527583+0000","last_active":"2024-04-26T18:33:47.943564+0000","last_peered":"2024-04-26T18:33:47.943564+0000","last_clean":"2024-04-26T18:33:47.943564+0000","last_became_active":"2024-04-26T18:33:03.527239+0000","last_became_peered":"2024-04-26T18:33:03.527239+0000","last_unstale":"2024-04-26T18:33:47.943564+0000","last_undegraded":"2024-04-26T18:33:47.943564+0000","last_fullsized":"2024-04-26T18:33:47.943564+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:30:43.989217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561539+0000","last_change":"2024-04-26T18:33:06.560652+0000","last_active":"2024-04-26T18:33:08.561539+0000","last_peered":"2024-04-26T18:33:08.561539+0000","last_clean":"2024-04-26T18:33:08.561539+0000","last_became_active":"2024-04-26T18:33:06.560311+0000","last_became_peered":"2024-04-26T18:33:06.560311+0000","last_unstale":"2024-04-26T18:33:08.561539+0000","last_undegraded":"2024-04-26T18:33:08.561539+0000","last_fullsized":"2024-04-26T18:33:08.561539+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:22.653995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.566923+0000","last_change":"2024-04-26T18:33:03.860585+0000","last_active":"2024-04-26T18:33:08.566923+0000","last_peered":"2024-04-26T18:33:08.566923+0000","last_clean":"2024-04-26T18:33:08.566923+0000","last_became_active":"2024-04-26T18:33:03.860232+0000","last_became_peered":"2024-04-26T18:33:03.860232+0000","last_unstale":"2024-04-26T18:33:08.566923+0000","last_undegraded":"2024-04-26T18:33:08.566923+0000","last_fullsized":"2024-04-26T18:33:08.566923+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:04.685495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T18:33:50.668510+0000","last_change":"2024-04-26T18:33:06.563764+0000","last_active":"2024-04-26T18:33:50.668510+0000","last_peered":"2024-04-26T18:33:50.668510+0000","last_clean":"2024-04-26T18:33:50.668510+0000","last_became_active":"2024-04-26T18:33:06.563322+0000","last_became_peered":"2024-04-26T18:33:06.563322+0000","last_unstale":"2024-04-26T18:33:50.668510+0000","last_undegraded":"2024-04-26T18:33:50.668510+0000","last_fullsized":"2024-04-26T18:33:50.668510+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:17:53.144144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:23.913213+0000","last_change":"2024-04-26T18:33:03.533057+0000","last_active":"2024-04-26T18:33:23.913213+0000","last_peered":"2024-04-26T18:33:23.913213+0000","last_clean":"2024-04-26T18:33:23.913213+0000","last_became_active":"2024-04-26T18:33:03.532665+0000","last_became_peered":"2024-04-26T18:33:03.532665+0000","last_unstale":"2024-04-26T18:33:23.913213+0000","last_undegraded":"2024-04-26T18:33:23.913213+0000","last_fullsized":"2024-04-26T18:33:23.913213+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:29.125064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.551629+0000","last_change":"2024-04-26T18:33:06.567612+0000","last_active":"2024-04-26T18:33:08.551629+0000","last_peered":"2024-04-26T18:33:08.551629+0000","last_clean":"2024-04-26T18:33:08.551629+0000","last_became_active":"2024-04-26T18:33:06.565883+0000","last_became_peered":"2024-04-26T18:33:06.565883+0000","last_unstale":"2024-04-26T18:33:08.551629+0000","last_undegraded":"2024-04-26T18:33:08.551629+0000","last_fullsized":"2024-04-26T18:33:08.551629+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:59.721305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:23.674632+0000","last_change":"2024-04-26T18:33:03.532075+0000","last_active":"2024-04-26T18:33:23.674632+0000","last_peered":"2024-04-26T18:33:23.674632+0000","last_clean":"2024-04-26T18:33:23.674632+0000","last_became_active":"2024-04-26T18:33:03.531729+0000","last_became_peered":"2024-04-26T18:33:03.531729+0000","last_unstale":"2024-04-26T18:33:23.674632+0000","last_undegraded":"2024-04-26T18:33:23.674632+0000","last_fullsized":"2024-04-26T18:33:23.674632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:23.748292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T18:33:50.639707+0000","last_change":"2024-04-26T18:33:06.569377+0000","last_active":"2024-04-26T18:33:50.639707+0000","last_peered":"2024-04-26T18:33:50.639707+0000","last_clean":"2024-04-26T18:33:50.639707+0000","last_became_active":"2024-04-26T18:33:06.569057+0000","last_became_peered":"2024-04-26T18:33:06.569057+0000","last_unstale":"2024-04-26T18:33:50.639707+0000","last_undegraded":"2024-04-26T18:33:50.639707+0000","last_fullsized":"2024-04-26T18:33:50.639707+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:10.968017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T18:33:50.639317+0000","last_change":"2024-04-26T18:33:03.525186+0000","last_active":"2024-04-26T18:33:50.639317+0000","last_peered":"2024-04-26T18:33:50.639317+0000","last_clean":"2024-04-26T18:33:50.639317+0000","last_became_active":"2024-04-26T18:33:03.524880+0000","last_became_peered":"2024-04-26T18:33:03.524880+0000","last_unstale":"2024-04-26T18:33:50.639317+0000","last_undegraded":"2024-04-26T18:33:50.639317+0000","last_fullsized":"2024-04-26T18:33:50.639317+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:51:30.130244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.548852+0000","last_change":"2024-04-26T18:33:06.558034+0000","last_active":"2024-04-26T18:33:08.548852+0000","last_peered":"2024-04-26T18:33:08.548852+0000","last_clean":"2024-04-26T18:33:08.548852+0000","last_became_active":"2024-04-26T18:33:06.557694+0000","last_became_peered":"2024-04-26T18:33:06.557694+0000","last_unstale":"2024-04-26T18:33:08.548852+0000","last_undegraded":"2024-04-26T18:33:08.548852+0000","last_fullsized":"2024-04-26T18:33:08.548852+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:02.497601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T18:33:50.645827+0000","last_change":"2024-04-26T18:33:03.528750+0000","last_active":"2024-04-26T18:33:50.645827+0000","last_peered":"2024-04-26T18:33:50.645827+0000","last_clean":"2024-04-26T18:33:50.645827+0000","last_became_active":"2024-04-26T18:33:03.528442+0000","last_became_peered":"2024-04-26T18:33:03.528442+0000","last_unstale":"2024-04-26T18:33:50.645827+0000","last_undegraded":"2024-04-26T18:33:50.645827+0000","last_fullsized":"2024-04-26T18:33:50.645827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:13.931280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T18:33:50.639352+0000","last_change":"2024-04-26T18:33:06.561274+0000","last_active":"2024-04-26T18:33:50.639352+0000","last_peered":"2024-04-26T18:33:50.639352+0000","last_clean":"2024-04-26T18:33:50.639352+0000","last_became_active":"2024-04-26T18:33:06.560622+0000","last_became_peered":"2024-04-26T18:33:06.560622+0000","last_unstale":"2024-04-26T18:33:50.639352+0000","last_undegraded":"2024-04-26T18:33:50.639352+0000","last_fullsized":"2024-04-26T18:33:50.639352+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:27.875181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:21.657538+0000","last_change":"2024-04-26T18:33:03.529634+0000","last_active":"2024-04-26T18:33:21.657538+0000","last_peered":"2024-04-26T18:33:21.657538+0000","last_clean":"2024-04-26T18:33:21.657538+0000","last_became_active":"2024-04-26T18:33:03.529303+0000","last_became_peered":"2024-04-26T18:33:03.529303+0000","last_unstale":"2024-04-26T18:33:21.657538+0000","last_undegraded":"2024-04-26T18:33:21.657538+0000","last_fullsized":"2024-04-26T18:33:21.657538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:37.580542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.562269+0000","last_change":"2024-04-26T18:33:06.550896+0000","last_active":"2024-04-26T18:33:08.562269+0000","last_peered":"2024-04-26T18:33:08.562269+0000","last_clean":"2024-04-26T18:33:08.562269+0000","last_became_active":"2024-04-26T18:33:06.550571+0000","last_became_peered":"2024-04-26T18:33:06.550571+0000","last_unstale":"2024-04-26T18:33:08.562269+0000","last_undegraded":"2024-04-26T18:33:08.562269+0000","last_fullsized":"2024-04-26T18:33:08.562269+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:26.715158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T18:33:50.639139+0000","last_change":"2024-04-26T18:33:03.530875+0000","last_active":"2024-04-26T18:33:50.639139+0000","last_peered":"2024-04-26T18:33:50.639139+0000","last_clean":"2024-04-26T18:33:50.639139+0000","last_became_active":"2024-04-26T18:33:03.530564+0000","last_became_peered":"2024-04-26T18:33:03.530564+0000","last_unstale":"2024-04-26T18:33:50.639139+0000","last_undegraded":"2024-04-26T18:33:50.639139+0000","last_fullsized":"2024-04-26T18:33:50.639139+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:20.320591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.546287+0000","last_change":"2024-04-26T18:33:06.553434+0000","last_active":"2024-04-26T18:33:08.546287+0000","last_peered":"2024-04-26T18:33:08.546287+0000","last_clean":"2024-04-26T18:33:08.546287+0000","last_became_active":"2024-04-26T18:33:06.551897+0000","last_became_peered":"2024-04-26T18:33:06.551897+0000","last_unstale":"2024-04-26T18:33:08.546287+0000","last_undegraded":"2024-04-26T18:33:08.546287+0000","last_fullsized":"2024-04-26T18:33:08.546287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:56.503266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T18:33:50.948334+0000","last_change":"2024-04-26T18:33:03.524239+0000","last_active":"2024-04-26T18:33:50.948334+0000","last_peered":"2024-04-26T18:33:50.948334+0000","last_clean":"2024-04-26T18:33:50.948334+0000","last_became_active":"2024-04-26T18:33:03.523848+0000","last_became_peered":"2024-04-26T18:33:03.523848+0000","last_unstale":"2024-04-26T18:33:50.948334+0000","last_undegraded":"2024-04-26T18:33:50.948334+0000","last_fullsized":"2024-04-26T18:33:50.948334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:29.354430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.551984+0000","last_change":"2024-04-26T18:33:06.569557+0000","last_active":"2024-04-26T18:33:08.551984+0000","last_peered":"2024-04-26T18:33:08.551984+0000","last_clean":"2024-04-26T18:33:08.551984+0000","last_became_active":"2024-04-26T18:33:06.568414+0000","last_became_peered":"2024-04-26T18:33:06.568414+0000","last_unstale":"2024-04-26T18:33:08.551984+0000","last_undegraded":"2024-04-26T18:33:08.551984+0000","last_fullsized":"2024-04-26T18:33:08.551984+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:30.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:23.672108+0000","last_change":"2024-04-26T18:33:03.528554+0000","last_active":"2024-04-26T18:33:23.672108+0000","last_peered":"2024-04-26T18:33:23.672108+0000","last_clean":"2024-04-26T18:33:23.672108+0000","last_became_active":"2024-04-26T18:33:03.527611+0000","last_became_peered":"2024-04-26T18:33:03.527611+0000","last_unstale":"2024-04-26T18:33:23.672108+0000","last_undegraded":"2024-04-26T18:33:23.672108+0000","last_fullsized":"2024-04-26T18:33:23.672108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:28.387779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T18:33:50.668586+0000","last_change":"2024-04-26T18:33:06.561415+0000","last_active":"2024-04-26T18:33:50.668586+0000","last_peered":"2024-04-26T18:33:50.668586+0000","last_clean":"2024-04-26T18:33:50.668586+0000","last_became_active":"2024-04-26T18:33:06.560518+0000","last_became_peered":"2024-04-26T18:33:06.560518+0000","last_unstale":"2024-04-26T18:33:50.668586+0000","last_undegraded":"2024-04-26T18:33:50.668586+0000","last_fullsized":"2024-04-26T18:33:50.668586+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:49.824157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T18:33:50.639746+0000","last_change":"2024-04-26T18:33:03.861087+0000","last_active":"2024-04-26T18:33:50.639746+0000","last_peered":"2024-04-26T18:33:50.639746+0000","last_clean":"2024-04-26T18:33:50.639746+0000","last_became_active":"2024-04-26T18:33:03.860531+0000","last_became_peered":"2024-04-26T18:33:03.860531+0000","last_unstale":"2024-04-26T18:33:50.639746+0000","last_undegraded":"2024-04-26T18:33:50.639746+0000","last_fullsized":"2024-04-26T18:33:50.639746+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:22:07.086887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.551869+0000","last_change":"2024-04-26T18:33:06.565910+0000","last_active":"2024-04-26T18:33:08.551869+0000","last_peered":"2024-04-26T18:33:08.551869+0000","last_clean":"2024-04-26T18:33:08.551869+0000","last_became_active":"2024-04-26T18:33:06.565402+0000","last_became_peered":"2024-04-26T18:33:06.565402+0000","last_unstale":"2024-04-26T18:33:08.551869+0000","last_undegraded":"2024-04-26T18:33:08.551869+0000","last_fullsized":"2024-04-26T18:33:08.551869+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:40.418513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"89'29","reported_seq":116,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T18:33:50.950717+0000","last_change":"2024-04-26T18:33:03.527871+0000","last_active":"2024-04-26T18:33:50.950717+0000","last_peered":"2024-04-26T18:33:50.950717+0000","last_clean":"2024-04-26T18:33:50.950717+0000","last_became_active":"2024-04-26T18:33:03.527546+0000","last_became_peered":"2024-04-26T18:33:03.527546+0000","last_unstale":"2024-04-26T18:33:50.950717+0000","last_undegraded":"2024-04-26T18:33:50.950717+0000","last_fullsized":"2024-04-26T18:33:50.950717+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:24.749505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55581,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":64,"num_read_kb":85,"num_write":31,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.548762+0000","last_change":"2024-04-26T18:33:06.546735+0000","last_active":"2024-04-26T18:33:08.548762+0000","last_peered":"2024-04-26T18:33:08.548762+0000","last_clean":"2024-04-26T18:33:08.548762+0000","last_became_active":"2024-04-26T18:33:06.546360+0000","last_became_peered":"2024-04-26T18:33:06.546360+0000","last_unstale":"2024-04-26T18:33:08.548762+0000","last_undegraded":"2024-04-26T18:33:08.548762+0000","last_fullsized":"2024-04-26T18:33:08.548762+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:15.736669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:23.913029+0000","last_change":"2024-04-26T18:33:03.526081+0000","last_active":"2024-04-26T18:33:23.913029+0000","last_peered":"2024-04-26T18:33:23.913029+0000","last_clean":"2024-04-26T18:33:23.913029+0000","last_became_active":"2024-04-26T18:33:03.525717+0000","last_became_peered":"2024-04-26T18:33:03.525717+0000","last_unstale":"2024-04-26T18:33:23.913029+0000","last_undegraded":"2024-04-26T18:33:23.913029+0000","last_fullsized":"2024-04-26T18:33:23.913029+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:15.137654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561065+0000","last_change":"2024-04-26T18:33:06.552689+0000","last_active":"2024-04-26T18:33:08.561065+0000","last_peered":"2024-04-26T18:33:08.561065+0000","last_clean":"2024-04-26T18:33:08.561065+0000","last_became_active":"2024-04-26T18:33:06.552404+0000","last_became_peered":"2024-04-26T18:33:06.552404+0000","last_unstale":"2024-04-26T18:33:08.561065+0000","last_undegraded":"2024-04-26T18:33:08.561065+0000","last_fullsized":"2024-04-26T18:33:08.561065+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:58:32.681037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T18:33:50.639315+0000","last_change":"2024-04-26T18:33:03.526092+0000","last_active":"2024-04-26T18:33:50.639315+0000","last_peered":"2024-04-26T18:33:50.639315+0000","last_clean":"2024-04-26T18:33:50.639315+0000","last_became_active":"2024-04-26T18:33:03.525782+0000","last_became_peered":"2024-04-26T18:33:03.525782+0000","last_unstale":"2024-04-26T18:33:50.639315+0000","last_undegraded":"2024-04-26T18:33:50.639315+0000","last_fullsized":"2024-04-26T18:33:50.639315+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:56.564484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.562622+0000","last_change":"2024-04-26T18:33:06.555034+0000","last_active":"2024-04-26T18:33:08.562622+0000","last_peered":"2024-04-26T18:33:08.562622+0000","last_clean":"2024-04-26T18:33:08.562622+0000","last_became_active":"2024-04-26T18:33:06.554623+0000","last_became_peered":"2024-04-26T18:33:06.554623+0000","last_unstale":"2024-04-26T18:33:08.562622+0000","last_undegraded":"2024-04-26T18:33:08.562622+0000","last_fullsized":"2024-04-26T18:33:08.562622+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:56.243086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'5","reported_seq":61,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.651583+0000","last_change":"2024-04-26T18:33:03.531232+0000","last_active":"2024-04-26T18:33:51.651583+0000","last_peered":"2024-04-26T18:33:51.651583+0000","last_clean":"2024-04-26T18:33:51.651583+0000","last_became_active":"2024-04-26T18:33:03.530861+0000","last_became_peered":"2024-04-26T18:33:03.530861+0000","last_unstale":"2024-04-26T18:33:51.651583+0000","last_undegraded":"2024-04-26T18:33:51.651583+0000","last_fullsized":"2024-04-26T18:33:51.651583+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:07:44.576659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.562081+0000","last_change":"2024-04-26T18:33:06.559471+0000","last_active":"2024-04-26T18:33:08.562081+0000","last_peered":"2024-04-26T18:33:08.562081+0000","last_clean":"2024-04-26T18:33:08.562081+0000","last_became_active":"2024-04-26T18:33:06.559156+0000","last_became_peered":"2024-04-26T18:33:06.559156+0000","last_unstale":"2024-04-26T18:33:08.562081+0000","last_undegraded":"2024-04-26T18:33:08.562081+0000","last_fullsized":"2024-04-26T18:33:08.562081+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:37.624415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:23.674177+0000","last_change":"2024-04-26T18:33:03.860900+0000","last_active":"2024-04-26T18:33:23.674177+0000","last_peered":"2024-04-26T18:33:23.674177+0000","last_clean":"2024-04-26T18:33:23.674177+0000","last_became_active":"2024-04-26T18:33:03.860601+0000","last_became_peered":"2024-04-26T18:33:03.860601+0000","last_unstale":"2024-04-26T18:33:23.674177+0000","last_undegraded":"2024-04-26T18:33:23.674177+0000","last_fullsized":"2024-04-26T18:33:23.674177+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:56.527624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561952+0000","last_change":"2024-04-26T18:33:06.569012+0000","last_active":"2024-04-26T18:33:08.561952+0000","last_peered":"2024-04-26T18:33:08.561952+0000","last_clean":"2024-04-26T18:33:08.561952+0000","last_became_active":"2024-04-26T18:33:06.568628+0000","last_became_peered":"2024-04-26T18:33:06.568628+0000","last_unstale":"2024-04-26T18:33:08.561952+0000","last_undegraded":"2024-04-26T18:33:08.561952+0000","last_fullsized":"2024-04-26T18:33:08.561952+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:34.510828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:23.651775+0000","last_change":"2024-04-26T18:33:03.530623+0000","last_active":"2024-04-26T18:33:23.651775+0000","last_peered":"2024-04-26T18:33:23.651775+0000","last_clean":"2024-04-26T18:33:23.651775+0000","last_became_active":"2024-04-26T18:33:03.530283+0000","last_became_peered":"2024-04-26T18:33:03.530283+0000","last_unstale":"2024-04-26T18:33:23.651775+0000","last_undegraded":"2024-04-26T18:33:23.651775+0000","last_fullsized":"2024-04-26T18:33:23.651775+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:05.798381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.566303+0000","last_change":"2024-04-26T18:33:06.557597+0000","last_active":"2024-04-26T18:33:08.566303+0000","last_peered":"2024-04-26T18:33:08.566303+0000","last_clean":"2024-04-26T18:33:08.566303+0000","last_became_active":"2024-04-26T18:33:06.557249+0000","last_became_peered":"2024-04-26T18:33:06.557249+0000","last_unstale":"2024-04-26T18:33:08.566303+0000","last_undegraded":"2024-04-26T18:33:08.566303+0000","last_fullsized":"2024-04-26T18:33:08.566303+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:22.258691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.546308+0000","last_change":"2024-04-26T18:33:03.861082+0000","last_active":"2024-04-26T18:33:08.546308+0000","last_peered":"2024-04-26T18:33:08.546308+0000","last_clean":"2024-04-26T18:33:08.546308+0000","last_became_active":"2024-04-26T18:33:03.860661+0000","last_became_peered":"2024-04-26T18:33:03.860661+0000","last_unstale":"2024-04-26T18:33:08.546308+0000","last_undegraded":"2024-04-26T18:33:08.546308+0000","last_fullsized":"2024-04-26T18:33:08.546308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:46.653421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"89'1","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T18:33:50.646023+0000","last_change":"2024-04-26T18:33:06.558268+0000","last_active":"2024-04-26T18:33:50.646023+0000","last_peered":"2024-04-26T18:33:50.646023+0000","last_clean":"2024-04-26T18:33:50.646023+0000","last_became_active":"2024-04-26T18:33:06.557899+0000","last_became_peered":"2024-04-26T18:33:06.557899+0000","last_unstale":"2024-04-26T18:33:50.646023+0000","last_undegraded":"2024-04-26T18:33:50.646023+0000","last_fullsized":"2024-04-26T18:33:50.646023+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:03:47.016288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'5","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:46.942918+0000","last_change":"2024-04-26T18:33:03.528398+0000","last_active":"2024-04-26T18:33:46.942918+0000","last_peered":"2024-04-26T18:33:46.942918+0000","last_clean":"2024-04-26T18:33:46.942918+0000","last_became_active":"2024-04-26T18:33:03.528008+0000","last_became_peered":"2024-04-26T18:33:03.528008+0000","last_unstale":"2024-04-26T18:33:46.942918+0000","last_undegraded":"2024-04-26T18:33:46.942918+0000","last_fullsized":"2024-04-26T18:33:46.942918+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:27.027873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T18:33:50.645829+0000","last_change":"2024-04-26T18:33:06.556035+0000","last_active":"2024-04-26T18:33:50.645829+0000","last_peered":"2024-04-26T18:33:50.645829+0000","last_clean":"2024-04-26T18:33:50.645829+0000","last_became_active":"2024-04-26T18:33:06.555703+0000","last_became_peered":"2024-04-26T18:33:06.555703+0000","last_unstale":"2024-04-26T18:33:50.645829+0000","last_undegraded":"2024-04-26T18:33:50.645829+0000","last_fullsized":"2024-04-26T18:33:50.645829+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:30:02.064205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T18:33:50.639749+0000","last_change":"2024-04-26T18:33:06.556447+0000","last_active":"2024-04-26T18:33:50.639749+0000","last_peered":"2024-04-26T18:33:50.639749+0000","last_clean":"2024-04-26T18:33:50.639749+0000","last_became_active":"2024-04-26T18:33:06.556124+0000","last_became_peered":"2024-04-26T18:33:06.556124+0000","last_unstale":"2024-04-26T18:33:50.639749+0000","last_undegraded":"2024-04-26T18:33:50.639749+0000","last_fullsized":"2024-04-26T18:33:50.639749+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:43:07.915584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:45.941304+0000","last_change":"2024-04-26T18:33:03.860440+0000","last_active":"2024-04-26T18:33:45.941304+0000","last_peered":"2024-04-26T18:33:45.941304+0000","last_clean":"2024-04-26T18:33:45.941304+0000","last_became_active":"2024-04-26T18:33:03.860112+0000","last_became_peered":"2024-04-26T18:33:03.860112+0000","last_unstale":"2024-04-26T18:33:45.941304+0000","last_undegraded":"2024-04-26T18:33:45.941304+0000","last_fullsized":"2024-04-26T18:33:45.941304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:19:05.661597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561961+0000","last_change":"2024-04-26T18:33:06.561688+0000","last_active":"2024-04-26T18:33:08.561961+0000","last_peered":"2024-04-26T18:33:08.561961+0000","last_clean":"2024-04-26T18:33:08.561961+0000","last_became_active":"2024-04-26T18:33:06.561285+0000","last_became_peered":"2024-04-26T18:33:06.561285+0000","last_unstale":"2024-04-26T18:33:08.561961+0000","last_undegraded":"2024-04-26T18:33:08.561961+0000","last_fullsized":"2024-04-26T18:33:08.561961+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:13.272896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.651942+0000","last_change":"2024-04-26T18:33:03.531237+0000","last_active":"2024-04-26T18:33:51.651942+0000","last_peered":"2024-04-26T18:33:51.651942+0000","last_clean":"2024-04-26T18:33:51.651942+0000","last_became_active":"2024-04-26T18:33:03.530843+0000","last_became_peered":"2024-04-26T18:33:03.530843+0000","last_unstale":"2024-04-26T18:33:51.651942+0000","last_undegraded":"2024-04-26T18:33:51.651942+0000","last_fullsized":"2024-04-26T18:33:51.651942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:24.454752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":354,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561560+0000","last_change":"2024-04-26T18:31:39.402840+0000","last_active":"2024-04-26T18:33:08.561560+0000","last_peered":"2024-04-26T18:33:08.561560+0000","last_clean":"2024-04-26T18:33:08.561560+0000","last_became_active":"2024-04-26T18:31:39.402341+0000","last_became_peered":"2024-04-26T18:31:39.402341+0000","last_unstale":"2024-04-26T18:33:08.561560+0000","last_undegraded":"2024-04-26T18:33:08.561560+0000","last_fullsized":"2024-04-26T18:33:08.561560+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:28:14.522548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:28:14.522548+0000","last_clean_scrub_stamp":"2024-04-26T18:28:14.522548+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:32.052085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561528+0000","last_change":"2024-04-26T18:33:06.557695+0000","last_active":"2024-04-26T18:33:08.561528+0000","last_peered":"2024-04-26T18:33:08.561528+0000","last_clean":"2024-04-26T18:33:08.561528+0000","last_became_active":"2024-04-26T18:33:06.557369+0000","last_became_peered":"2024-04-26T18:33:06.557369+0000","last_unstale":"2024-04-26T18:33:08.561528+0000","last_undegraded":"2024-04-26T18:33:08.561528+0000","last_fullsized":"2024-04-26T18:33:08.561528+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:35.666232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:21.656675+0000","last_change":"2024-04-26T18:33:03.527897+0000","last_active":"2024-04-26T18:33:21.656675+0000","last_peered":"2024-04-26T18:33:21.656675+0000","last_clean":"2024-04-26T18:33:21.656675+0000","last_became_active":"2024-04-26T18:33:03.527345+0000","last_became_peered":"2024-04-26T18:33:03.527345+0000","last_unstale":"2024-04-26T18:33:21.656675+0000","last_undegraded":"2024-04-26T18:33:21.656675+0000","last_fullsized":"2024-04-26T18:33:21.656675+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:31.144555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:23.674511+0000","last_change":"2024-04-26T18:33:03.860572+0000","last_active":"2024-04-26T18:33:23.674511+0000","last_peered":"2024-04-26T18:33:23.674511+0000","last_clean":"2024-04-26T18:33:23.674511+0000","last_became_active":"2024-04-26T18:33:03.860188+0000","last_became_peered":"2024-04-26T18:33:03.860188+0000","last_unstale":"2024-04-26T18:33:23.674511+0000","last_undegraded":"2024-04-26T18:33:23.674511+0000","last_fullsized":"2024-04-26T18:33:23.674511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:24:34.811572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561002+0000","last_change":"2024-04-26T18:33:06.558075+0000","last_active":"2024-04-26T18:33:08.561002+0000","last_peered":"2024-04-26T18:33:08.561002+0000","last_clean":"2024-04-26T18:33:08.561002+0000","last_became_active":"2024-04-26T18:33:06.557293+0000","last_became_peered":"2024-04-26T18:33:06.557293+0000","last_unstale":"2024-04-26T18:33:08.561002+0000","last_undegraded":"2024-04-26T18:33:08.561002+0000","last_fullsized":"2024-04-26T18:33:08.561002+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:12.635253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"89'16","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:44.563390+0000","last_change":"2024-04-26T18:33:03.528196+0000","last_active":"2024-04-26T18:33:44.563390+0000","last_peered":"2024-04-26T18:33:44.563390+0000","last_clean":"2024-04-26T18:33:44.563390+0000","last_became_active":"2024-04-26T18:33:03.527846+0000","last_became_peered":"2024-04-26T18:33:03.527846+0000","last_unstale":"2024-04-26T18:33:44.563390+0000","last_undegraded":"2024-04-26T18:33:44.563390+0000","last_fullsized":"2024-04-26T18:33:44.563390+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:13:46.073405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.562401+0000","last_change":"2024-04-26T18:33:06.550260+0000","last_active":"2024-04-26T18:33:08.562401+0000","last_peered":"2024-04-26T18:33:08.562401+0000","last_clean":"2024-04-26T18:33:08.562401+0000","last_became_active":"2024-04-26T18:33:06.549925+0000","last_became_peered":"2024-04-26T18:33:06.549925+0000","last_unstale":"2024-04-26T18:33:08.562401+0000","last_undegraded":"2024-04-26T18:33:08.562401+0000","last_fullsized":"2024-04-26T18:33:08.562401+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:17:01.777381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.652423+0000","last_change":"2024-04-26T18:33:03.876609+0000","last_active":"2024-04-26T18:33:51.652423+0000","last_peered":"2024-04-26T18:33:51.652423+0000","last_clean":"2024-04-26T18:33:51.652423+0000","last_became_active":"2024-04-26T18:33:03.876284+0000","last_became_peered":"2024-04-26T18:33:03.876284+0000","last_unstale":"2024-04-26T18:33:51.652423+0000","last_undegraded":"2024-04-26T18:33:51.652423+0000","last_fullsized":"2024-04-26T18:33:51.652423+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:22.995000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T18:33:50.668582+0000","last_change":"2024-04-26T18:33:06.558735+0000","last_active":"2024-04-26T18:33:50.668582+0000","last_peered":"2024-04-26T18:33:50.668582+0000","last_clean":"2024-04-26T18:33:50.668582+0000","last_became_active":"2024-04-26T18:33:06.558416+0000","last_became_peered":"2024-04-26T18:33:06.558416+0000","last_unstale":"2024-04-26T18:33:50.668582+0000","last_undegraded":"2024-04-26T18:33:50.668582+0000","last_fullsized":"2024-04-26T18:33:50.668582+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:27.627055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:20.652577+0000","last_change":"2024-04-26T18:33:03.861073+0000","last_active":"2024-04-26T18:33:20.652577+0000","last_peered":"2024-04-26T18:33:20.652577+0000","last_clean":"2024-04-26T18:33:20.652577+0000","last_became_active":"2024-04-26T18:33:03.860661+0000","last_became_peered":"2024-04-26T18:33:03.860661+0000","last_unstale":"2024-04-26T18:33:20.652577+0000","last_undegraded":"2024-04-26T18:33:20.652577+0000","last_fullsized":"2024-04-26T18:33:20.652577+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:19.429969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.548480+0000","last_change":"2024-04-26T18:33:06.553160+0000","last_active":"2024-04-26T18:33:08.548480+0000","last_peered":"2024-04-26T18:33:08.548480+0000","last_clean":"2024-04-26T18:33:08.548480+0000","last_became_active":"2024-04-26T18:33:06.552791+0000","last_became_peered":"2024-04-26T18:33:06.552791+0000","last_unstale":"2024-04-26T18:33:08.548480+0000","last_undegraded":"2024-04-26T18:33:08.548480+0000","last_fullsized":"2024-04-26T18:33:08.548480+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:31.675069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:23.672066+0000","last_change":"2024-04-26T18:33:03.524443+0000","last_active":"2024-04-26T18:33:23.672066+0000","last_peered":"2024-04-26T18:33:23.672066+0000","last_clean":"2024-04-26T18:33:23.672066+0000","last_became_active":"2024-04-26T18:33:03.524137+0000","last_became_peered":"2024-04-26T18:33:03.524137+0000","last_unstale":"2024-04-26T18:33:23.672066+0000","last_undegraded":"2024-04-26T18:33:23.672066+0000","last_fullsized":"2024-04-26T18:33:23.672066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:43.021778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.567125+0000","last_change":"2024-04-26T18:33:06.553698+0000","last_active":"2024-04-26T18:33:08.567125+0000","last_peered":"2024-04-26T18:33:08.567125+0000","last_clean":"2024-04-26T18:33:08.567125+0000","last_became_active":"2024-04-26T18:33:06.552995+0000","last_became_peered":"2024-04-26T18:33:06.552995+0000","last_unstale":"2024-04-26T18:33:08.567125+0000","last_undegraded":"2024-04-26T18:33:08.567125+0000","last_fullsized":"2024-04-26T18:33:08.567125+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:27.135435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:22.663653+0000","last_change":"2024-04-26T18:33:03.528134+0000","last_active":"2024-04-26T18:33:22.663653+0000","last_peered":"2024-04-26T18:33:22.663653+0000","last_clean":"2024-04-26T18:33:22.663653+0000","last_became_active":"2024-04-26T18:33:03.527839+0000","last_became_peered":"2024-04-26T18:33:03.527839+0000","last_unstale":"2024-04-26T18:33:22.663653+0000","last_undegraded":"2024-04-26T18:33:22.663653+0000","last_fullsized":"2024-04-26T18:33:22.663653+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:52.658208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.562082+0000","last_change":"2024-04-26T18:33:06.553596+0000","last_active":"2024-04-26T18:33:08.562082+0000","last_peered":"2024-04-26T18:33:08.562082+0000","last_clean":"2024-04-26T18:33:08.562082+0000","last_became_active":"2024-04-26T18:33:06.553284+0000","last_became_peered":"2024-04-26T18:33:06.553284+0000","last_unstale":"2024-04-26T18:33:08.562082+0000","last_undegraded":"2024-04-26T18:33:08.562082+0000","last_fullsized":"2024-04-26T18:33:08.562082+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.245437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:20.652999+0000","last_change":"2024-04-26T18:33:03.533191+0000","last_active":"2024-04-26T18:33:20.652999+0000","last_peered":"2024-04-26T18:33:20.652999+0000","last_clean":"2024-04-26T18:33:20.652999+0000","last_became_active":"2024-04-26T18:33:03.532904+0000","last_became_peered":"2024-04-26T18:33:03.532904+0000","last_unstale":"2024-04-26T18:33:20.652999+0000","last_undegraded":"2024-04-26T18:33:20.652999+0000","last_fullsized":"2024-04-26T18:33:20.652999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:47.916518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.562016+0000","last_change":"2024-04-26T18:33:06.566899+0000","last_active":"2024-04-26T18:33:08.562016+0000","last_peered":"2024-04-26T18:33:08.562016+0000","last_clean":"2024-04-26T18:33:08.562016+0000","last_became_active":"2024-04-26T18:33:06.566548+0000","last_became_peered":"2024-04-26T18:33:06.566548+0000","last_unstale":"2024-04-26T18:33:08.562016+0000","last_undegraded":"2024-04-26T18:33:08.562016+0000","last_fullsized":"2024-04-26T18:33:08.562016+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:07.751063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'5","reported_seq":53,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:46.943554+0000","last_change":"2024-04-26T18:33:03.876589+0000","last_active":"2024-04-26T18:33:46.943554+0000","last_peered":"2024-04-26T18:33:46.943554+0000","last_clean":"2024-04-26T18:33:46.943554+0000","last_became_active":"2024-04-26T18:33:03.876262+0000","last_became_peered":"2024-04-26T18:33:03.876262+0000","last_unstale":"2024-04-26T18:33:46.943554+0000","last_undegraded":"2024-04-26T18:33:46.943554+0000","last_fullsized":"2024-04-26T18:33:46.943554+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:04.959745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.562323+0000","last_change":"2024-04-26T18:33:06.561848+0000","last_active":"2024-04-26T18:33:08.562323+0000","last_peered":"2024-04-26T18:33:08.562323+0000","last_clean":"2024-04-26T18:33:08.562323+0000","last_became_active":"2024-04-26T18:33:06.561514+0000","last_became_peered":"2024-04-26T18:33:06.561514+0000","last_unstale":"2024-04-26T18:33:08.562323+0000","last_undegraded":"2024-04-26T18:33:08.562323+0000","last_fullsized":"2024-04-26T18:33:08.562323+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:46.326261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T18:33:50.639486+0000","last_change":"2024-04-26T18:33:03.527237+0000","last_active":"2024-04-26T18:33:50.639486+0000","last_peered":"2024-04-26T18:33:50.639486+0000","last_clean":"2024-04-26T18:33:50.639486+0000","last_became_active":"2024-04-26T18:33:03.526618+0000","last_became_peered":"2024-04-26T18:33:03.526618+0000","last_unstale":"2024-04-26T18:33:50.639486+0000","last_undegraded":"2024-04-26T18:33:50.639486+0000","last_fullsized":"2024-04-26T18:33:50.639486+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:28.232597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"89'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561741+0000","last_change":"2024-04-26T18:33:06.555276+0000","last_active":"2024-04-26T18:33:08.561741+0000","last_peered":"2024-04-26T18:33:08.561741+0000","last_clean":"2024-04-26T18:33:08.561741+0000","last_became_active":"2024-04-26T18:33:06.554889+0000","last_became_peered":"2024-04-26T18:33:06.554889+0000","last_unstale":"2024-04-26T18:33:08.561741+0000","last_undegraded":"2024-04-26T18:33:08.561741+0000","last_fullsized":"2024-04-26T18:33:08.561741+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:33:13.614662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:23.672736+0000","last_change":"2024-04-26T18:33:03.527108+0000","last_active":"2024-04-26T18:33:23.672736+0000","last_peered":"2024-04-26T18:33:23.672736+0000","last_clean":"2024-04-26T18:33:23.672736+0000","last_became_active":"2024-04-26T18:33:03.526648+0000","last_became_peered":"2024-04-26T18:33:03.526648+0000","last_unstale":"2024-04-26T18:33:23.672736+0000","last_undegraded":"2024-04-26T18:33:23.672736+0000","last_fullsized":"2024-04-26T18:33:23.672736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:40.915022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.563000+0000","last_change":"2024-04-26T18:33:06.551605+0000","last_active":"2024-04-26T18:33:08.563000+0000","last_peered":"2024-04-26T18:33:08.563000+0000","last_clean":"2024-04-26T18:33:08.563000+0000","last_became_active":"2024-04-26T18:33:06.550772+0000","last_became_peered":"2024-04-26T18:33:06.550772+0000","last_unstale":"2024-04-26T18:33:08.563000+0000","last_undegraded":"2024-04-26T18:33:08.563000+0000","last_fullsized":"2024-04-26T18:33:08.563000+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:33.124989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.567274+0000","last_change":"2024-04-26T18:33:06.558971+0000","last_active":"2024-04-26T18:33:08.567274+0000","last_peered":"2024-04-26T18:33:08.567274+0000","last_clean":"2024-04-26T18:33:08.567274+0000","last_became_active":"2024-04-26T18:33:06.558594+0000","last_became_peered":"2024-04-26T18:33:06.558594+0000","last_unstale":"2024-04-26T18:33:08.567274+0000","last_undegraded":"2024-04-26T18:33:08.567274+0000","last_fullsized":"2024-04-26T18:33:08.567274+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:12.974472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.549996+0000","last_change":"2024-04-26T18:33:06.558928+0000","last_active":"2024-04-26T18:33:08.549996+0000","last_peered":"2024-04-26T18:33:08.549996+0000","last_clean":"2024-04-26T18:33:08.549996+0000","last_became_active":"2024-04-26T18:33:06.558348+0000","last_became_peered":"2024-04-26T18:33:06.558348+0000","last_unstale":"2024-04-26T18:33:08.549996+0000","last_undegraded":"2024-04-26T18:33:08.549996+0000","last_fullsized":"2024-04-26T18:33:08.549996+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:04.266404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.550115+0000","last_change":"2024-04-26T18:33:06.555182+0000","last_active":"2024-04-26T18:33:08.550115+0000","last_peered":"2024-04-26T18:33:08.550115+0000","last_clean":"2024-04-26T18:33:08.550115+0000","last_became_active":"2024-04-26T18:33:06.554830+0000","last_became_peered":"2024-04-26T18:33:06.554830+0000","last_unstale":"2024-04-26T18:33:08.550115+0000","last_undegraded":"2024-04-26T18:33:08.550115+0000","last_fullsized":"2024-04-26T18:33:08.550115+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:48.841634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T18:33:50.668399+0000","last_change":"2024-04-26T18:33:06.558962+0000","last_active":"2024-04-26T18:33:50.668399+0000","last_peered":"2024-04-26T18:33:50.668399+0000","last_clean":"2024-04-26T18:33:50.668399+0000","last_became_active":"2024-04-26T18:33:06.557995+0000","last_became_peered":"2024-04-26T18:33:06.557995+0000","last_unstale":"2024-04-26T18:33:50.668399+0000","last_undegraded":"2024-04-26T18:33:50.668399+0000","last_fullsized":"2024-04-26T18:33:50.668399+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:54.207205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.563283+0000","last_change":"2024-04-26T18:33:06.558055+0000","last_active":"2024-04-26T18:33:08.563283+0000","last_peered":"2024-04-26T18:33:08.563283+0000","last_clean":"2024-04-26T18:33:08.563283+0000","last_became_active":"2024-04-26T18:33:06.557299+0000","last_became_peered":"2024-04-26T18:33:06.557299+0000","last_unstale":"2024-04-26T18:33:08.563283+0000","last_undegraded":"2024-04-26T18:33:08.563283+0000","last_fullsized":"2024-04-26T18:33:08.563283+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:21.143017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.566892+0000","last_change":"2024-04-26T18:33:06.558680+0000","last_active":"2024-04-26T18:33:08.566892+0000","last_peered":"2024-04-26T18:33:08.566892+0000","last_clean":"2024-04-26T18:33:08.566892+0000","last_became_active":"2024-04-26T18:33:06.558139+0000","last_became_peered":"2024-04-26T18:33:06.558139+0000","last_unstale":"2024-04-26T18:33:08.566892+0000","last_undegraded":"2024-04-26T18:33:08.566892+0000","last_fullsized":"2024-04-26T18:33:08.566892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:31.511770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.550836+0000","last_change":"2024-04-26T18:33:06.563832+0000","last_active":"2024-04-26T18:33:08.550836+0000","last_peered":"2024-04-26T18:33:08.550836+0000","last_clean":"2024-04-26T18:33:08.550836+0000","last_became_active":"2024-04-26T18:33:06.562193+0000","last_became_peered":"2024-04-26T18:33:06.562193+0000","last_unstale":"2024-04-26T18:33:08.550836+0000","last_undegraded":"2024-04-26T18:33:08.550836+0000","last_fullsized":"2024-04-26T18:33:08.550836+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:35.384552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561962+0000","last_change":"2024-04-26T18:33:06.562368+0000","last_active":"2024-04-26T18:33:08.561962+0000","last_peered":"2024-04-26T18:33:08.561962+0000","last_clean":"2024-04-26T18:33:08.561962+0000","last_became_active":"2024-04-26T18:33:06.562024+0000","last_became_peered":"2024-04-26T18:33:06.562024+0000","last_unstale":"2024-04-26T18:33:08.561962+0000","last_undegraded":"2024-04-26T18:33:08.561962+0000","last_fullsized":"2024-04-26T18:33:08.561962+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:01.562885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T18:33:50.639201+0000","last_change":"2024-04-26T18:33:06.560953+0000","last_active":"2024-04-26T18:33:50.639201+0000","last_peered":"2024-04-26T18:33:50.639201+0000","last_clean":"2024-04-26T18:33:50.639201+0000","last_became_active":"2024-04-26T18:33:06.560593+0000","last_became_peered":"2024-04-26T18:33:06.560593+0000","last_unstale":"2024-04-26T18:33:50.639201+0000","last_undegraded":"2024-04-26T18:33:50.639201+0000","last_fullsized":"2024-04-26T18:33:50.639201+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:18.168564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.562194+0000","last_change":"2024-04-26T18:33:06.555389+0000","last_active":"2024-04-26T18:33:08.562194+0000","last_peered":"2024-04-26T18:33:08.562194+0000","last_clean":"2024-04-26T18:33:08.562194+0000","last_became_active":"2024-04-26T18:33:06.555055+0000","last_became_peered":"2024-04-26T18:33:06.555055+0000","last_unstale":"2024-04-26T18:33:08.562194+0000","last_undegraded":"2024-04-26T18:33:08.562194+0000","last_fullsized":"2024-04-26T18:33:08.562194+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:32.802687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.551949+0000","last_change":"2024-04-26T18:33:06.563791+0000","last_active":"2024-04-26T18:33:08.551949+0000","last_peered":"2024-04-26T18:33:08.551949+0000","last_clean":"2024-04-26T18:33:08.551949+0000","last_became_active":"2024-04-26T18:33:06.561959+0000","last_became_peered":"2024-04-26T18:33:06.561959+0000","last_unstale":"2024-04-26T18:33:08.551949+0000","last_undegraded":"2024-04-26T18:33:08.551949+0000","last_fullsized":"2024-04-26T18:33:08.551949+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:35.280202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.561898+0000","last_change":"2024-04-26T18:33:06.554270+0000","last_active":"2024-04-26T18:33:08.561898+0000","last_peered":"2024-04-26T18:33:08.561898+0000","last_clean":"2024-04-26T18:33:08.561898+0000","last_became_active":"2024-04-26T18:33:06.553931+0000","last_became_peered":"2024-04-26T18:33:06.553931+0000","last_unstale":"2024-04-26T18:33:08.561898+0000","last_undegraded":"2024-04-26T18:33:08.561898+0000","last_fullsized":"2024-04-26T18:33:08.561898+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:40.587824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T18:33:08.566485+0000","last_change":"2024-04-26T18:33:06.556766+0000","last_active":"2024-04-26T18:33:08.566485+0000","last_peered":"2024-04-26T18:33:08.566485+0000","last_clean":"2024-04-26T18:33:08.566485+0000","last_became_active":"2024-04-26T18:33:06.556361+0000","last_became_peered":"2024-04-26T18:33:06.556361+0000","last_unstale":"2024-04-26T18:33:08.566485+0000","last_undegraded":"2024-04-26T18:33:08.566485+0000","last_fullsized":"2024-04-26T18:33:08.566485+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:10.101747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":245619,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62394,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":307,"num_read_kb":222,"num_write":243,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":187854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351000,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":466448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612638,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32272,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712880,"statfs":{"total":95995035648,"available":95961989120,"internally_reserved":0,"allocated":1122304,"data_stored":1113058,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776163,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":995328,"data_stored":466378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037799,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":466756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299437,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1044480,"data_stored":1059274,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462962,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":978944,"data_stored":466095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1036288,"data_stored":522589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":467434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":523200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149761,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":995328,"data_stored":465920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888125,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":483627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724598,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":1058952,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33912,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33912,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":57333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":57944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":57317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T18:33:54.431 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-26T18:33:54.432 INFO:tasks.cephadm:Setting up client nodes... 2024-04-26T18:33:54.433 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-26T18:33:54.679 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:33:55.823 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:55 smithi080 ceph-mon[29135]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T18:33:55.824 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:55 smithi080 ceph-mon[29135]: pgmap v323: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 383 B/s wr, 9 op/s; 2 B/s, 0 objects/s recovering 2024-04-26T18:33:55.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:55 smithi082 ceph-mon[32808]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T18:33:55.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:55 smithi082 ceph-mon[32808]: pgmap v323: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 383 B/s wr, 9 op/s; 2 B/s, 0 objects/s recovering 2024-04-26T18:33:56.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:55 smithi192 ceph-mon[32842]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T18:33:56.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:55 smithi192 ceph-mon[32842]: pgmap v323: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 383 B/s wr, 9 op/s; 2 B/s, 0 objects/s recovering 2024-04-26T18:33:56.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.362+0000 7ff1ebbf3700 1 -- 172.21.15.80:0/3682336802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e41023b0 msgr2=0x7ff1e41027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:56.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.362+0000 7ff1ebbf3700 1 --2- 172.21.15.80:0/3682336802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e41023b0 0x7ff1e41027d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff1e00099c0 tx=0x7ff1e0009cd0 comp rx=0 tx=0).stop 2024-04-26T18:33:56.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.362+0000 7ff1ebbf3700 1 -- 172.21.15.80:0/3682336802 shutdown_connections 2024-04-26T18:33:56.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.362+0000 7ff1ebbf3700 1 --2- 172.21.15.80:0/3682336802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1e4103f50 0x7ff1e410a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:56.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.362+0000 7ff1ebbf3700 1 --2- 172.21.15.80:0/3682336802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e41023b0 0x7ff1e41027d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:56.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.362+0000 7ff1ebbf3700 1 --2- 172.21.15.80:0/3682336802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1e41035b0 0x7ff1e4103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:56.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.362+0000 7ff1ebbf3700 1 -- 172.21.15.80:0/3682336802 >> 172.21.15.80:0/3682336802 conn(0x7ff1e40fd950 msgr2=0x7ff1e40ffd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:56.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.363+0000 7ff1ebbf3700 1 -- 172.21.15.80:0/3682336802 shutdown_connections 2024-04-26T18:33:56.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.363+0000 7ff1ebbf3700 1 -- 172.21.15.80:0/3682336802 wait complete. 2024-04-26T18:33:56.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.363+0000 7ff1ebbf3700 1 Processor -- start 2024-04-26T18:33:56.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.363+0000 7ff1ebbf3700 1 -- start start 2024-04-26T18:33:56.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.363+0000 7ff1ebbf3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1e41023b0 0x7ff1e4198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:56.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.363+0000 7ff1ebbf3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1e41035b0 0x7ff1e41989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:56.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.363+0000 7ff1ebbf3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e4103f50 0x7ff1e419fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:56.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.363+0000 7ff1ebbf3700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e410dec0 con 0x7ff1e4103f50 2024-04-26T18:33:56.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.363+0000 7ff1ebbf3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e410dd40 con 0x7ff1e41023b0 2024-04-26T18:33:56.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.363+0000 7ff1ebbf3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e410e040 con 0x7ff1e41035b0 2024-04-26T18:33:56.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.363+0000 7ff1ea190700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e4103f50 0x7ff1e419fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:56.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.363+0000 7ff1ea190700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e4103f50 0x7ff1e419fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60404/0 (socket says 172.21.15.80:60404) 2024-04-26T18:33:56.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.364+0000 7ff1ea190700 1 -- 172.21.15.80:0/56046200 learned_addr learned my addr 172.21.15.80:0/56046200 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:33:56.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.364+0000 7ff1e918e700 1 --2- 172.21.15.80:0/56046200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1e41035b0 0x7ff1e41989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:56.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.364+0000 7ff1e998f700 1 --2- 172.21.15.80:0/56046200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1e41023b0 0x7ff1e4198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:56.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.364+0000 7ff1ea190700 1 -- 172.21.15.80:0/56046200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1e41035b0 msgr2=0x7ff1e41989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:56.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.364+0000 7ff1ea190700 1 --2- 172.21.15.80:0/56046200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1e41035b0 0x7ff1e41989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:56.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.364+0000 7ff1ea190700 1 -- 172.21.15.80:0/56046200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1e41023b0 msgr2=0x7ff1e4198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:56.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.364+0000 7ff1ea190700 1 --2- 172.21.15.80:0/56046200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1e41023b0 0x7ff1e4198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:56.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.364+0000 7ff1ea190700 1 -- 172.21.15.80:0/56046200 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e406bcd0 con 0x7ff1e4103f50 2024-04-26T18:33:56.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.364+0000 7ff1e918e700 1 --2- 172.21.15.80:0/56046200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1e41035b0 0x7ff1e41989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:33:56.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.364+0000 7ff1ea190700 1 --2- 172.21.15.80:0/56046200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e4103f50 0x7ff1e419fa40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00b970 tx=0x7ff1dc00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:56.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.364+0000 7ff1daffd700 1 -- 172.21.15.80:0/56046200 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc019070 con 0x7ff1e4103f50 2024-04-26T18:33:56.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.364+0000 7ff1ebbf3700 1 -- 172.21.15.80:0/56046200 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e406bfc0 con 0x7ff1e4103f50 2024-04-26T18:33:56.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.364+0000 7ff1daffd700 1 -- 172.21.15.80:0/56046200 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1dc014440 con 0x7ff1e4103f50 2024-04-26T18:33:56.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.364+0000 7ff1daffd700 1 -- 172.21.15.80:0/56046200 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc00ce60 con 0x7ff1e4103f50 2024-04-26T18:33:56.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.364+0000 7ff1ebbf3700 1 -- 172.21.15.80:0/56046200 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e406c550 con 0x7ff1e4103f50 2024-04-26T18:33:56.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.365+0000 7ff1ebbf3700 1 -- 172.21.15.80:0/56046200 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1e4051960 con 0x7ff1e4103f50 2024-04-26T18:33:56.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.367+0000 7ff1daffd700 1 -- 172.21.15.80:0/56046200 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ff1dc01c070 con 0x7ff1e4103f50 2024-04-26T18:33:56.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.367+0000 7ff1daffd700 1 --2- 172.21.15.80:0/56046200 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff1d00a3d80 0x7ff1d00a6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:56.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.368+0000 7ff1e998f700 1 --2- 172.21.15.80:0/56046200 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff1d00a3d80 0x7ff1d00a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:56.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.368+0000 7ff1daffd700 1 -- 172.21.15.80:0/56046200 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7ff1dc0cfd60 con 0x7ff1e4103f50 2024-04-26T18:33:56.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.368+0000 7ff1e998f700 1 --2- 172.21.15.80:0/56046200 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff1d00a3d80 0x7ff1d00a6240 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff1e00038c0 tx=0x7ff1e0000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:56.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.371+0000 7ff1daffd700 1 -- 172.21.15.80:0/56046200 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff1dc09c720 con 0x7ff1e4103f50 2024-04-26T18:33:56.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.655+0000 7ff1ebbf3700 1 -- 172.21.15.80:0/56046200 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7ff1e406c870 con 0x7ff1e4103f50 2024-04-26T18:33:56.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.658+0000 7ff1daffd700 1 -- 172.21.15.80:0/56046200 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7ff1dc09c020 con 0x7ff1e4103f50 2024-04-26T18:33:56.658 INFO:teuthology.orchestra.run.smithi080.stdout:[client.0] 2024-04-26T18:33:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCU8ytma00tJxAAYcnql/Dfyme/K9en4tOpFQ== 2024-04-26T18:33:56.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.661+0000 7ff1ebbf3700 1 -- 172.21.15.80:0/56046200 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff1d00a3d80 msgr2=0x7ff1d00a6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:56.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.661+0000 7ff1ebbf3700 1 --2- 172.21.15.80:0/56046200 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff1d00a3d80 0x7ff1d00a6240 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff1e00038c0 tx=0x7ff1e0000bc0 comp rx=0 tx=0).stop 2024-04-26T18:33:56.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.661+0000 7ff1ebbf3700 1 -- 172.21.15.80:0/56046200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e4103f50 msgr2=0x7ff1e419fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:56.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.661+0000 7ff1ebbf3700 1 --2- 172.21.15.80:0/56046200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e4103f50 0x7ff1e419fa40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00b970 tx=0x7ff1dc00bd30 comp rx=0 tx=0).stop 2024-04-26T18:33:56.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.661+0000 7ff1ebbf3700 1 -- 172.21.15.80:0/56046200 shutdown_connections 2024-04-26T18:33:56.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.661+0000 7ff1ebbf3700 1 --2- 172.21.15.80:0/56046200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1e4103f50 0x7ff1e419fa40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:56.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.661+0000 7ff1ebbf3700 1 --2- 172.21.15.80:0/56046200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1e41023b0 0x7ff1e4198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:56.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.661+0000 7ff1ebbf3700 1 --2- 172.21.15.80:0/56046200 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff1d00a3d80 0x7ff1d00a6240 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:56.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.661+0000 7ff1ebbf3700 1 --2- 172.21.15.80:0/56046200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1e41035b0 0x7ff1e41989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:56.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.661+0000 7ff1ebbf3700 1 -- 172.21.15.80:0/56046200 >> 172.21.15.80:0/56046200 conn(0x7ff1e40fd950 msgr2=0x7ff1e4106980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:56.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.661+0000 7ff1ebbf3700 1 -- 172.21.15.80:0/56046200 shutdown_connections 2024-04-26T18:33:56.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:56.661+0000 7ff1ebbf3700 1 -- 172.21.15.80:0/56046200 wait complete. 2024-04-26T18:33:57.344 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T18:33:57.344 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-26T18:33:57.344 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T18:33:57.380 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T18:33:57.380 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-26T18:33:57.380 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph mgr dump --format=json 2024-04-26T18:33:57.654 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:33:57.954 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:57 smithi080 ceph-mon[29135]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s; 86 B/s, 1 objects/s recovering 2024-04-26T18:33:57.954 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:57 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/56046200' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T18:33:57.955 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:57 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/56046200' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-26T18:33:57.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:57 smithi082 ceph-mon[32808]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s; 86 B/s, 1 objects/s recovering 2024-04-26T18:33:57.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:57 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/56046200' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T18:33:57.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:57 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/56046200' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-26T18:33:58.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:57 smithi192 ceph-mon[32842]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s; 86 B/s, 1 objects/s recovering 2024-04-26T18:33:58.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:57 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/56046200' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T18:33:58.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:57 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/56046200' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-26T18:33:58.827 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:58 smithi080 ceph-mon[29135]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s; 86 B/s, 1 objects/s recovering 2024-04-26T18:33:58.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:58 smithi082 ceph-mon[32808]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s; 86 B/s, 1 objects/s recovering 2024-04-26T18:33:59.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:58 smithi192 ceph-mon[32842]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s; 86 B/s, 1 objects/s recovering 2024-04-26T18:33:59.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.373+0000 7efc77b03700 1 -- 172.21.15.80:0/1303791679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7006c530 msgr2=0x7efc701102e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:59.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.373+0000 7efc77b03700 1 --2- 172.21.15.80:0/1303791679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7006c530 0x7efc701102e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efc6800b0a0 tx=0x7efc6800b3b0 comp rx=0 tx=0).stop 2024-04-26T18:33:59.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.373+0000 7efc77b03700 1 -- 172.21.15.80:0/1303791679 shutdown_connections 2024-04-26T18:33:59.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.373+0000 7efc77b03700 1 --2- 172.21.15.80:0/1303791679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7006c530 0x7efc701102e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:59.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.373+0000 7efc77b03700 1 --2- 172.21.15.80:0/1303791679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc701094a0 0x7efc70109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:59.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.373+0000 7efc77b03700 1 --2- 172.21.15.80:0/1303791679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc7006bb90 0x7efc7006bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:59.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.373+0000 7efc77b03700 1 -- 172.21.15.80:0/1303791679 >> 172.21.15.80:0/1303791679 conn(0x7efc70078390 msgr2=0x7efc700787a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:59.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.373+0000 7efc77b03700 1 -- 172.21.15.80:0/1303791679 shutdown_connections 2024-04-26T18:33:59.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.373+0000 7efc77b03700 1 -- 172.21.15.80:0/1303791679 wait complete. 2024-04-26T18:33:59.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.373+0000 7efc77b03700 1 Processor -- start 2024-04-26T18:33:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.373+0000 7efc77b03700 1 -- start start 2024-04-26T18:33:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.374+0000 7efc77b03700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc7006bb90 0x7efc7019f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.374+0000 7efc77b03700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc7006c530 0x7efc7019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.374+0000 7efc77b03700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc701094a0 0x7efc701999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.374+0000 7efc77b03700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efc70113620 con 0x7efc701094a0 2024-04-26T18:33:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.374+0000 7efc77b03700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efc701134a0 con 0x7efc7006bb90 2024-04-26T18:33:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.374+0000 7efc77b03700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efc701137a0 con 0x7efc7006c530 2024-04-26T18:33:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.374+0000 7efc760a0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc701094a0 0x7efc701999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.374+0000 7efc760a0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc701094a0 0x7efc701999a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60410/0 (socket says 172.21.15.80:60410) 2024-04-26T18:33:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.374+0000 7efc760a0700 1 -- 172.21.15.80:0/2474688009 learned_addr learned my addr 172.21.15.80:0/2474688009 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:33:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.374+0000 7efc7509e700 1 --2- 172.21.15.80:0/2474688009 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc7006c530 0x7efc7019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.374+0000 7efc7589f700 1 --2- 172.21.15.80:0/2474688009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc7006bb90 0x7efc7019f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:59.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.374+0000 7efc760a0700 1 -- 172.21.15.80:0/2474688009 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc7006c530 msgr2=0x7efc7019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:59.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.374+0000 7efc760a0700 1 --2- 172.21.15.80:0/2474688009 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc7006c530 0x7efc7019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:59.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.374+0000 7efc760a0700 1 -- 172.21.15.80:0/2474688009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc7006bb90 msgr2=0x7efc7019f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:59.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.374+0000 7efc760a0700 1 --2- 172.21.15.80:0/2474688009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc7006bb90 0x7efc7019f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:59.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.374+0000 7efc760a0700 1 -- 172.21.15.80:0/2474688009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc7019a100 con 0x7efc701094a0 2024-04-26T18:33:59.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.374+0000 7efc7589f700 1 --2- 172.21.15.80:0/2474688009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc7006bb90 0x7efc7019f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:33:59.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.374+0000 7efc760a0700 1 --2- 172.21.15.80:0/2474688009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc701094a0 0x7efc701999a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efc6800b830 tx=0x7efc68004d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:59.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.374+0000 7efc66ffd700 1 -- 172.21.15.80:0/2474688009 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68021070 con 0x7efc701094a0 2024-04-26T18:33:59.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.374+0000 7efc66ffd700 1 -- 172.21.15.80:0/2474688009 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc68003c00 con 0x7efc701094a0 2024-04-26T18:33:59.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.374+0000 7efc77b03700 1 -- 172.21.15.80:0/2474688009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc7019a390 con 0x7efc701094a0 2024-04-26T18:33:59.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.374+0000 7efc66ffd700 1 -- 172.21.15.80:0/2474688009 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68004730 con 0x7efc701094a0 2024-04-26T18:33:59.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.374+0000 7efc77b03700 1 -- 172.21.15.80:0/2474688009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc701a66b0 con 0x7efc701094a0 2024-04-26T18:33:59.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.375+0000 7efc77b03700 1 -- 172.21.15.80:0/2474688009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc7010ba10 con 0x7efc701094a0 2024-04-26T18:33:59.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.377+0000 7efc66ffd700 1 -- 172.21.15.80:0/2474688009 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7efc68003db0 con 0x7efc701094a0 2024-04-26T18:33:59.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.377+0000 7efc66ffd700 1 --2- 172.21.15.80:0/2474688009 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7efc5c0a3cd0 0x7efc5c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:59.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.378+0000 7efc7589f700 1 --2- 172.21.15.80:0/2474688009 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7efc5c0a3cd0 0x7efc5c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:59.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.378+0000 7efc66ffd700 1 -- 172.21.15.80:0/2474688009 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7efc6800f020 con 0x7efc701094a0 2024-04-26T18:33:59.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.378+0000 7efc7589f700 1 --2- 172.21.15.80:0/2474688009 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7efc5c0a3cd0 0x7efc5c0a6190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efc7019aae0 tx=0x7efc6c008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:59.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.381+0000 7efc66ffd700 1 -- 172.21.15.80:0/2474688009 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7efc6802a020 con 0x7efc701094a0 2024-04-26T18:33:59.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.645+0000 7efc77b03700 1 -- 172.21.15.80:0/2474688009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7efc7019aed0 con 0x7efc701094a0 2024-04-26T18:33:59.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.650+0000 7efc66ffd700 1 -- 172.21.15.80:0/2474688009 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264992 (secure 0 0 0) 0x7efc6809e990 con 0x7efc701094a0 2024-04-26T18:33:59.653 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:33:59.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.654+0000 7efc77b03700 1 -- 172.21.15.80:0/2474688009 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7efc5c0a3cd0 msgr2=0x7efc5c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:59.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.654+0000 7efc77b03700 1 --2- 172.21.15.80:0/2474688009 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7efc5c0a3cd0 0x7efc5c0a6190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efc7019aae0 tx=0x7efc6c008040 comp rx=0 tx=0).stop 2024-04-26T18:33:59.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.654+0000 7efc77b03700 1 -- 172.21.15.80:0/2474688009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc701094a0 msgr2=0x7efc701999a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:33:59.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.654+0000 7efc77b03700 1 --2- 172.21.15.80:0/2474688009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc701094a0 0x7efc701999a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efc6800b830 tx=0x7efc68004d90 comp rx=0 tx=0).stop 2024-04-26T18:33:59.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.654+0000 7efc77b03700 1 -- 172.21.15.80:0/2474688009 shutdown_connections 2024-04-26T18:33:59.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.654+0000 7efc77b03700 1 --2- 172.21.15.80:0/2474688009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc701094a0 0x7efc701999a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:59.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.654+0000 7efc77b03700 1 --2- 172.21.15.80:0/2474688009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc7006bb90 0x7efc7019f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:59.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.654+0000 7efc77b03700 1 --2- 172.21.15.80:0/2474688009 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7efc5c0a3cd0 0x7efc5c0a6190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:59.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.654+0000 7efc77b03700 1 --2- 172.21.15.80:0/2474688009 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc7006c530 0x7efc7019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:59.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.654+0000 7efc77b03700 1 -- 172.21.15.80:0/2474688009 >> 172.21.15.80:0/2474688009 conn(0x7efc70078390 msgr2=0x7efc70100400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:33:59.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.654+0000 7efc77b03700 1 -- 172.21.15.80:0/2474688009 shutdown_connections 2024-04-26T18:33:59.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:33:59.654+0000 7efc77b03700 1 -- 172.21.15.80:0/2474688009 wait complete. 2024-04-26T18:33:59.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:33:59 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/2474688009' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-26T18:33:59.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:33:59 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2474688009' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-26T18:34:00.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:33:59 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/2474688009' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-26T18:34:00.289 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":17,"flags":0,"active_gid":14148,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":179326828},{"type":"v1","addr":"172.21.15.80:6801","nonce":179326828}]},"active_addr":"172.21.15.80:6801/179326828","active_change":"2024-04-26T18:25:50.413315+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24106,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.80:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":2539501834}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":601829731}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":2453252862}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":444150730}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":102981250}]}]} 2024-04-26T18:34:00.297 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-26T18:34:00.297 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-26T18:34:00.298 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T18:34:00.545 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:00.925 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:00 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:34:00.925 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:00 smithi080 ceph-mon[29135]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.0 KiB/s wr, 9 op/s; 70 B/s, 1 objects/s recovering 2024-04-26T18:34:00.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:00 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:34:00.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:00 smithi082 ceph-mon[32808]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.0 KiB/s wr, 9 op/s; 70 B/s, 1 objects/s recovering 2024-04-26T18:34:01.013 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:00 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:34:01.013 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:00 smithi192 ceph-mon[32842]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.0 KiB/s wr, 9 op/s; 70 B/s, 1 objects/s recovering 2024-04-26T18:34:02.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.277+0000 7f24b1084700 1 -- 172.21.15.80:0/891833068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24ac107640 msgr2=0x7f24ac10f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:02.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.277+0000 7f24b1084700 1 --2- 172.21.15.80:0/891833068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24ac107640 0x7f24ac10f210 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f24a400b0d0 tx=0x7f24a400b3e0 comp rx=0 tx=0).stop 2024-04-26T18:34:02.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.277+0000 7f24b1084700 1 -- 172.21.15.80:0/891833068 shutdown_connections 2024-04-26T18:34:02.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.277+0000 7f24b1084700 1 --2- 172.21.15.80:0/891833068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24ac107640 0x7f24ac10f210 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:02.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.277+0000 7f24b1084700 1 --2- 172.21.15.80:0/891833068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24ac1025b0 0x7f24ac102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:02.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.277+0000 7f24b1084700 1 --2- 172.21.15.80:0/891833068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24ac102f60 0x7f24ac106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:02.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.277+0000 7f24b1084700 1 -- 172.21.15.80:0/891833068 >> 172.21.15.80:0/891833068 conn(0x7f24ac0792f0 msgr2=0x7f24ac079700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:02.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.277+0000 7f24b1084700 1 -- 172.21.15.80:0/891833068 shutdown_connections 2024-04-26T18:34:02.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.277+0000 7f24b1084700 1 -- 172.21.15.80:0/891833068 wait complete. 2024-04-26T18:34:02.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.278+0000 7f24b1084700 1 Processor -- start 2024-04-26T18:34:02.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.278+0000 7f24b1084700 1 -- start start 2024-04-26T18:34:02.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.279+0000 7f24b1084700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24ac1025b0 0x7f24ac19e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:02.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.279+0000 7f24b1084700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24ac102f60 0x7f24ac19ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:02.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.279+0000 7f24b1084700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24ac107640 0x7f24ac198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:02.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.279+0000 7f24b1084700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac112500 con 0x7f24ac1025b0 2024-04-26T18:34:02.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.279+0000 7f24b1084700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac112380 con 0x7f24ac102f60 2024-04-26T18:34:02.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.279+0000 7f24b1084700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac112680 con 0x7f24ac107640 2024-04-26T18:34:02.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.279+0000 7f24aa59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24ac102f60 0x7f24ac19ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:02.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.279+0000 7f24ab59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24ac107640 0x7f24ac198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:02.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.279+0000 7f24aa59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24ac102f60 0x7f24ac19ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:54120/0 (socket says 172.21.15.80:54120) 2024-04-26T18:34:02.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.279+0000 7f24ab59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24ac107640 0x7f24ac198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.80:37656/0 (socket says 172.21.15.80:37656) 2024-04-26T18:34:02.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.279+0000 7f24aa59c700 1 -- 172.21.15.80:0/2960663627 learned_addr learned my addr 172.21.15.80:0/2960663627 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:02.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.279+0000 7f24aad9d700 1 --2- 172.21.15.80:0/2960663627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24ac1025b0 0x7f24ac19e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:02.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.279+0000 7f24aa59c700 1 -- 172.21.15.80:0/2960663627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24ac107640 msgr2=0x7f24ac198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:02.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.279+0000 7f24aa59c700 1 --2- 172.21.15.80:0/2960663627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24ac107640 0x7f24ac198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:02.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.279+0000 7f24aa59c700 1 -- 172.21.15.80:0/2960663627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24ac1025b0 msgr2=0x7f24ac19e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:02.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.279+0000 7f24aa59c700 1 --2- 172.21.15.80:0/2960663627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24ac1025b0 0x7f24ac19e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:02.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.279+0000 7f24aa59c700 1 -- 172.21.15.80:0/2960663627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24ac199020 con 0x7f24ac102f60 2024-04-26T18:34:02.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.279+0000 7f24aa59c700 1 --2- 172.21.15.80:0/2960663627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24ac102f60 0x7f24ac19ec00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f24a000d950 tx=0x7f24a000dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:02.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.279+0000 7f2493fff700 1 -- 172.21.15.80:0/2960663627 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a0017070 con 0x7f24ac102f60 2024-04-26T18:34:02.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.279+0000 7f24b1084700 1 -- 172.21.15.80:0/2960663627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24ac199310 con 0x7f24ac102f60 2024-04-26T18:34:02.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.279+0000 7f2493fff700 1 -- 172.21.15.80:0/2960663627 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24a0005020 con 0x7f24ac102f60 2024-04-26T18:34:02.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.279+0000 7f2493fff700 1 -- 172.21.15.80:0/2960663627 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a000fa10 con 0x7f24ac102f60 2024-04-26T18:34:02.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.280+0000 7f24b1084700 1 -- 172.21.15.80:0/2960663627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24ac1a5520 con 0x7f24ac102f60 2024-04-26T18:34:02.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.280+0000 7f24b1084700 1 -- 172.21.15.80:0/2960663627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24ac103a40 con 0x7f24ac102f60 2024-04-26T18:34:02.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.281+0000 7f2493fff700 1 -- 172.21.15.80:0/2960663627 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f24a000fbd0 con 0x7f24ac102f60 2024-04-26T18:34:02.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.282+0000 7f2493fff700 1 --2- 172.21.15.80:0/2960663627 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f24940a3cd0 0x7f24940a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:02.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.282+0000 7f24aad9d700 1 --2- 172.21.15.80:0/2960663627 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f24940a3cd0 0x7f24940a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:02.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.282+0000 7f2493fff700 1 -- 172.21.15.80:0/2960663627 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f24a00cff50 con 0x7f24ac102f60 2024-04-26T18:34:02.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.282+0000 7f24aad9d700 1 --2- 172.21.15.80:0/2960663627 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f24940a3cd0 0x7f24940a6190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f249c007be0 tx=0x7f249c0073d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:02.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.286+0000 7f2493fff700 1 -- 172.21.15.80:0/2960663627 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f24a009c7a0 con 0x7f24ac102f60 2024-04-26T18:34:02.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.496+0000 7f24b1084700 1 -- 172.21.15.80:0/2960663627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f24ac02e490 con 0x7f24ac102f60 2024-04-26T18:34:02.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.498+0000 7f2493fff700 1 -- 172.21.15.80:0/2960663627 <== mon.2 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+22533 (secure 0 0 0) 0x7f24a009c0a0 con 0x7f24ac102f60 2024-04-26T18:34:02.498 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:34:02.499 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":91,"fsid":"2187ca98-03fa-11ef-bc93-c7b262605968","created":"2024-04-26T18:24:58.809431+0000","modified":"2024-04-26T18:33:51.637301+0000","last_up_change":"2024-04-26T18:32:02.550187+0000","last_in_change":"2024-04-26T18:31:41.630932+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T18:28:14.502290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T18:33:02.102135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T18:33:05.300979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a01cfe6-d13a-4828-8c20-ad7fee7e87ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6803","nonce":429487384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6805","nonce":429487384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6809","nonce":429487384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6807","nonce":429487384}]},"public_addr":"172.21.15.80:6803/429487384","cluster_addr":"172.21.15.80:6805/429487384","heartbeat_back_addr":"172.21.15.80:6809/429487384","heartbeat_front_addr":"172.21.15.80:6807/429487384","state":["exists","up"]},{"osd":1,"uuid":"1f815d88-30b1-4540-b4f5-cc3d62707318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913033849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913033849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913033849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913033849}]},"public_addr":"172.21.15.82:6801/3913033849","cluster_addr":"172.21.15.82:6803/3913033849","heartbeat_back_addr":"172.21.15.82:6807/3913033849","heartbeat_front_addr":"172.21.15.82:6805/3913033849","state":["exists","up"]},{"osd":2,"uuid":"b8625dd7-4c1d-4258-ac2b-463ff96f4cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6801","nonce":503427508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6803","nonce":503427508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6807","nonce":503427508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6805","nonce":503427508}]},"public_addr":"172.21.15.192:6801/503427508","cluster_addr":"172.21.15.192:6803/503427508","heartbeat_back_addr":"172.21.15.192:6807/503427508","heartbeat_front_addr":"172.21.15.192:6805/503427508","state":["exists","up"]},{"osd":3,"uuid":"3068321a-3070-44ae-9bbd-a3faac8c21fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6811","nonce":407817066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6813","nonce":407817066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6817","nonce":407817066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6815","nonce":407817066}]},"public_addr":"172.21.15.80:6811/407817066","cluster_addr":"172.21.15.80:6813/407817066","heartbeat_back_addr":"172.21.15.80:6817/407817066","heartbeat_front_addr":"172.21.15.80:6815/407817066","state":["exists","up"]},{"osd":4,"uuid":"6b3d6455-9495-435b-8193-a260b63504ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6809","nonce":2068291934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6811","nonce":2068291934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6815","nonce":2068291934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6813","nonce":2068291934}]},"public_addr":"172.21.15.82:6809/2068291934","cluster_addr":"172.21.15.82:6811/2068291934","heartbeat_back_addr":"172.21.15.82:6815/2068291934","heartbeat_front_addr":"172.21.15.82:6813/2068291934","state":["exists","up"]},{"osd":5,"uuid":"538863f1-1486-45b5-a675-ecb1d3035599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6809","nonce":1770809727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6811","nonce":1770809727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6815","nonce":1770809727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6813","nonce":1770809727}]},"public_addr":"172.21.15.192:6809/1770809727","cluster_addr":"172.21.15.192:6811/1770809727","heartbeat_back_addr":"172.21.15.192:6815/1770809727","heartbeat_front_addr":"172.21.15.192:6813/1770809727","state":["exists","up"]},{"osd":6,"uuid":"7b4374d8-98e6-48e1-924b-c9b70a4baf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6819","nonce":145064490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6821","nonce":145064490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6825","nonce":145064490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6823","nonce":145064490}]},"public_addr":"172.21.15.80:6819/145064490","cluster_addr":"172.21.15.80:6821/145064490","heartbeat_back_addr":"172.21.15.80:6825/145064490","heartbeat_front_addr":"172.21.15.80:6823/145064490","state":["exists","up"]},{"osd":7,"uuid":"f3bb3c7d-4cce-4f49-b924-72ebbaad58ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6817","nonce":208047447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6819","nonce":208047447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6823","nonce":208047447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6821","nonce":208047447}]},"public_addr":"172.21.15.82:6817/208047447","cluster_addr":"172.21.15.82:6819/208047447","heartbeat_back_addr":"172.21.15.82:6823/208047447","heartbeat_front_addr":"172.21.15.82:6821/208047447","state":["exists","up"]},{"osd":8,"uuid":"6557b536-a516-4b01-a607-7981620fb2a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6817","nonce":3763069187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6819","nonce":3763069187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6823","nonce":3763069187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6821","nonce":3763069187}]},"public_addr":"172.21.15.192:6817/3763069187","cluster_addr":"172.21.15.192:6819/3763069187","heartbeat_back_addr":"172.21.15.192:6823/3763069187","heartbeat_front_addr":"172.21.15.192:6821/3763069187","state":["exists","up"]},{"osd":9,"uuid":"838615a7-1e68-4e81-8b3a-fba0ea75f7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6827","nonce":2109877993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6829","nonce":2109877993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6833","nonce":2109877993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6831","nonce":2109877993}]},"public_addr":"172.21.15.80:6827/2109877993","cluster_addr":"172.21.15.80:6829/2109877993","heartbeat_back_addr":"172.21.15.80:6833/2109877993","heartbeat_front_addr":"172.21.15.80:6831/2109877993","state":["exists","up"]},{"osd":10,"uuid":"cd664e50-3217-453d-9a89-6e26d717e6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6825","nonce":2877220993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6827","nonce":2877220993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6831","nonce":2877220993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6829","nonce":2877220993}]},"public_addr":"172.21.15.82:6825/2877220993","cluster_addr":"172.21.15.82:6827/2877220993","heartbeat_back_addr":"172.21.15.82:6831/2877220993","heartbeat_front_addr":"172.21.15.82:6829/2877220993","state":["exists","up"]},{"osd":11,"uuid":"e52807c6-8890-4df7-a8c6-51a7ff4b467b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6825","nonce":3466865106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6827","nonce":3466865106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6831","nonce":3466865106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6829","nonce":3466865106}]},"public_addr":"172.21.15.192:6825/3466865106","cluster_addr":"172.21.15.192:6827/3466865106","heartbeat_back_addr":"172.21.15.192:6831/3466865106","heartbeat_front_addr":"172.21.15.192:6829/3466865106","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:27:23.385471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:27:46.648232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:10.578970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:34.922048+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:59.142838+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:29:24.492250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:29:49.721803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:30:15.177027+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:30:41.544775+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:31:07.562401+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:31:33.498042+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:32:00.584085+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/1997155783":"2024-04-27T18:25:50.413207+0000","172.21.15.80:0/323607684":"2024-04-27T18:25:50.413207+0000","172.21.15.80:0/586397709":"2024-04-27T18:25:50.413207+0000","172.21.15.80:6801/4208962819":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/1353083127":"2024-04-27T18:25:24.440373+0000","172.21.15.80:6800/1997155783":"2024-04-27T18:25:50.413207+0000","172.21.15.80:6800/4208962819":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2644175019":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/1853513470":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2122929159":"2024-04-27T18:25:50.413207+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T18:34:02.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.500+0000 7f24b1084700 1 -- 172.21.15.80:0/2960663627 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f24940a3cd0 msgr2=0x7f24940a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:02.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.500+0000 7f24b1084700 1 --2- 172.21.15.80:0/2960663627 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f24940a3cd0 0x7f24940a6190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f249c007be0 tx=0x7f249c0073d0 comp rx=0 tx=0).stop 2024-04-26T18:34:02.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.500+0000 7f24b1084700 1 -- 172.21.15.80:0/2960663627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24ac102f60 msgr2=0x7f24ac19ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:02.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.500+0000 7f24b1084700 1 --2- 172.21.15.80:0/2960663627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24ac102f60 0x7f24ac19ec00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f24a000d950 tx=0x7f24a000dc60 comp rx=0 tx=0).stop 2024-04-26T18:34:02.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.500+0000 7f24b1084700 1 -- 172.21.15.80:0/2960663627 shutdown_connections 2024-04-26T18:34:02.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.500+0000 7f24b1084700 1 --2- 172.21.15.80:0/2960663627 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f24940a3cd0 0x7f24940a6190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:02.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.500+0000 7f24b1084700 1 --2- 172.21.15.80:0/2960663627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24ac107640 0x7f24ac198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:02.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.500+0000 7f24b1084700 1 --2- 172.21.15.80:0/2960663627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24ac1025b0 0x7f24ac19e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:02.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.500+0000 7f24b1084700 1 --2- 172.21.15.80:0/2960663627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24ac102f60 0x7f24ac19ec00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:02.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.500+0000 7f24b1084700 1 -- 172.21.15.80:0/2960663627 >> 172.21.15.80:0/2960663627 conn(0x7f24ac0792f0 msgr2=0x7f24ac100400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:02.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.501+0000 7f24b1084700 1 -- 172.21.15.80:0/2960663627 shutdown_connections 2024-04-26T18:34:02.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:02.501+0000 7f24b1084700 1 -- 172.21.15.80:0/2960663627 wait complete. 2024-04-26T18:34:03.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:02 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:34:03.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:02 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:34:03.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:02 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:34:03.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:02 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:34:03.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:02 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2960663627' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:34:03.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:02 smithi080 ceph-mon[29135]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 659 B/s wr, 9 op/s; 63 B/s, 1 objects/s recovering 2024-04-26T18:34:03.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:02 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:34:03.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:02 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:34:03.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:02 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:34:03.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:02 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:34:03.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:02 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/2960663627' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:34:03.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:02 smithi192 ceph-mon[32842]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 659 B/s wr, 9 op/s; 63 B/s, 1 objects/s recovering 2024-04-26T18:34:03.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:02 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:34:03.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:02 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:34:03.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:02 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:34:03.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:02 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:34:03.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:02 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/2960663627' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:34:03.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:02 smithi082 ceph-mon[32808]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 659 B/s wr, 9 op/s; 63 B/s, 1 objects/s recovering 2024-04-26T18:34:03.621 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-26T18:34:03.622 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T18:34:03.885 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:05.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.487+0000 7fcf6ca87700 1 -- 172.21.15.80:0/3110706800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf68102320 msgr2=0x7fcf681027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:05.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.487+0000 7fcf6ca87700 1 --2- 172.21.15.80:0/3110706800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf68102320 0x7fcf681027a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c009990 tx=0x7fcf5c009ca0 comp rx=0 tx=0).stop 2024-04-26T18:34:05.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.487+0000 7fcf6ca87700 1 -- 172.21.15.80:0/3110706800 shutdown_connections 2024-04-26T18:34:05.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.487+0000 7fcf6ca87700 1 --2- 172.21.15.80:0/3110706800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf68102ce0 0x7fcf6810f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:05.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.487+0000 7fcf6ca87700 1 --2- 172.21.15.80:0/3110706800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf68108390 0x7fcf68108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:05.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.487+0000 7fcf6ca87700 1 --2- 172.21.15.80:0/3110706800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf68102320 0x7fcf681027a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:05.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.487+0000 7fcf6ca87700 1 -- 172.21.15.80:0/3110706800 >> 172.21.15.80:0/3110706800 conn(0x7fcf680792d0 msgr2=0x7fcf680796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:05.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.487+0000 7fcf6ca87700 1 -- 172.21.15.80:0/3110706800 shutdown_connections 2024-04-26T18:34:05.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.487+0000 7fcf6ca87700 1 -- 172.21.15.80:0/3110706800 wait complete. 2024-04-26T18:34:05.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.488+0000 7fcf6ca87700 1 Processor -- start 2024-04-26T18:34:05.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.488+0000 7fcf6ca87700 1 -- start start 2024-04-26T18:34:05.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.488+0000 7fcf6ca87700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf68102320 0x7fcf6819e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:05.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.488+0000 7fcf6ca87700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf68102ce0 0x7fcf6819ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:05.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.488+0000 7fcf6ca87700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf68108390 0x7fcf68198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:05.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.488+0000 7fcf6ca87700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcf68112530 con 0x7fcf68102ce0 2024-04-26T18:34:05.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.488+0000 7fcf6ca87700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcf681123b0 con 0x7fcf68102320 2024-04-26T18:34:05.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.488+0000 7fcf6ca87700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcf681126b0 con 0x7fcf68108390 2024-04-26T18:34:05.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.488+0000 7fcf65d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf68102ce0 0x7fcf6819ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:05.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.488+0000 7fcf65d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf68102ce0 0x7fcf6819ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53874/0 (socket says 172.21.15.80:53874) 2024-04-26T18:34:05.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.488+0000 7fcf65d9b700 1 -- 172.21.15.80:0/3867654387 learned_addr learned my addr 172.21.15.80:0/3867654387 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:05.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.488+0000 7fcf6659c700 1 --2- 172.21.15.80:0/3867654387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf68102320 0x7fcf6819e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:05.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.488+0000 7fcf66d9d700 1 --2- 172.21.15.80:0/3867654387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf68108390 0x7fcf68198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:05.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.489+0000 7fcf65d9b700 1 -- 172.21.15.80:0/3867654387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf68108390 msgr2=0x7fcf68198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:05.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.489+0000 7fcf65d9b700 1 --2- 172.21.15.80:0/3867654387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf68108390 0x7fcf68198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:05.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.489+0000 7fcf65d9b700 1 -- 172.21.15.80:0/3867654387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf68102320 msgr2=0x7fcf6819e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:05.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.489+0000 7fcf65d9b700 1 --2- 172.21.15.80:0/3867654387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf68102320 0x7fcf6819e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:05.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.489+0000 7fcf65d9b700 1 -- 172.21.15.80:0/3867654387 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf68199030 con 0x7fcf68102ce0 2024-04-26T18:34:05.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.489+0000 7fcf6659c700 1 --2- 172.21.15.80:0/3867654387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf68102320 0x7fcf6819e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:34:05.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.489+0000 7fcf66d9d700 1 --2- 172.21.15.80:0/3867654387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf68108390 0x7fcf68198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:34:05.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.489+0000 7fcf65d9b700 1 --2- 172.21.15.80:0/3867654387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf68102ce0 0x7fcf6819ec10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c000c00 tx=0x7fcf5c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:05.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.489+0000 7fcf577fe700 1 -- 172.21.15.80:0/3867654387 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c027070 con 0x7fcf68102ce0 2024-04-26T18:34:05.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.489+0000 7fcf6ca87700 1 -- 172.21.15.80:0/3867654387 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf681992c0 con 0x7fcf68102ce0 2024-04-26T18:34:05.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.489+0000 7fcf577fe700 1 -- 172.21.15.80:0/3867654387 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf5c022470 con 0x7fcf68102ce0 2024-04-26T18:34:05.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.489+0000 7fcf577fe700 1 -- 172.21.15.80:0/3867654387 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c017650 con 0x7fcf68102ce0 2024-04-26T18:34:05.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.489+0000 7fcf6ca87700 1 -- 172.21.15.80:0/3867654387 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf681a5530 con 0x7fcf68102ce0 2024-04-26T18:34:05.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.490+0000 7fcf6ca87700 1 -- 172.21.15.80:0/3867654387 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf68103a40 con 0x7fcf68102ce0 2024-04-26T18:34:05.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.491+0000 7fcf577fe700 1 -- 172.21.15.80:0/3867654387 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fcf5c02a070 con 0x7fcf68102ce0 2024-04-26T18:34:05.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.492+0000 7fcf577fe700 1 --2- 172.21.15.80:0/3867654387 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fcf500a3cd0 0x7fcf500a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:05.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.492+0000 7fcf6659c700 1 --2- 172.21.15.80:0/3867654387 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fcf500a3cd0 0x7fcf500a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:05.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.492+0000 7fcf577fe700 1 -- 172.21.15.80:0/3867654387 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fcf5c0d1390 con 0x7fcf68102ce0 2024-04-26T18:34:05.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.492+0000 7fcf6659c700 1 --2- 172.21.15.80:0/3867654387 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fcf500a3cd0 0x7fcf500a6190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009cb0 tx=0x7fcf58009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:05.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.496+0000 7fcf577fe700 1 -- 172.21.15.80:0/3867654387 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcf5c013070 con 0x7fcf68102ce0 2024-04-26T18:34:05.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.751+0000 7fcf6ca87700 1 -- 172.21.15.80:0/3867654387 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf6802e490 con 0x7fcf68102ce0 2024-04-26T18:34:05.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.753+0000 7fcf577fe700 1 -- 172.21.15.80:0/3867654387 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+22533 (secure 0 0 0) 0x7fcf5c09dcd0 con 0x7fcf68102ce0 2024-04-26T18:34:05.753 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:34:05.754 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":91,"fsid":"2187ca98-03fa-11ef-bc93-c7b262605968","created":"2024-04-26T18:24:58.809431+0000","modified":"2024-04-26T18:33:51.637301+0000","last_up_change":"2024-04-26T18:32:02.550187+0000","last_in_change":"2024-04-26T18:31:41.630932+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T18:28:14.502290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T18:33:02.102135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T18:33:05.300979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a01cfe6-d13a-4828-8c20-ad7fee7e87ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6803","nonce":429487384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6805","nonce":429487384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6809","nonce":429487384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6807","nonce":429487384}]},"public_addr":"172.21.15.80:6803/429487384","cluster_addr":"172.21.15.80:6805/429487384","heartbeat_back_addr":"172.21.15.80:6809/429487384","heartbeat_front_addr":"172.21.15.80:6807/429487384","state":["exists","up"]},{"osd":1,"uuid":"1f815d88-30b1-4540-b4f5-cc3d62707318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913033849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913033849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913033849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913033849}]},"public_addr":"172.21.15.82:6801/3913033849","cluster_addr":"172.21.15.82:6803/3913033849","heartbeat_back_addr":"172.21.15.82:6807/3913033849","heartbeat_front_addr":"172.21.15.82:6805/3913033849","state":["exists","up"]},{"osd":2,"uuid":"b8625dd7-4c1d-4258-ac2b-463ff96f4cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6801","nonce":503427508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6803","nonce":503427508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6807","nonce":503427508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6805","nonce":503427508}]},"public_addr":"172.21.15.192:6801/503427508","cluster_addr":"172.21.15.192:6803/503427508","heartbeat_back_addr":"172.21.15.192:6807/503427508","heartbeat_front_addr":"172.21.15.192:6805/503427508","state":["exists","up"]},{"osd":3,"uuid":"3068321a-3070-44ae-9bbd-a3faac8c21fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6811","nonce":407817066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6813","nonce":407817066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6817","nonce":407817066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6815","nonce":407817066}]},"public_addr":"172.21.15.80:6811/407817066","cluster_addr":"172.21.15.80:6813/407817066","heartbeat_back_addr":"172.21.15.80:6817/407817066","heartbeat_front_addr":"172.21.15.80:6815/407817066","state":["exists","up"]},{"osd":4,"uuid":"6b3d6455-9495-435b-8193-a260b63504ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6809","nonce":2068291934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6811","nonce":2068291934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6815","nonce":2068291934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6813","nonce":2068291934}]},"public_addr":"172.21.15.82:6809/2068291934","cluster_addr":"172.21.15.82:6811/2068291934","heartbeat_back_addr":"172.21.15.82:6815/2068291934","heartbeat_front_addr":"172.21.15.82:6813/2068291934","state":["exists","up"]},{"osd":5,"uuid":"538863f1-1486-45b5-a675-ecb1d3035599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6809","nonce":1770809727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6811","nonce":1770809727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6815","nonce":1770809727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6813","nonce":1770809727}]},"public_addr":"172.21.15.192:6809/1770809727","cluster_addr":"172.21.15.192:6811/1770809727","heartbeat_back_addr":"172.21.15.192:6815/1770809727","heartbeat_front_addr":"172.21.15.192:6813/1770809727","state":["exists","up"]},{"osd":6,"uuid":"7b4374d8-98e6-48e1-924b-c9b70a4baf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6819","nonce":145064490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6821","nonce":145064490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6825","nonce":145064490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6823","nonce":145064490}]},"public_addr":"172.21.15.80:6819/145064490","cluster_addr":"172.21.15.80:6821/145064490","heartbeat_back_addr":"172.21.15.80:6825/145064490","heartbeat_front_addr":"172.21.15.80:6823/145064490","state":["exists","up"]},{"osd":7,"uuid":"f3bb3c7d-4cce-4f49-b924-72ebbaad58ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6817","nonce":208047447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6819","nonce":208047447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6823","nonce":208047447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6821","nonce":208047447}]},"public_addr":"172.21.15.82:6817/208047447","cluster_addr":"172.21.15.82:6819/208047447","heartbeat_back_addr":"172.21.15.82:6823/208047447","heartbeat_front_addr":"172.21.15.82:6821/208047447","state":["exists","up"]},{"osd":8,"uuid":"6557b536-a516-4b01-a607-7981620fb2a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6817","nonce":3763069187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6819","nonce":3763069187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6823","nonce":3763069187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6821","nonce":3763069187}]},"public_addr":"172.21.15.192:6817/3763069187","cluster_addr":"172.21.15.192:6819/3763069187","heartbeat_back_addr":"172.21.15.192:6823/3763069187","heartbeat_front_addr":"172.21.15.192:6821/3763069187","state":["exists","up"]},{"osd":9,"uuid":"838615a7-1e68-4e81-8b3a-fba0ea75f7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6827","nonce":2109877993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6829","nonce":2109877993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6833","nonce":2109877993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6831","nonce":2109877993}]},"public_addr":"172.21.15.80:6827/2109877993","cluster_addr":"172.21.15.80:6829/2109877993","heartbeat_back_addr":"172.21.15.80:6833/2109877993","heartbeat_front_addr":"172.21.15.80:6831/2109877993","state":["exists","up"]},{"osd":10,"uuid":"cd664e50-3217-453d-9a89-6e26d717e6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6825","nonce":2877220993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6827","nonce":2877220993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6831","nonce":2877220993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6829","nonce":2877220993}]},"public_addr":"172.21.15.82:6825/2877220993","cluster_addr":"172.21.15.82:6827/2877220993","heartbeat_back_addr":"172.21.15.82:6831/2877220993","heartbeat_front_addr":"172.21.15.82:6829/2877220993","state":["exists","up"]},{"osd":11,"uuid":"e52807c6-8890-4df7-a8c6-51a7ff4b467b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6825","nonce":3466865106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6827","nonce":3466865106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6831","nonce":3466865106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6829","nonce":3466865106}]},"public_addr":"172.21.15.192:6825/3466865106","cluster_addr":"172.21.15.192:6827/3466865106","heartbeat_back_addr":"172.21.15.192:6831/3466865106","heartbeat_front_addr":"172.21.15.192:6829/3466865106","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:27:23.385471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:27:46.648232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:10.578970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:34.922048+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:59.142838+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:29:24.492250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:29:49.721803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:30:15.177027+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:30:41.544775+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:31:07.562401+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:31:33.498042+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:32:00.584085+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/1997155783":"2024-04-27T18:25:50.413207+0000","172.21.15.80:0/323607684":"2024-04-27T18:25:50.413207+0000","172.21.15.80:0/586397709":"2024-04-27T18:25:50.413207+0000","172.21.15.80:6801/4208962819":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/1353083127":"2024-04-27T18:25:24.440373+0000","172.21.15.80:6800/1997155783":"2024-04-27T18:25:50.413207+0000","172.21.15.80:6800/4208962819":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2644175019":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/1853513470":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2122929159":"2024-04-27T18:25:50.413207+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T18:34:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.755+0000 7fcf6ca87700 1 -- 172.21.15.80:0/3867654387 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fcf500a3cd0 msgr2=0x7fcf500a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.755+0000 7fcf6ca87700 1 --2- 172.21.15.80:0/3867654387 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fcf500a3cd0 0x7fcf500a6190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009cb0 tx=0x7fcf58009260 comp rx=0 tx=0).stop 2024-04-26T18:34:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.755+0000 7fcf6ca87700 1 -- 172.21.15.80:0/3867654387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf68102ce0 msgr2=0x7fcf6819ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.755+0000 7fcf6ca87700 1 --2- 172.21.15.80:0/3867654387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf68102ce0 0x7fcf6819ec10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c000c00 tx=0x7fcf5c009580 comp rx=0 tx=0).stop 2024-04-26T18:34:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.755+0000 7fcf6ca87700 1 -- 172.21.15.80:0/3867654387 shutdown_connections 2024-04-26T18:34:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.755+0000 7fcf6ca87700 1 --2- 172.21.15.80:0/3867654387 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fcf500a3cd0 0x7fcf500a6190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.756+0000 7fcf6ca87700 1 --2- 172.21.15.80:0/3867654387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf68108390 0x7fcf68198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.756+0000 7fcf6ca87700 1 --2- 172.21.15.80:0/3867654387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf68102320 0x7fcf6819e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.756+0000 7fcf6ca87700 1 --2- 172.21.15.80:0/3867654387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf68102ce0 0x7fcf6819ec10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.756+0000 7fcf6ca87700 1 -- 172.21.15.80:0/3867654387 >> 172.21.15.80:0/3867654387 conn(0x7fcf680792d0 msgr2=0x7fcf68100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.756+0000 7fcf6ca87700 1 -- 172.21.15.80:0/3867654387 shutdown_connections 2024-04-26T18:34:05.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:05.756+0000 7fcf6ca87700 1 -- 172.21.15.80:0/3867654387 wait complete. 2024-04-26T18:34:05.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:05 smithi192 ceph-mon[32842]: pgmap v328: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 597 B/s wr, 9 op/s; 57 B/s, 0 objects/s recovering 2024-04-26T18:34:05.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:05 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:34:05.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:05 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:34:05.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:05 smithi082 ceph-mon[32808]: pgmap v328: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 597 B/s wr, 9 op/s; 57 B/s, 0 objects/s recovering 2024-04-26T18:34:05.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:05 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:34:05.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:05 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:34:05.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:05 smithi080 ceph-mon[29135]: pgmap v328: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 597 B/s wr, 9 op/s; 57 B/s, 0 objects/s recovering 2024-04-26T18:34:05.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:05 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:34:05.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:05 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:34:06.470 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-26T18:34:06.470 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-26T18:34:06.471 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-26T18:34:06.471 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-26T18:34:06.472 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-26T18:34:06.472 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-26T18:34:06.473 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-04-26T18:34:06.473 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-04-26T18:34:06.474 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-04-26T18:34:06.474 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-04-26T18:34:06.475 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-04-26T18:34:06.475 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-04-26T18:34:06.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:34:06.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:34:06.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:34:06.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:06 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3867654387' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:34:06.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:06 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:34:06.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:06 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:34:06.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:06 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:34:06.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:06 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3867654387' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:34:06.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:06 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:34:06.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:06 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:34:06.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:06 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:34:06.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:06 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3867654387' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:34:07.095 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:07.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:07 smithi192 ceph-mon[32842]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 597 B/s wr, 10 op/s; 55 B/s, 0 objects/s recovering 2024-04-26T18:34:07.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:07 smithi082 ceph-mon[32808]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 597 B/s wr, 10 op/s; 55 B/s, 0 objects/s recovering 2024-04-26T18:34:07.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:07 smithi080 ceph-mon[29135]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 597 B/s wr, 10 op/s; 55 B/s, 0 objects/s recovering 2024-04-26T18:34:08.304 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:08.312 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:08.312 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:08.316 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:08.316 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:08.317 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:08.318 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:08.319 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:08.322 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:08.323 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:08.331 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:09.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:09 smithi080 ceph-mon[29135]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:34:09.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:09 smithi192 ceph-mon[32842]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:34:09.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:09 smithi082 ceph-mon[32808]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:34:11.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:11 smithi192 ceph-mon[32842]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:34:11.876 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:11 smithi080 ceph-mon[29135]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:34:11.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:11 smithi082 ceph-mon[32808]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:34:13.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:13 smithi080 ceph-mon[29135]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:34:13.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:13 smithi192 ceph-mon[32842]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:34:13.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:13 smithi082 ceph-mon[32808]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:34:15.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:15 smithi080 ceph-mon[29135]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:34:15.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:15 smithi192 ceph-mon[32842]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:34:15.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:15 smithi082 ceph-mon[32808]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:34:17.849 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:17 smithi080 ceph-mon[29135]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:34:17.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:17 smithi192 ceph-mon[32842]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:34:17.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:17 smithi082 ceph-mon[32808]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:34:18.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.057+0000 7f8e1847e700 1 -- 172.21.15.80:0/3527005486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e10102310 msgr2=0x7f8e10102790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:18.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.057+0000 7f8e1847e700 1 --2- 172.21.15.80:0/3527005486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e10102310 0x7f8e10102790 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009990 tx=0x7f8e00009ca0 comp rx=0 tx=0).stop 2024-04-26T18:34:18.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.058+0000 7f8e1847e700 1 -- 172.21.15.80:0/3527005486 shutdown_connections 2024-04-26T18:34:18.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.058+0000 7f8e1847e700 1 --2- 172.21.15.80:0/3527005486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e10102cd0 0x7f8e1010f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:18.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.058+0000 7f8e1847e700 1 --2- 172.21.15.80:0/3527005486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e10108380 0x7f8e10108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:18.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.058+0000 7f8e1847e700 1 --2- 172.21.15.80:0/3527005486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e10102310 0x7f8e10102790 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:18.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.058+0000 7f8e1847e700 1 -- 172.21.15.80:0/3527005486 >> 172.21.15.80:0/3527005486 conn(0x7f8e10079290 msgr2=0x7f8e100796a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:18.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.058+0000 7f8e1847e700 1 -- 172.21.15.80:0/3527005486 shutdown_connections 2024-04-26T18:34:18.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.058+0000 7f8e1847e700 1 -- 172.21.15.80:0/3527005486 wait complete. 2024-04-26T18:34:18.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.058+0000 7f8e1847e700 1 Processor -- start 2024-04-26T18:34:18.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.058+0000 7f8e1847e700 1 -- start start 2024-04-26T18:34:18.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.058+0000 7f8e1847e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e10102310 0x7f8e1019e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:18.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.058+0000 7f8e1847e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e10102cd0 0x7f8e1019ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:18.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.058+0000 7f8e1847e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e10108380 0x7f8e10198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:18.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.058+0000 7f8e1847e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8e101125a0 con 0x7f8e10102cd0 2024-04-26T18:34:18.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.058+0000 7f8e1847e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8e10112420 con 0x7f8e10102310 2024-04-26T18:34:18.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.058+0000 7f8e1847e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8e10112720 con 0x7f8e10108380 2024-04-26T18:34:18.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.058+0000 7f8e15a19700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e10102cd0 0x7f8e1019ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:18.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.059+0000 7f8e15a19700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e10102cd0 0x7f8e1019ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39190/0 (socket says 172.21.15.80:39190) 2024-04-26T18:34:18.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.059+0000 7f8e15a19700 1 -- 172.21.15.80:0/2885020805 learned_addr learned my addr 172.21.15.80:0/2885020805 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:18.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.059+0000 7f8e1621a700 1 --2- 172.21.15.80:0/2885020805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e10102310 0x7f8e1019e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:18.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.059+0000 7f8e15a19700 1 -- 172.21.15.80:0/2885020805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e10108380 msgr2=0x7f8e10198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:18.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.059+0000 7f8e15a19700 1 --2- 172.21.15.80:0/2885020805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e10108380 0x7f8e10198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:18.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.059+0000 7f8e15a19700 1 -- 172.21.15.80:0/2885020805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e10102310 msgr2=0x7f8e1019e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:18.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.059+0000 7f8e15a19700 1 --2- 172.21.15.80:0/2885020805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e10102310 0x7f8e1019e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:18.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.059+0000 7f8e15a19700 1 -- 172.21.15.80:0/2885020805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e101990e0 con 0x7f8e10102cd0 2024-04-26T18:34:18.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.059+0000 7f8e1621a700 1 --2- 172.21.15.80:0/2885020805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e10102310 0x7f8e1019e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:34:18.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.059+0000 7f8e15a19700 1 --2- 172.21.15.80:0/2885020805 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e10102cd0 0x7f8e1019ed00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8e00000c00 tx=0x7f8e000047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:18.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.059+0000 7f8e077fe700 1 -- 172.21.15.80:0/2885020805 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e00027070 con 0x7f8e10102cd0 2024-04-26T18:34:18.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.059+0000 7f8e1847e700 1 -- 172.21.15.80:0/2885020805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e10199370 con 0x7f8e10102cd0 2024-04-26T18:34:18.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.059+0000 7f8e077fe700 1 -- 172.21.15.80:0/2885020805 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e000041d0 con 0x7f8e10102cd0 2024-04-26T18:34:18.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.059+0000 7f8e077fe700 1 -- 172.21.15.80:0/2885020805 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0000f460 con 0x7f8e10102cd0 2024-04-26T18:34:18.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.059+0000 7f8e1847e700 1 -- 172.21.15.80:0/2885020805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e101a5690 con 0x7f8e10102cd0 2024-04-26T18:34:18.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.060+0000 7f8e1847e700 1 -- 172.21.15.80:0/2885020805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8e10063b30 con 0x7f8e10102cd0 2024-04-26T18:34:18.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.061+0000 7f8e077fe700 1 -- 172.21.15.80:0/2885020805 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f8e0002a070 con 0x7f8e10102cd0 2024-04-26T18:34:18.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.062+0000 7f8e077fe700 1 --2- 172.21.15.80:0/2885020805 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8dfc0a3cd0 0x7f8dfc0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:18.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.062+0000 7f8e1621a700 1 --2- 172.21.15.80:0/2885020805 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8dfc0a3cd0 0x7f8dfc0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:18.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.062+0000 7f8e077fe700 1 -- 172.21.15.80:0/2885020805 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f8e000d1c30 con 0x7f8e10102cd0 2024-04-26T18:34:18.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.062+0000 7f8e077fe700 1 --2- 172.21.15.80:0/2885020805 >> [v2:172.21.15.82:6824/2877220993,v1:172.21.15.82:6825/2877220993] conn(0x7f8dfc0ad790 0x7f8dfc0afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:18.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.062+0000 7f8e077fe700 1 -- 172.21.15.80:0/2885020805 --> [v2:172.21.15.82:6824/2877220993,v1:172.21.15.82:6825/2877220993] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8e000043d0 con 0x7f8dfc0ad790 2024-04-26T18:34:18.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.062+0000 7f8e077fe700 1 -- 172.21.15.80:0/2885020805 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f8e000d2080 con 0x7f8e10102cd0 2024-04-26T18:34:18.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.062+0000 7f8e1621a700 1 --2- 172.21.15.80:0/2885020805 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8dfc0a3cd0 0x7f8dfc0a6190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8e10199ac0 tx=0x7f8e0c008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:18.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.062+0000 7f8e16a1b700 1 --2- 172.21.15.80:0/2885020805 >> [v2:172.21.15.82:6824/2877220993,v1:172.21.15.82:6825/2877220993] conn(0x7f8dfc0ad790 0x7f8dfc0afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:18.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.063+0000 7f8e16a1b700 1 --2- 172.21.15.80:0/2885020805 >> [v2:172.21.15.82:6824/2877220993,v1:172.21.15.82:6825/2877220993] conn(0x7f8dfc0ad790 0x7f8dfc0afc30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:18.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.064+0000 7f8e077fe700 1 -- 172.21.15.80:0/2885020805 <== osd.10 v2:172.21.15.82:6824/2877220993 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8e000043d0 con 0x7f8dfc0ad790 2024-04-26T18:34:18.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.081+0000 7f8e1847e700 1 -- 172.21.15.80:0/2885020805 --> [v2:172.21.15.82:6824/2877220993,v1:172.21.15.82:6825/2877220993] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8e10063f30 con 0x7f8dfc0ad790 2024-04-26T18:34:18.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.081+0000 7f8e077fe700 1 -- 172.21.15.80:0/2885020805 <== osd.10 v2:172.21.15.82:6824/2877220993 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8e10063f30 con 0x7f8dfc0ad790 2024-04-26T18:34:18.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.082+0000 7f8e1847e700 1 -- 172.21.15.80:0/2885020805 >> [v2:172.21.15.82:6824/2877220993,v1:172.21.15.82:6825/2877220993] conn(0x7f8dfc0ad790 msgr2=0x7f8dfc0afc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:18.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.082+0000 7f8e1847e700 1 --2- 172.21.15.80:0/2885020805 >> [v2:172.21.15.82:6824/2877220993,v1:172.21.15.82:6825/2877220993] conn(0x7f8dfc0ad790 0x7f8dfc0afc30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:18.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.082+0000 7f8e1847e700 1 -- 172.21.15.80:0/2885020805 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8dfc0a3cd0 msgr2=0x7f8dfc0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:18.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.082+0000 7f8e1847e700 1 --2- 172.21.15.80:0/2885020805 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8dfc0a3cd0 0x7f8dfc0a6190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8e10199ac0 tx=0x7f8e0c008040 comp rx=0 tx=0).stop 2024-04-26T18:34:18.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.082+0000 7f8e1847e700 1 -- 172.21.15.80:0/2885020805 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e10102cd0 msgr2=0x7f8e1019ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:18.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.082+0000 7f8e1847e700 1 --2- 172.21.15.80:0/2885020805 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e10102cd0 0x7f8e1019ed00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8e00000c00 tx=0x7f8e000047b0 comp rx=0 tx=0).stop 2024-04-26T18:34:18.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.082+0000 7f8e16a1b700 1 -- 172.21.15.80:0/2885020805 reap_dead start 2024-04-26T18:34:18.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.082+0000 7f8e1847e700 1 -- 172.21.15.80:0/2885020805 shutdown_connections 2024-04-26T18:34:18.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.082+0000 7f8e1847e700 1 -- 172.21.15.80:0/2885020805 >> 172.21.15.80:0/2885020805 conn(0x7f8e10079290 msgr2=0x7f8e10101080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:18.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.082+0000 7f8e1847e700 1 -- 172.21.15.80:0/2885020805 shutdown_connections 2024-04-26T18:34:18.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.082+0000 7f8e1847e700 1 -- 172.21.15.80:0/2885020805 wait complete. 2024-04-26T18:34:18.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.514+0000 7fceda9f3700 1 -- 172.21.15.80:0/1565381603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced4103e30 msgr2=0x7fced4110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:18.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.514+0000 7fceda9f3700 1 --2- 172.21.15.80:0/1565381603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced4103e30 0x7fced4110290 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcecc00b0a0 tx=0x7fcecc00b3b0 comp rx=0 tx=0).stop 2024-04-26T18:34:18.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.514+0000 7fceda9f3700 1 -- 172.21.15.80:0/1565381603 shutdown_connections 2024-04-26T18:34:18.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.514+0000 7fceda9f3700 1 --2- 172.21.15.80:0/1565381603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced4103e30 0x7fced4110290 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:18.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.514+0000 7fceda9f3700 1 --2- 172.21.15.80:0/1565381603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fced41094c0 0x7fced41098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:18.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.514+0000 7fceda9f3700 1 --2- 172.21.15.80:0/1565381603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fced4103470 0x7fced41038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:18.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.514+0000 7fceda9f3700 1 -- 172.21.15.80:0/1565381603 >> 172.21.15.80:0/1565381603 conn(0x7fced407a580 msgr2=0x7fced407a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:18.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.514+0000 7fceda9f3700 1 -- 172.21.15.80:0/1565381603 shutdown_connections 2024-04-26T18:34:18.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.514+0000 7fceda9f3700 1 -- 172.21.15.80:0/1565381603 wait complete. 2024-04-26T18:34:18.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.514+0000 7fceda9f3700 1 Processor -- start 2024-04-26T18:34:18.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.515+0000 7fceda9f3700 1 -- start start 2024-04-26T18:34:18.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.515+0000 7fceda9f3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fced4103470 0x7fced4074bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:18.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.515+0000 7fceda9f3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced4103e30 0x7fced4075100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:18.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.515+0000 7fceda9f3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fced41094c0 0x7fced406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:18.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.515+0000 7fceda9f3700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fced41135e0 con 0x7fced4103e30 2024-04-26T18:34:18.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.515+0000 7fceda9f3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fced4113460 con 0x7fced41094c0 2024-04-26T18:34:18.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.515+0000 7fceda9f3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fced4113760 con 0x7fced4103470 2024-04-26T18:34:18.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.515+0000 7fced37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced4103e30 0x7fced4075100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:18.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.515+0000 7fced37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced4103e30 0x7fced4075100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39218/0 (socket says 172.21.15.80:39218) 2024-04-26T18:34:18.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.515+0000 7fced37fe700 1 -- 172.21.15.80:0/485710618 learned_addr learned my addr 172.21.15.80:0/485710618 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:18.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.515+0000 7fced3fff700 1 --2- 172.21.15.80:0/485710618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fced4103470 0x7fced4074bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:18.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.516+0000 7fced8f90700 1 --2- 172.21.15.80:0/485710618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fced41094c0 0x7fced406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:18.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.516+0000 7fced37fe700 1 -- 172.21.15.80:0/485710618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fced4103470 msgr2=0x7fced4074bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:18.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.516+0000 7fced37fe700 1 --2- 172.21.15.80:0/485710618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fced4103470 0x7fced4074bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:18.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.516+0000 7fced37fe700 1 -- 172.21.15.80:0/485710618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fced41094c0 msgr2=0x7fced406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:18.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.516+0000 7fced37fe700 1 --2- 172.21.15.80:0/485710618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fced41094c0 0x7fced406de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:18.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.516+0000 7fced37fe700 1 -- 172.21.15.80:0/485710618 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced406e750 con 0x7fced4103e30 2024-04-26T18:34:18.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.516+0000 7fced37fe700 1 --2- 172.21.15.80:0/485710618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced4103e30 0x7fced4075100 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcec800d950 tx=0x7fcec800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:18.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.516+0000 7fced17fa700 1 -- 172.21.15.80:0/485710618 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec8016070 con 0x7fced4103e30 2024-04-26T18:34:18.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.516+0000 7fceda9f3700 1 -- 172.21.15.80:0/485710618 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced406ea40 con 0x7fced4103e30 2024-04-26T18:34:18.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.516+0000 7fced17fa700 1 -- 172.21.15.80:0/485710618 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcec800fd40 con 0x7fced4103e30 2024-04-26T18:34:18.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.516+0000 7fced17fa700 1 -- 172.21.15.80:0/485710618 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec800e3b0 con 0x7fced4103e30 2024-04-26T18:34:18.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.516+0000 7fceda9f3700 1 -- 172.21.15.80:0/485710618 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced4072a10 con 0x7fced4103e30 2024-04-26T18:34:18.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.517+0000 7fceda9f3700 1 -- 172.21.15.80:0/485710618 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fced4072f40 con 0x7fced4103e30 2024-04-26T18:34:18.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.518+0000 7fced17fa700 1 -- 172.21.15.80:0/485710618 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fcec8019070 con 0x7fced4103e30 2024-04-26T18:34:18.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.519+0000 7fced17fa700 1 --2- 172.21.15.80:0/485710618 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fcebc0a3cd0 0x7fcebc0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:18.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.519+0000 7fced3fff700 1 --2- 172.21.15.80:0/485710618 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fcebc0a3cd0 0x7fcebc0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:18.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.519+0000 7fced17fa700 1 -- 172.21.15.80:0/485710618 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fcec80cff70 con 0x7fced4103e30 2024-04-26T18:34:18.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.519+0000 7fced17fa700 1 --2- 172.21.15.80:0/485710618 >> [v2:172.21.15.192:6800/503427508,v1:172.21.15.192:6801/503427508] conn(0x7fcebc0ad790 0x7fcebc0afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:18.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.519+0000 7fced17fa700 1 -- 172.21.15.80:0/485710618 --> [v2:172.21.15.192:6800/503427508,v1:172.21.15.192:6801/503427508] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcebc0b0300 con 0x7fcebc0ad790 2024-04-26T18:34:18.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.519+0000 7fced17fa700 1 -- 172.21.15.80:0/485710618 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fcec80d7050 con 0x7fced4103e30 2024-04-26T18:34:18.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.519+0000 7fced3fff700 1 --2- 172.21.15.80:0/485710618 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fcebc0a3cd0 0x7fcebc0a6190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcec40045b0 tx=0x7fcec400b3c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:18.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.519+0000 7fced8f90700 1 --2- 172.21.15.80:0/485710618 >> [v2:172.21.15.192:6800/503427508,v1:172.21.15.192:6801/503427508] conn(0x7fcebc0ad790 0x7fcebc0afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:18.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.520+0000 7fced8f90700 1 --2- 172.21.15.80:0/485710618 >> [v2:172.21.15.192:6800/503427508,v1:172.21.15.192:6801/503427508] conn(0x7fcebc0ad790 0x7fcebc0afc30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:18.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.521+0000 7fced17fa700 1 -- 172.21.15.80:0/485710618 <== osd.2 v2:172.21.15.192:6800/503427508 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcebc0b0300 con 0x7fcebc0ad790 2024-04-26T18:34:18.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.537+0000 7fceda9f3700 1 -- 172.21.15.80:0/485710618 --> [v2:172.21.15.192:6800/503427508,v1:172.21.15.192:6801/503427508] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fced40733c0 con 0x7fcebc0ad790 2024-04-26T18:34:18.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.538+0000 7fced17fa700 1 -- 172.21.15.80:0/485710618 <== osd.2 v2:172.21.15.192:6800/503427508 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fced40733c0 con 0x7fcebc0ad790 2024-04-26T18:34:18.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.538+0000 7fceda9f3700 1 -- 172.21.15.80:0/485710618 >> [v2:172.21.15.192:6800/503427508,v1:172.21.15.192:6801/503427508] conn(0x7fcebc0ad790 msgr2=0x7fcebc0afc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:18.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.539+0000 7fceda9f3700 1 --2- 172.21.15.80:0/485710618 >> [v2:172.21.15.192:6800/503427508,v1:172.21.15.192:6801/503427508] conn(0x7fcebc0ad790 0x7fcebc0afc30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:18.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.539+0000 7fceda9f3700 1 -- 172.21.15.80:0/485710618 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fcebc0a3cd0 msgr2=0x7fcebc0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:18.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.539+0000 7fceda9f3700 1 --2- 172.21.15.80:0/485710618 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fcebc0a3cd0 0x7fcebc0a6190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcec40045b0 tx=0x7fcec400b3c0 comp rx=0 tx=0).stop 2024-04-26T18:34:18.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.539+0000 7fceda9f3700 1 -- 172.21.15.80:0/485710618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced4103e30 msgr2=0x7fced4075100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:18.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.539+0000 7fceda9f3700 1 --2- 172.21.15.80:0/485710618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced4103e30 0x7fced4075100 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcec800d950 tx=0x7fcec800dc60 comp rx=0 tx=0).stop 2024-04-26T18:34:18.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.539+0000 7fced8f90700 1 -- 172.21.15.80:0/485710618 reap_dead start 2024-04-26T18:34:18.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.539+0000 7fceda9f3700 1 -- 172.21.15.80:0/485710618 shutdown_connections 2024-04-26T18:34:18.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.539+0000 7fceda9f3700 1 -- 172.21.15.80:0/485710618 >> 172.21.15.80:0/485710618 conn(0x7fced407a580 msgr2=0x7fced4102170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:18.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.539+0000 7fceda9f3700 1 -- 172.21.15.80:0/485710618 shutdown_connections 2024-04-26T18:34:18.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:18.539+0000 7fceda9f3700 1 -- 172.21.15.80:0/485710618 wait complete. 2024-04-26T18:34:19.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:19 smithi192 ceph-mon[32842]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-26T18:34:19.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:19 smithi082 ceph-mon[32808]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-26T18:34:19.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:19 smithi080 ceph-mon[29135]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-26T18:34:20.646 INFO:teuthology.orchestra.run.smithi080.stdout:313532612644 2024-04-26T18:34:20.647 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-04-26T18:34:21.722 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:21 smithi080 ceph-mon[29135]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2024-04-26T18:34:21.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:21 smithi192 ceph-mon[32842]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2024-04-26T18:34:21.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:21 smithi082 ceph-mon[32808]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2024-04-26T18:34:22.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.005+0000 7f31163c2700 1 -- 172.21.15.80:0/709620330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3110102320 msgr2=0x7f31101027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:22.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.005+0000 7f31163c2700 1 --2- 172.21.15.80:0/709620330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3110102320 0x7f31101027a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3104009990 tx=0x7f3104009ca0 comp rx=0 tx=0).stop 2024-04-26T18:34:22.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.005+0000 7f31163c2700 1 -- 172.21.15.80:0/709620330 shutdown_connections 2024-04-26T18:34:22.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.005+0000 7f31163c2700 1 --2- 172.21.15.80:0/709620330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3110102ce0 0x7f311010f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:22.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.005+0000 7f31163c2700 1 --2- 172.21.15.80:0/709620330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3110108390 0x7f3110108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:22.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.005+0000 7f31163c2700 1 --2- 172.21.15.80:0/709620330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3110102320 0x7f31101027a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:22.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.005+0000 7f31163c2700 1 -- 172.21.15.80:0/709620330 >> 172.21.15.80:0/709620330 conn(0x7f31100792d0 msgr2=0x7f31100796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:22.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.005+0000 7f31163c2700 1 -- 172.21.15.80:0/709620330 shutdown_connections 2024-04-26T18:34:22.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.005+0000 7f31163c2700 1 -- 172.21.15.80:0/709620330 wait complete. 2024-04-26T18:34:22.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.005+0000 7f31163c2700 1 Processor -- start 2024-04-26T18:34:22.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.005+0000 7f31163c2700 1 -- start start 2024-04-26T18:34:22.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.006+0000 7f31163c2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3110102320 0x7f311019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:22.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.006+0000 7f31163c2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3110102ce0 0x7f311019af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:22.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.006+0000 7f31163c2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3110108390 0x7f31101a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:22.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.006+0000 7f31163c2700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3110112530 con 0x7f3110102ce0 2024-04-26T18:34:22.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.006+0000 7f31163c2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f31101123b0 con 0x7f3110108390 2024-04-26T18:34:22.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.006+0000 7f31163c2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f31101126b0 con 0x7f3110102320 2024-04-26T18:34:22.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.006+0000 7f310f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3110102ce0 0x7f311019af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:22.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.006+0000 7f310f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3110102ce0 0x7f311019af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39234/0 (socket says 172.21.15.80:39234) 2024-04-26T18:34:22.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.006+0000 7f310f7fe700 1 -- 172.21.15.80:0/2808412958 learned_addr learned my addr 172.21.15.80:0/2808412958 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:22.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.006+0000 7f311495f700 1 --2- 172.21.15.80:0/2808412958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3110108390 0x7f31101a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:22.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.006+0000 7f310ffff700 1 --2- 172.21.15.80:0/2808412958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3110102320 0x7f311019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:22.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.006+0000 7f310f7fe700 1 -- 172.21.15.80:0/2808412958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3110102320 msgr2=0x7f311019a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:22.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.006+0000 7f310f7fe700 1 --2- 172.21.15.80:0/2808412958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3110102320 0x7f311019a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:22.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.006+0000 7f310f7fe700 1 -- 172.21.15.80:0/2808412958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3110108390 msgr2=0x7f31101a5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:22.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.006+0000 7f310f7fe700 1 --2- 172.21.15.80:0/2808412958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3110108390 0x7f31101a5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:22.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.006+0000 7f310f7fe700 1 -- 172.21.15.80:0/2808412958 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31101a5fb0 con 0x7f3110102ce0 2024-04-26T18:34:22.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.006+0000 7f310f7fe700 1 --2- 172.21.15.80:0/2808412958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3110102ce0 0x7f311019af30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3104000c00 tx=0x7f31040047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:22.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.007+0000 7f310d7fa700 1 -- 172.21.15.80:0/2808412958 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3104027070 con 0x7f3110102ce0 2024-04-26T18:34:22.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.007+0000 7f31163c2700 1 -- 172.21.15.80:0/2808412958 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31101a6180 con 0x7f3110102ce0 2024-04-26T18:34:22.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.007+0000 7f310d7fa700 1 -- 172.21.15.80:0/2808412958 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31040040e0 con 0x7f3110102ce0 2024-04-26T18:34:22.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.007+0000 7f310d7fa700 1 -- 172.21.15.80:0/2808412958 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310400f460 con 0x7f3110102ce0 2024-04-26T18:34:22.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.007+0000 7f31163c2700 1 -- 172.21.15.80:0/2808412958 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31101a65d0 con 0x7f3110102ce0 2024-04-26T18:34:22.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.007+0000 7f31163c2700 1 -- 172.21.15.80:0/2808412958 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3110063b30 con 0x7f3110102ce0 2024-04-26T18:34:22.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.009+0000 7f310d7fa700 1 -- 172.21.15.80:0/2808412958 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f310402a070 con 0x7f3110102ce0 2024-04-26T18:34:22.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.009+0000 7f310d7fa700 1 --2- 172.21.15.80:0/2808412958 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f30f80a3cd0 0x7f30f80a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:22.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.009+0000 7f310ffff700 1 --2- 172.21.15.80:0/2808412958 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f30f80a3cd0 0x7f30f80a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:22.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.009+0000 7f310d7fa700 1 -- 172.21.15.80:0/2808412958 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f31040d1c00 con 0x7f3110102ce0 2024-04-26T18:34:22.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.009+0000 7f310d7fa700 1 --2- 172.21.15.80:0/2808412958 >> [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447] conn(0x7f30f80ad790 0x7f30f80afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:22.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.009+0000 7f310d7fa700 1 -- 172.21.15.80:0/2808412958 --> [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3104011ec0 con 0x7f30f80ad790 2024-04-26T18:34:22.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.009+0000 7f310d7fa700 1 -- 172.21.15.80:0/2808412958 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f31040d2050 con 0x7f3110102ce0 2024-04-26T18:34:22.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.010+0000 7f310ffff700 1 --2- 172.21.15.80:0/2808412958 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f30f80a3cd0 0x7f30f80a6190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3100005950 tx=0x7f3100005cf0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:22.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.010+0000 7f311495f700 1 --2- 172.21.15.80:0/2808412958 >> [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447] conn(0x7f30f80ad790 0x7f30f80afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:22.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.010+0000 7f311495f700 1 --2- 172.21.15.80:0/2808412958 >> [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447] conn(0x7f30f80ad790 0x7f30f80afc30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:22.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.011+0000 7f310d7fa700 1 -- 172.21.15.80:0/2808412958 <== osd.7 v2:172.21.15.82:6816/208047447 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3104011ec0 con 0x7f30f80ad790 2024-04-26T18:34:22.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.028+0000 7f31163c2700 1 -- 172.21.15.80:0/2808412958 --> [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3110063f30 con 0x7f30f80ad790 2024-04-26T18:34:22.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.029+0000 7f310d7fa700 1 -- 172.21.15.80:0/2808412958 <== osd.7 v2:172.21.15.82:6816/208047447 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3110063f30 con 0x7f30f80ad790 2024-04-26T18:34:22.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.029+0000 7f31163c2700 1 -- 172.21.15.80:0/2808412958 >> [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447] conn(0x7f30f80ad790 msgr2=0x7f30f80afc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:22.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.029+0000 7f31163c2700 1 --2- 172.21.15.80:0/2808412958 >> [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447] conn(0x7f30f80ad790 0x7f30f80afc30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:22.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.029+0000 7f31163c2700 1 -- 172.21.15.80:0/2808412958 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f30f80a3cd0 msgr2=0x7f30f80a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:22.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.029+0000 7f31163c2700 1 --2- 172.21.15.80:0/2808412958 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f30f80a3cd0 0x7f30f80a6190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3100005950 tx=0x7f3100005cf0 comp rx=0 tx=0).stop 2024-04-26T18:34:22.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.029+0000 7f31163c2700 1 -- 172.21.15.80:0/2808412958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3110102ce0 msgr2=0x7f311019af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:22.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.029+0000 7f31163c2700 1 --2- 172.21.15.80:0/2808412958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3110102ce0 0x7f311019af30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3104000c00 tx=0x7f31040047b0 comp rx=0 tx=0).stop 2024-04-26T18:34:22.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.029+0000 7f311495f700 1 -- 172.21.15.80:0/2808412958 reap_dead start 2024-04-26T18:34:22.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.030+0000 7f31163c2700 1 -- 172.21.15.80:0/2808412958 shutdown_connections 2024-04-26T18:34:22.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.030+0000 7f31163c2700 1 -- 172.21.15.80:0/2808412958 >> 172.21.15.80:0/2808412958 conn(0x7f31100792d0 msgr2=0x7f3110100f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:22.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.030+0000 7f31163c2700 1 -- 172.21.15.80:0/2808412958 shutdown_connections 2024-04-26T18:34:22.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.030+0000 7f31163c2700 1 -- 172.21.15.80:0/2808412958 wait complete. 2024-04-26T18:34:22.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.117+0000 7f9a2672e700 1 -- 172.21.15.80:0/830368418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a20107640 msgr2=0x7f9a2010f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:22.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.117+0000 7f9a2672e700 1 --2- 172.21.15.80:0/830368418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a20107640 0x7f9a2010f210 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800b0d0 tx=0x7f9a1800b3e0 comp rx=0 tx=0).stop 2024-04-26T18:34:22.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.117+0000 7f9a2672e700 1 -- 172.21.15.80:0/830368418 shutdown_connections 2024-04-26T18:34:22.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.117+0000 7f9a2672e700 1 --2- 172.21.15.80:0/830368418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a20107640 0x7f9a2010f210 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:22.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.117+0000 7f9a2672e700 1 --2- 172.21.15.80:0/830368418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a201025b0 0x7f9a20102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:22.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.117+0000 7f9a2672e700 1 --2- 172.21.15.80:0/830368418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a20102f60 0x7f9a20106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:22.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.117+0000 7f9a2672e700 1 -- 172.21.15.80:0/830368418 >> 172.21.15.80:0/830368418 conn(0x7f9a200792f0 msgr2=0x7f9a20079700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:22.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.117+0000 7f9a2672e700 1 -- 172.21.15.80:0/830368418 shutdown_connections 2024-04-26T18:34:22.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.117+0000 7f9a2672e700 1 -- 172.21.15.80:0/830368418 wait complete. 2024-04-26T18:34:22.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.118+0000 7f9a2672e700 1 Processor -- start 2024-04-26T18:34:22.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.118+0000 7f9a2672e700 1 -- start start 2024-04-26T18:34:22.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.118+0000 7f9a2672e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a201025b0 0x7f9a2019a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:22.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.118+0000 7f9a2672e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a20102f60 0x7f9a2019ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:22.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.118+0000 7f9a2672e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a20107640 0x7f9a201a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:22.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.118+0000 7f9a2672e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9a201124e0 con 0x7f9a20102f60 2024-04-26T18:34:22.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.118+0000 7f9a2672e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9a20112360 con 0x7f9a20107640 2024-04-26T18:34:22.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.118+0000 7f9a2672e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9a20112660 con 0x7f9a201025b0 2024-04-26T18:34:22.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.118+0000 7f9a1f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a20102f60 0x7f9a2019ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:22.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.118+0000 7f9a1f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a20102f60 0x7f9a2019ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39254/0 (socket says 172.21.15.80:39254) 2024-04-26T18:34:22.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.118+0000 7f9a1f7fe700 1 -- 172.21.15.80:0/1003769951 learned_addr learned my addr 172.21.15.80:0/1003769951 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:22.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.118+0000 7f9a1ffff700 1 --2- 172.21.15.80:0/1003769951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a201025b0 0x7f9a2019a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:22.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.119+0000 7f9a24ccb700 1 --2- 172.21.15.80:0/1003769951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a20107640 0x7f9a201a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:22.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.119+0000 7f9a1f7fe700 1 -- 172.21.15.80:0/1003769951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a201025b0 msgr2=0x7f9a2019a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:22.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.119+0000 7f9a1f7fe700 1 --2- 172.21.15.80:0/1003769951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a201025b0 0x7f9a2019a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:22.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.119+0000 7f9a1f7fe700 1 -- 172.21.15.80:0/1003769951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a20107640 msgr2=0x7f9a201a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:22.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.119+0000 7f9a1f7fe700 1 --2- 172.21.15.80:0/1003769951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a20107640 0x7f9a201a58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:22.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.119+0000 7f9a1f7fe700 1 -- 172.21.15.80:0/1003769951 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a201a5e20 con 0x7f9a20102f60 2024-04-26T18:34:22.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.119+0000 7f9a1f7fe700 1 --2- 172.21.15.80:0/1003769951 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a20102f60 0x7f9a2019ada0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400d980 tx=0x7f9a1400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:22.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.119+0000 7f9a1d7fa700 1 -- 172.21.15.80:0/1003769951 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a14017070 con 0x7f9a20102f60 2024-04-26T18:34:22.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.119+0000 7f9a2672e700 1 -- 172.21.15.80:0/1003769951 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a201a5ff0 con 0x7f9a20102f60 2024-04-26T18:34:22.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.119+0000 7f9a1d7fa700 1 -- 172.21.15.80:0/1003769951 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a1400fd40 con 0x7f9a20102f60 2024-04-26T18:34:22.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.119+0000 7f9a1d7fa700 1 -- 172.21.15.80:0/1003769951 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1400e3b0 con 0x7f9a20102f60 2024-04-26T18:34:22.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.119+0000 7f9a2672e700 1 -- 172.21.15.80:0/1003769951 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a201a6500 con 0x7f9a20102f60 2024-04-26T18:34:22.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.120+0000 7f9a2672e700 1 -- 172.21.15.80:0/1003769951 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9a20100c60 con 0x7f9a20102f60 2024-04-26T18:34:22.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.121+0000 7f9a1d7fa700 1 -- 172.21.15.80:0/1003769951 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f9a14010610 con 0x7f9a20102f60 2024-04-26T18:34:22.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.122+0000 7f9a1d7fa700 1 --2- 172.21.15.80:0/1003769951 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f9a080a3cd0 0x7f9a080a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:22.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.122+0000 7f9a1ffff700 1 --2- 172.21.15.80:0/1003769951 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f9a080a3cd0 0x7f9a080a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:22.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.122+0000 7f9a1d7fa700 1 -- 172.21.15.80:0/1003769951 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f9a140d0300 con 0x7f9a20102f60 2024-04-26T18:34:22.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.122+0000 7f9a1d7fa700 1 --2- 172.21.15.80:0/1003769951 >> [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490] conn(0x7f9a080ad790 0x7f9a080afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:22.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.122+0000 7f9a1d7fa700 1 -- 172.21.15.80:0/1003769951 --> [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9a080b0300 con 0x7f9a080ad790 2024-04-26T18:34:22.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.122+0000 7f9a1d7fa700 1 -- 172.21.15.80:0/1003769951 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f9a140d0750 con 0x7f9a20102f60 2024-04-26T18:34:22.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.122+0000 7f9a1ffff700 1 --2- 172.21.15.80:0/1003769951 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f9a080a3cd0 0x7f9a080a6190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9a1000ac50 tx=0x7f9a1000a380 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:22.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.122+0000 7f9a24ccb700 1 --2- 172.21.15.80:0/1003769951 >> [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490] conn(0x7f9a080ad790 0x7f9a080afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:22.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.122+0000 7f9a24ccb700 1 --2- 172.21.15.80:0/1003769951 >> [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490] conn(0x7f9a080ad790 0x7f9a080afc30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:22.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.123+0000 7f9a1d7fa700 1 -- 172.21.15.80:0/1003769951 <== osd.6 v2:172.21.15.80:6818/145064490 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9a080b0300 con 0x7f9a080ad790 2024-04-26T18:34:22.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.140+0000 7f9a2672e700 1 -- 172.21.15.80:0/1003769951 --> [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9a20103a40 con 0x7f9a080ad790 2024-04-26T18:34:22.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.140+0000 7f9a1d7fa700 1 -- 172.21.15.80:0/1003769951 <== osd.6 v2:172.21.15.80:6818/145064490 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9a20103a40 con 0x7f9a080ad790 2024-04-26T18:34:22.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.140+0000 7f9a2672e700 1 -- 172.21.15.80:0/1003769951 >> [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490] conn(0x7f9a080ad790 msgr2=0x7f9a080afc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:22.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.140+0000 7f9a2672e700 1 --2- 172.21.15.80:0/1003769951 >> [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490] conn(0x7f9a080ad790 0x7f9a080afc30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:22.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.140+0000 7f9a2672e700 1 -- 172.21.15.80:0/1003769951 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f9a080a3cd0 msgr2=0x7f9a080a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:22.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.140+0000 7f9a2672e700 1 --2- 172.21.15.80:0/1003769951 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f9a080a3cd0 0x7f9a080a6190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9a1000ac50 tx=0x7f9a1000a380 comp rx=0 tx=0).stop 2024-04-26T18:34:22.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.140+0000 7f9a2672e700 1 -- 172.21.15.80:0/1003769951 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a20102f60 msgr2=0x7f9a2019ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:22.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.140+0000 7f9a2672e700 1 --2- 172.21.15.80:0/1003769951 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a20102f60 0x7f9a2019ada0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400d980 tx=0x7f9a1400dc90 comp rx=0 tx=0).stop 2024-04-26T18:34:22.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.140+0000 7f9a24ccb700 1 -- 172.21.15.80:0/1003769951 reap_dead start 2024-04-26T18:34:22.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.140+0000 7f9a2672e700 1 -- 172.21.15.80:0/1003769951 shutdown_connections 2024-04-26T18:34:22.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.140+0000 7f9a2672e700 1 -- 172.21.15.80:0/1003769951 >> 172.21.15.80:0/1003769951 conn(0x7f9a200792f0 msgr2=0x7f9a201002c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:22.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.140+0000 7f9a2672e700 1 -- 172.21.15.80:0/1003769951 shutdown_connections 2024-04-26T18:34:22.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:22.140+0000 7f9a2672e700 1 -- 172.21.15.80:0/1003769951 wait complete. 2024-04-26T18:34:23.832 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:23 smithi080 ceph-mon[29135]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-26T18:34:23.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:23 smithi192 ceph-mon[32842]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-26T18:34:23.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:23 smithi082 ceph-mon[32808]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-26T18:34:25.106 INFO:teuthology.orchestra.run.smithi080.stdout:77309411405 2024-04-26T18:34:25.106 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-26T18:34:25.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.351+0000 7fdcad9b0700 1 -- 172.21.15.80:0/2958148750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdca8103e90 msgr2=0x7fdca81102c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:25.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.351+0000 7fdcad9b0700 1 --2- 172.21.15.80:0/2958148750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdca8103e90 0x7fdca81102c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdca000b0a0 tx=0x7fdca000b3b0 comp rx=0 tx=0).stop 2024-04-26T18:34:25.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.351+0000 7fdcad9b0700 1 -- 172.21.15.80:0/2958148750 shutdown_connections 2024-04-26T18:34:25.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.351+0000 7fdcad9b0700 1 --2- 172.21.15.80:0/2958148750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdca8103e90 0x7fdca81102c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:25.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.351+0000 7fdcad9b0700 1 --2- 172.21.15.80:0/2958148750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca81094f0 0x7fdca81098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:25.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.351+0000 7fdcad9b0700 1 --2- 172.21.15.80:0/2958148750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdca81034d0 0x7fdca8103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:25.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.351+0000 7fdcad9b0700 1 -- 172.21.15.80:0/2958148750 >> 172.21.15.80:0/2958148750 conn(0x7fdca807a4b0 msgr2=0x7fdca807a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:25.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.351+0000 7fdcad9b0700 1 -- 172.21.15.80:0/2958148750 shutdown_connections 2024-04-26T18:34:25.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.351+0000 7fdcad9b0700 1 -- 172.21.15.80:0/2958148750 wait complete. 2024-04-26T18:34:25.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.351+0000 7fdcad9b0700 1 Processor -- start 2024-04-26T18:34:25.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.352+0000 7fdcad9b0700 1 -- start start 2024-04-26T18:34:25.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.352+0000 7fdcad9b0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdca81034d0 0x7fdca819f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:25.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.352+0000 7fdcad9b0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdca8103e90 0x7fdca819fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:25.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.352+0000 7fdcad9b0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca81094f0 0x7fdca8199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:25.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.352+0000 7fdcad9b0700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdca8113610 con 0x7fdca81034d0 2024-04-26T18:34:25.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.352+0000 7fdcad9b0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdca8113490 con 0x7fdca8103e90 2024-04-26T18:34:25.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.352+0000 7fdcad9b0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdca8113790 con 0x7fdca81094f0 2024-04-26T18:34:25.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.352+0000 7fdca6ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdca81034d0 0x7fdca819f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:25.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.352+0000 7fdca6ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdca81034d0 0x7fdca819f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55818/0 (socket says 172.21.15.80:55818) 2024-04-26T18:34:25.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.352+0000 7fdca6ffd700 1 -- 172.21.15.80:0/1693358668 learned_addr learned my addr 172.21.15.80:0/1693358668 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:25.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.352+0000 7fdca67fc700 1 --2- 172.21.15.80:0/1693358668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdca8103e90 0x7fdca819fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:25.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.352+0000 7fdca77fe700 1 --2- 172.21.15.80:0/1693358668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca81094f0 0x7fdca8199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:25.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.352+0000 7fdca6ffd700 1 -- 172.21.15.80:0/1693358668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca81094f0 msgr2=0x7fdca8199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:25.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.352+0000 7fdca6ffd700 1 --2- 172.21.15.80:0/1693358668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca81094f0 0x7fdca8199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:25.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.352+0000 7fdca6ffd700 1 -- 172.21.15.80:0/1693358668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdca8103e90 msgr2=0x7fdca819fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:25.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.352+0000 7fdca6ffd700 1 --2- 172.21.15.80:0/1693358668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdca8103e90 0x7fdca819fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:25.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.352+0000 7fdca6ffd700 1 -- 172.21.15.80:0/1693358668 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca8199ff0 con 0x7fdca81034d0 2024-04-26T18:34:25.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.352+0000 7fdca6ffd700 1 --2- 172.21.15.80:0/1693358668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdca81034d0 0x7fdca819f690 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800d980 tx=0x7fdc9800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:25.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.353+0000 7fdcac9ae700 1 -- 172.21.15.80:0/1693358668 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc98017070 con 0x7fdca81034d0 2024-04-26T18:34:25.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.353+0000 7fdcad9b0700 1 -- 172.21.15.80:0/1693358668 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdca819a2e0 con 0x7fdca81034d0 2024-04-26T18:34:25.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.353+0000 7fdcac9ae700 1 -- 172.21.15.80:0/1693358668 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc98005020 con 0x7fdca81034d0 2024-04-26T18:34:25.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.353+0000 7fdcac9ae700 1 -- 172.21.15.80:0/1693358668 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc98009b50 con 0x7fdca81034d0 2024-04-26T18:34:25.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.353+0000 7fdcad9b0700 1 -- 172.21.15.80:0/1693358668 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdca8075650 con 0x7fdca81034d0 2024-04-26T18:34:25.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.353+0000 7fdcad9b0700 1 -- 172.21.15.80:0/1693358668 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdca8063bb0 con 0x7fdca81034d0 2024-04-26T18:34:25.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.355+0000 7fdcac9ae700 1 -- 172.21.15.80:0/1693358668 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fdc980051d0 con 0x7fdca81034d0 2024-04-26T18:34:25.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.355+0000 7fdcac9ae700 1 --2- 172.21.15.80:0/1693358668 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fdc900a3cd0 0x7fdc900a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:25.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.355+0000 7fdca67fc700 1 --2- 172.21.15.80:0/1693358668 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fdc900a3cd0 0x7fdc900a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:25.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.355+0000 7fdcac9ae700 1 -- 172.21.15.80:0/1693358668 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fdc980d09a0 con 0x7fdca81034d0 2024-04-26T18:34:25.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.356+0000 7fdcac9ae700 1 --2- 172.21.15.80:0/1693358668 >> [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066] conn(0x7fdc900ad790 0x7fdc900afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:25.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.356+0000 7fdcac9ae700 1 -- 172.21.15.80:0/1693358668 --> [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc900b0300 con 0x7fdc900ad790 2024-04-26T18:34:25.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.356+0000 7fdcac9ae700 1 -- 172.21.15.80:0/1693358668 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fdc980d0df0 con 0x7fdca81034d0 2024-04-26T18:34:25.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.356+0000 7fdca77fe700 1 --2- 172.21.15.80:0/1693358668 >> [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066] conn(0x7fdc900ad790 0x7fdc900afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:25.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.356+0000 7fdca67fc700 1 --2- 172.21.15.80:0/1693358668 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fdc900a3cd0 0x7fdc900a6190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdca807aa40 tx=0x7fdc9c00a380 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:25.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.356+0000 7fdca77fe700 1 --2- 172.21.15.80:0/1693358668 >> [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066] conn(0x7fdc900ad790 0x7fdc900afc30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:25.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.357+0000 7fdcac9ae700 1 -- 172.21.15.80:0/1693358668 <== osd.3 v2:172.21.15.80:6810/407817066 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdc900b0300 con 0x7fdc900ad790 2024-04-26T18:34:25.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.373+0000 7fdcad9b0700 1 -- 172.21.15.80:0/1693358668 --> [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdca8064030 con 0x7fdc900ad790 2024-04-26T18:34:25.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.373+0000 7fdcac9ae700 1 -- 172.21.15.80:0/1693358668 <== osd.3 v2:172.21.15.80:6810/407817066 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdca8064030 con 0x7fdc900ad790 2024-04-26T18:34:25.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.374+0000 7fdcad9b0700 1 -- 172.21.15.80:0/1693358668 >> [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066] conn(0x7fdc900ad790 msgr2=0x7fdc900afc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:25.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.374+0000 7fdcad9b0700 1 --2- 172.21.15.80:0/1693358668 >> [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066] conn(0x7fdc900ad790 0x7fdc900afc30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:25.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.374+0000 7fdcad9b0700 1 -- 172.21.15.80:0/1693358668 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fdc900a3cd0 msgr2=0x7fdc900a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:25.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.374+0000 7fdcad9b0700 1 --2- 172.21.15.80:0/1693358668 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fdc900a3cd0 0x7fdc900a6190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdca807aa40 tx=0x7fdc9c00a380 comp rx=0 tx=0).stop 2024-04-26T18:34:25.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.374+0000 7fdcad9b0700 1 -- 172.21.15.80:0/1693358668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdca81034d0 msgr2=0x7fdca819f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:25.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.374+0000 7fdcad9b0700 1 --2- 172.21.15.80:0/1693358668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdca81034d0 0x7fdca819f690 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800d980 tx=0x7fdc9800dc90 comp rx=0 tx=0).stop 2024-04-26T18:34:25.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.374+0000 7fdca77fe700 1 -- 172.21.15.80:0/1693358668 reap_dead start 2024-04-26T18:34:25.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.374+0000 7fdcad9b0700 1 -- 172.21.15.80:0/1693358668 shutdown_connections 2024-04-26T18:34:25.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.374+0000 7fdcad9b0700 1 -- 172.21.15.80:0/1693358668 >> 172.21.15.80:0/1693358668 conn(0x7fdca807a4b0 msgr2=0x7fdca8101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:25.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.374+0000 7fdcad9b0700 1 -- 172.21.15.80:0/1693358668 shutdown_connections 2024-04-26T18:34:25.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.374+0000 7fdcad9b0700 1 -- 172.21.15.80:0/1693358668 wait complete. 2024-04-26T18:34:25.810 INFO:teuthology.orchestra.run.smithi080.stdout:201863462969 2024-04-26T18:34:25.810 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-04-26T18:34:25.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:25 smithi192 ceph-mon[32842]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:34:25.885 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:25 smithi080 ceph-mon[29135]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:34:25.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:25 smithi082 ceph-mon[32808]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:34:25.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.990+0000 7f1aea6ea700 1 -- 172.21.15.80:0/1404453237 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ae406b9c0 msgr2=0x7f1ae406be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:25.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.990+0000 7f1aea6ea700 1 --2- 172.21.15.80:0/1404453237 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ae406b9c0 0x7f1ae406be20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8009990 tx=0x7f1ad8009ca0 comp rx=0 tx=0).stop 2024-04-26T18:34:25.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.990+0000 7f1aea6ea700 1 -- 172.21.15.80:0/1404453237 shutdown_connections 2024-04-26T18:34:25.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.990+0000 7f1aea6ea700 1 --2- 172.21.15.80:0/1404453237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae406c360 0x7f1ae41102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:25.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.990+0000 7f1aea6ea700 1 --2- 172.21.15.80:0/1404453237 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ae4109490 0x7f1ae4109870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:25.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.990+0000 7f1aea6ea700 1 --2- 172.21.15.80:0/1404453237 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ae406b9c0 0x7f1ae406be20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:25.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.990+0000 7f1aea6ea700 1 -- 172.21.15.80:0/1404453237 >> 172.21.15.80:0/1404453237 conn(0x7f1ae4079290 msgr2=0x7f1ae40796a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:25.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.990+0000 7f1aea6ea700 1 -- 172.21.15.80:0/1404453237 shutdown_connections 2024-04-26T18:34:25.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.990+0000 7f1aea6ea700 1 -- 172.21.15.80:0/1404453237 wait complete. 2024-04-26T18:34:25.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.991+0000 7f1aea6ea700 1 Processor -- start 2024-04-26T18:34:25.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.991+0000 7f1aea6ea700 1 -- start start 2024-04-26T18:34:25.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.991+0000 7f1aea6ea700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ae406b9c0 0x7f1ae41023e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:25.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.991+0000 7f1aea6ea700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ae406c360 0x7f1ae4102920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:25.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.991+0000 7f1aea6ea700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae4109490 0x7f1ae4102e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:25.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.991+0000 7f1aea6ea700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae4113600 con 0x7f1ae406c360 2024-04-26T18:34:25.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.991+0000 7f1aea6ea700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae4113480 con 0x7f1ae4109490 2024-04-26T18:34:25.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.991+0000 7f1aea6ea700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae4113780 con 0x7f1ae406b9c0 2024-04-26T18:34:25.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.991+0000 7f1ae37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ae406c360 0x7f1ae4102920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:25.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.991+0000 7f1ae37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ae406c360 0x7f1ae4102920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55840/0 (socket says 172.21.15.80:55840) 2024-04-26T18:34:25.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.991+0000 7f1ae37fe700 1 -- 172.21.15.80:0/2400050129 learned_addr learned my addr 172.21.15.80:0/2400050129 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:25.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.991+0000 7f1ae8c87700 1 --2- 172.21.15.80:0/2400050129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae4109490 0x7f1ae4102e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:25.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.991+0000 7f1ae3fff700 1 --2- 172.21.15.80:0/2400050129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ae406b9c0 0x7f1ae41023e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:25.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.992+0000 7f1ae37fe700 1 -- 172.21.15.80:0/2400050129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ae406b9c0 msgr2=0x7f1ae41023e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:25.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.992+0000 7f1ae37fe700 1 --2- 172.21.15.80:0/2400050129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ae406b9c0 0x7f1ae41023e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:25.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.992+0000 7f1ae37fe700 1 -- 172.21.15.80:0/2400050129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae4109490 msgr2=0x7f1ae4102e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:25.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.992+0000 7f1ae37fe700 1 --2- 172.21.15.80:0/2400050129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae4109490 0x7f1ae4102e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:25.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.992+0000 7f1ae37fe700 1 -- 172.21.15.80:0/2400050129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ae41a80c0 con 0x7f1ae406c360 2024-04-26T18:34:25.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.992+0000 7f1ae37fe700 1 --2- 172.21.15.80:0/2400050129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ae406c360 0x7f1ae4102920 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8000c00 tx=0x7f1ad80047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:25.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.992+0000 7f1ae17fa700 1 -- 172.21.15.80:0/2400050129 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8027070 con 0x7f1ae406c360 2024-04-26T18:34:25.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.992+0000 7f1aea6ea700 1 -- 172.21.15.80:0/2400050129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ae41a8350 con 0x7f1ae406c360 2024-04-26T18:34:25.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.992+0000 7f1ae17fa700 1 -- 172.21.15.80:0/2400050129 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ad80040e0 con 0x7f1ae406c360 2024-04-26T18:34:25.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.992+0000 7f1ae17fa700 1 -- 172.21.15.80:0/2400050129 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad800f460 con 0x7f1ae406c360 2024-04-26T18:34:25.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.992+0000 7f1aea6ea700 1 -- 172.21.15.80:0/2400050129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ae41a87a0 con 0x7f1ae406c360 2024-04-26T18:34:25.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.993+0000 7f1aea6ea700 1 -- 172.21.15.80:0/2400050129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1ae4063b30 con 0x7f1ae406c360 2024-04-26T18:34:25.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.994+0000 7f1ae17fa700 1 -- 172.21.15.80:0/2400050129 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f1ad802a070 con 0x7f1ae406c360 2024-04-26T18:34:25.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.995+0000 7f1ae17fa700 1 --2- 172.21.15.80:0/2400050129 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f1acc0a3cd0 0x7f1acc0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:25.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.995+0000 7f1ae3fff700 1 --2- 172.21.15.80:0/2400050129 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f1acc0a3cd0 0x7f1acc0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:25.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.995+0000 7f1ae17fa700 1 -- 172.21.15.80:0/2400050129 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f1ad80d1c00 con 0x7f1ae406c360 2024-04-26T18:34:25.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.995+0000 7f1ae17fa700 1 --2- 172.21.15.80:0/2400050129 >> [v2:172.21.15.192:6824/3466865106,v1:172.21.15.192:6825/3466865106] conn(0x7f1acc0ad790 0x7f1acc0afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:25.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.995+0000 7f1ae17fa700 1 -- 172.21.15.80:0/2400050129 --> [v2:172.21.15.192:6824/3466865106,v1:172.21.15.192:6825/3466865106] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1ad8011ec0 con 0x7f1acc0ad790 2024-04-26T18:34:25.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.995+0000 7f1ae17fa700 1 -- 172.21.15.80:0/2400050129 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f1ad80d2050 con 0x7f1ae406c360 2024-04-26T18:34:25.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.995+0000 7f1ae3fff700 1 --2- 172.21.15.80:0/2400050129 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f1acc0a3cd0 0x7f1acc0a6190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4006fd0 tx=0x7f1ad4008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:25.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.995+0000 7f1ae8c87700 1 --2- 172.21.15.80:0/2400050129 >> [v2:172.21.15.192:6824/3466865106,v1:172.21.15.192:6825/3466865106] conn(0x7f1acc0ad790 0x7f1acc0afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:25.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.996+0000 7f1ae8c87700 1 --2- 172.21.15.80:0/2400050129 >> [v2:172.21.15.192:6824/3466865106,v1:172.21.15.192:6825/3466865106] conn(0x7f1acc0ad790 0x7f1acc0afc30 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:25.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:25.997+0000 7f1ae17fa700 1 -- 172.21.15.80:0/2400050129 <== osd.11 v2:172.21.15.192:6824/3466865106 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1ad8011ec0 con 0x7f1acc0ad790 2024-04-26T18:34:26.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:26.013+0000 7f1aea6ea700 1 -- 172.21.15.80:0/2400050129 --> [v2:172.21.15.192:6824/3466865106,v1:172.21.15.192:6825/3466865106] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1ae4063f30 con 0x7f1acc0ad790 2024-04-26T18:34:26.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:26.014+0000 7f1ae17fa700 1 -- 172.21.15.80:0/2400050129 <== osd.11 v2:172.21.15.192:6824/3466865106 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1ae4063f30 con 0x7f1acc0ad790 2024-04-26T18:34:26.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:26.014+0000 7f1aea6ea700 1 -- 172.21.15.80:0/2400050129 >> [v2:172.21.15.192:6824/3466865106,v1:172.21.15.192:6825/3466865106] conn(0x7f1acc0ad790 msgr2=0x7f1acc0afc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:26.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:26.014+0000 7f1aea6ea700 1 --2- 172.21.15.80:0/2400050129 >> [v2:172.21.15.192:6824/3466865106,v1:172.21.15.192:6825/3466865106] conn(0x7f1acc0ad790 0x7f1acc0afc30 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:26.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:26.014+0000 7f1aea6ea700 1 -- 172.21.15.80:0/2400050129 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f1acc0a3cd0 msgr2=0x7f1acc0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:26.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:26.014+0000 7f1aea6ea700 1 --2- 172.21.15.80:0/2400050129 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f1acc0a3cd0 0x7f1acc0a6190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4006fd0 tx=0x7f1ad4008040 comp rx=0 tx=0).stop 2024-04-26T18:34:26.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:26.014+0000 7f1aea6ea700 1 -- 172.21.15.80:0/2400050129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ae406c360 msgr2=0x7f1ae4102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:26.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:26.014+0000 7f1aea6ea700 1 --2- 172.21.15.80:0/2400050129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ae406c360 0x7f1ae4102920 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8000c00 tx=0x7f1ad80047b0 comp rx=0 tx=0).stop 2024-04-26T18:34:26.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:26.014+0000 7f1ae8c87700 1 -- 172.21.15.80:0/2400050129 reap_dead start 2024-04-26T18:34:26.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:26.014+0000 7f1aea6ea700 1 -- 172.21.15.80:0/2400050129 shutdown_connections 2024-04-26T18:34:26.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:26.014+0000 7f1aea6ea700 1 -- 172.21.15.80:0/2400050129 >> 172.21.15.80:0/2400050129 conn(0x7f1ae4079290 msgr2=0x7f1ae4100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:26.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:26.014+0000 7f1aea6ea700 1 -- 172.21.15.80:0/2400050129 shutdown_connections 2024-04-26T18:34:26.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:26.014+0000 7f1aea6ea700 1 -- 172.21.15.80:0/2400050129 wait complete. 2024-04-26T18:34:26.536 INFO:teuthology.orchestra.run.smithi080.stdout:223338299444 2024-04-26T18:34:26.536 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-04-26T18:34:27.182 INFO:teuthology.orchestra.run.smithi080.stdout:111669149769 2024-04-26T18:34:27.183 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-26T18:34:27.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:27 smithi080 ceph-mon[29135]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:34:27.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:27 smithi192 ceph-mon[32842]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:34:27.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:27 smithi082 ceph-mon[32808]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:34:28.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.104+0000 7f14792be700 1 -- 172.21.15.80:0/2137378172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1474103e30 msgr2=0x7f1474110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:28.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.104+0000 7f14792be700 1 --2- 172.21.15.80:0/2137378172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1474103e30 0x7f1474110290 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f146400b0a0 tx=0x7f146400b3b0 comp rx=0 tx=0).stop 2024-04-26T18:34:28.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.104+0000 7f14792be700 1 -- 172.21.15.80:0/2137378172 shutdown_connections 2024-04-26T18:34:28.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.104+0000 7f14792be700 1 --2- 172.21.15.80:0/2137378172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1474103e30 0x7f1474110290 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:28.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.104+0000 7f14792be700 1 --2- 172.21.15.80:0/2137378172 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14741094c0 0x7f14741098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:28.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.104+0000 7f14792be700 1 --2- 172.21.15.80:0/2137378172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1474103470 0x7f14741038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:28.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.104+0000 7f14792be700 1 -- 172.21.15.80:0/2137378172 >> 172.21.15.80:0/2137378172 conn(0x7f147407a580 msgr2=0x7f147407a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:28.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.104+0000 7f14792be700 1 -- 172.21.15.80:0/2137378172 shutdown_connections 2024-04-26T18:34:28.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.104+0000 7f14792be700 1 -- 172.21.15.80:0/2137378172 wait complete. 2024-04-26T18:34:28.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.104+0000 7f14792be700 1 Processor -- start 2024-04-26T18:34:28.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.105+0000 7f14792be700 1 -- start start 2024-04-26T18:34:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.105+0000 7f14792be700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1474103470 0x7f147419f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.105+0000 7f14792be700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1474103e30 0x7f147419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.105+0000 7f14792be700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14741094c0 0x7f1474199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.105+0000 7f14792be700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f14741136c0 con 0x7f14741094c0 2024-04-26T18:34:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.105+0000 7f14792be700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1474113540 con 0x7f1474103470 2024-04-26T18:34:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.105+0000 7f14792be700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1474113840 con 0x7f1474103e30 2024-04-26T18:34:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.105+0000 7f14737fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14741094c0 0x7f1474199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.105+0000 7f14737fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14741094c0 0x7f1474199a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55860/0 (socket says 172.21.15.80:55860) 2024-04-26T18:34:28.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.105+0000 7f14737fe700 1 -- 172.21.15.80:0/4236150549 learned_addr learned my addr 172.21.15.80:0/4236150549 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.105+0000 7f1472ffd700 1 --2- 172.21.15.80:0/4236150549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1474103470 0x7f147419f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.105+0000 7f14727fc700 1 --2- 172.21.15.80:0/4236150549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1474103e30 0x7f147419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.105+0000 7f14737fe700 1 -- 172.21.15.80:0/4236150549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1474103e30 msgr2=0x7f147419fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.105+0000 7f14737fe700 1 --2- 172.21.15.80:0/4236150549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1474103e30 0x7f147419fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.105+0000 7f14737fe700 1 -- 172.21.15.80:0/4236150549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1474103470 msgr2=0x7f147419f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.105+0000 7f14737fe700 1 --2- 172.21.15.80:0/4236150549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1474103470 0x7f147419f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.105+0000 7f14737fe700 1 -- 172.21.15.80:0/4236150549 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147419a1a0 con 0x7f14741094c0 2024-04-26T18:34:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.105+0000 7f14727fc700 1 --2- 172.21.15.80:0/4236150549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1474103e30 0x7f147419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:34:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.106+0000 7f14737fe700 1 --2- 172.21.15.80:0/4236150549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14741094c0 0x7f1474199a40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f14640062a0 tx=0x7f1464004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.106+0000 7f145bfff700 1 -- 172.21.15.80:0/4236150549 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1464021070 con 0x7f14741094c0 2024-04-26T18:34:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.106+0000 7f145bfff700 1 -- 172.21.15.80:0/4236150549 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1464007c80 con 0x7f14741094c0 2024-04-26T18:34:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.106+0000 7f14792be700 1 -- 172.21.15.80:0/4236150549 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f147419a430 con 0x7f14741094c0 2024-04-26T18:34:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.106+0000 7f145bfff700 1 -- 172.21.15.80:0/4236150549 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146401d450 con 0x7f14741094c0 2024-04-26T18:34:28.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.106+0000 7f14792be700 1 -- 172.21.15.80:0/4236150549 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14741a6750 con 0x7f14741094c0 2024-04-26T18:34:28.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.107+0000 7f14792be700 1 -- 172.21.15.80:0/4236150549 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1474063bb0 con 0x7f14741094c0 2024-04-26T18:34:28.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.108+0000 7f145bfff700 1 -- 172.21.15.80:0/4236150549 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f1464004000 con 0x7f14741094c0 2024-04-26T18:34:28.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.108+0000 7f145bfff700 1 --2- 172.21.15.80:0/4236150549 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f145c0a3cd0 0x7f145c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:28.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.108+0000 7f1472ffd700 1 --2- 172.21.15.80:0/4236150549 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f145c0a3cd0 0x7f145c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:28.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.109+0000 7f145bfff700 1 -- 172.21.15.80:0/4236150549 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f146400f020 con 0x7f14741094c0 2024-04-26T18:34:28.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.109+0000 7f145bfff700 1 --2- 172.21.15.80:0/4236150549 >> [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993] conn(0x7f145c0ad790 0x7f145c0afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:28.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.109+0000 7f145bfff700 1 -- 172.21.15.80:0/4236150549 --> [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f146402ee50 con 0x7f145c0ad790 2024-04-26T18:34:28.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.109+0000 7f145bfff700 1 -- 172.21.15.80:0/4236150549 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f14640d22a0 con 0x7f14741094c0 2024-04-26T18:34:28.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.109+0000 7f14727fc700 1 --2- 172.21.15.80:0/4236150549 >> [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993] conn(0x7f145c0ad790 0x7f145c0afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:28.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.109+0000 7f1472ffd700 1 --2- 172.21.15.80:0/4236150549 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f145c0a3cd0 0x7f145c0a6190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f147419ab80 tx=0x7f146c009190 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:28.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.109+0000 7f14727fc700 1 --2- 172.21.15.80:0/4236150549 >> [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993] conn(0x7f145c0ad790 0x7f145c0afc30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:28.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.110+0000 7f145bfff700 1 -- 172.21.15.80:0/4236150549 <== osd.9 v2:172.21.15.80:6826/2109877993 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f146402ee50 con 0x7f145c0ad790 2024-04-26T18:34:28.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.126+0000 7f14792be700 1 -- 172.21.15.80:0/4236150549 --> [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1474064030 con 0x7f145c0ad790 2024-04-26T18:34:28.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.127+0000 7f145bfff700 1 -- 172.21.15.80:0/4236150549 <== osd.9 v2:172.21.15.80:6826/2109877993 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1474064030 con 0x7f145c0ad790 2024-04-26T18:34:28.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.127+0000 7f14792be700 1 -- 172.21.15.80:0/4236150549 >> [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993] conn(0x7f145c0ad790 msgr2=0x7f145c0afc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:28.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.127+0000 7f14792be700 1 --2- 172.21.15.80:0/4236150549 >> [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993] conn(0x7f145c0ad790 0x7f145c0afc30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:28.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.127+0000 7f14792be700 1 -- 172.21.15.80:0/4236150549 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f145c0a3cd0 msgr2=0x7f145c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:28.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.127+0000 7f14792be700 1 --2- 172.21.15.80:0/4236150549 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f145c0a3cd0 0x7f145c0a6190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f147419ab80 tx=0x7f146c009190 comp rx=0 tx=0).stop 2024-04-26T18:34:28.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.127+0000 7f14792be700 1 -- 172.21.15.80:0/4236150549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14741094c0 msgr2=0x7f1474199a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:28.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.127+0000 7f14792be700 1 --2- 172.21.15.80:0/4236150549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14741094c0 0x7f1474199a40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f14640062a0 tx=0x7f1464004e20 comp rx=0 tx=0).stop 2024-04-26T18:34:28.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.127+0000 7f14737fe700 1 -- 172.21.15.80:0/4236150549 reap_dead start 2024-04-26T18:34:28.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.127+0000 7f14792be700 1 -- 172.21.15.80:0/4236150549 shutdown_connections 2024-04-26T18:34:28.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.127+0000 7f14792be700 1 -- 172.21.15.80:0/4236150549 >> 172.21.15.80:0/4236150549 conn(0x7f147407a580 msgr2=0x7f14741021a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:28.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.127+0000 7f14792be700 1 -- 172.21.15.80:0/4236150549 shutdown_connections 2024-04-26T18:34:28.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.127+0000 7f14792be700 1 -- 172.21.15.80:0/4236150549 wait complete. 2024-04-26T18:34:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.321+0000 7fd75d87b700 1 -- 172.21.15.80:0/1899574340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd758102d10 msgr2=0x7fd75810f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.321+0000 7fd75d87b700 1 --2- 172.21.15.80:0/1899574340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd758102d10 0x7fd75810f200 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd75000b0a0 tx=0x7fd75000b3b0 comp rx=0 tx=0).stop 2024-04-26T18:34:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.321+0000 7fd75d87b700 1 -- 172.21.15.80:0/1899574340 shutdown_connections 2024-04-26T18:34:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.321+0000 7fd75d87b700 1 --2- 172.21.15.80:0/1899574340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd758102d10 0x7fd75810f200 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.321+0000 7fd75d87b700 1 --2- 172.21.15.80:0/1899574340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7581083c0 0x7fd7581087a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.321+0000 7fd75d87b700 1 --2- 172.21.15.80:0/1899574340 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd758102350 0x7fd7581027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.321+0000 7fd75d87b700 1 -- 172.21.15.80:0/1899574340 >> 172.21.15.80:0/1899574340 conn(0x7fd758079360 msgr2=0x7fd758079770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.321+0000 7fd75d87b700 1 -- 172.21.15.80:0/1899574340 shutdown_connections 2024-04-26T18:34:28.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.321+0000 7fd75d87b700 1 -- 172.21.15.80:0/1899574340 wait complete. 2024-04-26T18:34:28.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.322+0000 7fd75d87b700 1 Processor -- start 2024-04-26T18:34:28.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.322+0000 7fd75d87b700 1 -- start start 2024-04-26T18:34:28.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.322+0000 7fd75d87b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd758102350 0x7fd75819e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.322+0000 7fd75d87b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd758102d10 0x7fd75819ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.322+0000 7fd75d87b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7581083c0 0x7fd7581988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.322+0000 7fd75d87b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd758112560 con 0x7fd758102d10 2024-04-26T18:34:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.322+0000 7fd75d87b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd7581123e0 con 0x7fd758102350 2024-04-26T18:34:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.322+0000 7fd75d87b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd7581126e0 con 0x7fd7581083c0 2024-04-26T18:34:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.322+0000 7fd7567fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd758102d10 0x7fd75819ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.322+0000 7fd7567fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd758102d10 0x7fd75819ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55876/0 (socket says 172.21.15.80:55876) 2024-04-26T18:34:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.322+0000 7fd7567fc700 1 -- 172.21.15.80:0/1402445065 learned_addr learned my addr 172.21.15.80:0/1402445065 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.322+0000 7fd756ffd700 1 --2- 172.21.15.80:0/1402445065 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd758102350 0x7fd75819e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.322+0000 7fd7577fe700 1 --2- 172.21.15.80:0/1402445065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7581083c0 0x7fd7581988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.323+0000 7fd7567fc700 1 -- 172.21.15.80:0/1402445065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7581083c0 msgr2=0x7fd7581988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.323+0000 7fd7567fc700 1 --2- 172.21.15.80:0/1402445065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7581083c0 0x7fd7581988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.323+0000 7fd7567fc700 1 -- 172.21.15.80:0/1402445065 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd758102350 msgr2=0x7fd75819e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.323+0000 7fd7567fc700 1 --2- 172.21.15.80:0/1402445065 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd758102350 0x7fd75819e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.323+0000 7fd7567fc700 1 -- 172.21.15.80:0/1402445065 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd758199020 con 0x7fd758102d10 2024-04-26T18:34:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.323+0000 7fd7567fc700 1 --2- 172.21.15.80:0/1402445065 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd758102d10 0x7fd75819ec40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd74800d9e0 tx=0x7fd74800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.323+0000 7fd75c879700 1 -- 172.21.15.80:0/1402445065 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74801b070 con 0x7fd758102d10 2024-04-26T18:34:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.323+0000 7fd75d87b700 1 -- 172.21.15.80:0/1402445065 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd758199310 con 0x7fd758102d10 2024-04-26T18:34:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.323+0000 7fd75c879700 1 -- 172.21.15.80:0/1402445065 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd74800ec50 con 0x7fd758102d10 2024-04-26T18:34:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.323+0000 7fd75c879700 1 -- 172.21.15.80:0/1402445065 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd748014630 con 0x7fd758102d10 2024-04-26T18:34:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.323+0000 7fd75d87b700 1 -- 172.21.15.80:0/1402445065 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd75806baf0 con 0x7fd758102d10 2024-04-26T18:34:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.324+0000 7fd75d87b700 1 -- 172.21.15.80:0/1402445065 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd75806c0e0 con 0x7fd758102d10 2024-04-26T18:34:28.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.325+0000 7fd75c879700 1 -- 172.21.15.80:0/1402445065 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fd74801e070 con 0x7fd758102d10 2024-04-26T18:34:28.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.325+0000 7fd75c879700 1 --2- 172.21.15.80:0/1402445065 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd7440a3cd0 0x7fd7440a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:28.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.326+0000 7fd756ffd700 1 --2- 172.21.15.80:0/1402445065 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd7440a3cd0 0x7fd7440a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:28.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.326+0000 7fd75c879700 1 -- 172.21.15.80:0/1402445065 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fd7480d1960 con 0x7fd758102d10 2024-04-26T18:34:28.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.326+0000 7fd75c879700 1 --2- 172.21.15.80:0/1402445065 >> [v2:172.21.15.82:6808/2068291934,v1:172.21.15.82:6809/2068291934] conn(0x7fd7440ad790 0x7fd7440afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:28.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.326+0000 7fd75c879700 1 -- 172.21.15.80:0/1402445065 --> [v2:172.21.15.82:6808/2068291934,v1:172.21.15.82:6809/2068291934] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd7440b0300 con 0x7fd7440ad790 2024-04-26T18:34:28.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.326+0000 7fd75c879700 1 -- 172.21.15.80:0/1402445065 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fd7480d62c0 con 0x7fd758102d10 2024-04-26T18:34:28.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.326+0000 7fd756ffd700 1 --2- 172.21.15.80:0/1402445065 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd7440a3cd0 0x7fd7440a6190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd758199a00 tx=0x7fd74000b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:28.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.326+0000 7fd7577fe700 1 --2- 172.21.15.80:0/1402445065 >> [v2:172.21.15.82:6808/2068291934,v1:172.21.15.82:6809/2068291934] conn(0x7fd7440ad790 0x7fd7440afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:28.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.326+0000 7fd7577fe700 1 --2- 172.21.15.80:0/1402445065 >> [v2:172.21.15.82:6808/2068291934,v1:172.21.15.82:6809/2068291934] conn(0x7fd7440ad790 0x7fd7440afc30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:28.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.327+0000 7fd75c879700 1 -- 172.21.15.80:0/1402445065 <== osd.4 v2:172.21.15.82:6808/2068291934 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd7440b0300 con 0x7fd7440ad790 2024-04-26T18:34:28.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.347+0000 7fd75d87b700 1 -- 172.21.15.80:0/1402445065 --> [v2:172.21.15.82:6808/2068291934,v1:172.21.15.82:6809/2068291934] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd75806c4e0 con 0x7fd7440ad790 2024-04-26T18:34:28.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.347+0000 7fd75c879700 1 -- 172.21.15.80:0/1402445065 <== osd.4 v2:172.21.15.82:6808/2068291934 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd75806c4e0 con 0x7fd7440ad790 2024-04-26T18:34:28.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.347+0000 7fd75d87b700 1 -- 172.21.15.80:0/1402445065 >> [v2:172.21.15.82:6808/2068291934,v1:172.21.15.82:6809/2068291934] conn(0x7fd7440ad790 msgr2=0x7fd7440afc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:28.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.347+0000 7fd75d87b700 1 --2- 172.21.15.80:0/1402445065 >> [v2:172.21.15.82:6808/2068291934,v1:172.21.15.82:6809/2068291934] conn(0x7fd7440ad790 0x7fd7440afc30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:28.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.348+0000 7fd75d87b700 1 -- 172.21.15.80:0/1402445065 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd7440a3cd0 msgr2=0x7fd7440a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:28.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.348+0000 7fd75d87b700 1 --2- 172.21.15.80:0/1402445065 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd7440a3cd0 0x7fd7440a6190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd758199a00 tx=0x7fd74000b410 comp rx=0 tx=0).stop 2024-04-26T18:34:28.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.348+0000 7fd75d87b700 1 -- 172.21.15.80:0/1402445065 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd758102d10 msgr2=0x7fd75819ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:28.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.348+0000 7fd75d87b700 1 --2- 172.21.15.80:0/1402445065 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd758102d10 0x7fd75819ec40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd74800d9e0 tx=0x7fd74800dcf0 comp rx=0 tx=0).stop 2024-04-26T18:34:28.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.348+0000 7fd7577fe700 1 -- 172.21.15.80:0/1402445065 reap_dead start 2024-04-26T18:34:28.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.348+0000 7fd75d87b700 1 -- 172.21.15.80:0/1402445065 shutdown_connections 2024-04-26T18:34:28.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.348+0000 7fd75d87b700 1 -- 172.21.15.80:0/1402445065 >> 172.21.15.80:0/1402445065 conn(0x7fd758079360 msgr2=0x7fd7581010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:28.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.348+0000 7fd75d87b700 1 -- 172.21.15.80:0/1402445065 shutdown_connections 2024-04-26T18:34:28.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:28.348+0000 7fd75d87b700 1 -- 172.21.15.80:0/1402445065 wait complete. 2024-04-26T18:34:28.911 INFO:teuthology.orchestra.run.smithi080.stdout:347892351008 2024-04-26T18:34:28.912 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-04-26T18:34:29.568 INFO:teuthology.orchestra.run.smithi080.stdout:146028888133 2024-04-26T18:34:29.568 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-26T18:34:29.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:29 smithi192 ceph-mon[32842]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-04-26T18:34:29.868 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:29 smithi080 ceph-mon[29135]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-04-26T18:34:29.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:29 smithi082 ceph-mon[32808]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-04-26T18:34:30.528 INFO:teuthology.orchestra.run.smithi080.stdout:292057776171 2024-04-26T18:34:30.528 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-04-26T18:34:30.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.868+0000 7f96432e1700 1 -- 172.21.15.80:0/647512819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f963c108470 msgr2=0x7f963c108850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:30.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.868+0000 7f96432e1700 1 --2- 172.21.15.80:0/647512819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f963c108470 0x7f963c108850 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9638009990 tx=0x7f9638009ca0 comp rx=0 tx=0).stop 2024-04-26T18:34:30.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.868+0000 7f96432e1700 1 -- 172.21.15.80:0/647512819 shutdown_connections 2024-04-26T18:34:30.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.868+0000 7f96432e1700 1 --2- 172.21.15.80:0/647512819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f963c102fc0 0x7f963c10f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:30.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.868+0000 7f96432e1700 1 --2- 172.21.15.80:0/647512819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f963c108470 0x7f963c108850 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:30.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.868+0000 7f96432e1700 1 --2- 172.21.15.80:0/647512819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f963c102600 0x7f963c102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:30.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.868+0000 7f96432e1700 1 -- 172.21.15.80:0/647512819 >> 172.21.15.80:0/647512819 conn(0x7f963c079210 msgr2=0x7f963c079620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:30.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.869+0000 7f96432e1700 1 -- 172.21.15.80:0/647512819 shutdown_connections 2024-04-26T18:34:30.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.869+0000 7f96432e1700 1 -- 172.21.15.80:0/647512819 wait complete. 2024-04-26T18:34:30.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.869+0000 7f96432e1700 1 Processor -- start 2024-04-26T18:34:30.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.869+0000 7f96432e1700 1 -- start start 2024-04-26T18:34:30.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.869+0000 7f96432e1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f963c102600 0x7f963c19e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:30.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.869+0000 7f96432e1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f963c102fc0 0x7f963c19ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:30.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.869+0000 7f96432e1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f963c108470 0x7f963c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:30.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.870+0000 7f96432e1700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f963c112610 con 0x7f963c108470 2024-04-26T18:34:30.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.870+0000 7f96432e1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f963c112490 con 0x7f963c102600 2024-04-26T18:34:30.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.870+0000 7f96432e1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f963c112790 con 0x7f963c102fc0 2024-04-26T18:34:30.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.870+0000 7f964187e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f963c108470 0x7f963c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:30.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.870+0000 7f964187e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f963c108470 0x7f963c198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55888/0 (socket says 172.21.15.80:55888) 2024-04-26T18:34:30.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.870+0000 7f964187e700 1 -- 172.21.15.80:0/2088837633 learned_addr learned my addr 172.21.15.80:0/2088837633 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:30.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.870+0000 7f964107d700 1 --2- 172.21.15.80:0/2088837633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f963c102600 0x7f963c19e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:30.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.870+0000 7f964087c700 1 --2- 172.21.15.80:0/2088837633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f963c102fc0 0x7f963c19ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:30.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.870+0000 7f964187e700 1 -- 172.21.15.80:0/2088837633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f963c102fc0 msgr2=0x7f963c19ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:30.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.870+0000 7f964187e700 1 --2- 172.21.15.80:0/2088837633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f963c102fc0 0x7f963c19ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:30.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.870+0000 7f964187e700 1 -- 172.21.15.80:0/2088837633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f963c102600 msgr2=0x7f963c19e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:30.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.870+0000 7f964187e700 1 --2- 172.21.15.80:0/2088837633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f963c102600 0x7f963c19e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:30.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.870+0000 7f964187e700 1 -- 172.21.15.80:0/2088837633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f963c199070 con 0x7f963c108470 2024-04-26T18:34:30.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.870+0000 7f964187e700 1 --2- 172.21.15.80:0/2088837633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f963c108470 0x7f963c198910 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f963400b970 tx=0x7f963400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:30.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.870+0000 7f96327fc700 1 -- 172.21.15.80:0/2088837633 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9634019070 con 0x7f963c108470 2024-04-26T18:34:30.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.870+0000 7f96432e1700 1 -- 172.21.15.80:0/2088837633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f963c199360 con 0x7f963c108470 2024-04-26T18:34:30.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.870+0000 7f96327fc700 1 -- 172.21.15.80:0/2088837633 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9634014440 con 0x7f963c108470 2024-04-26T18:34:30.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.870+0000 7f96327fc700 1 -- 172.21.15.80:0/2088837633 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963400ce60 con 0x7f963c108470 2024-04-26T18:34:30.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.870+0000 7f96432e1700 1 -- 172.21.15.80:0/2088837633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f963c1a5620 con 0x7f963c108470 2024-04-26T18:34:30.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.871+0000 7f96432e1700 1 -- 172.21.15.80:0/2088837633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f963c063b30 con 0x7f963c108470 2024-04-26T18:34:30.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.872+0000 7f96327fc700 1 -- 172.21.15.80:0/2088837633 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f963401c070 con 0x7f963c108470 2024-04-26T18:34:30.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.873+0000 7f96327fc700 1 --2- 172.21.15.80:0/2088837633 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f96280a3cd0 0x7f96280a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:30.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.873+0000 7f964107d700 1 --2- 172.21.15.80:0/2088837633 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f96280a3cd0 0x7f96280a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:30.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.873+0000 7f96327fc700 1 -- 172.21.15.80:0/2088837633 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f96340cff70 con 0x7f963c108470 2024-04-26T18:34:30.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.873+0000 7f96327fc700 1 --2- 172.21.15.80:0/2088837633 >> [v2:172.21.15.192:6808/1770809727,v1:172.21.15.192:6809/1770809727] conn(0x7f96280ad790 0x7f96280afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:30.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.873+0000 7f96327fc700 1 -- 172.21.15.80:0/2088837633 --> [v2:172.21.15.192:6808/1770809727,v1:172.21.15.192:6809/1770809727] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f96280b0300 con 0x7f96280ad790 2024-04-26T18:34:30.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.873+0000 7f96327fc700 1 -- 172.21.15.80:0/2088837633 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f96340d0450 con 0x7f963c108470 2024-04-26T18:34:30.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.873+0000 7f964107d700 1 --2- 172.21.15.80:0/2088837633 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f96280a3cd0 0x7f96280a6190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f963800b5c0 tx=0x7f9638005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:30.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.873+0000 7f964087c700 1 --2- 172.21.15.80:0/2088837633 >> [v2:172.21.15.192:6808/1770809727,v1:172.21.15.192:6809/1770809727] conn(0x7f96280ad790 0x7f96280afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:30.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.874+0000 7f964087c700 1 --2- 172.21.15.80:0/2088837633 >> [v2:172.21.15.192:6808/1770809727,v1:172.21.15.192:6809/1770809727] conn(0x7f96280ad790 0x7f96280afc30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:30.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.875+0000 7f96327fc700 1 -- 172.21.15.80:0/2088837633 <== osd.5 v2:172.21.15.192:6808/1770809727 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f96280b0300 con 0x7f96280ad790 2024-04-26T18:34:30.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.891+0000 7f96432e1700 1 -- 172.21.15.80:0/2088837633 --> [v2:172.21.15.192:6808/1770809727,v1:172.21.15.192:6809/1770809727] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f963c063f30 con 0x7f96280ad790 2024-04-26T18:34:30.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.892+0000 7f96327fc700 1 -- 172.21.15.80:0/2088837633 <== osd.5 v2:172.21.15.192:6808/1770809727 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f963c063f30 con 0x7f96280ad790 2024-04-26T18:34:30.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.892+0000 7f96432e1700 1 -- 172.21.15.80:0/2088837633 >> [v2:172.21.15.192:6808/1770809727,v1:172.21.15.192:6809/1770809727] conn(0x7f96280ad790 msgr2=0x7f96280afc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:30.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.892+0000 7f96432e1700 1 --2- 172.21.15.80:0/2088837633 >> [v2:172.21.15.192:6808/1770809727,v1:172.21.15.192:6809/1770809727] conn(0x7f96280ad790 0x7f96280afc30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:30.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.892+0000 7f96432e1700 1 -- 172.21.15.80:0/2088837633 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f96280a3cd0 msgr2=0x7f96280a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:30.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.892+0000 7f96432e1700 1 --2- 172.21.15.80:0/2088837633 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f96280a3cd0 0x7f96280a6190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f963800b5c0 tx=0x7f9638005fb0 comp rx=0 tx=0).stop 2024-04-26T18:34:30.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.892+0000 7f96432e1700 1 -- 172.21.15.80:0/2088837633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f963c108470 msgr2=0x7f963c198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:30.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.892+0000 7f96432e1700 1 --2- 172.21.15.80:0/2088837633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f963c108470 0x7f963c198910 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f963400b970 tx=0x7f963400bd30 comp rx=0 tx=0).stop 2024-04-26T18:34:30.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.892+0000 7f964187e700 1 -- 172.21.15.80:0/2088837633 reap_dead start 2024-04-26T18:34:30.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.892+0000 7f96432e1700 1 -- 172.21.15.80:0/2088837633 shutdown_connections 2024-04-26T18:34:30.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.893+0000 7f96432e1700 1 -- 172.21.15.80:0/2088837633 >> 172.21.15.80:0/2088837633 conn(0x7f963c079210 msgr2=0x7f963c1012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:30.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.893+0000 7f96432e1700 1 -- 172.21.15.80:0/2088837633 shutdown_connections 2024-04-26T18:34:30.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:29.893+0000 7f96432e1700 1 -- 172.21.15.80:0/2088837633 wait complete. 2024-04-26T18:34:31.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.082+0000 7fb6ff0e9700 1 -- 172.21.15.80:0/2689350669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f8102310 msgr2=0x7fb6f8102790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:31.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.082+0000 7fb6ff0e9700 1 --2- 172.21.15.80:0/2689350669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f8102310 0x7fb6f8102790 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8009990 tx=0x7fb6e8009ca0 comp rx=0 tx=0).stop 2024-04-26T18:34:31.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.082+0000 7fb6ff0e9700 1 -- 172.21.15.80:0/2689350669 shutdown_connections 2024-04-26T18:34:31.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.082+0000 7fb6ff0e9700 1 --2- 172.21.15.80:0/2689350669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6f8102cd0 0x7fb6f810f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:31.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.082+0000 7fb6ff0e9700 1 --2- 172.21.15.80:0/2689350669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6f8108380 0x7fb6f8108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:31.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.082+0000 7fb6ff0e9700 1 --2- 172.21.15.80:0/2689350669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f8102310 0x7fb6f8102790 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:31.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.082+0000 7fb6ff0e9700 1 -- 172.21.15.80:0/2689350669 >> 172.21.15.80:0/2689350669 conn(0x7fb6f8079290 msgr2=0x7fb6f80796a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:31.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.082+0000 7fb6ff0e9700 1 -- 172.21.15.80:0/2689350669 shutdown_connections 2024-04-26T18:34:31.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.082+0000 7fb6ff0e9700 1 -- 172.21.15.80:0/2689350669 wait complete. 2024-04-26T18:34:31.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.082+0000 7fb6ff0e9700 1 Processor -- start 2024-04-26T18:34:31.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.083+0000 7fb6ff0e9700 1 -- start start 2024-04-26T18:34:31.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.083+0000 7fb6ff0e9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6f8102310 0x7fb6f819f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:31.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.083+0000 7fb6ff0e9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f8102cd0 0x7fb6f819fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:31.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.083+0000 7fb6ff0e9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6f8108380 0x7fb6f81998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:31.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.083+0000 7fb6ff0e9700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f81124c0 con 0x7fb6f8102cd0 2024-04-26T18:34:31.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.083+0000 7fb6ff0e9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f8112340 con 0x7fb6f8102310 2024-04-26T18:34:31.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.083+0000 7fb6ff0e9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f8112640 con 0x7fb6f8108380 2024-04-26T18:34:31.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.083+0000 7fb6f7fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f8102cd0 0x7fb6f819fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:31.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.083+0000 7fb6f7fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f8102cd0 0x7fb6f819fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55904/0 (socket says 172.21.15.80:55904) 2024-04-26T18:34:31.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.083+0000 7fb6f7fff700 1 -- 172.21.15.80:0/3174747904 learned_addr learned my addr 172.21.15.80:0/3174747904 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:31.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.083+0000 7fb6fce85700 1 --2- 172.21.15.80:0/3174747904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6f8102310 0x7fb6f819f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:31.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.083+0000 7fb6fd686700 1 --2- 172.21.15.80:0/3174747904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6f8108380 0x7fb6f81998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:31.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.083+0000 7fb6f7fff700 1 -- 172.21.15.80:0/3174747904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6f8108380 msgr2=0x7fb6f81998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:31.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.083+0000 7fb6f7fff700 1 --2- 172.21.15.80:0/3174747904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6f8108380 0x7fb6f81998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:31.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.083+0000 7fb6f7fff700 1 -- 172.21.15.80:0/3174747904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6f8102310 msgr2=0x7fb6f819f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:31.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.083+0000 7fb6f7fff700 1 --2- 172.21.15.80:0/3174747904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6f8102310 0x7fb6f819f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:31.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.083+0000 7fb6f7fff700 1 -- 172.21.15.80:0/3174747904 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6f819a030 con 0x7fb6f8102cd0 2024-04-26T18:34:31.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.083+0000 7fb6fd686700 1 --2- 172.21.15.80:0/3174747904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6f8108380 0x7fb6f81998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:34:31.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.083+0000 7fb6f7fff700 1 --2- 172.21.15.80:0/3174747904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f8102cd0 0x7fb6f819fc50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8000c00 tx=0x7fb6e80047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:31.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.084+0000 7fb6f5ffb700 1 -- 172.21.15.80:0/3174747904 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e8027070 con 0x7fb6f8102cd0 2024-04-26T18:34:31.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.084+0000 7fb6ff0e9700 1 -- 172.21.15.80:0/3174747904 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6f819a2c0 con 0x7fb6f8102cd0 2024-04-26T18:34:31.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.084+0000 7fb6f5ffb700 1 -- 172.21.15.80:0/3174747904 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6e8003f20 con 0x7fb6f8102cd0 2024-04-26T18:34:31.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.084+0000 7fb6f5ffb700 1 -- 172.21.15.80:0/3174747904 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e8022cf0 con 0x7fb6f8102cd0 2024-04-26T18:34:31.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.084+0000 7fb6ff0e9700 1 -- 172.21.15.80:0/3174747904 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6f81a65e0 con 0x7fb6f8102cd0 2024-04-26T18:34:31.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.085+0000 7fb6ff0e9700 1 -- 172.21.15.80:0/3174747904 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb6f8106480 con 0x7fb6f8102cd0 2024-04-26T18:34:31.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.086+0000 7fb6f5ffb700 1 -- 172.21.15.80:0/3174747904 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb6e802a070 con 0x7fb6f8102cd0 2024-04-26T18:34:31.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.086+0000 7fb6f5ffb700 1 --2- 172.21.15.80:0/3174747904 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb6e40a3cd0 0x7fb6e40a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:31.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.086+0000 7fb6fce85700 1 --2- 172.21.15.80:0/3174747904 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb6e40a3cd0 0x7fb6e40a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:31.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.087+0000 7fb6f5ffb700 1 -- 172.21.15.80:0/3174747904 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fb6e80d1970 con 0x7fb6f8102cd0 2024-04-26T18:34:31.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.087+0000 7fb6f5ffb700 1 --2- 172.21.15.80:0/3174747904 >> [v2:172.21.15.82:6800/3913033849,v1:172.21.15.82:6801/3913033849] conn(0x7fb6e40ad790 0x7fb6e40afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:31.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.087+0000 7fb6f5ffb700 1 -- 172.21.15.80:0/3174747904 --> [v2:172.21.15.82:6800/3913033849,v1:172.21.15.82:6801/3913033849] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb6e80095d0 con 0x7fb6e40ad790 2024-04-26T18:34:31.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.087+0000 7fb6f5ffb700 1 -- 172.21.15.80:0/3174747904 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fb6e80d1dc0 con 0x7fb6f8102cd0 2024-04-26T18:34:31.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.087+0000 7fb6fce85700 1 --2- 172.21.15.80:0/3174747904 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb6e40a3cd0 0x7fb6e40a6190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb6f819aa10 tx=0x7fb6f0009180 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:31.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.087+0000 7fb6fd686700 1 --2- 172.21.15.80:0/3174747904 >> [v2:172.21.15.82:6800/3913033849,v1:172.21.15.82:6801/3913033849] conn(0x7fb6e40ad790 0x7fb6e40afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:31.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.087+0000 7fb6fd686700 1 --2- 172.21.15.80:0/3174747904 >> [v2:172.21.15.82:6800/3913033849,v1:172.21.15.82:6801/3913033849] conn(0x7fb6e40ad790 0x7fb6e40afc30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:31.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.088+0000 7fb6f5ffb700 1 -- 172.21.15.80:0/3174747904 <== osd.1 v2:172.21.15.82:6800/3913033849 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb6e80095d0 con 0x7fb6e40ad790 2024-04-26T18:34:31.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.104+0000 7fb6ff0e9700 1 -- 172.21.15.80:0/3174747904 --> [v2:172.21.15.82:6800/3913033849,v1:172.21.15.82:6801/3913033849] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb6f8103a30 con 0x7fb6e40ad790 2024-04-26T18:34:31.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.105+0000 7fb6f5ffb700 1 -- 172.21.15.80:0/3174747904 <== osd.1 v2:172.21.15.82:6800/3913033849 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb6f8103a30 con 0x7fb6e40ad790 2024-04-26T18:34:31.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.105+0000 7fb6ff0e9700 1 -- 172.21.15.80:0/3174747904 >> [v2:172.21.15.82:6800/3913033849,v1:172.21.15.82:6801/3913033849] conn(0x7fb6e40ad790 msgr2=0x7fb6e40afc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:31.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.105+0000 7fb6ff0e9700 1 --2- 172.21.15.80:0/3174747904 >> [v2:172.21.15.82:6800/3913033849,v1:172.21.15.82:6801/3913033849] conn(0x7fb6e40ad790 0x7fb6e40afc30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:31.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.105+0000 7fb6ff0e9700 1 -- 172.21.15.80:0/3174747904 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb6e40a3cd0 msgr2=0x7fb6e40a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:31.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.105+0000 7fb6ff0e9700 1 --2- 172.21.15.80:0/3174747904 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb6e40a3cd0 0x7fb6e40a6190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb6f819aa10 tx=0x7fb6f0009180 comp rx=0 tx=0).stop 2024-04-26T18:34:31.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.105+0000 7fb6ff0e9700 1 -- 172.21.15.80:0/3174747904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f8102cd0 msgr2=0x7fb6f819fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:31.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.105+0000 7fb6ff0e9700 1 --2- 172.21.15.80:0/3174747904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f8102cd0 0x7fb6f819fc50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8000c00 tx=0x7fb6e80047b0 comp rx=0 tx=0).stop 2024-04-26T18:34:31.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.105+0000 7fb6fd686700 1 -- 172.21.15.80:0/3174747904 reap_dead start 2024-04-26T18:34:31.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.106+0000 7fb6ff0e9700 1 -- 172.21.15.80:0/3174747904 shutdown_connections 2024-04-26T18:34:31.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.106+0000 7fb6ff0e9700 1 -- 172.21.15.80:0/3174747904 >> 172.21.15.80:0/3174747904 conn(0x7fb6f8079290 msgr2=0x7fb6f81016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:31.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.106+0000 7fb6ff0e9700 1 -- 172.21.15.80:0/3174747904 shutdown_connections 2024-04-26T18:34:31.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.106+0000 7fb6ff0e9700 1 -- 172.21.15.80:0/3174747904 wait complete. 2024-04-26T18:34:31.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.289+0000 7f26212df700 1 -- 172.21.15.80:0/468832685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f261c102f60 msgr2=0x7f261c106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:31.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.289+0000 7f26212df700 1 --2- 172.21.15.80:0/468832685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f261c102f60 0x7f261c106f60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f260c0099c0 tx=0x7f260c009cd0 comp rx=0 tx=0).stop 2024-04-26T18:34:31.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.289+0000 7f26212df700 1 -- 172.21.15.80:0/468832685 shutdown_connections 2024-04-26T18:34:31.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.289+0000 7f26212df700 1 --2- 172.21.15.80:0/468832685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f261c107640 0x7f261c10f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:31.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.289+0000 7f26212df700 1 --2- 172.21.15.80:0/468832685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f261c1025b0 0x7f261c102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:31.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.289+0000 7f26212df700 1 --2- 172.21.15.80:0/468832685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f261c102f60 0x7f261c106f60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:31.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.289+0000 7f26212df700 1 -- 172.21.15.80:0/468832685 >> 172.21.15.80:0/468832685 conn(0x7f261c0792d0 msgr2=0x7f261c0796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:31.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.289+0000 7f26212df700 1 -- 172.21.15.80:0/468832685 shutdown_connections 2024-04-26T18:34:31.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.289+0000 7f26212df700 1 -- 172.21.15.80:0/468832685 wait complete. 2024-04-26T18:34:31.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.290+0000 7f26212df700 1 Processor -- start 2024-04-26T18:34:31.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.290+0000 7f26212df700 1 -- start start 2024-04-26T18:34:31.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.290+0000 7f26212df700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f261c1025b0 0x7f261c19a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:31.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.290+0000 7f26212df700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f261c102f60 0x7f261c19ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:31.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.290+0000 7f26212df700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f261c107640 0x7f261c1a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:31.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.290+0000 7f26212df700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f261c1124d0 con 0x7f261c1025b0 2024-04-26T18:34:31.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.290+0000 7f26212df700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f261c112350 con 0x7f261c102f60 2024-04-26T18:34:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.290+0000 7f26212df700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f261c112650 con 0x7f261c107640 2024-04-26T18:34:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.290+0000 7f261affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f261c1025b0 0x7f261c19a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.290+0000 7f261affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f261c1025b0 0x7f261c19a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55922/0 (socket says 172.21.15.80:55922) 2024-04-26T18:34:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.290+0000 7f261affd700 1 -- 172.21.15.80:0/3207861423 learned_addr learned my addr 172.21.15.80:0/3207861423 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.290+0000 7f261a7fc700 1 --2- 172.21.15.80:0/3207861423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f261c102f60 0x7f261c19ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.291+0000 7f261b7fe700 1 --2- 172.21.15.80:0/3207861423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f261c107640 0x7f261c1a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.291+0000 7f261affd700 1 -- 172.21.15.80:0/3207861423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f261c107640 msgr2=0x7f261c1a59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.291+0000 7f261affd700 1 --2- 172.21.15.80:0/3207861423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f261c107640 0x7f261c1a59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.291+0000 7f261affd700 1 -- 172.21.15.80:0/3207861423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f261c102f60 msgr2=0x7f261c19ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.291+0000 7f261affd700 1 --2- 172.21.15.80:0/3207861423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f261c102f60 0x7f261c19ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.291+0000 7f261affd700 1 -- 172.21.15.80:0/3207861423 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f261c1a5ef0 con 0x7f261c1025b0 2024-04-26T18:34:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.291+0000 7f261affd700 1 --2- 172.21.15.80:0/3207861423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f261c1025b0 0x7f261c19a930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f261000c970 tx=0x7f261000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.291+0000 7f2603fff700 1 -- 172.21.15.80:0/3207861423 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26100078d0 con 0x7f261c1025b0 2024-04-26T18:34:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.291+0000 7f26212df700 1 -- 172.21.15.80:0/3207861423 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f261c1a6120 con 0x7f261c1025b0 2024-04-26T18:34:31.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.291+0000 7f2603fff700 1 -- 172.21.15.80:0/3207861423 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2610018480 con 0x7f261c1025b0 2024-04-26T18:34:31.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.291+0000 7f2603fff700 1 -- 172.21.15.80:0/3207861423 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261000f6b0 con 0x7f261c1025b0 2024-04-26T18:34:31.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.291+0000 7f26212df700 1 -- 172.21.15.80:0/3207861423 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f261c1a65e0 con 0x7f261c1025b0 2024-04-26T18:34:31.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.292+0000 7f26212df700 1 -- 172.21.15.80:0/3207861423 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f261c063af0 con 0x7f261c1025b0 2024-04-26T18:34:31.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.293+0000 7f2603fff700 1 -- 172.21.15.80:0/3207861423 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f2610018930 con 0x7f261c1025b0 2024-04-26T18:34:31.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.294+0000 7f2603fff700 1 --2- 172.21.15.80:0/3207861423 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f26040a3cd0 0x7f26040a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:31.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.294+0000 7f261a7fc700 1 --2- 172.21.15.80:0/3207861423 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f26040a3cd0 0x7f26040a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:31.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.294+0000 7f2603fff700 1 -- 172.21.15.80:0/3207861423 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f26100d0a90 con 0x7f261c1025b0 2024-04-26T18:34:31.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.294+0000 7f2603fff700 1 --2- 172.21.15.80:0/3207861423 >> [v2:172.21.15.80:6802/429487384,v1:172.21.15.80:6803/429487384] conn(0x7f26040ad790 0x7f26040afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:31.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.294+0000 7f2603fff700 1 -- 172.21.15.80:0/3207861423 --> [v2:172.21.15.80:6802/429487384,v1:172.21.15.80:6803/429487384] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f26040b0300 con 0x7f26040ad790 2024-04-26T18:34:31.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.294+0000 7f2603fff700 1 -- 172.21.15.80:0/3207861423 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f26100d0ee0 con 0x7f261c1025b0 2024-04-26T18:34:31.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.294+0000 7f261b7fe700 1 --2- 172.21.15.80:0/3207861423 >> [v2:172.21.15.80:6802/429487384,v1:172.21.15.80:6803/429487384] conn(0x7f26040ad790 0x7f26040afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:31.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.294+0000 7f261a7fc700 1 --2- 172.21.15.80:0/3207861423 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f26040a3cd0 0x7f26040a6190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f260c006010 tx=0x7f260c005c60 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:31.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.294+0000 7f261b7fe700 1 --2- 172.21.15.80:0/3207861423 >> [v2:172.21.15.80:6802/429487384,v1:172.21.15.80:6803/429487384] conn(0x7f26040ad790 0x7f26040afc30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:31.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.295+0000 7f2603fff700 1 -- 172.21.15.80:0/3207861423 <== osd.0 v2:172.21.15.80:6802/429487384 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f26040b0300 con 0x7f26040ad790 2024-04-26T18:34:31.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.313+0000 7f26212df700 1 -- 172.21.15.80:0/3207861423 --> [v2:172.21.15.80:6802/429487384,v1:172.21.15.80:6803/429487384] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f261c063f70 con 0x7f26040ad790 2024-04-26T18:34:31.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.313+0000 7f2603fff700 1 -- 172.21.15.80:0/3207861423 <== osd.0 v2:172.21.15.80:6802/429487384 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f261c063f70 con 0x7f26040ad790 2024-04-26T18:34:31.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.314+0000 7f26212df700 1 -- 172.21.15.80:0/3207861423 >> [v2:172.21.15.80:6802/429487384,v1:172.21.15.80:6803/429487384] conn(0x7f26040ad790 msgr2=0x7f26040afc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:31.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.314+0000 7f26212df700 1 --2- 172.21.15.80:0/3207861423 >> [v2:172.21.15.80:6802/429487384,v1:172.21.15.80:6803/429487384] conn(0x7f26040ad790 0x7f26040afc30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:31.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.314+0000 7f26212df700 1 -- 172.21.15.80:0/3207861423 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f26040a3cd0 msgr2=0x7f26040a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:31.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.314+0000 7f26212df700 1 --2- 172.21.15.80:0/3207861423 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f26040a3cd0 0x7f26040a6190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f260c006010 tx=0x7f260c005c60 comp rx=0 tx=0).stop 2024-04-26T18:34:31.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.314+0000 7f26212df700 1 -- 172.21.15.80:0/3207861423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f261c1025b0 msgr2=0x7f261c19a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:31.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.314+0000 7f26212df700 1 --2- 172.21.15.80:0/3207861423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f261c1025b0 0x7f261c19a930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f261000c970 tx=0x7f261000cc80 comp rx=0 tx=0).stop 2024-04-26T18:34:31.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.314+0000 7f261b7fe700 1 -- 172.21.15.80:0/3207861423 reap_dead start 2024-04-26T18:34:31.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.314+0000 7f26212df700 1 -- 172.21.15.80:0/3207861423 shutdown_connections 2024-04-26T18:34:31.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.314+0000 7f26212df700 1 -- 172.21.15.80:0/3207861423 >> 172.21.15.80:0/3207861423 conn(0x7f261c0792d0 msgr2=0x7f261c1003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:31.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.314+0000 7f26212df700 1 -- 172.21.15.80:0/3207861423 shutdown_connections 2024-04-26T18:34:31.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:31.314+0000 7f26212df700 1 -- 172.21.15.80:0/3207861423 wait complete. 2024-04-26T18:34:31.735 INFO:teuthology.orchestra.run.smithi080.stdout:167503724606 2024-04-26T18:34:31.735 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-26T18:34:31.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:31 smithi192 ceph-mon[32842]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:34:31.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:31 smithi082 ceph-mon[32808]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:34:31.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:31 smithi080 ceph-mon[29135]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:34:32.357 INFO:teuthology.orchestra.run.smithi080.stdout:55834574932 2024-04-26T18:34:32.357 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-26T18:34:32.594 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:32.594 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:33.161 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:33.174 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:33.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.190+0000 7f1da77fe700 1 -- 172.21.15.80:0/934741190 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d94004230 con 0x7f1da806bb20 2024-04-26T18:34:33.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.191+0000 7f1daec9d700 1 -- 172.21.15.80:0/934741190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1da806bb20 msgr2=0x7f1da806bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:33.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.191+0000 7f1daec9d700 1 --2- 172.21.15.80:0/934741190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1da806bb20 0x7f1da806bf80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009990 tx=0x7f1d94009ca0 comp rx=0 tx=0).stop 2024-04-26T18:34:33.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.191+0000 7f1daec9d700 1 -- 172.21.15.80:0/934741190 shutdown_connections 2024-04-26T18:34:33.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.191+0000 7f1daec9d700 1 --2- 172.21.15.80:0/934741190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1da806c4c0 0x7f1da8110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.191+0000 7f1daec9d700 1 --2- 172.21.15.80:0/934741190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1da81094d0 0x7f1da81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.191+0000 7f1daec9d700 1 --2- 172.21.15.80:0/934741190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1da806bb20 0x7f1da806bf80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.191+0000 7f1daec9d700 1 -- 172.21.15.80:0/934741190 >> 172.21.15.80:0/934741190 conn(0x7f1da8079360 msgr2=0x7f1da8079770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.191+0000 7f1daec9d700 1 -- 172.21.15.80:0/934741190 shutdown_connections 2024-04-26T18:34:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.191+0000 7f1daec9d700 1 -- 172.21.15.80:0/934741190 wait complete. 2024-04-26T18:34:33.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.192+0000 7f1daec9d700 1 Processor -- start 2024-04-26T18:34:33.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.192+0000 7f1daec9d700 1 -- start start 2024-04-26T18:34:33.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.192+0000 7f1daec9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1da806bb20 0x7f1da8102480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:33.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.192+0000 7f1daec9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1da806c4c0 0x7f1da81029c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:33.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.192+0000 7f1daec9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1da81094d0 0x7f1da8102f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:33.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.192+0000 7f1daec9d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1da81136e0 con 0x7f1da81094d0 2024-04-26T18:34:33.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.192+0000 7f1daec9d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1da8113560 con 0x7f1da806c4c0 2024-04-26T18:34:33.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.192+0000 7f1daec9d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1da8113860 con 0x7f1da806bb20 2024-04-26T18:34:33.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.194+0000 7f1dad23a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1da81094d0 0x7f1da8102f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:33.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.194+0000 7f1dad23a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1da81094d0 0x7f1da8102f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55942/0 (socket says 172.21.15.80:55942) 2024-04-26T18:34:33.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.194+0000 7f1dad23a700 1 -- 172.21.15.80:0/1085095227 learned_addr learned my addr 172.21.15.80:0/1085095227 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:33.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.194+0000 7f1da7fff700 1 --2- 172.21.15.80:0/1085095227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1da806c4c0 0x7f1da81029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:33.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.194+0000 7f1dad23a700 1 -- 172.21.15.80:0/1085095227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1da806bb20 msgr2=0x7f1da8102480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:33.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.194+0000 7f1dad23a700 1 --2- 172.21.15.80:0/1085095227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1da806bb20 0x7f1da8102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:33.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.194+0000 7f1dad23a700 1 -- 172.21.15.80:0/1085095227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1da806c4c0 msgr2=0x7f1da81029c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:33.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.194+0000 7f1dad23a700 1 --2- 172.21.15.80:0/1085095227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1da806c4c0 0x7f1da81029c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:33.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.194+0000 7f1dad23a700 1 -- 172.21.15.80:0/1085095227 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da819fc50 con 0x7f1da81094d0 2024-04-26T18:34:33.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.195+0000 7f1dad23a700 1 --2- 172.21.15.80:0/1085095227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1da81094d0 0x7f1da8102f00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1da0007d40 tx=0x7f1da000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:33.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.195+0000 7f1da5ffb700 1 -- 172.21.15.80:0/1085095227 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da0016020 con 0x7f1da81094d0 2024-04-26T18:34:33.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.195+0000 7f1da5ffb700 1 -- 172.21.15.80:0/1085095227 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1da000ad60 con 0x7f1da81094d0 2024-04-26T18:34:33.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.195+0000 7f1daec9d700 1 -- 172.21.15.80:0/1085095227 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da819ff40 con 0x7f1da81094d0 2024-04-26T18:34:33.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.196+0000 7f1da5ffb700 1 -- 172.21.15.80:0/1085095227 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da00115e0 con 0x7f1da81094d0 2024-04-26T18:34:33.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.196+0000 7f1daec9d700 1 -- 172.21.15.80:0/1085095227 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da81a03f0 con 0x7f1da81094d0 2024-04-26T18:34:33.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.197+0000 7f1daec9d700 1 -- 172.21.15.80:0/1085095227 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1da8063b30 con 0x7f1da81094d0 2024-04-26T18:34:33.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.199+0000 7f1da5ffb700 1 -- 172.21.15.80:0/1085095227 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f1da0019020 con 0x7f1da81094d0 2024-04-26T18:34:33.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.200+0000 7f1da5ffb700 1 --2- 172.21.15.80:0/1085095227 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f1d980a3ea0 0x7f1d980a6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:33.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.200+0000 7f1da5ffb700 1 -- 172.21.15.80:0/1085095227 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f1da00d0a10 con 0x7f1da81094d0 2024-04-26T18:34:33.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.201+0000 7f1da5ffb700 1 --2- 172.21.15.80:0/1085095227 >> [v2:172.21.15.192:6816/3763069187,v1:172.21.15.192:6817/3763069187] conn(0x7f1d980ad960 0x7f1d980afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:33.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.201+0000 7f1da5ffb700 1 -- 172.21.15.80:0/1085095227 --> [v2:172.21.15.192:6816/3763069187,v1:172.21.15.192:6817/3763069187] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1da0010ec0 con 0x7f1d980ad960 2024-04-26T18:34:33.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.201+0000 7f1da5ffb700 1 -- 172.21.15.80:0/1085095227 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f1da00d0e00 con 0x7f1da81094d0 2024-04-26T18:34:33.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.201+0000 7f1daca39700 1 --2- 172.21.15.80:0/1085095227 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f1d980a3ea0 0x7f1d980a6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:33.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.201+0000 7f1daca39700 1 --2- 172.21.15.80:0/1085095227 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f1d980a3ea0 0x7f1d980a6360 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c0097b0 tx=0x7f1d9c006d20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:33.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.202+0000 7f1da7fff700 1 --2- 172.21.15.80:0/1085095227 >> [v2:172.21.15.192:6816/3763069187,v1:172.21.15.192:6817/3763069187] conn(0x7f1d980ad960 0x7f1d980afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:33.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.204+0000 7f1da7fff700 1 --2- 172.21.15.80:0/1085095227 >> [v2:172.21.15.192:6816/3763069187,v1:172.21.15.192:6817/3763069187] conn(0x7f1d980ad960 0x7f1d980afe00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:33.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.206+0000 7f1da5ffb700 1 -- 172.21.15.80:0/1085095227 <== osd.8 v2:172.21.15.192:6816/3763069187 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1da0010ec0 con 0x7f1d980ad960 2024-04-26T18:34:33.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.223+0000 7f1daec9d700 1 -- 172.21.15.80:0/1085095227 --> [v2:172.21.15.192:6816/3763069187,v1:172.21.15.192:6817/3763069187] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1da8063fb0 con 0x7f1d980ad960 2024-04-26T18:34:33.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.223+0000 7f1da5ffb700 1 -- 172.21.15.80:0/1085095227 <== osd.8 v2:172.21.15.192:6816/3763069187 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1da8063fb0 con 0x7f1d980ad960 2024-04-26T18:34:33.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.224+0000 7f1daec9d700 1 -- 172.21.15.80:0/1085095227 >> [v2:172.21.15.192:6816/3763069187,v1:172.21.15.192:6817/3763069187] conn(0x7f1d980ad960 msgr2=0x7f1d980afe00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:33.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.224+0000 7f1daec9d700 1 --2- 172.21.15.80:0/1085095227 >> [v2:172.21.15.192:6816/3763069187,v1:172.21.15.192:6817/3763069187] conn(0x7f1d980ad960 0x7f1d980afe00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:33.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.224+0000 7f1daec9d700 1 -- 172.21.15.80:0/1085095227 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f1d980a3ea0 msgr2=0x7f1d980a6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:33.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.224+0000 7f1daec9d700 1 --2- 172.21.15.80:0/1085095227 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f1d980a3ea0 0x7f1d980a6360 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c0097b0 tx=0x7f1d9c006d20 comp rx=0 tx=0).stop 2024-04-26T18:34:33.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.224+0000 7f1daec9d700 1 -- 172.21.15.80:0/1085095227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1da81094d0 msgr2=0x7f1da8102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:33.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.224+0000 7f1daec9d700 1 --2- 172.21.15.80:0/1085095227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1da81094d0 0x7f1da8102f00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1da0007d40 tx=0x7f1da000a340 comp rx=0 tx=0).stop 2024-04-26T18:34:33.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.224+0000 7f1dad23a700 1 -- 172.21.15.80:0/1085095227 reap_dead start 2024-04-26T18:34:33.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.224+0000 7f1daec9d700 1 -- 172.21.15.80:0/1085095227 shutdown_connections 2024-04-26T18:34:33.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.224+0000 7f1daec9d700 1 -- 172.21.15.80:0/1085095227 >> 172.21.15.80:0/1085095227 conn(0x7f1da8079360 msgr2=0x7f1da8100400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:33.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.224+0000 7f1daec9d700 1 -- 172.21.15.80:0/1085095227 shutdown_connections 2024-04-26T18:34:33.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:33.224+0000 7f1daec9d700 1 -- 172.21.15.80:0/1085095227 wait complete. 2024-04-26T18:34:33.705 INFO:teuthology.orchestra.run.smithi080.stdout:34359738457 2024-04-26T18:34:33.706 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-26T18:34:33.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:33 smithi192 ceph-mon[32842]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-04-26T18:34:33.951 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:33 smithi080 ceph-mon[29135]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-04-26T18:34:33.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:33 smithi082 ceph-mon[32808]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-04-26T18:34:34.795 INFO:teuthology.orchestra.run.smithi080.stdout:257698037808 2024-04-26T18:34:34.796 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-04-26T18:34:35.680 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:35.861 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:35 smithi080 ceph-mon[29135]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:34:35.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:35 smithi192 ceph-mon[32842]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:34:35.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:35 smithi082 ceph-mon[32808]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:34:37.460 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:37.461 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:37.464 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:37.466 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:37.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:37 smithi082 ceph-mon[32808]: pgmap v344: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:34:37.975 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:37 smithi080 ceph-mon[29135]: pgmap v344: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:34:38.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:37 smithi192 ceph-mon[32842]: pgmap v344: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:34:39.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:39 smithi082 ceph-mon[32808]: pgmap v345: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:34:39.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:39 smithi080 ceph-mon[29135]: pgmap v345: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:34:40.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:39 smithi192 ceph-mon[32842]: pgmap v345: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:34:40.755 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:41.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:41 smithi080 ceph-mon[29135]: pgmap v346: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-26T18:34:41.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:41 smithi082 ceph-mon[32808]: pgmap v346: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-26T18:34:42.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:41 smithi192 ceph-mon[32842]: pgmap v346: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-26T18:34:42.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.364+0000 7f65e2ee3700 1 -- 172.21.15.80:0/2191662771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65dc102f60 msgr2=0x7f65dc106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:42.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.364+0000 7f65e2ee3700 1 --2- 172.21.15.80:0/2191662771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65dc102f60 0x7f65dc106f60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0099c0 tx=0x7f65cc009cd0 comp rx=0 tx=0).stop 2024-04-26T18:34:42.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.364+0000 7f65e2ee3700 1 -- 172.21.15.80:0/2191662771 shutdown_connections 2024-04-26T18:34:42.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.364+0000 7f65e2ee3700 1 --2- 172.21.15.80:0/2191662771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65dc107640 0x7f65dc10f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:42.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.364+0000 7f65e2ee3700 1 --2- 172.21.15.80:0/2191662771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65dc1025b0 0x7f65dc102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:42.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.364+0000 7f65e2ee3700 1 --2- 172.21.15.80:0/2191662771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65dc102f60 0x7f65dc106f60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:42.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.364+0000 7f65e2ee3700 1 -- 172.21.15.80:0/2191662771 >> 172.21.15.80:0/2191662771 conn(0x7f65dc0792f0 msgr2=0x7f65dc079700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:42.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.364+0000 7f65e2ee3700 1 -- 172.21.15.80:0/2191662771 shutdown_connections 2024-04-26T18:34:42.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.364+0000 7f65e2ee3700 1 -- 172.21.15.80:0/2191662771 wait complete. 2024-04-26T18:34:42.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.364+0000 7f65e2ee3700 1 Processor -- start 2024-04-26T18:34:42.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.364+0000 7f65e2ee3700 1 -- start start 2024-04-26T18:34:42.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.365+0000 7f65e2ee3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65dc1025b0 0x7f65dc19f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:42.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.365+0000 7f65e2ee3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65dc102f60 0x7f65dc19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:42.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.365+0000 7f65e2ee3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65dc107640 0x7f65dc1999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:42.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.365+0000 7f65e2ee3700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc112550 con 0x7f65dc102f60 2024-04-26T18:34:42.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.365+0000 7f65e2ee3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc1123d0 con 0x7f65dc107640 2024-04-26T18:34:42.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.365+0000 7f65e2ee3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc1126d0 con 0x7f65dc1025b0 2024-04-26T18:34:42.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.365+0000 7f65d3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65dc102f60 0x7f65dc19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:42.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.365+0000 7f65d3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65dc102f60 0x7f65dc19fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50784/0 (socket says 172.21.15.80:50784) 2024-04-26T18:34:42.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.365+0000 7f65d3fff700 1 -- 172.21.15.80:0/1435079805 learned_addr learned my addr 172.21.15.80:0/1435079805 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:42.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.365+0000 7f65d3fff700 1 -- 172.21.15.80:0/1435079805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65dc1025b0 msgr2=0x7f65dc19f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:42.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.365+0000 7f65d3fff700 1 --2- 172.21.15.80:0/1435079805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65dc1025b0 0x7f65dc19f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:42.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.365+0000 7f65d3fff700 1 -- 172.21.15.80:0/1435079805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65dc107640 msgr2=0x7f65dc1999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:42.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.365+0000 7f65e1480700 1 --2- 172.21.15.80:0/1435079805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65dc107640 0x7f65dc1999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:42.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.365+0000 7f65d3fff700 1 --2- 172.21.15.80:0/1435079805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65dc107640 0x7f65dc1999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:42.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.365+0000 7f65d3fff700 1 -- 172.21.15.80:0/1435079805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65dc19a140 con 0x7f65dc102f60 2024-04-26T18:34:42.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.365+0000 7f65d3fff700 1 --2- 172.21.15.80:0/1435079805 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65dc102f60 0x7f65dc19fd60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f65cc006010 tx=0x7f65cc00bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:42.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.365+0000 7f65d1ffb700 1 -- 172.21.15.80:0/1435079805 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc027070 con 0x7f65dc102f60 2024-04-26T18:34:42.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.365+0000 7f65d1ffb700 1 -- 172.21.15.80:0/1435079805 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65cc004020 con 0x7f65dc102f60 2024-04-26T18:34:42.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.365+0000 7f65d1ffb700 1 -- 172.21.15.80:0/1435079805 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc022d40 con 0x7f65dc102f60 2024-04-26T18:34:42.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.365+0000 7f65e2ee3700 1 -- 172.21.15.80:0/1435079805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65dc19a3d0 con 0x7f65dc102f60 2024-04-26T18:34:42.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.366+0000 7f65e2ee3700 1 -- 172.21.15.80:0/1435079805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65dc1a66f0 con 0x7f65dc102f60 2024-04-26T18:34:42.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.366+0000 7f65e2ee3700 1 -- 172.21.15.80:0/1435079805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65dc103a40 con 0x7f65dc102f60 2024-04-26T18:34:42.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.367+0000 7f65d1ffb700 1 -- 172.21.15.80:0/1435079805 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f65cc02a070 con 0x7f65dc102f60 2024-04-26T18:34:42.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.368+0000 7f65d1ffb700 1 --2- 172.21.15.80:0/1435079805 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f65c40a3cd0 0x7f65c40a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:42.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.368+0000 7f65e0c7f700 1 --2- 172.21.15.80:0/1435079805 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f65c40a3cd0 0x7f65c40a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:42.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.368+0000 7f65d1ffb700 1 -- 172.21.15.80:0/1435079805 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f65cc0d13e0 con 0x7f65dc102f60 2024-04-26T18:34:42.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.368+0000 7f65e0c7f700 1 --2- 172.21.15.80:0/1435079805 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f65c40a3cd0 0x7f65c40a6190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f65dc19ab20 tx=0x7f65d8006cd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:42.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.373+0000 7f65d1ffb700 1 -- 172.21.15.80:0/1435079805 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f65cc05eff0 con 0x7f65dc102f60 2024-04-26T18:34:42.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.588+0000 7f65e2ee3700 1 -- 172.21.15.80:0/1435079805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f65dc02e490 con 0x7f65dc102f60 2024-04-26T18:34:42.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.588+0000 7f65d1ffb700 1 -- 172.21.15.80:0/1435079805 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f65cc013070 con 0x7f65dc102f60 2024-04-26T18:34:42.589 INFO:teuthology.orchestra.run.smithi080.stdout:201863462973 2024-04-26T18:34:42.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.591+0000 7f65e2ee3700 1 -- 172.21.15.80:0/1435079805 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f65c40a3cd0 msgr2=0x7f65c40a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:42.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.591+0000 7f65e2ee3700 1 --2- 172.21.15.80:0/1435079805 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f65c40a3cd0 0x7f65c40a6190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f65dc19ab20 tx=0x7f65d8006cd0 comp rx=0 tx=0).stop 2024-04-26T18:34:42.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.591+0000 7f65e2ee3700 1 -- 172.21.15.80:0/1435079805 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65dc102f60 msgr2=0x7f65dc19fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:42.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.591+0000 7f65e2ee3700 1 --2- 172.21.15.80:0/1435079805 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65dc102f60 0x7f65dc19fd60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f65cc006010 tx=0x7f65cc00bfb0 comp rx=0 tx=0).stop 2024-04-26T18:34:42.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.591+0000 7f65e2ee3700 1 -- 172.21.15.80:0/1435079805 shutdown_connections 2024-04-26T18:34:42.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.591+0000 7f65e2ee3700 1 --2- 172.21.15.80:0/1435079805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65dc107640 0x7f65dc1999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:42.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.591+0000 7f65e2ee3700 1 --2- 172.21.15.80:0/1435079805 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f65c40a3cd0 0x7f65c40a6190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:42.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.591+0000 7f65e2ee3700 1 --2- 172.21.15.80:0/1435079805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65dc1025b0 0x7f65dc19f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:42.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.591+0000 7f65e2ee3700 1 --2- 172.21.15.80:0/1435079805 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65dc102f60 0x7f65dc19fd60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:42.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.591+0000 7f65e2ee3700 1 -- 172.21.15.80:0/1435079805 >> 172.21.15.80:0/1435079805 conn(0x7f65dc0792f0 msgr2=0x7f65dc06bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:42.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.591+0000 7f65e2ee3700 1 -- 172.21.15.80:0/1435079805 shutdown_connections 2024-04-26T18:34:42.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:42.591+0000 7f65e2ee3700 1 -- 172.21.15.80:0/1435079805 wait complete. 2024-04-26T18:34:42.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:42 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1435079805' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-26T18:34:42.930 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:42 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1435079805' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-26T18:34:42.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:42 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1435079805' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-26T18:34:43.365 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462969 got 201863462973 for osd.6 2024-04-26T18:34:43.365 DEBUG:teuthology.parallel:result is None 2024-04-26T18:34:43.923 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:43 smithi080 ceph-mon[29135]: pgmap v347: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:34:43.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:43 smithi082 ceph-mon[32808]: pgmap v347: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:34:44.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:43 smithi192 ceph-mon[32842]: pgmap v347: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:34:44.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.156+0000 7f6c70640700 1 -- 172.21.15.80:0/738040111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c68109480 msgr2=0x7f6c68109860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:44.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.156+0000 7f6c70640700 1 --2- 172.21.15.80:0/738040111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c68109480 0x7f6c68109860 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6c58009990 tx=0x7f6c58009ca0 comp rx=0 tx=0).stop 2024-04-26T18:34:44.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.156+0000 7f6c70640700 1 -- 172.21.15.80:0/738040111 shutdown_connections 2024-04-26T18:34:44.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.156+0000 7f6c70640700 1 --2- 172.21.15.80:0/738040111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c68103ea0 0x7f6c681102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:44.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.156+0000 7f6c70640700 1 --2- 172.21.15.80:0/738040111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c68109480 0x7f6c68109860 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:44.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.156+0000 7f6c70640700 1 --2- 172.21.15.80:0/738040111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c681034e0 0x7f6c68103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:44.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.156+0000 7f6c70640700 1 -- 172.21.15.80:0/738040111 >> 172.21.15.80:0/738040111 conn(0x7f6c6807a5e0 msgr2=0x7f6c6807a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:44.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.156+0000 7f6c70640700 1 -- 172.21.15.80:0/738040111 shutdown_connections 2024-04-26T18:34:44.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.156+0000 7f6c70640700 1 -- 172.21.15.80:0/738040111 wait complete. 2024-04-26T18:34:44.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.157+0000 7f6c70640700 1 Processor -- start 2024-04-26T18:34:44.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.157+0000 7f6c70640700 1 -- start start 2024-04-26T18:34:44.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.157+0000 7f6c70640700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c681034e0 0x7f6c6819fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:44.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.157+0000 7f6c70640700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c68103ea0 0x7f6c6819ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:44.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.157+0000 7f6c70640700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c68109480 0x7f6c68199b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:44.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.157+0000 7f6c70640700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6c681136b0 con 0x7f6c681034e0 2024-04-26T18:34:44.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.157+0000 7f6c70640700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6c68113530 con 0x7f6c68109480 2024-04-26T18:34:44.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.157+0000 7f6c70640700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6c68113830 con 0x7f6c68103ea0 2024-04-26T18:34:44.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.157+0000 7f6c6e3dc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c681034e0 0x7f6c6819fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:44.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.157+0000 7f6c6e3dc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c681034e0 0x7f6c6819fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46330/0 (socket says 172.21.15.80:46330) 2024-04-26T18:34:44.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.157+0000 7f6c6e3dc700 1 -- 172.21.15.80:0/186802045 learned_addr learned my addr 172.21.15.80:0/186802045 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:44.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.157+0000 7f6c6ebdd700 1 --2- 172.21.15.80:0/186802045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c68109480 0x7f6c68199b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:44.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.157+0000 7f6c6e3dc700 1 -- 172.21.15.80:0/186802045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c68103ea0 msgr2=0x7f6c6819ff90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T18:34:44.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.157+0000 7f6c6e3dc700 1 --2- 172.21.15.80:0/186802045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c68103ea0 0x7f6c6819ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:44.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.157+0000 7f6c6e3dc700 1 -- 172.21.15.80:0/186802045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c68109480 msgr2=0x7f6c68199b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:44.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.157+0000 7f6c6e3dc700 1 --2- 172.21.15.80:0/186802045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c68109480 0x7f6c68199b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:44.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.157+0000 7f6c6e3dc700 1 -- 172.21.15.80:0/186802045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6819a400 con 0x7f6c681034e0 2024-04-26T18:34:44.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.157+0000 7f6c6ebdd700 1 --2- 172.21.15.80:0/186802045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c68109480 0x7f6c68199b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:34:44.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.158+0000 7f6c6e3dc700 1 --2- 172.21.15.80:0/186802045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c681034e0 0x7f6c6819fa50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6c58009f70 tx=0x7f6c58005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:44.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.158+0000 7f6c5f7fe700 1 -- 172.21.15.80:0/186802045 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c58027070 con 0x7f6c681034e0 2024-04-26T18:34:44.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.158+0000 7f6c5f7fe700 1 -- 172.21.15.80:0/186802045 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c580040b0 con 0x7f6c681034e0 2024-04-26T18:34:44.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.158+0000 7f6c70640700 1 -- 172.21.15.80:0/186802045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c6819a690 con 0x7f6c681034e0 2024-04-26T18:34:44.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.158+0000 7f6c5f7fe700 1 -- 172.21.15.80:0/186802045 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c58022e40 con 0x7f6c681034e0 2024-04-26T18:34:44.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.158+0000 7f6c70640700 1 -- 172.21.15.80:0/186802045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c681a6800 con 0x7f6c681034e0 2024-04-26T18:34:44.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.159+0000 7f6c70640700 1 -- 172.21.15.80:0/186802045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c68104b30 con 0x7f6c681034e0 2024-04-26T18:34:44.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.160+0000 7f6c5f7fe700 1 -- 172.21.15.80:0/186802045 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f6c5802a070 con 0x7f6c681034e0 2024-04-26T18:34:44.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.161+0000 7f6c5f7fe700 1 --2- 172.21.15.80:0/186802045 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6c540a3cd0 0x7f6c540a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:44.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.161+0000 7f6c6dbdb700 1 --2- 172.21.15.80:0/186802045 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6c540a3cd0 0x7f6c540a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:44.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.161+0000 7f6c5f7fe700 1 -- 172.21.15.80:0/186802045 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f6c580d1770 con 0x7f6c681034e0 2024-04-26T18:34:44.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.162+0000 7f6c6dbdb700 1 --2- 172.21.15.80:0/186802045 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6c540a3cd0 0x7f6c540a6190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6c6819b270 tx=0x7f6c64006cb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:44.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.165+0000 7f6c5f7fe700 1 -- 172.21.15.80:0/186802045 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6c58013070 con 0x7f6c681034e0 2024-04-26T18:34:44.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.381+0000 7f6c70640700 1 -- 172.21.15.80:0/186802045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6c6819afe0 con 0x7f6c681034e0 2024-04-26T18:34:44.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.381+0000 7f6c5f7fe700 1 -- 172.21.15.80:0/186802045 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6c5809e0b0 con 0x7f6c681034e0 2024-04-26T18:34:44.381 INFO:teuthology.orchestra.run.smithi080.stdout:77309411409 2024-04-26T18:34:44.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.383+0000 7f6c70640700 1 -- 172.21.15.80:0/186802045 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6c540a3cd0 msgr2=0x7f6c540a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:44.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.383+0000 7f6c70640700 1 --2- 172.21.15.80:0/186802045 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6c540a3cd0 0x7f6c540a6190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6c6819b270 tx=0x7f6c64006cb0 comp rx=0 tx=0).stop 2024-04-26T18:34:44.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.383+0000 7f6c70640700 1 -- 172.21.15.80:0/186802045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c681034e0 msgr2=0x7f6c6819fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:44.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.383+0000 7f6c70640700 1 --2- 172.21.15.80:0/186802045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c681034e0 0x7f6c6819fa50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6c58009f70 tx=0x7f6c58005640 comp rx=0 tx=0).stop 2024-04-26T18:34:44.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.383+0000 7f6c70640700 1 -- 172.21.15.80:0/186802045 shutdown_connections 2024-04-26T18:34:44.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.383+0000 7f6c70640700 1 --2- 172.21.15.80:0/186802045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c68109480 0x7f6c68199b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:44.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.383+0000 7f6c70640700 1 --2- 172.21.15.80:0/186802045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c681034e0 0x7f6c6819fa50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:44.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.383+0000 7f6c70640700 1 --2- 172.21.15.80:0/186802045 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6c540a3cd0 0x7f6c540a6190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:44.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.383+0000 7f6c70640700 1 --2- 172.21.15.80:0/186802045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c68103ea0 0x7f6c6819ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:44.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.383+0000 7f6c70640700 1 -- 172.21.15.80:0/186802045 >> 172.21.15.80:0/186802045 conn(0x7f6c6807a5e0 msgr2=0x7f6c68101690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:44.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.383+0000 7f6c70640700 1 -- 172.21.15.80:0/186802045 shutdown_connections 2024-04-26T18:34:44.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.383+0000 7f6c70640700 1 -- 172.21.15.80:0/186802045 wait complete. 2024-04-26T18:34:44.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.727+0000 7ff710ff3700 1 -- 172.21.15.80:0/2426543569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff70c06b130 msgr2=0x7ff70c06b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:44.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.727+0000 7ff710ff3700 1 --2- 172.21.15.80:0/2426543569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff70c06b130 0x7ff70c06b590 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff700009990 tx=0x7ff700009ca0 comp rx=0 tx=0).stop 2024-04-26T18:34:44.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.727+0000 7ff710ff3700 1 -- 172.21.15.80:0/2426543569 shutdown_connections 2024-04-26T18:34:44.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.727+0000 7ff710ff3700 1 --2- 172.21.15.80:0/2426543569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff70c06bad0 0x7ff70c1102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:44.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.727+0000 7ff710ff3700 1 --2- 172.21.15.80:0/2426543569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff70c1094a0 0x7ff70c109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:44.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.727+0000 7ff710ff3700 1 --2- 172.21.15.80:0/2426543569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff70c06b130 0x7ff70c06b590 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:44.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.727+0000 7ff710ff3700 1 -- 172.21.15.80:0/2426543569 >> 172.21.15.80:0/2426543569 conn(0x7ff70c0792d0 msgr2=0x7ff70c0796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:44.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.727+0000 7ff710ff3700 1 -- 172.21.15.80:0/2426543569 shutdown_connections 2024-04-26T18:34:44.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.727+0000 7ff710ff3700 1 -- 172.21.15.80:0/2426543569 wait complete. 2024-04-26T18:34:44.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.728+0000 7ff710ff3700 1 Processor -- start 2024-04-26T18:34:44.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.728+0000 7ff710ff3700 1 -- start start 2024-04-26T18:34:44.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.728+0000 7ff710ff3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff70c06b130 0x7ff70c19bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:44.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.728+0000 7ff710ff3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff70c06bad0 0x7ff70c19c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:44.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.728+0000 7ff710ff3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff70c1094a0 0x7ff70c1a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:44.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.728+0000 7ff710ff3700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff70c1136b0 con 0x7ff70c06b130 2024-04-26T18:34:44.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.728+0000 7ff710ff3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff70c113530 con 0x7ff70c1094a0 2024-04-26T18:34:44.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.728+0000 7ff710ff3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff70c113830 con 0x7ff70c06bad0 2024-04-26T18:34:44.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.728+0000 7ff70a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff70c06b130 0x7ff70c19bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:44.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.728+0000 7ff70a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff70c06b130 0x7ff70c19bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46350/0 (socket says 172.21.15.80:46350) 2024-04-26T18:34:44.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.728+0000 7ff70a59c700 1 -- 172.21.15.80:0/2115901873 learned_addr learned my addr 172.21.15.80:0/2115901873 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:44.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.728+0000 7ff70a59c700 1 -- 172.21.15.80:0/2115901873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff70c06bad0 msgr2=0x7ff70c19c400 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T18:34:44.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.728+0000 7ff70a59c700 1 --2- 172.21.15.80:0/2115901873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff70c06bad0 0x7ff70c19c400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:44.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.728+0000 7ff70a59c700 1 -- 172.21.15.80:0/2115901873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff70c1094a0 msgr2=0x7ff70c1a0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:44.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.728+0000 7ff70a59c700 1 --2- 172.21.15.80:0/2115901873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff70c1094a0 0x7ff70c1a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:44.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.728+0000 7ff70a59c700 1 -- 172.21.15.80:0/2115901873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70c1a0ed0 con 0x7ff70c06b130 2024-04-26T18:34:44.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.728+0000 7ff70a59c700 1 --2- 172.21.15.80:0/2115901873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff70c06b130 0x7ff70c19bec0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff70400b840 tx=0x7ff70400bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:44.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.729+0000 7ff6fb7fe700 1 -- 172.21.15.80:0/2115901873 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70400d890 con 0x7ff70c06b130 2024-04-26T18:34:44.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.729+0000 7ff710ff3700 1 -- 172.21.15.80:0/2115901873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff70c1a11c0 con 0x7ff70c06b130 2024-04-26T18:34:44.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.729+0000 7ff6fb7fe700 1 -- 172.21.15.80:0/2115901873 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff70400e430 con 0x7ff70c06b130 2024-04-26T18:34:44.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.729+0000 7ff6fb7fe700 1 -- 172.21.15.80:0/2115901873 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff704017660 con 0x7ff70c06b130 2024-04-26T18:34:44.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.729+0000 7ff710ff3700 1 -- 172.21.15.80:0/2115901873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff70c1a8a40 con 0x7ff70c06b130 2024-04-26T18:34:44.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.730+0000 7ff710ff3700 1 -- 172.21.15.80:0/2115901873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff70c06a110 con 0x7ff70c06b130 2024-04-26T18:34:44.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.731+0000 7ff6fb7fe700 1 -- 172.21.15.80:0/2115901873 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ff70400e5e0 con 0x7ff70c06b130 2024-04-26T18:34:44.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.731+0000 7ff6fb7fe700 1 --2- 172.21.15.80:0/2115901873 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff6f40a3cd0 0x7ff6f40a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:44.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.731+0000 7ff709d9b700 1 --2- 172.21.15.80:0/2115901873 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff6f40a3cd0 0x7ff6f40a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:44.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.731+0000 7ff6fb7fe700 1 -- 172.21.15.80:0/2115901873 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7ff7040d0380 con 0x7ff70c06b130 2024-04-26T18:34:44.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.732+0000 7ff709d9b700 1 --2- 172.21.15.80:0/2115901873 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff6f40a3cd0 0x7ff6f40a6190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff700005cb0 tx=0x7ff700005bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:44.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.735+0000 7ff6fb7fe700 1 -- 172.21.15.80:0/2115901873 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff704013030 con 0x7ff70c06b130 2024-04-26T18:34:44.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.944+0000 7ff710ff3700 1 -- 172.21.15.80:0/2115901873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7ff70c02e490 con 0x7ff70c06b130 2024-04-26T18:34:44.945 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:44 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/186802045' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-26T18:34:44.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.944+0000 7ff6fb7fe700 1 -- 172.21.15.80:0/2115901873 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff70409cc30 con 0x7ff70c06b130 2024-04-26T18:34:44.945 INFO:teuthology.orchestra.run.smithi080.stdout:292057776174 2024-04-26T18:34:44.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.947+0000 7ff710ff3700 1 -- 172.21.15.80:0/2115901873 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff6f40a3cd0 msgr2=0x7ff6f40a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:44.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.947+0000 7ff710ff3700 1 --2- 172.21.15.80:0/2115901873 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff6f40a3cd0 0x7ff6f40a6190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff700005cb0 tx=0x7ff700005bc0 comp rx=0 tx=0).stop 2024-04-26T18:34:44.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.947+0000 7ff710ff3700 1 -- 172.21.15.80:0/2115901873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff70c06b130 msgr2=0x7ff70c19bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:44.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.947+0000 7ff710ff3700 1 --2- 172.21.15.80:0/2115901873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff70c06b130 0x7ff70c19bec0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff70400b840 tx=0x7ff70400bc00 comp rx=0 tx=0).stop 2024-04-26T18:34:44.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.947+0000 7ff710ff3700 1 -- 172.21.15.80:0/2115901873 shutdown_connections 2024-04-26T18:34:44.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.947+0000 7ff710ff3700 1 --2- 172.21.15.80:0/2115901873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff70c1094a0 0x7ff70c1a0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:44.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.947+0000 7ff710ff3700 1 --2- 172.21.15.80:0/2115901873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff70c06b130 0x7ff70c19bec0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:44.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.947+0000 7ff710ff3700 1 --2- 172.21.15.80:0/2115901873 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff6f40a3cd0 0x7ff6f40a6190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:44.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.947+0000 7ff710ff3700 1 --2- 172.21.15.80:0/2115901873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff70c06bad0 0x7ff70c19c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:44.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.947+0000 7ff710ff3700 1 -- 172.21.15.80:0/2115901873 >> 172.21.15.80:0/2115901873 conn(0x7ff70c0792d0 msgr2=0x7ff70c10ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:44.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.947+0000 7ff710ff3700 1 -- 172.21.15.80:0/2115901873 shutdown_connections 2024-04-26T18:34:44.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:44.947+0000 7ff710ff3700 1 -- 172.21.15.80:0/2115901873 wait complete. 2024-04-26T18:34:44.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:44 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/186802045' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-26T18:34:45.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:44 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/186802045' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-26T18:34:45.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.163+0000 7f94b6398700 1 -- 172.21.15.80:0/1640693210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94b01024a0 msgr2=0x7f94b010e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:45.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.163+0000 7f94b6398700 1 --2- 172.21.15.80:0/1640693210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94b01024a0 0x7f94b010e960 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f94a800b0a0 tx=0x7f94a800b3b0 comp rx=0 tx=0).stop 2024-04-26T18:34:45.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.163+0000 7f94b6398700 1 -- 172.21.15.80:0/1640693210 shutdown_connections 2024-04-26T18:34:45.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.163+0000 7f94b6398700 1 --2- 172.21.15.80:0/1640693210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94b01024a0 0x7f94b010e960 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:45.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.163+0000 7f94b6398700 1 --2- 172.21.15.80:0/1640693210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94b0107a90 0x7f94b0107e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:45.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.163+0000 7f94b6398700 1 --2- 172.21.15.80:0/1640693210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94b0101ae0 0x7f94b0101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:45.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.163+0000 7f94b6398700 1 -- 172.21.15.80:0/1640693210 >> 172.21.15.80:0/1640693210 conn(0x7f94b0078990 msgr2=0x7f94b00ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:45.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.163+0000 7f94b6398700 1 -- 172.21.15.80:0/1640693210 shutdown_connections 2024-04-26T18:34:45.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.163+0000 7f94b6398700 1 -- 172.21.15.80:0/1640693210 wait complete. 2024-04-26T18:34:45.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.164+0000 7f94b6398700 1 Processor -- start 2024-04-26T18:34:45.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.164+0000 7f94b6398700 1 -- start start 2024-04-26T18:34:45.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.164+0000 7f94b6398700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94b0101ae0 0x7f94b019a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:45.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.164+0000 7f94b6398700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94b01024a0 0x7f94b019ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:45.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.164+0000 7f94b6398700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94b0107a90 0x7f94b01a59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:45.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.164+0000 7f94b6398700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f94b0112550 con 0x7f94b01024a0 2024-04-26T18:34:45.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.164+0000 7f94b6398700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f94b01123d0 con 0x7f94b0101ae0 2024-04-26T18:34:45.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.164+0000 7f94b6398700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f94b01126d0 con 0x7f94b0107a90 2024-04-26T18:34:45.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.164+0000 7f94af7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94b01024a0 0x7f94b019ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:45.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.164+0000 7f94af7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94b01024a0 0x7f94b019ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46378/0 (socket says 172.21.15.80:46378) 2024-04-26T18:34:45.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.164+0000 7f94af7fe700 1 -- 172.21.15.80:0/2692074266 learned_addr learned my addr 172.21.15.80:0/2692074266 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:45.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.164+0000 7f94affff700 1 --2- 172.21.15.80:0/2692074266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94b0101ae0 0x7f94b019a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:45.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.165+0000 7f94af7fe700 1 -- 172.21.15.80:0/2692074266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94b0107a90 msgr2=0x7f94b01a59d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T18:34:45.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.165+0000 7f94af7fe700 1 --2- 172.21.15.80:0/2692074266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94b0107a90 0x7f94b01a59d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:45.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.165+0000 7f94af7fe700 1 -- 172.21.15.80:0/2692074266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94b0101ae0 msgr2=0x7f94b019a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:45.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.165+0000 7f94af7fe700 1 --2- 172.21.15.80:0/2692074266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94b0101ae0 0x7f94b019a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:45.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.165+0000 7f94af7fe700 1 -- 172.21.15.80:0/2692074266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b01a5f10 con 0x7f94b01024a0 2024-04-26T18:34:45.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.165+0000 7f94af7fe700 1 --2- 172.21.15.80:0/2692074266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94b01024a0 0x7f94b019ae90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f94a400c9b0 tx=0x7f94a400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:45.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.165+0000 7f94ad7fa700 1 -- 172.21.15.80:0/2692074266 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a4007b00 con 0x7f94b01024a0 2024-04-26T18:34:45.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.165+0000 7f94b6398700 1 -- 172.21.15.80:0/2692074266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b01a60e0 con 0x7f94b01024a0 2024-04-26T18:34:45.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.165+0000 7f94ad7fa700 1 -- 172.21.15.80:0/2692074266 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94a4007ca0 con 0x7f94b01024a0 2024-04-26T18:34:45.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.165+0000 7f94ad7fa700 1 -- 172.21.15.80:0/2692074266 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a4018660 con 0x7f94b01024a0 2024-04-26T18:34:45.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.165+0000 7f94b6398700 1 -- 172.21.15.80:0/2692074266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b01a6670 con 0x7f94b01024a0 2024-04-26T18:34:45.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.166+0000 7f94b6398700 1 -- 172.21.15.80:0/2692074266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b010a090 con 0x7f94b01024a0 2024-04-26T18:34:45.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.167+0000 7f94ad7fa700 1 -- 172.21.15.80:0/2692074266 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f94a400f450 con 0x7f94b01024a0 2024-04-26T18:34:45.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.168+0000 7f94ad7fa700 1 --2- 172.21.15.80:0/2692074266 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f94980a3cd0 0x7f94980a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:45.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.168+0000 7f94affff700 1 --2- 172.21.15.80:0/2692074266 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f94980a3cd0 0x7f94980a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:45.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.168+0000 7f94ad7fa700 1 -- 172.21.15.80:0/2692074266 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f94a40d0520 con 0x7f94b01024a0 2024-04-26T18:34:45.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.168+0000 7f94affff700 1 --2- 172.21.15.80:0/2692074266 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f94980a3cd0 0x7f94980a6190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f94a0006fd0 tx=0x7f94a0009190 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:45.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.172+0000 7f94ad7fa700 1 -- 172.21.15.80:0/2692074266 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f94a4014030 con 0x7f94b01024a0 2024-04-26T18:34:45.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.390+0000 7f94b6398700 1 -- 172.21.15.80:0/2692074266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f94b010f8e0 con 0x7f94b01024a0 2024-04-26T18:34:45.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.390+0000 7f94ad7fa700 1 -- 172.21.15.80:0/2692074266 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f94a409cdd0 con 0x7f94b01024a0 2024-04-26T18:34:45.390 INFO:teuthology.orchestra.run.smithi080.stdout:55834574935 2024-04-26T18:34:45.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.392+0000 7f94b6398700 1 -- 172.21.15.80:0/2692074266 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f94980a3cd0 msgr2=0x7f94980a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:45.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.392+0000 7f94b6398700 1 --2- 172.21.15.80:0/2692074266 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f94980a3cd0 0x7f94980a6190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f94a0006fd0 tx=0x7f94a0009190 comp rx=0 tx=0).stop 2024-04-26T18:34:45.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.392+0000 7f94b6398700 1 -- 172.21.15.80:0/2692074266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94b01024a0 msgr2=0x7f94b019ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:45.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.392+0000 7f94b6398700 1 --2- 172.21.15.80:0/2692074266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94b01024a0 0x7f94b019ae90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f94a400c9b0 tx=0x7f94a400ccc0 comp rx=0 tx=0).stop 2024-04-26T18:34:45.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.392+0000 7f94b6398700 1 -- 172.21.15.80:0/2692074266 shutdown_connections 2024-04-26T18:34:45.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.392+0000 7f94b6398700 1 --2- 172.21.15.80:0/2692074266 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f94980a3cd0 0x7f94980a6190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:45.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.392+0000 7f94b6398700 1 --2- 172.21.15.80:0/2692074266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94b0107a90 0x7f94b01a59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:45.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.392+0000 7f94b6398700 1 --2- 172.21.15.80:0/2692074266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94b0101ae0 0x7f94b019a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:45.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.392+0000 7f94b6398700 1 --2- 172.21.15.80:0/2692074266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94b01024a0 0x7f94b019ae90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:45.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.392+0000 7f94b6398700 1 -- 172.21.15.80:0/2692074266 >> 172.21.15.80:0/2692074266 conn(0x7f94b0078990 msgr2=0x7f94b01047a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:45.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.392+0000 7f94b6398700 1 -- 172.21.15.80:0/2692074266 shutdown_connections 2024-04-26T18:34:45.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:45.392+0000 7f94b6398700 1 -- 172.21.15.80:0/2692074266 wait complete. 2024-04-26T18:34:45.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:45 smithi082 ceph-mon[32808]: pgmap v348: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:34:45.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:45 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/2115901873' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-26T18:34:45.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:45 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/2692074266' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-26T18:34:45.989 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:45 smithi080 ceph-mon[29135]: pgmap v348: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:34:45.989 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:45 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2115901873' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-26T18:34:45.989 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:45 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2692074266' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-26T18:34:46.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:45 smithi192 ceph-mon[32842]: pgmap v348: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:34:46.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:45 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/2115901873' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-26T18:34:46.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:45 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/2692074266' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-26T18:34:46.691 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776171 got 292057776174 for osd.9 2024-04-26T18:34:46.691 DEBUG:teuthology.parallel:result is None 2024-04-26T18:34:47.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.447+0000 7facea62c700 1 -- 172.21.15.80:0/1626214979 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7face4077400 msgr2=0x7face4075650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:47.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.447+0000 7facea62c700 1 --2- 172.21.15.80:0/1626214979 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7face4077400 0x7face4075650 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7facd4009990 tx=0x7facd4009ca0 comp rx=0 tx=0).stop 2024-04-26T18:34:47.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.447+0000 7facea62c700 1 -- 172.21.15.80:0/1626214979 shutdown_connections 2024-04-26T18:34:47.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.447+0000 7facea62c700 1 --2- 172.21.15.80:0/1626214979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7face4114120 0x7face4116510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:47.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.447+0000 7facea62c700 1 --2- 172.21.15.80:0/1626214979 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7face4077400 0x7face4075650 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:47.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.447+0000 7facea62c700 1 --2- 172.21.15.80:0/1626214979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7face4075b90 0x7face4076010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:47.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.447+0000 7facea62c700 1 -- 172.21.15.80:0/1626214979 >> 172.21.15.80:0/1626214979 conn(0x7face407a5e0 msgr2=0x7face407a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:47.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.447+0000 7facea62c700 1 -- 172.21.15.80:0/1626214979 shutdown_connections 2024-04-26T18:34:47.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.447+0000 7facea62c700 1 -- 172.21.15.80:0/1626214979 wait complete. 2024-04-26T18:34:47.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.447+0000 7facea62c700 1 Processor -- start 2024-04-26T18:34:47.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.447+0000 7facea62c700 1 -- start start 2024-04-26T18:34:47.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.448+0000 7facea62c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7face4075b90 0x7face41a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:47.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.448+0000 7facea62c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7face4077400 0x7face41a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:47.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.448+0000 7facea62c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7face4114120 0x7face41a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:47.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.448+0000 7facea62c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7face4119cf0 con 0x7face4114120 2024-04-26T18:34:47.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.448+0000 7facea62c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7face4119b70 con 0x7face4075b90 2024-04-26T18:34:47.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.448+0000 7facea62c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7face4119e70 con 0x7face4077400 2024-04-26T18:34:47.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.448+0000 7face8bc9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7face4114120 0x7face41a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:47.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.448+0000 7face8bc9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7face4114120 0x7face41a4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46406/0 (socket says 172.21.15.80:46406) 2024-04-26T18:34:47.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.448+0000 7face8bc9700 1 -- 172.21.15.80:0/3552954902 learned_addr learned my addr 172.21.15.80:0/3552954902 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:47.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.448+0000 7face3fff700 1 --2- 172.21.15.80:0/3552954902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7face4075b90 0x7face41a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:47.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.448+0000 7face37fe700 1 --2- 172.21.15.80:0/3552954902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7face4077400 0x7face41a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:47.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.448+0000 7face8bc9700 1 -- 172.21.15.80:0/3552954902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7face4077400 msgr2=0x7face41a07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:47.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.448+0000 7face8bc9700 1 --2- 172.21.15.80:0/3552954902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7face4077400 0x7face41a07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:47.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.448+0000 7face8bc9700 1 -- 172.21.15.80:0/3552954902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7face4075b90 msgr2=0x7face41a02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:47.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.448+0000 7face8bc9700 1 --2- 172.21.15.80:0/3552954902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7face4075b90 0x7face41a02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:47.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.448+0000 7face8bc9700 1 -- 172.21.15.80:0/3552954902 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face41a52b0 con 0x7face4114120 2024-04-26T18:34:47.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.449+0000 7face8bc9700 1 --2- 172.21.15.80:0/3552954902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7face4114120 0x7face41a4b70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7facdc00b9e0 tx=0x7facdc00bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:47.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.449+0000 7face17fa700 1 -- 172.21.15.80:0/3552954902 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc00d8e0 con 0x7face4114120 2024-04-26T18:34:47.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.449+0000 7face17fa700 1 -- 172.21.15.80:0/3552954902 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facdc015420 con 0x7face4114120 2024-04-26T18:34:47.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.449+0000 7facea62c700 1 -- 172.21.15.80:0/3552954902 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7face41a55a0 con 0x7face4114120 2024-04-26T18:34:47.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.449+0000 7face17fa700 1 -- 172.21.15.80:0/3552954902 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc00c640 con 0x7face4114120 2024-04-26T18:34:47.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.449+0000 7facea62c700 1 -- 172.21.15.80:0/3552954902 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7face41ace20 con 0x7face4114120 2024-04-26T18:34:47.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.450+0000 7facea62c700 1 -- 172.21.15.80:0/3552954902 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7face406a110 con 0x7face4114120 2024-04-26T18:34:47.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.451+0000 7face17fa700 1 -- 172.21.15.80:0/3552954902 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7facdc00da80 con 0x7face4114120 2024-04-26T18:34:47.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.452+0000 7face17fa700 1 --2- 172.21.15.80:0/3552954902 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7faccc0a3cd0 0x7faccc0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:47.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.452+0000 7face3fff700 1 --2- 172.21.15.80:0/3552954902 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7faccc0a3cd0 0x7faccc0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:47.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.452+0000 7face17fa700 1 -- 172.21.15.80:0/3552954902 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7facdc0cfea0 con 0x7face4114120 2024-04-26T18:34:47.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.452+0000 7face3fff700 1 --2- 172.21.15.80:0/3552954902 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7faccc0a3cd0 0x7faccc0a6190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7facd4003800 tx=0x7facd400b560 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:47.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.457+0000 7face17fa700 1 -- 172.21.15.80:0/3552954902 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7facdc00dd70 con 0x7face4114120 2024-04-26T18:34:47.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.661+0000 7facea62c700 1 -- 172.21.15.80:0/3552954902 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7face41acff0 con 0x7face4114120 2024-04-26T18:34:47.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.661+0000 7face17fa700 1 -- 172.21.15.80:0/3552954902 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7facdc09c750 con 0x7face4114120 2024-04-26T18:34:47.661 INFO:teuthology.orchestra.run.smithi080.stdout:313532612650 2024-04-26T18:34:47.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.663+0000 7facea62c700 1 -- 172.21.15.80:0/3552954902 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7faccc0a3cd0 msgr2=0x7faccc0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:47.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.663+0000 7facea62c700 1 --2- 172.21.15.80:0/3552954902 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7faccc0a3cd0 0x7faccc0a6190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7facd4003800 tx=0x7facd400b560 comp rx=0 tx=0).stop 2024-04-26T18:34:47.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.663+0000 7facea62c700 1 -- 172.21.15.80:0/3552954902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7face4114120 msgr2=0x7face41a4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:47.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.663+0000 7facea62c700 1 --2- 172.21.15.80:0/3552954902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7face4114120 0x7face41a4b70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7facdc00b9e0 tx=0x7facdc00bcf0 comp rx=0 tx=0).stop 2024-04-26T18:34:47.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.663+0000 7facea62c700 1 -- 172.21.15.80:0/3552954902 shutdown_connections 2024-04-26T18:34:47.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.663+0000 7facea62c700 1 --2- 172.21.15.80:0/3552954902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7face4114120 0x7face41a4b70 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:47.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.663+0000 7facea62c700 1 --2- 172.21.15.80:0/3552954902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7face4075b90 0x7face41a02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:47.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.663+0000 7facea62c700 1 --2- 172.21.15.80:0/3552954902 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7faccc0a3cd0 0x7faccc0a6190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:47.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.663+0000 7facea62c700 1 --2- 172.21.15.80:0/3552954902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7face4077400 0x7face41a07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:47.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.663+0000 7facea62c700 1 -- 172.21.15.80:0/3552954902 >> 172.21.15.80:0/3552954902 conn(0x7face407a5e0 msgr2=0x7face4112110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:47.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.663+0000 7facea62c700 1 -- 172.21.15.80:0/3552954902 shutdown_connections 2024-04-26T18:34:47.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:47.663+0000 7facea62c700 1 -- 172.21.15.80:0/3552954902 wait complete. 2024-04-26T18:34:47.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:47 smithi080 ceph-mon[29135]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:34:47.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:47 smithi082 ceph-mon[32808]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:34:48.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:47 smithi192 ceph-mon[32842]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:34:48.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:48 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3552954902' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-26T18:34:48.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:48 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3552954902' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-26T18:34:49.094 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:49.096 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:34:49.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:48 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3552954902' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-26T18:34:49.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:49 smithi080 ceph-mon[29135]: pgmap v350: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:34:49.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:49 smithi082 ceph-mon[32808]: pgmap v350: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:34:50.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:49 smithi192 ceph-mon[32842]: pgmap v350: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:34:50.556 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574932 got 55834574935 for osd.1 2024-04-26T18:34:50.557 DEBUG:teuthology.parallel:result is None 2024-04-26T18:34:51.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.391+0000 7f9469853700 1 -- 172.21.15.80:0/4180612112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9464075f70 msgr2=0x7f946410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:51.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.391+0000 7f9469853700 1 --2- 172.21.15.80:0/4180612112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9464075f70 0x7f946410f950 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9458009990 tx=0x7f9458009ca0 comp rx=0 tx=0).stop 2024-04-26T18:34:51.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.391+0000 7f9469853700 1 -- 172.21.15.80:0/4180612112 shutdown_connections 2024-04-26T18:34:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.391+0000 7f9469853700 1 --2- 172.21.15.80:0/4180612112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f946410fe90 0x7f9464112280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.391+0000 7f9469853700 1 --2- 172.21.15.80:0/4180612112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9464075650 0x7f9464075a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.391+0000 7f9469853700 1 --2- 172.21.15.80:0/4180612112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9464075f70 0x7f946410f950 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.391+0000 7f9469853700 1 -- 172.21.15.80:0/4180612112 >> 172.21.15.80:0/4180612112 conn(0x7f946407a5e0 msgr2=0x7f946407a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.391+0000 7f9469853700 1 -- 172.21.15.80:0/4180612112 shutdown_connections 2024-04-26T18:34:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.391+0000 7f9469853700 1 -- 172.21.15.80:0/4180612112 wait complete. 2024-04-26T18:34:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.391+0000 7f9469853700 1 Processor -- start 2024-04-26T18:34:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.392+0000 7f9469853700 1 -- start start 2024-04-26T18:34:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.392+0000 7f9469853700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9464075650 0x7f946419bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.392+0000 7f9469853700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9464075f70 0x7f946419c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.392+0000 7f9469853700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f946410fe90 0x7f94641a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:51.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.392+0000 7f9469853700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9464115830 con 0x7f946410fe90 2024-04-26T18:34:51.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.392+0000 7f9469853700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f94641156b0 con 0x7f9464075650 2024-04-26T18:34:51.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.392+0000 7f9469853700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f94641159b0 con 0x7f9464075f70 2024-04-26T18:34:51.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.392+0000 7f94637fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f946410fe90 0x7f94641a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:51.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.392+0000 7f94637fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f946410fe90 0x7f94641a0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46434/0 (socket says 172.21.15.80:46434) 2024-04-26T18:34:51.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.392+0000 7f94637fe700 1 -- 172.21.15.80:0/3802191060 learned_addr learned my addr 172.21.15.80:0/3802191060 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:51.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.392+0000 7f9462ffd700 1 --2- 172.21.15.80:0/3802191060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9464075650 0x7f946419bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:51.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.392+0000 7f94637fe700 1 -- 172.21.15.80:0/3802191060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9464075f70 msgr2=0x7f946419c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:51.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.392+0000 7f94637fe700 1 --2- 172.21.15.80:0/3802191060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9464075f70 0x7f946419c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:51.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.392+0000 7f94637fe700 1 -- 172.21.15.80:0/3802191060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9464075650 msgr2=0x7f946419bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:51.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.392+0000 7f94637fe700 1 --2- 172.21.15.80:0/3802191060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9464075650 0x7f946419bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:51.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.392+0000 7f94637fe700 1 -- 172.21.15.80:0/3802191060 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94641a0d80 con 0x7f946410fe90 2024-04-26T18:34:51.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.392+0000 7f94637fe700 1 --2- 172.21.15.80:0/3802191060 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f946410fe90 0x7f94641a0640 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f945c00b970 tx=0x7f945c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:51.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.393+0000 7f9468851700 1 -- 172.21.15.80:0/3802191060 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945c019070 con 0x7f946410fe90 2024-04-26T18:34:51.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.393+0000 7f9468851700 1 -- 172.21.15.80:0/3802191060 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f945c00cde0 con 0x7f946410fe90 2024-04-26T18:34:51.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.393+0000 7f9469853700 1 -- 172.21.15.80:0/3802191060 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94641a1070 con 0x7f946410fe90 2024-04-26T18:34:51.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.393+0000 7f9468851700 1 -- 172.21.15.80:0/3802191060 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945c007370 con 0x7f946410fe90 2024-04-26T18:34:51.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.393+0000 7f9469853700 1 -- 172.21.15.80:0/3802191060 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94641a88f0 con 0x7f946410fe90 2024-04-26T18:34:51.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.394+0000 7f9469853700 1 -- 172.21.15.80:0/3802191060 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f946406a110 con 0x7f946410fe90 2024-04-26T18:34:51.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.395+0000 7f9468851700 1 -- 172.21.15.80:0/3802191060 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f945c01c070 con 0x7f946410fe90 2024-04-26T18:34:51.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.395+0000 7f9468851700 1 --2- 172.21.15.80:0/3802191060 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f944c0a3cc0 0x7f944c0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:51.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.395+0000 7f9462ffd700 1 --2- 172.21.15.80:0/3802191060 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f944c0a3cc0 0x7f944c0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:51.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.395+0000 7f9468851700 1 -- 172.21.15.80:0/3802191060 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f945c0cf700 con 0x7f946410fe90 2024-04-26T18:34:51.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.396+0000 7f9462ffd700 1 --2- 172.21.15.80:0/3802191060 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f944c0a3cc0 0x7f944c0a6180 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9454005950 tx=0x7f945400b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:51.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.400+0000 7f9468851700 1 -- 172.21.15.80:0/3802191060 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f945c09c110 con 0x7f946410fe90 2024-04-26T18:34:51.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.612+0000 7f9469853700 1 -- 172.21.15.80:0/3802191060 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f946402e650 con 0x7f946410fe90 2024-04-26T18:34:51.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.613+0000 7f9468851700 1 -- 172.21.15.80:0/3802191060 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f945c09ba10 con 0x7f946410fe90 2024-04-26T18:34:51.613 INFO:teuthology.orchestra.run.smithi080.stdout:111669149774 2024-04-26T18:34:51.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.615+0000 7f9469853700 1 -- 172.21.15.80:0/3802191060 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f944c0a3cc0 msgr2=0x7f944c0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:51.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.615+0000 7f9469853700 1 --2- 172.21.15.80:0/3802191060 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f944c0a3cc0 0x7f944c0a6180 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9454005950 tx=0x7f945400b410 comp rx=0 tx=0).stop 2024-04-26T18:34:51.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.615+0000 7f9469853700 1 -- 172.21.15.80:0/3802191060 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f946410fe90 msgr2=0x7f94641a0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:51.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.615+0000 7f9469853700 1 --2- 172.21.15.80:0/3802191060 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f946410fe90 0x7f94641a0640 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f945c00b970 tx=0x7f945c00bc80 comp rx=0 tx=0).stop 2024-04-26T18:34:51.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.615+0000 7f9469853700 1 -- 172.21.15.80:0/3802191060 shutdown_connections 2024-04-26T18:34:51.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.615+0000 7f9469853700 1 --2- 172.21.15.80:0/3802191060 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f946410fe90 0x7f94641a0640 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:51.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.615+0000 7f9469853700 1 --2- 172.21.15.80:0/3802191060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9464075650 0x7f946419bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:51.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.615+0000 7f9469853700 1 --2- 172.21.15.80:0/3802191060 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f944c0a3cc0 0x7f944c0a6180 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:51.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.615+0000 7f9469853700 1 --2- 172.21.15.80:0/3802191060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9464075f70 0x7f946419c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:51.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.615+0000 7f9469853700 1 -- 172.21.15.80:0/3802191060 >> 172.21.15.80:0/3802191060 conn(0x7f946407a5e0 msgr2=0x7f9464100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:51.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.615+0000 7f9469853700 1 -- 172.21.15.80:0/3802191060 shutdown_connections 2024-04-26T18:34:51.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:51.615+0000 7f9469853700 1 -- 172.21.15.80:0/3802191060 wait complete. 2024-04-26T18:34:51.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:51 smithi082 ceph-mon[32808]: pgmap v351: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:34:51.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:51 smithi082 ceph-mon[32808]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-04-26T18:34:51.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:51 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3802191060' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-26T18:34:51.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:51 smithi080 ceph-mon[29135]: pgmap v351: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:34:51.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:51 smithi080 ceph-mon[29135]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-04-26T18:34:51.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:51 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3802191060' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-26T18:34:52.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:51 smithi192 ceph-mon[32842]: pgmap v351: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:34:52.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:51 smithi192 ceph-mon[32842]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-04-26T18:34:52.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:51 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3802191060' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-26T18:34:52.920 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411405 got 77309411409 for osd.2 2024-04-26T18:34:52.920 DEBUG:teuthology.parallel:result is None 2024-04-26T18:34:53.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.528+0000 7fd3f65a5700 1 -- 172.21.15.80:0/4034979588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3f0102ce0 msgr2=0x7fd3f010f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:53.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.528+0000 7fd3f65a5700 1 --2- 172.21.15.80:0/4034979588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3f0102ce0 0x7fd3f010f1d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd3e800b0a0 tx=0x7fd3e800b3b0 comp rx=0 tx=0).stop 2024-04-26T18:34:53.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.528+0000 7fd3f65a5700 1 -- 172.21.15.80:0/4034979588 shutdown_connections 2024-04-26T18:34:53.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.528+0000 7fd3f65a5700 1 --2- 172.21.15.80:0/4034979588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3f0102ce0 0x7fd3f010f1d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:53.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.528+0000 7fd3f65a5700 1 --2- 172.21.15.80:0/4034979588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3f0108390 0x7fd3f0108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:53.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.528+0000 7fd3f65a5700 1 --2- 172.21.15.80:0/4034979588 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3f0102320 0x7fd3f01027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:53.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.528+0000 7fd3f65a5700 1 -- 172.21.15.80:0/4034979588 >> 172.21.15.80:0/4034979588 conn(0x7fd3f00792d0 msgr2=0x7fd3f00796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:53.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.528+0000 7fd3f65a5700 1 -- 172.21.15.80:0/4034979588 shutdown_connections 2024-04-26T18:34:53.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.528+0000 7fd3f65a5700 1 -- 172.21.15.80:0/4034979588 wait complete. 2024-04-26T18:34:53.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.529+0000 7fd3f65a5700 1 Processor -- start 2024-04-26T18:34:53.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.529+0000 7fd3f65a5700 1 -- start start 2024-04-26T18:34:53.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.529+0000 7fd3f65a5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3f0102320 0x7fd3f019a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:53.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.529+0000 7fd3f65a5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3f0102ce0 0x7fd3f019ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:53.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.530+0000 7fd3f65a5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3f0108390 0x7fd3f01a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:53.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.530+0000 7fd3f65a5700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f0112550 con 0x7fd3f0108390 2024-04-26T18:34:53.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.530+0000 7fd3f65a5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f01123d0 con 0x7fd3f0102ce0 2024-04-26T18:34:53.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.530+0000 7fd3f65a5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f01126d0 con 0x7fd3f0102320 2024-04-26T18:34:53.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.530+0000 7fd3f4b42700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3f0108390 0x7fd3f01a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:53.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.530+0000 7fd3f4b42700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3f0108390 0x7fd3f01a59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55322/0 (socket says 172.21.15.80:55322) 2024-04-26T18:34:53.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.530+0000 7fd3f4b42700 1 -- 172.21.15.80:0/2951300660 learned_addr learned my addr 172.21.15.80:0/2951300660 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:53.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.530+0000 7fd3f4b42700 1 -- 172.21.15.80:0/2951300660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3f0102320 msgr2=0x7fd3f019a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:53.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.530+0000 7fd3ef7fe700 1 --2- 172.21.15.80:0/2951300660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3f0102ce0 0x7fd3f019ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:53.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.530+0000 7fd3f4b42700 1 --2- 172.21.15.80:0/2951300660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3f0102320 0x7fd3f019a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:53.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.530+0000 7fd3f4b42700 1 -- 172.21.15.80:0/2951300660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3f0102ce0 msgr2=0x7fd3f019ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:53.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.530+0000 7fd3f4b42700 1 --2- 172.21.15.80:0/2951300660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3f0102ce0 0x7fd3f019ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:53.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.530+0000 7fd3f4b42700 1 -- 172.21.15.80:0/2951300660 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f01a5ef0 con 0x7fd3f0108390 2024-04-26T18:34:53.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.530+0000 7fd3f4b42700 1 --2- 172.21.15.80:0/2951300660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3f0108390 0x7fd3f01a59b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8006070 tx=0x7fd3e8004ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:53.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.530+0000 7fd3ed7fa700 1 -- 172.21.15.80:0/2951300660 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e8021070 con 0x7fd3f0108390 2024-04-26T18:34:53.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.530+0000 7fd3f65a5700 1 -- 172.21.15.80:0/2951300660 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3f01a60c0 con 0x7fd3f0108390 2024-04-26T18:34:53.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.530+0000 7fd3ed7fa700 1 -- 172.21.15.80:0/2951300660 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3e8007df0 con 0x7fd3f0108390 2024-04-26T18:34:53.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.530+0000 7fd3ed7fa700 1 -- 172.21.15.80:0/2951300660 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e801d450 con 0x7fd3f0108390 2024-04-26T18:34:53.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.530+0000 7fd3f65a5700 1 -- 172.21.15.80:0/2951300660 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3f01a6570 con 0x7fd3f0108390 2024-04-26T18:34:53.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.531+0000 7fd3f65a5700 1 -- 172.21.15.80:0/2951300660 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3f006a110 con 0x7fd3f0108390 2024-04-26T18:34:53.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.532+0000 7fd3ed7fa700 1 -- 172.21.15.80:0/2951300660 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fd3e8004000 con 0x7fd3f0108390 2024-04-26T18:34:53.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.533+0000 7fd3ed7fa700 1 --2- 172.21.15.80:0/2951300660 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd3d80a3cc0 0x7fd3d80a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:53.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.533+0000 7fd3effff700 1 --2- 172.21.15.80:0/2951300660 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd3d80a3cc0 0x7fd3d80a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:53.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.533+0000 7fd3ed7fa700 1 -- 172.21.15.80:0/2951300660 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fd3e80d1500 con 0x7fd3f0108390 2024-04-26T18:34:53.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.533+0000 7fd3effff700 1 --2- 172.21.15.80:0/2951300660 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd3d80a3cc0 0x7fd3d80a6180 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400a990 tx=0x7fd3e4005c80 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:53.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.541+0000 7fd3ed7fa700 1 -- 172.21.15.80:0/2951300660 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd3e809dfa0 con 0x7fd3f0108390 2024-04-26T18:34:53.681 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:53 smithi080 ceph-mon[29135]: pgmap v352: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-04-26T18:34:53.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.751+0000 7fd3f65a5700 1 -- 172.21.15.80:0/2951300660 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd3f002e5b0 con 0x7fd3f0108390 2024-04-26T18:34:53.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.751+0000 7fd3ed7fa700 1 -- 172.21.15.80:0/2951300660 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd3e809d8a0 con 0x7fd3f0108390 2024-04-26T18:34:53.752 INFO:teuthology.orchestra.run.smithi080.stdout:167503724611 2024-04-26T18:34:53.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.754+0000 7fd3f65a5700 1 -- 172.21.15.80:0/2951300660 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd3d80a3cc0 msgr2=0x7fd3d80a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:53.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.754+0000 7fd3f65a5700 1 --2- 172.21.15.80:0/2951300660 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd3d80a3cc0 0x7fd3d80a6180 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400a990 tx=0x7fd3e4005c80 comp rx=0 tx=0).stop 2024-04-26T18:34:53.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.754+0000 7fd3f65a5700 1 -- 172.21.15.80:0/2951300660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3f0108390 msgr2=0x7fd3f01a59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:53.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.754+0000 7fd3f65a5700 1 --2- 172.21.15.80:0/2951300660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3f0108390 0x7fd3f01a59b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8006070 tx=0x7fd3e8004ef0 comp rx=0 tx=0).stop 2024-04-26T18:34:53.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.754+0000 7fd3f65a5700 1 -- 172.21.15.80:0/2951300660 shutdown_connections 2024-04-26T18:34:53.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.754+0000 7fd3f65a5700 1 --2- 172.21.15.80:0/2951300660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3f0108390 0x7fd3f01a59b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:53.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.754+0000 7fd3f65a5700 1 --2- 172.21.15.80:0/2951300660 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd3d80a3cc0 0x7fd3d80a6180 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:53.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.754+0000 7fd3f65a5700 1 --2- 172.21.15.80:0/2951300660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3f0102320 0x7fd3f019a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:53.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.754+0000 7fd3f65a5700 1 --2- 172.21.15.80:0/2951300660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3f0102ce0 0x7fd3f019ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:53.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.754+0000 7fd3f65a5700 1 -- 172.21.15.80:0/2951300660 >> 172.21.15.80:0/2951300660 conn(0x7fd3f00792d0 msgr2=0x7fd3f0100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:53.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.754+0000 7fd3f65a5700 1 -- 172.21.15.80:0/2951300660 shutdown_connections 2024-04-26T18:34:53.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.754+0000 7fd3f65a5700 1 -- 172.21.15.80:0/2951300660 wait complete. 2024-04-26T18:34:53.975 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:53 smithi082 ceph-mon[32808]: pgmap v352: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-04-26T18:34:54.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:53 smithi192 ceph-mon[32842]: pgmap v352: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-04-26T18:34:54.193 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149769 got 111669149774 for osd.3 2024-04-26T18:34:54.194 DEBUG:teuthology.parallel:result is None 2024-04-26T18:34:54.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.444+0000 7ff4322ab700 1 -- 172.21.15.80:0/3136431014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff42c1094f0 msgr2=0x7ff42c1098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.444+0000 7ff4322ab700 1 --2- 172.21.15.80:0/3136431014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff42c1094f0 0x7ff42c1098d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff41c009990 tx=0x7ff41c009ca0 comp rx=0 tx=0).stop 2024-04-26T18:34:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.444+0000 7ff4322ab700 1 -- 172.21.15.80:0/3136431014 shutdown_connections 2024-04-26T18:34:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.444+0000 7ff4322ab700 1 --2- 172.21.15.80:0/3136431014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff42c103e90 0x7ff42c1102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.444+0000 7ff4322ab700 1 --2- 172.21.15.80:0/3136431014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff42c1094f0 0x7ff42c1098d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.444+0000 7ff4322ab700 1 --2- 172.21.15.80:0/3136431014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff42c1034d0 0x7ff42c103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.444+0000 7ff4322ab700 1 -- 172.21.15.80:0/3136431014 >> 172.21.15.80:0/3136431014 conn(0x7ff42c07a4b0 msgr2=0x7ff42c07a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.444+0000 7ff4322ab700 1 -- 172.21.15.80:0/3136431014 shutdown_connections 2024-04-26T18:34:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.444+0000 7ff4322ab700 1 -- 172.21.15.80:0/3136431014 wait complete. 2024-04-26T18:34:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.445+0000 7ff4322ab700 1 Processor -- start 2024-04-26T18:34:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.445+0000 7ff4322ab700 1 -- start start 2024-04-26T18:34:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.445+0000 7ff4322ab700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff42c1034d0 0x7ff42c19f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:54.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.445+0000 7ff4322ab700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff42c103e90 0x7ff42c19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:54.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.445+0000 7ff4322ab700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff42c1094f0 0x7ff42c1999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:54.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.445+0000 7ff4322ab700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff42c113670 con 0x7ff42c1034d0 2024-04-26T18:34:54.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.445+0000 7ff4322ab700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff42c1134f0 con 0x7ff42c103e90 2024-04-26T18:34:54.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.445+0000 7ff4322ab700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff42c1137f0 con 0x7ff42c1094f0 2024-04-26T18:34:54.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.445+0000 7ff42bfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff42c1034d0 0x7ff42c19f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:54.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.445+0000 7ff42bfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff42c1034d0 0x7ff42c19f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46456/0 (socket says 172.21.15.80:46456) 2024-04-26T18:34:54.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.445+0000 7ff42bfff700 1 -- 172.21.15.80:0/3884155621 learned_addr learned my addr 172.21.15.80:0/3884155621 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:54.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.445+0000 7ff42b7fe700 1 --2- 172.21.15.80:0/3884155621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff42c103e90 0x7ff42c19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:54.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.445+0000 7ff430848700 1 --2- 172.21.15.80:0/3884155621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff42c1094f0 0x7ff42c1999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:54.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.446+0000 7ff42bfff700 1 -- 172.21.15.80:0/3884155621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff42c1094f0 msgr2=0x7ff42c1999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:54.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.446+0000 7ff42bfff700 1 --2- 172.21.15.80:0/3884155621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff42c1094f0 0x7ff42c1999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:54.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.446+0000 7ff42bfff700 1 -- 172.21.15.80:0/3884155621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff42c103e90 msgr2=0x7ff42c19fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:54.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.446+0000 7ff42bfff700 1 --2- 172.21.15.80:0/3884155621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff42c103e90 0x7ff42c19fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:54.378 INFO:teuthology.orchestra.run.smithi080.stdout:223338299450 2024-04-26T18:34:54.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.446+0000 7ff42bfff700 1 -- 172.21.15.80:0/3884155621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff42c19a130 con 0x7ff42c1034d0 2024-04-26T18:34:54.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.446+0000 7ff430848700 1 --2- 172.21.15.80:0/3884155621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff42c1094f0 0x7ff42c1999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:34:54.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.446+0000 7ff42b7fe700 1 --2- 172.21.15.80:0/3884155621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff42c103e90 0x7ff42c19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:34:54.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.446+0000 7ff42bfff700 1 --2- 172.21.15.80:0/3884155621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff42c1034d0 0x7ff42c19f7c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff41c000c00 tx=0x7ff41c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:54.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.446+0000 7ff4297fa700 1 -- 172.21.15.80:0/3884155621 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff41c027070 con 0x7ff42c1034d0 2024-04-26T18:34:54.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.446+0000 7ff4322ab700 1 -- 172.21.15.80:0/3884155621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff42c19a3c0 con 0x7ff42c1034d0 2024-04-26T18:34:54.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.446+0000 7ff4297fa700 1 -- 172.21.15.80:0/3884155621 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff41c0041d0 con 0x7ff42c1034d0 2024-04-26T18:34:54.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.446+0000 7ff4297fa700 1 -- 172.21.15.80:0/3884155621 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff41c00f460 con 0x7ff42c1034d0 2024-04-26T18:34:54.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.446+0000 7ff4322ab700 1 -- 172.21.15.80:0/3884155621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff42c1a6690 con 0x7ff42c1034d0 2024-04-26T18:34:54.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.447+0000 7ff4322ab700 1 -- 172.21.15.80:0/3884155621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff42c06a110 con 0x7ff42c1034d0 2024-04-26T18:34:54.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.448+0000 7ff4297fa700 1 -- 172.21.15.80:0/3884155621 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7ff41c02a070 con 0x7ff42c1034d0 2024-04-26T18:34:54.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.448+0000 7ff4297fa700 1 --2- 172.21.15.80:0/3884155621 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff4140a3c40 0x7ff4140a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:54.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.449+0000 7ff42b7fe700 1 --2- 172.21.15.80:0/3884155621 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff4140a3c40 0x7ff4140a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:54.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.449+0000 7ff4297fa700 1 -- 172.21.15.80:0/3884155621 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7ff41c0d13d0 con 0x7ff42c1034d0 2024-04-26T18:34:54.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.449+0000 7ff42b7fe700 1 --2- 172.21.15.80:0/3884155621 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff4140a3c40 0x7ff4140a6100 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff420005fd0 tx=0x7ff420005e30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:54.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.454+0000 7ff4297fa700 1 -- 172.21.15.80:0/3884155621 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff41c05eff0 con 0x7ff42c1034d0 2024-04-26T18:34:54.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.667+0000 7ff4322ab700 1 -- 172.21.15.80:0/3884155621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff42c19aeb0 con 0x7ff42c1034d0 2024-04-26T18:34:54.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.667+0000 7ff4297fa700 1 -- 172.21.15.80:0/3884155621 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff41c013070 con 0x7ff42c1034d0 2024-04-26T18:34:54.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.670+0000 7ff4322ab700 1 -- 172.21.15.80:0/3884155621 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff4140a3c40 msgr2=0x7ff4140a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:54.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.670+0000 7ff4322ab700 1 --2- 172.21.15.80:0/3884155621 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff4140a3c40 0x7ff4140a6100 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff420005fd0 tx=0x7ff420005e30 comp rx=0 tx=0).stop 2024-04-26T18:34:54.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.670+0000 7ff4322ab700 1 -- 172.21.15.80:0/3884155621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff42c1034d0 msgr2=0x7ff42c19f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:54.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.670+0000 7ff4322ab700 1 --2- 172.21.15.80:0/3884155621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff42c1034d0 0x7ff42c19f7c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff41c000c00 tx=0x7ff41c0047b0 comp rx=0 tx=0).stop 2024-04-26T18:34:54.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.670+0000 7ff4322ab700 1 -- 172.21.15.80:0/3884155621 shutdown_connections 2024-04-26T18:34:54.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.670+0000 7ff4322ab700 1 --2- 172.21.15.80:0/3884155621 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff4140a3c40 0x7ff4140a6100 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:54.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.670+0000 7ff4322ab700 1 --2- 172.21.15.80:0/3884155621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff42c1094f0 0x7ff42c1999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:54.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.670+0000 7ff4322ab700 1 --2- 172.21.15.80:0/3884155621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff42c1034d0 0x7ff42c19f7c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:54.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.670+0000 7ff4322ab700 1 --2- 172.21.15.80:0/3884155621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff42c103e90 0x7ff42c19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.670+0000 7ff4322ab700 1 -- 172.21.15.80:0/3884155621 >> 172.21.15.80:0/3884155621 conn(0x7ff42c07a4b0 msgr2=0x7ff42c1020e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.670+0000 7ff4322ab700 1 -- 172.21.15.80:0/3884155621 shutdown_connections 2024-04-26T18:34:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:53.670+0000 7ff4322ab700 1 -- 172.21.15.80:0/3884155621 wait complete. 2024-04-26T18:34:54.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.888+0000 7f49e8b79700 1 -- 172.21.15.80:0/3162390248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e4102cd0 msgr2=0x7f49e410f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:54.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.888+0000 7f49e8b79700 1 --2- 172.21.15.80:0/3162390248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e4102cd0 0x7f49e410f1c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00b0a0 tx=0x7f49dc00b3b0 comp rx=0 tx=0).stop 2024-04-26T18:34:54.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.888+0000 7f49e8b79700 1 -- 172.21.15.80:0/3162390248 shutdown_connections 2024-04-26T18:34:54.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.888+0000 7f49e8b79700 1 --2- 172.21.15.80:0/3162390248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e4102cd0 0x7f49e410f1c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:54.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.888+0000 7f49e8b79700 1 --2- 172.21.15.80:0/3162390248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49e4108380 0x7f49e4108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:54.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.888+0000 7f49e8b79700 1 --2- 172.21.15.80:0/3162390248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49e4102310 0x7f49e4102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:54.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.888+0000 7f49e8b79700 1 -- 172.21.15.80:0/3162390248 >> 172.21.15.80:0/3162390248 conn(0x7f49e4079290 msgr2=0x7f49e40796a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:54.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.888+0000 7f49e8b79700 1 -- 172.21.15.80:0/3162390248 shutdown_connections 2024-04-26T18:34:54.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.888+0000 7f49e8b79700 1 -- 172.21.15.80:0/3162390248 wait complete. 2024-04-26T18:34:54.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.889+0000 7f49e8b79700 1 Processor -- start 2024-04-26T18:34:54.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.889+0000 7f49e8b79700 1 -- start start 2024-04-26T18:34:54.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.889+0000 7f49e8b79700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e4102310 0x7f49e419aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:54.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.889+0000 7f49e8b79700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49e4102cd0 0x7f49e419b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:54.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.889+0000 7f49e8b79700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49e4108380 0x7f49e41a5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:54.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.889+0000 7f49e8b79700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f49e41125c0 con 0x7f49e4102310 2024-04-26T18:34:54.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.889+0000 7f49e8b79700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f49e4112440 con 0x7f49e4108380 2024-04-26T18:34:54.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.889+0000 7f49e8b79700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f49e4112740 con 0x7f49e4102cd0 2024-04-26T18:34:54.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.889+0000 7f49e259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e4102310 0x7f49e419aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:54.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.889+0000 7f49e259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e4102310 0x7f49e419aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55348/0 (socket says 172.21.15.80:55348) 2024-04-26T18:34:54.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.889+0000 7f49e259c700 1 -- 172.21.15.80:0/2055643892 learned_addr learned my addr 172.21.15.80:0/2055643892 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:54.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.889+0000 7f49e2d9d700 1 --2- 172.21.15.80:0/2055643892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49e4108380 0x7f49e41a5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:54.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.890+0000 7f49e259c700 1 -- 172.21.15.80:0/2055643892 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49e4102cd0 msgr2=0x7f49e419b000 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T18:34:54.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.890+0000 7f49e259c700 1 --2- 172.21.15.80:0/2055643892 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49e4102cd0 0x7f49e419b000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:54.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.890+0000 7f49e259c700 1 -- 172.21.15.80:0/2055643892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49e4108380 msgr2=0x7f49e41a5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:54.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.890+0000 7f49e259c700 1 --2- 172.21.15.80:0/2055643892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49e4108380 0x7f49e41a5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:54.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.890+0000 7f49e259c700 1 -- 172.21.15.80:0/2055643892 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e41a6080 con 0x7f49e4102310 2024-04-26T18:34:54.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.890+0000 7f49e259c700 1 --2- 172.21.15.80:0/2055643892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e4102310 0x7f49e419aac0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f49d400b530 tx=0x7f49d400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:54.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.890+0000 7f49d37fe700 1 -- 172.21.15.80:0/2055643892 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d4015020 con 0x7f49e4102310 2024-04-26T18:34:54.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.890+0000 7f49e8b79700 1 -- 172.21.15.80:0/2055643892 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e41a62b0 con 0x7f49e4102310 2024-04-26T18:34:54.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.890+0000 7f49d37fe700 1 -- 172.21.15.80:0/2055643892 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49d4011ce0 con 0x7f49e4102310 2024-04-26T18:34:54.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.890+0000 7f49d37fe700 1 -- 172.21.15.80:0/2055643892 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d4010d20 con 0x7f49e4102310 2024-04-26T18:34:54.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.890+0000 7f49e8b79700 1 -- 172.21.15.80:0/2055643892 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e41a67c0 con 0x7f49e4102310 2024-04-26T18:34:54.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.891+0000 7f49e8b79700 1 -- 172.21.15.80:0/2055643892 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49e410a8f0 con 0x7f49e4102310 2024-04-26T18:34:54.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.892+0000 7f49d37fe700 1 -- 172.21.15.80:0/2055643892 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f49d4018020 con 0x7f49e4102310 2024-04-26T18:34:54.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.892+0000 7f49d37fe700 1 --2- 172.21.15.80:0/2055643892 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f49cc0a3c40 0x7f49cc0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:54.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.893+0000 7f49e1d9b700 1 --2- 172.21.15.80:0/2055643892 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f49cc0a3c40 0x7f49cc0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:54.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.893+0000 7f49d37fe700 1 -- 172.21.15.80:0/2055643892 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f49d40cfc00 con 0x7f49e4102310 2024-04-26T18:34:54.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.893+0000 7f49e1d9b700 1 --2- 172.21.15.80:0/2055643892 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f49cc0a3c40 0x7f49cc0a6100 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f49e4079940 tx=0x7f49d8006c60 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:54.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:54.897+0000 7f49d37fe700 1 -- 172.21.15.80:0/2055643892 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f49d40d6080 con 0x7f49e4102310 2024-04-26T18:34:54.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:54 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3884155621' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-26T18:34:54.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:54 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/2951300660' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-26T18:34:54.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:54 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3884155621' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-26T18:34:54.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:54 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2951300660' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-26T18:34:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:55.100+0000 7f49e8b79700 1 -- 172.21.15.80:0/2055643892 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f49e406bf80 con 0x7f49e4102310 2024-04-26T18:34:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:55.100+0000 7f49d37fe700 1 -- 172.21.15.80:0/2055643892 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f49d401f020 con 0x7f49e4102310 2024-04-26T18:34:55.101 INFO:teuthology.orchestra.run.smithi080.stdout:347892351014 2024-04-26T18:34:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:55.102+0000 7f49e8b79700 1 -- 172.21.15.80:0/2055643892 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f49cc0a3c40 msgr2=0x7f49cc0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:55.102+0000 7f49e8b79700 1 --2- 172.21.15.80:0/2055643892 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f49cc0a3c40 0x7f49cc0a6100 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f49e4079940 tx=0x7f49d8006c60 comp rx=0 tx=0).stop 2024-04-26T18:34:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:55.102+0000 7f49e8b79700 1 -- 172.21.15.80:0/2055643892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e4102310 msgr2=0x7f49e419aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:55.102+0000 7f49e8b79700 1 --2- 172.21.15.80:0/2055643892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e4102310 0x7f49e419aac0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f49d400b530 tx=0x7f49d400b8f0 comp rx=0 tx=0).stop 2024-04-26T18:34:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:55.103+0000 7f49e8b79700 1 -- 172.21.15.80:0/2055643892 shutdown_connections 2024-04-26T18:34:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:55.103+0000 7f49e8b79700 1 --2- 172.21.15.80:0/2055643892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49e4108380 0x7f49e41a5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:55.103+0000 7f49e8b79700 1 --2- 172.21.15.80:0/2055643892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e4102310 0x7f49e419aac0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:55.103+0000 7f49e8b79700 1 --2- 172.21.15.80:0/2055643892 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f49cc0a3c40 0x7f49cc0a6100 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:55.103+0000 7f49e8b79700 1 --2- 172.21.15.80:0/2055643892 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49e4102cd0 0x7f49e419b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:55.103+0000 7f49e8b79700 1 -- 172.21.15.80:0/2055643892 >> 172.21.15.80:0/2055643892 conn(0x7f49e4079290 msgr2=0x7f49e4101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:55.103+0000 7f49e8b79700 1 -- 172.21.15.80:0/2055643892 shutdown_connections 2024-04-26T18:34:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:55.103+0000 7f49e8b79700 1 -- 172.21.15.80:0/2055643892 wait complete. 2024-04-26T18:34:55.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:54 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3884155621' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-26T18:34:55.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:54 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/2951300660' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-26T18:34:55.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:55 smithi080 ceph-mon[29135]: pgmap v353: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-04-26T18:34:55.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:55 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2055643892' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-26T18:34:55.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:55 smithi082 ceph-mon[32808]: pgmap v353: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-04-26T18:34:55.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:55 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/2055643892' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-26T18:34:55.991 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724606 got 167503724611 for osd.5 2024-04-26T18:34:55.991 DEBUG:teuthology.parallel:result is None 2024-04-26T18:34:56.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:55 smithi192 ceph-mon[32842]: pgmap v353: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-04-26T18:34:56.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:55 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/2055643892' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-26T18:34:56.434 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299444 got 223338299450 for osd.7 2024-04-26T18:34:56.434 DEBUG:teuthology.parallel:result is None 2024-04-26T18:34:57.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.871+0000 7f4ce00f6700 1 -- 172.21.15.80:0/3612989311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cd81094a0 msgr2=0x7f4cd8109880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:57.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.871+0000 7f4ce00f6700 1 --2- 172.21.15.80:0/3612989311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cd81094a0 0x7f4cd8109880 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009990 tx=0x7f4cd4009ca0 comp rx=0 tx=0).stop 2024-04-26T18:34:57.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.871+0000 7f4ce00f6700 1 -- 172.21.15.80:0/3612989311 shutdown_connections 2024-04-26T18:34:57.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.871+0000 7f4ce00f6700 1 --2- 172.21.15.80:0/3612989311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cd806bad0 0x7f4cd81102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:57.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.871+0000 7f4ce00f6700 1 --2- 172.21.15.80:0/3612989311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cd81094a0 0x7f4cd8109880 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:57.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.871+0000 7f4ce00f6700 1 --2- 172.21.15.80:0/3612989311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cd806b130 0x7f4cd806b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:57.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.871+0000 7f4ce00f6700 1 -- 172.21.15.80:0/3612989311 >> 172.21.15.80:0/3612989311 conn(0x7f4cd80792d0 msgr2=0x7f4cd80796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:57.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.871+0000 7f4ce00f6700 1 -- 172.21.15.80:0/3612989311 shutdown_connections 2024-04-26T18:34:57.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.871+0000 7f4ce00f6700 1 -- 172.21.15.80:0/3612989311 wait complete. 2024-04-26T18:34:57.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.872+0000 7f4ce00f6700 1 Processor -- start 2024-04-26T18:34:57.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.872+0000 7f4ce00f6700 1 -- start start 2024-04-26T18:34:57.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.872+0000 7f4ce00f6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cd806b130 0x7f4cd819f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:57.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.872+0000 7f4ce00f6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cd806bad0 0x7f4cd819fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:57.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.872+0000 7f4ce00f6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cd81094a0 0x7f4cd81998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:57.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.872+0000 7f4ce00f6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd8113590 con 0x7f4cd806b130 2024-04-26T18:34:57.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.872+0000 7f4ce00f6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd8113410 con 0x7f4cd81094a0 2024-04-26T18:34:57.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.872+0000 7f4ce00f6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd8113710 con 0x7f4cd806bad0 2024-04-26T18:34:57.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.872+0000 7f4cdde92700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cd806b130 0x7f4cd819f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:57.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.872+0000 7f4cdde92700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cd806b130 0x7f4cd819f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55360/0 (socket says 172.21.15.80:55360) 2024-04-26T18:34:57.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.872+0000 7f4cdde92700 1 -- 172.21.15.80:0/2391668789 learned_addr learned my addr 172.21.15.80:0/2391668789 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:57.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.873+0000 7f4cdd691700 1 --2- 172.21.15.80:0/2391668789 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cd806bad0 0x7f4cd819fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:57.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.873+0000 7f4cde693700 1 --2- 172.21.15.80:0/2391668789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cd81094a0 0x7f4cd81998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:57.807 INFO:teuthology.orchestra.run.smithi080.stdout:257698037813 2024-04-26T18:34:57.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.873+0000 7f4cdde92700 1 -- 172.21.15.80:0/2391668789 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cd806bad0 msgr2=0x7f4cd819fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:57.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.873+0000 7f4cdde92700 1 --2- 172.21.15.80:0/2391668789 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cd806bad0 0x7f4cd819fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:57.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.873+0000 7f4cdde92700 1 -- 172.21.15.80:0/2391668789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cd81094a0 msgr2=0x7f4cd81998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:57.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.873+0000 7f4cdde92700 1 --2- 172.21.15.80:0/2391668789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cd81094a0 0x7f4cd81998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:57.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.873+0000 7f4cdde92700 1 -- 172.21.15.80:0/2391668789 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd819a030 con 0x7f4cd806b130 2024-04-26T18:34:57.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.873+0000 7f4cde693700 1 --2- 172.21.15.80:0/2391668789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cd81094a0 0x7f4cd81998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:34:57.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.873+0000 7f4cdde92700 1 --2- 172.21.15.80:0/2391668789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cd806b130 0x7f4cd819f710 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4000c00 tx=0x7f4cd40047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:57.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.873+0000 7f4cceffd700 1 -- 172.21.15.80:0/2391668789 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4027070 con 0x7f4cd806b130 2024-04-26T18:34:57.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.873+0000 7f4cceffd700 1 -- 172.21.15.80:0/2391668789 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cd4003fa0 con 0x7f4cd806b130 2024-04-26T18:34:57.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.873+0000 7f4ce00f6700 1 -- 172.21.15.80:0/2391668789 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd819a2c0 con 0x7f4cd806b130 2024-04-26T18:34:57.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.873+0000 7f4cceffd700 1 -- 172.21.15.80:0/2391668789 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4022db0 con 0x7f4cd806b130 2024-04-26T18:34:57.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.873+0000 7f4ce00f6700 1 -- 172.21.15.80:0/2391668789 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd81a65e0 con 0x7f4cd806b130 2024-04-26T18:34:57.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.874+0000 7f4ce00f6700 1 -- 172.21.15.80:0/2391668789 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd806a110 con 0x7f4cd806b130 2024-04-26T18:34:57.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.875+0000 7f4cceffd700 1 -- 172.21.15.80:0/2391668789 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f4cd402a070 con 0x7f4cd806b130 2024-04-26T18:34:57.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.876+0000 7f4cceffd700 1 --2- 172.21.15.80:0/2391668789 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f4cc40a3cc0 0x7f4cc40a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:57.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.876+0000 7f4cdd691700 1 --2- 172.21.15.80:0/2391668789 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f4cc40a3cc0 0x7f4cc40a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:57.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.876+0000 7f4cceffd700 1 -- 172.21.15.80:0/2391668789 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f4cd40d1410 con 0x7f4cd806b130 2024-04-26T18:34:57.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.876+0000 7f4cdd691700 1 --2- 172.21.15.80:0/2391668789 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f4cc40a3cc0 0x7f4cc40a6180 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8005ea0 tx=0x7f4cc8005e30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:57.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:56.879+0000 7f4cceffd700 1 -- 172.21.15.80:0/2391668789 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4cd4013070 con 0x7f4cd806b130 2024-04-26T18:34:57.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:57.083+0000 7f4ce00f6700 1 -- 172.21.15.80:0/2391668789 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f4cd802e490 con 0x7f4cd806b130 2024-04-26T18:34:57.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:57.083+0000 7f4cceffd700 1 -- 172.21.15.80:0/2391668789 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4cd409deb0 con 0x7f4cd806b130 2024-04-26T18:34:57.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:57.085+0000 7f4ce00f6700 1 -- 172.21.15.80:0/2391668789 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f4cc40a3cc0 msgr2=0x7f4cc40a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:57.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:57.085+0000 7f4ce00f6700 1 --2- 172.21.15.80:0/2391668789 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f4cc40a3cc0 0x7f4cc40a6180 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8005ea0 tx=0x7f4cc8005e30 comp rx=0 tx=0).stop 2024-04-26T18:34:57.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:57.085+0000 7f4ce00f6700 1 -- 172.21.15.80:0/2391668789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cd806b130 msgr2=0x7f4cd819f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:57.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:57.085+0000 7f4ce00f6700 1 --2- 172.21.15.80:0/2391668789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cd806b130 0x7f4cd819f710 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4000c00 tx=0x7f4cd40047b0 comp rx=0 tx=0).stop 2024-04-26T18:34:57.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:57.085+0000 7f4ce00f6700 1 -- 172.21.15.80:0/2391668789 shutdown_connections 2024-04-26T18:34:57.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:57.085+0000 7f4ce00f6700 1 --2- 172.21.15.80:0/2391668789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cd81094a0 0x7f4cd81998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:57.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:57.085+0000 7f4ce00f6700 1 --2- 172.21.15.80:0/2391668789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4cd806b130 0x7f4cd819f710 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:57.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:57.085+0000 7f4ce00f6700 1 --2- 172.21.15.80:0/2391668789 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f4cc40a3cc0 0x7f4cc40a6180 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:57.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:57.085+0000 7f4ce00f6700 1 --2- 172.21.15.80:0/2391668789 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cd806bad0 0x7f4cd819fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:57.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:57.085+0000 7f4ce00f6700 1 -- 172.21.15.80:0/2391668789 >> 172.21.15.80:0/2391668789 conn(0x7f4cd80792d0 msgr2=0x7f4cd8100410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:57.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:57.085+0000 7f4ce00f6700 1 -- 172.21.15.80:0/2391668789 shutdown_connections 2024-04-26T18:34:57.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:57.085+0000 7f4ce00f6700 1 -- 172.21.15.80:0/2391668789 wait complete. 2024-04-26T18:34:57.810 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:57 smithi080 ceph-mon[29135]: pgmap v354: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-04-26T18:34:57.810 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:57 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2391668789' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-26T18:34:57.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:57 smithi082 ceph-mon[32808]: pgmap v354: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-04-26T18:34:57.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:57 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/2391668789' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-26T18:34:58.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:57 smithi192 ceph-mon[32842]: pgmap v354: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-04-26T18:34:58.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:57 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/2391668789' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-26T18:34:58.440 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612644 got 313532612650 for osd.10 2024-04-26T18:34:58.440 DEBUG:teuthology.parallel:result is None 2024-04-26T18:34:58.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.661+0000 7feace719700 1 -- 172.21.15.80:0/2379497790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feac806c0d0 msgr2=0x7feac806c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:58.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.661+0000 7feace719700 1 --2- 172.21.15.80:0/2379497790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feac806c0d0 0x7feac806c550 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7feabc009990 tx=0x7feabc009ca0 comp rx=0 tx=0).stop 2024-04-26T18:34:58.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.661+0000 7feace719700 1 -- 172.21.15.80:0/2379497790 shutdown_connections 2024-04-26T18:34:58.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.661+0000 7feace719700 1 --2- 172.21.15.80:0/2379497790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feac8105eb0 0x7feac8106330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:58.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.661+0000 7feace719700 1 --2- 172.21.15.80:0/2379497790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feac8108440 0x7feac806bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:58.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.661+0000 7feace719700 1 --2- 172.21.15.80:0/2379497790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feac806c0d0 0x7feac806c550 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:58.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.661+0000 7feace719700 1 -- 172.21.15.80:0/2379497790 >> 172.21.15.80:0/2379497790 conn(0x7feac8078370 msgr2=0x7feac8078780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:58.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.661+0000 7feace719700 1 -- 172.21.15.80:0/2379497790 shutdown_connections 2024-04-26T18:34:58.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.661+0000 7feace719700 1 -- 172.21.15.80:0/2379497790 wait complete. 2024-04-26T18:34:58.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.661+0000 7feace719700 1 Processor -- start 2024-04-26T18:34:58.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.661+0000 7feace719700 1 -- start start 2024-04-26T18:34:58.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.662+0000 7feace719700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feac806c0d0 0x7feac81a0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:58.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.662+0000 7feace719700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feac8105eb0 0x7feac81a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:58.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.662+0000 7feace719700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feac8108440 0x7feac81a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:58.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.662+0000 7feace719700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7feac8119c10 con 0x7feac806c0d0 2024-04-26T18:34:58.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.662+0000 7feace719700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7feac8119a90 con 0x7feac8105eb0 2024-04-26T18:34:58.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.662+0000 7feace719700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feac8119d90 con 0x7feac8108440 2024-04-26T18:34:58.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.662+0000 7feac7fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feac806c0d0 0x7feac81a0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:58.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.662+0000 7feac77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feac8105eb0 0x7feac81a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:58.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.662+0000 7feac7fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feac806c0d0 0x7feac81a0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55378/0 (socket says 172.21.15.80:55378) 2024-04-26T18:34:58.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.662+0000 7feac7fff700 1 -- 172.21.15.80:0/1640911306 learned_addr learned my addr 172.21.15.80:0/1640911306 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:34:58.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.662+0000 7feacccb6700 1 --2- 172.21.15.80:0/1640911306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feac8108440 0x7feac81a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:58.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.662+0000 7feac77fe700 1 -- 172.21.15.80:0/1640911306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feac8108440 msgr2=0x7feac81a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:58.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.662+0000 7feac77fe700 1 --2- 172.21.15.80:0/1640911306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feac8108440 0x7feac81a4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:58.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.662+0000 7feac77fe700 1 -- 172.21.15.80:0/1640911306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feac806c0d0 msgr2=0x7feac81a0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:58.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.662+0000 7feac77fe700 1 --2- 172.21.15.80:0/1640911306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feac806c0d0 0x7feac81a0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:58.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.662+0000 7feac77fe700 1 -- 172.21.15.80:0/1640911306 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac81a5150 con 0x7feac8105eb0 2024-04-26T18:34:58.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.662+0000 7feac7fff700 1 --2- 172.21.15.80:0/1640911306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feac806c0d0 0x7feac81a0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:34:58.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.663+0000 7feac77fe700 1 --2- 172.21.15.80:0/1640911306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feac8105eb0 0x7feac81a0680 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feabc0059d0 tx=0x7feabc0047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:58.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.666+0000 7feac57fa700 1 -- 172.21.15.80:0/1640911306 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc027070 con 0x7feac8105eb0 2024-04-26T18:34:58.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.666+0000 7feace719700 1 -- 172.21.15.80:0/1640911306 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feac81a53e0 con 0x7feac8105eb0 2024-04-26T18:34:58.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.666+0000 7feac57fa700 1 -- 172.21.15.80:0/1640911306 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feabc00fb20 con 0x7feac8105eb0 2024-04-26T18:34:58.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.666+0000 7feac57fa700 1 -- 172.21.15.80:0/1640911306 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc022c40 con 0x7feac8105eb0 2024-04-26T18:34:58.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.666+0000 7feace719700 1 -- 172.21.15.80:0/1640911306 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feac81accc0 con 0x7feac8105eb0 2024-04-26T18:34:58.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.667+0000 7feace719700 1 -- 172.21.15.80:0/1640911306 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feac8102990 con 0x7feac8105eb0 2024-04-26T18:34:58.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.668+0000 7feac57fa700 1 -- 172.21.15.80:0/1640911306 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7feabc02a070 con 0x7feac8105eb0 2024-04-26T18:34:58.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.668+0000 7feac57fa700 1 --2- 172.21.15.80:0/1640911306 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7feab00a3c40 0x7feab00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:34:58.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.668+0000 7feac7fff700 1 --2- 172.21.15.80:0/1640911306 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7feab00a3c40 0x7feab00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:34:58.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.668+0000 7feac57fa700 1 -- 172.21.15.80:0/1640911306 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7feabc0d1490 con 0x7feac8105eb0 2024-04-26T18:34:58.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.669+0000 7feac7fff700 1 --2- 172.21.15.80:0/1640911306 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7feab00a3c40 0x7feab00a6100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7feab80104e0 tx=0x7feab800b480 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:34:58.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.672+0000 7feac57fa700 1 -- 172.21.15.80:0/1640911306 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7feabc013070 con 0x7feac8105eb0 2024-04-26T18:34:58.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.876+0000 7feace719700 1 -- 172.21.15.80:0/1640911306 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7feac806a110 con 0x7feac8105eb0 2024-04-26T18:34:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.877+0000 7feac57fa700 1 -- 172.21.15.80:0/1640911306 <== mon.2 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feabc09df30 con 0x7feac8105eb0 2024-04-26T18:34:58.877 INFO:teuthology.orchestra.run.smithi080.stdout:34359738462 2024-04-26T18:34:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.881+0000 7feace719700 1 -- 172.21.15.80:0/1640911306 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7feab00a3c40 msgr2=0x7feab00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.881+0000 7feace719700 1 --2- 172.21.15.80:0/1640911306 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7feab00a3c40 0x7feab00a6100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7feab80104e0 tx=0x7feab800b480 comp rx=0 tx=0).stop 2024-04-26T18:34:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.881+0000 7feace719700 1 -- 172.21.15.80:0/1640911306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feac8105eb0 msgr2=0x7feac81a0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:34:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.881+0000 7feace719700 1 --2- 172.21.15.80:0/1640911306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feac8105eb0 0x7feac81a0680 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feabc0059d0 tx=0x7feabc0047b0 comp rx=0 tx=0).stop 2024-04-26T18:34:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.881+0000 7feace719700 1 -- 172.21.15.80:0/1640911306 shutdown_connections 2024-04-26T18:34:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.881+0000 7feace719700 1 --2- 172.21.15.80:0/1640911306 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7feab00a3c40 0x7feab00a6100 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.881+0000 7feace719700 1 --2- 172.21.15.80:0/1640911306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feac8108440 0x7feac81a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.881+0000 7feace719700 1 --2- 172.21.15.80:0/1640911306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feac806c0d0 0x7feac81a0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:58.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.881+0000 7feace719700 1 --2- 172.21.15.80:0/1640911306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feac8105eb0 0x7feac81a0680 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:34:58.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.881+0000 7feace719700 1 -- 172.21.15.80:0/1640911306 >> 172.21.15.80:0/1640911306 conn(0x7feac8078370 msgr2=0x7feac81013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:34:58.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.881+0000 7feace719700 1 -- 172.21.15.80:0/1640911306 shutdown_connections 2024-04-26T18:34:58.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:34:58.881+0000 7feace719700 1 -- 172.21.15.80:0/1640911306 wait complete. 2024-04-26T18:34:59.067 INFO:tasks.cephadm.ceph_manager.ceph:need seq 347892351008 got 347892351014 for osd.11 2024-04-26T18:34:59.067 DEBUG:teuthology.parallel:result is None 2024-04-26T18:34:59.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:59 smithi080 ceph-mon[29135]: pgmap v355: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-04-26T18:34:59.848 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:34:59 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1640911306' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-26T18:34:59.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:59 smithi082 ceph-mon[32808]: pgmap v355: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-04-26T18:34:59.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:34:59 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1640911306' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-26T18:35:00.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:59 smithi192 ceph-mon[32842]: pgmap v355: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-04-26T18:35:00.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:34:59 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1640911306' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-26T18:35:00.183 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738457 got 34359738462 for osd.0 2024-04-26T18:35:00.183 DEBUG:teuthology.parallel:result is None 2024-04-26T18:35:00.627 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037808 got 257698037813 for osd.8 2024-04-26T18:35:00.628 DEBUG:teuthology.parallel:result is None 2024-04-26T18:35:00.853 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:00 smithi080 ceph-mon[29135]: pgmap v356: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2024-04-26T18:35:00.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:00 smithi082 ceph-mon[32808]: pgmap v356: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2024-04-26T18:35:01.013 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:00 smithi192 ceph-mon[32842]: pgmap v356: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2024-04-26T18:35:01.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.083+0000 7f4a46912700 1 -- 172.21.15.80:0/765448626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a40102320 msgr2=0x7f4a401027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:01.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.083+0000 7f4a46912700 1 --2- 172.21.15.80:0/765448626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a40102320 0x7f4a401027a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009990 tx=0x7f4a28009ca0 comp rx=0 tx=0).stop 2024-04-26T18:35:01.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.083+0000 7f4a46912700 1 -- 172.21.15.80:0/765448626 shutdown_connections 2024-04-26T18:35:01.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.083+0000 7f4a46912700 1 --2- 172.21.15.80:0/765448626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a40102ce0 0x7f4a4010f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:01.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.083+0000 7f4a46912700 1 --2- 172.21.15.80:0/765448626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a40108390 0x7f4a40108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:01.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.083+0000 7f4a46912700 1 --2- 172.21.15.80:0/765448626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a40102320 0x7f4a401027a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:01.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.083+0000 7f4a46912700 1 -- 172.21.15.80:0/765448626 >> 172.21.15.80:0/765448626 conn(0x7f4a400792d0 msgr2=0x7f4a400796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:01.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.083+0000 7f4a46912700 1 -- 172.21.15.80:0/765448626 shutdown_connections 2024-04-26T18:35:01.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.083+0000 7f4a46912700 1 -- 172.21.15.80:0/765448626 wait complete. 2024-04-26T18:35:01.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.084+0000 7f4a46912700 1 Processor -- start 2024-04-26T18:35:01.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.084+0000 7f4a46912700 1 -- start start 2024-04-26T18:35:01.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.084+0000 7f4a46912700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a40102320 0x7f4a4019a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:01.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.084+0000 7f4a46912700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a40102ce0 0x7f4a4019ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:01.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.084+0000 7f4a46912700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a40108390 0x7f4a401a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:01.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.084+0000 7f4a46912700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4a401124b0 con 0x7f4a40102ce0 2024-04-26T18:35:01.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.084+0000 7f4a46912700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4a40112330 con 0x7f4a40102320 2024-04-26T18:35:01.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.084+0000 7f4a46912700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4a40112630 con 0x7f4a40108390 2024-04-26T18:35:01.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.084+0000 7f4a37fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a40102ce0 0x7f4a4019ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:01.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.084+0000 7f4a37fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a40102ce0 0x7f4a4019ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55384/0 (socket says 172.21.15.80:55384) 2024-04-26T18:35:01.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.084+0000 7f4a37fff700 1 -- 172.21.15.80:0/774848491 learned_addr learned my addr 172.21.15.80:0/774848491 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:01.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.084+0000 7f4a44eaf700 1 --2- 172.21.15.80:0/774848491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a40108390 0x7f4a401a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:01.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.085+0000 7f4a37fff700 1 -- 172.21.15.80:0/774848491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a40108390 msgr2=0x7f4a401a5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:01.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.085+0000 7f4a3ffff700 1 --2- 172.21.15.80:0/774848491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a40102320 0x7f4a4019a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:01.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.085+0000 7f4a37fff700 1 --2- 172.21.15.80:0/774848491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a40108390 0x7f4a401a5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:01.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.085+0000 7f4a37fff700 1 -- 172.21.15.80:0/774848491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a40102320 msgr2=0x7f4a4019a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:01.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.085+0000 7f4a37fff700 1 --2- 172.21.15.80:0/774848491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a40102320 0x7f4a4019a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:01.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.085+0000 7f4a37fff700 1 -- 172.21.15.80:0/774848491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a401a5e90 con 0x7f4a40102ce0 2024-04-26T18:35:01.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.085+0000 7f4a3ffff700 1 --2- 172.21.15.80:0/774848491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a40102320 0x7f4a4019a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:35:01.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.085+0000 7f4a37fff700 1 --2- 172.21.15.80:0/774848491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a40102ce0 0x7f4a4019ae10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4a28000c00 tx=0x7f4a280047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:01.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.085+0000 7f4a3dffb700 1 -- 172.21.15.80:0/774848491 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a28027070 con 0x7f4a40102ce0 2024-04-26T18:35:01.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.085+0000 7f4a46912700 1 -- 172.21.15.80:0/774848491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a401a6060 con 0x7f4a40102ce0 2024-04-26T18:35:01.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.085+0000 7f4a3dffb700 1 -- 172.21.15.80:0/774848491 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a280040e0 con 0x7f4a40102ce0 2024-04-26T18:35:01.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.085+0000 7f4a3dffb700 1 -- 172.21.15.80:0/774848491 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2800f460 con 0x7f4a40102ce0 2024-04-26T18:35:01.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.085+0000 7f4a46912700 1 -- 172.21.15.80:0/774848491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a401a64b0 con 0x7f4a40102ce0 2024-04-26T18:35:01.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.086+0000 7f4a46912700 1 -- 172.21.15.80:0/774848491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a4006a110 con 0x7f4a40102ce0 2024-04-26T18:35:01.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.088+0000 7f4a3dffb700 1 -- 172.21.15.80:0/774848491 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f4a2802a070 con 0x7f4a40102ce0 2024-04-26T18:35:01.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.088+0000 7f4a3dffb700 1 --2- 172.21.15.80:0/774848491 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f4a2c0a3c40 0x7f4a2c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:01.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.088+0000 7f4a3ffff700 1 --2- 172.21.15.80:0/774848491 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f4a2c0a3c40 0x7f4a2c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:01.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.088+0000 7f4a3dffb700 1 -- 172.21.15.80:0/774848491 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f4a280d17e0 con 0x7f4a40102ce0 2024-04-26T18:35:01.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.089+0000 7f4a3ffff700 1 --2- 172.21.15.80:0/774848491 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f4a2c0a3c40 0x7f4a2c0a6100 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4a30005fd0 tx=0x7f4a30005d40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:01.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.092+0000 7f4a3dffb700 1 -- 172.21.15.80:0/774848491 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4a28031070 con 0x7f4a40102ce0 2024-04-26T18:35:01.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.317+0000 7f4a46912700 1 -- 172.21.15.80:0/774848491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4a4002e490 con 0x7f4a40102ce0 2024-04-26T18:35:01.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.317+0000 7f4a3dffb700 1 -- 172.21.15.80:0/774848491 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4a28013070 con 0x7f4a40102ce0 2024-04-26T18:35:01.318 INFO:teuthology.orchestra.run.smithi080.stdout:146028888139 2024-04-26T18:35:01.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.319+0000 7f4a46912700 1 -- 172.21.15.80:0/774848491 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f4a2c0a3c40 msgr2=0x7f4a2c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:01.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.319+0000 7f4a46912700 1 --2- 172.21.15.80:0/774848491 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f4a2c0a3c40 0x7f4a2c0a6100 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4a30005fd0 tx=0x7f4a30005d40 comp rx=0 tx=0).stop 2024-04-26T18:35:01.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.319+0000 7f4a46912700 1 -- 172.21.15.80:0/774848491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a40102ce0 msgr2=0x7f4a4019ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:01.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.319+0000 7f4a46912700 1 --2- 172.21.15.80:0/774848491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a40102ce0 0x7f4a4019ae10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4a28000c00 tx=0x7f4a280047b0 comp rx=0 tx=0).stop 2024-04-26T18:35:01.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.319+0000 7f4a46912700 1 -- 172.21.15.80:0/774848491 shutdown_connections 2024-04-26T18:35:01.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.320+0000 7f4a46912700 1 --2- 172.21.15.80:0/774848491 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f4a2c0a3c40 0x7f4a2c0a6100 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:01.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.320+0000 7f4a46912700 1 --2- 172.21.15.80:0/774848491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a40108390 0x7f4a401a5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:01.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.320+0000 7f4a46912700 1 --2- 172.21.15.80:0/774848491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a40102320 0x7f4a4019a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:01.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.320+0000 7f4a46912700 1 --2- 172.21.15.80:0/774848491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a40102ce0 0x7f4a4019ae10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:01.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.320+0000 7f4a46912700 1 -- 172.21.15.80:0/774848491 >> 172.21.15.80:0/774848491 conn(0x7f4a400792d0 msgr2=0x7f4a40100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:01.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.320+0000 7f4a46912700 1 -- 172.21.15.80:0/774848491 shutdown_connections 2024-04-26T18:35:01.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:01.320+0000 7f4a46912700 1 -- 172.21.15.80:0/774848491 wait complete. 2024-04-26T18:35:01.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:01 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/774848491' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-26T18:35:01.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:01 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/774848491' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-26T18:35:02.027 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888133 got 146028888139 for osd.4 2024-04-26T18:35:02.028 DEBUG:teuthology.parallel:result is None 2024-04-26T18:35:02.028 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-26T18:35:02.028 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T18:35:02.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:01 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/774848491' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-26T18:35:02.271 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:35:02.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:02 smithi082 ceph-mon[32808]: pgmap v357: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-04-26T18:35:02.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:02 smithi080 ceph-mon[29135]: pgmap v357: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-04-26T18:35:03.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:02 smithi192 ceph-mon[32842]: pgmap v357: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-04-26T18:35:04.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.011+0000 7fb7e9a5e700 1 -- 172.21.15.80:0/367103986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e41094c0 msgr2=0x7fb7e41098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:04.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.011+0000 7fb7e9a5e700 1 --2- 172.21.15.80:0/367103986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e41094c0 0x7fb7e41098a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8009990 tx=0x7fb7d8009ca0 comp rx=0 tx=0).stop 2024-04-26T18:35:04.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.011+0000 7fb7e9a5e700 1 -- 172.21.15.80:0/367103986 shutdown_connections 2024-04-26T18:35:04.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.011+0000 7fb7e9a5e700 1 --2- 172.21.15.80:0/367103986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7e4103e30 0x7fb7e4110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:04.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.011+0000 7fb7e9a5e700 1 --2- 172.21.15.80:0/367103986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e41094c0 0x7fb7e41098a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:04.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.011+0000 7fb7e9a5e700 1 --2- 172.21.15.80:0/367103986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7e4103470 0x7fb7e41038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:04.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.011+0000 7fb7e9a5e700 1 -- 172.21.15.80:0/367103986 >> 172.21.15.80:0/367103986 conn(0x7fb7e407a580 msgr2=0x7fb7e407a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:04.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.011+0000 7fb7e9a5e700 1 -- 172.21.15.80:0/367103986 shutdown_connections 2024-04-26T18:35:04.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.011+0000 7fb7e9a5e700 1 -- 172.21.15.80:0/367103986 wait complete. 2024-04-26T18:35:04.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.012+0000 7fb7e9a5e700 1 Processor -- start 2024-04-26T18:35:04.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.012+0000 7fb7e9a5e700 1 -- start start 2024-04-26T18:35:04.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.012+0000 7fb7e9a5e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7e4103470 0x7fb7e419f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:04.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.012+0000 7fb7e9a5e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7e4103e30 0x7fb7e419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:04.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.012+0000 7fb7e9a5e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e41094c0 0x7fb7e4199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:04.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.012+0000 7fb7e9a5e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e41135c0 con 0x7fb7e41094c0 2024-04-26T18:35:04.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.012+0000 7fb7e9a5e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e4113440 con 0x7fb7e4103470 2024-04-26T18:35:04.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.012+0000 7fb7e9a5e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e4113740 con 0x7fb7e4103e30 2024-04-26T18:35:04.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.012+0000 7fb7e37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e41094c0 0x7fb7e4199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:04.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.012+0000 7fb7e37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e41094c0 0x7fb7e4199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39990/0 (socket says 172.21.15.80:39990) 2024-04-26T18:35:04.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.012+0000 7fb7e37fe700 1 -- 172.21.15.80:0/3003644953 learned_addr learned my addr 172.21.15.80:0/3003644953 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:04.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.013+0000 7fb7e2ffd700 1 --2- 172.21.15.80:0/3003644953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7e4103470 0x7fb7e419f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:04.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.013+0000 7fb7e27fc700 1 --2- 172.21.15.80:0/3003644953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7e4103e30 0x7fb7e419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:04.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.013+0000 7fb7e37fe700 1 -- 172.21.15.80:0/3003644953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7e4103e30 msgr2=0x7fb7e419fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:04.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.013+0000 7fb7e37fe700 1 --2- 172.21.15.80:0/3003644953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7e4103e30 0x7fb7e419fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:04.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.013+0000 7fb7e37fe700 1 -- 172.21.15.80:0/3003644953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7e4103470 msgr2=0x7fb7e419f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:04.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.013+0000 7fb7e37fe700 1 --2- 172.21.15.80:0/3003644953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7e4103470 0x7fb7e419f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:04.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.013+0000 7fb7e37fe700 1 -- 172.21.15.80:0/3003644953 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e419a060 con 0x7fb7e41094c0 2024-04-26T18:35:04.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.013+0000 7fb7e37fe700 1 --2- 172.21.15.80:0/3003644953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e41094c0 0x7fb7e4199900 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc00ada0 tx=0x7fb7dc00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:04.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.013+0000 7fb7e8a5c700 1 -- 172.21.15.80:0/3003644953 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc017020 con 0x7fb7e41094c0 2024-04-26T18:35:04.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.013+0000 7fb7e8a5c700 1 -- 172.21.15.80:0/3003644953 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7dc00ce30 con 0x7fb7e41094c0 2024-04-26T18:35:04.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.013+0000 7fb7e8a5c700 1 -- 172.21.15.80:0/3003644953 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc0054a0 con 0x7fb7e41094c0 2024-04-26T18:35:04.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.013+0000 7fb7e9a5e700 1 -- 172.21.15.80:0/3003644953 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e419a350 con 0x7fb7e41094c0 2024-04-26T18:35:04.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.013+0000 7fb7e9a5e700 1 -- 172.21.15.80:0/3003644953 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e41a65c0 con 0x7fb7e41094c0 2024-04-26T18:35:04.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.014+0000 7fb7e9a5e700 1 -- 172.21.15.80:0/3003644953 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7e406a110 con 0x7fb7e41094c0 2024-04-26T18:35:04.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.015+0000 7fb7e8a5c700 1 -- 172.21.15.80:0/3003644953 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fb7dc00c980 con 0x7fb7e41094c0 2024-04-26T18:35:04.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.016+0000 7fb7e8a5c700 1 --2- 172.21.15.80:0/3003644953 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb7cc0a3c40 0x7fb7cc0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:04.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.016+0000 7fb7e2ffd700 1 --2- 172.21.15.80:0/3003644953 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb7cc0a3c40 0x7fb7cc0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:04.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.016+0000 7fb7e8a5c700 1 -- 172.21.15.80:0/3003644953 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fb7dc0cfb60 con 0x7fb7e41094c0 2024-04-26T18:35:04.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.016+0000 7fb7e2ffd700 1 --2- 172.21.15.80:0/3003644953 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb7cc0a3c40 0x7fb7cc0a6100 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8006010 tx=0x7fb7d801a040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:04.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.020+0000 7fb7e8a5c700 1 -- 172.21.15.80:0/3003644953 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb7dc021020 con 0x7fb7e41094c0 2024-04-26T18:35:04.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.214+0000 7fb7e9a5e700 1 -- 172.21.15.80:0/3003644953 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb7e4063860 con 0x7fb7cc0a3c40 2024-04-26T18:35:04.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.221+0000 7fb7e8a5c700 1 -- 172.21.15.80:0/3003644953 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259033 (secure 0 0 0) 0x7fb7e4063860 con 0x7fb7cc0a3c40 2024-04-26T18:35:04.225 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:35:04.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.224+0000 7fb7e9a5e700 1 -- 172.21.15.80:0/3003644953 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb7cc0a3c40 msgr2=0x7fb7cc0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:04.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.224+0000 7fb7e9a5e700 1 --2- 172.21.15.80:0/3003644953 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb7cc0a3c40 0x7fb7cc0a6100 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8006010 tx=0x7fb7d801a040 comp rx=0 tx=0).stop 2024-04-26T18:35:04.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.224+0000 7fb7e9a5e700 1 -- 172.21.15.80:0/3003644953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e41094c0 msgr2=0x7fb7e4199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:04.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.224+0000 7fb7e9a5e700 1 --2- 172.21.15.80:0/3003644953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e41094c0 0x7fb7e4199900 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc00ada0 tx=0x7fb7dc00c330 comp rx=0 tx=0).stop 2024-04-26T18:35:04.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.224+0000 7fb7e9a5e700 1 -- 172.21.15.80:0/3003644953 shutdown_connections 2024-04-26T18:35:04.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.224+0000 7fb7e9a5e700 1 --2- 172.21.15.80:0/3003644953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e41094c0 0x7fb7e4199900 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:04.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.224+0000 7fb7e9a5e700 1 --2- 172.21.15.80:0/3003644953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7e4103470 0x7fb7e419f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:04.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.224+0000 7fb7e9a5e700 1 --2- 172.21.15.80:0/3003644953 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb7cc0a3c40 0x7fb7cc0a6100 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:04.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.224+0000 7fb7e9a5e700 1 --2- 172.21.15.80:0/3003644953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7e4103e30 0x7fb7e419fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:04.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.224+0000 7fb7e9a5e700 1 -- 172.21.15.80:0/3003644953 >> 172.21.15.80:0/3003644953 conn(0x7fb7e407a580 msgr2=0x7fb7e4102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:04.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.224+0000 7fb7e9a5e700 1 -- 172.21.15.80:0/3003644953 shutdown_connections 2024-04-26T18:35:04.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:04.224+0000 7fb7e9a5e700 1 -- 172.21.15.80:0/3003644953 wait complete. 2024-04-26T18:35:04.229 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-26T18:35:04.885 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":357,"stamp":"2024-04-26T18:35:02.524375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659631,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1136,"num_read_kb":692,"num_write":435,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1181430,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":855,"ondisk_log_size":855,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365552,"kb_used_data":12240,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576272,"statfs":{"total":1151940427776,"available":1151566102528,"internally_reserved":0,"allocated":12533760,"data_stored":7765953,"data_compressed":106677,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":390,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":67,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003185"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.517610+0000","last_change":"2024-04-26T18:33:06.565673+0000","last_active":"2024-04-26T18:34:50.517610+0000","last_peered":"2024-04-26T18:34:50.517610+0000","last_clean":"2024-04-26T18:34:50.517610+0000","last_became_active":"2024-04-26T18:33:06.565065+0000","last_became_peered":"2024-04-26T18:33:06.565065+0000","last_unstale":"2024-04-26T18:34:50.517610+0000","last_undegraded":"2024-04-26T18:34:50.517610+0000","last_fullsized":"2024-04-26T18:34:50.517610+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:54:10.833343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.511721+0000","last_change":"2024-04-26T18:33:06.552350+0000","last_active":"2024-04-26T18:34:50.511721+0000","last_peered":"2024-04-26T18:34:50.511721+0000","last_clean":"2024-04-26T18:34:50.511721+0000","last_became_active":"2024-04-26T18:33:06.551941+0000","last_became_peered":"2024-04-26T18:33:06.551941+0000","last_unstale":"2024-04-26T18:34:50.511721+0000","last_undegraded":"2024-04-26T18:34:50.511721+0000","last_fullsized":"2024-04-26T18:34:50.511721+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:40.702995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.532724+0000","last_change":"2024-04-26T18:33:06.561456+0000","last_active":"2024-04-26T18:34:50.532724+0000","last_peered":"2024-04-26T18:34:50.532724+0000","last_clean":"2024-04-26T18:34:50.532724+0000","last_became_active":"2024-04-26T18:33:06.561032+0000","last_became_peered":"2024-04-26T18:33:06.561032+0000","last_unstale":"2024-04-26T18:34:50.532724+0000","last_undegraded":"2024-04-26T18:34:50.532724+0000","last_fullsized":"2024-04-26T18:34:50.532724+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:56:56.228873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.505062+0000","last_change":"2024-04-26T18:33:06.556597+0000","last_active":"2024-04-26T18:34:50.505062+0000","last_peered":"2024-04-26T18:34:50.505062+0000","last_clean":"2024-04-26T18:34:50.505062+0000","last_became_active":"2024-04-26T18:33:06.555356+0000","last_became_peered":"2024-04-26T18:33:06.555356+0000","last_unstale":"2024-04-26T18:34:50.505062+0000","last_undegraded":"2024-04-26T18:34:50.505062+0000","last_fullsized":"2024-04-26T18:34:50.505062+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:55.860495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.505161+0000","last_change":"2024-04-26T18:33:06.549480+0000","last_active":"2024-04-26T18:34:50.505161+0000","last_peered":"2024-04-26T18:34:50.505161+0000","last_clean":"2024-04-26T18:34:50.505161+0000","last_became_active":"2024-04-26T18:33:06.549086+0000","last_became_peered":"2024-04-26T18:33:06.549086+0000","last_unstale":"2024-04-26T18:34:50.505161+0000","last_undegraded":"2024-04-26T18:34:50.505161+0000","last_fullsized":"2024-04-26T18:34:50.505161+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:13.012745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.525776+0000","last_change":"2024-04-26T18:33:06.558539+0000","last_active":"2024-04-26T18:34:50.525776+0000","last_peered":"2024-04-26T18:34:50.525776+0000","last_clean":"2024-04-26T18:34:50.525776+0000","last_became_active":"2024-04-26T18:33:06.558185+0000","last_became_peered":"2024-04-26T18:33:06.558185+0000","last_unstale":"2024-04-26T18:34:50.525776+0000","last_undegraded":"2024-04-26T18:34:50.525776+0000","last_fullsized":"2024-04-26T18:34:50.525776+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:59:31.299478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.511734+0000","last_change":"2024-04-26T18:33:06.557336+0000","last_active":"2024-04-26T18:34:50.511734+0000","last_peered":"2024-04-26T18:34:50.511734+0000","last_clean":"2024-04-26T18:34:50.511734+0000","last_became_active":"2024-04-26T18:33:06.556988+0000","last_became_peered":"2024-04-26T18:33:06.556988+0000","last_unstale":"2024-04-26T18:34:50.511734+0000","last_undegraded":"2024-04-26T18:34:50.511734+0000","last_fullsized":"2024-04-26T18:34:50.511734+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:48.814042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.528890+0000","last_change":"2024-04-26T18:33:06.556355+0000","last_active":"2024-04-26T18:34:50.528890+0000","last_peered":"2024-04-26T18:34:50.528890+0000","last_clean":"2024-04-26T18:34:50.528890+0000","last_became_active":"2024-04-26T18:33:06.555947+0000","last_became_peered":"2024-04-26T18:33:06.555947+0000","last_unstale":"2024-04-26T18:34:50.528890+0000","last_undegraded":"2024-04-26T18:34:50.528890+0000","last_fullsized":"2024-04-26T18:34:50.528890+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:36.607305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.522408+0000","last_change":"2024-04-26T18:33:06.569673+0000","last_active":"2024-04-26T18:34:50.522408+0000","last_peered":"2024-04-26T18:34:50.522408+0000","last_clean":"2024-04-26T18:34:50.522408+0000","last_became_active":"2024-04-26T18:33:06.568453+0000","last_became_peered":"2024-04-26T18:33:06.568453+0000","last_unstale":"2024-04-26T18:34:50.522408+0000","last_undegraded":"2024-04-26T18:34:50.522408+0000","last_fullsized":"2024-04-26T18:34:50.522408+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:38.428723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.515334+0000","last_change":"2024-04-26T18:33:06.564286+0000","last_active":"2024-04-26T18:34:50.515334+0000","last_peered":"2024-04-26T18:34:50.515334+0000","last_clean":"2024-04-26T18:34:50.515334+0000","last_became_active":"2024-04-26T18:33:06.563830+0000","last_became_peered":"2024-04-26T18:33:06.563830+0000","last_unstale":"2024-04-26T18:34:50.515334+0000","last_undegraded":"2024-04-26T18:34:50.515334+0000","last_fullsized":"2024-04-26T18:34:50.515334+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:36.518838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.525362+0000","last_change":"2024-04-26T18:33:06.560724+0000","last_active":"2024-04-26T18:34:50.525362+0000","last_peered":"2024-04-26T18:34:50.525362+0000","last_clean":"2024-04-26T18:34:50.525362+0000","last_became_active":"2024-04-26T18:33:06.560393+0000","last_became_peered":"2024-04-26T18:33:06.560393+0000","last_unstale":"2024-04-26T18:34:50.525362+0000","last_undegraded":"2024-04-26T18:34:50.525362+0000","last_fullsized":"2024-04-26T18:34:50.525362+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:41.286466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.527263+0000","last_change":"2024-04-26T18:33:51.859986+0000","last_active":"2024-04-26T18:34:50.527263+0000","last_peered":"2024-04-26T18:34:50.527263+0000","last_clean":"2024-04-26T18:34:50.527263+0000","last_became_active":"2024-04-26T18:33:51.859656+0000","last_became_peered":"2024-04-26T18:33:51.859656+0000","last_unstale":"2024-04-26T18:34:50.527263+0000","last_undegraded":"2024-04-26T18:34:50.527263+0000","last_fullsized":"2024-04-26T18:34:50.527263+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:09:48.471097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.529194+0000","last_change":"2024-04-26T18:33:06.555813+0000","last_active":"2024-04-26T18:34:50.529194+0000","last_peered":"2024-04-26T18:34:50.529194+0000","last_clean":"2024-04-26T18:34:50.529194+0000","last_became_active":"2024-04-26T18:33:06.555498+0000","last_became_peered":"2024-04-26T18:33:06.555498+0000","last_unstale":"2024-04-26T18:34:50.529194+0000","last_undegraded":"2024-04-26T18:34:50.529194+0000","last_fullsized":"2024-04-26T18:34:50.529194+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:21.531142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.521138+0000","last_change":"2024-04-26T18:33:06.551833+0000","last_active":"2024-04-26T18:34:50.521138+0000","last_peered":"2024-04-26T18:34:50.521138+0000","last_clean":"2024-04-26T18:34:50.521138+0000","last_became_active":"2024-04-26T18:33:06.551503+0000","last_became_peered":"2024-04-26T18:33:06.551503+0000","last_unstale":"2024-04-26T18:34:50.521138+0000","last_undegraded":"2024-04-26T18:34:50.521138+0000","last_fullsized":"2024-04-26T18:34:50.521138+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:20.560656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.515548+0000","last_change":"2024-04-26T18:33:06.555971+0000","last_active":"2024-04-26T18:34:50.515548+0000","last_peered":"2024-04-26T18:34:50.515548+0000","last_clean":"2024-04-26T18:34:50.515548+0000","last_became_active":"2024-04-26T18:33:06.555312+0000","last_became_peered":"2024-04-26T18:33:06.555312+0000","last_unstale":"2024-04-26T18:34:50.515548+0000","last_undegraded":"2024-04-26T18:34:50.515548+0000","last_fullsized":"2024-04-26T18:34:50.515548+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:05.066403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.532536+0000","last_change":"2024-04-26T18:33:06.567762+0000","last_active":"2024-04-26T18:34:50.532536+0000","last_peered":"2024-04-26T18:34:50.532536+0000","last_clean":"2024-04-26T18:34:50.532536+0000","last_became_active":"2024-04-26T18:33:06.567368+0000","last_became_peered":"2024-04-26T18:33:06.567368+0000","last_unstale":"2024-04-26T18:34:50.532536+0000","last_undegraded":"2024-04-26T18:34:50.532536+0000","last_fullsized":"2024-04-26T18:34:50.532536+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:27.428529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.517974+0000","last_change":"2024-04-26T18:33:06.565334+0000","last_active":"2024-04-26T18:34:50.517974+0000","last_peered":"2024-04-26T18:34:50.517974+0000","last_clean":"2024-04-26T18:34:50.517974+0000","last_became_active":"2024-04-26T18:33:06.564997+0000","last_became_peered":"2024-04-26T18:33:06.564997+0000","last_unstale":"2024-04-26T18:34:50.517974+0000","last_undegraded":"2024-04-26T18:34:50.517974+0000","last_fullsized":"2024-04-26T18:34:50.517974+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:57.892318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.531950+0000","last_change":"2024-04-26T18:33:06.562242+0000","last_active":"2024-04-26T18:34:50.531950+0000","last_peered":"2024-04-26T18:34:50.531950+0000","last_clean":"2024-04-26T18:34:50.531950+0000","last_became_active":"2024-04-26T18:33:06.561863+0000","last_became_peered":"2024-04-26T18:33:06.561863+0000","last_unstale":"2024-04-26T18:34:50.531950+0000","last_undegraded":"2024-04-26T18:34:50.531950+0000","last_fullsized":"2024-04-26T18:34:50.531950+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:22.745294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.530333+0000","last_change":"2024-04-26T18:33:06.555511+0000","last_active":"2024-04-26T18:34:50.530333+0000","last_peered":"2024-04-26T18:34:50.530333+0000","last_clean":"2024-04-26T18:34:50.530333+0000","last_became_active":"2024-04-26T18:33:06.555201+0000","last_became_peered":"2024-04-26T18:33:06.555201+0000","last_unstale":"2024-04-26T18:34:50.530333+0000","last_undegraded":"2024-04-26T18:34:50.530333+0000","last_fullsized":"2024-04-26T18:34:50.530333+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:09.644167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:58.754061+0000","last_change":"2024-04-26T18:33:51.664154+0000","last_active":"2024-04-26T18:34:58.754061+0000","last_peered":"2024-04-26T18:34:58.754061+0000","last_clean":"2024-04-26T18:34:58.754061+0000","last_became_active":"2024-04-26T18:33:51.653330+0000","last_became_peered":"2024-04-26T18:33:51.653330+0000","last_unstale":"2024-04-26T18:34:58.754061+0000","last_undegraded":"2024-04-26T18:34:58.754061+0000","last_fullsized":"2024-04-26T18:34:58.754061+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:55:49.100993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.530675+0000","last_change":"2024-04-26T18:33:06.560652+0000","last_active":"2024-04-26T18:34:50.530675+0000","last_peered":"2024-04-26T18:34:50.530675+0000","last_clean":"2024-04-26T18:34:50.530675+0000","last_became_active":"2024-04-26T18:33:06.560311+0000","last_became_peered":"2024-04-26T18:33:06.560311+0000","last_unstale":"2024-04-26T18:34:50.530675+0000","last_undegraded":"2024-04-26T18:34:50.530675+0000","last_fullsized":"2024-04-26T18:34:50.530675+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:22.653995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.651282+0000","last_change":"2024-04-26T18:33:03.860585+0000","last_active":"2024-04-26T18:33:51.651282+0000","last_peered":"2024-04-26T18:33:51.651282+0000","last_clean":"2024-04-26T18:33:51.651282+0000","last_became_active":"2024-04-26T18:33:03.860232+0000","last_became_peered":"2024-04-26T18:33:03.860232+0000","last_unstale":"2024-04-26T18:33:51.651282+0000","last_undegraded":"2024-04-26T18:33:51.651282+0000","last_fullsized":"2024-04-26T18:33:51.651282+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:04.685495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.532712+0000","last_change":"2024-04-26T18:33:06.563764+0000","last_active":"2024-04-26T18:34:50.532712+0000","last_peered":"2024-04-26T18:34:50.532712+0000","last_clean":"2024-04-26T18:34:50.532712+0000","last_became_active":"2024-04-26T18:33:06.563322+0000","last_became_peered":"2024-04-26T18:33:06.563322+0000","last_unstale":"2024-04-26T18:34:50.532712+0000","last_undegraded":"2024-04-26T18:34:50.532712+0000","last_fullsized":"2024-04-26T18:34:50.532712+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:17:53.144144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.648913+0000","last_change":"2024-04-26T18:33:03.533057+0000","last_active":"2024-04-26T18:33:51.648913+0000","last_peered":"2024-04-26T18:33:51.648913+0000","last_clean":"2024-04-26T18:33:51.648913+0000","last_became_active":"2024-04-26T18:33:03.532665+0000","last_became_peered":"2024-04-26T18:33:03.532665+0000","last_unstale":"2024-04-26T18:33:51.648913+0000","last_undegraded":"2024-04-26T18:33:51.648913+0000","last_fullsized":"2024-04-26T18:33:51.648913+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:29.125064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.527073+0000","last_change":"2024-04-26T18:33:06.567612+0000","last_active":"2024-04-26T18:34:50.527073+0000","last_peered":"2024-04-26T18:34:50.527073+0000","last_clean":"2024-04-26T18:34:50.527073+0000","last_became_active":"2024-04-26T18:33:06.565883+0000","last_became_peered":"2024-04-26T18:33:06.565883+0000","last_unstale":"2024-04-26T18:34:50.527073+0000","last_undegraded":"2024-04-26T18:34:50.527073+0000","last_fullsized":"2024-04-26T18:34:50.527073+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:59.721305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.649230+0000","last_change":"2024-04-26T18:33:03.532075+0000","last_active":"2024-04-26T18:33:51.649230+0000","last_peered":"2024-04-26T18:33:51.649230+0000","last_clean":"2024-04-26T18:33:51.649230+0000","last_became_active":"2024-04-26T18:33:03.531729+0000","last_became_peered":"2024-04-26T18:33:03.531729+0000","last_unstale":"2024-04-26T18:33:51.649230+0000","last_undegraded":"2024-04-26T18:33:51.649230+0000","last_fullsized":"2024-04-26T18:33:51.649230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:23.748292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.523709+0000","last_change":"2024-04-26T18:33:06.569377+0000","last_active":"2024-04-26T18:34:50.523709+0000","last_peered":"2024-04-26T18:34:50.523709+0000","last_clean":"2024-04-26T18:34:50.523709+0000","last_became_active":"2024-04-26T18:33:06.569057+0000","last_became_peered":"2024-04-26T18:33:06.569057+0000","last_unstale":"2024-04-26T18:34:50.523709+0000","last_undegraded":"2024-04-26T18:34:50.523709+0000","last_fullsized":"2024-04-26T18:34:50.523709+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:10.968017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"91'7","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:59.051214+0000","last_change":"2024-04-26T18:33:03.525186+0000","last_active":"2024-04-26T18:34:59.051214+0000","last_peered":"2024-04-26T18:34:59.051214+0000","last_clean":"2024-04-26T18:34:59.051214+0000","last_became_active":"2024-04-26T18:33:03.524880+0000","last_became_peered":"2024-04-26T18:33:03.524880+0000","last_unstale":"2024-04-26T18:34:59.051214+0000","last_undegraded":"2024-04-26T18:34:59.051214+0000","last_fullsized":"2024-04-26T18:34:59.051214+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:51:30.130244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.518638+0000","last_change":"2024-04-26T18:33:06.558034+0000","last_active":"2024-04-26T18:34:50.518638+0000","last_peered":"2024-04-26T18:34:50.518638+0000","last_clean":"2024-04-26T18:34:50.518638+0000","last_became_active":"2024-04-26T18:33:06.557694+0000","last_became_peered":"2024-04-26T18:33:06.557694+0000","last_unstale":"2024-04-26T18:34:50.518638+0000","last_undegraded":"2024-04-26T18:34:50.518638+0000","last_fullsized":"2024-04-26T18:34:50.518638+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:02.497601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.857346+0000","last_change":"2024-04-26T18:33:03.528750+0000","last_active":"2024-04-26T18:33:51.857346+0000","last_peered":"2024-04-26T18:33:51.857346+0000","last_clean":"2024-04-26T18:33:51.857346+0000","last_became_active":"2024-04-26T18:33:03.528442+0000","last_became_peered":"2024-04-26T18:33:03.528442+0000","last_unstale":"2024-04-26T18:33:51.857346+0000","last_undegraded":"2024-04-26T18:33:51.857346+0000","last_fullsized":"2024-04-26T18:33:51.857346+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:13.931280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.530787+0000","last_change":"2024-04-26T18:33:06.561274+0000","last_active":"2024-04-26T18:34:50.530787+0000","last_peered":"2024-04-26T18:34:50.530787+0000","last_clean":"2024-04-26T18:34:50.530787+0000","last_became_active":"2024-04-26T18:33:06.560622+0000","last_became_peered":"2024-04-26T18:33:06.560622+0000","last_unstale":"2024-04-26T18:34:50.530787+0000","last_undegraded":"2024-04-26T18:34:50.530787+0000","last_fullsized":"2024-04-26T18:34:50.530787+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:27.875181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.950814+0000","last_change":"2024-04-26T18:33:03.529634+0000","last_active":"2024-04-26T18:33:51.950814+0000","last_peered":"2024-04-26T18:33:51.950814+0000","last_clean":"2024-04-26T18:33:51.950814+0000","last_became_active":"2024-04-26T18:33:03.529303+0000","last_became_peered":"2024-04-26T18:33:03.529303+0000","last_unstale":"2024-04-26T18:33:51.950814+0000","last_undegraded":"2024-04-26T18:33:51.950814+0000","last_fullsized":"2024-04-26T18:33:51.950814+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:37.580542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.530454+0000","last_change":"2024-04-26T18:33:06.550896+0000","last_active":"2024-04-26T18:34:50.530454+0000","last_peered":"2024-04-26T18:34:50.530454+0000","last_clean":"2024-04-26T18:34:50.530454+0000","last_became_active":"2024-04-26T18:33:06.550571+0000","last_became_peered":"2024-04-26T18:33:06.550571+0000","last_unstale":"2024-04-26T18:34:50.530454+0000","last_undegraded":"2024-04-26T18:34:50.530454+0000","last_fullsized":"2024-04-26T18:34:50.530454+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:26.715158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.651588+0000","last_change":"2024-04-26T18:33:03.530875+0000","last_active":"2024-04-26T18:33:51.651588+0000","last_peered":"2024-04-26T18:33:51.651588+0000","last_clean":"2024-04-26T18:33:51.651588+0000","last_became_active":"2024-04-26T18:33:03.530564+0000","last_became_peered":"2024-04-26T18:33:03.530564+0000","last_unstale":"2024-04-26T18:33:51.651588+0000","last_undegraded":"2024-04-26T18:33:51.651588+0000","last_fullsized":"2024-04-26T18:33:51.651588+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:20.320591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.528595+0000","last_change":"2024-04-26T18:33:06.553434+0000","last_active":"2024-04-26T18:34:50.528595+0000","last_peered":"2024-04-26T18:34:50.528595+0000","last_clean":"2024-04-26T18:34:50.528595+0000","last_became_active":"2024-04-26T18:33:06.551897+0000","last_became_peered":"2024-04-26T18:33:06.551897+0000","last_unstale":"2024-04-26T18:34:50.528595+0000","last_undegraded":"2024-04-26T18:34:50.528595+0000","last_fullsized":"2024-04-26T18:34:50.528595+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:56.503266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"91'5","reported_seq":226,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:35:01.053450+0000","last_change":"2024-04-26T18:33:03.524239+0000","last_active":"2024-04-26T18:35:01.053450+0000","last_peered":"2024-04-26T18:35:01.053450+0000","last_clean":"2024-04-26T18:35:01.053450+0000","last_became_active":"2024-04-26T18:33:03.523848+0000","last_became_peered":"2024-04-26T18:33:03.523848+0000","last_unstale":"2024-04-26T18:35:01.053450+0000","last_undegraded":"2024-04-26T18:35:01.053450+0000","last_fullsized":"2024-04-26T18:35:01.053450+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:29.354430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":196,"num_read_kb":196,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.530265+0000","last_change":"2024-04-26T18:33:06.569557+0000","last_active":"2024-04-26T18:34:50.530265+0000","last_peered":"2024-04-26T18:34:50.530265+0000","last_clean":"2024-04-26T18:34:50.530265+0000","last_became_active":"2024-04-26T18:33:06.568414+0000","last_became_peered":"2024-04-26T18:33:06.568414+0000","last_unstale":"2024-04-26T18:34:50.530265+0000","last_undegraded":"2024-04-26T18:34:50.530265+0000","last_fullsized":"2024-04-26T18:34:50.530265+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:30.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.651383+0000","last_change":"2024-04-26T18:33:03.528554+0000","last_active":"2024-04-26T18:33:51.651383+0000","last_peered":"2024-04-26T18:33:51.651383+0000","last_clean":"2024-04-26T18:33:51.651383+0000","last_became_active":"2024-04-26T18:33:03.527611+0000","last_became_peered":"2024-04-26T18:33:03.527611+0000","last_unstale":"2024-04-26T18:33:51.651383+0000","last_undegraded":"2024-04-26T18:33:51.651383+0000","last_fullsized":"2024-04-26T18:33:51.651383+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:28.387779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.519235+0000","last_change":"2024-04-26T18:33:06.561415+0000","last_active":"2024-04-26T18:34:50.519235+0000","last_peered":"2024-04-26T18:34:50.519235+0000","last_clean":"2024-04-26T18:34:50.519235+0000","last_became_active":"2024-04-26T18:33:06.560518+0000","last_became_peered":"2024-04-26T18:33:06.560518+0000","last_unstale":"2024-04-26T18:34:50.519235+0000","last_undegraded":"2024-04-26T18:34:50.519235+0000","last_fullsized":"2024-04-26T18:34:50.519235+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:49.824157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.653029+0000","last_change":"2024-04-26T18:33:03.861087+0000","last_active":"2024-04-26T18:33:51.653029+0000","last_peered":"2024-04-26T18:33:51.653029+0000","last_clean":"2024-04-26T18:33:51.653029+0000","last_became_active":"2024-04-26T18:33:03.860531+0000","last_became_peered":"2024-04-26T18:33:03.860531+0000","last_unstale":"2024-04-26T18:33:51.653029+0000","last_undegraded":"2024-04-26T18:33:51.653029+0000","last_fullsized":"2024-04-26T18:33:51.653029+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:22:07.086887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.532244+0000","last_change":"2024-04-26T18:33:06.565910+0000","last_active":"2024-04-26T18:34:50.532244+0000","last_peered":"2024-04-26T18:34:50.532244+0000","last_clean":"2024-04-26T18:34:50.532244+0000","last_became_active":"2024-04-26T18:33:06.565402+0000","last_became_peered":"2024-04-26T18:33:06.565402+0000","last_unstale":"2024-04-26T18:34:50.532244+0000","last_undegraded":"2024-04-26T18:34:50.532244+0000","last_fullsized":"2024-04-26T18:34:50.532244+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:40.418513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"91'34","reported_seq":265,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:35:01.052973+0000","last_change":"2024-04-26T18:33:03.527871+0000","last_active":"2024-04-26T18:35:01.052973+0000","last_peered":"2024-04-26T18:35:01.052973+0000","last_clean":"2024-04-26T18:35:01.052973+0000","last_became_active":"2024-04-26T18:33:03.527546+0000","last_became_peered":"2024-04-26T18:33:03.527546+0000","last_unstale":"2024-04-26T18:35:01.052973+0000","last_undegraded":"2024-04-26T18:35:01.052973+0000","last_fullsized":"2024-04-26T18:35:01.052973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:24.749505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62075,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":206,"num_read_kb":163,"num_write":36,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.509760+0000","last_change":"2024-04-26T18:33:06.546735+0000","last_active":"2024-04-26T18:34:50.509760+0000","last_peered":"2024-04-26T18:34:50.509760+0000","last_clean":"2024-04-26T18:34:50.509760+0000","last_became_active":"2024-04-26T18:33:06.546360+0000","last_became_peered":"2024-04-26T18:33:06.546360+0000","last_unstale":"2024-04-26T18:34:50.509760+0000","last_undegraded":"2024-04-26T18:34:50.509760+0000","last_fullsized":"2024-04-26T18:34:50.509760+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:15.736669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.647249+0000","last_change":"2024-04-26T18:33:03.526081+0000","last_active":"2024-04-26T18:33:51.647249+0000","last_peered":"2024-04-26T18:33:51.647249+0000","last_clean":"2024-04-26T18:33:51.647249+0000","last_became_active":"2024-04-26T18:33:03.525717+0000","last_became_peered":"2024-04-26T18:33:03.525717+0000","last_unstale":"2024-04-26T18:33:51.647249+0000","last_undegraded":"2024-04-26T18:33:51.647249+0000","last_fullsized":"2024-04-26T18:33:51.647249+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:15.137654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.530086+0000","last_change":"2024-04-26T18:33:06.552689+0000","last_active":"2024-04-26T18:34:50.530086+0000","last_peered":"2024-04-26T18:34:50.530086+0000","last_clean":"2024-04-26T18:34:50.530086+0000","last_became_active":"2024-04-26T18:33:06.552404+0000","last_became_peered":"2024-04-26T18:33:06.552404+0000","last_unstale":"2024-04-26T18:34:50.530086+0000","last_undegraded":"2024-04-26T18:34:50.530086+0000","last_fullsized":"2024-04-26T18:34:50.530086+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:58:32.681037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.652399+0000","last_change":"2024-04-26T18:33:03.526092+0000","last_active":"2024-04-26T18:33:51.652399+0000","last_peered":"2024-04-26T18:33:51.652399+0000","last_clean":"2024-04-26T18:33:51.652399+0000","last_became_active":"2024-04-26T18:33:03.525782+0000","last_became_peered":"2024-04-26T18:33:03.525782+0000","last_unstale":"2024-04-26T18:33:51.652399+0000","last_undegraded":"2024-04-26T18:33:51.652399+0000","last_fullsized":"2024-04-26T18:33:51.652399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:56.564484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.523411+0000","last_change":"2024-04-26T18:33:51.952244+0000","last_active":"2024-04-26T18:34:50.523411+0000","last_peered":"2024-04-26T18:34:50.523411+0000","last_clean":"2024-04-26T18:34:50.523411+0000","last_became_active":"2024-04-26T18:33:51.951795+0000","last_became_peered":"2024-04-26T18:33:51.951795+0000","last_unstale":"2024-04-26T18:34:50.523411+0000","last_undegraded":"2024-04-26T18:34:50.523411+0000","last_fullsized":"2024-04-26T18:34:50.523411+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:39.268117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'5","reported_seq":130,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:35:00.046852+0000","last_change":"2024-04-26T18:33:03.531232+0000","last_active":"2024-04-26T18:35:00.046852+0000","last_peered":"2024-04-26T18:35:00.046852+0000","last_clean":"2024-04-26T18:35:00.046852+0000","last_became_active":"2024-04-26T18:33:03.530861+0000","last_became_peered":"2024-04-26T18:33:03.530861+0000","last_unstale":"2024-04-26T18:35:00.046852+0000","last_undegraded":"2024-04-26T18:35:00.046852+0000","last_fullsized":"2024-04-26T18:35:00.046852+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:07:44.576659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.511089+0000","last_change":"2024-04-26T18:33:06.559471+0000","last_active":"2024-04-26T18:34:50.511089+0000","last_peered":"2024-04-26T18:34:50.511089+0000","last_clean":"2024-04-26T18:34:50.511089+0000","last_became_active":"2024-04-26T18:33:06.559156+0000","last_became_peered":"2024-04-26T18:33:06.559156+0000","last_unstale":"2024-04-26T18:34:50.511089+0000","last_undegraded":"2024-04-26T18:34:50.511089+0000","last_fullsized":"2024-04-26T18:34:50.511089+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:37.624415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.648213+0000","last_change":"2024-04-26T18:33:03.860900+0000","last_active":"2024-04-26T18:33:51.648213+0000","last_peered":"2024-04-26T18:33:51.648213+0000","last_clean":"2024-04-26T18:33:51.648213+0000","last_became_active":"2024-04-26T18:33:03.860601+0000","last_became_peered":"2024-04-26T18:33:03.860601+0000","last_unstale":"2024-04-26T18:33:51.648213+0000","last_undegraded":"2024-04-26T18:33:51.648213+0000","last_fullsized":"2024-04-26T18:33:51.648213+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:56.527624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.531579+0000","last_change":"2024-04-26T18:33:51.861484+0000","last_active":"2024-04-26T18:34:50.531579+0000","last_peered":"2024-04-26T18:34:50.531579+0000","last_clean":"2024-04-26T18:34:50.531579+0000","last_became_active":"2024-04-26T18:33:51.861066+0000","last_became_peered":"2024-04-26T18:33:51.861066+0000","last_unstale":"2024-04-26T18:34:50.531579+0000","last_undegraded":"2024-04-26T18:34:50.531579+0000","last_fullsized":"2024-04-26T18:34:50.531579+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:48.477037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.667905+0000","last_change":"2024-04-26T18:33:51.667455+0000","last_active":"2024-04-26T18:33:51.667905+0000","last_peered":"2024-04-26T18:33:51.667905+0000","last_clean":"2024-04-26T18:33:51.667905+0000","last_became_active":"2024-04-26T18:33:51.653472+0000","last_became_peered":"2024-04-26T18:33:51.653472+0000","last_unstale":"2024-04-26T18:33:51.667905+0000","last_undegraded":"2024-04-26T18:33:51.667905+0000","last_fullsized":"2024-04-26T18:33:51.667905+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:19.828738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.519194+0000","last_change":"2024-04-26T18:33:06.557597+0000","last_active":"2024-04-26T18:34:50.519194+0000","last_peered":"2024-04-26T18:34:50.519194+0000","last_clean":"2024-04-26T18:34:50.519194+0000","last_became_active":"2024-04-26T18:33:06.557249+0000","last_became_peered":"2024-04-26T18:33:06.557249+0000","last_unstale":"2024-04-26T18:34:50.519194+0000","last_undegraded":"2024-04-26T18:34:50.519194+0000","last_fullsized":"2024-04-26T18:34:50.519194+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:22.258691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.648284+0000","last_change":"2024-04-26T18:33:03.861082+0000","last_active":"2024-04-26T18:33:51.648284+0000","last_peered":"2024-04-26T18:33:51.648284+0000","last_clean":"2024-04-26T18:33:51.648284+0000","last_became_active":"2024-04-26T18:33:03.860661+0000","last_became_peered":"2024-04-26T18:33:03.860661+0000","last_unstale":"2024-04-26T18:33:51.648284+0000","last_undegraded":"2024-04-26T18:33:51.648284+0000","last_fullsized":"2024-04-26T18:33:51.648284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:46.653421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.526441+0000","last_change":"2024-04-26T18:33:06.558268+0000","last_active":"2024-04-26T18:34:50.526441+0000","last_peered":"2024-04-26T18:34:50.526441+0000","last_clean":"2024-04-26T18:34:50.526441+0000","last_became_active":"2024-04-26T18:33:06.557899+0000","last_became_peered":"2024-04-26T18:33:06.557899+0000","last_unstale":"2024-04-26T18:34:50.526441+0000","last_undegraded":"2024-04-26T18:34:50.526441+0000","last_fullsized":"2024-04-26T18:34:50.526441+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:03:47.016288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'5","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:56.752101+0000","last_change":"2024-04-26T18:33:03.528398+0000","last_active":"2024-04-26T18:34:56.752101+0000","last_peered":"2024-04-26T18:34:56.752101+0000","last_clean":"2024-04-26T18:34:56.752101+0000","last_became_active":"2024-04-26T18:33:03.528008+0000","last_became_peered":"2024-04-26T18:33:03.528008+0000","last_unstale":"2024-04-26T18:34:56.752101+0000","last_undegraded":"2024-04-26T18:34:56.752101+0000","last_fullsized":"2024-04-26T18:34:56.752101+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:27.027873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.521321+0000","last_change":"2024-04-26T18:33:06.556035+0000","last_active":"2024-04-26T18:34:50.521321+0000","last_peered":"2024-04-26T18:34:50.521321+0000","last_clean":"2024-04-26T18:34:50.521321+0000","last_became_active":"2024-04-26T18:33:06.555703+0000","last_became_peered":"2024-04-26T18:33:06.555703+0000","last_unstale":"2024-04-26T18:34:50.521321+0000","last_undegraded":"2024-04-26T18:34:50.521321+0000","last_fullsized":"2024-04-26T18:34:50.521321+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:30:02.064205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.519581+0000","last_change":"2024-04-26T18:33:06.556447+0000","last_active":"2024-04-26T18:34:50.519581+0000","last_peered":"2024-04-26T18:34:50.519581+0000","last_clean":"2024-04-26T18:34:50.519581+0000","last_became_active":"2024-04-26T18:33:06.556124+0000","last_became_peered":"2024-04-26T18:33:06.556124+0000","last_unstale":"2024-04-26T18:34:50.519581+0000","last_undegraded":"2024-04-26T18:34:50.519581+0000","last_fullsized":"2024-04-26T18:34:50.519581+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:43:07.915584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":126,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:56.040558+0000","last_change":"2024-04-26T18:33:03.860440+0000","last_active":"2024-04-26T18:34:56.040558+0000","last_peered":"2024-04-26T18:34:56.040558+0000","last_clean":"2024-04-26T18:34:56.040558+0000","last_became_active":"2024-04-26T18:33:03.860112+0000","last_became_peered":"2024-04-26T18:33:03.860112+0000","last_unstale":"2024-04-26T18:34:56.040558+0000","last_undegraded":"2024-04-26T18:34:56.040558+0000","last_fullsized":"2024-04-26T18:34:56.040558+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:19:05.661597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.529101+0000","last_change":"2024-04-26T18:33:06.561688+0000","last_active":"2024-04-26T18:34:50.529101+0000","last_peered":"2024-04-26T18:34:50.529101+0000","last_clean":"2024-04-26T18:34:50.529101+0000","last_became_active":"2024-04-26T18:33:06.561285+0000","last_became_peered":"2024-04-26T18:33:06.561285+0000","last_unstale":"2024-04-26T18:34:50.529101+0000","last_undegraded":"2024-04-26T18:34:50.529101+0000","last_fullsized":"2024-04-26T18:34:50.529101+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:13.272896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.651942+0000","last_change":"2024-04-26T18:33:03.531237+0000","last_active":"2024-04-26T18:33:51.651942+0000","last_peered":"2024-04-26T18:33:51.651942+0000","last_clean":"2024-04-26T18:33:51.651942+0000","last_became_active":"2024-04-26T18:33:03.530843+0000","last_became_peered":"2024-04-26T18:33:03.530843+0000","last_unstale":"2024-04-26T18:33:51.651942+0000","last_undegraded":"2024-04-26T18:33:51.651942+0000","last_fullsized":"2024-04-26T18:33:51.651942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:24.454752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":359,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.650822+0000","last_change":"2024-04-26T18:31:39.402840+0000","last_active":"2024-04-26T18:33:51.650822+0000","last_peered":"2024-04-26T18:33:51.650822+0000","last_clean":"2024-04-26T18:33:51.650822+0000","last_became_active":"2024-04-26T18:31:39.402341+0000","last_became_peered":"2024-04-26T18:31:39.402341+0000","last_unstale":"2024-04-26T18:33:51.650822+0000","last_undegraded":"2024-04-26T18:33:51.650822+0000","last_fullsized":"2024-04-26T18:33:51.650822+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:28:14.522548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:28:14.522548+0000","last_clean_scrub_stamp":"2024-04-26T18:28:14.522548+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:32.052085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.521836+0000","last_change":"2024-04-26T18:33:06.557695+0000","last_active":"2024-04-26T18:34:50.521836+0000","last_peered":"2024-04-26T18:34:50.521836+0000","last_clean":"2024-04-26T18:34:50.521836+0000","last_became_active":"2024-04-26T18:33:06.557369+0000","last_became_peered":"2024-04-26T18:33:06.557369+0000","last_unstale":"2024-04-26T18:34:50.521836+0000","last_undegraded":"2024-04-26T18:34:50.521836+0000","last_fullsized":"2024-04-26T18:34:50.521836+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:35.666232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.650721+0000","last_change":"2024-04-26T18:33:03.527897+0000","last_active":"2024-04-26T18:33:51.650721+0000","last_peered":"2024-04-26T18:33:51.650721+0000","last_clean":"2024-04-26T18:33:51.650721+0000","last_became_active":"2024-04-26T18:33:03.527345+0000","last_became_peered":"2024-04-26T18:33:03.527345+0000","last_unstale":"2024-04-26T18:33:51.650721+0000","last_undegraded":"2024-04-26T18:33:51.650721+0000","last_fullsized":"2024-04-26T18:33:51.650721+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:31.144555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.648589+0000","last_change":"2024-04-26T18:33:03.860572+0000","last_active":"2024-04-26T18:33:51.648589+0000","last_peered":"2024-04-26T18:33:51.648589+0000","last_clean":"2024-04-26T18:33:51.648589+0000","last_became_active":"2024-04-26T18:33:03.860188+0000","last_became_peered":"2024-04-26T18:33:03.860188+0000","last_unstale":"2024-04-26T18:33:51.648589+0000","last_undegraded":"2024-04-26T18:33:51.648589+0000","last_fullsized":"2024-04-26T18:33:51.648589+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:24:34.811572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.519125+0000","last_change":"2024-04-26T18:33:06.558075+0000","last_active":"2024-04-26T18:34:50.519125+0000","last_peered":"2024-04-26T18:34:50.519125+0000","last_clean":"2024-04-26T18:34:50.519125+0000","last_became_active":"2024-04-26T18:33:06.557293+0000","last_became_peered":"2024-04-26T18:33:06.557293+0000","last_unstale":"2024-04-26T18:34:50.519125+0000","last_undegraded":"2024-04-26T18:34:50.519125+0000","last_fullsized":"2024-04-26T18:34:50.519125+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:12.635253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"91'17","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.648518+0000","last_change":"2024-04-26T18:33:03.528196+0000","last_active":"2024-04-26T18:33:51.648518+0000","last_peered":"2024-04-26T18:33:51.648518+0000","last_clean":"2024-04-26T18:33:51.648518+0000","last_became_active":"2024-04-26T18:33:03.527846+0000","last_became_peered":"2024-04-26T18:33:03.527846+0000","last_unstale":"2024-04-26T18:33:51.648518+0000","last_undegraded":"2024-04-26T18:33:51.648518+0000","last_fullsized":"2024-04-26T18:33:51.648518+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:13:46.073405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.525019+0000","last_change":"2024-04-26T18:33:06.550260+0000","last_active":"2024-04-26T18:34:50.525019+0000","last_peered":"2024-04-26T18:34:50.525019+0000","last_clean":"2024-04-26T18:34:50.525019+0000","last_became_active":"2024-04-26T18:33:06.549925+0000","last_became_peered":"2024-04-26T18:33:06.549925+0000","last_unstale":"2024-04-26T18:34:50.525019+0000","last_undegraded":"2024-04-26T18:34:50.525019+0000","last_fullsized":"2024-04-26T18:34:50.525019+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:17:01.777381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.652423+0000","last_change":"2024-04-26T18:33:03.876609+0000","last_active":"2024-04-26T18:33:51.652423+0000","last_peered":"2024-04-26T18:33:51.652423+0000","last_clean":"2024-04-26T18:33:51.652423+0000","last_became_active":"2024-04-26T18:33:03.876284+0000","last_became_peered":"2024-04-26T18:33:03.876284+0000","last_unstale":"2024-04-26T18:33:51.652423+0000","last_undegraded":"2024-04-26T18:33:51.652423+0000","last_fullsized":"2024-04-26T18:33:51.652423+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:22.995000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.529845+0000","last_change":"2024-04-26T18:33:06.558735+0000","last_active":"2024-04-26T18:34:50.529845+0000","last_peered":"2024-04-26T18:34:50.529845+0000","last_clean":"2024-04-26T18:34:50.529845+0000","last_became_active":"2024-04-26T18:33:06.558416+0000","last_became_peered":"2024-04-26T18:33:06.558416+0000","last_unstale":"2024-04-26T18:34:50.529845+0000","last_undegraded":"2024-04-26T18:34:50.529845+0000","last_fullsized":"2024-04-26T18:34:50.529845+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:27.627055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.860052+0000","last_change":"2024-04-26T18:33:03.861073+0000","last_active":"2024-04-26T18:33:51.860052+0000","last_peered":"2024-04-26T18:33:51.860052+0000","last_clean":"2024-04-26T18:33:51.860052+0000","last_became_active":"2024-04-26T18:33:03.860661+0000","last_became_peered":"2024-04-26T18:33:03.860661+0000","last_unstale":"2024-04-26T18:33:51.860052+0000","last_undegraded":"2024-04-26T18:33:51.860052+0000","last_fullsized":"2024-04-26T18:33:51.860052+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:19.429969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.479048+0000","last_change":"2024-04-26T18:33:06.553160+0000","last_active":"2024-04-26T18:34:50.479048+0000","last_peered":"2024-04-26T18:34:50.479048+0000","last_clean":"2024-04-26T18:34:50.479048+0000","last_became_active":"2024-04-26T18:33:06.552791+0000","last_became_peered":"2024-04-26T18:33:06.552791+0000","last_unstale":"2024-04-26T18:34:50.479048+0000","last_undegraded":"2024-04-26T18:34:50.479048+0000","last_fullsized":"2024-04-26T18:34:50.479048+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:31.675069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.651019+0000","last_change":"2024-04-26T18:33:03.524443+0000","last_active":"2024-04-26T18:33:51.651019+0000","last_peered":"2024-04-26T18:33:51.651019+0000","last_clean":"2024-04-26T18:33:51.651019+0000","last_became_active":"2024-04-26T18:33:03.524137+0000","last_became_peered":"2024-04-26T18:33:03.524137+0000","last_unstale":"2024-04-26T18:33:51.651019+0000","last_undegraded":"2024-04-26T18:33:51.651019+0000","last_fullsized":"2024-04-26T18:33:51.651019+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:43.021778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.517477+0000","last_change":"2024-04-26T18:33:06.553698+0000","last_active":"2024-04-26T18:34:50.517477+0000","last_peered":"2024-04-26T18:34:50.517477+0000","last_clean":"2024-04-26T18:34:50.517477+0000","last_became_active":"2024-04-26T18:33:06.552995+0000","last_became_peered":"2024-04-26T18:33:06.552995+0000","last_unstale":"2024-04-26T18:34:50.517477+0000","last_undegraded":"2024-04-26T18:34:50.517477+0000","last_fullsized":"2024-04-26T18:34:50.517477+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:27.135435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.657038+0000","last_change":"2024-04-26T18:33:51.656557+0000","last_active":"2024-04-26T18:33:51.657038+0000","last_peered":"2024-04-26T18:33:51.657038+0000","last_clean":"2024-04-26T18:33:51.657038+0000","last_became_active":"2024-04-26T18:33:51.652009+0000","last_became_peered":"2024-04-26T18:33:51.652009+0000","last_unstale":"2024-04-26T18:33:51.657038+0000","last_undegraded":"2024-04-26T18:33:51.657038+0000","last_fullsized":"2024-04-26T18:33:51.657038+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:05.047482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.530039+0000","last_change":"2024-04-26T18:33:06.553596+0000","last_active":"2024-04-26T18:34:50.530039+0000","last_peered":"2024-04-26T18:34:50.530039+0000","last_clean":"2024-04-26T18:34:50.530039+0000","last_became_active":"2024-04-26T18:33:06.553284+0000","last_became_peered":"2024-04-26T18:33:06.553284+0000","last_unstale":"2024-04-26T18:34:50.530039+0000","last_undegraded":"2024-04-26T18:34:50.530039+0000","last_fullsized":"2024-04-26T18:34:50.530039+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.245437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.865849+0000","last_change":"2024-04-26T18:33:51.865849+0000","last_active":"2024-04-26T18:33:51.865849+0000","last_peered":"2024-04-26T18:33:51.865849+0000","last_clean":"2024-04-26T18:33:51.865849+0000","last_became_active":"2024-04-26T18:33:51.861408+0000","last_became_peered":"2024-04-26T18:33:51.861408+0000","last_unstale":"2024-04-26T18:33:51.865849+0000","last_undegraded":"2024-04-26T18:33:51.865849+0000","last_fullsized":"2024-04-26T18:33:51.865849+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:12.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.531045+0000","last_change":"2024-04-26T18:33:06.566899+0000","last_active":"2024-04-26T18:34:50.531045+0000","last_peered":"2024-04-26T18:34:50.531045+0000","last_clean":"2024-04-26T18:34:50.531045+0000","last_became_active":"2024-04-26T18:33:06.566548+0000","last_became_peered":"2024-04-26T18:33:06.566548+0000","last_unstale":"2024-04-26T18:34:50.531045+0000","last_undegraded":"2024-04-26T18:34:50.531045+0000","last_fullsized":"2024-04-26T18:34:50.531045+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:07.751063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'5","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:57.051922+0000","last_change":"2024-04-26T18:33:03.876589+0000","last_active":"2024-04-26T18:34:57.051922+0000","last_peered":"2024-04-26T18:34:57.051922+0000","last_clean":"2024-04-26T18:34:57.051922+0000","last_became_active":"2024-04-26T18:33:03.876262+0000","last_became_peered":"2024-04-26T18:33:03.876262+0000","last_unstale":"2024-04-26T18:34:57.051922+0000","last_undegraded":"2024-04-26T18:34:57.051922+0000","last_fullsized":"2024-04-26T18:34:57.051922+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:04.959745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":97,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.531154+0000","last_change":"2024-04-26T18:33:06.561848+0000","last_active":"2024-04-26T18:34:50.531154+0000","last_peered":"2024-04-26T18:34:50.531154+0000","last_clean":"2024-04-26T18:34:50.531154+0000","last_became_active":"2024-04-26T18:33:06.561514+0000","last_became_peered":"2024-04-26T18:33:06.561514+0000","last_unstale":"2024-04-26T18:34:50.531154+0000","last_undegraded":"2024-04-26T18:34:50.531154+0000","last_fullsized":"2024-04-26T18:34:50.531154+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:46.326261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.652880+0000","last_change":"2024-04-26T18:33:03.527237+0000","last_active":"2024-04-26T18:33:51.652880+0000","last_peered":"2024-04-26T18:33:51.652880+0000","last_clean":"2024-04-26T18:33:51.652880+0000","last_became_active":"2024-04-26T18:33:03.526618+0000","last_became_peered":"2024-04-26T18:33:03.526618+0000","last_unstale":"2024-04-26T18:33:51.652880+0000","last_undegraded":"2024-04-26T18:33:51.652880+0000","last_fullsized":"2024-04-26T18:33:51.652880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:28.232597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.518175+0000","last_change":"2024-04-26T18:33:06.555276+0000","last_active":"2024-04-26T18:34:50.518175+0000","last_peered":"2024-04-26T18:34:50.518175+0000","last_clean":"2024-04-26T18:34:50.518175+0000","last_became_active":"2024-04-26T18:33:06.554889+0000","last_became_peered":"2024-04-26T18:33:06.554889+0000","last_unstale":"2024-04-26T18:34:50.518175+0000","last_undegraded":"2024-04-26T18:34:50.518175+0000","last_fullsized":"2024-04-26T18:34:50.518175+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:33:13.614662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.950766+0000","last_change":"2024-04-26T18:33:03.527108+0000","last_active":"2024-04-26T18:33:51.950766+0000","last_peered":"2024-04-26T18:33:51.950766+0000","last_clean":"2024-04-26T18:33:51.950766+0000","last_became_active":"2024-04-26T18:33:03.526648+0000","last_became_peered":"2024-04-26T18:33:03.526648+0000","last_unstale":"2024-04-26T18:33:51.950766+0000","last_undegraded":"2024-04-26T18:33:51.950766+0000","last_fullsized":"2024-04-26T18:33:51.950766+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:40.915022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.521045+0000","last_change":"2024-04-26T18:33:06.551605+0000","last_active":"2024-04-26T18:34:50.521045+0000","last_peered":"2024-04-26T18:34:50.521045+0000","last_clean":"2024-04-26T18:34:50.521045+0000","last_became_active":"2024-04-26T18:33:06.550772+0000","last_became_peered":"2024-04-26T18:33:06.550772+0000","last_unstale":"2024-04-26T18:34:50.521045+0000","last_undegraded":"2024-04-26T18:34:50.521045+0000","last_fullsized":"2024-04-26T18:34:50.521045+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:33.124989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.522652+0000","last_change":"2024-04-26T18:33:06.558971+0000","last_active":"2024-04-26T18:34:50.522652+0000","last_peered":"2024-04-26T18:34:50.522652+0000","last_clean":"2024-04-26T18:34:50.522652+0000","last_became_active":"2024-04-26T18:33:06.558594+0000","last_became_peered":"2024-04-26T18:33:06.558594+0000","last_unstale":"2024-04-26T18:34:50.522652+0000","last_undegraded":"2024-04-26T18:34:50.522652+0000","last_fullsized":"2024-04-26T18:34:50.522652+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:12.974472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.521051+0000","last_change":"2024-04-26T18:33:06.558928+0000","last_active":"2024-04-26T18:34:50.521051+0000","last_peered":"2024-04-26T18:34:50.521051+0000","last_clean":"2024-04-26T18:34:50.521051+0000","last_became_active":"2024-04-26T18:33:06.558348+0000","last_became_peered":"2024-04-26T18:33:06.558348+0000","last_unstale":"2024-04-26T18:34:50.521051+0000","last_undegraded":"2024-04-26T18:34:50.521051+0000","last_fullsized":"2024-04-26T18:34:50.521051+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:04.266404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.530053+0000","last_change":"2024-04-26T18:33:06.555182+0000","last_active":"2024-04-26T18:34:50.530053+0000","last_peered":"2024-04-26T18:34:50.530053+0000","last_clean":"2024-04-26T18:34:50.530053+0000","last_became_active":"2024-04-26T18:33:06.554830+0000","last_became_peered":"2024-04-26T18:33:06.554830+0000","last_unstale":"2024-04-26T18:34:50.530053+0000","last_undegraded":"2024-04-26T18:34:50.530053+0000","last_fullsized":"2024-04-26T18:34:50.530053+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:48.841634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.515959+0000","last_change":"2024-04-26T18:33:06.558962+0000","last_active":"2024-04-26T18:34:50.515959+0000","last_peered":"2024-04-26T18:34:50.515959+0000","last_clean":"2024-04-26T18:34:50.515959+0000","last_became_active":"2024-04-26T18:33:06.557995+0000","last_became_peered":"2024-04-26T18:33:06.557995+0000","last_unstale":"2024-04-26T18:34:50.515959+0000","last_undegraded":"2024-04-26T18:34:50.515959+0000","last_fullsized":"2024-04-26T18:34:50.515959+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:54.207205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.521772+0000","last_change":"2024-04-26T18:33:06.558055+0000","last_active":"2024-04-26T18:34:50.521772+0000","last_peered":"2024-04-26T18:34:50.521772+0000","last_clean":"2024-04-26T18:34:50.521772+0000","last_became_active":"2024-04-26T18:33:06.557299+0000","last_became_peered":"2024-04-26T18:33:06.557299+0000","last_unstale":"2024-04-26T18:34:50.521772+0000","last_undegraded":"2024-04-26T18:34:50.521772+0000","last_fullsized":"2024-04-26T18:34:50.521772+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:21.143017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.519110+0000","last_change":"2024-04-26T18:33:06.558680+0000","last_active":"2024-04-26T18:34:50.519110+0000","last_peered":"2024-04-26T18:34:50.519110+0000","last_clean":"2024-04-26T18:34:50.519110+0000","last_became_active":"2024-04-26T18:33:06.558139+0000","last_became_peered":"2024-04-26T18:33:06.558139+0000","last_unstale":"2024-04-26T18:34:50.519110+0000","last_undegraded":"2024-04-26T18:34:50.519110+0000","last_fullsized":"2024-04-26T18:34:50.519110+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:31.511770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.522619+0000","last_change":"2024-04-26T18:33:06.563832+0000","last_active":"2024-04-26T18:34:50.522619+0000","last_peered":"2024-04-26T18:34:50.522619+0000","last_clean":"2024-04-26T18:34:50.522619+0000","last_became_active":"2024-04-26T18:33:06.562193+0000","last_became_peered":"2024-04-26T18:33:06.562193+0000","last_unstale":"2024-04-26T18:34:50.522619+0000","last_undegraded":"2024-04-26T18:34:50.522619+0000","last_fullsized":"2024-04-26T18:34:50.522619+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:35.384552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.530536+0000","last_change":"2024-04-26T18:33:06.562368+0000","last_active":"2024-04-26T18:34:50.530536+0000","last_peered":"2024-04-26T18:34:50.530536+0000","last_clean":"2024-04-26T18:34:50.530536+0000","last_became_active":"2024-04-26T18:33:06.562024+0000","last_became_peered":"2024-04-26T18:33:06.562024+0000","last_unstale":"2024-04-26T18:34:50.530536+0000","last_undegraded":"2024-04-26T18:34:50.530536+0000","last_fullsized":"2024-04-26T18:34:50.530536+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:01.562885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.530181+0000","last_change":"2024-04-26T18:33:06.560953+0000","last_active":"2024-04-26T18:34:50.530181+0000","last_peered":"2024-04-26T18:34:50.530181+0000","last_clean":"2024-04-26T18:34:50.530181+0000","last_became_active":"2024-04-26T18:33:06.560593+0000","last_became_peered":"2024-04-26T18:33:06.560593+0000","last_unstale":"2024-04-26T18:34:50.530181+0000","last_undegraded":"2024-04-26T18:34:50.530181+0000","last_fullsized":"2024-04-26T18:34:50.530181+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:18.168564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.530908+0000","last_change":"2024-04-26T18:33:06.555389+0000","last_active":"2024-04-26T18:34:50.530908+0000","last_peered":"2024-04-26T18:34:50.530908+0000","last_clean":"2024-04-26T18:34:50.530908+0000","last_became_active":"2024-04-26T18:33:06.555055+0000","last_became_peered":"2024-04-26T18:33:06.555055+0000","last_unstale":"2024-04-26T18:34:50.530908+0000","last_undegraded":"2024-04-26T18:34:50.530908+0000","last_fullsized":"2024-04-26T18:34:50.530908+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:32.802687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.532655+0000","last_change":"2024-04-26T18:33:06.563791+0000","last_active":"2024-04-26T18:34:50.532655+0000","last_peered":"2024-04-26T18:34:50.532655+0000","last_clean":"2024-04-26T18:34:50.532655+0000","last_became_active":"2024-04-26T18:33:06.561959+0000","last_became_peered":"2024-04-26T18:33:06.561959+0000","last_unstale":"2024-04-26T18:34:50.532655+0000","last_undegraded":"2024-04-26T18:34:50.532655+0000","last_fullsized":"2024-04-26T18:34:50.532655+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:35.280202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.524469+0000","last_change":"2024-04-26T18:33:06.554270+0000","last_active":"2024-04-26T18:34:50.524469+0000","last_peered":"2024-04-26T18:34:50.524469+0000","last_clean":"2024-04-26T18:34:50.524469+0000","last_became_active":"2024-04-26T18:33:06.553931+0000","last_became_peered":"2024-04-26T18:33:06.553931+0000","last_unstale":"2024-04-26T18:34:50.524469+0000","last_undegraded":"2024-04-26T18:34:50.524469+0000","last_fullsized":"2024-04-26T18:34:50.524469+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:40.587824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.515024+0000","last_change":"2024-04-26T18:33:06.556766+0000","last_active":"2024-04-26T18:34:50.515024+0000","last_peered":"2024-04-26T18:34:50.515024+0000","last_clean":"2024-04-26T18:34:50.515024+0000","last_became_active":"2024-04-26T18:33:06.556361+0000","last_became_peered":"2024-04-26T18:33:06.556361+0000","last_unstale":"2024-04-26T18:34:50.515024+0000","last_undegraded":"2024-04-26T18:34:50.515024+0000","last_fullsized":"2024-04-26T18:34:50.515024+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:10.101747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":245619,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69029,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1000,"num_read_kb":573,"num_write":252,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":207087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351015,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":483469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612653,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32300,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712852,"statfs":{"total":95995035648,"available":95961960448,"internally_reserved":0,"allocated":1150976,"data_stored":1136551,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776178,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1019904,"data_stored":483377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037814,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":483061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1069056,"data_stored":1076414,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462977,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":1003520,"data_stored":483094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1064960,"data_stored":546082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1024000,"data_stored":484433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1085440,"data_stored":546834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149776,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1019904,"data_stored":482919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888140,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":483627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724613,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1081344,"data_stored":1076092,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33912,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33912,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T18:35:04.891 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T18:35:05.128 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:35:05.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:05 smithi192 ceph-mon[32842]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T18:35:05.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:05 smithi192 ceph-mon[32842]: pgmap v358: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-26T18:35:05.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:05 smithi082 ceph-mon[32808]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T18:35:05.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:05 smithi082 ceph-mon[32808]: pgmap v358: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-26T18:35:05.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:05 smithi080 ceph-mon[29135]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T18:35:05.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:05 smithi080 ceph-mon[29135]: pgmap v358: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-26T18:35:06.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:06 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:35:06.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:06 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:35:06.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.892+0000 7f90eda35700 1 -- 172.21.15.80:0/1336052641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90e81094a0 msgr2=0x7f90e8109880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:06.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.892+0000 7f90eda35700 1 --2- 172.21.15.80:0/1336052641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90e81094a0 0x7f90e8109880 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009990 tx=0x7f90d8009ca0 comp rx=0 tx=0).stop 2024-04-26T18:35:06.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.892+0000 7f90eda35700 1 -- 172.21.15.80:0/1336052641 shutdown_connections 2024-04-26T18:35:06.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.892+0000 7f90eda35700 1 --2- 172.21.15.80:0/1336052641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90e806c580 0x7f90e81102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:06.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.892+0000 7f90eda35700 1 --2- 172.21.15.80:0/1336052641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90e81094a0 0x7f90e8109880 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:06.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.892+0000 7f90eda35700 1 --2- 172.21.15.80:0/1336052641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90e806bbe0 0x7f90e806c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:06.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.892+0000 7f90eda35700 1 -- 172.21.15.80:0/1336052641 >> 172.21.15.80:0/1336052641 conn(0x7f90e80792d0 msgr2=0x7f90e80796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:06.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.892+0000 7f90eda35700 1 -- 172.21.15.80:0/1336052641 shutdown_connections 2024-04-26T18:35:06.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.892+0000 7f90eda35700 1 -- 172.21.15.80:0/1336052641 wait complete. 2024-04-26T18:35:06.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.893+0000 7f90eda35700 1 Processor -- start 2024-04-26T18:35:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.893+0000 7f90eda35700 1 -- start start 2024-04-26T18:35:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.893+0000 7f90eda35700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90e806bbe0 0x7f90e819f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.893+0000 7f90eda35700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90e806c580 0x7f90e819fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.893+0000 7f90eda35700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90e81094a0 0x7f90e8199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.893+0000 7f90eda35700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f90e81136e0 con 0x7f90e806bbe0 2024-04-26T18:35:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.893+0000 7f90eda35700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f90e8113560 con 0x7f90e806c580 2024-04-26T18:35:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.893+0000 7f90eda35700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f90e8113860 con 0x7f90e81094a0 2024-04-26T18:35:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.894+0000 7f90e6ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90e806bbe0 0x7f90e819f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.894+0000 7f90e6ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90e806bbe0 0x7f90e819f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40010/0 (socket says 172.21.15.80:40010) 2024-04-26T18:35:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.894+0000 7f90e6ffd700 1 -- 172.21.15.80:0/4210510030 learned_addr learned my addr 172.21.15.80:0/4210510030 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.894+0000 7f90e67fc700 1 --2- 172.21.15.80:0/4210510030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90e806c580 0x7f90e819fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:06.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.894+0000 7f90e77fe700 1 --2- 172.21.15.80:0/4210510030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90e81094a0 0x7f90e8199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:06.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.894+0000 7f90e6ffd700 1 -- 172.21.15.80:0/4210510030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90e81094a0 msgr2=0x7f90e8199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:06.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.894+0000 7f90e6ffd700 1 --2- 172.21.15.80:0/4210510030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90e81094a0 0x7f90e8199aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:06.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.894+0000 7f90e6ffd700 1 -- 172.21.15.80:0/4210510030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90e806c580 msgr2=0x7f90e819fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:06.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.894+0000 7f90e6ffd700 1 --2- 172.21.15.80:0/4210510030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90e806c580 0x7f90e819fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:06.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.894+0000 7f90e6ffd700 1 -- 172.21.15.80:0/4210510030 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e819a200 con 0x7f90e806bbe0 2024-04-26T18:35:06.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.894+0000 7f90e6ffd700 1 --2- 172.21.15.80:0/4210510030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90e806bbe0 0x7f90e819f8e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f90d8000c00 tx=0x7f90d80057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:06.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.894+0000 7f90eca33700 1 -- 172.21.15.80:0/4210510030 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d8026070 con 0x7f90e806bbe0 2024-04-26T18:35:06.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.894+0000 7f90eca33700 1 -- 172.21.15.80:0/4210510030 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90d8003f20 con 0x7f90e806bbe0 2024-04-26T18:35:06.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.894+0000 7f90eda35700 1 -- 172.21.15.80:0/4210510030 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e819a490 con 0x7f90e806bbe0 2024-04-26T18:35:06.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.894+0000 7f90eda35700 1 -- 172.21.15.80:0/4210510030 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e81a67b0 con 0x7f90e806bbe0 2024-04-26T18:35:06.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.894+0000 7f90eca33700 1 -- 172.21.15.80:0/4210510030 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d800fce0 con 0x7f90e806bbe0 2024-04-26T18:35:06.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.895+0000 7f90eda35700 1 -- 172.21.15.80:0/4210510030 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90e806a110 con 0x7f90e806bbe0 2024-04-26T18:35:06.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.897+0000 7f90eca33700 1 -- 172.21.15.80:0/4210510030 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f90d8029070 con 0x7f90e806bbe0 2024-04-26T18:35:06.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.897+0000 7f90eca33700 1 --2- 172.21.15.80:0/4210510030 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f90d00a3c40 0x7f90d00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:06.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.897+0000 7f90e67fc700 1 --2- 172.21.15.80:0/4210510030 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f90d00a3c40 0x7f90d00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:06.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.898+0000 7f90eca33700 1 -- 172.21.15.80:0/4210510030 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f90d80d1090 con 0x7f90e806bbe0 2024-04-26T18:35:06.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.898+0000 7f90e67fc700 1 --2- 172.21.15.80:0/4210510030 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f90d00a3c40 0x7f90d00a6100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f90e8079a10 tx=0x7f90dc009190 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:06.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:06.901+0000 7f90eca33700 1 -- 172.21.15.80:0/4210510030 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f90d8030080 con 0x7f90e806bbe0 2024-04-26T18:35:06.925 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:06 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:35:07.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:07.104+0000 7f90eda35700 1 -- 172.21.15.80:0/4210510030 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f90e819afd0 con 0x7f90d00a3c40 2024-04-26T18:35:07.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:07.111+0000 7f90eca33700 1 -- 172.21.15.80:0/4210510030 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259035 (secure 0 0 0) 0x7f90e819afd0 con 0x7f90d00a3c40 2024-04-26T18:35:07.115 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:35:07.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:07.114+0000 7f90eda35700 1 -- 172.21.15.80:0/4210510030 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f90d00a3c40 msgr2=0x7f90d00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:07.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:07.114+0000 7f90eda35700 1 --2- 172.21.15.80:0/4210510030 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f90d00a3c40 0x7f90d00a6100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f90e8079a10 tx=0x7f90dc009190 comp rx=0 tx=0).stop 2024-04-26T18:35:07.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:07.114+0000 7f90eda35700 1 -- 172.21.15.80:0/4210510030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90e806bbe0 msgr2=0x7f90e819f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:07.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:07.114+0000 7f90eda35700 1 --2- 172.21.15.80:0/4210510030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90e806bbe0 0x7f90e819f8e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f90d8000c00 tx=0x7f90d80057c0 comp rx=0 tx=0).stop 2024-04-26T18:35:07.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:07.114+0000 7f90eda35700 1 -- 172.21.15.80:0/4210510030 shutdown_connections 2024-04-26T18:35:07.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:07.114+0000 7f90eda35700 1 --2- 172.21.15.80:0/4210510030 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f90d00a3c40 0x7f90d00a6100 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:07.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:07.114+0000 7f90eda35700 1 --2- 172.21.15.80:0/4210510030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90e81094a0 0x7f90e8199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:07.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:07.114+0000 7f90eda35700 1 --2- 172.21.15.80:0/4210510030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90e806bbe0 0x7f90e819f8e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:07.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:07.114+0000 7f90eda35700 1 --2- 172.21.15.80:0/4210510030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90e806c580 0x7f90e819fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:07.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:07.114+0000 7f90eda35700 1 -- 172.21.15.80:0/4210510030 >> 172.21.15.80:0/4210510030 conn(0x7f90e80792d0 msgr2=0x7f90e81004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:07.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:07.114+0000 7f90eda35700 1 -- 172.21.15.80:0/4210510030 shutdown_connections 2024-04-26T18:35:07.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:07.114+0000 7f90eda35700 1 -- 172.21.15.80:0/4210510030 wait complete. 2024-04-26T18:35:07.118 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-26T18:35:07.831 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":359,"stamp":"2024-04-26T18:35:06.525225+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659631,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1181,"num_read_kb":717,"num_write":435,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1181430,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":855,"ondisk_log_size":855,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365552,"kb_used_data":12240,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576272,"statfs":{"total":1151940427776,"available":1151566102528,"internally_reserved":0,"allocated":12533760,"data_stored":7765953,"data_compressed":106677,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":71,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003032"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.517610+0000","last_change":"2024-04-26T18:33:06.565673+0000","last_active":"2024-04-26T18:34:50.517610+0000","last_peered":"2024-04-26T18:34:50.517610+0000","last_clean":"2024-04-26T18:34:50.517610+0000","last_became_active":"2024-04-26T18:33:06.565065+0000","last_became_peered":"2024-04-26T18:33:06.565065+0000","last_unstale":"2024-04-26T18:34:50.517610+0000","last_undegraded":"2024-04-26T18:34:50.517610+0000","last_fullsized":"2024-04-26T18:34:50.517610+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:54:10.833343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.511721+0000","last_change":"2024-04-26T18:33:06.552350+0000","last_active":"2024-04-26T18:34:50.511721+0000","last_peered":"2024-04-26T18:34:50.511721+0000","last_clean":"2024-04-26T18:34:50.511721+0000","last_became_active":"2024-04-26T18:33:06.551941+0000","last_became_peered":"2024-04-26T18:33:06.551941+0000","last_unstale":"2024-04-26T18:34:50.511721+0000","last_undegraded":"2024-04-26T18:34:50.511721+0000","last_fullsized":"2024-04-26T18:34:50.511721+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:40.702995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.532724+0000","last_change":"2024-04-26T18:33:06.561456+0000","last_active":"2024-04-26T18:34:50.532724+0000","last_peered":"2024-04-26T18:34:50.532724+0000","last_clean":"2024-04-26T18:34:50.532724+0000","last_became_active":"2024-04-26T18:33:06.561032+0000","last_became_peered":"2024-04-26T18:33:06.561032+0000","last_unstale":"2024-04-26T18:34:50.532724+0000","last_undegraded":"2024-04-26T18:34:50.532724+0000","last_fullsized":"2024-04-26T18:34:50.532724+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:56:56.228873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.505062+0000","last_change":"2024-04-26T18:33:06.556597+0000","last_active":"2024-04-26T18:34:50.505062+0000","last_peered":"2024-04-26T18:34:50.505062+0000","last_clean":"2024-04-26T18:34:50.505062+0000","last_became_active":"2024-04-26T18:33:06.555356+0000","last_became_peered":"2024-04-26T18:33:06.555356+0000","last_unstale":"2024-04-26T18:34:50.505062+0000","last_undegraded":"2024-04-26T18:34:50.505062+0000","last_fullsized":"2024-04-26T18:34:50.505062+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:55.860495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.505161+0000","last_change":"2024-04-26T18:33:06.549480+0000","last_active":"2024-04-26T18:34:50.505161+0000","last_peered":"2024-04-26T18:34:50.505161+0000","last_clean":"2024-04-26T18:34:50.505161+0000","last_became_active":"2024-04-26T18:33:06.549086+0000","last_became_peered":"2024-04-26T18:33:06.549086+0000","last_unstale":"2024-04-26T18:34:50.505161+0000","last_undegraded":"2024-04-26T18:34:50.505161+0000","last_fullsized":"2024-04-26T18:34:50.505161+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:13.012745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.525776+0000","last_change":"2024-04-26T18:33:06.558539+0000","last_active":"2024-04-26T18:34:50.525776+0000","last_peered":"2024-04-26T18:34:50.525776+0000","last_clean":"2024-04-26T18:34:50.525776+0000","last_became_active":"2024-04-26T18:33:06.558185+0000","last_became_peered":"2024-04-26T18:33:06.558185+0000","last_unstale":"2024-04-26T18:34:50.525776+0000","last_undegraded":"2024-04-26T18:34:50.525776+0000","last_fullsized":"2024-04-26T18:34:50.525776+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:59:31.299478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.511734+0000","last_change":"2024-04-26T18:33:06.557336+0000","last_active":"2024-04-26T18:34:50.511734+0000","last_peered":"2024-04-26T18:34:50.511734+0000","last_clean":"2024-04-26T18:34:50.511734+0000","last_became_active":"2024-04-26T18:33:06.556988+0000","last_became_peered":"2024-04-26T18:33:06.556988+0000","last_unstale":"2024-04-26T18:34:50.511734+0000","last_undegraded":"2024-04-26T18:34:50.511734+0000","last_fullsized":"2024-04-26T18:34:50.511734+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:48.814042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.528890+0000","last_change":"2024-04-26T18:33:06.556355+0000","last_active":"2024-04-26T18:34:50.528890+0000","last_peered":"2024-04-26T18:34:50.528890+0000","last_clean":"2024-04-26T18:34:50.528890+0000","last_became_active":"2024-04-26T18:33:06.555947+0000","last_became_peered":"2024-04-26T18:33:06.555947+0000","last_unstale":"2024-04-26T18:34:50.528890+0000","last_undegraded":"2024-04-26T18:34:50.528890+0000","last_fullsized":"2024-04-26T18:34:50.528890+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:36.607305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.522408+0000","last_change":"2024-04-26T18:33:06.569673+0000","last_active":"2024-04-26T18:34:50.522408+0000","last_peered":"2024-04-26T18:34:50.522408+0000","last_clean":"2024-04-26T18:34:50.522408+0000","last_became_active":"2024-04-26T18:33:06.568453+0000","last_became_peered":"2024-04-26T18:33:06.568453+0000","last_unstale":"2024-04-26T18:34:50.522408+0000","last_undegraded":"2024-04-26T18:34:50.522408+0000","last_fullsized":"2024-04-26T18:34:50.522408+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:38.428723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.515334+0000","last_change":"2024-04-26T18:33:06.564286+0000","last_active":"2024-04-26T18:34:50.515334+0000","last_peered":"2024-04-26T18:34:50.515334+0000","last_clean":"2024-04-26T18:34:50.515334+0000","last_became_active":"2024-04-26T18:33:06.563830+0000","last_became_peered":"2024-04-26T18:33:06.563830+0000","last_unstale":"2024-04-26T18:34:50.515334+0000","last_undegraded":"2024-04-26T18:34:50.515334+0000","last_fullsized":"2024-04-26T18:34:50.515334+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:36.518838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.525362+0000","last_change":"2024-04-26T18:33:06.560724+0000","last_active":"2024-04-26T18:34:50.525362+0000","last_peered":"2024-04-26T18:34:50.525362+0000","last_clean":"2024-04-26T18:34:50.525362+0000","last_became_active":"2024-04-26T18:33:06.560393+0000","last_became_peered":"2024-04-26T18:33:06.560393+0000","last_unstale":"2024-04-26T18:34:50.525362+0000","last_undegraded":"2024-04-26T18:34:50.525362+0000","last_fullsized":"2024-04-26T18:34:50.525362+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:41.286466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.527263+0000","last_change":"2024-04-26T18:33:51.859986+0000","last_active":"2024-04-26T18:34:50.527263+0000","last_peered":"2024-04-26T18:34:50.527263+0000","last_clean":"2024-04-26T18:34:50.527263+0000","last_became_active":"2024-04-26T18:33:51.859656+0000","last_became_peered":"2024-04-26T18:33:51.859656+0000","last_unstale":"2024-04-26T18:34:50.527263+0000","last_undegraded":"2024-04-26T18:34:50.527263+0000","last_fullsized":"2024-04-26T18:34:50.527263+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:09:48.471097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.529194+0000","last_change":"2024-04-26T18:33:06.555813+0000","last_active":"2024-04-26T18:34:50.529194+0000","last_peered":"2024-04-26T18:34:50.529194+0000","last_clean":"2024-04-26T18:34:50.529194+0000","last_became_active":"2024-04-26T18:33:06.555498+0000","last_became_peered":"2024-04-26T18:33:06.555498+0000","last_unstale":"2024-04-26T18:34:50.529194+0000","last_undegraded":"2024-04-26T18:34:50.529194+0000","last_fullsized":"2024-04-26T18:34:50.529194+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:21.531142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.521138+0000","last_change":"2024-04-26T18:33:06.551833+0000","last_active":"2024-04-26T18:34:50.521138+0000","last_peered":"2024-04-26T18:34:50.521138+0000","last_clean":"2024-04-26T18:34:50.521138+0000","last_became_active":"2024-04-26T18:33:06.551503+0000","last_became_peered":"2024-04-26T18:33:06.551503+0000","last_unstale":"2024-04-26T18:34:50.521138+0000","last_undegraded":"2024-04-26T18:34:50.521138+0000","last_fullsized":"2024-04-26T18:34:50.521138+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:20.560656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.515548+0000","last_change":"2024-04-26T18:33:06.555971+0000","last_active":"2024-04-26T18:34:50.515548+0000","last_peered":"2024-04-26T18:34:50.515548+0000","last_clean":"2024-04-26T18:34:50.515548+0000","last_became_active":"2024-04-26T18:33:06.555312+0000","last_became_peered":"2024-04-26T18:33:06.555312+0000","last_unstale":"2024-04-26T18:34:50.515548+0000","last_undegraded":"2024-04-26T18:34:50.515548+0000","last_fullsized":"2024-04-26T18:34:50.515548+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:05.066403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.532536+0000","last_change":"2024-04-26T18:33:06.567762+0000","last_active":"2024-04-26T18:34:50.532536+0000","last_peered":"2024-04-26T18:34:50.532536+0000","last_clean":"2024-04-26T18:34:50.532536+0000","last_became_active":"2024-04-26T18:33:06.567368+0000","last_became_peered":"2024-04-26T18:33:06.567368+0000","last_unstale":"2024-04-26T18:34:50.532536+0000","last_undegraded":"2024-04-26T18:34:50.532536+0000","last_fullsized":"2024-04-26T18:34:50.532536+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:27.428529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.517974+0000","last_change":"2024-04-26T18:33:06.565334+0000","last_active":"2024-04-26T18:34:50.517974+0000","last_peered":"2024-04-26T18:34:50.517974+0000","last_clean":"2024-04-26T18:34:50.517974+0000","last_became_active":"2024-04-26T18:33:06.564997+0000","last_became_peered":"2024-04-26T18:33:06.564997+0000","last_unstale":"2024-04-26T18:34:50.517974+0000","last_undegraded":"2024-04-26T18:34:50.517974+0000","last_fullsized":"2024-04-26T18:34:50.517974+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:57.892318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.531950+0000","last_change":"2024-04-26T18:33:06.562242+0000","last_active":"2024-04-26T18:34:50.531950+0000","last_peered":"2024-04-26T18:34:50.531950+0000","last_clean":"2024-04-26T18:34:50.531950+0000","last_became_active":"2024-04-26T18:33:06.561863+0000","last_became_peered":"2024-04-26T18:33:06.561863+0000","last_unstale":"2024-04-26T18:34:50.531950+0000","last_undegraded":"2024-04-26T18:34:50.531950+0000","last_fullsized":"2024-04-26T18:34:50.531950+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:22.745294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.530333+0000","last_change":"2024-04-26T18:33:06.555511+0000","last_active":"2024-04-26T18:34:50.530333+0000","last_peered":"2024-04-26T18:34:50.530333+0000","last_clean":"2024-04-26T18:34:50.530333+0000","last_became_active":"2024-04-26T18:33:06.555201+0000","last_became_peered":"2024-04-26T18:33:06.555201+0000","last_unstale":"2024-04-26T18:34:50.530333+0000","last_undegraded":"2024-04-26T18:34:50.530333+0000","last_fullsized":"2024-04-26T18:34:50.530333+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:09.644167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:35:03.761526+0000","last_change":"2024-04-26T18:33:51.664154+0000","last_active":"2024-04-26T18:35:03.761526+0000","last_peered":"2024-04-26T18:35:03.761526+0000","last_clean":"2024-04-26T18:35:03.761526+0000","last_became_active":"2024-04-26T18:33:51.653330+0000","last_became_peered":"2024-04-26T18:33:51.653330+0000","last_unstale":"2024-04-26T18:35:03.761526+0000","last_undegraded":"2024-04-26T18:35:03.761526+0000","last_fullsized":"2024-04-26T18:35:03.761526+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:55:49.100993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.530675+0000","last_change":"2024-04-26T18:33:06.560652+0000","last_active":"2024-04-26T18:34:50.530675+0000","last_peered":"2024-04-26T18:34:50.530675+0000","last_clean":"2024-04-26T18:34:50.530675+0000","last_became_active":"2024-04-26T18:33:06.560311+0000","last_became_peered":"2024-04-26T18:33:06.560311+0000","last_unstale":"2024-04-26T18:34:50.530675+0000","last_undegraded":"2024-04-26T18:34:50.530675+0000","last_fullsized":"2024-04-26T18:34:50.530675+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:22.653995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.651326+0000","last_change":"2024-04-26T18:33:03.860585+0000","last_active":"2024-04-26T18:33:51.651326+0000","last_peered":"2024-04-26T18:33:51.651326+0000","last_clean":"2024-04-26T18:33:51.651326+0000","last_became_active":"2024-04-26T18:33:03.860232+0000","last_became_peered":"2024-04-26T18:33:03.860232+0000","last_unstale":"2024-04-26T18:33:51.651326+0000","last_undegraded":"2024-04-26T18:33:51.651326+0000","last_fullsized":"2024-04-26T18:33:51.651326+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:04.685495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.532712+0000","last_change":"2024-04-26T18:33:06.563764+0000","last_active":"2024-04-26T18:34:50.532712+0000","last_peered":"2024-04-26T18:34:50.532712+0000","last_clean":"2024-04-26T18:34:50.532712+0000","last_became_active":"2024-04-26T18:33:06.563322+0000","last_became_peered":"2024-04-26T18:33:06.563322+0000","last_unstale":"2024-04-26T18:34:50.532712+0000","last_undegraded":"2024-04-26T18:34:50.532712+0000","last_fullsized":"2024-04-26T18:34:50.532712+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:17:53.144144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.648913+0000","last_change":"2024-04-26T18:33:03.533057+0000","last_active":"2024-04-26T18:33:51.648913+0000","last_peered":"2024-04-26T18:33:51.648913+0000","last_clean":"2024-04-26T18:33:51.648913+0000","last_became_active":"2024-04-26T18:33:03.532665+0000","last_became_peered":"2024-04-26T18:33:03.532665+0000","last_unstale":"2024-04-26T18:33:51.648913+0000","last_undegraded":"2024-04-26T18:33:51.648913+0000","last_fullsized":"2024-04-26T18:33:51.648913+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:29.125064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.527073+0000","last_change":"2024-04-26T18:33:06.567612+0000","last_active":"2024-04-26T18:34:50.527073+0000","last_peered":"2024-04-26T18:34:50.527073+0000","last_clean":"2024-04-26T18:34:50.527073+0000","last_became_active":"2024-04-26T18:33:06.565883+0000","last_became_peered":"2024-04-26T18:33:06.565883+0000","last_unstale":"2024-04-26T18:34:50.527073+0000","last_undegraded":"2024-04-26T18:34:50.527073+0000","last_fullsized":"2024-04-26T18:34:50.527073+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:59.721305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.649230+0000","last_change":"2024-04-26T18:33:03.532075+0000","last_active":"2024-04-26T18:33:51.649230+0000","last_peered":"2024-04-26T18:33:51.649230+0000","last_clean":"2024-04-26T18:33:51.649230+0000","last_became_active":"2024-04-26T18:33:03.531729+0000","last_became_peered":"2024-04-26T18:33:03.531729+0000","last_unstale":"2024-04-26T18:33:51.649230+0000","last_undegraded":"2024-04-26T18:33:51.649230+0000","last_fullsized":"2024-04-26T18:33:51.649230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:23.748292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.523709+0000","last_change":"2024-04-26T18:33:06.569377+0000","last_active":"2024-04-26T18:34:50.523709+0000","last_peered":"2024-04-26T18:34:50.523709+0000","last_clean":"2024-04-26T18:34:50.523709+0000","last_became_active":"2024-04-26T18:33:06.569057+0000","last_became_peered":"2024-04-26T18:33:06.569057+0000","last_unstale":"2024-04-26T18:34:50.523709+0000","last_undegraded":"2024-04-26T18:34:50.523709+0000","last_fullsized":"2024-04-26T18:34:50.523709+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:10.968017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"91'7","reported_seq":138,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:35:04.057923+0000","last_change":"2024-04-26T18:33:03.525186+0000","last_active":"2024-04-26T18:35:04.057923+0000","last_peered":"2024-04-26T18:35:04.057923+0000","last_clean":"2024-04-26T18:35:04.057923+0000","last_became_active":"2024-04-26T18:33:03.524880+0000","last_became_peered":"2024-04-26T18:33:03.524880+0000","last_unstale":"2024-04-26T18:35:04.057923+0000","last_undegraded":"2024-04-26T18:35:04.057923+0000","last_fullsized":"2024-04-26T18:35:04.057923+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:51:30.130244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.518638+0000","last_change":"2024-04-26T18:33:06.558034+0000","last_active":"2024-04-26T18:34:50.518638+0000","last_peered":"2024-04-26T18:34:50.518638+0000","last_clean":"2024-04-26T18:34:50.518638+0000","last_became_active":"2024-04-26T18:33:06.557694+0000","last_became_peered":"2024-04-26T18:33:06.557694+0000","last_unstale":"2024-04-26T18:34:50.518638+0000","last_undegraded":"2024-04-26T18:34:50.518638+0000","last_fullsized":"2024-04-26T18:34:50.518638+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:02.497601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.857346+0000","last_change":"2024-04-26T18:33:03.528750+0000","last_active":"2024-04-26T18:33:51.857346+0000","last_peered":"2024-04-26T18:33:51.857346+0000","last_clean":"2024-04-26T18:33:51.857346+0000","last_became_active":"2024-04-26T18:33:03.528442+0000","last_became_peered":"2024-04-26T18:33:03.528442+0000","last_unstale":"2024-04-26T18:33:51.857346+0000","last_undegraded":"2024-04-26T18:33:51.857346+0000","last_fullsized":"2024-04-26T18:33:51.857346+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:13.931280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.530787+0000","last_change":"2024-04-26T18:33:06.561274+0000","last_active":"2024-04-26T18:34:50.530787+0000","last_peered":"2024-04-26T18:34:50.530787+0000","last_clean":"2024-04-26T18:34:50.530787+0000","last_became_active":"2024-04-26T18:33:06.560622+0000","last_became_peered":"2024-04-26T18:33:06.560622+0000","last_unstale":"2024-04-26T18:34:50.530787+0000","last_undegraded":"2024-04-26T18:34:50.530787+0000","last_fullsized":"2024-04-26T18:34:50.530787+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:27.875181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.950814+0000","last_change":"2024-04-26T18:33:03.529634+0000","last_active":"2024-04-26T18:33:51.950814+0000","last_peered":"2024-04-26T18:33:51.950814+0000","last_clean":"2024-04-26T18:33:51.950814+0000","last_became_active":"2024-04-26T18:33:03.529303+0000","last_became_peered":"2024-04-26T18:33:03.529303+0000","last_unstale":"2024-04-26T18:33:51.950814+0000","last_undegraded":"2024-04-26T18:33:51.950814+0000","last_fullsized":"2024-04-26T18:33:51.950814+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:37.580542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.530454+0000","last_change":"2024-04-26T18:33:06.550896+0000","last_active":"2024-04-26T18:34:50.530454+0000","last_peered":"2024-04-26T18:34:50.530454+0000","last_clean":"2024-04-26T18:34:50.530454+0000","last_became_active":"2024-04-26T18:33:06.550571+0000","last_became_peered":"2024-04-26T18:33:06.550571+0000","last_unstale":"2024-04-26T18:34:50.530454+0000","last_undegraded":"2024-04-26T18:34:50.530454+0000","last_fullsized":"2024-04-26T18:34:50.530454+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:26.715158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.651588+0000","last_change":"2024-04-26T18:33:03.530875+0000","last_active":"2024-04-26T18:33:51.651588+0000","last_peered":"2024-04-26T18:33:51.651588+0000","last_clean":"2024-04-26T18:33:51.651588+0000","last_became_active":"2024-04-26T18:33:03.530564+0000","last_became_peered":"2024-04-26T18:33:03.530564+0000","last_unstale":"2024-04-26T18:33:51.651588+0000","last_undegraded":"2024-04-26T18:33:51.651588+0000","last_fullsized":"2024-04-26T18:33:51.651588+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:20.320591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.528595+0000","last_change":"2024-04-26T18:33:06.553434+0000","last_active":"2024-04-26T18:34:50.528595+0000","last_peered":"2024-04-26T18:34:50.528595+0000","last_clean":"2024-04-26T18:34:50.528595+0000","last_became_active":"2024-04-26T18:33:06.551897+0000","last_became_peered":"2024-04-26T18:33:06.551897+0000","last_unstale":"2024-04-26T18:34:50.528595+0000","last_undegraded":"2024-04-26T18:34:50.528595+0000","last_fullsized":"2024-04-26T18:34:50.528595+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:56.503266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"91'5","reported_seq":236,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:35:06.059903+0000","last_change":"2024-04-26T18:33:03.524239+0000","last_active":"2024-04-26T18:35:06.059903+0000","last_peered":"2024-04-26T18:35:06.059903+0000","last_clean":"2024-04-26T18:35:06.059903+0000","last_became_active":"2024-04-26T18:33:03.523848+0000","last_became_peered":"2024-04-26T18:33:03.523848+0000","last_unstale":"2024-04-26T18:35:06.059903+0000","last_undegraded":"2024-04-26T18:35:06.059903+0000","last_fullsized":"2024-04-26T18:35:06.059903+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:29.354430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":206,"num_read_kb":206,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.530265+0000","last_change":"2024-04-26T18:33:06.569557+0000","last_active":"2024-04-26T18:34:50.530265+0000","last_peered":"2024-04-26T18:34:50.530265+0000","last_clean":"2024-04-26T18:34:50.530265+0000","last_became_active":"2024-04-26T18:33:06.568414+0000","last_became_peered":"2024-04-26T18:33:06.568414+0000","last_unstale":"2024-04-26T18:34:50.530265+0000","last_undegraded":"2024-04-26T18:34:50.530265+0000","last_fullsized":"2024-04-26T18:34:50.530265+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:30.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.651383+0000","last_change":"2024-04-26T18:33:03.528554+0000","last_active":"2024-04-26T18:33:51.651383+0000","last_peered":"2024-04-26T18:33:51.651383+0000","last_clean":"2024-04-26T18:33:51.651383+0000","last_became_active":"2024-04-26T18:33:03.527611+0000","last_became_peered":"2024-04-26T18:33:03.527611+0000","last_unstale":"2024-04-26T18:33:51.651383+0000","last_undegraded":"2024-04-26T18:33:51.651383+0000","last_fullsized":"2024-04-26T18:33:51.651383+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:28.387779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.519235+0000","last_change":"2024-04-26T18:33:06.561415+0000","last_active":"2024-04-26T18:34:50.519235+0000","last_peered":"2024-04-26T18:34:50.519235+0000","last_clean":"2024-04-26T18:34:50.519235+0000","last_became_active":"2024-04-26T18:33:06.560518+0000","last_became_peered":"2024-04-26T18:33:06.560518+0000","last_unstale":"2024-04-26T18:34:50.519235+0000","last_undegraded":"2024-04-26T18:34:50.519235+0000","last_fullsized":"2024-04-26T18:34:50.519235+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:49.824157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.653029+0000","last_change":"2024-04-26T18:33:03.861087+0000","last_active":"2024-04-26T18:33:51.653029+0000","last_peered":"2024-04-26T18:33:51.653029+0000","last_clean":"2024-04-26T18:33:51.653029+0000","last_became_active":"2024-04-26T18:33:03.860531+0000","last_became_peered":"2024-04-26T18:33:03.860531+0000","last_unstale":"2024-04-26T18:33:51.653029+0000","last_undegraded":"2024-04-26T18:33:51.653029+0000","last_fullsized":"2024-04-26T18:33:51.653029+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:22:07.086887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.532244+0000","last_change":"2024-04-26T18:33:06.565910+0000","last_active":"2024-04-26T18:34:50.532244+0000","last_peered":"2024-04-26T18:34:50.532244+0000","last_clean":"2024-04-26T18:34:50.532244+0000","last_became_active":"2024-04-26T18:33:06.565402+0000","last_became_peered":"2024-04-26T18:33:06.565402+0000","last_unstale":"2024-04-26T18:34:50.532244+0000","last_undegraded":"2024-04-26T18:34:50.532244+0000","last_fullsized":"2024-04-26T18:34:50.532244+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:40.418513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"91'34","reported_seq":275,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:35:06.059534+0000","last_change":"2024-04-26T18:33:03.527871+0000","last_active":"2024-04-26T18:35:06.059534+0000","last_peered":"2024-04-26T18:35:06.059534+0000","last_clean":"2024-04-26T18:35:06.059534+0000","last_became_active":"2024-04-26T18:33:03.527546+0000","last_became_peered":"2024-04-26T18:33:03.527546+0000","last_unstale":"2024-04-26T18:35:06.059534+0000","last_undegraded":"2024-04-26T18:35:06.059534+0000","last_fullsized":"2024-04-26T18:35:06.059534+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:24.749505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62075,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":216,"num_read_kb":168,"num_write":36,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.509760+0000","last_change":"2024-04-26T18:33:06.546735+0000","last_active":"2024-04-26T18:34:50.509760+0000","last_peered":"2024-04-26T18:34:50.509760+0000","last_clean":"2024-04-26T18:34:50.509760+0000","last_became_active":"2024-04-26T18:33:06.546360+0000","last_became_peered":"2024-04-26T18:33:06.546360+0000","last_unstale":"2024-04-26T18:34:50.509760+0000","last_undegraded":"2024-04-26T18:34:50.509760+0000","last_fullsized":"2024-04-26T18:34:50.509760+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:15.736669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.647249+0000","last_change":"2024-04-26T18:33:03.526081+0000","last_active":"2024-04-26T18:33:51.647249+0000","last_peered":"2024-04-26T18:33:51.647249+0000","last_clean":"2024-04-26T18:33:51.647249+0000","last_became_active":"2024-04-26T18:33:03.525717+0000","last_became_peered":"2024-04-26T18:33:03.525717+0000","last_unstale":"2024-04-26T18:33:51.647249+0000","last_undegraded":"2024-04-26T18:33:51.647249+0000","last_fullsized":"2024-04-26T18:33:51.647249+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:15.137654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.530086+0000","last_change":"2024-04-26T18:33:06.552689+0000","last_active":"2024-04-26T18:34:50.530086+0000","last_peered":"2024-04-26T18:34:50.530086+0000","last_clean":"2024-04-26T18:34:50.530086+0000","last_became_active":"2024-04-26T18:33:06.552404+0000","last_became_peered":"2024-04-26T18:33:06.552404+0000","last_unstale":"2024-04-26T18:34:50.530086+0000","last_undegraded":"2024-04-26T18:34:50.530086+0000","last_fullsized":"2024-04-26T18:34:50.530086+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:58:32.681037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.652399+0000","last_change":"2024-04-26T18:33:03.526092+0000","last_active":"2024-04-26T18:33:51.652399+0000","last_peered":"2024-04-26T18:33:51.652399+0000","last_clean":"2024-04-26T18:33:51.652399+0000","last_became_active":"2024-04-26T18:33:03.525782+0000","last_became_peered":"2024-04-26T18:33:03.525782+0000","last_unstale":"2024-04-26T18:33:51.652399+0000","last_undegraded":"2024-04-26T18:33:51.652399+0000","last_fullsized":"2024-04-26T18:33:51.652399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:56.564484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.523411+0000","last_change":"2024-04-26T18:33:51.952244+0000","last_active":"2024-04-26T18:34:50.523411+0000","last_peered":"2024-04-26T18:34:50.523411+0000","last_clean":"2024-04-26T18:34:50.523411+0000","last_became_active":"2024-04-26T18:33:51.951795+0000","last_became_peered":"2024-04-26T18:33:51.951795+0000","last_unstale":"2024-04-26T18:34:50.523411+0000","last_undegraded":"2024-04-26T18:34:50.523411+0000","last_fullsized":"2024-04-26T18:34:50.523411+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:39.268117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'5","reported_seq":130,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:35:00.046852+0000","last_change":"2024-04-26T18:33:03.531232+0000","last_active":"2024-04-26T18:35:00.046852+0000","last_peered":"2024-04-26T18:35:00.046852+0000","last_clean":"2024-04-26T18:35:00.046852+0000","last_became_active":"2024-04-26T18:33:03.530861+0000","last_became_peered":"2024-04-26T18:33:03.530861+0000","last_unstale":"2024-04-26T18:35:00.046852+0000","last_undegraded":"2024-04-26T18:35:00.046852+0000","last_fullsized":"2024-04-26T18:35:00.046852+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:07:44.576659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.511089+0000","last_change":"2024-04-26T18:33:06.559471+0000","last_active":"2024-04-26T18:34:50.511089+0000","last_peered":"2024-04-26T18:34:50.511089+0000","last_clean":"2024-04-26T18:34:50.511089+0000","last_became_active":"2024-04-26T18:33:06.559156+0000","last_became_peered":"2024-04-26T18:33:06.559156+0000","last_unstale":"2024-04-26T18:34:50.511089+0000","last_undegraded":"2024-04-26T18:34:50.511089+0000","last_fullsized":"2024-04-26T18:34:50.511089+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:37.624415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.648213+0000","last_change":"2024-04-26T18:33:03.860900+0000","last_active":"2024-04-26T18:33:51.648213+0000","last_peered":"2024-04-26T18:33:51.648213+0000","last_clean":"2024-04-26T18:33:51.648213+0000","last_became_active":"2024-04-26T18:33:03.860601+0000","last_became_peered":"2024-04-26T18:33:03.860601+0000","last_unstale":"2024-04-26T18:33:51.648213+0000","last_undegraded":"2024-04-26T18:33:51.648213+0000","last_fullsized":"2024-04-26T18:33:51.648213+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:56.527624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.531579+0000","last_change":"2024-04-26T18:33:51.861484+0000","last_active":"2024-04-26T18:34:50.531579+0000","last_peered":"2024-04-26T18:34:50.531579+0000","last_clean":"2024-04-26T18:34:50.531579+0000","last_became_active":"2024-04-26T18:33:51.861066+0000","last_became_peered":"2024-04-26T18:33:51.861066+0000","last_unstale":"2024-04-26T18:34:50.531579+0000","last_undegraded":"2024-04-26T18:34:50.531579+0000","last_fullsized":"2024-04-26T18:34:50.531579+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:48.477037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.667905+0000","last_change":"2024-04-26T18:33:51.667455+0000","last_active":"2024-04-26T18:33:51.667905+0000","last_peered":"2024-04-26T18:33:51.667905+0000","last_clean":"2024-04-26T18:33:51.667905+0000","last_became_active":"2024-04-26T18:33:51.653472+0000","last_became_peered":"2024-04-26T18:33:51.653472+0000","last_unstale":"2024-04-26T18:33:51.667905+0000","last_undegraded":"2024-04-26T18:33:51.667905+0000","last_fullsized":"2024-04-26T18:33:51.667905+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:19.828738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.519194+0000","last_change":"2024-04-26T18:33:06.557597+0000","last_active":"2024-04-26T18:34:50.519194+0000","last_peered":"2024-04-26T18:34:50.519194+0000","last_clean":"2024-04-26T18:34:50.519194+0000","last_became_active":"2024-04-26T18:33:06.557249+0000","last_became_peered":"2024-04-26T18:33:06.557249+0000","last_unstale":"2024-04-26T18:34:50.519194+0000","last_undegraded":"2024-04-26T18:34:50.519194+0000","last_fullsized":"2024-04-26T18:34:50.519194+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:22.258691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.648284+0000","last_change":"2024-04-26T18:33:03.861082+0000","last_active":"2024-04-26T18:33:51.648284+0000","last_peered":"2024-04-26T18:33:51.648284+0000","last_clean":"2024-04-26T18:33:51.648284+0000","last_became_active":"2024-04-26T18:33:03.860661+0000","last_became_peered":"2024-04-26T18:33:03.860661+0000","last_unstale":"2024-04-26T18:33:51.648284+0000","last_undegraded":"2024-04-26T18:33:51.648284+0000","last_fullsized":"2024-04-26T18:33:51.648284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:46.653421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.526441+0000","last_change":"2024-04-26T18:33:06.558268+0000","last_active":"2024-04-26T18:34:50.526441+0000","last_peered":"2024-04-26T18:34:50.526441+0000","last_clean":"2024-04-26T18:34:50.526441+0000","last_became_active":"2024-04-26T18:33:06.557899+0000","last_became_peered":"2024-04-26T18:33:06.557899+0000","last_unstale":"2024-04-26T18:34:50.526441+0000","last_undegraded":"2024-04-26T18:34:50.526441+0000","last_fullsized":"2024-04-26T18:34:50.526441+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:03:47.016288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'5","reported_seq":130,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:35:01.759519+0000","last_change":"2024-04-26T18:33:03.528398+0000","last_active":"2024-04-26T18:35:01.759519+0000","last_peered":"2024-04-26T18:35:01.759519+0000","last_clean":"2024-04-26T18:35:01.759519+0000","last_became_active":"2024-04-26T18:33:03.528008+0000","last_became_peered":"2024-04-26T18:33:03.528008+0000","last_unstale":"2024-04-26T18:35:01.759519+0000","last_undegraded":"2024-04-26T18:35:01.759519+0000","last_fullsized":"2024-04-26T18:35:01.759519+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:27.027873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.521321+0000","last_change":"2024-04-26T18:33:06.556035+0000","last_active":"2024-04-26T18:34:50.521321+0000","last_peered":"2024-04-26T18:34:50.521321+0000","last_clean":"2024-04-26T18:34:50.521321+0000","last_became_active":"2024-04-26T18:33:06.555703+0000","last_became_peered":"2024-04-26T18:33:06.555703+0000","last_unstale":"2024-04-26T18:34:50.521321+0000","last_undegraded":"2024-04-26T18:34:50.521321+0000","last_fullsized":"2024-04-26T18:34:50.521321+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:30:02.064205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.519704+0000","last_change":"2024-04-26T18:33:06.556447+0000","last_active":"2024-04-26T18:34:50.519704+0000","last_peered":"2024-04-26T18:34:50.519704+0000","last_clean":"2024-04-26T18:34:50.519704+0000","last_became_active":"2024-04-26T18:33:06.556124+0000","last_became_peered":"2024-04-26T18:33:06.556124+0000","last_unstale":"2024-04-26T18:34:50.519704+0000","last_undegraded":"2024-04-26T18:34:50.519704+0000","last_fullsized":"2024-04-26T18:34:50.519704+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:43:07.915584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:35:01.047667+0000","last_change":"2024-04-26T18:33:03.860440+0000","last_active":"2024-04-26T18:35:01.047667+0000","last_peered":"2024-04-26T18:35:01.047667+0000","last_clean":"2024-04-26T18:35:01.047667+0000","last_became_active":"2024-04-26T18:33:03.860112+0000","last_became_peered":"2024-04-26T18:33:03.860112+0000","last_unstale":"2024-04-26T18:35:01.047667+0000","last_undegraded":"2024-04-26T18:35:01.047667+0000","last_fullsized":"2024-04-26T18:35:01.047667+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:19:05.661597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.529101+0000","last_change":"2024-04-26T18:33:06.561688+0000","last_active":"2024-04-26T18:34:50.529101+0000","last_peered":"2024-04-26T18:34:50.529101+0000","last_clean":"2024-04-26T18:34:50.529101+0000","last_became_active":"2024-04-26T18:33:06.561285+0000","last_became_peered":"2024-04-26T18:33:06.561285+0000","last_unstale":"2024-04-26T18:34:50.529101+0000","last_undegraded":"2024-04-26T18:34:50.529101+0000","last_fullsized":"2024-04-26T18:34:50.529101+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:13.272896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.651942+0000","last_change":"2024-04-26T18:33:03.531237+0000","last_active":"2024-04-26T18:33:51.651942+0000","last_peered":"2024-04-26T18:33:51.651942+0000","last_clean":"2024-04-26T18:33:51.651942+0000","last_became_active":"2024-04-26T18:33:03.530843+0000","last_became_peered":"2024-04-26T18:33:03.530843+0000","last_unstale":"2024-04-26T18:33:51.651942+0000","last_undegraded":"2024-04-26T18:33:51.651942+0000","last_fullsized":"2024-04-26T18:33:51.651942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:24.454752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":359,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.650822+0000","last_change":"2024-04-26T18:31:39.402840+0000","last_active":"2024-04-26T18:33:51.650822+0000","last_peered":"2024-04-26T18:33:51.650822+0000","last_clean":"2024-04-26T18:33:51.650822+0000","last_became_active":"2024-04-26T18:31:39.402341+0000","last_became_peered":"2024-04-26T18:31:39.402341+0000","last_unstale":"2024-04-26T18:33:51.650822+0000","last_undegraded":"2024-04-26T18:33:51.650822+0000","last_fullsized":"2024-04-26T18:33:51.650822+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:28:14.522548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:28:14.522548+0000","last_clean_scrub_stamp":"2024-04-26T18:28:14.522548+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:32.052085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.521836+0000","last_change":"2024-04-26T18:33:06.557695+0000","last_active":"2024-04-26T18:34:50.521836+0000","last_peered":"2024-04-26T18:34:50.521836+0000","last_clean":"2024-04-26T18:34:50.521836+0000","last_became_active":"2024-04-26T18:33:06.557369+0000","last_became_peered":"2024-04-26T18:33:06.557369+0000","last_unstale":"2024-04-26T18:34:50.521836+0000","last_undegraded":"2024-04-26T18:34:50.521836+0000","last_fullsized":"2024-04-26T18:34:50.521836+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:35.666232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.650779+0000","last_change":"2024-04-26T18:33:03.527897+0000","last_active":"2024-04-26T18:33:51.650779+0000","last_peered":"2024-04-26T18:33:51.650779+0000","last_clean":"2024-04-26T18:33:51.650779+0000","last_became_active":"2024-04-26T18:33:03.527345+0000","last_became_peered":"2024-04-26T18:33:03.527345+0000","last_unstale":"2024-04-26T18:33:51.650779+0000","last_undegraded":"2024-04-26T18:33:51.650779+0000","last_fullsized":"2024-04-26T18:33:51.650779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:31.144555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.648589+0000","last_change":"2024-04-26T18:33:03.860572+0000","last_active":"2024-04-26T18:33:51.648589+0000","last_peered":"2024-04-26T18:33:51.648589+0000","last_clean":"2024-04-26T18:33:51.648589+0000","last_became_active":"2024-04-26T18:33:03.860188+0000","last_became_peered":"2024-04-26T18:33:03.860188+0000","last_unstale":"2024-04-26T18:33:51.648589+0000","last_undegraded":"2024-04-26T18:33:51.648589+0000","last_fullsized":"2024-04-26T18:33:51.648589+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:24:34.811572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.519125+0000","last_change":"2024-04-26T18:33:06.558075+0000","last_active":"2024-04-26T18:34:50.519125+0000","last_peered":"2024-04-26T18:34:50.519125+0000","last_clean":"2024-04-26T18:34:50.519125+0000","last_became_active":"2024-04-26T18:33:06.557293+0000","last_became_peered":"2024-04-26T18:33:06.557293+0000","last_unstale":"2024-04-26T18:34:50.519125+0000","last_undegraded":"2024-04-26T18:34:50.519125+0000","last_fullsized":"2024-04-26T18:34:50.519125+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:12.635253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"91'17","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.648518+0000","last_change":"2024-04-26T18:33:03.528196+0000","last_active":"2024-04-26T18:33:51.648518+0000","last_peered":"2024-04-26T18:33:51.648518+0000","last_clean":"2024-04-26T18:33:51.648518+0000","last_became_active":"2024-04-26T18:33:03.527846+0000","last_became_peered":"2024-04-26T18:33:03.527846+0000","last_unstale":"2024-04-26T18:33:51.648518+0000","last_undegraded":"2024-04-26T18:33:51.648518+0000","last_fullsized":"2024-04-26T18:33:51.648518+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:13:46.073405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.525019+0000","last_change":"2024-04-26T18:33:06.550260+0000","last_active":"2024-04-26T18:34:50.525019+0000","last_peered":"2024-04-26T18:34:50.525019+0000","last_clean":"2024-04-26T18:34:50.525019+0000","last_became_active":"2024-04-26T18:33:06.549925+0000","last_became_peered":"2024-04-26T18:33:06.549925+0000","last_unstale":"2024-04-26T18:34:50.525019+0000","last_undegraded":"2024-04-26T18:34:50.525019+0000","last_fullsized":"2024-04-26T18:34:50.525019+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:17:01.777381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.652423+0000","last_change":"2024-04-26T18:33:03.876609+0000","last_active":"2024-04-26T18:33:51.652423+0000","last_peered":"2024-04-26T18:33:51.652423+0000","last_clean":"2024-04-26T18:33:51.652423+0000","last_became_active":"2024-04-26T18:33:03.876284+0000","last_became_peered":"2024-04-26T18:33:03.876284+0000","last_unstale":"2024-04-26T18:33:51.652423+0000","last_undegraded":"2024-04-26T18:33:51.652423+0000","last_fullsized":"2024-04-26T18:33:51.652423+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:22.995000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.529845+0000","last_change":"2024-04-26T18:33:06.558735+0000","last_active":"2024-04-26T18:34:50.529845+0000","last_peered":"2024-04-26T18:34:50.529845+0000","last_clean":"2024-04-26T18:34:50.529845+0000","last_became_active":"2024-04-26T18:33:06.558416+0000","last_became_peered":"2024-04-26T18:33:06.558416+0000","last_unstale":"2024-04-26T18:34:50.529845+0000","last_undegraded":"2024-04-26T18:34:50.529845+0000","last_fullsized":"2024-04-26T18:34:50.529845+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:27.627055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.860052+0000","last_change":"2024-04-26T18:33:03.861073+0000","last_active":"2024-04-26T18:33:51.860052+0000","last_peered":"2024-04-26T18:33:51.860052+0000","last_clean":"2024-04-26T18:33:51.860052+0000","last_became_active":"2024-04-26T18:33:03.860661+0000","last_became_peered":"2024-04-26T18:33:03.860661+0000","last_unstale":"2024-04-26T18:33:51.860052+0000","last_undegraded":"2024-04-26T18:33:51.860052+0000","last_fullsized":"2024-04-26T18:33:51.860052+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:19.429969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.479048+0000","last_change":"2024-04-26T18:33:06.553160+0000","last_active":"2024-04-26T18:34:50.479048+0000","last_peered":"2024-04-26T18:34:50.479048+0000","last_clean":"2024-04-26T18:34:50.479048+0000","last_became_active":"2024-04-26T18:33:06.552791+0000","last_became_peered":"2024-04-26T18:33:06.552791+0000","last_unstale":"2024-04-26T18:34:50.479048+0000","last_undegraded":"2024-04-26T18:34:50.479048+0000","last_fullsized":"2024-04-26T18:34:50.479048+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:31.675069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.651019+0000","last_change":"2024-04-26T18:33:03.524443+0000","last_active":"2024-04-26T18:33:51.651019+0000","last_peered":"2024-04-26T18:33:51.651019+0000","last_clean":"2024-04-26T18:33:51.651019+0000","last_became_active":"2024-04-26T18:33:03.524137+0000","last_became_peered":"2024-04-26T18:33:03.524137+0000","last_unstale":"2024-04-26T18:33:51.651019+0000","last_undegraded":"2024-04-26T18:33:51.651019+0000","last_fullsized":"2024-04-26T18:33:51.651019+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:43.021778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.517477+0000","last_change":"2024-04-26T18:33:06.553698+0000","last_active":"2024-04-26T18:34:50.517477+0000","last_peered":"2024-04-26T18:34:50.517477+0000","last_clean":"2024-04-26T18:34:50.517477+0000","last_became_active":"2024-04-26T18:33:06.552995+0000","last_became_peered":"2024-04-26T18:33:06.552995+0000","last_unstale":"2024-04-26T18:34:50.517477+0000","last_undegraded":"2024-04-26T18:34:50.517477+0000","last_fullsized":"2024-04-26T18:34:50.517477+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:27.135435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.657038+0000","last_change":"2024-04-26T18:33:51.656557+0000","last_active":"2024-04-26T18:33:51.657038+0000","last_peered":"2024-04-26T18:33:51.657038+0000","last_clean":"2024-04-26T18:33:51.657038+0000","last_became_active":"2024-04-26T18:33:51.652009+0000","last_became_peered":"2024-04-26T18:33:51.652009+0000","last_unstale":"2024-04-26T18:33:51.657038+0000","last_undegraded":"2024-04-26T18:33:51.657038+0000","last_fullsized":"2024-04-26T18:33:51.657038+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:05.047482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.530039+0000","last_change":"2024-04-26T18:33:06.553596+0000","last_active":"2024-04-26T18:34:50.530039+0000","last_peered":"2024-04-26T18:34:50.530039+0000","last_clean":"2024-04-26T18:34:50.530039+0000","last_became_active":"2024-04-26T18:33:06.553284+0000","last_became_peered":"2024-04-26T18:33:06.553284+0000","last_unstale":"2024-04-26T18:34:50.530039+0000","last_undegraded":"2024-04-26T18:34:50.530039+0000","last_fullsized":"2024-04-26T18:34:50.530039+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.245437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.865849+0000","last_change":"2024-04-26T18:33:51.865849+0000","last_active":"2024-04-26T18:33:51.865849+0000","last_peered":"2024-04-26T18:33:51.865849+0000","last_clean":"2024-04-26T18:33:51.865849+0000","last_became_active":"2024-04-26T18:33:51.861408+0000","last_became_peered":"2024-04-26T18:33:51.861408+0000","last_unstale":"2024-04-26T18:33:51.865849+0000","last_undegraded":"2024-04-26T18:33:51.865849+0000","last_fullsized":"2024-04-26T18:33:51.865849+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:12.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.531045+0000","last_change":"2024-04-26T18:33:06.566899+0000","last_active":"2024-04-26T18:34:50.531045+0000","last_peered":"2024-04-26T18:34:50.531045+0000","last_clean":"2024-04-26T18:34:50.531045+0000","last_became_active":"2024-04-26T18:33:06.566548+0000","last_became_peered":"2024-04-26T18:33:06.566548+0000","last_unstale":"2024-04-26T18:34:50.531045+0000","last_undegraded":"2024-04-26T18:34:50.531045+0000","last_fullsized":"2024-04-26T18:34:50.531045+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:07.751063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'5","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:35:02.060460+0000","last_change":"2024-04-26T18:33:03.876589+0000","last_active":"2024-04-26T18:35:02.060460+0000","last_peered":"2024-04-26T18:35:02.060460+0000","last_clean":"2024-04-26T18:35:02.060460+0000","last_became_active":"2024-04-26T18:33:03.876262+0000","last_became_peered":"2024-04-26T18:33:03.876262+0000","last_unstale":"2024-04-26T18:35:02.060460+0000","last_undegraded":"2024-04-26T18:35:02.060460+0000","last_fullsized":"2024-04-26T18:35:02.060460+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:04.959745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.531154+0000","last_change":"2024-04-26T18:33:06.561848+0000","last_active":"2024-04-26T18:34:50.531154+0000","last_peered":"2024-04-26T18:34:50.531154+0000","last_clean":"2024-04-26T18:34:50.531154+0000","last_became_active":"2024-04-26T18:33:06.561514+0000","last_became_peered":"2024-04-26T18:33:06.561514+0000","last_unstale":"2024-04-26T18:34:50.531154+0000","last_undegraded":"2024-04-26T18:34:50.531154+0000","last_fullsized":"2024-04-26T18:34:50.531154+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:46.326261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.652880+0000","last_change":"2024-04-26T18:33:03.527237+0000","last_active":"2024-04-26T18:33:51.652880+0000","last_peered":"2024-04-26T18:33:51.652880+0000","last_clean":"2024-04-26T18:33:51.652880+0000","last_became_active":"2024-04-26T18:33:03.526618+0000","last_became_peered":"2024-04-26T18:33:03.526618+0000","last_unstale":"2024-04-26T18:33:51.652880+0000","last_undegraded":"2024-04-26T18:33:51.652880+0000","last_fullsized":"2024-04-26T18:33:51.652880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:28.232597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.518175+0000","last_change":"2024-04-26T18:33:06.555276+0000","last_active":"2024-04-26T18:34:50.518175+0000","last_peered":"2024-04-26T18:34:50.518175+0000","last_clean":"2024-04-26T18:34:50.518175+0000","last_became_active":"2024-04-26T18:33:06.554889+0000","last_became_peered":"2024-04-26T18:33:06.554889+0000","last_unstale":"2024-04-26T18:34:50.518175+0000","last_undegraded":"2024-04-26T18:34:50.518175+0000","last_fullsized":"2024-04-26T18:34:50.518175+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:33:13.614662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:33:51.950766+0000","last_change":"2024-04-26T18:33:03.527108+0000","last_active":"2024-04-26T18:33:51.950766+0000","last_peered":"2024-04-26T18:33:51.950766+0000","last_clean":"2024-04-26T18:33:51.950766+0000","last_became_active":"2024-04-26T18:33:03.526648+0000","last_became_peered":"2024-04-26T18:33:03.526648+0000","last_unstale":"2024-04-26T18:33:51.950766+0000","last_undegraded":"2024-04-26T18:33:51.950766+0000","last_fullsized":"2024-04-26T18:33:51.950766+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:40.915022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.521045+0000","last_change":"2024-04-26T18:33:06.551605+0000","last_active":"2024-04-26T18:34:50.521045+0000","last_peered":"2024-04-26T18:34:50.521045+0000","last_clean":"2024-04-26T18:34:50.521045+0000","last_became_active":"2024-04-26T18:33:06.550772+0000","last_became_peered":"2024-04-26T18:33:06.550772+0000","last_unstale":"2024-04-26T18:34:50.521045+0000","last_undegraded":"2024-04-26T18:34:50.521045+0000","last_fullsized":"2024-04-26T18:34:50.521045+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:33.124989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.522652+0000","last_change":"2024-04-26T18:33:06.558971+0000","last_active":"2024-04-26T18:34:50.522652+0000","last_peered":"2024-04-26T18:34:50.522652+0000","last_clean":"2024-04-26T18:34:50.522652+0000","last_became_active":"2024-04-26T18:33:06.558594+0000","last_became_peered":"2024-04-26T18:33:06.558594+0000","last_unstale":"2024-04-26T18:34:50.522652+0000","last_undegraded":"2024-04-26T18:34:50.522652+0000","last_fullsized":"2024-04-26T18:34:50.522652+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:12.974472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.521051+0000","last_change":"2024-04-26T18:33:06.558928+0000","last_active":"2024-04-26T18:34:50.521051+0000","last_peered":"2024-04-26T18:34:50.521051+0000","last_clean":"2024-04-26T18:34:50.521051+0000","last_became_active":"2024-04-26T18:33:06.558348+0000","last_became_peered":"2024-04-26T18:33:06.558348+0000","last_unstale":"2024-04-26T18:34:50.521051+0000","last_undegraded":"2024-04-26T18:34:50.521051+0000","last_fullsized":"2024-04-26T18:34:50.521051+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:04.266404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.530053+0000","last_change":"2024-04-26T18:33:06.555182+0000","last_active":"2024-04-26T18:34:50.530053+0000","last_peered":"2024-04-26T18:34:50.530053+0000","last_clean":"2024-04-26T18:34:50.530053+0000","last_became_active":"2024-04-26T18:33:06.554830+0000","last_became_peered":"2024-04-26T18:33:06.554830+0000","last_unstale":"2024-04-26T18:34:50.530053+0000","last_undegraded":"2024-04-26T18:34:50.530053+0000","last_fullsized":"2024-04-26T18:34:50.530053+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:48.841634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.515959+0000","last_change":"2024-04-26T18:33:06.558962+0000","last_active":"2024-04-26T18:34:50.515959+0000","last_peered":"2024-04-26T18:34:50.515959+0000","last_clean":"2024-04-26T18:34:50.515959+0000","last_became_active":"2024-04-26T18:33:06.557995+0000","last_became_peered":"2024-04-26T18:33:06.557995+0000","last_unstale":"2024-04-26T18:34:50.515959+0000","last_undegraded":"2024-04-26T18:34:50.515959+0000","last_fullsized":"2024-04-26T18:34:50.515959+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:54.207205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.521772+0000","last_change":"2024-04-26T18:33:06.558055+0000","last_active":"2024-04-26T18:34:50.521772+0000","last_peered":"2024-04-26T18:34:50.521772+0000","last_clean":"2024-04-26T18:34:50.521772+0000","last_became_active":"2024-04-26T18:33:06.557299+0000","last_became_peered":"2024-04-26T18:33:06.557299+0000","last_unstale":"2024-04-26T18:34:50.521772+0000","last_undegraded":"2024-04-26T18:34:50.521772+0000","last_fullsized":"2024-04-26T18:34:50.521772+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:21.143017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.519110+0000","last_change":"2024-04-26T18:33:06.558680+0000","last_active":"2024-04-26T18:34:50.519110+0000","last_peered":"2024-04-26T18:34:50.519110+0000","last_clean":"2024-04-26T18:34:50.519110+0000","last_became_active":"2024-04-26T18:33:06.558139+0000","last_became_peered":"2024-04-26T18:33:06.558139+0000","last_unstale":"2024-04-26T18:34:50.519110+0000","last_undegraded":"2024-04-26T18:34:50.519110+0000","last_fullsized":"2024-04-26T18:34:50.519110+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:31.511770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.522619+0000","last_change":"2024-04-26T18:33:06.563832+0000","last_active":"2024-04-26T18:34:50.522619+0000","last_peered":"2024-04-26T18:34:50.522619+0000","last_clean":"2024-04-26T18:34:50.522619+0000","last_became_active":"2024-04-26T18:33:06.562193+0000","last_became_peered":"2024-04-26T18:33:06.562193+0000","last_unstale":"2024-04-26T18:34:50.522619+0000","last_undegraded":"2024-04-26T18:34:50.522619+0000","last_fullsized":"2024-04-26T18:34:50.522619+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:35.384552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.530536+0000","last_change":"2024-04-26T18:33:06.562368+0000","last_active":"2024-04-26T18:34:50.530536+0000","last_peered":"2024-04-26T18:34:50.530536+0000","last_clean":"2024-04-26T18:34:50.530536+0000","last_became_active":"2024-04-26T18:33:06.562024+0000","last_became_peered":"2024-04-26T18:33:06.562024+0000","last_unstale":"2024-04-26T18:34:50.530536+0000","last_undegraded":"2024-04-26T18:34:50.530536+0000","last_fullsized":"2024-04-26T18:34:50.530536+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:01.562885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.530181+0000","last_change":"2024-04-26T18:33:06.560953+0000","last_active":"2024-04-26T18:34:50.530181+0000","last_peered":"2024-04-26T18:34:50.530181+0000","last_clean":"2024-04-26T18:34:50.530181+0000","last_became_active":"2024-04-26T18:33:06.560593+0000","last_became_peered":"2024-04-26T18:33:06.560593+0000","last_unstale":"2024-04-26T18:34:50.530181+0000","last_undegraded":"2024-04-26T18:34:50.530181+0000","last_fullsized":"2024-04-26T18:34:50.530181+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:18.168564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.530908+0000","last_change":"2024-04-26T18:33:06.555389+0000","last_active":"2024-04-26T18:34:50.530908+0000","last_peered":"2024-04-26T18:34:50.530908+0000","last_clean":"2024-04-26T18:34:50.530908+0000","last_became_active":"2024-04-26T18:33:06.555055+0000","last_became_peered":"2024-04-26T18:33:06.555055+0000","last_unstale":"2024-04-26T18:34:50.530908+0000","last_undegraded":"2024-04-26T18:34:50.530908+0000","last_fullsized":"2024-04-26T18:34:50.530908+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:32.802687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.532655+0000","last_change":"2024-04-26T18:33:06.563791+0000","last_active":"2024-04-26T18:34:50.532655+0000","last_peered":"2024-04-26T18:34:50.532655+0000","last_clean":"2024-04-26T18:34:50.532655+0000","last_became_active":"2024-04-26T18:33:06.561959+0000","last_became_peered":"2024-04-26T18:33:06.561959+0000","last_unstale":"2024-04-26T18:34:50.532655+0000","last_undegraded":"2024-04-26T18:34:50.532655+0000","last_fullsized":"2024-04-26T18:34:50.532655+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:35.280202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.524469+0000","last_change":"2024-04-26T18:33:06.554270+0000","last_active":"2024-04-26T18:34:50.524469+0000","last_peered":"2024-04-26T18:34:50.524469+0000","last_clean":"2024-04-26T18:34:50.524469+0000","last_became_active":"2024-04-26T18:33:06.553931+0000","last_became_peered":"2024-04-26T18:33:06.553931+0000","last_unstale":"2024-04-26T18:34:50.524469+0000","last_undegraded":"2024-04-26T18:34:50.524469+0000","last_fullsized":"2024-04-26T18:34:50.524469+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:40.587824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T18:34:50.515024+0000","last_change":"2024-04-26T18:33:06.556766+0000","last_active":"2024-04-26T18:34:50.515024+0000","last_peered":"2024-04-26T18:34:50.515024+0000","last_clean":"2024-04-26T18:34:50.515024+0000","last_became_active":"2024-04-26T18:33:06.556361+0000","last_became_peered":"2024-04-26T18:33:06.556361+0000","last_unstale":"2024-04-26T18:34:50.515024+0000","last_undegraded":"2024-04-26T18:34:50.515024+0000","last_fullsized":"2024-04-26T18:34:50.515024+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:10.101747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":245619,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69029,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1045,"num_read_kb":598,"num_write":252,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":207087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351016,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":483469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612654,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32300,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712852,"statfs":{"total":95995035648,"available":95961960448,"internally_reserved":0,"allocated":1150976,"data_stored":1136551,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776179,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1019904,"data_stored":483377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037815,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":483061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299453,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1069056,"data_stored":1076414,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462978,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":1003520,"data_stored":483094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1064960,"data_stored":546082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1024000,"data_stored":484433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411414,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1085440,"data_stored":546834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149777,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1019904,"data_stored":482919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888140,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":483627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724614,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1081344,"data_stored":1076092,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33912,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33912,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T18:35:07.835 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-26T18:35:07.835 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T18:35:07.835 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-26T18:35:07.836 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph health --format=json 2024-04-26T18:35:07.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:07 smithi080 ceph-mon[29135]: pgmap v359: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-26T18:35:07.847 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:07 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:35:07.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:07 smithi192 ceph-mon[32842]: pgmap v359: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-26T18:35:07.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:07 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:35:07.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:07 smithi082 ceph-mon[32808]: pgmap v359: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-26T18:35:07.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:07 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:35:08.213 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:35:08.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:08 smithi192 ceph-mon[32842]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T18:35:08.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:08 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:35:08.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:08 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:35:08.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:08 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:35:08.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:08 smithi082 ceph-mon[32808]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T18:35:08.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:08 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:35:08.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:08 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:35:08.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:08 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:35:08.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:08 smithi080 ceph-mon[29135]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T18:35:08.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:08 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:35:08.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:08 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:35:08.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:08 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:35:09.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.878+0000 7f06601f8700 1 -- 172.21.15.80:0/3516225585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065806bb70 msgr2=0x7f065806bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:09.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.878+0000 7f06601f8700 1 --2- 172.21.15.80:0/3516225585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065806bb70 0x7f065806bfd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f06480099c0 tx=0x7f0648009cd0 comp rx=0 tx=0).stop 2024-04-26T18:35:09.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.878+0000 7f06601f8700 1 -- 172.21.15.80:0/3516225585 shutdown_connections 2024-04-26T18:35:09.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.878+0000 7f06601f8700 1 --2- 172.21.15.80:0/3516225585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f065806c510 0x7f06581102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:09.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.878+0000 7f06601f8700 1 --2- 172.21.15.80:0/3516225585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06581094a0 0x7f0658109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:09.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.878+0000 7f06601f8700 1 --2- 172.21.15.80:0/3516225585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065806bb70 0x7f065806bfd0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:09.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.878+0000 7f06601f8700 1 -- 172.21.15.80:0/3516225585 >> 172.21.15.80:0/3516225585 conn(0x7f06580792c0 msgr2=0x7f06580796d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:09.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.879+0000 7f06601f8700 1 -- 172.21.15.80:0/3516225585 shutdown_connections 2024-04-26T18:35:09.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.879+0000 7f06601f8700 1 -- 172.21.15.80:0/3516225585 wait complete. 2024-04-26T18:35:09.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.879+0000 7f06601f8700 1 Processor -- start 2024-04-26T18:35:09.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.880+0000 7f06601f8700 1 -- start start 2024-04-26T18:35:09.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.880+0000 7f06601f8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065806bb70 0x7f065819f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:09.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.880+0000 7f06601f8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f065806c510 0x7f065819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:09.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.880+0000 7f06601f8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06581094a0 0x7f0658199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:09.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.880+0000 7f06601f8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0658113610 con 0x7f065806bb70 2024-04-26T18:35:09.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.880+0000 7f06601f8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0658113490 con 0x7f06581094a0 2024-04-26T18:35:09.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.880+0000 7f06601f8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0658113790 con 0x7f065806c510 2024-04-26T18:35:09.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.880+0000 7f065df94700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065806bb70 0x7f065819f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:09.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.880+0000 7f065df94700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065806bb70 0x7f065819f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40026/0 (socket says 172.21.15.80:40026) 2024-04-26T18:35:09.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.880+0000 7f065df94700 1 -- 172.21.15.80:0/1712678831 learned_addr learned my addr 172.21.15.80:0/1712678831 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:09.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.880+0000 7f065e795700 1 --2- 172.21.15.80:0/1712678831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06581094a0 0x7f0658199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:09.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.880+0000 7f065d793700 1 --2- 172.21.15.80:0/1712678831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f065806c510 0x7f065819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:09.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.880+0000 7f065df94700 1 -- 172.21.15.80:0/1712678831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f065806c510 msgr2=0x7f065819fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:09.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.880+0000 7f065df94700 1 --2- 172.21.15.80:0/1712678831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f065806c510 0x7f065819fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:09.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.880+0000 7f065df94700 1 -- 172.21.15.80:0/1712678831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06581094a0 msgr2=0x7f0658199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:09.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.880+0000 7f065df94700 1 --2- 172.21.15.80:0/1712678831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06581094a0 0x7f0658199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:09.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.880+0000 7f065df94700 1 -- 172.21.15.80:0/1712678831 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065819a090 con 0x7f065806bb70 2024-04-26T18:35:09.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.880+0000 7f065df94700 1 --2- 172.21.15.80:0/1712678831 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065806bb70 0x7f065819f700 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f065400b530 tx=0x7f065400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:09.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.881+0000 7f064effd700 1 -- 172.21.15.80:0/1712678831 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0654015020 con 0x7f065806bb70 2024-04-26T18:35:09.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.881+0000 7f06601f8700 1 -- 172.21.15.80:0/1712678831 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f065819a380 con 0x7f065806bb70 2024-04-26T18:35:09.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.881+0000 7f064effd700 1 -- 172.21.15.80:0/1712678831 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0654011ce0 con 0x7f065806bb70 2024-04-26T18:35:09.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.881+0000 7f064effd700 1 -- 172.21.15.80:0/1712678831 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0654010e40 con 0x7f065806bb70 2024-04-26T18:35:09.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.881+0000 7f06601f8700 1 -- 172.21.15.80:0/1712678831 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06581a65d0 con 0x7f065806bb70 2024-04-26T18:35:09.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.882+0000 7f06601f8700 1 -- 172.21.15.80:0/1712678831 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0658104b50 con 0x7f065806bb70 2024-04-26T18:35:09.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.883+0000 7f064effd700 1 -- 172.21.15.80:0/1712678831 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f0654018020 con 0x7f065806bb70 2024-04-26T18:35:09.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.883+0000 7f064effd700 1 --2- 172.21.15.80:0/1712678831 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f06440a3c40 0x7f06440a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:09.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.884+0000 7f065d793700 1 --2- 172.21.15.80:0/1712678831 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f06440a3c40 0x7f06440a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:09.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.884+0000 7f064effd700 1 -- 172.21.15.80:0/1712678831 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f06540d01f0 con 0x7f065806bb70 2024-04-26T18:35:09.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.884+0000 7f065d793700 1 --2- 172.21.15.80:0/1712678831 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f06440a3c40 0x7f06440a6100 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0648003800 tx=0x7f0648000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:09.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:09.887+0000 7f064effd700 1 -- 172.21.15.80:0/1712678831 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f065401f020 con 0x7f065806bb70 2024-04-26T18:35:09.888 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:09 smithi080 ceph-mon[29135]: pgmap v360: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:09.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:09 smithi082 ceph-mon[32808]: pgmap v360: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:10.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:09 smithi192 ceph-mon[32842]: pgmap v360: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:10.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:10.222+0000 7f06601f8700 1 -- 172.21.15.80:0/1712678831 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f065819adf0 con 0x7f065806bb70 2024-04-26T18:35:10.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:10.223+0000 7f064effd700 1 -- 172.21.15.80:0/1712678831 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f065409cc00 con 0x7f065806bb70 2024-04-26T18:35:10.223 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:35:10.223 INFO:teuthology.orchestra.run.smithi080.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T18:35:10.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:10.225+0000 7f06601f8700 1 -- 172.21.15.80:0/1712678831 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f06440a3c40 msgr2=0x7f06440a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:10.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:10.225+0000 7f06601f8700 1 --2- 172.21.15.80:0/1712678831 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f06440a3c40 0x7f06440a6100 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0648003800 tx=0x7f0648000bc0 comp rx=0 tx=0).stop 2024-04-26T18:35:10.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:10.225+0000 7f06601f8700 1 -- 172.21.15.80:0/1712678831 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065806bb70 msgr2=0x7f065819f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:10.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:10.225+0000 7f06601f8700 1 --2- 172.21.15.80:0/1712678831 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065806bb70 0x7f065819f700 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f065400b530 tx=0x7f065400b840 comp rx=0 tx=0).stop 2024-04-26T18:35:10.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:10.225+0000 7f06601f8700 1 -- 172.21.15.80:0/1712678831 shutdown_connections 2024-04-26T18:35:10.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:10.225+0000 7f06601f8700 1 --2- 172.21.15.80:0/1712678831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06581094a0 0x7f0658199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:10.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:10.225+0000 7f06601f8700 1 --2- 172.21.15.80:0/1712678831 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065806bb70 0x7f065819f700 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:10.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:10.225+0000 7f06601f8700 1 --2- 172.21.15.80:0/1712678831 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f06440a3c40 0x7f06440a6100 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:10.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:10.225+0000 7f06601f8700 1 --2- 172.21.15.80:0/1712678831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f065806c510 0x7f065819fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:10.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:10.225+0000 7f06601f8700 1 -- 172.21.15.80:0/1712678831 >> 172.21.15.80:0/1712678831 conn(0x7f06580792c0 msgr2=0x7f0658100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:10.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:10.225+0000 7f06601f8700 1 -- 172.21.15.80:0/1712678831 shutdown_connections 2024-04-26T18:35:10.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:10.225+0000 7f06601f8700 1 -- 172.21.15.80:0/1712678831 wait complete. 2024-04-26T18:35:10.945 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-26T18:35:10.946 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:35:11.233 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:35:11.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:35:11.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:35:11.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:11 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1712678831' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-26T18:35:11.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:11 smithi082 ceph-mon[32808]: pgmap v361: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:11.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:35:11.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:35:11.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:35:11.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:35:11.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:35:11.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:11 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1712678831' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-26T18:35:11.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:11 smithi080 ceph-mon[29135]: pgmap v361: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:11.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:35:11.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:35:11.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:35:11.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:35:11.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:35:11.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:11 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1712678831' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-26T18:35:11.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:11 smithi192 ceph-mon[32842]: pgmap v361: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:11.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:35:11.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:35:11.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:35:12.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.989+0000 7f523b955700 1 -- 172.21.15.80:0/1054808907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f523406c580 msgr2=0x7f52341102b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:12.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.989+0000 7f523b955700 1 --2- 172.21.15.80:0/1054808907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f523406c580 0x7f52341102b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f522c00b0d0 tx=0x7f522c00b3e0 comp rx=0 tx=0).stop 2024-04-26T18:35:12.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.989+0000 7f523b955700 1 -- 172.21.15.80:0/1054808907 shutdown_connections 2024-04-26T18:35:12.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.989+0000 7f523b955700 1 --2- 172.21.15.80:0/1054808907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f523406c580 0x7f52341102b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:12.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.989+0000 7f523b955700 1 --2- 172.21.15.80:0/1054808907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5234109490 0x7f5234109870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:12.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.989+0000 7f523b955700 1 --2- 172.21.15.80:0/1054808907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f523406bbc0 0x7f523406c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:12.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.989+0000 7f523b955700 1 -- 172.21.15.80:0/1054808907 >> 172.21.15.80:0/1054808907 conn(0x7f5234078390 msgr2=0x7f52340787a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:12.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.989+0000 7f523b955700 1 -- 172.21.15.80:0/1054808907 shutdown_connections 2024-04-26T18:35:12.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.989+0000 7f523b955700 1 -- 172.21.15.80:0/1054808907 wait complete. 2024-04-26T18:35:12.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.989+0000 7f523b955700 1 Processor -- start 2024-04-26T18:35:12.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.990+0000 7f523b955700 1 -- start start 2024-04-26T18:35:12.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.990+0000 7f523b955700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f523406bbc0 0x7f5234102420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:12.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.990+0000 7f523b955700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f523406c580 0x7f5234102960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:12.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.990+0000 7f523b955700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5234109490 0x7f5234102ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:12.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.990+0000 7f523b955700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f52341135c0 con 0x7f5234109490 2024-04-26T18:35:12.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.990+0000 7f523b955700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5234113440 con 0x7f523406c580 2024-04-26T18:35:12.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.990+0000 7f523b955700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5234113740 con 0x7f523406bbc0 2024-04-26T18:35:12.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.990+0000 7f5239ef2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5234109490 0x7f5234102ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:12.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.990+0000 7f5239ef2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5234109490 0x7f5234102ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40032/0 (socket says 172.21.15.80:40032) 2024-04-26T18:35:12.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.990+0000 7f5239ef2700 1 -- 172.21.15.80:0/3122796942 learned_addr learned my addr 172.21.15.80:0/3122796942 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:12.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.990+0000 7f5238ef0700 1 --2- 172.21.15.80:0/3122796942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f523406c580 0x7f5234102960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:12.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.990+0000 7f52396f1700 1 --2- 172.21.15.80:0/3122796942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f523406bbc0 0x7f5234102420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:12.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.990+0000 7f5239ef2700 1 -- 172.21.15.80:0/3122796942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f523406bbc0 msgr2=0x7f5234102420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:12.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.990+0000 7f5239ef2700 1 --2- 172.21.15.80:0/3122796942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f523406bbc0 0x7f5234102420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:12.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.990+0000 7f5239ef2700 1 -- 172.21.15.80:0/3122796942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f523406c580 msgr2=0x7f5234102960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:12.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.990+0000 7f5239ef2700 1 --2- 172.21.15.80:0/3122796942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f523406c580 0x7f5234102960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:12.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.990+0000 7f5239ef2700 1 -- 172.21.15.80:0/3122796942 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52341a7fb0 con 0x7f5234109490 2024-04-26T18:35:12.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.991+0000 7f5239ef2700 1 --2- 172.21.15.80:0/3122796942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5234109490 0x7f5234102ea0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f522c009fd0 tx=0x7f522c007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:12.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.991+0000 7f522a7fc700 1 -- 172.21.15.80:0/3122796942 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f522c01f070 con 0x7f5234109490 2024-04-26T18:35:12.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.991+0000 7f523b955700 1 -- 172.21.15.80:0/3122796942 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52341a8240 con 0x7f5234109490 2024-04-26T18:35:12.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.991+0000 7f522a7fc700 1 -- 172.21.15.80:0/3122796942 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f522c003c00 con 0x7f5234109490 2024-04-26T18:35:12.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.991+0000 7f522a7fc700 1 -- 172.21.15.80:0/3122796942 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f522c01b7b0 con 0x7f5234109490 2024-04-26T18:35:12.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.992+0000 7f523b955700 1 -- 172.21.15.80:0/3122796942 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52341a86f0 con 0x7f5234109490 2024-04-26T18:35:12.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.992+0000 7f523b955700 1 -- 172.21.15.80:0/3122796942 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5234104b80 con 0x7f5234109490 2024-04-26T18:35:12.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.994+0000 7f522a7fc700 1 -- 172.21.15.80:0/3122796942 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f522c022070 con 0x7f5234109490 2024-04-26T18:35:12.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.994+0000 7f522a7fc700 1 --2- 172.21.15.80:0/3122796942 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f52200a3c40 0x7f52200a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:12.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.994+0000 7f52396f1700 1 --2- 172.21.15.80:0/3122796942 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f52200a3c40 0x7f52200a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:12.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.994+0000 7f522a7fc700 1 -- 172.21.15.80:0/3122796942 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f522c00f020 con 0x7f5234109490 2024-04-26T18:35:12.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.995+0000 7f52396f1700 1 --2- 172.21.15.80:0/3122796942 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f52200a3c40 0x7f52200a6100 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5224005fd0 tx=0x7f522400af20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:12.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:12.998+0000 7f522a7fc700 1 -- 172.21.15.80:0/3122796942 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f522c029070 con 0x7f5234109490 2024-04-26T18:35:13.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:13.240+0000 7f523b955700 1 -- 172.21.15.80:0/3122796942 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5234103900 con 0x7f5234109490 2024-04-26T18:35:13.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:13.241+0000 7f522a7fc700 1 -- 172.21.15.80:0/3122796942 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11918 (secure 0 0 0) 0x7f522c09e270 con 0x7f5234109490 2024-04-26T18:35:13.243 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:35:13.243 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1967550873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1967550873},{"type":"v1","addr":"172.21.15.80:6835","nonce":1967550873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/559541830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":559541830},{"type":"v1","addr":"172.21.15.80:6837","nonce":559541830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T18:33:08.347399+0000","modified":"2024-04-26T18:33:27.036209+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24434,"mds_1":24421,"mds_2":24404,"mds_3":24400,"mds_4":24394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14577":{"gid":14577,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6839/2137993298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":2137993298},{"type":"v1","addr":"172.21.15.80:6839","nonce":2137993298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6841/1544670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1544670},{"type":"v1","addr":"172.21.15.80:6841","nonce":1544670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24371":{"gid":24371,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/3564539039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3564539039},{"type":"v1","addr":"172.21.15.82:6833","nonce":3564539039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24379":{"gid":24379,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/572065563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":572065563},{"type":"v1","addr":"172.21.15.82:6835","nonce":572065563}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.192:6835/719058020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":719058020},{"type":"v1","addr":"172.21.15.192:6835","nonce":719058020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.192:6837/2361996920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2361996920},{"type":"v1","addr":"172.21.15.192:6837","nonce":2361996920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.82:6837/2084055551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2084055551},{"type":"v1","addr":"172.21.15.82:6837","nonce":2084055551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6839/2735406056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":2735406056},{"type":"v1","addr":"172.21.15.192:6839","nonce":2735406056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.82:6839/1482576497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1482576497},{"type":"v1","addr":"172.21.15.82:6839","nonce":1482576497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24434,"qdb_cluster":[24404,24434,24394,24400,24421]},"id":1}]} 2024-04-26T18:35:13.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:13.243+0000 7f523b955700 1 -- 172.21.15.80:0/3122796942 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f52200a3c40 msgr2=0x7f52200a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:13.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:13.243+0000 7f523b955700 1 --2- 172.21.15.80:0/3122796942 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f52200a3c40 0x7f52200a6100 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5224005fd0 tx=0x7f522400af20 comp rx=0 tx=0).stop 2024-04-26T18:35:13.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:13.243+0000 7f523b955700 1 -- 172.21.15.80:0/3122796942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5234109490 msgr2=0x7f5234102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:13.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:13.243+0000 7f523b955700 1 --2- 172.21.15.80:0/3122796942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5234109490 0x7f5234102ea0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f522c009fd0 tx=0x7f522c007a20 comp rx=0 tx=0).stop 2024-04-26T18:35:13.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:13.243+0000 7f523b955700 1 -- 172.21.15.80:0/3122796942 shutdown_connections 2024-04-26T18:35:13.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:13.243+0000 7f523b955700 1 --2- 172.21.15.80:0/3122796942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5234109490 0x7f5234102ea0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:13.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:13.243+0000 7f523b955700 1 --2- 172.21.15.80:0/3122796942 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f52200a3c40 0x7f52200a6100 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:13.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:13.243+0000 7f523b955700 1 --2- 172.21.15.80:0/3122796942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f523406bbc0 0x7f5234102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:13.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:13.243+0000 7f523b955700 1 --2- 172.21.15.80:0/3122796942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f523406c580 0x7f5234102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:13.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:13.243+0000 7f523b955700 1 -- 172.21.15.80:0/3122796942 >> 172.21.15.80:0/3122796942 conn(0x7f5234078390 msgr2=0x7f5234100f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:13.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:13.243+0000 7f523b955700 1 -- 172.21.15.80:0/3122796942 shutdown_connections 2024-04-26T18:35:13.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:13.243+0000 7f523b955700 1 -- 172.21.15.80:0/3122796942 wait complete. 2024-04-26T18:35:13.245 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 26 2024-04-26T18:35:13.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:13 smithi192 ceph-mon[32842]: pgmap v362: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:35:13.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:13 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3122796942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:35:13.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:13 smithi080 ceph-mon[29135]: pgmap v362: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:35:13.871 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:13 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3122796942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:35:13.900 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:35:13.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:13 smithi082 ceph-mon[32808]: pgmap v362: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:35:13.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:13 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3122796942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:35:14.139 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:35:15.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.802+0000 7f444e129700 1 -- 172.21.15.80:0/4200514882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44481027a0 msgr2=0x7f4448110210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:15.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.802+0000 7f444e129700 1 --2- 172.21.15.80:0/4200514882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44481027a0 0x7f4448110210 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f444000b0a0 tx=0x7f444000b3b0 comp rx=0 tx=0).stop 2024-04-26T18:35:15.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.802+0000 7f444e129700 1 -- 172.21.15.80:0/4200514882 shutdown_connections 2024-04-26T18:35:15.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.802+0000 7f444e129700 1 --2- 172.21.15.80:0/4200514882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44481027a0 0x7f4448110210 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:15.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.802+0000 7f444e129700 1 --2- 172.21.15.80:0/4200514882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4448108500 0x7f44481088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:15.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.802+0000 7f444e129700 1 --2- 172.21.15.80:0/4200514882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4448101de0 0x7f4448102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:15.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.802+0000 7f444e129700 1 -- 172.21.15.80:0/4200514882 >> 172.21.15.80:0/4200514882 conn(0x7f4448077640 msgr2=0x7f4448077a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:15.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.802+0000 7f444e129700 1 -- 172.21.15.80:0/4200514882 shutdown_connections 2024-04-26T18:35:15.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.802+0000 7f444e129700 1 -- 172.21.15.80:0/4200514882 wait complete. 2024-04-26T18:35:15.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.803+0000 7f444e129700 1 Processor -- start 2024-04-26T18:35:15.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.803+0000 7f444e129700 1 -- start start 2024-04-26T18:35:15.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.803+0000 7f444e129700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4448101de0 0x7f444819f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:15.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.803+0000 7f444e129700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44481027a0 0x7f444819fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:15.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.803+0000 7f444e129700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4448108500 0x7f4448199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:15.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.803+0000 7f444e129700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4448113710 con 0x7f44481027a0 2024-04-26T18:35:15.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.803+0000 7f444e129700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4448113590 con 0x7f4448101de0 2024-04-26T18:35:15.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.803+0000 7f444e129700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4448113890 con 0x7f4448108500 2024-04-26T18:35:15.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.803+0000 7f4446ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44481027a0 0x7f444819fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:15.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.803+0000 7f4446ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44481027a0 0x7f444819fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33474/0 (socket says 172.21.15.80:33474) 2024-04-26T18:35:15.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.803+0000 7f4446ffd700 1 -- 172.21.15.80:0/1045788961 learned_addr learned my addr 172.21.15.80:0/1045788961 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:15.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.804+0000 7f4447fff700 1 --2- 172.21.15.80:0/1045788961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4448108500 0x7f4448199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:15.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.804+0000 7f44477fe700 1 --2- 172.21.15.80:0/1045788961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4448101de0 0x7f444819f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:15.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.804+0000 7f4446ffd700 1 -- 172.21.15.80:0/1045788961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4448108500 msgr2=0x7f4448199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:15.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.804+0000 7f4446ffd700 1 --2- 172.21.15.80:0/1045788961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4448108500 0x7f4448199a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:15.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.804+0000 7f4446ffd700 1 -- 172.21.15.80:0/1045788961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4448101de0 msgr2=0x7f444819f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:15.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.804+0000 7f4446ffd700 1 --2- 172.21.15.80:0/1045788961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4448101de0 0x7f444819f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:15.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.804+0000 7f4446ffd700 1 -- 172.21.15.80:0/1045788961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f444819a190 con 0x7f44481027a0 2024-04-26T18:35:15.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.804+0000 7f44477fe700 1 --2- 172.21.15.80:0/1045788961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4448101de0 0x7f444819f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:35:15.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.804+0000 7f4446ffd700 1 --2- 172.21.15.80:0/1045788961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44481027a0 0x7f444819fdb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f443c00b530 tx=0x7f443c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:15.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.804+0000 7f4444ff9700 1 -- 172.21.15.80:0/1045788961 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c015020 con 0x7f44481027a0 2024-04-26T18:35:15.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.804+0000 7f444e129700 1 -- 172.21.15.80:0/1045788961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f444819a480 con 0x7f44481027a0 2024-04-26T18:35:15.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.804+0000 7f4444ff9700 1 -- 172.21.15.80:0/1045788961 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f443c011ce0 con 0x7f44481027a0 2024-04-26T18:35:15.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.804+0000 7f4444ff9700 1 -- 172.21.15.80:0/1045788961 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c010d20 con 0x7f44481027a0 2024-04-26T18:35:15.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.804+0000 7f444e129700 1 -- 172.21.15.80:0/1045788961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44481a67c0 con 0x7f44481027a0 2024-04-26T18:35:15.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.805+0000 7f444e129700 1 -- 172.21.15.80:0/1045788961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f444806a110 con 0x7f44481027a0 2024-04-26T18:35:15.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.806+0000 7f4444ff9700 1 -- 172.21.15.80:0/1045788961 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f443c018020 con 0x7f44481027a0 2024-04-26T18:35:15.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.807+0000 7f4444ff9700 1 --2- 172.21.15.80:0/1045788961 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f44300a3c40 0x7f44300a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:15.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.807+0000 7f44477fe700 1 --2- 172.21.15.80:0/1045788961 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f44300a3c40 0x7f44300a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:15.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.807+0000 7f4444ff9700 1 -- 172.21.15.80:0/1045788961 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f443c0d0150 con 0x7f44481027a0 2024-04-26T18:35:15.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.807+0000 7f44477fe700 1 --2- 172.21.15.80:0/1045788961 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f44300a3c40 0x7f44300a6100 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f444819ab70 tx=0x7f4438008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:15.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:15.810+0000 7f4444ff9700 1 -- 172.21.15.80:0/1045788961 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f443c01f020 con 0x7f44481027a0 2024-04-26T18:35:15.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:15 smithi192 ceph-mon[32842]: pgmap v363: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:15.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:15 smithi082 ceph-mon[32808]: pgmap v363: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:15.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:15 smithi080 ceph-mon[29135]: pgmap v363: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:16.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:16.053+0000 7f444e129700 1 -- 172.21.15.80:0/1045788961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f444819af60 con 0x7f44481027a0 2024-04-26T18:35:16.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:16.054+0000 7f4444ff9700 1 -- 172.21.15.80:0/1045788961 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11918 (secure 0 0 0) 0x7f443c09cb60 con 0x7f44481027a0 2024-04-26T18:35:16.055 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:35:16.055 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1967550873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1967550873},{"type":"v1","addr":"172.21.15.80:6835","nonce":1967550873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/559541830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":559541830},{"type":"v1","addr":"172.21.15.80:6837","nonce":559541830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T18:33:08.347399+0000","modified":"2024-04-26T18:33:27.036209+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24434,"mds_1":24421,"mds_2":24404,"mds_3":24400,"mds_4":24394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14577":{"gid":14577,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6839/2137993298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":2137993298},{"type":"v1","addr":"172.21.15.80:6839","nonce":2137993298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6841/1544670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1544670},{"type":"v1","addr":"172.21.15.80:6841","nonce":1544670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24371":{"gid":24371,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/3564539039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3564539039},{"type":"v1","addr":"172.21.15.82:6833","nonce":3564539039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24379":{"gid":24379,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/572065563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":572065563},{"type":"v1","addr":"172.21.15.82:6835","nonce":572065563}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.192:6835/719058020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":719058020},{"type":"v1","addr":"172.21.15.192:6835","nonce":719058020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.192:6837/2361996920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2361996920},{"type":"v1","addr":"172.21.15.192:6837","nonce":2361996920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.82:6837/2084055551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2084055551},{"type":"v1","addr":"172.21.15.82:6837","nonce":2084055551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6839/2735406056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":2735406056},{"type":"v1","addr":"172.21.15.192:6839","nonce":2735406056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.82:6839/1482576497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1482576497},{"type":"v1","addr":"172.21.15.82:6839","nonce":1482576497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24434,"qdb_cluster":[24404,24434,24394,24400,24421]},"id":1}]} 2024-04-26T18:35:16.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:16.056+0000 7f444e129700 1 -- 172.21.15.80:0/1045788961 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f44300a3c40 msgr2=0x7f44300a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:16.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:16.056+0000 7f444e129700 1 --2- 172.21.15.80:0/1045788961 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f44300a3c40 0x7f44300a6100 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f444819ab70 tx=0x7f4438008040 comp rx=0 tx=0).stop 2024-04-26T18:35:16.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:16.056+0000 7f444e129700 1 -- 172.21.15.80:0/1045788961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44481027a0 msgr2=0x7f444819fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:16.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:16.056+0000 7f444e129700 1 --2- 172.21.15.80:0/1045788961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44481027a0 0x7f444819fdb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f443c00b530 tx=0x7f443c00b8f0 comp rx=0 tx=0).stop 2024-04-26T18:35:16.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:16.056+0000 7f444e129700 1 -- 172.21.15.80:0/1045788961 shutdown_connections 2024-04-26T18:35:16.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:16.056+0000 7f444e129700 1 --2- 172.21.15.80:0/1045788961 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f44300a3c40 0x7f44300a6100 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:16.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:16.056+0000 7f444e129700 1 --2- 172.21.15.80:0/1045788961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4448108500 0x7f4448199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:16.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:16.056+0000 7f444e129700 1 --2- 172.21.15.80:0/1045788961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4448101de0 0x7f444819f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:16.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:16.056+0000 7f444e129700 1 --2- 172.21.15.80:0/1045788961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44481027a0 0x7f444819fdb0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:16.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:16.056+0000 7f444e129700 1 -- 172.21.15.80:0/1045788961 >> 172.21.15.80:0/1045788961 conn(0x7f4448077640 msgr2=0x7f4448100a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:16.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:16.056+0000 7f444e129700 1 -- 172.21.15.80:0/1045788961 shutdown_connections 2024-04-26T18:35:16.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:16.056+0000 7f444e129700 1 -- 172.21.15.80:0/1045788961 wait complete. 2024-04-26T18:35:16.058 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 26 2024-04-26T18:35:16.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:16 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1045788961' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:35:16.796 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T18:35:16.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:16 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1045788961' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:35:16.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:16 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1045788961' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:35:17.034 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:35:17.851 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:17 smithi080 ceph-mon[29135]: pgmap v364: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:35:17.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:17 smithi192 ceph-mon[32842]: pgmap v364: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:35:17.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:17 smithi082 ceph-mon[32808]: pgmap v364: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:35:18.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.693+0000 7f0f364eb700 1 -- 172.21.15.80:0/587513806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f30103e10 msgr2=0x7f0f301102a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:18.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.693+0000 7f0f364eb700 1 --2- 172.21.15.80:0/587513806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f30103e10 0x7f0f301102a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800b0a0 tx=0x7f0f2800b3b0 comp rx=0 tx=0).stop 2024-04-26T18:35:18.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.693+0000 7f0f364eb700 1 -- 172.21.15.80:0/587513806 shutdown_connections 2024-04-26T18:35:18.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.693+0000 7f0f364eb700 1 --2- 172.21.15.80:0/587513806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f30103e10 0x7f0f301102a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:18.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.693+0000 7f0f364eb700 1 --2- 172.21.15.80:0/587513806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f301083a0 0x7f0f30108780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:18.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.693+0000 7f0f364eb700 1 --2- 172.21.15.80:0/587513806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f30103470 0x7f0f301038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:18.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.693+0000 7f0f364eb700 1 -- 172.21.15.80:0/587513806 >> 172.21.15.80:0/587513806 conn(0x7f0f3007a5d0 msgr2=0x7f0f3007a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:18.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.693+0000 7f0f364eb700 1 -- 172.21.15.80:0/587513806 shutdown_connections 2024-04-26T18:35:18.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.693+0000 7f0f364eb700 1 -- 172.21.15.80:0/587513806 wait complete. 2024-04-26T18:35:18.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.693+0000 7f0f364eb700 1 Processor -- start 2024-04-26T18:35:18.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.694+0000 7f0f364eb700 1 -- start start 2024-04-26T18:35:18.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.694+0000 7f0f364eb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f30103470 0x7f0f3019f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:18.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.694+0000 7f0f364eb700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f30103e10 0x7f0f3019fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:18.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.694+0000 7f0f364eb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f301083a0 0x7f0f30199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:18.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.694+0000 7f0f364eb700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0f30113620 con 0x7f0f30103e10 2024-04-26T18:35:18.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.694+0000 7f0f364eb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0f301134a0 con 0x7f0f30103470 2024-04-26T18:35:18.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.694+0000 7f0f364eb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0f301137a0 con 0x7f0f301083a0 2024-04-26T18:35:18.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.694+0000 7f0f2f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f30103e10 0x7f0f3019fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:18.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.694+0000 7f0f2f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f30103e10 0x7f0f3019fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33484/0 (socket says 172.21.15.80:33484) 2024-04-26T18:35:18.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.694+0000 7f0f2f7fe700 1 -- 172.21.15.80:0/4077284689 learned_addr learned my addr 172.21.15.80:0/4077284689 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:18.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.694+0000 7f0f2ffff700 1 --2- 172.21.15.80:0/4077284689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f30103470 0x7f0f3019f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:18.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.694+0000 7f0f34a88700 1 --2- 172.21.15.80:0/4077284689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f301083a0 0x7f0f30199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:18.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.694+0000 7f0f2f7fe700 1 -- 172.21.15.80:0/4077284689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f301083a0 msgr2=0x7f0f30199940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:18.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.694+0000 7f0f2f7fe700 1 --2- 172.21.15.80:0/4077284689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f301083a0 0x7f0f30199940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:18.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.694+0000 7f0f2f7fe700 1 -- 172.21.15.80:0/4077284689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f30103470 msgr2=0x7f0f3019f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:18.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.694+0000 7f0f2f7fe700 1 --2- 172.21.15.80:0/4077284689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f30103470 0x7f0f3019f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:18.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.694+0000 7f0f2f7fe700 1 -- 172.21.15.80:0/4077284689 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3019a0a0 con 0x7f0f30103e10 2024-04-26T18:35:18.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.695+0000 7f0f2f7fe700 1 --2- 172.21.15.80:0/4077284689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f30103e10 0x7f0f3019fc70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400b530 tx=0x7f0f2400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:18.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.695+0000 7f0f2d7fa700 1 -- 172.21.15.80:0/4077284689 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f24015020 con 0x7f0f30103e10 2024-04-26T18:35:18.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.695+0000 7f0f364eb700 1 -- 172.21.15.80:0/4077284689 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f3019a390 con 0x7f0f30103e10 2024-04-26T18:35:18.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.695+0000 7f0f2d7fa700 1 -- 172.21.15.80:0/4077284689 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f24011ce0 con 0x7f0f30103e10 2024-04-26T18:35:18.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.695+0000 7f0f2d7fa700 1 -- 172.21.15.80:0/4077284689 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f24010e40 con 0x7f0f30103e10 2024-04-26T18:35:18.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.695+0000 7f0f364eb700 1 -- 172.21.15.80:0/4077284689 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f301a6600 con 0x7f0f30103e10 2024-04-26T18:35:18.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.696+0000 7f0f364eb700 1 -- 172.21.15.80:0/4077284689 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f3006a110 con 0x7f0f30103e10 2024-04-26T18:35:18.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.697+0000 7f0f2d7fa700 1 -- 172.21.15.80:0/4077284689 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f0f24018020 con 0x7f0f30103e10 2024-04-26T18:35:18.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.698+0000 7f0f2d7fa700 1 --2- 172.21.15.80:0/4077284689 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f0f180a3c40 0x7f0f180a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:18.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.698+0000 7f0f2ffff700 1 --2- 172.21.15.80:0/4077284689 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f0f180a3c40 0x7f0f180a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:18.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.698+0000 7f0f2d7fa700 1 -- 172.21.15.80:0/4077284689 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f0f240d01f0 con 0x7f0f30103e10 2024-04-26T18:35:18.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.698+0000 7f0f2ffff700 1 --2- 172.21.15.80:0/4077284689 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f0f180a3c40 0x7f0f180a6100 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0f30109850 tx=0x7f0f2000b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:18.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.702+0000 7f0f2d7fa700 1 -- 172.21.15.80:0/4077284689 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0f2401f020 con 0x7f0f30103e10 2024-04-26T18:35:18.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.900+0000 7f0f364eb700 1 -- 172.21.15.80:0/4077284689 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f3002e490 con 0x7f0f30103e10 2024-04-26T18:35:18.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.902+0000 7f0f2d7fa700 1 -- 172.21.15.80:0/4077284689 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+22533 (secure 0 0 0) 0x7f0f2409cc00 con 0x7f0f30103e10 2024-04-26T18:35:18.902 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:35:18.902 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":91,"fsid":"2187ca98-03fa-11ef-bc93-c7b262605968","created":"2024-04-26T18:24:58.809431+0000","modified":"2024-04-26T18:33:51.637301+0000","last_up_change":"2024-04-26T18:32:02.550187+0000","last_in_change":"2024-04-26T18:31:41.630932+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T18:28:14.502290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T18:33:02.102135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T18:33:05.300979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a01cfe6-d13a-4828-8c20-ad7fee7e87ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6803","nonce":429487384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6805","nonce":429487384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6809","nonce":429487384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6807","nonce":429487384}]},"public_addr":"172.21.15.80:6803/429487384","cluster_addr":"172.21.15.80:6805/429487384","heartbeat_back_addr":"172.21.15.80:6809/429487384","heartbeat_front_addr":"172.21.15.80:6807/429487384","state":["exists","up"]},{"osd":1,"uuid":"1f815d88-30b1-4540-b4f5-cc3d62707318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913033849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913033849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913033849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913033849}]},"public_addr":"172.21.15.82:6801/3913033849","cluster_addr":"172.21.15.82:6803/3913033849","heartbeat_back_addr":"172.21.15.82:6807/3913033849","heartbeat_front_addr":"172.21.15.82:6805/3913033849","state":["exists","up"]},{"osd":2,"uuid":"b8625dd7-4c1d-4258-ac2b-463ff96f4cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6801","nonce":503427508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6803","nonce":503427508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6807","nonce":503427508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6805","nonce":503427508}]},"public_addr":"172.21.15.192:6801/503427508","cluster_addr":"172.21.15.192:6803/503427508","heartbeat_back_addr":"172.21.15.192:6807/503427508","heartbeat_front_addr":"172.21.15.192:6805/503427508","state":["exists","up"]},{"osd":3,"uuid":"3068321a-3070-44ae-9bbd-a3faac8c21fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6811","nonce":407817066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6813","nonce":407817066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6817","nonce":407817066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6815","nonce":407817066}]},"public_addr":"172.21.15.80:6811/407817066","cluster_addr":"172.21.15.80:6813/407817066","heartbeat_back_addr":"172.21.15.80:6817/407817066","heartbeat_front_addr":"172.21.15.80:6815/407817066","state":["exists","up"]},{"osd":4,"uuid":"6b3d6455-9495-435b-8193-a260b63504ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6809","nonce":2068291934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6811","nonce":2068291934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6815","nonce":2068291934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6813","nonce":2068291934}]},"public_addr":"172.21.15.82:6809/2068291934","cluster_addr":"172.21.15.82:6811/2068291934","heartbeat_back_addr":"172.21.15.82:6815/2068291934","heartbeat_front_addr":"172.21.15.82:6813/2068291934","state":["exists","up"]},{"osd":5,"uuid":"538863f1-1486-45b5-a675-ecb1d3035599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6809","nonce":1770809727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6811","nonce":1770809727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6815","nonce":1770809727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6813","nonce":1770809727}]},"public_addr":"172.21.15.192:6809/1770809727","cluster_addr":"172.21.15.192:6811/1770809727","heartbeat_back_addr":"172.21.15.192:6815/1770809727","heartbeat_front_addr":"172.21.15.192:6813/1770809727","state":["exists","up"]},{"osd":6,"uuid":"7b4374d8-98e6-48e1-924b-c9b70a4baf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6819","nonce":145064490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6821","nonce":145064490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6825","nonce":145064490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6823","nonce":145064490}]},"public_addr":"172.21.15.80:6819/145064490","cluster_addr":"172.21.15.80:6821/145064490","heartbeat_back_addr":"172.21.15.80:6825/145064490","heartbeat_front_addr":"172.21.15.80:6823/145064490","state":["exists","up"]},{"osd":7,"uuid":"f3bb3c7d-4cce-4f49-b924-72ebbaad58ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6817","nonce":208047447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6819","nonce":208047447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6823","nonce":208047447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6821","nonce":208047447}]},"public_addr":"172.21.15.82:6817/208047447","cluster_addr":"172.21.15.82:6819/208047447","heartbeat_back_addr":"172.21.15.82:6823/208047447","heartbeat_front_addr":"172.21.15.82:6821/208047447","state":["exists","up"]},{"osd":8,"uuid":"6557b536-a516-4b01-a607-7981620fb2a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6817","nonce":3763069187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6819","nonce":3763069187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6823","nonce":3763069187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6821","nonce":3763069187}]},"public_addr":"172.21.15.192:6817/3763069187","cluster_addr":"172.21.15.192:6819/3763069187","heartbeat_back_addr":"172.21.15.192:6823/3763069187","heartbeat_front_addr":"172.21.15.192:6821/3763069187","state":["exists","up"]},{"osd":9,"uuid":"838615a7-1e68-4e81-8b3a-fba0ea75f7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6827","nonce":2109877993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6829","nonce":2109877993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6833","nonce":2109877993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6831","nonce":2109877993}]},"public_addr":"172.21.15.80:6827/2109877993","cluster_addr":"172.21.15.80:6829/2109877993","heartbeat_back_addr":"172.21.15.80:6833/2109877993","heartbeat_front_addr":"172.21.15.80:6831/2109877993","state":["exists","up"]},{"osd":10,"uuid":"cd664e50-3217-453d-9a89-6e26d717e6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6825","nonce":2877220993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6827","nonce":2877220993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6831","nonce":2877220993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6829","nonce":2877220993}]},"public_addr":"172.21.15.82:6825/2877220993","cluster_addr":"172.21.15.82:6827/2877220993","heartbeat_back_addr":"172.21.15.82:6831/2877220993","heartbeat_front_addr":"172.21.15.82:6829/2877220993","state":["exists","up"]},{"osd":11,"uuid":"e52807c6-8890-4df7-a8c6-51a7ff4b467b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6825","nonce":3466865106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6827","nonce":3466865106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6831","nonce":3466865106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6829","nonce":3466865106}]},"public_addr":"172.21.15.192:6825/3466865106","cluster_addr":"172.21.15.192:6827/3466865106","heartbeat_back_addr":"172.21.15.192:6831/3466865106","heartbeat_front_addr":"172.21.15.192:6829/3466865106","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:27:23.385471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:27:46.648232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:10.578970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:34.922048+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:59.142838+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:29:24.492250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:29:49.721803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:30:15.177027+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:30:41.544775+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:31:07.562401+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:31:33.498042+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:32:00.584085+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/1997155783":"2024-04-27T18:25:50.413207+0000","172.21.15.80:0/323607684":"2024-04-27T18:25:50.413207+0000","172.21.15.80:0/586397709":"2024-04-27T18:25:50.413207+0000","172.21.15.80:6801/4208962819":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/1353083127":"2024-04-27T18:25:24.440373+0000","172.21.15.80:6800/1997155783":"2024-04-27T18:25:50.413207+0000","172.21.15.80:6800/4208962819":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2644175019":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/1853513470":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2122929159":"2024-04-27T18:25:50.413207+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T18:35:18.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.904+0000 7f0f364eb700 1 -- 172.21.15.80:0/4077284689 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f0f180a3c40 msgr2=0x7f0f180a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:18.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.904+0000 7f0f364eb700 1 --2- 172.21.15.80:0/4077284689 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f0f180a3c40 0x7f0f180a6100 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0f30109850 tx=0x7f0f2000b410 comp rx=0 tx=0).stop 2024-04-26T18:35:18.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.904+0000 7f0f364eb700 1 -- 172.21.15.80:0/4077284689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f30103e10 msgr2=0x7f0f3019fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:18.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.904+0000 7f0f364eb700 1 --2- 172.21.15.80:0/4077284689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f30103e10 0x7f0f3019fc70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400b530 tx=0x7f0f2400b840 comp rx=0 tx=0).stop 2024-04-26T18:35:18.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.904+0000 7f0f364eb700 1 -- 172.21.15.80:0/4077284689 shutdown_connections 2024-04-26T18:35:18.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.904+0000 7f0f364eb700 1 --2- 172.21.15.80:0/4077284689 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f0f180a3c40 0x7f0f180a6100 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:18.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.904+0000 7f0f364eb700 1 --2- 172.21.15.80:0/4077284689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f301083a0 0x7f0f30199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:18.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.904+0000 7f0f364eb700 1 --2- 172.21.15.80:0/4077284689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f30103470 0x7f0f3019f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:18.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.904+0000 7f0f364eb700 1 --2- 172.21.15.80:0/4077284689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f30103e10 0x7f0f3019fc70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:18.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.904+0000 7f0f364eb700 1 -- 172.21.15.80:0/4077284689 >> 172.21.15.80:0/4077284689 conn(0x7f0f3007a5d0 msgr2=0x7f0f30101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:18.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.904+0000 7f0f364eb700 1 -- 172.21.15.80:0/4077284689 shutdown_connections 2024-04-26T18:35:18.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:18.904+0000 7f0f364eb700 1 -- 172.21.15.80:0/4077284689 wait complete. 2024-04-26T18:35:19.650 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:35:19.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:19 smithi192 ceph-mon[32842]: pgmap v365: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:19.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:19 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/4077284689' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:35:19.888 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:35:19.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:19 smithi082 ceph-mon[32808]: pgmap v365: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:19.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:19 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/4077284689' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:35:19.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:19 smithi080 ceph-mon[29135]: pgmap v365: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:19.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:19 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/4077284689' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:35:21.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.476+0000 7f3bd8b77700 1 -- 172.21.15.80:0/1856378285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bd406bb50 msgr2=0x7f3bd406bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:21.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.476+0000 7f3bd8b77700 1 --2- 172.21.15.80:0/1856378285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bd406bb50 0x7f3bd406bfb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8009990 tx=0x7f3bc8009ca0 comp rx=0 tx=0).stop 2024-04-26T18:35:21.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.476+0000 7f3bd8b77700 1 -- 172.21.15.80:0/1856378285 shutdown_connections 2024-04-26T18:35:21.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.476+0000 7f3bd8b77700 1 --2- 172.21.15.80:0/1856378285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bd406c4f0 0x7f3bd41102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:21.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.476+0000 7f3bd8b77700 1 --2- 172.21.15.80:0/1856378285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bd41094a0 0x7f3bd4109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:21.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.476+0000 7f3bd8b77700 1 --2- 172.21.15.80:0/1856378285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bd406bb50 0x7f3bd406bfb0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:21.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.476+0000 7f3bd8b77700 1 -- 172.21.15.80:0/1856378285 >> 172.21.15.80:0/1856378285 conn(0x7f3bd40792d0 msgr2=0x7f3bd40796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:21.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.476+0000 7f3bd8b77700 1 -- 172.21.15.80:0/1856378285 shutdown_connections 2024-04-26T18:35:21.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.476+0000 7f3bd8b77700 1 -- 172.21.15.80:0/1856378285 wait complete. 2024-04-26T18:35:21.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.476+0000 7f3bd8b77700 1 Processor -- start 2024-04-26T18:35:21.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.477+0000 7f3bd8b77700 1 -- start start 2024-04-26T18:35:21.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.477+0000 7f3bd8b77700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bd406bb50 0x7f3bd4102420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:21.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.477+0000 7f3bd8b77700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bd406c4f0 0x7f3bd4102960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:21.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.477+0000 7f3bd8b77700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bd41094a0 0x7f3bd4102ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:21.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.477+0000 7f3bd8b77700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd41135d0 con 0x7f3bd406c4f0 2024-04-26T18:35:21.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.477+0000 7f3bd8b77700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd4113450 con 0x7f3bd41094a0 2024-04-26T18:35:21.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.477+0000 7f3bd8b77700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd4113750 con 0x7f3bd406bb50 2024-04-26T18:35:21.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.477+0000 7f3bd1d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bd406c4f0 0x7f3bd4102960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:21.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.477+0000 7f3bd1d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bd406c4f0 0x7f3bd4102960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33504/0 (socket says 172.21.15.80:33504) 2024-04-26T18:35:21.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.477+0000 7f3bd1d9b700 1 -- 172.21.15.80:0/3381886690 learned_addr learned my addr 172.21.15.80:0/3381886690 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:21.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.477+0000 7f3bd259c700 1 --2- 172.21.15.80:0/3381886690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bd406bb50 0x7f3bd4102420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:21.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.477+0000 7f3bd2d9d700 1 --2- 172.21.15.80:0/3381886690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bd41094a0 0x7f3bd4102ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:21.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.477+0000 7f3bd1d9b700 1 -- 172.21.15.80:0/3381886690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bd406bb50 msgr2=0x7f3bd4102420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:21.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.477+0000 7f3bd1d9b700 1 --2- 172.21.15.80:0/3381886690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bd406bb50 0x7f3bd4102420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:21.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.477+0000 7f3bd1d9b700 1 -- 172.21.15.80:0/3381886690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bd41094a0 msgr2=0x7f3bd4102ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:21.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.477+0000 7f3bd1d9b700 1 --2- 172.21.15.80:0/3381886690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bd41094a0 0x7f3bd4102ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:21.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.477+0000 7f3bd1d9b700 1 -- 172.21.15.80:0/3381886690 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd41a8050 con 0x7f3bd406c4f0 2024-04-26T18:35:21.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.477+0000 7f3bd1d9b700 1 --2- 172.21.15.80:0/3381886690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bd406c4f0 0x7f3bd4102960 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80057c0 tx=0x7f3bc80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:21.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.478+0000 7f3bc37fe700 1 -- 172.21.15.80:0/3381886690 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8027070 con 0x7f3bd406c4f0 2024-04-26T18:35:21.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.478+0000 7f3bd8b77700 1 -- 172.21.15.80:0/3381886690 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd41a82e0 con 0x7f3bd406c4f0 2024-04-26T18:35:21.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.478+0000 7f3bc37fe700 1 -- 172.21.15.80:0/3381886690 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bc8003f20 con 0x7f3bd406c4f0 2024-04-26T18:35:21.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.478+0000 7f3bc37fe700 1 -- 172.21.15.80:0/3381886690 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8022b30 con 0x7f3bd406c4f0 2024-04-26T18:35:21.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.478+0000 7f3bd8b77700 1 -- 172.21.15.80:0/3381886690 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd41a8810 con 0x7f3bd406c4f0 2024-04-26T18:35:21.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.479+0000 7f3bd8b77700 1 -- 172.21.15.80:0/3381886690 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd406a110 con 0x7f3bd406c4f0 2024-04-26T18:35:21.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.480+0000 7f3bc37fe700 1 -- 172.21.15.80:0/3381886690 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f3bc802a070 con 0x7f3bd406c4f0 2024-04-26T18:35:21.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.480+0000 7f3bc37fe700 1 --2- 172.21.15.80:0/3381886690 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f3bbc0a3c40 0x7f3bbc0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:21.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.480+0000 7f3bd259c700 1 --2- 172.21.15.80:0/3381886690 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f3bbc0a3c40 0x7f3bbc0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:21.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.480+0000 7f3bc37fe700 1 -- 172.21.15.80:0/3381886690 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f3bc80d17d0 con 0x7f3bd406c4f0 2024-04-26T18:35:21.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.481+0000 7f3bd259c700 1 --2- 172.21.15.80:0/3381886690 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f3bbc0a3c40 0x7f3bbc0a6100 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4005950 tx=0x7f3bc400b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:21.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.484+0000 7f3bc37fe700 1 -- 172.21.15.80:0/3381886690 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3bc8031020 con 0x7f3bd406c4f0 2024-04-26T18:35:21.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.728+0000 7f3bd8b77700 1 -- 172.21.15.80:0/3381886690 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3bd402e490 con 0x7f3bd406c4f0 2024-04-26T18:35:21.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.729+0000 7f3bc37fe700 1 -- 172.21.15.80:0/3381886690 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11918 (secure 0 0 0) 0x7f3bc8013070 con 0x7f3bd406c4f0 2024-04-26T18:35:21.729 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:35:21.729 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1967550873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1967550873},{"type":"v1","addr":"172.21.15.80:6835","nonce":1967550873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/559541830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":559541830},{"type":"v1","addr":"172.21.15.80:6837","nonce":559541830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T18:33:08.347399+0000","modified":"2024-04-26T18:33:27.036209+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24434,"mds_1":24421,"mds_2":24404,"mds_3":24400,"mds_4":24394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14577":{"gid":14577,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6839/2137993298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":2137993298},{"type":"v1","addr":"172.21.15.80:6839","nonce":2137993298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6841/1544670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1544670},{"type":"v1","addr":"172.21.15.80:6841","nonce":1544670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24371":{"gid":24371,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/3564539039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3564539039},{"type":"v1","addr":"172.21.15.82:6833","nonce":3564539039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24379":{"gid":24379,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/572065563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":572065563},{"type":"v1","addr":"172.21.15.82:6835","nonce":572065563}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.192:6835/719058020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":719058020},{"type":"v1","addr":"172.21.15.192:6835","nonce":719058020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.192:6837/2361996920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2361996920},{"type":"v1","addr":"172.21.15.192:6837","nonce":2361996920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.82:6837/2084055551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2084055551},{"type":"v1","addr":"172.21.15.82:6837","nonce":2084055551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6839/2735406056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":2735406056},{"type":"v1","addr":"172.21.15.192:6839","nonce":2735406056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.82:6839/1482576497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1482576497},{"type":"v1","addr":"172.21.15.82:6839","nonce":1482576497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24434,"qdb_cluster":[24404,24434,24394,24400,24421]},"id":1}]} 2024-04-26T18:35:21.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.731+0000 7f3bd8b77700 1 -- 172.21.15.80:0/3381886690 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f3bbc0a3c40 msgr2=0x7f3bbc0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:21.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.731+0000 7f3bd8b77700 1 --2- 172.21.15.80:0/3381886690 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f3bbc0a3c40 0x7f3bbc0a6100 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4005950 tx=0x7f3bc400b410 comp rx=0 tx=0).stop 2024-04-26T18:35:21.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.731+0000 7f3bd8b77700 1 -- 172.21.15.80:0/3381886690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bd406c4f0 msgr2=0x7f3bd4102960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:21.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.731+0000 7f3bd8b77700 1 --2- 172.21.15.80:0/3381886690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bd406c4f0 0x7f3bd4102960 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80057c0 tx=0x7f3bc80057f0 comp rx=0 tx=0).stop 2024-04-26T18:35:21.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.731+0000 7f3bd8b77700 1 -- 172.21.15.80:0/3381886690 shutdown_connections 2024-04-26T18:35:21.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.731+0000 7f3bd8b77700 1 --2- 172.21.15.80:0/3381886690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bd41094a0 0x7f3bd4102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:21.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.731+0000 7f3bd8b77700 1 --2- 172.21.15.80:0/3381886690 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f3bbc0a3c40 0x7f3bbc0a6100 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:21.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.731+0000 7f3bd8b77700 1 --2- 172.21.15.80:0/3381886690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bd406bb50 0x7f3bd4102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:21.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.731+0000 7f3bd8b77700 1 --2- 172.21.15.80:0/3381886690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bd406c4f0 0x7f3bd4102960 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:21.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.731+0000 7f3bd8b77700 1 -- 172.21.15.80:0/3381886690 >> 172.21.15.80:0/3381886690 conn(0x7f3bd40792d0 msgr2=0x7f3bd4100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:21.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.731+0000 7f3bd8b77700 1 -- 172.21.15.80:0/3381886690 shutdown_connections 2024-04-26T18:35:21.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:21.731+0000 7f3bd8b77700 1 -- 172.21.15.80:0/3381886690 wait complete. 2024-04-26T18:35:21.732 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 26 2024-04-26T18:35:21.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:21 smithi192 ceph-mon[32842]: pgmap v366: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:21.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:21 smithi082 ceph-mon[32808]: pgmap v366: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:21.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:21 smithi080 ceph-mon[29135]: pgmap v366: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:22.450 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-26T18:33:08.347399+0000', 'modified': '2024-04-26T18:33:27.036209+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24434, 'mds_1': 24421, 'mds_2': 24404, 'mds_3': 24400, 'mds_4': 24394}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14577': {'gid': 14577, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.80:6839/2137993298', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6838', 'nonce': 2137993298}, {'type': 'v1', 'addr': '172.21.15.80:6839', 'nonce': 2137993298}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14583': {'gid': 14583, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.80:6841/1544670', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6840', 'nonce': 1544670}, {'type': 'v1', 'addr': '172.21.15.80:6841', 'nonce': 1544670}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24371': {'gid': 24371, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6833/3564539039', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6832', 'nonce': 3564539039}, {'type': 'v1', 'addr': '172.21.15.82:6833', 'nonce': 3564539039}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24379': {'gid': 24379, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.192:6833/2905926211', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6832', 'nonce': 2905926211}, {'type': 'v1', 'addr': '172.21.15.192:6833', 'nonce': 2905926211}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24392': {'gid': 24392, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6835/572065563', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6834', 'nonce': 572065563}, {'type': 'v1', 'addr': '172.21.15.82:6835', 'nonce': 572065563}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24394': {'gid': 24394, 'name': 'f', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.192:6835/719058020', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6834', 'nonce': 719058020}, {'type': 'v1', 'addr': '172.21.15.192:6835', 'nonce': 719058020}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24400': {'gid': 24400, 'name': 'c', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.192:6837/2361996920', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6836', 'nonce': 2361996920}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 2361996920}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24404': {'gid': 24404, 'name': 'h', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.82:6837/2084055551', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6836', 'nonce': 2084055551}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 2084055551}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24421': {'gid': 24421, 'name': 'i', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.192:6839/2735406056', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6838', 'nonce': 2735406056}, {'type': 'v1', 'addr': '172.21.15.192:6839', 'nonce': 2735406056}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24434': {'gid': 24434, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.82:6839/1482576497', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 1482576497}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 1482576497}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24434, 'qdb_cluster': [24404, 24434, 24394, 24400, 24421]} 2024-04-26T18:35:22.450 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-26T18:35:22.450 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell mds.f status 2024-04-26T18:35:22.697 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:35:22.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:22 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3381886690' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:35:22.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:22 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3381886690' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:35:22.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:22 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3381886690' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:35:23.860 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:23 smithi080 ceph-mon[29135]: pgmap v367: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:35:23.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:23 smithi192 ceph-mon[32842]: pgmap v367: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:35:23.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:23 smithi082 ceph-mon[32808]: pgmap v367: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:35:24.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.406+0000 7fa3eb340700 1 -- 172.21.15.80:0/3375041874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e4103ea0 msgr2=0x7fa3e41102c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:24.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.406+0000 7fa3eb340700 1 --2- 172.21.15.80:0/3375041874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e4103ea0 0x7fa3e41102c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc00b0a0 tx=0x7fa3dc00b3b0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.406+0000 7fa3eb340700 1 -- 172.21.15.80:0/3375041874 shutdown_connections 2024-04-26T18:35:24.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.406+0000 7fa3eb340700 1 --2- 172.21.15.80:0/3375041874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e4103ea0 0x7fa3e41102c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.406+0000 7fa3eb340700 1 --2- 172.21.15.80:0/3375041874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3e4109480 0x7fa3e4109860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.406+0000 7fa3eb340700 1 --2- 172.21.15.80:0/3375041874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3e41034e0 0x7fa3e4103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.406+0000 7fa3eb340700 1 -- 172.21.15.80:0/3375041874 >> 172.21.15.80:0/3375041874 conn(0x7fa3e407a5e0 msgr2=0x7fa3e407a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:24.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.406+0000 7fa3eb340700 1 -- 172.21.15.80:0/3375041874 shutdown_connections 2024-04-26T18:35:24.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.406+0000 7fa3eb340700 1 -- 172.21.15.80:0/3375041874 wait complete. 2024-04-26T18:35:24.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.407+0000 7fa3eb340700 1 Processor -- start 2024-04-26T18:35:24.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.407+0000 7fa3eb340700 1 -- start start 2024-04-26T18:35:24.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.407+0000 7fa3eb340700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3e41034e0 0x7fa3e419f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:24.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.407+0000 7fa3eb340700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3e4103ea0 0x7fa3e419fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:24.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.407+0000 7fa3eb340700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e4109480 0x7fa3e41998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:24.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.407+0000 7fa3eb340700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e41135b0 con 0x7fa3e4109480 2024-04-26T18:35:24.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.407+0000 7fa3eb340700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e4113430 con 0x7fa3e41034e0 2024-04-26T18:35:24.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.407+0000 7fa3eb340700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e4113730 con 0x7fa3e4103ea0 2024-04-26T18:35:24.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.407+0000 7fa3e98dd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e4109480 0x7fa3e41998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:24.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.407+0000 7fa3e98dd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e4109480 0x7fa3e41998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37344/0 (socket says 172.21.15.80:37344) 2024-04-26T18:35:24.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.407+0000 7fa3e98dd700 1 -- 172.21.15.80:0/2296616756 learned_addr learned my addr 172.21.15.80:0/2296616756 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:24.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.407+0000 7fa3e88db700 1 --2- 172.21.15.80:0/2296616756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3e4103ea0 0x7fa3e419fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:24.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.407+0000 7fa3e90dc700 1 --2- 172.21.15.80:0/2296616756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3e41034e0 0x7fa3e419f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:24.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.407+0000 7fa3e98dd700 1 -- 172.21.15.80:0/2296616756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3e4103ea0 msgr2=0x7fa3e419fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:24.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.407+0000 7fa3e98dd700 1 --2- 172.21.15.80:0/2296616756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3e4103ea0 0x7fa3e419fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.407+0000 7fa3e98dd700 1 -- 172.21.15.80:0/2296616756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3e41034e0 msgr2=0x7fa3e419f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:24.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.407+0000 7fa3e98dd700 1 --2- 172.21.15.80:0/2296616756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3e41034e0 0x7fa3e419f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.407+0000 7fa3e98dd700 1 -- 172.21.15.80:0/2296616756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e419a010 con 0x7fa3e4109480 2024-04-26T18:35:24.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.407+0000 7fa3e98dd700 1 --2- 172.21.15.80:0/2296616756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e4109480 0x7fa3e41998b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0062a0 tx=0x7fa3dc004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:24.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.408+0000 7fa3da7fc700 1 -- 172.21.15.80:0/2296616756 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc021070 con 0x7fa3e4109480 2024-04-26T18:35:24.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.408+0000 7fa3da7fc700 1 -- 172.21.15.80:0/2296616756 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3dc007e30 con 0x7fa3e4109480 2024-04-26T18:35:24.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.408+0000 7fa3eb340700 1 -- 172.21.15.80:0/2296616756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e419a2a0 con 0x7fa3e4109480 2024-04-26T18:35:24.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.408+0000 7fa3da7fc700 1 -- 172.21.15.80:0/2296616756 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc0046d0 con 0x7fa3e4109480 2024-04-26T18:35:24.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.408+0000 7fa3eb340700 1 -- 172.21.15.80:0/2296616756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e41a6570 con 0x7fa3e4109480 2024-04-26T18:35:24.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.410+0000 7fa3da7fc700 1 -- 172.21.15.80:0/2296616756 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fa3dc007980 con 0x7fa3e4109480 2024-04-26T18:35:24.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.410+0000 7fa3da7fc700 1 --2- 172.21.15.80:0/2296616756 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fa3d00a3c40 0x7fa3d00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:24.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.410+0000 7fa3e90dc700 1 --2- 172.21.15.80:0/2296616756 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fa3d00a3c40 0x7fa3d00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:24.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.410+0000 7fa3da7fc700 1 -- 172.21.15.80:0/2296616756 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fa3dc00f020 con 0x7fa3e4109480 2024-04-26T18:35:24.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.411+0000 7fa3e90dc700 1 --2- 172.21.15.80:0/2296616756 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fa3d00a3c40 0x7fa3d00a6100 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4108850 tx=0x7fa3d4009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:24.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.411+0000 7fa3f5bd2b80 1 Processor -- start 2024-04-26T18:35:24.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.411+0000 7fa3f5bd2b80 1 -- start start 2024-04-26T18:35:24.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.412+0000 7fa3f5bd2b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582a0d43a20 0x5582a0d43e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:24.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.412+0000 7fa3f5bd2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582a0d3dd50 0x5582a0d3e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:24.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.412+0000 7fa3f5bd2b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d3e6f0 0x5582a0d4a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:24.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.412+0000 7fa3f5bd2b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5582a0c907e0 con 0x5582a0d3e6f0 2024-04-26T18:35:24.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.412+0000 7fa3f5bd2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5582a0bf68e0 con 0x5582a0d3dd50 2024-04-26T18:35:24.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.412+0000 7fa3f5bd2b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5582a0c8c7a0 con 0x5582a0d43a20 2024-04-26T18:35:24.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.412+0000 7fa3e98dd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d3e6f0 0x5582a0d4a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.412+0000 7fa3e98dd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d3e6f0 0x5582a0d4a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37352/0 (socket says 172.21.15.80:37352) 2024-04-26T18:35:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.412+0000 7fa3e98dd700 1 -- 172.21.15.80:0/503091512 learned_addr learned my addr 172.21.15.80:0/503091512 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.412+0000 7fa3e88db700 1 --2- 172.21.15.80:0/503091512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582a0d3dd50 0x5582a0d3e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.412+0000 7fa3e90dc700 1 --2- 172.21.15.80:0/503091512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582a0d43a20 0x5582a0d43e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.412+0000 7fa3e98dd700 1 -- 172.21.15.80:0/503091512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582a0d43a20 msgr2=0x5582a0d43e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.412+0000 7fa3e98dd700 1 --2- 172.21.15.80:0/503091512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582a0d43a20 0x5582a0d43e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.412+0000 7fa3e98dd700 1 -- 172.21.15.80:0/503091512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582a0d3dd50 msgr2=0x5582a0d3e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.412+0000 7fa3e98dd700 1 --2- 172.21.15.80:0/503091512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582a0d3dd50 0x5582a0d3e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.412+0000 7fa3e98dd700 1 -- 172.21.15.80:0/503091512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582a0bdd880 con 0x5582a0d3e6f0 2024-04-26T18:35:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.412+0000 7fa3e88db700 1 --2- 172.21.15.80:0/503091512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582a0d3dd50 0x5582a0d3e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:35:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.412+0000 7fa3e90dc700 1 --2- 172.21.15.80:0/503091512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582a0d43a20 0x5582a0d43e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:35:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.412+0000 7fa3e98dd700 1 --2- 172.21.15.80:0/503091512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d3e6f0 0x5582a0d4a770 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc09d8f0 tx=0x7fa3dc003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b62085fb4c4a5b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:24.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.413+0000 7fa3cf7fe700 1 -- 172.21.15.80:0/503091512 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc09dbf0 con 0x5582a0d3e6f0 2024-04-26T18:35:24.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.413+0000 7fa3cf7fe700 1 -- 172.21.15.80:0/503091512 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3dc088040 con 0x5582a0d3e6f0 2024-04-26T18:35:24.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.413+0000 7fa3cf7fe700 1 -- 172.21.15.80:0/503091512 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc02ddd0 con 0x5582a0d3e6f0 2024-04-26T18:35:24.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.413+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/503091512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d3e6f0 msgr2=0x5582a0d4a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:24.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.413+0000 7fa3f5bd2b80 1 --2- 172.21.15.80:0/503091512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d3e6f0 0x5582a0d4a770 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc09d8f0 tx=0x7fa3dc003f90 comp rx=0 tx=0).stop 2024-04-26T18:35:24.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.413+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/503091512 shutdown_connections 2024-04-26T18:35:24.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.413+0000 7fa3f5bd2b80 1 --2- 172.21.15.80:0/503091512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d3e6f0 0x5582a0d4a770 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.413+0000 7fa3f5bd2b80 1 --2- 172.21.15.80:0/503091512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582a0d43a20 0x5582a0d43e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.413+0000 7fa3f5bd2b80 1 --2- 172.21.15.80:0/503091512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582a0d3dd50 0x5582a0d3e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.413+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/503091512 >> 172.21.15.80:0/503091512 conn(0x5582a0c6c570 msgr2=0x5582a0d38900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:24.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.413+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/503091512 shutdown_connections 2024-04-26T18:35:24.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.414+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/503091512 wait complete. 2024-04-26T18:35:24.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.414+0000 7fa3f5bd2b80 1 -- start start 2024-04-26T18:35:24.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.414+0000 7fa3f5bd2b80 1 Processor -- start 2024-04-26T18:35:24.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.414+0000 7fa3f5bd2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582a0d3dd50 0x5582a0d4a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:24.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.414+0000 7fa3f5bd2b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d3e6f0 0x5582a0d47670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:24.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.414+0000 7fa3f5bd2b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582a0d43a20 0x5582a0d47bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:24.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.414+0000 7fa3f5bd2b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5582a0d44420 con 0x5582a0d3e6f0 2024-04-26T18:35:24.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.414+0000 7fa3f5bd2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5582a0c4aa30 con 0x5582a0d3dd50 2024-04-26T18:35:24.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.414+0000 7fa3f5bd2b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5582a0d4acb0 con 0x5582a0d43a20 2024-04-26T18:35:24.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.414+0000 7fa3f5bd2b80 10 client.0 _ll_register_callbacks cb 0x5582a0c28900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:35:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.414+0000 7fa3e88db700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d3e6f0 0x5582a0d47670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.414+0000 7fa3e88db700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d3e6f0 0x5582a0d47670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37364/0 (socket says 172.21.15.80:37364) 2024-04-26T18:35:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.415+0000 7fa3e88db700 1 -- 172.21.15.80:0/3140250757 learned_addr learned my addr 172.21.15.80:0/3140250757 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.415+0000 7fa3e98dd700 1 --2- 172.21.15.80:0/3140250757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582a0d43a20 0x5582a0d47bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.415+0000 7fa3e90dc700 1 --2- 172.21.15.80:0/3140250757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582a0d3dd50 0x5582a0d4a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.415+0000 7fa3e88db700 1 -- 172.21.15.80:0/3140250757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582a0d43a20 msgr2=0x5582a0d47bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.415+0000 7fa3e88db700 1 --2- 172.21.15.80:0/3140250757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582a0d43a20 0x5582a0d47bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.415+0000 7fa3e88db700 1 -- 172.21.15.80:0/3140250757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582a0d3dd50 msgr2=0x5582a0d4a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.415+0000 7fa3e88db700 1 --2- 172.21.15.80:0/3140250757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582a0d3dd50 0x5582a0d4a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.415+0000 7fa3e88db700 1 -- 172.21.15.80:0/3140250757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582a0c4e430 con 0x5582a0d3e6f0 2024-04-26T18:35:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.415+0000 7fa3e90dc700 1 --2- 172.21.15.80:0/3140250757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582a0d3dd50 0x5582a0d4a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:35:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.415+0000 7fa3e98dd700 1 --2- 172.21.15.80:0/3140250757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582a0d43a20 0x5582a0d47bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:35:24.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.415+0000 7fa3e88db700 1 --2- 172.21.15.80:0/3140250757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d3e6f0 0x5582a0d47670 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000bb40 tx=0x7fa3e000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff82785f9fb265 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:24.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.415+0000 7fa3ccff9700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:35:24.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.415+0000 7fa3ccff9700 1 -- 172.21.15.80:0/3140250757 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e001b440 con 0x5582a0d3e6f0 2024-04-26T18:35:24.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.415+0000 7fa3ccff9700 1 -- 172.21.15.80:0/3140250757 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fa3e001b5e0 con 0x5582a0d3e6f0 2024-04-26T18:35:24.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.415+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/3140250757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3dc088040 con 0x5582a0d3e6f0 2024-04-26T18:35:24.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.415+0000 7fa3ccff9700 1 -- 172.21.15.80:0/3140250757 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa3e001b7e0 con 0x5582a0d3e6f0 2024-04-26T18:35:24.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.415+0000 7fa3f5bd2b80 10 client.14943 fetch_fsmap learned FSMap version 26 2024-04-26T18:35:24.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.415+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/3140250757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5582a0d55110 con 0x5582a0d3e6f0 2024-04-26T18:35:24.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.416+0000 7fa3ccff9700 1 -- 172.21.15.80:0/3140250757 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3dc088040 con 0x5582a0d3e6f0 2024-04-26T18:35:24.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.416+0000 7fa3ccff9700 1 -- 172.21.15.80:0/3140250757 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fa3e0019020 con 0x5582a0d3e6f0 2024-04-26T18:35:24.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.416+0000 7fa3f5bd2b80 10 client.14943 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:35:24.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.416+0000 7fa3f5bd2b80 10 client.14943 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-26T18:35:24.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.416+0000 7fa3f5bd2b80 20 client.14943 populate_metadata read hostname 'smithi080' 2024-04-26T18:35:24.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.416+0000 7fa3f5bd2b80 1 --2- 172.21.15.80:0/3140250757 >> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] conn(0x5582a0d57740 0x5582a0d58bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:24.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.416+0000 7fa3f5bd2b80 4 client.14943 mds_command: new command op to 24394 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:35:24.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.416+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/3140250757 --> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582a0c9e1c0 con 0x5582a0d57740 2024-04-26T18:35:24.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.416+0000 7fa3e90dc700 1 --2- 172.21.15.80:0/3140250757 >> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] conn(0x5582a0d57740 0x5582a0d58bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:24.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.417+0000 7fa3ccff9700 10 client.14943 ms_handle_connect on v2:172.21.15.192:6834/719058020 2024-04-26T18:35:24.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.417+0000 7fa3e90dc700 1 --2- 172.21.15.80:0/3140250757 >> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] conn(0x5582a0d57740 0x5582a0d58bb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b83402695c477922 server_cookie=a96971c4edb56ce9 in_seq=0 out_seq=0 2024-04-26T18:35:24.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.417+0000 7fa3ccff9700 1 -- 172.21.15.80:0/3140250757 <== mds.4 v2:172.21.15.192:6834/719058020 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5582a0c9e1c0 con 0x5582a0d57740 2024-04-26T18:35:24.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.417+0000 7fa3ccff9700 10 client.14943 handle_command_reply: tid=0 2024-04-26T18:35:24.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.418+0000 7fa3f5bd2b80 1 client.14943 shutdown 2024-04-26T18:35:24.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.418+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/3140250757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d3e6f0 msgr2=0x5582a0d47670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:24.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.418+0000 7fa3f5bd2b80 1 --2- 172.21.15.80:0/3140250757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d3e6f0 0x5582a0d47670 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000bb40 tx=0x7fa3e000be50 comp rx=0 tx=0).stop 2024-04-26T18:35:24.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.418+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/3140250757 shutdown_connections 2024-04-26T18:35:24.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.418+0000 7fa3f5bd2b80 1 --2- 172.21.15.80:0/3140250757 >> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] conn(0x5582a0d57740 0x5582a0d58bb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.418+0000 7fa3f5bd2b80 1 --2- 172.21.15.80:0/3140250757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582a0d43a20 0x5582a0d47bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.418+0000 7fa3f5bd2b80 1 --2- 172.21.15.80:0/3140250757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582a0d3dd50 0x5582a0d4a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.418+0000 7fa3f5bd2b80 1 --2- 172.21.15.80:0/3140250757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d3e6f0 0x5582a0d47670 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.418+0000 7fa3ccff9700 0 client.14943 ms_handle_reset on v2:172.21.15.192:6834/719058020 2024-04-26T18:35:24.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.418+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/3140250757 >> 172.21.15.80:0/3140250757 conn(0x5582a0c6c570 msgr2=0x5582a0d3cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:24.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.418+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/3140250757 shutdown_connections 2024-04-26T18:35:24.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.418+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/3140250757 wait complete. 2024-04-26T18:35:24.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.418+0000 7fa3f5bd2b80 20 client.14943 trim_cache size 0 max 16384 2024-04-26T18:35:24.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.438+0000 7fa3f5bd2b80 1 Processor -- start 2024-04-26T18:35:24.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.438+0000 7fa3f5bd2b80 1 -- start start 2024-04-26T18:35:24.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.438+0000 7fa3f5bd2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582a0d3dd50 0x5582a0d62400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:24.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.438+0000 7fa3f5bd2b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582a0d3e6f0 0x5582a0d3cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:24.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.438+0000 7fa3f5bd2b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d43a20 0x5582a0d3d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:24.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.438+0000 7fa3f5bd2b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5582a0d56ef0 con 0x5582a0d43a20 2024-04-26T18:35:24.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.438+0000 7fa3f5bd2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5582a0d575c0 con 0x5582a0d3dd50 2024-04-26T18:35:24.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.438+0000 7fa3f5bd2b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5582a0d57c90 con 0x5582a0d3e6f0 2024-04-26T18:35:24.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.438+0000 7fa3e98dd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d43a20 0x5582a0d3d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:24.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.439+0000 7fa3e98dd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d43a20 0x5582a0d3d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37366/0 (socket says 172.21.15.80:37366) 2024-04-26T18:35:24.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.439+0000 7fa3e98dd700 1 -- 172.21.15.80:0/4137120468 learned_addr learned my addr 172.21.15.80:0/4137120468 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:24.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.439+0000 7fa3e88db700 1 --2- 172.21.15.80:0/4137120468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582a0d3e6f0 0x5582a0d3cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:24.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.439+0000 7fa3e90dc700 1 --2- 172.21.15.80:0/4137120468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582a0d3dd50 0x5582a0d62400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:24.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.439+0000 7fa3e98dd700 1 -- 172.21.15.80:0/4137120468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582a0d3e6f0 msgr2=0x5582a0d3cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:24.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.439+0000 7fa3e98dd700 1 --2- 172.21.15.80:0/4137120468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582a0d3e6f0 0x5582a0d3cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.439+0000 7fa3e98dd700 1 -- 172.21.15.80:0/4137120468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582a0d3dd50 msgr2=0x5582a0d62400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:24.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.439+0000 7fa3e98dd700 1 --2- 172.21.15.80:0/4137120468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582a0d3dd50 0x5582a0d62400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.439+0000 7fa3e98dd700 1 -- 172.21.15.80:0/4137120468 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582a0d3e4f0 con 0x5582a0d43a20 2024-04-26T18:35:24.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.439+0000 7fa3e88db700 1 --2- 172.21.15.80:0/4137120468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582a0d3e6f0 0x5582a0d3cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:35:24.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.439+0000 7fa3e98dd700 1 --2- 172.21.15.80:0/4137120468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d43a20 0x5582a0d3d280 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009e60 tx=0x7fa3dc004120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee6c13563949817 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:24.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.439+0000 7fa3ceffd700 1 -- 172.21.15.80:0/4137120468 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc0a67d0 con 0x5582a0d43a20 2024-04-26T18:35:24.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.439+0000 7fa3ceffd700 1 -- 172.21.15.80:0/4137120468 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3dc088040 con 0x5582a0d43a20 2024-04-26T18:35:24.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.439+0000 7fa3ceffd700 1 -- 172.21.15.80:0/4137120468 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc0074e0 con 0x5582a0d43a20 2024-04-26T18:35:24.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.440+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/4137120468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d43a20 msgr2=0x5582a0d3d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:24.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.440+0000 7fa3f5bd2b80 1 --2- 172.21.15.80:0/4137120468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d43a20 0x5582a0d3d280 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009e60 tx=0x7fa3dc004120 comp rx=0 tx=0).stop 2024-04-26T18:35:24.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.440+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/4137120468 shutdown_connections 2024-04-26T18:35:24.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.440+0000 7fa3f5bd2b80 1 --2- 172.21.15.80:0/4137120468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d43a20 0x5582a0d3d280 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.440+0000 7fa3f5bd2b80 1 --2- 172.21.15.80:0/4137120468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582a0d3dd50 0x5582a0d62400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.440+0000 7fa3f5bd2b80 1 --2- 172.21.15.80:0/4137120468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582a0d3e6f0 0x5582a0d3cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.440+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/4137120468 >> 172.21.15.80:0/4137120468 conn(0x5582a0c6c570 msgr2=0x5582a0d45f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:24.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.440+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/4137120468 shutdown_connections 2024-04-26T18:35:24.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.440+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/4137120468 wait complete. 2024-04-26T18:35:24.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.440+0000 7fa3f5bd2b80 1 -- start start 2024-04-26T18:35:24.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.440+0000 7fa3f5bd2b80 1 Processor -- start 2024-04-26T18:35:24.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.441+0000 7fa3f5bd2b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d3dd50 0x5582a0d405d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:24.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.441+0000 7fa3f5bd2b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582a0d3e6f0 0x5582a0d40b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:24.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.441+0000 7fa3f5bd2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582a0d43a20 0x5582a0d3f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:24.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.441+0000 7fa3f5bd2b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5582a0d58a30 con 0x5582a0d3dd50 2024-04-26T18:35:24.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.441+0000 7fa3f5bd2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5582a0d58360 con 0x5582a0d43a20 2024-04-26T18:35:24.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.441+0000 7fa3f5bd2b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5582a0d59100 con 0x5582a0d3e6f0 2024-04-26T18:35:24.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.441+0000 7fa3f5bd2b80 10 client.0 _ll_register_callbacks cb 0x5582a0c28900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:35:24.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.441+0000 7fa3e90dc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d3dd50 0x5582a0d405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:24.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.441+0000 7fa3e90dc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d3dd50 0x5582a0d405d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37368/0 (socket says 172.21.15.80:37368) 2024-04-26T18:35:24.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.441+0000 7fa3e90dc700 1 -- 172.21.15.80:0/2395609905 learned_addr learned my addr 172.21.15.80:0/2395609905 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:24.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.441+0000 7fa3e88db700 1 --2- 172.21.15.80:0/2395609905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582a0d3e6f0 0x5582a0d40b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:24.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.441+0000 7fa3e98dd700 1 --2- 172.21.15.80:0/2395609905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582a0d43a20 0x5582a0d3f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:24.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.441+0000 7fa3e90dc700 1 -- 172.21.15.80:0/2395609905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582a0d3e6f0 msgr2=0x5582a0d40b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:24.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.441+0000 7fa3e90dc700 1 --2- 172.21.15.80:0/2395609905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582a0d3e6f0 0x5582a0d40b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.441+0000 7fa3e90dc700 1 -- 172.21.15.80:0/2395609905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582a0d43a20 msgr2=0x5582a0d3f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:24.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.441+0000 7fa3e90dc700 1 --2- 172.21.15.80:0/2395609905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582a0d43a20 0x5582a0d3f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.441+0000 7fa3e90dc700 1 -- 172.21.15.80:0/2395609905 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582a0d3fb20 con 0x5582a0d3dd50 2024-04-26T18:35:24.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.441+0000 7fa3e88db700 1 --2- 172.21.15.80:0/2395609905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582a0d3e6f0 0x5582a0d40b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:35:24.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.441+0000 7fa3e98dd700 1 --2- 172.21.15.80:0/2395609905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582a0d43a20 0x5582a0d3f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:35:24.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.441+0000 7fa3e90dc700 1 --2- 172.21.15.80:0/2395609905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d3dd50 0x5582a0d405d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x5582a0d59410 tx=0x7fa3d40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3996255c7abe8cf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:24.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.441+0000 7fa3ccff9700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:35:24.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.441+0000 7fa3ccff9700 1 -- 172.21.15.80:0/2395609905 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d401ed60 con 0x5582a0d3dd50 2024-04-26T18:35:24.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.441+0000 7fa3ccff9700 1 -- 172.21.15.80:0/2395609905 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fa3d4027b50 con 0x5582a0d3dd50 2024-04-26T18:35:24.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.441+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/2395609905 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3dc088040 con 0x5582a0d3dd50 2024-04-26T18:35:24.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.442+0000 7fa3ccff9700 1 -- 172.21.15.80:0/2395609905 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa3d4027d50 con 0x5582a0d3dd50 2024-04-26T18:35:24.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.442+0000 7fa3f5bd2b80 10 client.14949 fetch_fsmap learned FSMap version 26 2024-04-26T18:35:24.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.442+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/2395609905 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5582a0dc3340 con 0x5582a0d3dd50 2024-04-26T18:35:24.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.442+0000 7fa3ccff9700 1 -- 172.21.15.80:0/2395609905 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3dc088040 con 0x5582a0d3dd50 2024-04-26T18:35:24.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.442+0000 7fa3ccff9700 1 -- 172.21.15.80:0/2395609905 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fa3d4003680 con 0x5582a0d3dd50 2024-04-26T18:35:24.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.442+0000 7fa3f5bd2b80 10 client.14949 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:35:24.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.442+0000 7fa3f5bd2b80 10 client.14949 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-26T18:35:24.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.442+0000 7fa3f5bd2b80 20 client.14949 populate_metadata read hostname 'smithi080' 2024-04-26T18:35:24.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.442+0000 7fa3f5bd2b80 1 --2- 172.21.15.80:0/2395609905 >> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] conn(0x5582a0dc7fb0 0x5582a0dc6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:24.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.442+0000 7fa3f5bd2b80 4 client.14949 mds_command: new command op to 24394 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T18:35:24.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.442+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/2395609905 --> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] -- command(tid 0: {"prefix": "status"}) -- 0x5582a0c98260 con 0x5582a0dc7fb0 2024-04-26T18:35:24.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.442+0000 7fa3e88db700 1 --2- 172.21.15.80:0/2395609905 >> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] conn(0x5582a0dc7fb0 0x5582a0dc6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:24.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.443+0000 7fa3ccff9700 10 client.14949 ms_handle_connect on v2:172.21.15.192:6834/719058020 2024-04-26T18:35:24.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.443+0000 7fa3e88db700 1 --2- 172.21.15.80:0/2395609905 >> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] conn(0x5582a0dc7fb0 0x5582a0dc6cc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6bd47b4f66870a55 server_cookie=a985ae38e8ce428e in_seq=0 out_seq=0 2024-04-26T18:35:24.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.443+0000 7fa3ccff9700 1 -- 172.21.15.80:0/2395609905 <== mds.4 v2:172.21.15.192:6834/719058020 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5582a0c98260 con 0x5582a0dc7fb0 2024-04-26T18:35:24.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.443+0000 7fa3ccff9700 10 client.14949 handle_command_reply: tid=0 2024-04-26T18:35:24.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.443+0000 7fa3f5bd2b80 1 client.14949 shutdown 2024-04-26T18:35:24.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.443+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/2395609905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d3dd50 msgr2=0x5582a0d405d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:24.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.443+0000 7fa3f5bd2b80 1 --2- 172.21.15.80:0/2395609905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d3dd50 0x5582a0d405d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x5582a0d59410 tx=0x7fa3d40047c0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.443+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/2395609905 shutdown_connections 2024-04-26T18:35:24.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.443+0000 7fa3f5bd2b80 1 --2- 172.21.15.80:0/2395609905 >> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] conn(0x5582a0dc7fb0 0x5582a0dc6cc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.443+0000 7fa3f5bd2b80 1 --2- 172.21.15.80:0/2395609905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582a0d43a20 0x5582a0d3f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.443+0000 7fa3f5bd2b80 1 --2- 172.21.15.80:0/2395609905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5582a0d3dd50 0x5582a0d405d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.443+0000 7fa3f5bd2b80 1 --2- 172.21.15.80:0/2395609905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582a0d3e6f0 0x5582a0d40b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.443+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/2395609905 >> 172.21.15.80:0/2395609905 conn(0x5582a0c6c570 msgr2=0x5582a0d3cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:24.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.443+0000 7fa3ccff9700 0 client.14949 ms_handle_reset on v2:172.21.15.192:6834/719058020 2024-04-26T18:35:24.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.443+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/2395609905 shutdown_connections 2024-04-26T18:35:24.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.443+0000 7fa3f5bd2b80 1 -- 172.21.15.80:0/2395609905 wait complete. 2024-04-26T18:35:24.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.443+0000 7fa3f5bd2b80 20 client.14949 trim_cache size 0 max 16384 2024-04-26T18:35:24.451 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:35:24.451 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "2187ca98-03fa-11ef-bc93-c7b262605968", 2024-04-26T18:35:24.451 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 4, 2024-04-26T18:35:24.451 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24394, 2024-04-26T18:35:24.451 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-26T18:35:24.451 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-26T18:35:24.451 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-26T18:35:24.452 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 120.779342469, 2024-04-26T18:35:24.452 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 26, 2024-04-26T18:35:24.452 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 91, 2024-04-26T18:35:24.452 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T18:35:24.452 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 171.79928001799999 2024-04-26T18:35:24.452 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:35:24.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.444+0000 7fa3eb340700 1 -- 172.21.15.80:0/2296616756 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fa3d00a3c40 msgr2=0x7fa3d00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:24.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.444+0000 7fa3eb340700 1 --2- 172.21.15.80:0/2296616756 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fa3d00a3c40 0x7fa3d00a6100 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4108850 tx=0x7fa3d4009260 comp rx=0 tx=0).stop 2024-04-26T18:35:24.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.444+0000 7fa3eb340700 1 -- 172.21.15.80:0/2296616756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e4109480 msgr2=0x7fa3e41998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:24.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.444+0000 7fa3eb340700 1 --2- 172.21.15.80:0/2296616756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e4109480 0x7fa3e41998b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0062a0 tx=0x7fa3dc004c80 comp rx=0 tx=0).stop 2024-04-26T18:35:24.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.444+0000 7fa3eb340700 1 -- 172.21.15.80:0/2296616756 shutdown_connections 2024-04-26T18:35:24.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.444+0000 7fa3eb340700 1 --2- 172.21.15.80:0/2296616756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e4109480 0x7fa3e41998b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.444+0000 7fa3eb340700 1 --2- 172.21.15.80:0/2296616756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3e41034e0 0x7fa3e419f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.444+0000 7fa3eb340700 1 --2- 172.21.15.80:0/2296616756 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fa3d00a3c40 0x7fa3d00a6100 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.444+0000 7fa3eb340700 1 --2- 172.21.15.80:0/2296616756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3e4103ea0 0x7fa3e419fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:24.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.444+0000 7fa3eb340700 1 -- 172.21.15.80:0/2296616756 >> 172.21.15.80:0/2296616756 conn(0x7fa3e407a5e0 msgr2=0x7fa3e4101530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:24.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.444+0000 7fa3eb340700 1 -- 172.21.15.80:0/2296616756 shutdown_connections 2024-04-26T18:35:24.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:24.444+0000 7fa3eb340700 1 -- 172.21.15.80:0/2296616756 wait complete. 2024-04-26T18:35:25.086 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell mds.c status 2024-04-26T18:35:25.322 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:35:25.713 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:25 smithi080 ceph-mon[29135]: pgmap v368: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:25.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:25 smithi192 ceph-mon[32842]: pgmap v368: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:25.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:25 smithi082 ceph-mon[32808]: pgmap v368: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:27.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.098+0000 7f4263d5e700 1 -- 172.21.15.80:0/2759653409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f425c107350 msgr2=0x7f425c107730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:27.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.098+0000 7f4263d5e700 1 --2- 172.21.15.80:0/2759653409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f425c107350 0x7f425c107730 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4258009990 tx=0x7f4258009ca0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.098+0000 7f4263d5e700 1 -- 172.21.15.80:0/2759653409 shutdown_connections 2024-04-26T18:35:27.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.098+0000 7f4263d5e700 1 --2- 172.21.15.80:0/2759653409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f425c103440 0x7f425c10f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.098+0000 7f4263d5e700 1 --2- 172.21.15.80:0/2759653409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f425c107350 0x7f425c107730 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.098+0000 7f4263d5e700 1 --2- 172.21.15.80:0/2759653409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f425c102a80 0x7f425c102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.098+0000 7f4263d5e700 1 -- 172.21.15.80:0/2759653409 >> 172.21.15.80:0/2759653409 conn(0x7f425c078920 msgr2=0x7f425c0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:27.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.098+0000 7f4263d5e700 1 -- 172.21.15.80:0/2759653409 shutdown_connections 2024-04-26T18:35:27.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.098+0000 7f4263d5e700 1 -- 172.21.15.80:0/2759653409 wait complete. 2024-04-26T18:35:27.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.099+0000 7f4263d5e700 1 Processor -- start 2024-04-26T18:35:27.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.099+0000 7f4263d5e700 1 -- start start 2024-04-26T18:35:27.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.099+0000 7f4263d5e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f425c102a80 0x7f425c19f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:27.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.099+0000 7f4263d5e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f425c103440 0x7f425c19fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:27.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.099+0000 7f4263d5e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f425c107350 0x7f425c1998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:27.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.099+0000 7f4263d5e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f425c112570 con 0x7f425c102a80 2024-04-26T18:35:27.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.099+0000 7f4263d5e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f425c1123f0 con 0x7f425c103440 2024-04-26T18:35:27.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.099+0000 7f4263d5e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f425c1126f0 con 0x7f425c107350 2024-04-26T18:35:27.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.099+0000 7f4261afa700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f425c102a80 0x7f425c19f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:27.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.099+0000 7f4261afa700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f425c102a80 0x7f425c19f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37380/0 (socket says 172.21.15.80:37380) 2024-04-26T18:35:27.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.099+0000 7f4261afa700 1 -- 172.21.15.80:0/4171289994 learned_addr learned my addr 172.21.15.80:0/4171289994 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:27.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.099+0000 7f42612f9700 1 --2- 172.21.15.80:0/4171289994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f425c103440 0x7f425c19fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:27.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.099+0000 7f42622fb700 1 --2- 172.21.15.80:0/4171289994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f425c107350 0x7f425c1998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:27.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.099+0000 7f4261afa700 1 -- 172.21.15.80:0/4171289994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f425c107350 msgr2=0x7f425c1998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:27.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.099+0000 7f4261afa700 1 --2- 172.21.15.80:0/4171289994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f425c107350 0x7f425c1998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.099+0000 7f4261afa700 1 -- 172.21.15.80:0/4171289994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f425c103440 msgr2=0x7f425c19fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:27.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.099+0000 7f4261afa700 1 --2- 172.21.15.80:0/4171289994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f425c103440 0x7f425c19fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.099+0000 7f4261afa700 1 -- 172.21.15.80:0/4171289994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f425c19a050 con 0x7f425c102a80 2024-04-26T18:35:27.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.100+0000 7f4261afa700 1 --2- 172.21.15.80:0/4171289994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f425c102a80 0x7f425c19f730 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4258000c00 tx=0x7f42580047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:27.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.100+0000 7f4252ffd700 1 -- 172.21.15.80:0/4171289994 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4258027070 con 0x7f425c102a80 2024-04-26T18:35:27.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.100+0000 7f4252ffd700 1 -- 172.21.15.80:0/4171289994 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42580041d0 con 0x7f425c102a80 2024-04-26T18:35:27.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.100+0000 7f4263d5e700 1 -- 172.21.15.80:0/4171289994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f425c19a2e0 con 0x7f425c102a80 2024-04-26T18:35:27.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.100+0000 7f4252ffd700 1 -- 172.21.15.80:0/4171289994 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425800f460 con 0x7f425c102a80 2024-04-26T18:35:27.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.100+0000 7f4263d5e700 1 -- 172.21.15.80:0/4171289994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f425c0fdc90 con 0x7f425c102a80 2024-04-26T18:35:27.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.102+0000 7f4252ffd700 1 -- 172.21.15.80:0/4171289994 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f425802a070 con 0x7f425c102a80 2024-04-26T18:35:27.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.102+0000 7f4252ffd700 1 --2- 172.21.15.80:0/4171289994 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f42480a3cc0 0x7f42480a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:27.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.103+0000 7f42612f9700 1 --2- 172.21.15.80:0/4171289994 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f42480a3cc0 0x7f42480a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:27.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.103+0000 7f4252ffd700 1 -- 172.21.15.80:0/4171289994 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f42580d1330 con 0x7f425c102a80 2024-04-26T18:35:27.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.103+0000 7f42612f9700 1 --2- 172.21.15.80:0/4171289994 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f42480a3cc0 0x7f42480a6180 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f424c005ea0 tx=0x7f424c005e30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:27.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.103+0000 7f426e5f0b80 1 Processor -- start 2024-04-26T18:35:27.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.104+0000 7f426e5f0b80 1 -- start start 2024-04-26T18:35:27.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.104+0000 7f426e5f0b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614833f2ad0 0x5614833f2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:27.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.104+0000 7f426e5f0b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f33f0 0x5614833eccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:27.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.104+0000 7f426e5f0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614833ed2d0 0x5614833ed710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:27.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.104+0000 7f426e5f0b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56148333f6f0 con 0x5614833f33f0 2024-04-26T18:35:27.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.104+0000 7f426e5f0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5614832de590 con 0x5614833ed2d0 2024-04-26T18:35:27.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.104+0000 7f426e5f0b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56148333b6b0 con 0x5614833f2ad0 2024-04-26T18:35:27.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.104+0000 7f42612f9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f33f0 0x5614833eccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:27.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.104+0000 7f42612f9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f33f0 0x5614833eccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37392/0 (socket says 172.21.15.80:37392) 2024-04-26T18:35:27.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.104+0000 7f42612f9700 1 -- 172.21.15.80:0/3149401112 learned_addr learned my addr 172.21.15.80:0/3149401112 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:27.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.104+0000 7f42622fb700 1 --2- 172.21.15.80:0/3149401112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614833ed2d0 0x5614833ed710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:27.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.104+0000 7f4261afa700 1 --2- 172.21.15.80:0/3149401112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614833f2ad0 0x5614833f2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:27.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.104+0000 7f42612f9700 1 -- 172.21.15.80:0/3149401112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614833f2ad0 msgr2=0x5614833f2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:27.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.104+0000 7f42612f9700 1 --2- 172.21.15.80:0/3149401112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614833f2ad0 0x5614833f2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.104+0000 7f42612f9700 1 -- 172.21.15.80:0/3149401112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614833ed2d0 msgr2=0x5614833ed710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:27.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.104+0000 7f42612f9700 1 --2- 172.21.15.80:0/3149401112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614833ed2d0 0x5614833ed710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.104+0000 7f42612f9700 1 -- 172.21.15.80:0/3149401112 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56148328c880 con 0x5614833f33f0 2024-04-26T18:35:27.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.104+0000 7f4261afa700 1 --2- 172.21.15.80:0/3149401112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614833f2ad0 0x5614833f2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:35:27.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.104+0000 7f42622fb700 1 --2- 172.21.15.80:0/3149401112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614833ed2d0 0x5614833ed710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:35:27.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.104+0000 7f42612f9700 1 --2- 172.21.15.80:0/3149401112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f33f0 0x5614833eccb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f424c00a520 tx=0x7f424c00af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ed93712723954 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:27.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.105+0000 7f4247fff700 1 -- 172.21.15.80:0/3149401112 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c021070 con 0x5614833f33f0 2024-04-26T18:35:27.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.105+0000 7f4247fff700 1 -- 172.21.15.80:0/3149401112 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f424c010d80 con 0x5614833f33f0 2024-04-26T18:35:27.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.105+0000 7f4247fff700 1 -- 172.21.15.80:0/3149401112 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c00f7c0 con 0x5614833f33f0 2024-04-26T18:35:27.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.105+0000 7f426e5f0b80 1 -- 172.21.15.80:0/3149401112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f33f0 msgr2=0x5614833eccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:27.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.105+0000 7f426e5f0b80 1 --2- 172.21.15.80:0/3149401112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f33f0 0x5614833eccb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f424c00a520 tx=0x7f424c00af90 comp rx=0 tx=0).stop 2024-04-26T18:35:27.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.105+0000 7f426e5f0b80 1 -- 172.21.15.80:0/3149401112 shutdown_connections 2024-04-26T18:35:27.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.105+0000 7f426e5f0b80 1 --2- 172.21.15.80:0/3149401112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614833ed2d0 0x5614833ed710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.105+0000 7f426e5f0b80 1 --2- 172.21.15.80:0/3149401112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614833f2ad0 0x5614833f2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.105+0000 7f426e5f0b80 1 --2- 172.21.15.80:0/3149401112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f33f0 0x5614833eccb0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.105+0000 7f426e5f0b80 1 -- 172.21.15.80:0/3149401112 >> 172.21.15.80:0/3149401112 conn(0x561483319cf0 msgr2=0x5614833e81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:27.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.106+0000 7f426e5f0b80 1 -- 172.21.15.80:0/3149401112 shutdown_connections 2024-04-26T18:35:27.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.106+0000 7f426e5f0b80 1 -- 172.21.15.80:0/3149401112 wait complete. 2024-04-26T18:35:27.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.106+0000 7f426e5f0b80 1 -- start start 2024-04-26T18:35:27.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.106+0000 7f426e5f0b80 1 Processor -- start 2024-04-26T18:35:27.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.106+0000 7f426e5f0b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614833ed2d0 0x5614833f9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:27.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.106+0000 7f426e5f0b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f2ad0 0x5614833f6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:27.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.106+0000 7f426e5f0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614833f33f0 0x5614833f6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:27.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.106+0000 7f426e5f0b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5614833f9f10 con 0x5614833f2ad0 2024-04-26T18:35:27.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.106+0000 7f426e5f0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5614832a5900 con 0x5614833f33f0 2024-04-26T18:35:27.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.106+0000 7f426e5f0b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5614833fa090 con 0x5614833ed2d0 2024-04-26T18:35:27.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.106+0000 7f426e5f0b80 10 client.0 _ll_register_callbacks cb 0x5614832d3530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:35:27.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.106+0000 7f42612f9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f2ad0 0x5614833f6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:27.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.106+0000 7f42612f9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f2ad0 0x5614833f6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37396/0 (socket says 172.21.15.80:37396) 2024-04-26T18:35:27.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.106+0000 7f42612f9700 1 -- 172.21.15.80:0/3575385624 learned_addr learned my addr 172.21.15.80:0/3575385624 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:27.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.106+0000 7f4261afa700 1 --2- 172.21.15.80:0/3575385624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614833ed2d0 0x5614833f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:27.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.107+0000 7f42622fb700 1 --2- 172.21.15.80:0/3575385624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614833f33f0 0x5614833f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:27.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.107+0000 7f42612f9700 1 -- 172.21.15.80:0/3575385624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614833ed2d0 msgr2=0x5614833f9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:27.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.107+0000 7f42612f9700 1 --2- 172.21.15.80:0/3575385624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614833ed2d0 0x5614833f9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.107+0000 7f42612f9700 1 -- 172.21.15.80:0/3575385624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614833f33f0 msgr2=0x5614833f6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:27.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.107+0000 7f42612f9700 1 --2- 172.21.15.80:0/3575385624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614833f33f0 0x5614833f6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.107+0000 7f42612f9700 1 -- 172.21.15.80:0/3575385624 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614833f6fd0 con 0x5614833f2ad0 2024-04-26T18:35:27.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.107+0000 7f42612f9700 1 --2- 172.21.15.80:0/3575385624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f2ad0 0x5614833f6450 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f424c01d990 tx=0x7f424c01d9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd342bc303881ae server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:27.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.107+0000 7f42457fa700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:35:27.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.107+0000 7f42457fa700 1 -- 172.21.15.80:0/3575385624 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c035060 con 0x5614833f2ad0 2024-04-26T18:35:27.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.107+0000 7f426e5f0b80 1 -- 172.21.15.80:0/3575385624 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f424c010d80 con 0x5614833f2ad0 2024-04-26T18:35:27.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.107+0000 7f42457fa700 1 -- 172.21.15.80:0/3575385624 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f424c010b80 con 0x5614833f2ad0 2024-04-26T18:35:27.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.107+0000 7f42457fa700 1 -- 172.21.15.80:0/3575385624 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f424c021050 con 0x5614833f2ad0 2024-04-26T18:35:27.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.107+0000 7f426e5f0b80 10 client.14961 fetch_fsmap learned FSMap version 26 2024-04-26T18:35:27.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.107+0000 7f426e5f0b80 1 -- 172.21.15.80:0/3575385624 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561483404870 con 0x5614833f2ad0 2024-04-26T18:35:27.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.107+0000 7f42457fa700 1 -- 172.21.15.80:0/3575385624 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f424c010d80 con 0x5614833f2ad0 2024-04-26T18:35:27.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.108+0000 7f42457fa700 1 -- 172.21.15.80:0/3575385624 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f424c0266f0 con 0x5614833f2ad0 2024-04-26T18:35:27.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.108+0000 7f426e5f0b80 10 client.14961 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:35:27.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.108+0000 7f426e5f0b80 10 client.14961 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T18:35:27.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.108+0000 7f426e5f0b80 20 client.14961 populate_metadata read hostname 'smithi080' 2024-04-26T18:35:27.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.108+0000 7f426e5f0b80 1 --2- 172.21.15.80:0/3575385624 >> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] conn(0x561483406a50 0x561483407ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:27.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.108+0000 7f426e5f0b80 4 client.14961 mds_command: new command op to 24400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:35:27.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.108+0000 7f426e5f0b80 1 -- 172.21.15.80:0/3575385624 --> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56148334d0d0 con 0x561483406a50 2024-04-26T18:35:27.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.108+0000 7f4261afa700 1 --2- 172.21.15.80:0/3575385624 >> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] conn(0x561483406a50 0x561483407ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:27.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.108+0000 7f42457fa700 10 client.14961 ms_handle_connect on v2:172.21.15.192:6836/2361996920 2024-04-26T18:35:27.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.108+0000 7f4261afa700 1 --2- 172.21.15.80:0/3575385624 >> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] conn(0x561483406a50 0x561483407ec0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e2a8541727b3ce47 server_cookie=6d1723f460183a52 in_seq=0 out_seq=0 2024-04-26T18:35:27.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.109+0000 7f42457fa700 1 -- 172.21.15.80:0/3575385624 <== mds.3 v2:172.21.15.192:6836/2361996920 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56148334d0d0 con 0x561483406a50 2024-04-26T18:35:27.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.109+0000 7f42457fa700 10 client.14961 handle_command_reply: tid=0 2024-04-26T18:35:27.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.109+0000 7f426e5f0b80 1 client.14961 shutdown 2024-04-26T18:35:27.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.109+0000 7f426e5f0b80 1 -- 172.21.15.80:0/3575385624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f2ad0 msgr2=0x5614833f6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:27.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.109+0000 7f426e5f0b80 1 --2- 172.21.15.80:0/3575385624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f2ad0 0x5614833f6450 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f424c01d990 tx=0x7f424c01d9c0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.109+0000 7f426e5f0b80 1 -- 172.21.15.80:0/3575385624 shutdown_connections 2024-04-26T18:35:27.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.109+0000 7f426e5f0b80 1 --2- 172.21.15.80:0/3575385624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614833f33f0 0x5614833f6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.109+0000 7f426e5f0b80 1 --2- 172.21.15.80:0/3575385624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614833ed2d0 0x5614833f9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.109+0000 7f426e5f0b80 1 --2- 172.21.15.80:0/3575385624 >> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] conn(0x561483406a50 0x561483407ec0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.110+0000 7f426e5f0b80 1 --2- 172.21.15.80:0/3575385624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f2ad0 0x5614833f6450 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.110+0000 7f42457fa700 0 client.14961 ms_handle_reset on v2:172.21.15.192:6836/2361996920 2024-04-26T18:35:27.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.110+0000 7f426e5f0b80 1 -- 172.21.15.80:0/3575385624 >> 172.21.15.80:0/3575385624 conn(0x561483319cf0 msgr2=0x5614833e7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:27.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.110+0000 7f426e5f0b80 1 -- 172.21.15.80:0/3575385624 shutdown_connections 2024-04-26T18:35:27.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.110+0000 7f426e5f0b80 1 -- 172.21.15.80:0/3575385624 wait complete. 2024-04-26T18:35:27.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.110+0000 7f426e5f0b80 20 client.14961 trim_cache size 0 max 16384 2024-04-26T18:35:27.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.130+0000 7f426e5f0b80 1 Processor -- start 2024-04-26T18:35:27.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.130+0000 7f426e5f0b80 1 -- start start 2024-04-26T18:35:27.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.130+0000 7f426e5f0b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614833ed2d0 0x5614833eccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:27.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.130+0000 7f426e5f0b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f2ad0 0x561483411320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:27.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.130+0000 7f426e5f0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614833f33f0 0x561483411860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:27.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.130+0000 7f426e5f0b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x561483406200 con 0x5614833f2ad0 2024-04-26T18:35:27.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.130+0000 7f426e5f0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5614834068d0 con 0x5614833f33f0 2024-04-26T18:35:27.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.130+0000 7f426e5f0b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561483406fa0 con 0x5614833ed2d0 2024-04-26T18:35:27.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.130+0000 7f42612f9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f2ad0 0x561483411320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:27.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.130+0000 7f42612f9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f2ad0 0x561483411320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37410/0 (socket says 172.21.15.80:37410) 2024-04-26T18:35:27.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.130+0000 7f42612f9700 1 -- 172.21.15.80:0/2945464174 learned_addr learned my addr 172.21.15.80:0/2945464174 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:27.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.130+0000 7f4261afa700 1 --2- 172.21.15.80:0/2945464174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614833ed2d0 0x5614833eccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:27.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.130+0000 7f42612f9700 1 -- 172.21.15.80:0/2945464174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614833ed2d0 msgr2=0x5614833eccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:27.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.130+0000 7f42612f9700 1 --2- 172.21.15.80:0/2945464174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614833ed2d0 0x5614833eccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.130+0000 7f42612f9700 1 -- 172.21.15.80:0/2945464174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614833f33f0 msgr2=0x561483411860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:27.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.130+0000 7f42622fb700 1 --2- 172.21.15.80:0/2945464174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614833f33f0 0x561483411860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:27.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.130+0000 7f42612f9700 1 --2- 172.21.15.80:0/2945464174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614833f33f0 0x561483411860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.130+0000 7f42612f9700 1 -- 172.21.15.80:0/2945464174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561483408e20 con 0x5614833f2ad0 2024-04-26T18:35:27.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.130+0000 7f42612f9700 1 --2- 172.21.15.80:0/2945464174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f2ad0 0x561483411320 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f424c00ec90 tx=0x7f424c00e8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a3fb7ef71b0249 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:27.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.131+0000 7f42477fe700 1 -- 172.21.15.80:0/2945464174 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c040020 con 0x5614833f2ad0 2024-04-26T18:35:27.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.131+0000 7f42477fe700 1 -- 172.21.15.80:0/2945464174 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f424c010b80 con 0x5614833f2ad0 2024-04-26T18:35:27.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.131+0000 7f42477fe700 1 -- 172.21.15.80:0/2945464174 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c014030 con 0x5614833f2ad0 2024-04-26T18:35:27.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.131+0000 7f426e5f0b80 1 -- 172.21.15.80:0/2945464174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f2ad0 msgr2=0x561483411320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:27.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.131+0000 7f426e5f0b80 1 --2- 172.21.15.80:0/2945464174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f2ad0 0x561483411320 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f424c00ec90 tx=0x7f424c00e8e0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.131+0000 7f426e5f0b80 1 -- 172.21.15.80:0/2945464174 shutdown_connections 2024-04-26T18:35:27.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.131+0000 7f426e5f0b80 1 --2- 172.21.15.80:0/2945464174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614833f33f0 0x561483411860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.131+0000 7f426e5f0b80 1 --2- 172.21.15.80:0/2945464174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614833ed2d0 0x5614833eccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.131+0000 7f426e5f0b80 1 --2- 172.21.15.80:0/2945464174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f2ad0 0x561483411320 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.131+0000 7f426e5f0b80 1 -- 172.21.15.80:0/2945464174 >> 172.21.15.80:0/2945464174 conn(0x561483319cf0 msgr2=0x5614833e7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:27.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.131+0000 7f426e5f0b80 1 -- 172.21.15.80:0/2945464174 shutdown_connections 2024-04-26T18:35:27.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.131+0000 7f426e5f0b80 1 -- 172.21.15.80:0/2945464174 wait complete. 2024-04-26T18:35:27.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.132+0000 7f426e5f0b80 1 -- start start 2024-04-26T18:35:27.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.132+0000 7f426e5f0b80 1 Processor -- start 2024-04-26T18:35:27.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.132+0000 7f426e5f0b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614833ed2d0 0x561483411820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:27.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.132+0000 7f426e5f0b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f2ad0 0x561483410330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:27.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.132+0000 7f426e5f0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614833f33f0 0x5614834109d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:27.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.132+0000 7f426e5f0b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x561483407d40 con 0x5614833f2ad0 2024-04-26T18:35:27.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.132+0000 7f426e5f0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561483407670 con 0x5614833f33f0 2024-04-26T18:35:27.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.132+0000 7f426e5f0b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561483408410 con 0x5614833ed2d0 2024-04-26T18:35:27.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.132+0000 7f42612f9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f2ad0 0x561483410330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:27.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.132+0000 7f426e5f0b80 10 client.0 _ll_register_callbacks cb 0x5614832d3530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:35:27.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.132+0000 7f42612f9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f2ad0 0x561483410330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37426/0 (socket says 172.21.15.80:37426) 2024-04-26T18:35:27.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.132+0000 7f42612f9700 1 -- 172.21.15.80:0/352949332 learned_addr learned my addr 172.21.15.80:0/352949332 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:27.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.132+0000 7f4261afa700 1 --2- 172.21.15.80:0/352949332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614833ed2d0 0x561483411820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:27.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.132+0000 7f42622fb700 1 --2- 172.21.15.80:0/352949332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614833f33f0 0x5614834109d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:27.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.133+0000 7f42612f9700 1 -- 172.21.15.80:0/352949332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614833ed2d0 msgr2=0x561483411820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:27.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.133+0000 7f42612f9700 1 --2- 172.21.15.80:0/352949332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614833ed2d0 0x561483411820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.133+0000 7f42612f9700 1 -- 172.21.15.80:0/352949332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614833f33f0 msgr2=0x5614834109d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:27.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.133+0000 7f42612f9700 1 --2- 172.21.15.80:0/352949332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614833f33f0 0x5614834109d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.133+0000 7f42612f9700 1 -- 172.21.15.80:0/352949332 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561483402320 con 0x5614833f2ad0 2024-04-26T18:35:27.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.133+0000 7f42612f9700 1 --2- 172.21.15.80:0/352949332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f2ad0 0x561483410330 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f424c026d20 tx=0x7f424c00f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842b8aa4fc8ad5d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:27.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.133+0000 7f42457fa700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:35:27.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.133+0000 7f42457fa700 1 -- 172.21.15.80:0/352949332 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c04b020 con 0x5614833f2ad0 2024-04-26T18:35:27.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.133+0000 7f42457fa700 1 -- 172.21.15.80:0/352949332 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f424c010d30 con 0x5614833f2ad0 2024-04-26T18:35:27.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.133+0000 7f426e5f0b80 1 -- 172.21.15.80:0/352949332 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f424c010b80 con 0x5614833f2ad0 2024-04-26T18:35:27.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.133+0000 7f42457fa700 1 -- 172.21.15.80:0/352949332 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f424c014040 con 0x5614833f2ad0 2024-04-26T18:35:27.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.133+0000 7f426e5f0b80 10 client.14967 fetch_fsmap learned FSMap version 26 2024-04-26T18:35:27.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.133+0000 7f426e5f0b80 1 -- 172.21.15.80:0/352949332 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56148346dc40 con 0x5614833f2ad0 2024-04-26T18:35:27.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.133+0000 7f42457fa700 1 -- 172.21.15.80:0/352949332 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f424c010b80 con 0x5614833f2ad0 2024-04-26T18:35:27.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.133+0000 7f42457fa700 1 -- 172.21.15.80:0/352949332 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f424c030c60 con 0x5614833f2ad0 2024-04-26T18:35:27.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.133+0000 7f426e5f0b80 10 client.14967 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:35:27.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.133+0000 7f426e5f0b80 10 client.14967 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T18:35:27.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.133+0000 7f426e5f0b80 20 client.14967 populate_metadata read hostname 'smithi080' 2024-04-26T18:35:27.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.133+0000 7f426e5f0b80 1 --2- 172.21.15.80:0/352949332 >> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] conn(0x561483472340 0x561483471050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:27.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.134+0000 7f426e5f0b80 4 client.14967 mds_command: new command op to 24400 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T18:35:27.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.134+0000 7f426e5f0b80 1 -- 172.21.15.80:0/352949332 --> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] -- command(tid 0: {"prefix": "status"}) -- 0x561483347170 con 0x561483472340 2024-04-26T18:35:27.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.134+0000 7f4261afa700 1 --2- 172.21.15.80:0/352949332 >> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] conn(0x561483472340 0x561483471050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:27.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.134+0000 7f42457fa700 10 client.14967 ms_handle_connect on v2:172.21.15.192:6836/2361996920 2024-04-26T18:35:27.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.134+0000 7f4261afa700 1 --2- 172.21.15.80:0/352949332 >> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] conn(0x561483472340 0x561483471050 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d1d10c059f97b1cc server_cookie=68db7ec82154b19d in_seq=0 out_seq=0 2024-04-26T18:35:27.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.134+0000 7f42457fa700 1 -- 172.21.15.80:0/352949332 <== mds.3 v2:172.21.15.192:6836/2361996920 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x561483347170 con 0x561483472340 2024-04-26T18:35:27.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.134+0000 7f42457fa700 10 client.14967 handle_command_reply: tid=0 2024-04-26T18:35:27.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.134+0000 7f426e5f0b80 1 client.14967 shutdown 2024-04-26T18:35:27.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.135+0000 7f426e5f0b80 1 -- 172.21.15.80:0/352949332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f2ad0 msgr2=0x561483410330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:27.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.135+0000 7f426e5f0b80 1 --2- 172.21.15.80:0/352949332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f2ad0 0x561483410330 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f424c026d20 tx=0x7f424c00f8a0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.135+0000 7f426e5f0b80 1 -- 172.21.15.80:0/352949332 shutdown_connections 2024-04-26T18:35:27.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.135+0000 7f426e5f0b80 1 --2- 172.21.15.80:0/352949332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614833f33f0 0x5614834109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.135+0000 7f426e5f0b80 1 --2- 172.21.15.80:0/352949332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614833ed2d0 0x561483411820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.135+0000 7f426e5f0b80 1 --2- 172.21.15.80:0/352949332 >> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] conn(0x561483472340 0x561483471050 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.135+0000 7f426e5f0b80 1 --2- 172.21.15.80:0/352949332 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5614833f2ad0 0x561483410330 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.135+0000 7f42457fa700 0 client.14967 ms_handle_reset on v2:172.21.15.192:6836/2361996920 2024-04-26T18:35:27.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.135+0000 7f426e5f0b80 1 -- 172.21.15.80:0/352949332 >> 172.21.15.80:0/352949332 conn(0x561483319cf0 msgr2=0x5614833f0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:27.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.135+0000 7f426e5f0b80 1 -- 172.21.15.80:0/352949332 shutdown_connections 2024-04-26T18:35:27.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.135+0000 7f426e5f0b80 1 -- 172.21.15.80:0/352949332 wait complete. 2024-04-26T18:35:27.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.135+0000 7f426e5f0b80 20 client.14967 trim_cache size 0 max 16384 2024-04-26T18:35:27.141 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:35:27.141 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "2187ca98-03fa-11ef-bc93-c7b262605968", 2024-04-26T18:35:27.141 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 3, 2024-04-26T18:35:27.142 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24400, 2024-04-26T18:35:27.142 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-26T18:35:27.142 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-26T18:35:27.142 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-26T18:35:27.142 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 124.479617201, 2024-04-26T18:35:27.142 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 26, 2024-04-26T18:35:27.142 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 91, 2024-04-26T18:35:27.142 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T18:35:27.142 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 171.61938733700001 2024-04-26T18:35:27.142 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:35:27.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.135+0000 7f4263d5e700 1 -- 172.21.15.80:0/4171289994 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f42480a3cc0 msgr2=0x7f42480a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:27.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.135+0000 7f4263d5e700 1 --2- 172.21.15.80:0/4171289994 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f42480a3cc0 0x7f42480a6180 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f424c005ea0 tx=0x7f424c005e30 comp rx=0 tx=0).stop 2024-04-26T18:35:27.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.135+0000 7f4263d5e700 1 -- 172.21.15.80:0/4171289994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f425c102a80 msgr2=0x7f425c19f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:27.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.135+0000 7f4263d5e700 1 --2- 172.21.15.80:0/4171289994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f425c102a80 0x7f425c19f730 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4258000c00 tx=0x7f42580047b0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.135+0000 7f4263d5e700 1 -- 172.21.15.80:0/4171289994 shutdown_connections 2024-04-26T18:35:27.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.135+0000 7f4263d5e700 1 --2- 172.21.15.80:0/4171289994 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f42480a3cc0 0x7f42480a6180 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.135+0000 7f4263d5e700 1 --2- 172.21.15.80:0/4171289994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f425c107350 0x7f425c1998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.135+0000 7f4263d5e700 1 --2- 172.21.15.80:0/4171289994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f425c102a80 0x7f425c19f730 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.135+0000 7f4263d5e700 1 --2- 172.21.15.80:0/4171289994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f425c103440 0x7f425c19fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:27.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.135+0000 7f4263d5e700 1 -- 172.21.15.80:0/4171289994 >> 172.21.15.80:0/4171289994 conn(0x7f425c078920 msgr2=0x7f425c101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:27.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.135+0000 7f4263d5e700 1 -- 172.21.15.80:0/4171289994 shutdown_connections 2024-04-26T18:35:27.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:27.136+0000 7f4263d5e700 1 -- 172.21.15.80:0/4171289994 wait complete. 2024-04-26T18:35:27.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:27 smithi080 ceph-mon[29135]: pgmap v369: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:35:27.831 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell mds.h status 2024-04-26T18:35:27.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:27 smithi192 ceph-mon[32842]: pgmap v369: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:35:27.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:27 smithi082 ceph-mon[32808]: pgmap v369: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:35:28.067 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:35:29.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.696+0000 7f46a3e7e700 1 -- 172.21.15.80:0/4286592474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f469c102320 msgr2=0x7f469c1027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:29.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.696+0000 7f46a3e7e700 1 --2- 172.21.15.80:0/4286592474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f469c102320 0x7f469c1027a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f468c009990 tx=0x7f468c009ca0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.696+0000 7f46a3e7e700 1 -- 172.21.15.80:0/4286592474 shutdown_connections 2024-04-26T18:35:29.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.696+0000 7f46a3e7e700 1 --2- 172.21.15.80:0/4286592474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f469c102ce0 0x7f469c10f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.696+0000 7f46a3e7e700 1 --2- 172.21.15.80:0/4286592474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f469c108390 0x7f469c108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.696+0000 7f46a3e7e700 1 --2- 172.21.15.80:0/4286592474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f469c102320 0x7f469c1027a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.696+0000 7f46a3e7e700 1 -- 172.21.15.80:0/4286592474 >> 172.21.15.80:0/4286592474 conn(0x7f469c0792d0 msgr2=0x7f469c0796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:29.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.696+0000 7f46a3e7e700 1 -- 172.21.15.80:0/4286592474 shutdown_connections 2024-04-26T18:35:29.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.696+0000 7f46a3e7e700 1 -- 172.21.15.80:0/4286592474 wait complete. 2024-04-26T18:35:29.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.697+0000 7f46a3e7e700 1 Processor -- start 2024-04-26T18:35:29.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.697+0000 7f46a3e7e700 1 -- start start 2024-04-26T18:35:29.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.697+0000 7f46a3e7e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f469c102320 0x7f469c19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:29.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.697+0000 7f46a3e7e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f469c102ce0 0x7f469c19af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:29.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.697+0000 7f46a3e7e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f469c108390 0x7f469c1a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:29.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.697+0000 7f46a3e7e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f469c1124d0 con 0x7f469c108390 2024-04-26T18:35:29.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.697+0000 7f46a3e7e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f469c112350 con 0x7f469c102ce0 2024-04-26T18:35:29.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.697+0000 7f46a3e7e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f469c112650 con 0x7f469c102320 2024-04-26T18:35:29.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.697+0000 7f46a241b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f469c108390 0x7f469c1a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:29.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.697+0000 7f46a241b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f469c108390 0x7f469c1a5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37444/0 (socket says 172.21.15.80:37444) 2024-04-26T18:35:29.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.697+0000 7f46a241b700 1 -- 172.21.15.80:0/839090621 learned_addr learned my addr 172.21.15.80:0/839090621 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:29.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.697+0000 7f46a1419700 1 --2- 172.21.15.80:0/839090621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f469c102ce0 0x7f469c19af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:29.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.697+0000 7f46a1c1a700 1 --2- 172.21.15.80:0/839090621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f469c102320 0x7f469c19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:29.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.697+0000 7f46a241b700 1 -- 172.21.15.80:0/839090621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f469c102320 msgr2=0x7f469c19aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:29.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.697+0000 7f46a241b700 1 --2- 172.21.15.80:0/839090621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f469c102320 0x7f469c19aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.697+0000 7f46a241b700 1 -- 172.21.15.80:0/839090621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f469c102ce0 msgr2=0x7f469c19af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:29.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.697+0000 7f46a241b700 1 --2- 172.21.15.80:0/839090621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f469c102ce0 0x7f469c19af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.697+0000 7f46a241b700 1 -- 172.21.15.80:0/839090621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469c1a5ff0 con 0x7f469c108390 2024-04-26T18:35:29.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.697+0000 7f46a1c1a700 1 --2- 172.21.15.80:0/839090621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f469c102320 0x7f469c19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:35:29.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.697+0000 7f46a241b700 1 --2- 172.21.15.80:0/839090621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f469c108390 0x7f469c1a5ab0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4694007ee0 tx=0x7f469400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:29.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.697+0000 7f4692ffd700 1 -- 172.21.15.80:0/839090621 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469400ddd0 con 0x7f469c108390 2024-04-26T18:35:29.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.698+0000 7f4692ffd700 1 -- 172.21.15.80:0/839090621 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4694004020 con 0x7f469c108390 2024-04-26T18:35:29.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.698+0000 7f46a3e7e700 1 -- 172.21.15.80:0/839090621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f469c1a61c0 con 0x7f469c108390 2024-04-26T18:35:29.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.698+0000 7f4692ffd700 1 -- 172.21.15.80:0/839090621 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4694015660 con 0x7f469c108390 2024-04-26T18:35:29.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.698+0000 7f46a3e7e700 1 -- 172.21.15.80:0/839090621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f469c1a66d0 con 0x7f469c108390 2024-04-26T18:35:29.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.700+0000 7f4692ffd700 1 -- 172.21.15.80:0/839090621 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f46940041d0 con 0x7f469c108390 2024-04-26T18:35:29.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.700+0000 7f4692ffd700 1 --2- 172.21.15.80:0/839090621 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f46880a3cc0 0x7f46880a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:29.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.700+0000 7f46a1c1a700 1 --2- 172.21.15.80:0/839090621 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f46880a3cc0 0x7f46880a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:29.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.700+0000 7f4692ffd700 1 -- 172.21.15.80:0/839090621 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f46940cfd70 con 0x7f469c108390 2024-04-26T18:35:29.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.701+0000 7f46a1c1a700 1 --2- 172.21.15.80:0/839090621 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f46880a3cc0 0x7f46880a6180 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4698005fd0 tx=0x7f4698005d40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:29.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.701+0000 7f46ae710b80 1 Processor -- start 2024-04-26T18:35:29.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.701+0000 7f46ae710b80 1 -- start start 2024-04-26T18:35:29.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.701+0000 7f46ae710b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eea6d19a20 0x55eea6d19e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:29.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.701+0000 7f46ae710b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55eea6d13d50 0x55eea6d141b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:29.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.701+0000 7f46ae710b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d146f0 0x55eea6d20770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.701+0000 7f46ae710b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55eea6c667e0 con 0x55eea6d146f0 2024-04-26T18:35:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.701+0000 7f46ae710b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55eea6bcc8e0 con 0x55eea6d19a20 2024-04-26T18:35:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.701+0000 7f46ae710b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55eea6c627a0 con 0x55eea6d13d50 2024-04-26T18:35:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.702+0000 7f46a241b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d146f0 0x55eea6d20770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.702+0000 7f46a241b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d146f0 0x55eea6d20770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37450/0 (socket says 172.21.15.80:37450) 2024-04-26T18:35:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.702+0000 7f46a241b700 1 -- 172.21.15.80:0/2242131942 learned_addr learned my addr 172.21.15.80:0/2242131942 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.702+0000 7f46a1419700 1 --2- 172.21.15.80:0/2242131942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55eea6d13d50 0x55eea6d141b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.702+0000 7f46a1c1a700 1 --2- 172.21.15.80:0/2242131942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eea6d19a20 0x55eea6d19e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.702+0000 7f46a241b700 1 -- 172.21.15.80:0/2242131942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55eea6d13d50 msgr2=0x55eea6d141b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.702+0000 7f46a241b700 1 --2- 172.21.15.80:0/2242131942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55eea6d13d50 0x55eea6d141b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.702+0000 7f46a241b700 1 -- 172.21.15.80:0/2242131942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eea6d19a20 msgr2=0x55eea6d19e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.702+0000 7f46a241b700 1 --2- 172.21.15.80:0/2242131942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eea6d19a20 0x55eea6d19e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.702+0000 7f46a241b700 1 -- 172.21.15.80:0/2242131942 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eea6bb3880 con 0x55eea6d146f0 2024-04-26T18:35:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.702+0000 7f46a1419700 1 --2- 172.21.15.80:0/2242131942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55eea6d13d50 0x55eea6d141b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:35:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.702+0000 7f46a241b700 1 --2- 172.21.15.80:0/2242131942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d146f0 0x55eea6d20770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f469409c010 tx=0x7f4694097c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431607f12a6fea13 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.702+0000 7f4687fff700 1 -- 172.21.15.80:0/2242131942 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46940a0430 con 0x55eea6d146f0 2024-04-26T18:35:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.702+0000 7f4687fff700 1 -- 172.21.15.80:0/2242131942 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46940a4cf0 con 0x55eea6d146f0 2024-04-26T18:35:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.702+0000 7f4687fff700 1 -- 172.21.15.80:0/2242131942 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469409c540 con 0x55eea6d146f0 2024-04-26T18:35:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.703+0000 7f46ae710b80 1 -- 172.21.15.80:0/2242131942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d146f0 msgr2=0x55eea6d20770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.703+0000 7f46ae710b80 1 --2- 172.21.15.80:0/2242131942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d146f0 0x55eea6d20770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f469409c010 tx=0x7f4694097c00 comp rx=0 tx=0).stop 2024-04-26T18:35:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.703+0000 7f46ae710b80 1 -- 172.21.15.80:0/2242131942 shutdown_connections 2024-04-26T18:35:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.703+0000 7f46ae710b80 1 --2- 172.21.15.80:0/2242131942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d146f0 0x55eea6d20770 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.703+0000 7f46ae710b80 1 --2- 172.21.15.80:0/2242131942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eea6d19a20 0x55eea6d19e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.703+0000 7f46ae710b80 1 --2- 172.21.15.80:0/2242131942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55eea6d13d50 0x55eea6d141b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.703+0000 7f46ae710b80 1 -- 172.21.15.80:0/2242131942 >> 172.21.15.80:0/2242131942 conn(0x55eea6c42570 msgr2=0x55eea6d0e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.703+0000 7f46ae710b80 1 -- 172.21.15.80:0/2242131942 shutdown_connections 2024-04-26T18:35:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.703+0000 7f46ae710b80 1 -- 172.21.15.80:0/2242131942 wait complete. 2024-04-26T18:35:29.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.703+0000 7f46ae710b80 1 -- start start 2024-04-26T18:35:29.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.703+0000 7f46ae710b80 1 Processor -- start 2024-04-26T18:35:29.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.704+0000 7f46ae710b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55eea6d13d50 0x55eea6d202d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:29.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.704+0000 7f46ae710b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d146f0 0x55eea6d1d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:29.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.704+0000 7f46ae710b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eea6d19a20 0x55eea6d1dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:29.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.704+0000 7f46ae710b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55eea6d20cb0 con 0x55eea6d146f0 2024-04-26T18:35:29.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.704+0000 7f46ae710b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55eea6c20a30 con 0x55eea6d19a20 2024-04-26T18:35:29.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.704+0000 7f46ae710b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55eea6d20e30 con 0x55eea6d13d50 2024-04-26T18:35:29.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.704+0000 7f46ae710b80 10 client.0 _ll_register_callbacks cb 0x55eea6bfe900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:35:29.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.704+0000 7f46a1419700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d146f0 0x55eea6d1d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:29.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.704+0000 7f46a1419700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d146f0 0x55eea6d1d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37458/0 (socket says 172.21.15.80:37458) 2024-04-26T18:35:29.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.704+0000 7f46a1419700 1 -- 172.21.15.80:0/1895438506 learned_addr learned my addr 172.21.15.80:0/1895438506 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:29.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.704+0000 7f46a241b700 1 --2- 172.21.15.80:0/1895438506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eea6d19a20 0x55eea6d1dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:29.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.704+0000 7f46a1c1a700 1 --2- 172.21.15.80:0/1895438506 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55eea6d13d50 0x55eea6d202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:29.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.704+0000 7f46a1419700 1 -- 172.21.15.80:0/1895438506 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55eea6d13d50 msgr2=0x55eea6d202d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:29.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.704+0000 7f46a1419700 1 --2- 172.21.15.80:0/1895438506 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55eea6d13d50 0x55eea6d202d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.704+0000 7f46a1419700 1 -- 172.21.15.80:0/1895438506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eea6d19a20 msgr2=0x55eea6d1dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:29.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.704+0000 7f46a1419700 1 --2- 172.21.15.80:0/1895438506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eea6d19a20 0x55eea6d1dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.704+0000 7f46a1419700 1 -- 172.21.15.80:0/1895438506 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eea6c24430 con 0x55eea6d146f0 2024-04-26T18:35:29.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.704+0000 7f46a1c1a700 1 --2- 172.21.15.80:0/1895438506 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55eea6d13d50 0x55eea6d202d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:35:29.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.705+0000 7f46a1419700 1 --2- 172.21.15.80:0/1895438506 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d146f0 0x55eea6d1d670 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f468c009990 tx=0x7f468c00bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc32fbec7da9648 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:29.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.705+0000 7f46857fa700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:35:29.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.705+0000 7f46857fa700 1 -- 172.21.15.80:0/1895438506 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c003c70 con 0x55eea6d146f0 2024-04-26T18:35:29.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.705+0000 7f46857fa700 1 -- 172.21.15.80:0/1895438506 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f468c005070 con 0x55eea6d146f0 2024-04-26T18:35:29.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.705+0000 7f46ae710b80 1 -- 172.21.15.80:0/1895438506 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46940a4cf0 con 0x55eea6d146f0 2024-04-26T18:35:29.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.705+0000 7f46857fa700 1 -- 172.21.15.80:0/1895438506 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f468c003680 con 0x55eea6d146f0 2024-04-26T18:35:29.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.705+0000 7f46ae710b80 10 client.14979 fetch_fsmap learned FSMap version 26 2024-04-26T18:35:29.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.705+0000 7f46ae710b80 1 -- 172.21.15.80:0/1895438506 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55eea6d2b380 con 0x55eea6d146f0 2024-04-26T18:35:29.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.705+0000 7f46857fa700 1 -- 172.21.15.80:0/1895438506 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46940a4cf0 con 0x55eea6d146f0 2024-04-26T18:35:29.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.705+0000 7f46857fa700 1 -- 172.21.15.80:0/1895438506 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f468c00f790 con 0x55eea6d146f0 2024-04-26T18:35:29.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.705+0000 7f46ae710b80 10 client.14979 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:35:29.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.705+0000 7f46ae710b80 10 client.14979 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-26T18:35:29.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.705+0000 7f46ae710b80 20 client.14979 populate_metadata read hostname 'smithi080' 2024-04-26T18:35:29.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.705+0000 7f46ae710b80 1 --2- 172.21.15.80:0/1895438506 >> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] conn(0x55eea6d2da20 0x55eea6d2ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:29.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.705+0000 7f46ae710b80 4 client.14979 mds_command: new command op to 24404 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:35:29.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.705+0000 7f46ae710b80 1 -- 172.21.15.80:0/1895438506 --> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eea6c741c0 con 0x55eea6d2da20 2024-04-26T18:35:29.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.706+0000 7f46a1c1a700 1 --2- 172.21.15.80:0/1895438506 >> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] conn(0x55eea6d2da20 0x55eea6d2ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:29.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.706+0000 7f46a1c1a700 1 --2- 172.21.15.80:0/1895438506 >> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] conn(0x55eea6d2da20 0x55eea6d2ee90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=698b051525caeb93 server_cookie=d9b7a3e767f8473b in_seq=0 out_seq=0 2024-04-26T18:35:29.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.706+0000 7f46857fa700 10 client.14979 ms_handle_connect on v2:172.21.15.82:6836/2084055551 2024-04-26T18:35:29.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.707+0000 7f46857fa700 1 -- 172.21.15.80:0/1895438506 <== mds.2 v2:172.21.15.82:6836/2084055551 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55eea6c741c0 con 0x55eea6d2da20 2024-04-26T18:35:29.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.707+0000 7f46857fa700 10 client.14979 handle_command_reply: tid=0 2024-04-26T18:35:29.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.707+0000 7f46ae710b80 1 client.14979 shutdown 2024-04-26T18:35:29.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.707+0000 7f46ae710b80 1 -- 172.21.15.80:0/1895438506 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d146f0 msgr2=0x55eea6d1d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:29.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.707+0000 7f46ae710b80 1 --2- 172.21.15.80:0/1895438506 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d146f0 0x55eea6d1d670 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f468c009990 tx=0x7f468c00bf20 comp rx=0 tx=0).stop 2024-04-26T18:35:29.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.707+0000 7f46ae710b80 1 -- 172.21.15.80:0/1895438506 shutdown_connections 2024-04-26T18:35:29.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.707+0000 7f46ae710b80 1 --2- 172.21.15.80:0/1895438506 >> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] conn(0x55eea6d2da20 0x55eea6d2ee90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.707+0000 7f46ae710b80 1 --2- 172.21.15.80:0/1895438506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eea6d19a20 0x55eea6d1dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.707+0000 7f46ae710b80 1 --2- 172.21.15.80:0/1895438506 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55eea6d13d50 0x55eea6d202d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.707+0000 7f46ae710b80 1 --2- 172.21.15.80:0/1895438506 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d146f0 0x55eea6d1d670 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.707+0000 7f46857fa700 0 client.14979 ms_handle_reset on v2:172.21.15.82:6836/2084055551 2024-04-26T18:35:29.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.707+0000 7f46ae710b80 1 -- 172.21.15.80:0/1895438506 >> 172.21.15.80:0/1895438506 conn(0x55eea6c42570 msgr2=0x55eea6d12d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:29.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.707+0000 7f46ae710b80 1 -- 172.21.15.80:0/1895438506 shutdown_connections 2024-04-26T18:35:29.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.707+0000 7f46ae710b80 1 -- 172.21.15.80:0/1895438506 wait complete. 2024-04-26T18:35:29.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.707+0000 7f46ae710b80 20 client.14979 trim_cache size 0 max 16384 2024-04-26T18:35:29.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.727+0000 7f46ae710b80 1 Processor -- start 2024-04-26T18:35:29.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.727+0000 7f46ae710b80 1 -- start start 2024-04-26T18:35:29.727 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:29 smithi080 ceph-mon[29135]: pgmap v370: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:29.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.727+0000 7f46ae710b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55eea6d13d50 0x55eea6d092b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:29.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.727+0000 7f46ae710b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d146f0 0x55eea6d382f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:29.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.727+0000 7f46ae710b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eea6d19a20 0x55eea6d38830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:29.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.727+0000 7f46ae710b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55eea6d2d1d0 con 0x55eea6d146f0 2024-04-26T18:35:29.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.727+0000 7f46ae710b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55eea6d2d8a0 con 0x55eea6d19a20 2024-04-26T18:35:29.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.727+0000 7f46ae710b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55eea6d2df70 con 0x55eea6d13d50 2024-04-26T18:35:29.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.727+0000 7f46a1419700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d146f0 0x55eea6d382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:29.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.727+0000 7f46a1419700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d146f0 0x55eea6d382f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37472/0 (socket says 172.21.15.80:37472) 2024-04-26T18:35:29.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.727+0000 7f46a1419700 1 -- 172.21.15.80:0/3158839353 learned_addr learned my addr 172.21.15.80:0/3158839353 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:29.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.728+0000 7f46a1c1a700 1 --2- 172.21.15.80:0/3158839353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55eea6d13d50 0x55eea6d092b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:29.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.728+0000 7f46a241b700 1 --2- 172.21.15.80:0/3158839353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eea6d19a20 0x55eea6d38830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:29.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.728+0000 7f46a1419700 1 -- 172.21.15.80:0/3158839353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55eea6d13d50 msgr2=0x55eea6d092b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:29.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.728+0000 7f46a1419700 1 --2- 172.21.15.80:0/3158839353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55eea6d13d50 0x55eea6d092b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.728+0000 7f46a1419700 1 -- 172.21.15.80:0/3158839353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eea6d19a20 msgr2=0x55eea6d38830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:29.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.728+0000 7f46a1419700 1 --2- 172.21.15.80:0/3158839353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eea6d19a20 0x55eea6d38830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.728+0000 7f46a1419700 1 -- 172.21.15.80:0/3158839353 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eea6d1df30 con 0x55eea6d146f0 2024-04-26T18:35:29.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.728+0000 7f46a241b700 1 --2- 172.21.15.80:0/3158839353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eea6d19a20 0x55eea6d38830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:35:29.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.728+0000 7f46a1419700 1 --2- 172.21.15.80:0/3158839353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d146f0 0x55eea6d382f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f468c006010 tx=0x7f468c005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3346e5841cacaa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:29.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.728+0000 7f46877fe700 1 -- 172.21.15.80:0/3158839353 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c03b070 con 0x55eea6d146f0 2024-04-26T18:35:29.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.728+0000 7f46877fe700 1 -- 172.21.15.80:0/3158839353 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f468c009590 con 0x55eea6d146f0 2024-04-26T18:35:29.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.728+0000 7f46877fe700 1 -- 172.21.15.80:0/3158839353 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c005350 con 0x55eea6d146f0 2024-04-26T18:35:29.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.729+0000 7f46ae710b80 1 -- 172.21.15.80:0/3158839353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d146f0 msgr2=0x55eea6d382f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:29.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.729+0000 7f46ae710b80 1 --2- 172.21.15.80:0/3158839353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d146f0 0x55eea6d382f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f468c006010 tx=0x7f468c005ca0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.729+0000 7f46ae710b80 1 -- 172.21.15.80:0/3158839353 shutdown_connections 2024-04-26T18:35:29.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.729+0000 7f46ae710b80 1 --2- 172.21.15.80:0/3158839353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eea6d19a20 0x55eea6d38830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.729+0000 7f46ae710b80 1 --2- 172.21.15.80:0/3158839353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55eea6d13d50 0x55eea6d092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.729+0000 7f46ae710b80 1 --2- 172.21.15.80:0/3158839353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d146f0 0x55eea6d382f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.729+0000 7f46ae710b80 1 -- 172.21.15.80:0/3158839353 >> 172.21.15.80:0/3158839353 conn(0x55eea6c42570 msgr2=0x55eea6d1bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:29.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.729+0000 7f46ae710b80 1 -- 172.21.15.80:0/3158839353 shutdown_connections 2024-04-26T18:35:29.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.729+0000 7f46ae710b80 1 -- 172.21.15.80:0/3158839353 wait complete. 2024-04-26T18:35:29.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.729+0000 7f46ae710b80 1 -- start start 2024-04-26T18:35:29.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.729+0000 7f46ae710b80 1 Processor -- start 2024-04-26T18:35:29.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.730+0000 7f46ae710b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d13d50 0x55eea6d384f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:29.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.730+0000 7f46ae710b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eea6d146f0 0x55eea6d332c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:29.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.730+0000 7f46ae710b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55eea6d19a20 0x55eea6d33800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:29.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.730+0000 7f46ae710b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55eea6d2ed10 con 0x55eea6d13d50 2024-04-26T18:35:29.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.730+0000 7f46ae710b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55eea6d2e640 con 0x55eea6d146f0 2024-04-26T18:35:29.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.730+0000 7f46ae710b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55eea6d2f3e0 con 0x55eea6d19a20 2024-04-26T18:35:29.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.730+0000 7f46ae710b80 10 client.0 _ll_register_callbacks cb 0x55eea6bfe900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:35:29.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.730+0000 7f46a1c1a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d13d50 0x55eea6d384f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:29.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.730+0000 7f46a1c1a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d13d50 0x55eea6d384f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37480/0 (socket says 172.21.15.80:37480) 2024-04-26T18:35:29.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.730+0000 7f46a1c1a700 1 -- 172.21.15.80:0/1759002436 learned_addr learned my addr 172.21.15.80:0/1759002436 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:29.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.730+0000 7f46a1419700 1 --2- 172.21.15.80:0/1759002436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eea6d146f0 0x55eea6d332c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:29.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.730+0000 7f46a241b700 1 --2- 172.21.15.80:0/1759002436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55eea6d19a20 0x55eea6d33800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:29.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.730+0000 7f46a1c1a700 1 -- 172.21.15.80:0/1759002436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55eea6d19a20 msgr2=0x55eea6d33800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:29.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.730+0000 7f46a1c1a700 1 --2- 172.21.15.80:0/1759002436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55eea6d19a20 0x55eea6d33800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.730+0000 7f46a1c1a700 1 -- 172.21.15.80:0/1759002436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eea6d146f0 msgr2=0x55eea6d332c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:29.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.730+0000 7f46a1c1a700 1 --2- 172.21.15.80:0/1759002436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eea6d146f0 0x55eea6d332c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.730+0000 7f46a1c1a700 1 -- 172.21.15.80:0/1759002436 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eea6d33dc0 con 0x55eea6d13d50 2024-04-26T18:35:29.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.730+0000 7f46a1c1a700 1 --2- 172.21.15.80:0/1759002436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d13d50 0x55eea6d384f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55eea6d2f9d0 tx=0x7f46980047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9b0d5c30aba711 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:29.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.730+0000 7f46857fa700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:35:29.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.730+0000 7f46857fa700 1 -- 172.21.15.80:0/1759002436 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46980254a0 con 0x55eea6d13d50 2024-04-26T18:35:29.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.730+0000 7f46857fa700 1 -- 172.21.15.80:0/1759002436 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f4698025640 con 0x55eea6d13d50 2024-04-26T18:35:29.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.730+0000 7f46ae710b80 1 -- 172.21.15.80:0/1759002436 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f468c009590 con 0x55eea6d13d50 2024-04-26T18:35:29.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.731+0000 7f46857fa700 1 -- 172.21.15.80:0/1759002436 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4698034070 con 0x55eea6d13d50 2024-04-26T18:35:29.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.731+0000 7f46ae710b80 10 client.14985 fetch_fsmap learned FSMap version 26 2024-04-26T18:35:29.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.731+0000 7f46ae710b80 1 -- 172.21.15.80:0/1759002436 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55eea6d95910 con 0x55eea6d13d50 2024-04-26T18:35:29.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.731+0000 7f46857fa700 1 -- 172.21.15.80:0/1759002436 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f468c009590 con 0x55eea6d13d50 2024-04-26T18:35:29.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.731+0000 7f46857fa700 1 -- 172.21.15.80:0/1759002436 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f469800f420 con 0x55eea6d13d50 2024-04-26T18:35:29.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.731+0000 7f46ae710b80 10 client.14985 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:35:29.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.731+0000 7f46ae710b80 10 client.14985 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-26T18:35:29.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.731+0000 7f46ae710b80 20 client.14985 populate_metadata read hostname 'smithi080' 2024-04-26T18:35:29.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.731+0000 7f46ae710b80 1 --2- 172.21.15.80:0/1759002436 >> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] conn(0x55eea6d9a510 0x55eea6d99220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:29.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.731+0000 7f46ae710b80 4 client.14985 mds_command: new command op to 24404 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T18:35:29.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.731+0000 7f46ae710b80 1 -- 172.21.15.80:0/1759002436 --> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] -- command(tid 0: {"prefix": "status"}) -- 0x55eea6c6e260 con 0x55eea6d9a510 2024-04-26T18:35:29.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.731+0000 7f46a1419700 1 --2- 172.21.15.80:0/1759002436 >> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] conn(0x55eea6d9a510 0x55eea6d99220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:29.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.732+0000 7f46a1419700 1 --2- 172.21.15.80:0/1759002436 >> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] conn(0x55eea6d9a510 0x55eea6d99220 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4b9fada89206c060 server_cookie=fbb1ed164dc4e051 in_seq=0 out_seq=0 2024-04-26T18:35:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.732+0000 7f46857fa700 10 client.14985 ms_handle_connect on v2:172.21.15.82:6836/2084055551 2024-04-26T18:35:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.732+0000 7f46857fa700 1 -- 172.21.15.80:0/1759002436 <== mds.2 v2:172.21.15.82:6836/2084055551 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55eea6c6e260 con 0x55eea6d9a510 2024-04-26T18:35:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.732+0000 7f46857fa700 10 client.14985 handle_command_reply: tid=0 2024-04-26T18:35:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.732+0000 7f46ae710b80 1 client.14985 shutdown 2024-04-26T18:35:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.732+0000 7f46ae710b80 1 -- 172.21.15.80:0/1759002436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d13d50 msgr2=0x55eea6d384f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.732+0000 7f46ae710b80 1 --2- 172.21.15.80:0/1759002436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d13d50 0x55eea6d384f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55eea6d2f9d0 tx=0x7f46980047c0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.732+0000 7f46ae710b80 1 -- 172.21.15.80:0/1759002436 shutdown_connections 2024-04-26T18:35:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.732+0000 7f46ae710b80 1 --2- 172.21.15.80:0/1759002436 >> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] conn(0x55eea6d9a510 0x55eea6d99220 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.732+0000 7f46ae710b80 1 --2- 172.21.15.80:0/1759002436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55eea6d19a20 0x55eea6d33800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.732+0000 7f46ae710b80 1 --2- 172.21.15.80:0/1759002436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55eea6d13d50 0x55eea6d384f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.732+0000 7f46857fa700 0 client.14985 ms_handle_reset on v2:172.21.15.82:6836/2084055551 2024-04-26T18:35:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.732+0000 7f46ae710b80 1 --2- 172.21.15.80:0/1759002436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eea6d146f0 0x55eea6d332c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.732+0000 7f46ae710b80 1 -- 172.21.15.80:0/1759002436 >> 172.21.15.80:0/1759002436 conn(0x55eea6c42570 msgr2=0x55eea6d12d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.732+0000 7f46ae710b80 1 -- 172.21.15.80:0/1759002436 shutdown_connections 2024-04-26T18:35:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.732+0000 7f46ae710b80 1 -- 172.21.15.80:0/1759002436 wait complete. 2024-04-26T18:35:29.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.732+0000 7f46ae710b80 20 client.14985 trim_cache size 0 max 16384 2024-04-26T18:35:29.738 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:35:29.738 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "2187ca98-03fa-11ef-bc93-c7b262605968", 2024-04-26T18:35:29.738 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 2, 2024-04-26T18:35:29.738 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24404, 2024-04-26T18:35:29.738 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-26T18:35:29.738 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-26T18:35:29.738 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-26T18:35:29.738 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 128.085760443, 2024-04-26T18:35:29.738 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 26, 2024-04-26T18:35:29.739 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 91, 2024-04-26T18:35:29.739 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T18:35:29.739 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 171.134963263 2024-04-26T18:35:29.739 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:35:29.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.733+0000 7f46a3e7e700 1 -- 172.21.15.80:0/839090621 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f46880a3cc0 msgr2=0x7f46880a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:29.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.733+0000 7f46a3e7e700 1 --2- 172.21.15.80:0/839090621 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f46880a3cc0 0x7f46880a6180 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4698005fd0 tx=0x7f4698005d40 comp rx=0 tx=0).stop 2024-04-26T18:35:29.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.733+0000 7f46a3e7e700 1 -- 172.21.15.80:0/839090621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f469c108390 msgr2=0x7f469c1a5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:29.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.733+0000 7f46a3e7e700 1 --2- 172.21.15.80:0/839090621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f469c108390 0x7f469c1a5ab0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4694007ee0 tx=0x7f469400d3b0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.733+0000 7f46a3e7e700 1 -- 172.21.15.80:0/839090621 shutdown_connections 2024-04-26T18:35:29.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.733+0000 7f46a3e7e700 1 --2- 172.21.15.80:0/839090621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f469c108390 0x7f469c1a5ab0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.733+0000 7f46a3e7e700 1 --2- 172.21.15.80:0/839090621 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f46880a3cc0 0x7f46880a6180 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.733+0000 7f46a3e7e700 1 --2- 172.21.15.80:0/839090621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f469c102320 0x7f469c19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.733+0000 7f46a3e7e700 1 --2- 172.21.15.80:0/839090621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f469c102ce0 0x7f469c19af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:29.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.733+0000 7f46a3e7e700 1 -- 172.21.15.80:0/839090621 >> 172.21.15.80:0/839090621 conn(0x7f469c0792d0 msgr2=0x7f469c100fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:29.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.733+0000 7f46a3e7e700 1 -- 172.21.15.80:0/839090621 shutdown_connections 2024-04-26T18:35:29.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:29.733+0000 7f46a3e7e700 1 -- 172.21.15.80:0/839090621 wait complete. 2024-04-26T18:35:29.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:29 smithi192 ceph-mon[32842]: pgmap v370: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:29.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:29 smithi082 ceph-mon[32808]: pgmap v370: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:30.469 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell mds.i status 2024-04-26T18:35:30.713 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:35:31.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:31 smithi080 ceph-mon[29135]: pgmap v371: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:31.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:31 smithi082 ceph-mon[32808]: pgmap v371: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:32.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:31 smithi192 ceph-mon[32842]: pgmap v371: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:32.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.356+0000 7f2918e6d700 1 -- 172.21.15.80:0/2906929398 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29141034a0 msgr2=0x7f2914103900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:32.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.356+0000 7f2918e6d700 1 --2- 172.21.15.80:0/2906929398 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29141034a0 0x7f2914103900 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2908009990 tx=0x7f2908009ca0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.356+0000 7f2918e6d700 1 -- 172.21.15.80:0/2906929398 shutdown_connections 2024-04-26T18:35:32.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.356+0000 7f2918e6d700 1 --2- 172.21.15.80:0/2906929398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2914103e40 0x7f2914110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.356+0000 7f2918e6d700 1 --2- 172.21.15.80:0/2906929398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29141094e0 0x7f29141098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.356+0000 7f2918e6d700 1 --2- 172.21.15.80:0/2906929398 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29141034a0 0x7f2914103900 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.356+0000 7f2918e6d700 1 -- 172.21.15.80:0/2906929398 >> 172.21.15.80:0/2906929398 conn(0x7f291407a4f0 msgr2=0x7f291407a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:32.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.356+0000 7f2918e6d700 1 -- 172.21.15.80:0/2906929398 shutdown_connections 2024-04-26T18:35:32.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.356+0000 7f2918e6d700 1 -- 172.21.15.80:0/2906929398 wait complete. 2024-04-26T18:35:32.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.357+0000 7f2918e6d700 1 Processor -- start 2024-04-26T18:35:32.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.357+0000 7f2918e6d700 1 -- start start 2024-04-26T18:35:32.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.357+0000 7f2918e6d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29141034a0 0x7f2914075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:32.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.357+0000 7f2918e6d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2914103e40 0x7f2914075c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:32.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.357+0000 7f2918e6d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29141094e0 0x7f29140761a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:32.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.357+0000 7f2918e6d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f29141135f0 con 0x7f29141094e0 2024-04-26T18:35:32.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.357+0000 7f2918e6d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2914113470 con 0x7f29141034a0 2024-04-26T18:35:32.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.357+0000 7f2918e6d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2914113770 con 0x7f2914103e40 2024-04-26T18:35:32.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.357+0000 7f2912d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29141094e0 0x7f29140761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:32.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.357+0000 7f2912d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29141094e0 0x7f29140761a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37488/0 (socket says 172.21.15.80:37488) 2024-04-26T18:35:32.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.357+0000 7f2912d9d700 1 -- 172.21.15.80:0/2329518800 learned_addr learned my addr 172.21.15.80:0/2329518800 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:32.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.357+0000 7f2911d9b700 1 --2- 172.21.15.80:0/2329518800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2914103e40 0x7f2914075c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:32.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.358+0000 7f291259c700 1 --2- 172.21.15.80:0/2329518800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29141034a0 0x7f2914075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:32.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.358+0000 7f2912d9d700 1 -- 172.21.15.80:0/2329518800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2914103e40 msgr2=0x7f2914075c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:32.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.358+0000 7f2912d9d700 1 --2- 172.21.15.80:0/2329518800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2914103e40 0x7f2914075c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.358+0000 7f2912d9d700 1 -- 172.21.15.80:0/2329518800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29141034a0 msgr2=0x7f2914075720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:32.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.358+0000 7f2912d9d700 1 --2- 172.21.15.80:0/2329518800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29141034a0 0x7f2914075720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.358+0000 7f2912d9d700 1 -- 172.21.15.80:0/2329518800 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29141a8020 con 0x7f29141094e0 2024-04-26T18:35:32.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.358+0000 7f2912d9d700 1 --2- 172.21.15.80:0/2329518800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29141094e0 0x7f29140761a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f290c007ee0 tx=0x7f290c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:32.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.358+0000 7f29037fe700 1 -- 172.21.15.80:0/2329518800 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c00dbd0 con 0x7f29141094e0 2024-04-26T18:35:32.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.358+0000 7f2918e6d700 1 -- 172.21.15.80:0/2329518800 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29141a8310 con 0x7f29141094e0 2024-04-26T18:35:32.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.358+0000 7f29037fe700 1 -- 172.21.15.80:0/2329518800 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f290c00dd70 con 0x7f29141094e0 2024-04-26T18:35:32.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.358+0000 7f29037fe700 1 -- 172.21.15.80:0/2329518800 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c005990 con 0x7f29141094e0 2024-04-26T18:35:32.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.358+0000 7f2918e6d700 1 -- 172.21.15.80:0/2329518800 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29141a8820 con 0x7f29141094e0 2024-04-26T18:35:32.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.360+0000 7f29037fe700 1 -- 172.21.15.80:0/2329518800 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f290c01a020 con 0x7f29141094e0 2024-04-26T18:35:32.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.361+0000 7f29037fe700 1 --2- 172.21.15.80:0/2329518800 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f28fc0a3c40 0x7f28fc0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:32.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.361+0000 7f291259c700 1 --2- 172.21.15.80:0/2329518800 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f28fc0a3c40 0x7f28fc0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:32.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.361+0000 7f29037fe700 1 -- 172.21.15.80:0/2329518800 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f290c0cfc00 con 0x7f29141094e0 2024-04-26T18:35:32.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.361+0000 7f291259c700 1 --2- 172.21.15.80:0/2329518800 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f28fc0a3c40 0x7f28fc0a6100 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2904005fd0 tx=0x7f2904005ee0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:32.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.362+0000 7f29236ffb80 1 Processor -- start 2024-04-26T18:35:32.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.362+0000 7f29236ffb80 1 -- start start 2024-04-26T18:35:32.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.362+0000 7f29236ffb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562c7d717a20 0x562c7d717e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:32.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.362+0000 7f29236ffb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d711d50 0x562c7d7121b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:32.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.362+0000 7f29236ffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c7d7126f0 0x562c7d71e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:32.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.362+0000 7f29236ffb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562c7d6647e0 con 0x562c7d711d50 2024-04-26T18:35:32.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.362+0000 7f29236ffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562c7d5ca8e0 con 0x562c7d7126f0 2024-04-26T18:35:32.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.362+0000 7f29236ffb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562c7d6607a0 con 0x562c7d717a20 2024-04-26T18:35:32.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.362+0000 7f2911d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d711d50 0x562c7d7121b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:32.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.362+0000 7f2911d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d711d50 0x562c7d7121b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37496/0 (socket says 172.21.15.80:37496) 2024-04-26T18:35:32.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.362+0000 7f2911d9b700 1 -- 172.21.15.80:0/2383130052 learned_addr learned my addr 172.21.15.80:0/2383130052 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:32.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.363+0000 7f2912d9d700 1 --2- 172.21.15.80:0/2383130052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c7d7126f0 0x562c7d71e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:32.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.363+0000 7f291259c700 1 --2- 172.21.15.80:0/2383130052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562c7d717a20 0x562c7d717e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:32.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.363+0000 7f2911d9b700 1 -- 172.21.15.80:0/2383130052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562c7d717a20 msgr2=0x562c7d717e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:32.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.363+0000 7f2911d9b700 1 --2- 172.21.15.80:0/2383130052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562c7d717a20 0x562c7d717e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.363+0000 7f2911d9b700 1 -- 172.21.15.80:0/2383130052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c7d7126f0 msgr2=0x562c7d71e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:32.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.363+0000 7f2911d9b700 1 --2- 172.21.15.80:0/2383130052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c7d7126f0 0x562c7d71e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.363+0000 7f2911d9b700 1 -- 172.21.15.80:0/2383130052 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c7d5b1880 con 0x562c7d711d50 2024-04-26T18:35:32.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.363+0000 7f2911d9b700 1 --2- 172.21.15.80:0/2383130052 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d711d50 0x562c7d7121b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2908009990 tx=0x7f2908009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bca70848019a824 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:32.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.363+0000 7f2900ff9700 1 -- 172.21.15.80:0/2383130052 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2908003a60 con 0x562c7d711d50 2024-04-26T18:35:32.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.363+0000 7f2900ff9700 1 -- 172.21.15.80:0/2383130052 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2908026070 con 0x562c7d711d50 2024-04-26T18:35:32.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.363+0000 7f2900ff9700 1 -- 172.21.15.80:0/2383130052 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290800ba30 con 0x562c7d711d50 2024-04-26T18:35:32.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.364+0000 7f29236ffb80 1 -- 172.21.15.80:0/2383130052 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d711d50 msgr2=0x562c7d7121b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:32.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.364+0000 7f29236ffb80 1 --2- 172.21.15.80:0/2383130052 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d711d50 0x562c7d7121b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2908009990 tx=0x7f2908009f90 comp rx=0 tx=0).stop 2024-04-26T18:35:32.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.364+0000 7f29236ffb80 1 -- 172.21.15.80:0/2383130052 shutdown_connections 2024-04-26T18:35:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.364+0000 7f29236ffb80 1 --2- 172.21.15.80:0/2383130052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c7d7126f0 0x562c7d71e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.364+0000 7f29236ffb80 1 --2- 172.21.15.80:0/2383130052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562c7d717a20 0x562c7d717e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.364+0000 7f29236ffb80 1 --2- 172.21.15.80:0/2383130052 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d711d50 0x562c7d7121b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.364+0000 7f29236ffb80 1 -- 172.21.15.80:0/2383130052 >> 172.21.15.80:0/2383130052 conn(0x562c7d640570 msgr2=0x562c7d70c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.364+0000 7f29236ffb80 1 -- 172.21.15.80:0/2383130052 shutdown_connections 2024-04-26T18:35:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.364+0000 7f29236ffb80 1 -- 172.21.15.80:0/2383130052 wait complete. 2024-04-26T18:35:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.364+0000 7f29236ffb80 1 -- start start 2024-04-26T18:35:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.364+0000 7f29236ffb80 1 Processor -- start 2024-04-26T18:35:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.365+0000 7f29236ffb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562c7d711d50 0x562c7d71e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.365+0000 7f29236ffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c7d7126f0 0x562c7d71b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.365+0000 7f29236ffb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d717a20 0x562c7d71bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.365+0000 7f29236ffb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562c7d71ecb0 con 0x562c7d717a20 2024-04-26T18:35:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.365+0000 7f29236ffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562c7d61ea30 con 0x562c7d7126f0 2024-04-26T18:35:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.365+0000 7f29236ffb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562c7d71ee30 con 0x562c7d711d50 2024-04-26T18:35:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.365+0000 7f29236ffb80 10 client.0 _ll_register_callbacks cb 0x562c7d5fc900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:35:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.365+0000 7f2912d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d717a20 0x562c7d71bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.365+0000 7f2912d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d717a20 0x562c7d71bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37498/0 (socket says 172.21.15.80:37498) 2024-04-26T18:35:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.365+0000 7f2912d9d700 1 -- 172.21.15.80:0/1041291276 learned_addr learned my addr 172.21.15.80:0/1041291276 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.365+0000 7f2911d9b700 1 --2- 172.21.15.80:0/1041291276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c7d7126f0 0x562c7d71b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.365+0000 7f291259c700 1 --2- 172.21.15.80:0/1041291276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562c7d711d50 0x562c7d71e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.365+0000 7f2912d9d700 1 -- 172.21.15.80:0/1041291276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562c7d711d50 msgr2=0x562c7d71e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.365+0000 7f2912d9d700 1 --2- 172.21.15.80:0/1041291276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562c7d711d50 0x562c7d71e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.365+0000 7f2912d9d700 1 -- 172.21.15.80:0/1041291276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c7d7126f0 msgr2=0x562c7d71b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.365+0000 7f2912d9d700 1 --2- 172.21.15.80:0/1041291276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c7d7126f0 0x562c7d71b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.365+0000 7f2912d9d700 1 -- 172.21.15.80:0/1041291276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c7d622430 con 0x562c7d717a20 2024-04-26T18:35:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.365+0000 7f2912d9d700 1 --2- 172.21.15.80:0/1041291276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d717a20 0x562c7d71bc80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f290c09be40 tx=0x7f290c09c5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d50b834cf987c647 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.365+0000 7f28f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:35:32.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.365+0000 7f28f9ffb700 1 -- 172.21.15.80:0/1041291276 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c0a4b20 con 0x562c7d717a20 2024-04-26T18:35:32.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.365+0000 7f28f9ffb700 1 -- 172.21.15.80:0/1041291276 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f290c0b5220 con 0x562c7d717a20 2024-04-26T18:35:32.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.365+0000 7f29236ffb80 1 -- 172.21.15.80:0/1041291276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2908026070 con 0x562c7d717a20 2024-04-26T18:35:32.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.366+0000 7f28f9ffb700 1 -- 172.21.15.80:0/1041291276 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f290c0b5420 con 0x562c7d717a20 2024-04-26T18:35:32.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.366+0000 7f29236ffb80 10 client.14997 fetch_fsmap learned FSMap version 26 2024-04-26T18:35:32.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.366+0000 7f29236ffb80 1 -- 172.21.15.80:0/1041291276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562c7d7294c0 con 0x562c7d717a20 2024-04-26T18:35:32.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.366+0000 7f28f9ffb700 1 -- 172.21.15.80:0/1041291276 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2908026070 con 0x562c7d717a20 2024-04-26T18:35:32.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.366+0000 7f28f9ffb700 1 -- 172.21.15.80:0/1041291276 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f290c0cdb90 con 0x562c7d717a20 2024-04-26T18:35:32.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.366+0000 7f29236ffb80 10 client.14997 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:35:32.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.366+0000 7f29236ffb80 10 client.14997 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T18:35:32.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.366+0000 7f29236ffb80 20 client.14997 populate_metadata read hostname 'smithi080' 2024-04-26T18:35:32.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.366+0000 7f29236ffb80 1 --2- 172.21.15.80:0/1041291276 >> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] conn(0x562c7d72ba60 0x562c7d72ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:32.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.366+0000 7f29236ffb80 4 client.14997 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:35:32.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.366+0000 7f29236ffb80 1 -- 172.21.15.80:0/1041291276 --> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c7d6721c0 con 0x562c7d72ba60 2024-04-26T18:35:32.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.366+0000 7f291259c700 1 --2- 172.21.15.80:0/1041291276 >> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] conn(0x562c7d72ba60 0x562c7d72ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:32.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.367+0000 7f291259c700 1 --2- 172.21.15.80:0/1041291276 >> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] conn(0x562c7d72ba60 0x562c7d72ced0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bd3eec1967041b2e server_cookie=84b2daf8e1c2c8fd in_seq=0 out_seq=0 2024-04-26T18:35:32.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.367+0000 7f28f9ffb700 10 client.14997 ms_handle_connect on v2:172.21.15.192:6838/2735406056 2024-04-26T18:35:32.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.368+0000 7f28f9ffb700 1 -- 172.21.15.80:0/1041291276 <== mds.1 v2:172.21.15.192:6838/2735406056 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562c7d6721c0 con 0x562c7d72ba60 2024-04-26T18:35:32.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.368+0000 7f28f9ffb700 10 client.14997 handle_command_reply: tid=0 2024-04-26T18:35:32.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.368+0000 7f29236ffb80 1 client.14997 shutdown 2024-04-26T18:35:32.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.368+0000 7f29236ffb80 1 -- 172.21.15.80:0/1041291276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d717a20 msgr2=0x562c7d71bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:32.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.368+0000 7f29236ffb80 1 --2- 172.21.15.80:0/1041291276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d717a20 0x562c7d71bc80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f290c09be40 tx=0x7f290c09c5b0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.368+0000 7f29236ffb80 1 -- 172.21.15.80:0/1041291276 shutdown_connections 2024-04-26T18:35:32.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.368+0000 7f29236ffb80 1 --2- 172.21.15.80:0/1041291276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d717a20 0x562c7d71bc80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.368+0000 7f29236ffb80 1 --2- 172.21.15.80:0/1041291276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562c7d711d50 0x562c7d71e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.368+0000 7f29236ffb80 1 --2- 172.21.15.80:0/1041291276 >> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] conn(0x562c7d72ba60 0x562c7d72ced0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.368+0000 7f29236ffb80 1 --2- 172.21.15.80:0/1041291276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c7d7126f0 0x562c7d71b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.368+0000 7f29236ffb80 1 -- 172.21.15.80:0/1041291276 >> 172.21.15.80:0/1041291276 conn(0x562c7d640570 msgr2=0x562c7d710d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:32.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.368+0000 7f28f9ffb700 0 client.14997 ms_handle_reset on v2:172.21.15.192:6838/2735406056 2024-04-26T18:35:32.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.368+0000 7f29236ffb80 1 -- 172.21.15.80:0/1041291276 shutdown_connections 2024-04-26T18:35:32.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.368+0000 7f29236ffb80 1 -- 172.21.15.80:0/1041291276 wait complete. 2024-04-26T18:35:32.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.368+0000 7f29236ffb80 20 client.14997 trim_cache size 0 max 16384 2024-04-26T18:35:32.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.388+0000 7f29236ffb80 1 Processor -- start 2024-04-26T18:35:32.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.388+0000 7f29236ffb80 1 -- start start 2024-04-26T18:35:32.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.388+0000 7f29236ffb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562c7d711d50 0x562c7d71e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:32.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.388+0000 7f29236ffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c7d7126f0 0x562c7d70c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:32.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.388+0000 7f29236ffb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d717a20 0x562c7d710d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:32.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.388+0000 7f29236ffb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562c7d72b210 con 0x562c7d717a20 2024-04-26T18:35:32.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.388+0000 7f29236ffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562c7d72b8e0 con 0x562c7d7126f0 2024-04-26T18:35:32.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.388+0000 7f29236ffb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562c7d72bfb0 con 0x562c7d711d50 2024-04-26T18:35:32.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.388+0000 7f2912d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d717a20 0x562c7d710d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:32.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.388+0000 7f2912d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d717a20 0x562c7d710d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37506/0 (socket says 172.21.15.80:37506) 2024-04-26T18:35:32.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.388+0000 7f2912d9d700 1 -- 172.21.15.80:0/3365590793 learned_addr learned my addr 172.21.15.80:0/3365590793 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:32.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.388+0000 7f291259c700 1 --2- 172.21.15.80:0/3365590793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562c7d711d50 0x562c7d71e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:32.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.388+0000 7f2911d9b700 1 --2- 172.21.15.80:0/3365590793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c7d7126f0 0x562c7d70c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:32.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.388+0000 7f2912d9d700 1 -- 172.21.15.80:0/3365590793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562c7d711d50 msgr2=0x562c7d71e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:32.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.388+0000 7f2912d9d700 1 --2- 172.21.15.80:0/3365590793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562c7d711d50 0x562c7d71e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.388+0000 7f2912d9d700 1 -- 172.21.15.80:0/3365590793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c7d7126f0 msgr2=0x562c7d70c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:32.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.388+0000 7f2912d9d700 1 --2- 172.21.15.80:0/3365590793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c7d7126f0 0x562c7d70c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.388+0000 7f2912d9d700 1 -- 172.21.15.80:0/3365590793 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c7d7091f0 con 0x562c7d717a20 2024-04-26T18:35:32.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.388+0000 7f2911d9b700 1 --2- 172.21.15.80:0/3365590793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c7d7126f0 0x562c7d70c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:35:32.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.388+0000 7f2912d9d700 1 --2- 172.21.15.80:0/3365590793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d717a20 0x562c7d710d40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f290c098310 tx=0x7f290c098150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3964597770cac136 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:32.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.389+0000 7f28fbfff700 1 -- 172.21.15.80:0/3365590793 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c0a4690 con 0x562c7d717a20 2024-04-26T18:35:32.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.389+0000 7f28fbfff700 1 -- 172.21.15.80:0/3365590793 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f290c0b5070 con 0x562c7d717a20 2024-04-26T18:35:32.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.389+0000 7f28fbfff700 1 -- 172.21.15.80:0/3365590793 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c0b5220 con 0x562c7d717a20 2024-04-26T18:35:32.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.389+0000 7f29236ffb80 1 -- 172.21.15.80:0/3365590793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d717a20 msgr2=0x562c7d710d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:32.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.389+0000 7f29236ffb80 1 --2- 172.21.15.80:0/3365590793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d717a20 0x562c7d710d40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f290c098310 tx=0x7f290c098150 comp rx=0 tx=0).stop 2024-04-26T18:35:32.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.389+0000 7f29236ffb80 1 -- 172.21.15.80:0/3365590793 shutdown_connections 2024-04-26T18:35:32.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.389+0000 7f29236ffb80 1 --2- 172.21.15.80:0/3365590793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d717a20 0x562c7d710d40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.389+0000 7f29236ffb80 1 --2- 172.21.15.80:0/3365590793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562c7d711d50 0x562c7d71e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.389+0000 7f29236ffb80 1 --2- 172.21.15.80:0/3365590793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c7d7126f0 0x562c7d70c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.389+0000 7f29236ffb80 1 -- 172.21.15.80:0/3365590793 >> 172.21.15.80:0/3365590793 conn(0x562c7d640570 msgr2=0x562c7d7115f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:32.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.389+0000 7f29236ffb80 1 -- 172.21.15.80:0/3365590793 shutdown_connections 2024-04-26T18:35:32.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.389+0000 7f29236ffb80 1 -- 172.21.15.80:0/3365590793 wait complete. 2024-04-26T18:35:32.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.390+0000 7f29236ffb80 1 -- start start 2024-04-26T18:35:32.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.390+0000 7f29236ffb80 1 Processor -- start 2024-04-26T18:35:32.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.390+0000 7f29236ffb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d711d50 0x562c7d736350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:32.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.390+0000 7f29236ffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c7d7126f0 0x562c7d736890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:32.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.390+0000 7f29236ffb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562c7d717a20 0x562c7d72f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:32.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.390+0000 7f29236ffb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562c7d72cd50 con 0x562c7d711d50 2024-04-26T18:35:32.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.390+0000 7f29236ffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562c7d72c680 con 0x562c7d7126f0 2024-04-26T18:35:32.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.390+0000 7f29236ffb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562c7d72d420 con 0x562c7d717a20 2024-04-26T18:35:32.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.390+0000 7f29236ffb80 10 client.0 _ll_register_callbacks cb 0x562c7d5fc900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:35:32.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.390+0000 7f291259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d711d50 0x562c7d736350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:32.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.390+0000 7f291259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d711d50 0x562c7d736350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37512/0 (socket says 172.21.15.80:37512) 2024-04-26T18:35:32.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.390+0000 7f291259c700 1 -- 172.21.15.80:0/2597905111 learned_addr learned my addr 172.21.15.80:0/2597905111 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:32.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.390+0000 7f291259c700 1 -- 172.21.15.80:0/2597905111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562c7d717a20 msgr2=0x562c7d72f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:32.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.390+0000 7f291259c700 1 --2- 172.21.15.80:0/2597905111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562c7d717a20 0x562c7d72f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.390+0000 7f291259c700 1 -- 172.21.15.80:0/2597905111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c7d7126f0 msgr2=0x562c7d736890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:32.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.390+0000 7f2911d9b700 1 --2- 172.21.15.80:0/2597905111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c7d7126f0 0x562c7d736890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:32.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.390+0000 7f291259c700 1 --2- 172.21.15.80:0/2597905111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c7d7126f0 0x562c7d736890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.390+0000 7f291259c700 1 -- 172.21.15.80:0/2597905111 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c7d72fc90 con 0x562c7d711d50 2024-04-26T18:35:32.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.390+0000 7f2911d9b700 1 --2- 172.21.15.80:0/2597905111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c7d7126f0 0x562c7d736890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:35:32.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.390+0000 7f291259c700 1 --2- 172.21.15.80:0/2597905111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d711d50 0x562c7d736350 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2904009fd0 tx=0x7f29040047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e6795a1cba8337 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:32.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.390+0000 7f28f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:35:32.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.391+0000 7f28f9ffb700 1 -- 172.21.15.80:0/2597905111 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2904011e50 con 0x562c7d711d50 2024-04-26T18:35:32.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.391+0000 7f28f9ffb700 1 -- 172.21.15.80:0/2597905111 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f2904004830 con 0x562c7d711d50 2024-04-26T18:35:32.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.391+0000 7f29236ffb80 1 -- 172.21.15.80:0/2597905111 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f290c0b5070 con 0x562c7d711d50 2024-04-26T18:35:32.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.391+0000 7f28f9ffb700 1 -- 172.21.15.80:0/2597905111 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2904004a30 con 0x562c7d711d50 2024-04-26T18:35:32.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.391+0000 7f29236ffb80 10 client.15003 fetch_fsmap learned FSMap version 26 2024-04-26T18:35:32.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.391+0000 7f29236ffb80 1 -- 172.21.15.80:0/2597905111 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562c7d7937f0 con 0x562c7d711d50 2024-04-26T18:35:32.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.391+0000 7f28f9ffb700 1 -- 172.21.15.80:0/2597905111 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f290c0b5070 con 0x562c7d711d50 2024-04-26T18:35:32.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.391+0000 7f28f9ffb700 1 -- 172.21.15.80:0/2597905111 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f290400f040 con 0x562c7d711d50 2024-04-26T18:35:32.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.391+0000 7f29236ffb80 10 client.15003 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:35:32.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.391+0000 7f29236ffb80 10 client.15003 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T18:35:32.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.391+0000 7f29236ffb80 20 client.15003 populate_metadata read hostname 'smithi080' 2024-04-26T18:35:32.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.391+0000 7f29236ffb80 1 --2- 172.21.15.80:0/2597905111 >> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] conn(0x562c7d7984d0 0x562c7d7971e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:32.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.391+0000 7f29236ffb80 4 client.15003 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T18:35:32.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.391+0000 7f29236ffb80 1 -- 172.21.15.80:0/2597905111 --> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] -- command(tid 0: {"prefix": "status"}) -- 0x562c7d66c260 con 0x562c7d7984d0 2024-04-26T18:35:32.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.391+0000 7f2911d9b700 1 --2- 172.21.15.80:0/2597905111 >> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] conn(0x562c7d7984d0 0x562c7d7971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:32.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.392+0000 7f28f9ffb700 10 client.15003 ms_handle_connect on v2:172.21.15.192:6838/2735406056 2024-04-26T18:35:32.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.392+0000 7f2911d9b700 1 --2- 172.21.15.80:0/2597905111 >> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] conn(0x562c7d7984d0 0x562c7d7971e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9b9481a0f74546ab server_cookie=55257ebd4cb2f937 in_seq=0 out_seq=0 2024-04-26T18:35:32.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.392+0000 7f28f9ffb700 1 -- 172.21.15.80:0/2597905111 <== mds.1 v2:172.21.15.192:6838/2735406056 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x562c7d66c260 con 0x562c7d7984d0 2024-04-26T18:35:32.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.392+0000 7f28f9ffb700 10 client.15003 handle_command_reply: tid=0 2024-04-26T18:35:32.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.392+0000 7f29236ffb80 1 client.15003 shutdown 2024-04-26T18:35:32.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.392+0000 7f29236ffb80 1 -- 172.21.15.80:0/2597905111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d711d50 msgr2=0x562c7d736350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:32.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.392+0000 7f29236ffb80 1 --2- 172.21.15.80:0/2597905111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d711d50 0x562c7d736350 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2904009fd0 tx=0x7f29040047c0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.392+0000 7f29236ffb80 1 -- 172.21.15.80:0/2597905111 shutdown_connections 2024-04-26T18:35:32.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.392+0000 7f29236ffb80 1 --2- 172.21.15.80:0/2597905111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562c7d717a20 0x562c7d72f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.392+0000 7f29236ffb80 1 --2- 172.21.15.80:0/2597905111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562c7d711d50 0x562c7d736350 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.392+0000 7f29236ffb80 1 --2- 172.21.15.80:0/2597905111 >> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] conn(0x562c7d7984d0 0x562c7d7971e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.392+0000 7f29236ffb80 1 --2- 172.21.15.80:0/2597905111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c7d7126f0 0x562c7d736890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.392+0000 7f28f9ffb700 0 client.15003 ms_handle_reset on v2:172.21.15.192:6838/2735406056 2024-04-26T18:35:32.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.392+0000 7f29236ffb80 1 -- 172.21.15.80:0/2597905111 >> 172.21.15.80:0/2597905111 conn(0x562c7d640570 msgr2=0x562c7d71aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:32.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.392+0000 7f29236ffb80 1 -- 172.21.15.80:0/2597905111 shutdown_connections 2024-04-26T18:35:32.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.392+0000 7f29236ffb80 1 -- 172.21.15.80:0/2597905111 wait complete. 2024-04-26T18:35:32.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.392+0000 7f29236ffb80 20 client.15003 trim_cache size 0 max 16384 2024-04-26T18:35:32.399 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:35:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "2187ca98-03fa-11ef-bc93-c7b262605968", 2024-04-26T18:35:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 1, 2024-04-26T18:35:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24421, 2024-04-26T18:35:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-26T18:35:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-26T18:35:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-26T18:35:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 131.75075255900001, 2024-04-26T18:35:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 26, 2024-04-26T18:35:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 91, 2024-04-26T18:35:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T18:35:32.399 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 170.83063940700001 2024-04-26T18:35:32.399 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:35:32.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.393+0000 7f2918e6d700 1 -- 172.21.15.80:0/2329518800 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f28fc0a3c40 msgr2=0x7f28fc0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:32.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.393+0000 7f2918e6d700 1 --2- 172.21.15.80:0/2329518800 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f28fc0a3c40 0x7f28fc0a6100 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2904005fd0 tx=0x7f2904005ee0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.393+0000 7f2918e6d700 1 -- 172.21.15.80:0/2329518800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29141094e0 msgr2=0x7f29140761a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:32.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.393+0000 7f2918e6d700 1 --2- 172.21.15.80:0/2329518800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29141094e0 0x7f29140761a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f290c007ee0 tx=0x7f290c00d3b0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.393+0000 7f2918e6d700 1 -- 172.21.15.80:0/2329518800 shutdown_connections 2024-04-26T18:35:32.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.393+0000 7f2918e6d700 1 --2- 172.21.15.80:0/2329518800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29141094e0 0x7f29140761a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.393+0000 7f2918e6d700 1 --2- 172.21.15.80:0/2329518800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29141034a0 0x7f2914075720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.393+0000 7f2918e6d700 1 --2- 172.21.15.80:0/2329518800 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f28fc0a3c40 0x7f28fc0a6100 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.393+0000 7f2918e6d700 1 --2- 172.21.15.80:0/2329518800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2914103e40 0x7f2914075c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:32.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.393+0000 7f2918e6d700 1 -- 172.21.15.80:0/2329518800 >> 172.21.15.80:0/2329518800 conn(0x7f291407a4f0 msgr2=0x7f2914101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:32.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.393+0000 7f2918e6d700 1 -- 172.21.15.80:0/2329518800 shutdown_connections 2024-04-26T18:35:32.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:32.393+0000 7f2918e6d700 1 -- 172.21.15.80:0/2329518800 wait complete. 2024-04-26T18:35:33.091 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell mds.b status 2024-04-26T18:35:33.328 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:35:33.715 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:33 smithi080 ceph-mon[29135]: pgmap v372: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:35:33.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:33 smithi082 ceph-mon[32808]: pgmap v372: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:35:34.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:33 smithi192 ceph-mon[32842]: pgmap v372: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:35:35.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.034+0000 7fa33b128700 1 -- 172.21.15.80:0/3108489945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa334102320 msgr2=0x7fa3341027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:35.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.034+0000 7fa33b128700 1 --2- 172.21.15.80:0/3108489945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa334102320 0x7fa3341027a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa320009990 tx=0x7fa320009ca0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.034+0000 7fa33b128700 1 -- 172.21.15.80:0/3108489945 shutdown_connections 2024-04-26T18:35:35.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.034+0000 7fa33b128700 1 --2- 172.21.15.80:0/3108489945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa334102ce0 0x7fa33410f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.034+0000 7fa33b128700 1 --2- 172.21.15.80:0/3108489945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa334108390 0x7fa334108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.034+0000 7fa33b128700 1 --2- 172.21.15.80:0/3108489945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa334102320 0x7fa3341027a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.034+0000 7fa33b128700 1 -- 172.21.15.80:0/3108489945 >> 172.21.15.80:0/3108489945 conn(0x7fa3340792d0 msgr2=0x7fa3340796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:35.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.034+0000 7fa33b128700 1 -- 172.21.15.80:0/3108489945 shutdown_connections 2024-04-26T18:35:35.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.034+0000 7fa33b128700 1 -- 172.21.15.80:0/3108489945 wait complete. 2024-04-26T18:35:35.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.035+0000 7fa33b128700 1 Processor -- start 2024-04-26T18:35:35.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.035+0000 7fa33b128700 1 -- start start 2024-04-26T18:35:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.035+0000 7fa33b128700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa334102320 0x7fa33419f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.035+0000 7fa33b128700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa334102ce0 0x7fa33419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.035+0000 7fa33b128700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa334108390 0x7fa334199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.035+0000 7fa33b128700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa334112530 con 0x7fa334108390 2024-04-26T18:35:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.035+0000 7fa33b128700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa3341123b0 con 0x7fa334102320 2024-04-26T18:35:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.035+0000 7fa33b128700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa3341126b0 con 0x7fa334102ce0 2024-04-26T18:35:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.035+0000 7fa3396c5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa334108390 0x7fa334199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.035+0000 7fa3396c5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa334108390 0x7fa334199970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44506/0 (socket says 172.21.15.80:44506) 2024-04-26T18:35:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.035+0000 7fa3396c5700 1 -- 172.21.15.80:0/209736758 learned_addr learned my addr 172.21.15.80:0/209736758 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.035+0000 7fa333fff700 1 --2- 172.21.15.80:0/209736758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa334102ce0 0x7fa33419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.035+0000 7fa338ec4700 1 --2- 172.21.15.80:0/209736758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa334102320 0x7fa33419f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.036+0000 7fa3396c5700 1 -- 172.21.15.80:0/209736758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa334102ce0 msgr2=0x7fa33419fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.036+0000 7fa3396c5700 1 --2- 172.21.15.80:0/209736758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa334102ce0 0x7fa33419fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.036+0000 7fa3396c5700 1 -- 172.21.15.80:0/209736758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa334102320 msgr2=0x7fa33419f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.036+0000 7fa3396c5700 1 --2- 172.21.15.80:0/209736758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa334102320 0x7fa33419f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.036+0000 7fa3396c5700 1 -- 172.21.15.80:0/209736758 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa33419a0d0 con 0x7fa334108390 2024-04-26T18:35:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.036+0000 7fa3396c5700 1 --2- 172.21.15.80:0/209736758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa334108390 0x7fa334199970 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa32c007ee0 tx=0x7fa32c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.036+0000 7fa331ffb700 1 -- 172.21.15.80:0/209736758 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c00dbd0 con 0x7fa334108390 2024-04-26T18:35:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.036+0000 7fa331ffb700 1 -- 172.21.15.80:0/209736758 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa32c00dd70 con 0x7fa334108390 2024-04-26T18:35:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.036+0000 7fa33b128700 1 -- 172.21.15.80:0/209736758 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa33419a3c0 con 0x7fa334108390 2024-04-26T18:35:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.036+0000 7fa331ffb700 1 -- 172.21.15.80:0/209736758 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c005990 con 0x7fa334108390 2024-04-26T18:35:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.036+0000 7fa33b128700 1 -- 172.21.15.80:0/209736758 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3341a6680 con 0x7fa334108390 2024-04-26T18:35:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.039+0000 7fa331ffb700 1 -- 172.21.15.80:0/209736758 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fa32c01a020 con 0x7fa334108390 2024-04-26T18:35:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.039+0000 7fa331ffb700 1 --2- 172.21.15.80:0/209736758 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fa3240a3c40 0x7fa3240a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.039+0000 7fa338ec4700 1 --2- 172.21.15.80:0/209736758 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fa3240a3c40 0x7fa3240a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.039+0000 7fa331ffb700 1 -- 172.21.15.80:0/209736758 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fa32c0cfba0 con 0x7fa334108390 2024-04-26T18:35:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.040+0000 7fa338ec4700 1 --2- 172.21.15.80:0/209736758 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fa3240a3c40 0x7fa3240a6100 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa328006fd0 tx=0x7fa328008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.040+0000 7fa3459bab80 1 Processor -- start 2024-04-26T18:35:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.040+0000 7fa3459bab80 1 -- start start 2024-04-26T18:35:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.040+0000 7fa3459bab80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5585311f4ad0 0x5585311f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.040+0000 7fa3459bab80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f53f0 0x5585311eecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.040+0000 7fa3459bab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585311ef2d0 0x5585311ef710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.040+0000 7fa3459bab80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5585311416f0 con 0x5585311f53f0 2024-04-26T18:35:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.040+0000 7fa3459bab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5585310e0590 con 0x5585311ef2d0 2024-04-26T18:35:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.040+0000 7fa3459bab80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55853113d6b0 con 0x5585311f4ad0 2024-04-26T18:35:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.041+0000 7fa333fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f53f0 0x5585311eecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.041+0000 7fa333fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f53f0 0x5585311eecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44518/0 (socket says 172.21.15.80:44518) 2024-04-26T18:35:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.041+0000 7fa333fff700 1 -- 172.21.15.80:0/3969632683 learned_addr learned my addr 172.21.15.80:0/3969632683 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.041+0000 7fa338ec4700 1 --2- 172.21.15.80:0/3969632683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5585311f4ad0 0x5585311f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.041+0000 7fa3396c5700 1 --2- 172.21.15.80:0/3969632683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585311ef2d0 0x5585311ef710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.041+0000 7fa333fff700 1 -- 172.21.15.80:0/3969632683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5585311f4ad0 msgr2=0x5585311f4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.041+0000 7fa333fff700 1 --2- 172.21.15.80:0/3969632683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5585311f4ad0 0x5585311f4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.041+0000 7fa333fff700 1 -- 172.21.15.80:0/3969632683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585311ef2d0 msgr2=0x5585311ef710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.041+0000 7fa333fff700 1 --2- 172.21.15.80:0/3969632683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585311ef2d0 0x5585311ef710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.041+0000 7fa333fff700 1 -- 172.21.15.80:0/3969632683 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55853108e880 con 0x5585311f53f0 2024-04-26T18:35:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.041+0000 7fa338ec4700 1 --2- 172.21.15.80:0/3969632683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5585311f4ad0 0x5585311f4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:35:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.041+0000 7fa333fff700 1 --2- 172.21.15.80:0/3969632683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f53f0 0x5585311eecb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa320009990 tx=0x7fa320005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe2e2a591934801 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.041+0000 7fa31effd700 1 -- 172.21.15.80:0/3969632683 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa320003a60 con 0x5585311f53f0 2024-04-26T18:35:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.041+0000 7fa31effd700 1 -- 172.21.15.80:0/3969632683 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa320026070 con 0x5585311f53f0 2024-04-26T18:35:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.041+0000 7fa31effd700 1 -- 172.21.15.80:0/3969632683 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa320005360 con 0x5585311f53f0 2024-04-26T18:35:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.042+0000 7fa3459bab80 1 -- 172.21.15.80:0/3969632683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f53f0 msgr2=0x5585311eecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.042+0000 7fa3459bab80 1 --2- 172.21.15.80:0/3969632683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f53f0 0x5585311eecb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa320009990 tx=0x7fa320005c70 comp rx=0 tx=0).stop 2024-04-26T18:35:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.042+0000 7fa3459bab80 1 -- 172.21.15.80:0/3969632683 shutdown_connections 2024-04-26T18:35:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.042+0000 7fa3459bab80 1 --2- 172.21.15.80:0/3969632683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585311ef2d0 0x5585311ef710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.042+0000 7fa3459bab80 1 --2- 172.21.15.80:0/3969632683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5585311f4ad0 0x5585311f4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.042+0000 7fa3459bab80 1 --2- 172.21.15.80:0/3969632683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f53f0 0x5585311eecb0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.042+0000 7fa3459bab80 1 -- 172.21.15.80:0/3969632683 >> 172.21.15.80:0/3969632683 conn(0x55853111bcf0 msgr2=0x5585311ea1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.042+0000 7fa3459bab80 1 -- 172.21.15.80:0/3969632683 shutdown_connections 2024-04-26T18:35:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.042+0000 7fa3459bab80 1 -- 172.21.15.80:0/3969632683 wait complete. 2024-04-26T18:35:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.042+0000 7fa3459bab80 1 -- start start 2024-04-26T18:35:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.043+0000 7fa3459bab80 1 Processor -- start 2024-04-26T18:35:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.043+0000 7fa3459bab80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5585311ef2d0 0x5585311fb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.043+0000 7fa3459bab80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f4ad0 0x5585311f8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.043+0000 7fa3459bab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585311f53f0 0x5585311f8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.043+0000 7fa3459bab80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5585311fbeb0 con 0x5585311f4ad0 2024-04-26T18:35:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.043+0000 7fa3459bab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5585310a7900 con 0x5585311f53f0 2024-04-26T18:35:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.043+0000 7fa3459bab80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5585311fc030 con 0x5585311ef2d0 2024-04-26T18:35:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.043+0000 7fa3459bab80 10 client.0 _ll_register_callbacks cb 0x5585310d5530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:35:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.043+0000 7fa333fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f4ad0 0x5585311f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.043+0000 7fa333fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f4ad0 0x5585311f8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44532/0 (socket says 172.21.15.80:44532) 2024-04-26T18:35:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.043+0000 7fa333fff700 1 -- 172.21.15.80:0/2410530335 learned_addr learned my addr 172.21.15.80:0/2410530335 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.043+0000 7fa338ec4700 1 --2- 172.21.15.80:0/2410530335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5585311ef2d0 0x5585311fb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.043+0000 7fa3396c5700 1 --2- 172.21.15.80:0/2410530335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585311f53f0 0x5585311f8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.043+0000 7fa333fff700 1 -- 172.21.15.80:0/2410530335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5585311ef2d0 msgr2=0x5585311fb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.043+0000 7fa333fff700 1 --2- 172.21.15.80:0/2410530335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5585311ef2d0 0x5585311fb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.043+0000 7fa333fff700 1 -- 172.21.15.80:0/2410530335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585311f53f0 msgr2=0x5585311f8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.043+0000 7fa333fff700 1 --2- 172.21.15.80:0/2410530335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585311f53f0 0x5585311f8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.043+0000 7fa333fff700 1 -- 172.21.15.80:0/2410530335 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585311f8f90 con 0x5585311f4ad0 2024-04-26T18:35:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.043+0000 7fa3396c5700 1 --2- 172.21.15.80:0/2410530335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585311f53f0 0x5585311f8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:35:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.044+0000 7fa333fff700 1 --2- 172.21.15.80:0/2410530335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f4ad0 0x5585311f8410 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa3200098e0 tx=0x7fa32000ba80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10ba4fd22cdeaed server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.044+0000 7fa313fff700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:35:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.044+0000 7fa313fff700 1 -- 172.21.15.80:0/2410530335 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa320005270 con 0x5585311f4ad0 2024-04-26T18:35:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.044+0000 7fa313fff700 1 -- 172.21.15.80:0/2410530335 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fa320005410 con 0x5585311f4ad0 2024-04-26T18:35:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.044+0000 7fa3459bab80 1 -- 172.21.15.80:0/2410530335 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa320026070 con 0x5585311f4ad0 2024-04-26T18:35:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.044+0000 7fa313fff700 1 -- 172.21.15.80:0/2410530335 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa320039070 con 0x5585311f4ad0 2024-04-26T18:35:35.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.044+0000 7fa3459bab80 10 client.15015 fetch_fsmap learned FSMap version 26 2024-04-26T18:35:35.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.044+0000 7fa3459bab80 1 -- 172.21.15.80:0/2410530335 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55853120acb0 con 0x5585311f4ad0 2024-04-26T18:35:35.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.044+0000 7fa313fff700 1 -- 172.21.15.80:0/2410530335 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa320026070 con 0x5585311f4ad0 2024-04-26T18:35:35.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.044+0000 7fa313fff700 1 -- 172.21.15.80:0/2410530335 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fa320032400 con 0x5585311f4ad0 2024-04-26T18:35:35.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.044+0000 7fa3459bab80 10 client.15015 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:35:35.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.044+0000 7fa3459bab80 10 client.15015 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T18:35:35.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.044+0000 7fa3459bab80 20 client.15015 populate_metadata read hostname 'smithi080' 2024-04-26T18:35:35.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.044+0000 7fa3459bab80 1 --2- 172.21.15.80:0/2410530335 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55853120c000 0x55853120e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:35.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.044+0000 7fa3459bab80 4 client.15015 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:35:35.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.044+0000 7fa3459bab80 1 -- 172.21.15.80:0/2410530335 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55853114f0d0 con 0x55853120c000 2024-04-26T18:35:35.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.045+0000 7fa338ec4700 1 --2- 172.21.15.80:0/2410530335 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55853120c000 0x55853120e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:35.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.045+0000 7fa338ec4700 1 --2- 172.21.15.80:0/2410530335 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55853120c000 0x55853120e1e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d9293c3edfd58d3 server_cookie=365bdaecb7954a91 in_seq=0 out_seq=0 2024-04-26T18:35:35.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.045+0000 7fa313fff700 10 client.15015 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:35:35.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.046+0000 7fa313fff700 1 -- 172.21.15.80:0/2410530335 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55853114f0d0 con 0x55853120c000 2024-04-26T18:35:35.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.046+0000 7fa313fff700 10 client.15015 handle_command_reply: tid=0 2024-04-26T18:35:35.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.046+0000 7fa3459bab80 1 client.15015 shutdown 2024-04-26T18:35:35.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.046+0000 7fa3459bab80 1 -- 172.21.15.80:0/2410530335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f4ad0 msgr2=0x5585311f8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:35.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.046+0000 7fa3459bab80 1 --2- 172.21.15.80:0/2410530335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f4ad0 0x5585311f8410 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa3200098e0 tx=0x7fa32000ba80 comp rx=0 tx=0).stop 2024-04-26T18:35:35.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.046+0000 7fa3459bab80 1 -- 172.21.15.80:0/2410530335 shutdown_connections 2024-04-26T18:35:35.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.046+0000 7fa3459bab80 1 --2- 172.21.15.80:0/2410530335 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55853120c000 0x55853120e1e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.046+0000 7fa3459bab80 1 --2- 172.21.15.80:0/2410530335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585311f53f0 0x5585311f8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.046+0000 7fa3459bab80 1 --2- 172.21.15.80:0/2410530335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5585311ef2d0 0x5585311fb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.046+0000 7fa3459bab80 1 --2- 172.21.15.80:0/2410530335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f4ad0 0x5585311f8410 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.046+0000 7fa3459bab80 1 -- 172.21.15.80:0/2410530335 >> 172.21.15.80:0/2410530335 conn(0x55853111bcf0 msgr2=0x5585311e9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:35.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.046+0000 7fa313fff700 0 client.15015 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:35:35.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.046+0000 7fa3459bab80 1 -- 172.21.15.80:0/2410530335 shutdown_connections 2024-04-26T18:35:35.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.046+0000 7fa3459bab80 1 -- 172.21.15.80:0/2410530335 wait complete. 2024-04-26T18:35:35.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.046+0000 7fa3459bab80 20 client.15015 trim_cache size 0 max 16384 2024-04-26T18:35:35.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.068+0000 7fa3459bab80 1 Processor -- start 2024-04-26T18:35:35.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.068+0000 7fa3459bab80 1 -- start start 2024-04-26T18:35:35.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.068+0000 7fa3459bab80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5585311ef2d0 0x55853120c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:35.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.068+0000 7fa3459bab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585311f4ad0 0x5585311f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.068+0000 7fa3459bab80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f53f0 0x5585311f9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.068+0000 7fa3459bab80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55853120c520 con 0x5585311f53f0 2024-04-26T18:35:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.068+0000 7fa3459bab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55853120cbf0 con 0x5585311f4ad0 2024-04-26T18:35:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.068+0000 7fa3459bab80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55853120d2c0 con 0x5585311ef2d0 2024-04-26T18:35:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.068+0000 7fa3396c5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f53f0 0x5585311f9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.068+0000 7fa3396c5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f53f0 0x5585311f9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44540/0 (socket says 172.21.15.80:44540) 2024-04-26T18:35:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.069+0000 7fa3396c5700 1 -- 172.21.15.80:0/1895204060 learned_addr learned my addr 172.21.15.80:0/1895204060 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.069+0000 7fa338ec4700 1 --2- 172.21.15.80:0/1895204060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5585311ef2d0 0x55853120c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.069+0000 7fa333fff700 1 --2- 172.21.15.80:0/1895204060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585311f4ad0 0x5585311f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.069+0000 7fa3396c5700 1 -- 172.21.15.80:0/1895204060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5585311ef2d0 msgr2=0x55853120c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.069+0000 7fa3396c5700 1 --2- 172.21.15.80:0/1895204060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5585311ef2d0 0x55853120c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.069+0000 7fa3396c5700 1 -- 172.21.15.80:0/1895204060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585311f4ad0 msgr2=0x5585311f5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.069+0000 7fa3396c5700 1 --2- 172.21.15.80:0/1895204060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585311f4ad0 0x5585311f5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.069+0000 7fa3396c5700 1 -- 172.21.15.80:0/1895204060 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585311fb5e0 con 0x5585311f53f0 2024-04-26T18:35:35.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.069+0000 7fa333fff700 1 --2- 172.21.15.80:0/1895204060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585311f4ad0 0x5585311f5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:35:35.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.069+0000 7fa3396c5700 1 --2- 172.21.15.80:0/1895204060 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f53f0 0x5585311f9c40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa32c09bbb0 tx=0x7fa32c0cd5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a61b2ace6ac4c2c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:35.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.069+0000 7fa31e7fc700 1 -- 172.21.15.80:0/1895204060 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c09beb0 con 0x5585311f53f0 2024-04-26T18:35:35.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.069+0000 7fa31e7fc700 1 -- 172.21.15.80:0/1895204060 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa32c0b5070 con 0x5585311f53f0 2024-04-26T18:35:35.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.069+0000 7fa31e7fc700 1 -- 172.21.15.80:0/1895204060 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c0b5220 con 0x5585311f53f0 2024-04-26T18:35:35.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.070+0000 7fa3459bab80 1 -- 172.21.15.80:0/1895204060 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f53f0 msgr2=0x5585311f9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:35.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.070+0000 7fa3459bab80 1 --2- 172.21.15.80:0/1895204060 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f53f0 0x5585311f9c40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa32c09bbb0 tx=0x7fa32c0cd5a0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.070+0000 7fa3459bab80 1 -- 172.21.15.80:0/1895204060 shutdown_connections 2024-04-26T18:35:35.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.070+0000 7fa3459bab80 1 --2- 172.21.15.80:0/1895204060 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f53f0 0x5585311f9c40 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.070+0000 7fa3459bab80 1 --2- 172.21.15.80:0/1895204060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5585311ef2d0 0x55853120c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.070+0000 7fa3459bab80 1 --2- 172.21.15.80:0/1895204060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585311f4ad0 0x5585311f5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.070+0000 7fa3459bab80 1 -- 172.21.15.80:0/1895204060 >> 172.21.15.80:0/1895204060 conn(0x55853111bcf0 msgr2=0x5585311f57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:35.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.070+0000 7fa3459bab80 1 -- 172.21.15.80:0/1895204060 shutdown_connections 2024-04-26T18:35:35.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.070+0000 7fa3459bab80 1 -- 172.21.15.80:0/1895204060 wait complete. 2024-04-26T18:35:35.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.070+0000 7fa3459bab80 1 -- start start 2024-04-26T18:35:35.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.070+0000 7fa3459bab80 1 Processor -- start 2024-04-26T18:35:35.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.071+0000 7fa3459bab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585311ef2d0 0x5585311fa240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:35.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.071+0000 7fa3459bab80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5585311f4ad0 0x5585311fa780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:35.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.071+0000 7fa3459bab80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f53f0 0x5585311facc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:35.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.071+0000 7fa3459bab80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55853120e060 con 0x5585311f53f0 2024-04-26T18:35:35.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.071+0000 7fa3459bab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55853120d990 con 0x5585311ef2d0 2024-04-26T18:35:35.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.071+0000 7fa3459bab80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55853120e730 con 0x5585311f4ad0 2024-04-26T18:35:35.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.071+0000 7fa3459bab80 10 client.0 _ll_register_callbacks cb 0x5585310d5530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:35:35.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.071+0000 7fa3396c5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f53f0 0x5585311facc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:35.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.071+0000 7fa3396c5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f53f0 0x5585311facc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44550/0 (socket says 172.21.15.80:44550) 2024-04-26T18:35:35.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.071+0000 7fa3396c5700 1 -- 172.21.15.80:0/1248089980 learned_addr learned my addr 172.21.15.80:0/1248089980 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:35.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.071+0000 7fa333fff700 1 --2- 172.21.15.80:0/1248089980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5585311f4ad0 0x5585311fa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:35.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.071+0000 7fa338ec4700 1 --2- 172.21.15.80:0/1248089980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585311ef2d0 0x5585311fa240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:35.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.071+0000 7fa3396c5700 1 -- 172.21.15.80:0/1248089980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5585311f4ad0 msgr2=0x5585311fa780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:35.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.071+0000 7fa3396c5700 1 --2- 172.21.15.80:0/1248089980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5585311f4ad0 0x5585311fa780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.071+0000 7fa3396c5700 1 -- 172.21.15.80:0/1248089980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585311ef2d0 msgr2=0x5585311fa240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:35:35.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.071+0000 7fa3396c5700 1 --2- 172.21.15.80:0/1248089980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585311ef2d0 0x5585311fa240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.071+0000 7fa3396c5700 1 -- 172.21.15.80:0/1248089980 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558531215920 con 0x5585311f53f0 2024-04-26T18:35:35.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.071+0000 7fa3396c5700 1 --2- 172.21.15.80:0/1248089980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f53f0 0x5585311facc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa32c098880 tx=0x7fa32c0a02e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3985ddb1a124e9c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:35.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.071+0000 7fa313fff700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:35:35.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.071+0000 7fa313fff700 1 -- 172.21.15.80:0/1248089980 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c0b5220 con 0x5585311f53f0 2024-04-26T18:35:35.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.071+0000 7fa313fff700 1 -- 172.21.15.80:0/1248089980 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fa32c0b53c0 con 0x5585311f53f0 2024-04-26T18:35:35.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.071+0000 7fa3459bab80 1 -- 172.21.15.80:0/1248089980 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa32c0b5070 con 0x5585311f53f0 2024-04-26T18:35:35.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.072+0000 7fa313fff700 1 -- 172.21.15.80:0/1248089980 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa32c09c110 con 0x5585311f53f0 2024-04-26T18:35:35.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.072+0000 7fa3459bab80 10 client.15021 fetch_fsmap learned FSMap version 26 2024-04-26T18:35:35.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.072+0000 7fa3459bab80 1 -- 172.21.15.80:0/1248089980 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558531274170 con 0x5585311f53f0 2024-04-26T18:35:35.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.072+0000 7fa313fff700 1 -- 172.21.15.80:0/1248089980 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa32c0b5070 con 0x5585311f53f0 2024-04-26T18:35:35.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.072+0000 7fa313fff700 1 -- 172.21.15.80:0/1248089980 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fa32c0cdb90 con 0x5585311f53f0 2024-04-26T18:35:35.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.072+0000 7fa3459bab80 10 client.15021 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:35:35.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.072+0000 7fa3459bab80 10 client.15021 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T18:35:35.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.072+0000 7fa3459bab80 20 client.15021 populate_metadata read hostname 'smithi080' 2024-04-26T18:35:35.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.072+0000 7fa3459bab80 1 --2- 172.21.15.80:0/1248089980 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x558531278760 0x558531277470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:35.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.072+0000 7fa3459bab80 4 client.15021 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T18:35:35.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.072+0000 7fa3459bab80 1 -- 172.21.15.80:0/1248089980 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "status"}) -- 0x558531149170 con 0x558531278760 2024-04-26T18:35:35.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.072+0000 7fa338ec4700 1 --2- 172.21.15.80:0/1248089980 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x558531278760 0x558531277470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:35.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.073+0000 7fa313fff700 10 client.15021 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:35:35.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.073+0000 7fa338ec4700 1 --2- 172.21.15.80:0/1248089980 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x558531278760 0x558531277470 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9af89f3c0592c50 server_cookie=b42960a5c06da7fa in_seq=0 out_seq=0 2024-04-26T18:35:35.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.073+0000 7fa313fff700 1 -- 172.21.15.80:0/1248089980 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x558531149170 con 0x558531278760 2024-04-26T18:35:35.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.073+0000 7fa313fff700 10 client.15021 handle_command_reply: tid=0 2024-04-26T18:35:35.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.073+0000 7fa3459bab80 1 client.15021 shutdown 2024-04-26T18:35:35.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.073+0000 7fa3459bab80 1 -- 172.21.15.80:0/1248089980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f53f0 msgr2=0x5585311facc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:35.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.073+0000 7fa3459bab80 1 --2- 172.21.15.80:0/1248089980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f53f0 0x5585311facc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa32c098880 tx=0x7fa32c0a02e0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.073+0000 7fa3459bab80 1 -- 172.21.15.80:0/1248089980 shutdown_connections 2024-04-26T18:35:35.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.073+0000 7fa3459bab80 1 --2- 172.21.15.80:0/1248089980 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x558531278760 0x558531277470 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.073+0000 7fa3459bab80 1 --2- 172.21.15.80:0/1248089980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5585311f53f0 0x5585311facc0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.073+0000 7fa3459bab80 1 --2- 172.21.15.80:0/1248089980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585311ef2d0 0x5585311fa240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.073+0000 7fa3459bab80 1 --2- 172.21.15.80:0/1248089980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5585311f4ad0 0x5585311fa780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.073+0000 7fa3459bab80 1 -- 172.21.15.80:0/1248089980 >> 172.21.15.80:0/1248089980 conn(0x55853111bcf0 msgr2=0x5585311f5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:35.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.073+0000 7fa313fff700 0 client.15021 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:35:35.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.073+0000 7fa3459bab80 1 -- 172.21.15.80:0/1248089980 shutdown_connections 2024-04-26T18:35:35.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.073+0000 7fa3459bab80 1 -- 172.21.15.80:0/1248089980 wait complete. 2024-04-26T18:35:35.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.073+0000 7fa3459bab80 20 client.15021 trim_cache size 0 max 16384 2024-04-26T18:35:35.079 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:35:35.079 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "2187ca98-03fa-11ef-bc93-c7b262605968", 2024-04-26T18:35:35.079 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2024-04-26T18:35:35.079 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24434, 2024-04-26T18:35:35.079 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-26T18:35:35.080 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-26T18:35:35.080 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-26T18:35:35.080 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 146.520579717, 2024-04-26T18:35:35.080 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 26, 2024-04-26T18:35:35.080 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 91, 2024-04-26T18:35:35.080 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T18:35:35.080 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 163.22143565299999 2024-04-26T18:35:35.080 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:35:35.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.074+0000 7fa33b128700 1 -- 172.21.15.80:0/209736758 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fa3240a3c40 msgr2=0x7fa3240a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:35.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.074+0000 7fa33b128700 1 --2- 172.21.15.80:0/209736758 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fa3240a3c40 0x7fa3240a6100 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa328006fd0 tx=0x7fa328008040 comp rx=0 tx=0).stop 2024-04-26T18:35:35.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.074+0000 7fa33b128700 1 -- 172.21.15.80:0/209736758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa334108390 msgr2=0x7fa334199970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:35.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.074+0000 7fa33b128700 1 --2- 172.21.15.80:0/209736758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa334108390 0x7fa334199970 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa32c007ee0 tx=0x7fa32c00d3b0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.074+0000 7fa33b128700 1 -- 172.21.15.80:0/209736758 shutdown_connections 2024-04-26T18:35:35.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.074+0000 7fa33b128700 1 --2- 172.21.15.80:0/209736758 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa334108390 0x7fa334199970 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.074+0000 7fa33b128700 1 --2- 172.21.15.80:0/209736758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa334102320 0x7fa33419f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.074+0000 7fa33b128700 1 --2- 172.21.15.80:0/209736758 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fa3240a3c40 0x7fa3240a6100 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.074+0000 7fa33b128700 1 --2- 172.21.15.80:0/209736758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa334102ce0 0x7fa33419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:35.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.074+0000 7fa33b128700 1 -- 172.21.15.80:0/209736758 >> 172.21.15.80:0/209736758 conn(0x7fa3340792d0 msgr2=0x7fa334101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:35.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.074+0000 7fa33b128700 1 -- 172.21.15.80:0/209736758 shutdown_connections 2024-04-26T18:35:35.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:35.074+0000 7fa33b128700 1 -- 172.21.15.80:0/209736758 wait complete. 2024-04-26T18:35:35.772 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:35 smithi080 ceph-mon[29135]: pgmap v373: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:35.803 INFO:tasks.cephadm:Setup complete, yielding 2024-04-26T18:35:35.803 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T18:35:35.814 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi080.front.sepia.ceph.com 2024-04-26T18:35:35.814 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- bash -c 'ceph orch status' 2024-04-26T18:35:35.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:35 smithi082 ceph-mon[32808]: pgmap v373: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:36.054 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:35:36.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:35 smithi192 ceph-mon[32842]: pgmap v373: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:37.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:37 smithi080 ceph-mon[29135]: pgmap v374: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:35:37.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.747+0000 7fe079059700 1 -- 172.21.15.80:0/365077745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe074103570 msgr2=0x7fe0741039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:37.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.747+0000 7fe079059700 1 --2- 172.21.15.80:0/365077745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe074103570 0x7fe0741039d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe0640099c0 tx=0x7fe064009cd0 comp rx=0 tx=0).stop 2024-04-26T18:35:37.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.747+0000 7fe079059700 1 -- 172.21.15.80:0/365077745 shutdown_connections 2024-04-26T18:35:37.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.747+0000 7fe079059700 1 --2- 172.21.15.80:0/365077745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe074103f10 0x7fe07410a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:37.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.747+0000 7fe079059700 1 --2- 172.21.15.80:0/365077745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe074102370 0x7fe074102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:37.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.747+0000 7fe079059700 1 --2- 172.21.15.80:0/365077745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe074103570 0x7fe0741039d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:37.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.747+0000 7fe079059700 1 -- 172.21.15.80:0/365077745 >> 172.21.15.80:0/365077745 conn(0x7fe0740fd910 msgr2=0x7fe0740ffd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:37.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.747+0000 7fe079059700 1 -- 172.21.15.80:0/365077745 shutdown_connections 2024-04-26T18:35:37.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.747+0000 7fe079059700 1 -- 172.21.15.80:0/365077745 wait complete. 2024-04-26T18:35:37.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.748+0000 7fe079059700 1 Processor -- start 2024-04-26T18:35:37.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.748+0000 7fe079059700 1 -- start start 2024-04-26T18:35:37.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.748+0000 7fe079059700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe074102370 0x7fe074199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:37.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.748+0000 7fe079059700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe074103570 0x7fe074199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:37.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.748+0000 7fe079059700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe074103f10 0x7fe0741a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:37.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.748+0000 7fe079059700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe07410de60 con 0x7fe074103570 2024-04-26T18:35:37.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.748+0000 7fe079059700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe07410dce0 con 0x7fe074102370 2024-04-26T18:35:37.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.748+0000 7fe079059700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe07410dfe0 con 0x7fe074103f10 2024-04-26T18:35:37.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.748+0000 7fe07259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe074103570 0x7fe074199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:37.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.748+0000 7fe07259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe074103570 0x7fe074199b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44578/0 (socket says 172.21.15.80:44578) 2024-04-26T18:35:37.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.748+0000 7fe07259c700 1 -- 172.21.15.80:0/661179728 learned_addr learned my addr 172.21.15.80:0/661179728 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:37.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.748+0000 7fe072d9d700 1 --2- 172.21.15.80:0/661179728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe074102370 0x7fe074199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:37.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.748+0000 7fe07359e700 1 --2- 172.21.15.80:0/661179728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe074103f10 0x7fe0741a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:37.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.748+0000 7fe07259c700 1 -- 172.21.15.80:0/661179728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe074103f10 msgr2=0x7fe0741a0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:37.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.748+0000 7fe07259c700 1 --2- 172.21.15.80:0/661179728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe074103f10 0x7fe0741a0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:37.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.748+0000 7fe07259c700 1 -- 172.21.15.80:0/661179728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe074102370 msgr2=0x7fe074199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:37.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.748+0000 7fe07259c700 1 --2- 172.21.15.80:0/661179728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe074102370 0x7fe074199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:37.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.748+0000 7fe07259c700 1 -- 172.21.15.80:0/661179728 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0741a1260 con 0x7fe074103570 2024-04-26T18:35:37.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.749+0000 7fe07359e700 1 --2- 172.21.15.80:0/661179728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe074103f10 0x7fe0741a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:35:37.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.749+0000 7fe07259c700 1 --2- 172.21.15.80:0/661179728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe074103570 0x7fe074199b40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe064005910 tx=0x7fe064005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:37.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.749+0000 7fe05bfff700 1 -- 172.21.15.80:0/661179728 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe064027070 con 0x7fe074103570 2024-04-26T18:35:37.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.749+0000 7fe079059700 1 -- 172.21.15.80:0/661179728 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0741a14f0 con 0x7fe074103570 2024-04-26T18:35:37.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.749+0000 7fe05bfff700 1 -- 172.21.15.80:0/661179728 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0640040a0 con 0x7fe074103570 2024-04-26T18:35:37.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.749+0000 7fe079059700 1 -- 172.21.15.80:0/661179728 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0741a1a20 con 0x7fe074103570 2024-04-26T18:35:37.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.749+0000 7fe05bfff700 1 -- 172.21.15.80:0/661179728 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe064022ce0 con 0x7fe074103570 2024-04-26T18:35:37.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.750+0000 7fe079059700 1 -- 172.21.15.80:0/661179728 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe060005360 con 0x7fe074103570 2024-04-26T18:35:37.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.751+0000 7fe05bfff700 1 -- 172.21.15.80:0/661179728 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fe06402a070 con 0x7fe074103570 2024-04-26T18:35:37.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.752+0000 7fe05bfff700 1 --2- 172.21.15.80:0/661179728 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe05c0a3c40 0x7fe05c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:37.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.752+0000 7fe072d9d700 1 --2- 172.21.15.80:0/661179728 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe05c0a3c40 0x7fe05c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:37.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.752+0000 7fe05bfff700 1 -- 172.21.15.80:0/661179728 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fe0640d1230 con 0x7fe074103570 2024-04-26T18:35:37.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.752+0000 7fe072d9d700 1 --2- 172.21.15.80:0/661179728 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe05c0a3c40 0x7fe05c0a6100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe0741033d0 tx=0x7fe06800b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:37.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.755+0000 7fe05bfff700 1 -- 172.21.15.80:0/661179728 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe064013070 con 0x7fe074103570 2024-04-26T18:35:37.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:37 smithi082 ceph-mon[32808]: pgmap v374: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:35:37.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.971+0000 7fe079059700 1 -- 172.21.15.80:0/661179728 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fe060000bf0 con 0x7fe05c0a3c40 2024-04-26T18:35:37.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.972+0000 7fe05bfff700 1 -- 172.21.15.80:0/661179728 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fe060000bf0 con 0x7fe05c0a3c40 2024-04-26T18:35:37.972 INFO:teuthology.orchestra.run.smithi080.stdout:Backend: cephadm 2024-04-26T18:35:37.972 INFO:teuthology.orchestra.run.smithi080.stdout:Available: Yes 2024-04-26T18:35:37.972 INFO:teuthology.orchestra.run.smithi080.stdout:Paused: No 2024-04-26T18:35:37.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.974+0000 7fe079059700 1 -- 172.21.15.80:0/661179728 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe05c0a3c40 msgr2=0x7fe05c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:37.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.974+0000 7fe079059700 1 --2- 172.21.15.80:0/661179728 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe05c0a3c40 0x7fe05c0a6100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe0741033d0 tx=0x7fe06800b410 comp rx=0 tx=0).stop 2024-04-26T18:35:37.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.974+0000 7fe079059700 1 -- 172.21.15.80:0/661179728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe074103570 msgr2=0x7fe074199b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:37.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.974+0000 7fe079059700 1 --2- 172.21.15.80:0/661179728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe074103570 0x7fe074199b40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe064005910 tx=0x7fe064005b00 comp rx=0 tx=0).stop 2024-04-26T18:35:37.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.974+0000 7fe079059700 1 -- 172.21.15.80:0/661179728 shutdown_connections 2024-04-26T18:35:37.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.974+0000 7fe079059700 1 --2- 172.21.15.80:0/661179728 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe05c0a3c40 0x7fe05c0a6100 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:37.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.974+0000 7fe079059700 1 --2- 172.21.15.80:0/661179728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe074103f10 0x7fe0741a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:37.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.974+0000 7fe079059700 1 --2- 172.21.15.80:0/661179728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe074102370 0x7fe074199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:37.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.974+0000 7fe079059700 1 --2- 172.21.15.80:0/661179728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe074103570 0x7fe074199b40 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:37.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.974+0000 7fe079059700 1 -- 172.21.15.80:0/661179728 >> 172.21.15.80:0/661179728 conn(0x7fe0740fd910 msgr2=0x7fe07406b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:37.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.974+0000 7fe079059700 1 -- 172.21.15.80:0/661179728 shutdown_connections 2024-04-26T18:35:37.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:37.974+0000 7fe079059700 1 -- 172.21.15.80:0/661179728 wait complete. 2024-04-26T18:35:38.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:37 smithi192 ceph-mon[32842]: pgmap v374: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:35:38.627 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-26T18:35:38.863 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:35:39.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:39 smithi082 ceph-mon[32808]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:35:39.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:39 smithi082 ceph-mon[32808]: pgmap v375: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:39.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:39 smithi080 ceph-mon[29135]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:35:39.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:39 smithi080 ceph-mon[29135]: pgmap v375: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:40.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:39 smithi192 ceph-mon[32842]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:35:40.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:39 smithi192 ceph-mon[32842]: pgmap v375: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:40.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.540+0000 7f8ffe251700 1 -- 172.21.15.80:0/3865494377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ff81091c0 msgr2=0x7f8ff810b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:40.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.540+0000 7f8ffe251700 1 --2- 172.21.15.80:0/3865494377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ff81091c0 0x7f8ff810b5f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000b0a0 tx=0x7f8ff000b3b0 comp rx=0 tx=0).stop 2024-04-26T18:35:40.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.540+0000 7f8ffe251700 1 -- 172.21.15.80:0/3865494377 shutdown_connections 2024-04-26T18:35:40.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.540+0000 7f8ffe251700 1 --2- 172.21.15.80:0/3865494377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ff81091c0 0x7f8ff810b5f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:40.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.540+0000 7f8ffe251700 1 --2- 172.21.15.80:0/3865494377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ff8103f60 0x7f8ff8106350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:40.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.540+0000 7f8ffe251700 1 --2- 172.21.15.80:0/3865494377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ff8106890 0x7f8ff8108c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:40.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.540+0000 7f8ffe251700 1 -- 172.21.15.80:0/3865494377 >> 172.21.15.80:0/3865494377 conn(0x7f8ff80fd950 msgr2=0x7f8ff80ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:40.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.541+0000 7f8ffe251700 1 -- 172.21.15.80:0/3865494377 shutdown_connections 2024-04-26T18:35:40.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.541+0000 7f8ffe251700 1 -- 172.21.15.80:0/3865494377 wait complete. 2024-04-26T18:35:40.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.541+0000 7f8ffe251700 1 Processor -- start 2024-04-26T18:35:40.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.541+0000 7f8ffe251700 1 -- start start 2024-04-26T18:35:40.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.541+0000 7f8ffe251700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ff8103f60 0x7f8ff81995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:40.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.541+0000 7f8ffe251700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ff8106890 0x7f8ff8199b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:40.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.541+0000 7f8ffe251700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ff81091c0 0x7f8ff81a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:40.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.541+0000 7f8ffe251700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff810ef70 con 0x7f8ff8103f60 2024-04-26T18:35:40.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.541+0000 7f8ffe251700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff810edf0 con 0x7f8ff81091c0 2024-04-26T18:35:40.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.541+0000 7f8ffe251700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff810f0f0 con 0x7f8ff8106890 2024-04-26T18:35:40.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.541+0000 7f8ff77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ff8103f60 0x7f8ff81995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:40.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.541+0000 7f8ff77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ff8103f60 0x7f8ff81995c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44606/0 (socket says 172.21.15.80:44606) 2024-04-26T18:35:40.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.541+0000 7f8ff77fe700 1 -- 172.21.15.80:0/1952832017 learned_addr learned my addr 172.21.15.80:0/1952832017 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:40.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.542+0000 7f8ff6ffd700 1 --2- 172.21.15.80:0/1952832017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ff8106890 0x7f8ff8199b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:40.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.542+0000 7f8ff7fff700 1 --2- 172.21.15.80:0/1952832017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ff81091c0 0x7f8ff81a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:40.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.542+0000 7f8ff77fe700 1 -- 172.21.15.80:0/1952832017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ff8106890 msgr2=0x7f8ff8199b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:40.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.542+0000 7f8ff77fe700 1 --2- 172.21.15.80:0/1952832017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ff8106890 0x7f8ff8199b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:40.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.542+0000 7f8ff77fe700 1 -- 172.21.15.80:0/1952832017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ff81091c0 msgr2=0x7f8ff81a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:40.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.542+0000 7f8ff77fe700 1 --2- 172.21.15.80:0/1952832017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ff81091c0 0x7f8ff81a0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:40.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.542+0000 7f8ff77fe700 1 -- 172.21.15.80:0/1952832017 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff81a1220 con 0x7f8ff8103f60 2024-04-26T18:35:40.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.542+0000 7f8ff6ffd700 1 --2- 172.21.15.80:0/1952832017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ff8106890 0x7f8ff8199b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:35:40.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.542+0000 7f8ff7fff700 1 --2- 172.21.15.80:0/1952832017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ff81091c0 0x7f8ff81a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:35:40.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.542+0000 7f8ff77fe700 1 --2- 172.21.15.80:0/1952832017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ff8103f60 0x7f8ff81995c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800b560 tx=0x7f8fe800b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:40.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.542+0000 7f8ff4ff9700 1 -- 172.21.15.80:0/1952832017 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8015020 con 0x7f8ff8103f60 2024-04-26T18:35:40.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.542+0000 7f8ffe251700 1 -- 172.21.15.80:0/1952832017 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff81a1510 con 0x7f8ff8103f60 2024-04-26T18:35:40.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.542+0000 7f8ff4ff9700 1 -- 172.21.15.80:0/1952832017 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fe8011ce0 con 0x7f8ff8103f60 2024-04-26T18:35:40.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.542+0000 7f8ff4ff9700 1 -- 172.21.15.80:0/1952832017 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8010da0 con 0x7f8ff8103f60 2024-04-26T18:35:40.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.542+0000 7f8ffe251700 1 -- 172.21.15.80:0/1952832017 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff81a1a80 con 0x7f8ff8103f60 2024-04-26T18:35:40.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.543+0000 7f8ffe251700 1 -- 172.21.15.80:0/1952832017 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ff806a110 con 0x7f8ff8103f60 2024-04-26T18:35:40.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.544+0000 7f8ff4ff9700 1 -- 172.21.15.80:0/1952832017 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f8fe8018020 con 0x7f8ff8103f60 2024-04-26T18:35:40.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.545+0000 7f8ff4ff9700 1 --2- 172.21.15.80:0/1952832017 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8fe00a3c40 0x7f8fe00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:40.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.545+0000 7f8ff4ff9700 1 -- 172.21.15.80:0/1952832017 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f8fe80cfc20 con 0x7f8ff8103f60 2024-04-26T18:35:40.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.545+0000 7f8ff6ffd700 1 --2- 172.21.15.80:0/1952832017 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8fe00a3c40 0x7f8fe00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:40.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.545+0000 7f8ff6ffd700 1 --2- 172.21.15.80:0/1952832017 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8fe00a3c40 0x7f8fe00a6100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8fec005fd0 tx=0x7f8fec005e30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:40.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.549+0000 7f8ff4ff9700 1 -- 172.21.15.80:0/1952832017 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8fe801f020 con 0x7f8ff8103f60 2024-04-26T18:35:40.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.760+0000 7f8ffe251700 1 -- 172.21.15.80:0/1952832017 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8ff8063860 con 0x7f8fe00a3c40 2024-04-26T18:35:40.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.774+0000 7f8ff4ff9700 1 -- 172.21.15.80:0/1952832017 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f8ff8063860 con 0x7f8fe00a3c40 2024-04-26T18:35:40.774 INFO:teuthology.orchestra.run.smithi080.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T18:35:40.774 INFO:teuthology.orchestra.run.smithi080.stdout:mds.a smithi080 running (2m) 30s ago 2m 19.3M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b 3de5c21d2b3f 2024-04-26T18:35:40.774 INFO:teuthology.orchestra.run.smithi080.stdout:mds.b smithi082 running (2m) 33s ago 2m 30.1M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b cadf56e3235a 2024-04-26T18:35:40.774 INFO:teuthology.orchestra.run.smithi080.stdout:mds.c smithi192 running (3m) 33s ago 3m 18.5M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b 23af43080fd6 2024-04-26T18:35:40.774 INFO:teuthology.orchestra.run.smithi080.stdout:mds.d smithi080 running (3m) 30s ago 3m 17.0M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b 53e169058972 2024-04-26T18:35:40.775 INFO:teuthology.orchestra.run.smithi080.stdout:mds.e smithi082 running (3m) 33s ago 3m 20.5M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b 3558e8b965d5 2024-04-26T18:35:40.775 INFO:teuthology.orchestra.run.smithi080.stdout:mds.f smithi192 running (3m) 33s ago 3m 18.5M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b 0c5011581cc1 2024-04-26T18:35:40.775 INFO:teuthology.orchestra.run.smithi080.stdout:mds.g smithi080 running (2m) 30s ago 2m 21.8M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b ece91e277231 2024-04-26T18:35:40.775 INFO:teuthology.orchestra.run.smithi080.stdout:mds.h smithi082 running (3m) 33s ago 3m 19.4M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b 5b4e2b058807 2024-04-26T18:35:40.775 INFO:teuthology.orchestra.run.smithi080.stdout:mds.i smithi192 running (2m) 33s ago 2m 20.2M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b af8838215a11 2024-04-26T18:35:40.775 INFO:teuthology.orchestra.run.smithi080.stdout:mds.j smithi080 running (3m) 30s ago 3m 14.3M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b 74b184685213 2024-04-26T18:35:40.775 INFO:teuthology.orchestra.run.smithi080.stdout:mds.k smithi082 running (3m) 33s ago 3m 20.8M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b b9baf38284bf 2024-04-26T18:35:40.775 INFO:teuthology.orchestra.run.smithi080.stdout:mds.l smithi192 running (3m) 33s ago 3m 19.2M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b ffca76a06a7c 2024-04-26T18:35:40.775 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.x smithi080 *:9283,8765 running (10m) 30s ago 10m 516M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b 6296c5fa5eda 2024-04-26T18:35:40.775 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.y smithi082 *:8443,8765 running (8m) 33s ago 8m 453M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b f32946a0fdec 2024-04-26T18:35:40.775 INFO:teuthology.orchestra.run.smithi080.stdout:mgr.z smithi192 *:8443,8765 running (8m) 33s ago 8m 453M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b 879b3597ad7d 2024-04-26T18:35:40.775 INFO:teuthology.orchestra.run.smithi080.stdout:mon.a smithi080 running (10m) 30s ago 10m 50.6M 2048M 19.0.0-3267-gbc94a2a9 3a6bde214c5b d90b35aa1c5e 2024-04-26T18:35:40.775 INFO:teuthology.orchestra.run.smithi080.stdout:mon.b smithi082 running (8m) 33s ago 8m 41.3M 2048M 19.0.0-3267-gbc94a2a9 3a6bde214c5b a31eaa4ff132 2024-04-26T18:35:40.775 INFO:teuthology.orchestra.run.smithi080.stdout:mon.c smithi192 running (9m) 33s ago 9m 43.3M 2048M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 4b76db465e29 2024-04-26T18:35:40.775 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0 smithi080 running (8m) 30s ago 8m 50.2M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 5c8f6428f212 2024-04-26T18:35:40.776 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1 smithi082 running (7m) 33s ago 7m 59.5M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 52637e04e9f7 2024-04-26T18:35:40.776 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2 smithi192 running (7m) 33s ago 7m 47.2M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b f8cfd702b4a2 2024-04-26T18:35:40.776 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3 smithi080 running (7m) 30s ago 7m 54.4M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 292f718fae4e 2024-04-26T18:35:40.776 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4 smithi082 running (6m) 33s ago 6m 42.8M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b f1f4a99c2615 2024-04-26T18:35:40.776 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5 smithi192 running (6m) 33s ago 6m 46.3M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 75925b8a6956 2024-04-26T18:35:40.776 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6 smithi080 running (5m) 30s ago 5m 56.7M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 1daf923894a5 2024-04-26T18:35:40.776 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7 smithi082 running (5m) 33s ago 5m 55.7M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b fb37219f1bae 2024-04-26T18:35:40.776 INFO:teuthology.orchestra.run.smithi080.stdout:osd.8 smithi192 running (5m) 33s ago 5m 44.2M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 273ff410158b 2024-04-26T18:35:40.776 INFO:teuthology.orchestra.run.smithi080.stdout:osd.9 smithi080 running (4m) 30s ago 4m 55.1M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 7dddf836fc44 2024-04-26T18:35:40.776 INFO:teuthology.orchestra.run.smithi080.stdout:osd.10 smithi082 running (4m) 33s ago 4m 55.2M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b bfa725cc41f0 2024-04-26T18:35:40.776 INFO:teuthology.orchestra.run.smithi080.stdout:osd.11 smithi192 running (3m) 33s ago 3m 42.4M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 26b78e48ef57 2024-04-26T18:35:40.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.776+0000 7f8ffe251700 1 -- 172.21.15.80:0/1952832017 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8fe00a3c40 msgr2=0x7f8fe00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:40.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.776+0000 7f8ffe251700 1 --2- 172.21.15.80:0/1952832017 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8fe00a3c40 0x7f8fe00a6100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8fec005fd0 tx=0x7f8fec005e30 comp rx=0 tx=0).stop 2024-04-26T18:35:40.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.776+0000 7f8ffe251700 1 -- 172.21.15.80:0/1952832017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ff8103f60 msgr2=0x7f8ff81995c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:40.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.776+0000 7f8ffe251700 1 --2- 172.21.15.80:0/1952832017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ff8103f60 0x7f8ff81995c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800b560 tx=0x7f8fe800b920 comp rx=0 tx=0).stop 2024-04-26T18:35:40.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.776+0000 7f8ffe251700 1 -- 172.21.15.80:0/1952832017 shutdown_connections 2024-04-26T18:35:40.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.776+0000 7f8ffe251700 1 --2- 172.21.15.80:0/1952832017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ff81091c0 0x7f8ff81a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:40.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.776+0000 7f8ffe251700 1 --2- 172.21.15.80:0/1952832017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ff8103f60 0x7f8ff81995c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:40.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.776+0000 7f8ffe251700 1 --2- 172.21.15.80:0/1952832017 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f8fe00a3c40 0x7f8fe00a6100 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:40.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.776+0000 7f8ffe251700 1 --2- 172.21.15.80:0/1952832017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ff8106890 0x7f8ff8199b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:40.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.776+0000 7f8ffe251700 1 -- 172.21.15.80:0/1952832017 >> 172.21.15.80:0/1952832017 conn(0x7f8ff80fd950 msgr2=0x7f8ff8104800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:40.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.776+0000 7f8ffe251700 1 -- 172.21.15.80:0/1952832017 shutdown_connections 2024-04-26T18:35:40.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:40.776+0000 7f8ffe251700 1 -- 172.21.15.80:0/1952832017 wait complete. 2024-04-26T18:35:41.587 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-26T18:35:41.832 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:35:41.954 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:41 smithi080 ceph-mon[29135]: pgmap v376: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:41.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:41 smithi082 ceph-mon[32808]: pgmap v376: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:42.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:41 smithi192 ceph-mon[32842]: pgmap v376: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:42.955 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:42 smithi080 ceph-mon[29135]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:35:42.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:42 smithi082 ceph-mon[32808]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:35:43.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:42 smithi192 ceph-mon[32842]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:35:43.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.501+0000 7faadca83700 1 -- 172.21.15.80:0/4018599323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faad8105050 msgr2=0x7faad810b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:43.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.501+0000 7faadca83700 1 --2- 172.21.15.80:0/4018599323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faad8105050 0x7faad810b900 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7faad000b0d0 tx=0x7faad000b3e0 comp rx=0 tx=0).stop 2024-04-26T18:35:43.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.501+0000 7faadca83700 1 -- 172.21.15.80:0/4018599323 shutdown_connections 2024-04-26T18:35:43.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.501+0000 7faadca83700 1 --2- 172.21.15.80:0/4018599323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faad8105050 0x7faad810b900 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:43.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.501+0000 7faadca83700 1 --2- 172.21.15.80:0/4018599323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faad81034b0 0x7faad81038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:43.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.501+0000 7faadca83700 1 --2- 172.21.15.80:0/4018599323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faad81046b0 0x7faad8104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:43.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.501+0000 7faadca83700 1 -- 172.21.15.80:0/4018599323 >> 172.21.15.80:0/4018599323 conn(0x7faad80fea70 msgr2=0x7faad8100e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:43.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.501+0000 7faadca83700 1 -- 172.21.15.80:0/4018599323 shutdown_connections 2024-04-26T18:35:43.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.502+0000 7faadca83700 1 -- 172.21.15.80:0/4018599323 wait complete. 2024-04-26T18:35:43.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.502+0000 7faadca83700 1 Processor -- start 2024-04-26T18:35:43.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.502+0000 7faadca83700 1 -- start start 2024-04-26T18:35:43.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.502+0000 7faadca83700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faad81034b0 0x7faad8199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:43.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.502+0000 7faadca83700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faad81046b0 0x7faad8199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:43.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.502+0000 7faadca83700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faad8105050 0x7faad81a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:43.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.502+0000 7faadca83700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7faad810ef30 con 0x7faad81046b0 2024-04-26T18:35:43.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.502+0000 7faadca83700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faad810edb0 con 0x7faad8105050 2024-04-26T18:35:43.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.502+0000 7faadca83700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7faad810f0b0 con 0x7faad81034b0 2024-04-26T18:35:43.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.503+0000 7faad5d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faad81046b0 0x7faad8199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:43.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.503+0000 7faad5d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faad81046b0 0x7faad8199990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48414/0 (socket says 172.21.15.80:48414) 2024-04-26T18:35:43.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.503+0000 7faad5d9b700 1 -- 172.21.15.80:0/4067500614 learned_addr learned my addr 172.21.15.80:0/4067500614 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:43.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.503+0000 7faad659c700 1 --2- 172.21.15.80:0/4067500614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faad81034b0 0x7faad8199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:43.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.503+0000 7faad6d9d700 1 --2- 172.21.15.80:0/4067500614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faad8105050 0x7faad81a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:43.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.503+0000 7faad5d9b700 1 -- 172.21.15.80:0/4067500614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faad81034b0 msgr2=0x7faad8199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:43.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.503+0000 7faad5d9b700 1 --2- 172.21.15.80:0/4067500614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faad81034b0 0x7faad8199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:43.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.503+0000 7faad5d9b700 1 -- 172.21.15.80:0/4067500614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faad8105050 msgr2=0x7faad81a0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:43.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.503+0000 7faad5d9b700 1 --2- 172.21.15.80:0/4067500614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faad8105050 0x7faad81a0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:43.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.503+0000 7faad5d9b700 1 -- 172.21.15.80:0/4067500614 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad81a10b0 con 0x7faad81046b0 2024-04-26T18:35:43.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.503+0000 7faad5d9b700 1 --2- 172.21.15.80:0/4067500614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faad81046b0 0x7faad8199990 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7faacc00c9e0 tx=0x7faacc00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:43.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.503+0000 7faac77fe700 1 -- 172.21.15.80:0/4067500614 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faacc007ac0 con 0x7faad81046b0 2024-04-26T18:35:43.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.503+0000 7faac77fe700 1 -- 172.21.15.80:0/4067500614 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faacc007c60 con 0x7faad81046b0 2024-04-26T18:35:43.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.503+0000 7faadca83700 1 -- 172.21.15.80:0/4067500614 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faad81a13a0 con 0x7faad81046b0 2024-04-26T18:35:43.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.503+0000 7faac77fe700 1 -- 172.21.15.80:0/4067500614 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faacc018660 con 0x7faad81046b0 2024-04-26T18:35:43.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.503+0000 7faadca83700 1 -- 172.21.15.80:0/4067500614 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faad81a18e0 con 0x7faad81046b0 2024-04-26T18:35:43.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.504+0000 7faadca83700 1 -- 172.21.15.80:0/4067500614 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faad806a110 con 0x7faad81046b0 2024-04-26T18:35:43.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.505+0000 7faac77fe700 1 -- 172.21.15.80:0/4067500614 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7faacc00f450 con 0x7faad81046b0 2024-04-26T18:35:43.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.506+0000 7faac77fe700 1 --2- 172.21.15.80:0/4067500614 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7faac00a3c40 0x7faac00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:43.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.506+0000 7faad659c700 1 --2- 172.21.15.80:0/4067500614 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7faac00a3c40 0x7faac00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:43.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.506+0000 7faac77fe700 1 -- 172.21.15.80:0/4067500614 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7faacc0d02e0 con 0x7faad81046b0 2024-04-26T18:35:43.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.506+0000 7faad659c700 1 --2- 172.21.15.80:0/4067500614 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7faac00a3c40 0x7faac00a6100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7faad8104510 tx=0x7faac800b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:43.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.510+0000 7faac77fe700 1 -- 172.21.15.80:0/4067500614 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7faacc014030 con 0x7faad81046b0 2024-04-26T18:35:43.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.721+0000 7faadca83700 1 -- 172.21.15.80:0/4067500614 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7faad8063860 con 0x7faac00a3c40 2024-04-26T18:35:43.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.726+0000 7faac77fe700 1 -- 172.21.15.80:0/4067500614 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7faad8063860 con 0x7faac00a3c40 2024-04-26T18:35:43.727 INFO:teuthology.orchestra.run.smithi080.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-26T18:35:43.727 INFO:teuthology.orchestra.run.smithi080.stdout:mds.all 12/12 36s ago 3m smithi080=a;smithi080=d;smithi080=g;smithi080=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l;count:12 2024-04-26T18:35:43.727 INFO:teuthology.orchestra.run.smithi080.stdout:mgr 3/3 36s ago 8m smithi080=x;smithi082=y;smithi192=z;count:3 2024-04-26T18:35:43.727 INFO:teuthology.orchestra.run.smithi080.stdout:mon 3/3 36s ago 9m smithi080:172.21.15.80=a;smithi082:172.21.15.82=b;smithi192:172.21.15.192=c;count:3 2024-04-26T18:35:43.727 INFO:teuthology.orchestra.run.smithi080.stdout:osd 12 36s ago - 2024-04-26T18:35:43.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.729+0000 7faadca83700 1 -- 172.21.15.80:0/4067500614 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7faac00a3c40 msgr2=0x7faac00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:43.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.729+0000 7faadca83700 1 --2- 172.21.15.80:0/4067500614 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7faac00a3c40 0x7faac00a6100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7faad8104510 tx=0x7faac800b410 comp rx=0 tx=0).stop 2024-04-26T18:35:43.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.729+0000 7faadca83700 1 -- 172.21.15.80:0/4067500614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faad81046b0 msgr2=0x7faad8199990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:43.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.729+0000 7faadca83700 1 --2- 172.21.15.80:0/4067500614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faad81046b0 0x7faad8199990 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7faacc00c9e0 tx=0x7faacc00ccf0 comp rx=0 tx=0).stop 2024-04-26T18:35:43.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.729+0000 7faadca83700 1 -- 172.21.15.80:0/4067500614 shutdown_connections 2024-04-26T18:35:43.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.729+0000 7faadca83700 1 --2- 172.21.15.80:0/4067500614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faad8105050 0x7faad81a0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:43.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.729+0000 7faadca83700 1 --2- 172.21.15.80:0/4067500614 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7faac00a3c40 0x7faac00a6100 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:43.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.729+0000 7faadca83700 1 --2- 172.21.15.80:0/4067500614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faad81034b0 0x7faad8199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:43.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.729+0000 7faadca83700 1 --2- 172.21.15.80:0/4067500614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faad81046b0 0x7faad8199990 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:43.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.729+0000 7faadca83700 1 -- 172.21.15.80:0/4067500614 >> 172.21.15.80:0/4067500614 conn(0x7faad80fea70 msgr2=0x7faad81078e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:43.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.729+0000 7faadca83700 1 -- 172.21.15.80:0/4067500614 shutdown_connections 2024-04-26T18:35:43.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:43.729+0000 7faadca83700 1 -- 172.21.15.80:0/4067500614 wait complete. 2024-04-26T18:35:43.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:43 smithi082 ceph-mon[32808]: pgmap v377: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:35:43.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:43 smithi080 ceph-mon[29135]: pgmap v377: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:35:44.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:43 smithi192 ceph-mon[32842]: pgmap v377: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:35:44.494 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-26T18:35:44.734 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:35:45.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:45 smithi082 ceph-mon[32808]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:35:45.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:45 smithi082 ceph-mon[32808]: pgmap v378: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:45.984 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:45 smithi080 ceph-mon[29135]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:35:45.984 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:45 smithi080 ceph-mon[29135]: pgmap v378: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:46.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:45 smithi192 ceph-mon[32842]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:35:46.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:45 smithi192 ceph-mon[32842]: pgmap v378: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:46.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.532+0000 7efd2083f700 1 -- 172.21.15.80:0/1865412622 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd1c102380 msgr2=0x7efd1c1027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:46.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.532+0000 7efd2083f700 1 --2- 172.21.15.80:0/1865412622 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd1c102380 0x7efd1c1027a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efd0c0099c0 tx=0x7efd0c009cd0 comp rx=0 tx=0).stop 2024-04-26T18:35:46.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.532+0000 7efd2083f700 1 -- 172.21.15.80:0/1865412622 shutdown_connections 2024-04-26T18:35:46.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.532+0000 7efd2083f700 1 --2- 172.21.15.80:0/1865412622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd1c103f20 0x7efd1c10a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:46.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.532+0000 7efd2083f700 1 --2- 172.21.15.80:0/1865412622 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd1c102380 0x7efd1c1027a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:46.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.532+0000 7efd2083f700 1 --2- 172.21.15.80:0/1865412622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd1c103580 0x7efd1c1039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:46.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.532+0000 7efd2083f700 1 -- 172.21.15.80:0/1865412622 >> 172.21.15.80:0/1865412622 conn(0x7efd1c0fd920 msgr2=0x7efd1c0ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:46.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.533+0000 7efd2083f700 1 -- 172.21.15.80:0/1865412622 shutdown_connections 2024-04-26T18:35:46.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.533+0000 7efd2083f700 1 -- 172.21.15.80:0/1865412622 wait complete. 2024-04-26T18:35:46.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.533+0000 7efd2083f700 1 Processor -- start 2024-04-26T18:35:46.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.533+0000 7efd2083f700 1 -- start start 2024-04-26T18:35:46.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.533+0000 7efd2083f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd1c102380 0x7efd1c199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:46.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.533+0000 7efd2083f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd1c103580 0x7efd1c199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:46.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.533+0000 7efd2083f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd1c103f20 0x7efd1c1a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:46.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.533+0000 7efd2083f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efd1c10de10 con 0x7efd1c103f20 2024-04-26T18:35:46.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.533+0000 7efd2083f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efd1c10dc90 con 0x7efd1c102380 2024-04-26T18:35:46.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.533+0000 7efd2083f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efd1c10df90 con 0x7efd1c103580 2024-04-26T18:35:46.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.534+0000 7efd1ad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd1c103f20 0x7efd1c1a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:46.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.534+0000 7efd19d9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd1c103580 0x7efd1c199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:46.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.534+0000 7efd1ad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd1c103f20 0x7efd1c1a0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48442/0 (socket says 172.21.15.80:48442) 2024-04-26T18:35:46.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.534+0000 7efd1ad9d700 1 -- 172.21.15.80:0/1132497881 learned_addr learned my addr 172.21.15.80:0/1132497881 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:46.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.534+0000 7efd1a59c700 1 --2- 172.21.15.80:0/1132497881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd1c102380 0x7efd1c199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:46.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.534+0000 7efd1ad9d700 1 -- 172.21.15.80:0/1132497881 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd1c103580 msgr2=0x7efd1c199bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:46.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.534+0000 7efd1ad9d700 1 --2- 172.21.15.80:0/1132497881 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd1c103580 0x7efd1c199bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:46.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.534+0000 7efd1ad9d700 1 -- 172.21.15.80:0/1132497881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd1c102380 msgr2=0x7efd1c199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:46.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.534+0000 7efd1ad9d700 1 --2- 172.21.15.80:0/1132497881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd1c102380 0x7efd1c199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:46.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.534+0000 7efd1ad9d700 1 -- 172.21.15.80:0/1132497881 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd1c1a12e0 con 0x7efd1c103f20 2024-04-26T18:35:46.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.534+0000 7efd1a59c700 1 --2- 172.21.15.80:0/1132497881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd1c102380 0x7efd1c199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:35:46.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.534+0000 7efd1ad9d700 1 --2- 172.21.15.80:0/1132497881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd1c103f20 0x7efd1c1a0c40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efd1400add0 tx=0x7efd1400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:46.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.534+0000 7efd0b7fe700 1 -- 172.21.15.80:0/1132497881 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd14017020 con 0x7efd1c103f20 2024-04-26T18:35:46.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.535+0000 7efd0b7fe700 1 -- 172.21.15.80:0/1132497881 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd1400ae00 con 0x7efd1c103f20 2024-04-26T18:35:46.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.535+0000 7efd2083f700 1 -- 172.21.15.80:0/1132497881 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd1c1a15d0 con 0x7efd1c103f20 2024-04-26T18:35:46.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.535+0000 7efd0b7fe700 1 -- 172.21.15.80:0/1132497881 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd140053e0 con 0x7efd1c103f20 2024-04-26T18:35:46.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.535+0000 7efd2083f700 1 -- 172.21.15.80:0/1132497881 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd1c1a1ac0 con 0x7efd1c103f20 2024-04-26T18:35:46.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.535+0000 7efd2083f700 1 -- 172.21.15.80:0/1132497881 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd1c06a110 con 0x7efd1c103f20 2024-04-26T18:35:46.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.537+0000 7efd0b7fe700 1 -- 172.21.15.80:0/1132497881 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7efd14004ad0 con 0x7efd1c103f20 2024-04-26T18:35:46.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.537+0000 7efd0b7fe700 1 --2- 172.21.15.80:0/1132497881 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7efd040a3c40 0x7efd040a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:46.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.537+0000 7efd1a59c700 1 --2- 172.21.15.80:0/1132497881 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7efd040a3c40 0x7efd040a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:46.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.537+0000 7efd0b7fe700 1 -- 172.21.15.80:0/1132497881 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7efd140d0110 con 0x7efd1c103f20 2024-04-26T18:35:46.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.538+0000 7efd1a59c700 1 --2- 172.21.15.80:0/1132497881 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7efd040a3c40 0x7efd040a6100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efd0c000c00 tx=0x7efd0c005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:46.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.541+0000 7efd0b7fe700 1 -- 172.21.15.80:0/1132497881 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7efd14021020 con 0x7efd1c103f20 2024-04-26T18:35:46.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.749+0000 7efd2083f700 1 -- 172.21.15.80:0/1132497881 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7efd1c06b880 con 0x7efd040a3c40 2024-04-26T18:35:46.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.751+0000 7efd0b7fe700 1 -- 172.21.15.80:0/1132497881 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7efd1c06b880 con 0x7efd040a3c40 2024-04-26T18:35:46.751 INFO:teuthology.orchestra.run.smithi080.stdout:HOST ADDR LABELS STATUS 2024-04-26T18:35:46.751 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080 172.21.15.80 2024-04-26T18:35:46.751 INFO:teuthology.orchestra.run.smithi080.stdout:smithi082 172.21.15.82 2024-04-26T18:35:46.751 INFO:teuthology.orchestra.run.smithi080.stdout:smithi192 172.21.15.192 2024-04-26T18:35:46.751 INFO:teuthology.orchestra.run.smithi080.stdout:3 hosts in cluster 2024-04-26T18:35:46.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.753+0000 7efd2083f700 1 -- 172.21.15.80:0/1132497881 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7efd040a3c40 msgr2=0x7efd040a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:46.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.753+0000 7efd2083f700 1 --2- 172.21.15.80:0/1132497881 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7efd040a3c40 0x7efd040a6100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efd0c000c00 tx=0x7efd0c005fd0 comp rx=0 tx=0).stop 2024-04-26T18:35:46.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.753+0000 7efd2083f700 1 -- 172.21.15.80:0/1132497881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd1c103f20 msgr2=0x7efd1c1a0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:46.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.753+0000 7efd2083f700 1 --2- 172.21.15.80:0/1132497881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd1c103f20 0x7efd1c1a0c40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efd1400add0 tx=0x7efd1400c330 comp rx=0 tx=0).stop 2024-04-26T18:35:46.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.753+0000 7efd2083f700 1 -- 172.21.15.80:0/1132497881 shutdown_connections 2024-04-26T18:35:46.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.753+0000 7efd2083f700 1 --2- 172.21.15.80:0/1132497881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd1c103f20 0x7efd1c1a0c40 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:46.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.753+0000 7efd2083f700 1 --2- 172.21.15.80:0/1132497881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd1c102380 0x7efd1c199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:46.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.753+0000 7efd2083f700 1 --2- 172.21.15.80:0/1132497881 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7efd040a3c40 0x7efd040a6100 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:46.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.753+0000 7efd2083f700 1 --2- 172.21.15.80:0/1132497881 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd1c103580 0x7efd1c199bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:46.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.753+0000 7efd2083f700 1 -- 172.21.15.80:0/1132497881 >> 172.21.15.80:0/1132497881 conn(0x7efd1c0fd920 msgr2=0x7efd1c06b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:46.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.753+0000 7efd2083f700 1 -- 172.21.15.80:0/1132497881 shutdown_connections 2024-04-26T18:35:46.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:46.753+0000 7efd2083f700 1 -- 172.21.15.80:0/1132497881 wait complete. 2024-04-26T18:35:47.599 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-26T18:35:47.840 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:35:47.962 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:47 smithi080 ceph-mon[29135]: pgmap v379: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:35:47.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:47 smithi082 ceph-mon[32808]: pgmap v379: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:35:48.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:47 smithi192 ceph-mon[32842]: pgmap v379: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:35:48.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:48 smithi082 ceph-mon[32808]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:35:48.970 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:48 smithi080 ceph-mon[29135]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:35:49.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:48 smithi192 ceph-mon[32842]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:35:49.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.493+0000 7f136ce0e700 1 -- 172.21.15.80:0/1939167818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13680773d0 msgr2=0x7f1368075830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:49.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.493+0000 7f136ce0e700 1 --2- 172.21.15.80:0/1939167818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13680773d0 0x7f1368075830 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1358009990 tx=0x7f1358009ca0 comp rx=0 tx=0).stop 2024-04-26T18:35:49.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.493+0000 7f136ce0e700 1 -- 172.21.15.80:0/1939167818 shutdown_connections 2024-04-26T18:35:49.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.493+0000 7f136ce0e700 1 --2- 172.21.15.80:0/1939167818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f136810b380 0x7f136810d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:49.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.493+0000 7f136ce0e700 1 --2- 172.21.15.80:0/1939167818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13680773d0 0x7f1368075830 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:49.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.493+0000 7f136ce0e700 1 --2- 172.21.15.80:0/1939167818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1368075e00 0x7f1368076280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:49.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.493+0000 7f136ce0e700 1 -- 172.21.15.80:0/1939167818 >> 172.21.15.80:0/1939167818 conn(0x7f13680fea20 msgr2=0x7f1368100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:49.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.493+0000 7f136ce0e700 1 -- 172.21.15.80:0/1939167818 shutdown_connections 2024-04-26T18:35:49.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.493+0000 7f136ce0e700 1 -- 172.21.15.80:0/1939167818 wait complete. 2024-04-26T18:35:49.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.494+0000 7f136ce0e700 1 Processor -- start 2024-04-26T18:35:49.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.494+0000 7f136ce0e700 1 -- start start 2024-04-26T18:35:49.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.494+0000 7f136ce0e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1368075e00 0x7f136819b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:49.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.494+0000 7f136ce0e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13680773d0 0x7f136819bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:49.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.494+0000 7f136ce0e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f136810b380 0x7f13681a2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:49.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.494+0000 7f136ce0e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1368111160 con 0x7f136810b380 2024-04-26T18:35:49.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.494+0000 7f136ce0e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1368110fe0 con 0x7f13680773d0 2024-04-26T18:35:49.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.494+0000 7f136ce0e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f13681112e0 con 0x7f1368075e00 2024-04-26T18:35:49.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.494+0000 7f1366d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f136810b380 0x7f13681a2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:49.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.494+0000 7f1366d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f136810b380 0x7f13681a2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48460/0 (socket says 172.21.15.80:48460) 2024-04-26T18:35:49.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.494+0000 7f1366d9d700 1 -- 172.21.15.80:0/808522484 learned_addr learned my addr 172.21.15.80:0/808522484 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:49.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.494+0000 7f1365d9b700 1 --2- 172.21.15.80:0/808522484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13680773d0 0x7f136819bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:49.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.494+0000 7f136659c700 1 --2- 172.21.15.80:0/808522484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1368075e00 0x7f136819b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:49.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.494+0000 7f1366d9d700 1 -- 172.21.15.80:0/808522484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1368075e00 msgr2=0x7f136819b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:49.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.494+0000 7f1366d9d700 1 --2- 172.21.15.80:0/808522484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1368075e00 0x7f136819b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:49.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.494+0000 7f1366d9d700 1 -- 172.21.15.80:0/808522484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13680773d0 msgr2=0x7f136819bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:49.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.494+0000 7f1366d9d700 1 --2- 172.21.15.80:0/808522484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13680773d0 0x7f136819bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:49.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.494+0000 7f1366d9d700 1 -- 172.21.15.80:0/808522484 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13681a3490 con 0x7f136810b380 2024-04-26T18:35:49.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.494+0000 7f1365d9b700 1 --2- 172.21.15.80:0/808522484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13680773d0 0x7f136819bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:35:49.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.495+0000 7f1366d9d700 1 --2- 172.21.15.80:0/808522484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f136810b380 0x7f13681a2df0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1360007f10 tx=0x7f136000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:49.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.495+0000 7f13577fe700 1 -- 172.21.15.80:0/808522484 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1360004bb0 con 0x7f136810b380 2024-04-26T18:35:49.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.495+0000 7f13577fe700 1 -- 172.21.15.80:0/808522484 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1360004d50 con 0x7f136810b380 2024-04-26T18:35:49.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.495+0000 7f136ce0e700 1 -- 172.21.15.80:0/808522484 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13681a3780 con 0x7f136810b380 2024-04-26T18:35:49.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.495+0000 7f13577fe700 1 -- 172.21.15.80:0/808522484 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1360005a30 con 0x7f136810b380 2024-04-26T18:35:49.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.495+0000 7f136ce0e700 1 -- 172.21.15.80:0/808522484 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13681a3cf0 con 0x7f136810b380 2024-04-26T18:35:49.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.496+0000 7f136ce0e700 1 -- 172.21.15.80:0/808522484 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f136806a110 con 0x7f136810b380 2024-04-26T18:35:49.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.497+0000 7f13577fe700 1 -- 172.21.15.80:0/808522484 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f136001a020 con 0x7f136810b380 2024-04-26T18:35:49.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.498+0000 7f13577fe700 1 --2- 172.21.15.80:0/808522484 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f13500a3c40 0x7f13500a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:49.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.498+0000 7f136659c700 1 --2- 172.21.15.80:0/808522484 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f13500a3c40 0x7f13500a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:49.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.498+0000 7f13577fe700 1 -- 172.21.15.80:0/808522484 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f13600cfbf0 con 0x7f136810b380 2024-04-26T18:35:49.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.498+0000 7f136659c700 1 --2- 172.21.15.80:0/808522484 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f13500a3c40 0x7f13500a6100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f135800b5c0 tx=0x7f1358005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:49.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.502+0000 7f13577fe700 1 -- 172.21.15.80:0/808522484 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1360010070 con 0x7f136810b380 2024-04-26T18:35:49.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.713+0000 7f136ce0e700 1 -- 172.21.15.80:0/808522484 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f1368063860 con 0x7f13500a3c40 2024-04-26T18:35:49.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.714+0000 7f13577fe700 1 -- 172.21.15.80:0/808522484 <== mgr.14148 v2:172.21.15.80:6800/179326828 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f1368063860 con 0x7f13500a3c40 2024-04-26T18:35:49.715 INFO:teuthology.orchestra.run.smithi080.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-26T18:35:49.715 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204014T400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-04-26T18:35:49.715 INFO:teuthology.orchestra.run.smithi080.stdout:smithi082 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400SD400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-04-26T18:35:49.715 INFO:teuthology.orchestra.run.smithi080.stdout:smithi192 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500NN400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-04-26T18:35:49.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.716+0000 7f136ce0e700 1 -- 172.21.15.80:0/808522484 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f13500a3c40 msgr2=0x7f13500a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:49.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.716+0000 7f136ce0e700 1 --2- 172.21.15.80:0/808522484 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f13500a3c40 0x7f13500a6100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f135800b5c0 tx=0x7f1358005fd0 comp rx=0 tx=0).stop 2024-04-26T18:35:49.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.716+0000 7f136ce0e700 1 -- 172.21.15.80:0/808522484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f136810b380 msgr2=0x7f13681a2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:49.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.716+0000 7f136ce0e700 1 --2- 172.21.15.80:0/808522484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f136810b380 0x7f13681a2df0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1360007f10 tx=0x7f136000d3b0 comp rx=0 tx=0).stop 2024-04-26T18:35:49.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.717+0000 7f136ce0e700 1 -- 172.21.15.80:0/808522484 shutdown_connections 2024-04-26T18:35:49.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.717+0000 7f136ce0e700 1 --2- 172.21.15.80:0/808522484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f136810b380 0x7f13681a2df0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:49.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.717+0000 7f136ce0e700 1 --2- 172.21.15.80:0/808522484 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f13500a3c40 0x7f13500a6100 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:49.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.717+0000 7f136ce0e700 1 --2- 172.21.15.80:0/808522484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1368075e00 0x7f136819b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:49.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.717+0000 7f136ce0e700 1 --2- 172.21.15.80:0/808522484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13680773d0 0x7f136819bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:49.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.717+0000 7f136ce0e700 1 -- 172.21.15.80:0/808522484 >> 172.21.15.80:0/808522484 conn(0x7f13680fea20 msgr2=0x7f13681072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:49.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.717+0000 7f136ce0e700 1 -- 172.21.15.80:0/808522484 shutdown_connections 2024-04-26T18:35:49.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:49.717+0000 7f136ce0e700 1 -- 172.21.15.80:0/808522484 wait complete. 2024-04-26T18:35:49.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:49 smithi082 ceph-mon[32808]: pgmap v380: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:49.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:49 smithi080 ceph-mon[29135]: pgmap v380: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:50.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:49 smithi192 ceph-mon[32842]: pgmap v380: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:50.425 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T18:35:50.436 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi080.front.sepia.ceph.com 2024-04-26T18:35:50.436 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-26T18:35:50.684 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:35:51.855 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:51 smithi080 ceph-mon[29135]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:35:51.855 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:51 smithi080 ceph-mon[29135]: pgmap v381: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:51.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:51 smithi082 ceph-mon[32808]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:35:51.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:51 smithi082 ceph-mon[32808]: pgmap v381: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:52.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:51 smithi192 ceph-mon[32842]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:35:52.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:51 smithi192 ceph-mon[32842]: pgmap v381: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.386+0000 7fec7c40d700 1 -- 172.21.15.80:0/2287387073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec74103f10 msgr2=0x7fec7410a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.386+0000 7fec7c40d700 1 --2- 172.21.15.80:0/2287387073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec74103f10 0x7fec7410a7c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fec6c00b0d0 tx=0x7fec6c00b3e0 comp rx=0 tx=0).stop 2024-04-26T18:35:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.386+0000 7fec7c40d700 1 -- 172.21.15.80:0/2287387073 shutdown_connections 2024-04-26T18:35:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.386+0000 7fec7c40d700 1 --2- 172.21.15.80:0/2287387073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec74103f10 0x7fec7410a7c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.386+0000 7fec7c40d700 1 --2- 172.21.15.80:0/2287387073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec74102370 0x7fec74102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.386+0000 7fec7c40d700 1 --2- 172.21.15.80:0/2287387073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec74103570 0x7fec741039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.386+0000 7fec7c40d700 1 -- 172.21.15.80:0/2287387073 >> 172.21.15.80:0/2287387073 conn(0x7fec740fd910 msgr2=0x7fec740ffd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.386+0000 7fec7c40d700 1 -- 172.21.15.80:0/2287387073 shutdown_connections 2024-04-26T18:35:52.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.386+0000 7fec7c40d700 1 -- 172.21.15.80:0/2287387073 wait complete. 2024-04-26T18:35:52.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.387+0000 7fec7c40d700 1 Processor -- start 2024-04-26T18:35:52.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.387+0000 7fec7c40d700 1 -- start start 2024-04-26T18:35:52.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.387+0000 7fec7c40d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec74102370 0x7fec74198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:52.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.387+0000 7fec7c40d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec74103570 0x7fec741989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:52.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.387+0000 7fec7c40d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec74103f10 0x7fec7419fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:52.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.387+0000 7fec7c40d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fec7410de80 con 0x7fec74102370 2024-04-26T18:35:52.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.387+0000 7fec7c40d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fec7410dd00 con 0x7fec74103f10 2024-04-26T18:35:52.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.387+0000 7fec7c40d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fec7410e000 con 0x7fec74103570 2024-04-26T18:35:52.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.387+0000 7fec7a1a9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec74102370 0x7fec74198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:52.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.387+0000 7fec7a1a9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec74102370 0x7fec74198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48482/0 (socket says 172.21.15.80:48482) 2024-04-26T18:35:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.387+0000 7fec7a1a9700 1 -- 172.21.15.80:0/1648641129 learned_addr learned my addr 172.21.15.80:0/1648641129 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.387+0000 7fec799a8700 1 --2- 172.21.15.80:0/1648641129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec74103570 0x7fec741989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.387+0000 7fec7a1a9700 1 -- 172.21.15.80:0/1648641129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec74103570 msgr2=0x7fec741989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.387+0000 7fec7a1a9700 1 --2- 172.21.15.80:0/1648641129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec74103570 0x7fec741989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.387+0000 7fec7a1a9700 1 -- 172.21.15.80:0/1648641129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec74103f10 msgr2=0x7fec7419fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.387+0000 7fec7a9aa700 1 --2- 172.21.15.80:0/1648641129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec74103f10 0x7fec7419fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.387+0000 7fec7a1a9700 1 --2- 172.21.15.80:0/1648641129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec74103f10 0x7fec7419fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.387+0000 7fec7a1a9700 1 -- 172.21.15.80:0/1648641129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec741a00f0 con 0x7fec74102370 2024-04-26T18:35:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.387+0000 7fec799a8700 1 --2- 172.21.15.80:0/1648641129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec74103570 0x7fec741989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:35:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.387+0000 7fec7a9aa700 1 --2- 172.21.15.80:0/1648641129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec74103f10 0x7fec7419fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:35:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.388+0000 7fec7a1a9700 1 --2- 172.21.15.80:0/1648641129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec74102370 0x7fec74198490 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fec7000d9b0 tx=0x7fec7000dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.388+0000 7fec6b7fe700 1 -- 172.21.15.80:0/1648641129 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec70017070 con 0x7fec74102370 2024-04-26T18:35:52.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.388+0000 7fec6b7fe700 1 -- 172.21.15.80:0/1648641129 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec70010460 con 0x7fec74102370 2024-04-26T18:35:52.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.388+0000 7fec7c40d700 1 -- 172.21.15.80:0/1648641129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec741a03e0 con 0x7fec74102370 2024-04-26T18:35:52.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.388+0000 7fec6b7fe700 1 -- 172.21.15.80:0/1648641129 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7000f620 con 0x7fec74102370 2024-04-26T18:35:52.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.388+0000 7fec7c40d700 1 -- 172.21.15.80:0/1648641129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec741a0950 con 0x7fec74102370 2024-04-26T18:35:52.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.389+0000 7fec7c40d700 1 -- 172.21.15.80:0/1648641129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec7406a110 con 0x7fec74102370 2024-04-26T18:35:52.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.390+0000 7fec6b7fe700 1 -- 172.21.15.80:0/1648641129 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fec70010610 con 0x7fec74102370 2024-04-26T18:35:52.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.390+0000 7fec6b7fe700 1 --2- 172.21.15.80:0/1648641129 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fec600a3c40 0x7fec600a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:52.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.391+0000 7fec799a8700 1 --2- 172.21.15.80:0/1648641129 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fec600a3c40 0x7fec600a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:52.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.391+0000 7fec6b7fe700 1 -- 172.21.15.80:0/1648641129 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fec700cfff0 con 0x7fec74102370 2024-04-26T18:35:52.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.391+0000 7fec799a8700 1 --2- 172.21.15.80:0/1648641129 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fec600a3c40 0x7fec600a6100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fec640099d0 tx=0x7fec64008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:52.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.394+0000 7fec6b7fe700 1 -- 172.21.15.80:0/1648641129 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fec7009ca00 con 0x7fec74102370 2024-04-26T18:35:52.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.640+0000 7fec7c40d700 1 -- 172.21.15.80:0/1648641129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fec74064030 con 0x7fec74102370 2024-04-26T18:35:52.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.640+0000 7fec6b7fe700 1 -- 172.21.15.80:0/1648641129 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+3082 (secure 0 0 0) 0x7fec7009c300 con 0x7fec74102370 2024-04-26T18:35:52.640 INFO:teuthology.orchestra.run.smithi080.stdout:e26 2024-04-26T18:35:52.640 INFO:teuthology.orchestra.run.smithi080.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T18:35:52.641 INFO:teuthology.orchestra.run.smithi080.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T18:35:52.641 INFO:teuthology.orchestra.run.smithi080.stdout:legacy client fscid: 1 2024-04-26T18:35:52.641 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:35:52.641 INFO:teuthology.orchestra.run.smithi080.stdout:Filesystem 'cephfs' (1) 2024-04-26T18:35:52.641 INFO:teuthology.orchestra.run.smithi080.stdout:fs_name cephfs 2024-04-26T18:35:52.641 INFO:teuthology.orchestra.run.smithi080.stdout:epoch 26 2024-04-26T18:35:52.641 INFO:teuthology.orchestra.run.smithi080.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-26T18:35:52.641 INFO:teuthology.orchestra.run.smithi080.stdout:created 2024-04-26T18:33:08.347399+0000 2024-04-26T18:35:52.641 INFO:teuthology.orchestra.run.smithi080.stdout:modified 2024-04-26T18:33:27.036209+0000 2024-04-26T18:35:52.641 INFO:teuthology.orchestra.run.smithi080.stdout:tableserver 0 2024-04-26T18:35:52.641 INFO:teuthology.orchestra.run.smithi080.stdout:root 0 2024-04-26T18:35:52.641 INFO:teuthology.orchestra.run.smithi080.stdout:session_timeout 300 2024-04-26T18:35:52.641 INFO:teuthology.orchestra.run.smithi080.stdout:session_autoclose 300 2024-04-26T18:35:52.642 INFO:teuthology.orchestra.run.smithi080.stdout:max_file_size 1099511627776 2024-04-26T18:35:52.642 INFO:teuthology.orchestra.run.smithi080.stdout:max_xattr_size 65536 2024-04-26T18:35:52.642 INFO:teuthology.orchestra.run.smithi080.stdout:required_client_features {} 2024-04-26T18:35:52.642 INFO:teuthology.orchestra.run.smithi080.stdout:last_failure 0 2024-04-26T18:35:52.642 INFO:teuthology.orchestra.run.smithi080.stdout:last_failure_osd_epoch 0 2024-04-26T18:35:52.642 INFO:teuthology.orchestra.run.smithi080.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T18:35:52.642 INFO:teuthology.orchestra.run.smithi080.stdout:max_mds 5 2024-04-26T18:35:52.642 INFO:teuthology.orchestra.run.smithi080.stdout:in 0,1,2,3,4 2024-04-26T18:35:52.642 INFO:teuthology.orchestra.run.smithi080.stdout:up {0=24434,1=24421,2=24404,3=24400,4=24394} 2024-04-26T18:35:52.642 INFO:teuthology.orchestra.run.smithi080.stdout:failed 2024-04-26T18:35:52.642 INFO:teuthology.orchestra.run.smithi080.stdout:damaged 2024-04-26T18:35:52.642 INFO:teuthology.orchestra.run.smithi080.stdout:stopped 2024-04-26T18:35:52.642 INFO:teuthology.orchestra.run.smithi080.stdout:data_pools [3] 2024-04-26T18:35:52.642 INFO:teuthology.orchestra.run.smithi080.stdout:metadata_pool 2 2024-04-26T18:35:52.643 INFO:teuthology.orchestra.run.smithi080.stdout:inline_data disabled 2024-04-26T18:35:52.643 INFO:teuthology.orchestra.run.smithi080.stdout:balancer 2024-04-26T18:35:52.643 INFO:teuthology.orchestra.run.smithi080.stdout:bal_rank_mask -1 2024-04-26T18:35:52.643 INFO:teuthology.orchestra.run.smithi080.stdout:standby_count_wanted 0 2024-04-26T18:35:52.643 INFO:teuthology.orchestra.run.smithi080.stdout:qdb_cluster leader: 24434 members: 24404,24434,24394,24400,24421 2024-04-26T18:35:52.643 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.b{0:24434} state up:active seq 6 addr [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T18:35:52.643 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.e{0:24392} state up:standby-replay seq 1 addr [v2:172.21.15.82:6834/572065563,v1:172.21.15.82:6835/572065563] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T18:35:52.643 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.i{1:24421} state up:active seq 11 addr [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T18:35:52.643 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.l{1:24379} state up:standby-replay seq 1 addr [v2:172.21.15.192:6832/2905926211,v1:172.21.15.192:6833/2905926211] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T18:35:52.643 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.h{2:24404} state up:active seq 12 addr [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T18:35:52.643 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.k{2:24371} state up:standby-replay seq 1 addr [v2:172.21.15.82:6832/3564539039,v1:172.21.15.82:6833/3564539039] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T18:35:52.643 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.c{3:24400} state up:active seq 13 addr [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T18:35:52.643 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.a{3:14583} state up:standby-replay seq 1 addr [v2:172.21.15.80:6840/1544670,v1:172.21.15.80:6841/1544670] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T18:35:52.643 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.f{4:24394} state up:active seq 14 addr [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T18:35:52.643 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.g{4:14577} state up:standby-replay seq 1 addr [v2:172.21.15.80:6838/2137993298,v1:172.21.15.80:6839/2137993298] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T18:35:52.644 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:35:52.644 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:35:52.644 INFO:teuthology.orchestra.run.smithi080.stdout:Standby daemons: 2024-04-26T18:35:52.644 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:35:52.644 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.j{-1:14514} state up:standby seq 1 addr [v2:172.21.15.80:6834/1967550873,v1:172.21.15.80:6835/1967550873] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T18:35:52.644 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.d{-1:14526} state up:standby seq 1 addr [v2:172.21.15.80:6836/559541830,v1:172.21.15.80:6837/559541830] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T18:35:52.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.642+0000 7fec7c40d700 1 -- 172.21.15.80:0/1648641129 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fec600a3c40 msgr2=0x7fec600a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:52.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.642+0000 7fec7c40d700 1 --2- 172.21.15.80:0/1648641129 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fec600a3c40 0x7fec600a6100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fec640099d0 tx=0x7fec64008040 comp rx=0 tx=0).stop 2024-04-26T18:35:52.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.642+0000 7fec7c40d700 1 -- 172.21.15.80:0/1648641129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec74102370 msgr2=0x7fec74198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:52.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.642+0000 7fec7c40d700 1 --2- 172.21.15.80:0/1648641129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec74102370 0x7fec74198490 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fec7000d9b0 tx=0x7fec7000dd70 comp rx=0 tx=0).stop 2024-04-26T18:35:52.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.642+0000 7fec7c40d700 1 -- 172.21.15.80:0/1648641129 shutdown_connections 2024-04-26T18:35:52.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.642+0000 7fec7c40d700 1 --2- 172.21.15.80:0/1648641129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec74103f10 0x7fec7419fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:52.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.642+0000 7fec7c40d700 1 --2- 172.21.15.80:0/1648641129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec74102370 0x7fec74198490 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:52.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.642+0000 7fec7c40d700 1 --2- 172.21.15.80:0/1648641129 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fec600a3c40 0x7fec600a6100 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:52.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.642+0000 7fec7c40d700 1 --2- 172.21.15.80:0/1648641129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec74103570 0x7fec741989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:52.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.642+0000 7fec7c40d700 1 -- 172.21.15.80:0/1648641129 >> 172.21.15.80:0/1648641129 conn(0x7fec740fd910 msgr2=0x7fec74106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:52.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.642+0000 7fec7c40d700 1 -- 172.21.15.80:0/1648641129 shutdown_connections 2024-04-26T18:35:52.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:52.642+0000 7fec7c40d700 1 -- 172.21.15.80:0/1648641129 wait complete. 2024-04-26T18:35:52.646 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 26 2024-04-26T18:35:52.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:52 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1648641129' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T18:35:52.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:52 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1648641129' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T18:35:53.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:52 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1648641129' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T18:35:53.447 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- bash -c 'ceph osd dump' 2024-04-26T18:35:53.689 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:35:53.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:53 smithi080 ceph-mon[29135]: pgmap v382: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:35:53.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:53 smithi082 ceph-mon[32808]: pgmap v382: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:35:54.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:53 smithi192 ceph-mon[32842]: pgmap v382: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:35:55.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.515+0000 7f3c77646700 1 -- 172.21.15.80:0/4038191232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c70103570 msgr2=0x7f3c701039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:55.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.515+0000 7f3c77646700 1 --2- 172.21.15.80:0/4038191232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c70103570 0x7f3c701039d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3c600099c0 tx=0x7f3c60009cd0 comp rx=0 tx=0).stop 2024-04-26T18:35:55.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.515+0000 7f3c77646700 1 -- 172.21.15.80:0/4038191232 shutdown_connections 2024-04-26T18:35:55.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.515+0000 7f3c77646700 1 --2- 172.21.15.80:0/4038191232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c70103f10 0x7f3c7010a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:55.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.515+0000 7f3c77646700 1 --2- 172.21.15.80:0/4038191232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c70102370 0x7f3c70102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:55.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.515+0000 7f3c77646700 1 --2- 172.21.15.80:0/4038191232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c70103570 0x7f3c701039d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:55.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.515+0000 7f3c77646700 1 -- 172.21.15.80:0/4038191232 >> 172.21.15.80:0/4038191232 conn(0x7f3c700fd910 msgr2=0x7f3c700ffd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:55.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.515+0000 7f3c77646700 1 -- 172.21.15.80:0/4038191232 shutdown_connections 2024-04-26T18:35:55.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.515+0000 7f3c77646700 1 -- 172.21.15.80:0/4038191232 wait complete. 2024-04-26T18:35:55.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.515+0000 7f3c77646700 1 Processor -- start 2024-04-26T18:35:55.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.515+0000 7f3c77646700 1 -- start start 2024-04-26T18:35:55.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.516+0000 7f3c77646700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c70102370 0x7f3c7006c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:55.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.516+0000 7f3c77646700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c70103570 0x7f3c7019e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:55.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.516+0000 7f3c77646700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c70103f10 0x7f3c701a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:55.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.516+0000 7f3c77646700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7010df50 con 0x7f3c70103570 2024-04-26T18:35:55.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.516+0000 7f3c77646700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7010ddd0 con 0x7f3c70103f10 2024-04-26T18:35:55.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.516+0000 7f3c77646700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7010e0d0 con 0x7f3c70102370 2024-04-26T18:35:55.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.516+0000 7f3c74be1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c70103570 0x7f3c7019e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:55.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.516+0000 7f3c74be1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c70103570 0x7f3c7019e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33916/0 (socket says 172.21.15.80:33916) 2024-04-26T18:35:55.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.516+0000 7f3c74be1700 1 -- 172.21.15.80:0/3497949422 learned_addr learned my addr 172.21.15.80:0/3497949422 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:55.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.516+0000 7f3c75be3700 1 --2- 172.21.15.80:0/3497949422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c70103f10 0x7f3c701a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:55.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.516+0000 7f3c753e2700 1 --2- 172.21.15.80:0/3497949422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c70102370 0x7f3c7006c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:55.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.516+0000 7f3c74be1700 1 -- 172.21.15.80:0/3497949422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c70102370 msgr2=0x7f3c7006c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:55.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.516+0000 7f3c74be1700 1 --2- 172.21.15.80:0/3497949422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c70102370 0x7f3c7006c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:55.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.516+0000 7f3c74be1700 1 -- 172.21.15.80:0/3497949422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c70103f10 msgr2=0x7f3c701a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:55.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.516+0000 7f3c74be1700 1 --2- 172.21.15.80:0/3497949422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c70103f10 0x7f3c701a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:55.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.516+0000 7f3c74be1700 1 -- 172.21.15.80:0/3497949422 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c701a13f0 con 0x7f3c70103570 2024-04-26T18:35:55.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.516+0000 7f3c75be3700 1 --2- 172.21.15.80:0/3497949422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c70103f10 0x7f3c701a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:35:55.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.516+0000 7f3c74be1700 1 --2- 172.21.15.80:0/3497949422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c70103570 0x7f3c7019e4e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3c60000c00 tx=0x7f3c60003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:55.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.516+0000 7f3c667fc700 1 -- 172.21.15.80:0/3497949422 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c60027070 con 0x7f3c70103570 2024-04-26T18:35:55.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.516+0000 7f3c77646700 1 -- 172.21.15.80:0/3497949422 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c701a1680 con 0x7f3c70103570 2024-04-26T18:35:55.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.516+0000 7f3c667fc700 1 -- 172.21.15.80:0/3497949422 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c60022470 con 0x7f3c70103570 2024-04-26T18:35:55.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.516+0000 7f3c667fc700 1 -- 172.21.15.80:0/3497949422 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6000f6a0 con 0x7f3c70103570 2024-04-26T18:35:55.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.517+0000 7f3c77646700 1 -- 172.21.15.80:0/3497949422 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c701a1bb0 con 0x7f3c70103570 2024-04-26T18:35:55.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.518+0000 7f3c77646700 1 -- 172.21.15.80:0/3497949422 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c7006a110 con 0x7f3c70103570 2024-04-26T18:35:55.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.519+0000 7f3c667fc700 1 -- 172.21.15.80:0/3497949422 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f3c6002a070 con 0x7f3c70103570 2024-04-26T18:35:55.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.519+0000 7f3c667fc700 1 --2- 172.21.15.80:0/3497949422 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f3c5c0a3c40 0x7f3c5c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:55.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.519+0000 7f3c753e2700 1 --2- 172.21.15.80:0/3497949422 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f3c5c0a3c40 0x7f3c5c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:55.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.519+0000 7f3c667fc700 1 -- 172.21.15.80:0/3497949422 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f3c600d12d0 con 0x7f3c70103570 2024-04-26T18:35:55.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.520+0000 7f3c753e2700 1 --2- 172.21.15.80:0/3497949422 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f3c5c0a3c40 0x7f3c5c0a6100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c006fd0 tx=0x7f3c6c008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:55.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.524+0000 7f3c667fc700 1 -- 172.21.15.80:0/3497949422 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3c60013070 con 0x7f3c70103570 2024-04-26T18:35:55.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.723+0000 7f3c77646700 1 -- 172.21.15.80:0/3497949422 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f3c70064030 con 0x7f3c70103570 2024-04-26T18:35:55.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.724+0000 7f3c667fc700 1 -- 172.21.15.80:0/3497949422 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v91) ==== 56+0+5233 (secure 0 0 0) 0x7f3c6009dd70 con 0x7f3c70103570 2024-04-26T18:35:55.724 INFO:teuthology.orchestra.run.smithi080.stdout:epoch 91 2024-04-26T18:35:55.724 INFO:teuthology.orchestra.run.smithi080.stdout:fsid 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:35:55.724 INFO:teuthology.orchestra.run.smithi080.stdout:created 2024-04-26T18:24:58.809431+0000 2024-04-26T18:35:55.724 INFO:teuthology.orchestra.run.smithi080.stdout:modified 2024-04-26T18:33:51.637301+0000 2024-04-26T18:35:55.724 INFO:teuthology.orchestra.run.smithi080.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-26T18:35:55.724 INFO:teuthology.orchestra.run.smithi080.stdout:crush_version 26 2024-04-26T18:35:55.725 INFO:teuthology.orchestra.run.smithi080.stdout:full_ratio 0.95 2024-04-26T18:35:55.725 INFO:teuthology.orchestra.run.smithi080.stdout:backfillfull_ratio 0.9 2024-04-26T18:35:55.725 INFO:teuthology.orchestra.run.smithi080.stdout:nearfull_ratio 0.85 2024-04-26T18:35:55.725 INFO:teuthology.orchestra.run.smithi080.stdout:require_min_compat_client luminous 2024-04-26T18:35:55.725 INFO:teuthology.orchestra.run.smithi080.stdout:min_compat_client luminous 2024-04-26T18:35:55.725 INFO:teuthology.orchestra.run.smithi080.stdout:require_osd_release squid 2024-04-26T18:35:55.725 INFO:teuthology.orchestra.run.smithi080.stdout:stretch_mode_enabled false 2024-04-26T18:35:55.725 INFO:teuthology.orchestra.run.smithi080.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-04-26T18:35:55.725 INFO:teuthology.orchestra.run.smithi080.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 89 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-04-26T18:35:55.725 INFO:teuthology.orchestra.run.smithi080.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 89 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-04-26T18:35:55.725 INFO:teuthology.orchestra.run.smithi080.stdout:max_osd 12 2024-04-26T18:35:55.725 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0 up in weight 1 up_from 8 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6802/429487384,v1:172.21.15.80:6803/429487384] [v2:172.21.15.80:6804/429487384,v1:172.21.15.80:6805/429487384] exists,up 7a01cfe6-d13a-4828-8c20-ad7fee7e87ba 2024-04-26T18:35:55.725 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1 up in weight 1 up_from 13 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6800/3913033849,v1:172.21.15.82:6801/3913033849] [v2:172.21.15.82:6802/3913033849,v1:172.21.15.82:6803/3913033849] exists,up 1f815d88-30b1-4540-b4f5-cc3d62707318 2024-04-26T18:35:55.726 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2 up in weight 1 up_from 18 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.192:6800/503427508,v1:172.21.15.192:6801/503427508] [v2:172.21.15.192:6802/503427508,v1:172.21.15.192:6803/503427508] exists,up b8625dd7-4c1d-4258-ac2b-463ff96f4cf0 2024-04-26T18:35:55.726 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3 up in weight 1 up_from 26 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6810/407817066,v1:172.21.15.80:6811/407817066] [v2:172.21.15.80:6812/407817066,v1:172.21.15.80:6813/407817066] exists,up 3068321a-3070-44ae-9bbd-a3faac8c21fa 2024-04-26T18:35:55.726 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4 up in weight 1 up_from 34 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6808/2068291934,v1:172.21.15.82:6809/2068291934] [v2:172.21.15.82:6810/2068291934,v1:172.21.15.82:6811/2068291934] exists,up 6b3d6455-9495-435b-8193-a260b63504ec 2024-04-26T18:35:55.726 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5 up in weight 1 up_from 39 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.192:6808/1770809727,v1:172.21.15.192:6809/1770809727] [v2:172.21.15.192:6810/1770809727,v1:172.21.15.192:6811/1770809727] exists,up 538863f1-1486-45b5-a675-ecb1d3035599 2024-04-26T18:35:55.726 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6 up in weight 1 up_from 47 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6818/145064490,v1:172.21.15.80:6819/145064490] [v2:172.21.15.80:6820/145064490,v1:172.21.15.80:6821/145064490] exists,up 7b4374d8-98e6-48e1-924b-c9b70a4baf28 2024-04-26T18:35:55.726 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7 up in weight 1 up_from 52 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6816/208047447,v1:172.21.15.82:6817/208047447] [v2:172.21.15.82:6818/208047447,v1:172.21.15.82:6819/208047447] exists,up f3bb3c7d-4cce-4f49-b924-72ebbaad58ff 2024-04-26T18:35:55.726 INFO:teuthology.orchestra.run.smithi080.stdout:osd.8 up in weight 1 up_from 60 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.192:6816/3763069187,v1:172.21.15.192:6817/3763069187] [v2:172.21.15.192:6818/3763069187,v1:172.21.15.192:6819/3763069187] exists,up 6557b536-a516-4b01-a607-7981620fb2a2 2024-04-26T18:35:55.726 INFO:teuthology.orchestra.run.smithi080.stdout:osd.9 up in weight 1 up_from 68 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6826/2109877993,v1:172.21.15.80:6827/2109877993] [v2:172.21.15.80:6828/2109877993,v1:172.21.15.80:6829/2109877993] exists,up 838615a7-1e68-4e81-8b3a-fba0ea75f7e1 2024-04-26T18:35:55.726 INFO:teuthology.orchestra.run.smithi080.stdout:osd.10 up in weight 1 up_from 73 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6824/2877220993,v1:172.21.15.82:6825/2877220993] [v2:172.21.15.82:6826/2877220993,v1:172.21.15.82:6827/2877220993] exists,up cd664e50-3217-453d-9a89-6e26d717e6be 2024-04-26T18:35:55.726 INFO:teuthology.orchestra.run.smithi080.stdout:osd.11 up in weight 1 up_from 81 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.192:6824/3466865106,v1:172.21.15.192:6825/3466865106] [v2:172.21.15.192:6826/3466865106,v1:172.21.15.192:6827/3466865106] exists,up e52807c6-8890-4df7-a8c6-51a7ff4b467b 2024-04-26T18:35:55.726 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 2.a [2,11] 2024-04-26T18:35:55.726 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 2.b [2,1] 2024-04-26T18:35:55.726 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 2.f [8,11] 2024-04-26T18:35:55.726 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 2.1f [8,4] 2024-04-26T18:35:55.727 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 3.11 [5,9] 2024-04-26T18:35:55.727 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 3.13 [4,9] 2024-04-26T18:35:55.727 INFO:teuthology.orchestra.run.smithi080.stdout:pg_upmap_items 3.34 [4,9] 2024-04-26T18:35:55.727 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:6801/1997155783 expires 2024-04-27T18:25:50.413207+0000 2024-04-26T18:35:55.727 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/323607684 expires 2024-04-27T18:25:50.413207+0000 2024-04-26T18:35:55.727 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/586397709 expires 2024-04-27T18:25:50.413207+0000 2024-04-26T18:35:55.727 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:6801/4208962819 expires 2024-04-27T18:25:24.440373+0000 2024-04-26T18:35:55.727 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/1353083127 expires 2024-04-27T18:25:24.440373+0000 2024-04-26T18:35:55.727 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:6800/1997155783 expires 2024-04-27T18:25:50.413207+0000 2024-04-26T18:35:55.727 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:6800/4208962819 expires 2024-04-27T18:25:24.440373+0000 2024-04-26T18:35:55.727 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/2644175019 expires 2024-04-27T18:25:24.440373+0000 2024-04-26T18:35:55.727 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/1853513470 expires 2024-04-27T18:25:24.440373+0000 2024-04-26T18:35:55.727 INFO:teuthology.orchestra.run.smithi080.stdout:blocklist 172.21.15.80:0/2122929159 expires 2024-04-27T18:25:50.413207+0000 2024-04-26T18:35:55.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.726+0000 7f3c77646700 1 -- 172.21.15.80:0/3497949422 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f3c5c0a3c40 msgr2=0x7f3c5c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:55.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.726+0000 7f3c77646700 1 --2- 172.21.15.80:0/3497949422 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f3c5c0a3c40 0x7f3c5c0a6100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c006fd0 tx=0x7f3c6c008040 comp rx=0 tx=0).stop 2024-04-26T18:35:55.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.726+0000 7f3c77646700 1 -- 172.21.15.80:0/3497949422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c70103570 msgr2=0x7f3c7019e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:55.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.726+0000 7f3c77646700 1 --2- 172.21.15.80:0/3497949422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c70103570 0x7f3c7019e4e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3c60000c00 tx=0x7f3c60003730 comp rx=0 tx=0).stop 2024-04-26T18:35:55.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.726+0000 7f3c77646700 1 -- 172.21.15.80:0/3497949422 shutdown_connections 2024-04-26T18:35:55.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.726+0000 7f3c77646700 1 --2- 172.21.15.80:0/3497949422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c70103f10 0x7f3c701a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:55.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.726+0000 7f3c77646700 1 --2- 172.21.15.80:0/3497949422 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f3c5c0a3c40 0x7f3c5c0a6100 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:55.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.726+0000 7f3c77646700 1 --2- 172.21.15.80:0/3497949422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c70102370 0x7f3c7006c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:55.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.726+0000 7f3c77646700 1 --2- 172.21.15.80:0/3497949422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c70103570 0x7f3c7019e4e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:55.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.726+0000 7f3c77646700 1 -- 172.21.15.80:0/3497949422 >> 172.21.15.80:0/3497949422 conn(0x7f3c700fd910 msgr2=0x7f3c70106980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:55.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.726+0000 7f3c77646700 1 -- 172.21.15.80:0/3497949422 shutdown_connections 2024-04-26T18:35:55.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:55.726+0000 7f3c77646700 1 -- 172.21.15.80:0/3497949422 wait complete. 2024-04-26T18:35:55.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:55 smithi082 ceph-mon[32808]: pgmap v383: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:55.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:55 smithi080 ceph-mon[29135]: pgmap v383: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:56.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:55 smithi192 ceph-mon[32842]: pgmap v383: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:56.456 INFO:teuthology.run_tasks:Running task fs.ready... 2024-04-26T18:35:56.467 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:35:56.704 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:35:56.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:56 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3497949422' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-26T18:35:56.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:56 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3497949422' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-26T18:35:57.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:56 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3497949422' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-26T18:35:57.938 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:57 smithi080 ceph-mon[29135]: pgmap v384: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:35:57.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:57 smithi082 ceph-mon[32808]: pgmap v384: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:35:58.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:57 smithi192 ceph-mon[32842]: pgmap v384: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:35:58.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.508+0000 7ff4022d0700 1 -- 172.21.15.80:0/2482746045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3fc108380 msgr2=0x7ff3fc06bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:58.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.508+0000 7ff4022d0700 1 --2- 172.21.15.80:0/2482746045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3fc108380 0x7ff3fc06bb30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec009990 tx=0x7ff3ec009ca0 comp rx=0 tx=0).stop 2024-04-26T18:35:58.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.509+0000 7ff4022d0700 1 -- 172.21.15.80:0/2482746045 shutdown_connections 2024-04-26T18:35:58.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.509+0000 7ff4022d0700 1 --2- 172.21.15.80:0/2482746045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3fc06c750 0x7ff3fc105f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:58.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.509+0000 7ff4022d0700 1 --2- 172.21.15.80:0/2482746045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3fc108380 0x7ff3fc06bb30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:58.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.509+0000 7ff4022d0700 1 --2- 172.21.15.80:0/2482746045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3fc1087f0 0x7ff3fc06c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:58.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.509+0000 7ff4022d0700 1 -- 172.21.15.80:0/2482746045 >> 172.21.15.80:0/2482746045 conn(0x7ff3fc079080 msgr2=0x7ff3fc079490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:58.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.509+0000 7ff4022d0700 1 -- 172.21.15.80:0/2482746045 shutdown_connections 2024-04-26T18:35:58.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.509+0000 7ff4022d0700 1 -- 172.21.15.80:0/2482746045 wait complete. 2024-04-26T18:35:58.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.509+0000 7ff4022d0700 1 Processor -- start 2024-04-26T18:35:58.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.509+0000 7ff4022d0700 1 -- start start 2024-04-26T18:35:58.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.509+0000 7ff4022d0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3fc108380 0x7ff3fc1a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:58.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.510+0000 7ff4022d0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3fc1087f0 0x7ff3fc1a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:58.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.510+0000 7ff4022d0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3fc1a4a40 0x7ff3fc1a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:58.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.510+0000 7ff4022d0700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc119c40 con 0x7ff3fc108380 2024-04-26T18:35:58.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.510+0000 7ff4022d0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc119ac0 con 0x7ff3fc1087f0 2024-04-26T18:35:58.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.510+0000 7ff4022d0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc119dc0 con 0x7ff3fc1a4a40 2024-04-26T18:35:58.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.510+0000 7ff3fbfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3fc108380 0x7ff3fc1a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:58.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.510+0000 7ff3fbfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3fc108380 0x7ff3fc1a0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33926/0 (socket says 172.21.15.80:33926) 2024-04-26T18:35:58.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.510+0000 7ff3fbfff700 1 -- 172.21.15.80:0/3756934217 learned_addr learned my addr 172.21.15.80:0/3756934217 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:35:58.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.510+0000 7ff40086d700 1 --2- 172.21.15.80:0/3756934217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3fc1a4a40 0x7ff3fc1a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:58.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.510+0000 7ff3fb7fe700 1 --2- 172.21.15.80:0/3756934217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3fc1087f0 0x7ff3fc1a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:58.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.510+0000 7ff3fbfff700 1 -- 172.21.15.80:0/3756934217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3fc1a4a40 msgr2=0x7ff3fc1a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:58.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.510+0000 7ff3fbfff700 1 --2- 172.21.15.80:0/3756934217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3fc1a4a40 0x7ff3fc1a4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:58.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.510+0000 7ff3fbfff700 1 -- 172.21.15.80:0/3756934217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3fc1087f0 msgr2=0x7ff3fc1a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:58.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.510+0000 7ff3fbfff700 1 --2- 172.21.15.80:0/3756934217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3fc1087f0 0x7ff3fc1a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:58.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.510+0000 7ff3fbfff700 1 -- 172.21.15.80:0/3756934217 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3fc1a5560 con 0x7ff3fc108380 2024-04-26T18:35:58.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.510+0000 7ff3fb7fe700 1 --2- 172.21.15.80:0/3756934217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3fc1087f0 0x7ff3fc1a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:35:58.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.510+0000 7ff3fbfff700 1 --2- 172.21.15.80:0/3756934217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3fc108380 0x7ff3fc1a0170 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec000c00 tx=0x7ff3ec0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:58.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.510+0000 7ff3f97fa700 1 -- 172.21.15.80:0/3756934217 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec027070 con 0x7ff3fc108380 2024-04-26T18:35:58.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.510+0000 7ff4022d0700 1 -- 172.21.15.80:0/3756934217 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3fc1a57f0 con 0x7ff3fc108380 2024-04-26T18:35:58.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.510+0000 7ff3f97fa700 1 -- 172.21.15.80:0/3756934217 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3ec003fa0 con 0x7ff3fc108380 2024-04-26T18:35:58.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.510+0000 7ff4022d0700 1 -- 172.21.15.80:0/3756934217 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3fc1acf70 con 0x7ff3fc108380 2024-04-26T18:35:58.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.510+0000 7ff3f97fa700 1 -- 172.21.15.80:0/3756934217 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec022db0 con 0x7ff3fc108380 2024-04-26T18:35:58.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.511+0000 7ff4022d0700 1 -- 172.21.15.80:0/3756934217 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3fc06a110 con 0x7ff3fc108380 2024-04-26T18:35:58.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.513+0000 7ff3f97fa700 1 -- 172.21.15.80:0/3756934217 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7ff3ec02a070 con 0x7ff3fc108380 2024-04-26T18:35:58.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.514+0000 7ff3f97fa700 1 --2- 172.21.15.80:0/3756934217 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff3e40a3c40 0x7ff3e40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:35:58.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.514+0000 7ff3fb7fe700 1 --2- 172.21.15.80:0/3756934217 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff3e40a3c40 0x7ff3e40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:35:58.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.514+0000 7ff3f97fa700 1 -- 172.21.15.80:0/3756934217 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7ff3ec0d1590 con 0x7ff3fc108380 2024-04-26T18:35:58.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.514+0000 7ff3fb7fe700 1 --2- 172.21.15.80:0/3756934217 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff3e40a3c40 0x7ff3e40a6100 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0005fd0 tx=0x7ff3f0005d40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:35:58.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.517+0000 7ff3f97fa700 1 -- 172.21.15.80:0/3756934217 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff3ec013070 con 0x7ff3fc108380 2024-04-26T18:35:58.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.761+0000 7ff4022d0700 1 -- 172.21.15.80:0/3756934217 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3fc06c750 con 0x7ff3fc108380 2024-04-26T18:35:58.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.762+0000 7ff3f97fa700 1 -- 172.21.15.80:0/3756934217 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11918 (secure 0 0 0) 0x7ff3ec09e030 con 0x7ff3fc108380 2024-04-26T18:35:58.762 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:35:58.763 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1967550873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1967550873},{"type":"v1","addr":"172.21.15.80:6835","nonce":1967550873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/559541830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":559541830},{"type":"v1","addr":"172.21.15.80:6837","nonce":559541830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T18:33:08.347399+0000","modified":"2024-04-26T18:33:27.036209+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24434,"mds_1":24421,"mds_2":24404,"mds_3":24400,"mds_4":24394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14577":{"gid":14577,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6839/2137993298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":2137993298},{"type":"v1","addr":"172.21.15.80:6839","nonce":2137993298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6841/1544670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1544670},{"type":"v1","addr":"172.21.15.80:6841","nonce":1544670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24371":{"gid":24371,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/3564539039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3564539039},{"type":"v1","addr":"172.21.15.82:6833","nonce":3564539039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24379":{"gid":24379,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/572065563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":572065563},{"type":"v1","addr":"172.21.15.82:6835","nonce":572065563}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.192:6835/719058020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":719058020},{"type":"v1","addr":"172.21.15.192:6835","nonce":719058020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.192:6837/2361996920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2361996920},{"type":"v1","addr":"172.21.15.192:6837","nonce":2361996920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.82:6837/2084055551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2084055551},{"type":"v1","addr":"172.21.15.82:6837","nonce":2084055551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6839/2735406056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":2735406056},{"type":"v1","addr":"172.21.15.192:6839","nonce":2735406056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.82:6839/1482576497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1482576497},{"type":"v1","addr":"172.21.15.82:6839","nonce":1482576497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24434,"qdb_cluster":[24404,24434,24394,24400,24421]},"id":1}]} 2024-04-26T18:35:58.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.764+0000 7ff4022d0700 1 -- 172.21.15.80:0/3756934217 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff3e40a3c40 msgr2=0x7ff3e40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:58.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.764+0000 7ff4022d0700 1 --2- 172.21.15.80:0/3756934217 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff3e40a3c40 0x7ff3e40a6100 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0005fd0 tx=0x7ff3f0005d40 comp rx=0 tx=0).stop 2024-04-26T18:35:58.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.764+0000 7ff4022d0700 1 -- 172.21.15.80:0/3756934217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3fc108380 msgr2=0x7ff3fc1a0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:35:58.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.764+0000 7ff4022d0700 1 --2- 172.21.15.80:0/3756934217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3fc108380 0x7ff3fc1a0170 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec000c00 tx=0x7ff3ec0047b0 comp rx=0 tx=0).stop 2024-04-26T18:35:58.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.764+0000 7ff4022d0700 1 -- 172.21.15.80:0/3756934217 shutdown_connections 2024-04-26T18:35:58.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.764+0000 7ff4022d0700 1 --2- 172.21.15.80:0/3756934217 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff3e40a3c40 0x7ff3e40a6100 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:58.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.764+0000 7ff4022d0700 1 --2- 172.21.15.80:0/3756934217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3fc1a4a40 0x7ff3fc1a4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:58.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.764+0000 7ff4022d0700 1 --2- 172.21.15.80:0/3756934217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3fc108380 0x7ff3fc1a0170 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:58.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.764+0000 7ff4022d0700 1 --2- 172.21.15.80:0/3756934217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3fc1087f0 0x7ff3fc1a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:35:58.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.764+0000 7ff4022d0700 1 -- 172.21.15.80:0/3756934217 >> 172.21.15.80:0/3756934217 conn(0x7ff3fc079080 msgr2=0x7ff3fc103510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:35:58.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.764+0000 7ff4022d0700 1 -- 172.21.15.80:0/3756934217 shutdown_connections 2024-04-26T18:35:58.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:35:58.764+0000 7ff4022d0700 1 -- 172.21.15.80:0/3756934217 wait complete. 2024-04-26T18:35:58.766 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 26 2024-04-26T18:35:59.581 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:35:59.826 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:35:59.948 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:59 smithi080 ceph-mon[29135]: pgmap v385: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:59.948 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:35:59 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3756934217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:35:59.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:59 smithi082 ceph-mon[32808]: pgmap v385: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:35:59.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:35:59 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3756934217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:36:00.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:59 smithi192 ceph-mon[32842]: pgmap v385: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:36:00.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:35:59 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3756934217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:36:01.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.611+0000 7f6ce336f700 1 -- 172.21.15.80:0/3945670193 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cdc1034c0 msgr2=0x7f6cdc103940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:01.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.611+0000 7f6ce336f700 1 --2- 172.21.15.80:0/3945670193 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cdc1034c0 0x7f6cdc103940 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6cd00099c0 tx=0x7f6cd0009cd0 comp rx=0 tx=0).stop 2024-04-26T18:36:01.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.611+0000 7f6ce336f700 1 -- 172.21.15.80:0/3945670193 shutdown_connections 2024-04-26T18:36:01.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.611+0000 7f6ce336f700 1 --2- 172.21.15.80:0/3945670193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cdc103e80 0x7f6cdc110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:01.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.611+0000 7f6ce336f700 1 --2- 172.21.15.80:0/3945670193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cdc109560 0x7f6cdc109940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:01.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.611+0000 7f6ce336f700 1 --2- 172.21.15.80:0/3945670193 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cdc1034c0 0x7f6cdc103940 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:01.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.611+0000 7f6ce336f700 1 -- 172.21.15.80:0/3945670193 >> 172.21.15.80:0/3945670193 conn(0x7f6cdc07a5d0 msgr2=0x7f6cdc07a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:01.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.611+0000 7f6ce336f700 1 -- 172.21.15.80:0/3945670193 shutdown_connections 2024-04-26T18:36:01.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.611+0000 7f6ce336f700 1 -- 172.21.15.80:0/3945670193 wait complete. 2024-04-26T18:36:01.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.612+0000 7f6ce336f700 1 Processor -- start 2024-04-26T18:36:01.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.612+0000 7f6ce336f700 1 -- start start 2024-04-26T18:36:01.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.612+0000 7f6ce336f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cdc1034c0 0x7f6cdc075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:01.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.612+0000 7f6ce336f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cdc103e80 0x7f6cdc075c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:01.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.612+0000 7f6ce336f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cdc109560 0x7f6cdc0761a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:01.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.612+0000 7f6ce336f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc113670 con 0x7f6cdc109560 2024-04-26T18:36:01.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.612+0000 7f6ce336f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc1134f0 con 0x7f6cdc1034c0 2024-04-26T18:36:01.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.612+0000 7f6ce336f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc1137f0 con 0x7f6cdc103e80 2024-04-26T18:36:01.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.613+0000 7f6ce190c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cdc109560 0x7f6cdc0761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:01.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.613+0000 7f6ce190c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cdc109560 0x7f6cdc0761a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33944/0 (socket says 172.21.15.80:33944) 2024-04-26T18:36:01.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.613+0000 7f6ce190c700 1 -- 172.21.15.80:0/312341605 learned_addr learned my addr 172.21.15.80:0/312341605 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:01.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.613+0000 7f6ce090a700 1 --2- 172.21.15.80:0/312341605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cdc103e80 0x7f6cdc075c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:01.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.613+0000 7f6ce110b700 1 --2- 172.21.15.80:0/312341605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cdc1034c0 0x7f6cdc075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:01.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.613+0000 7f6ce190c700 1 -- 172.21.15.80:0/312341605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cdc103e80 msgr2=0x7f6cdc075c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:01.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.613+0000 7f6ce190c700 1 --2- 172.21.15.80:0/312341605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cdc103e80 0x7f6cdc075c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:01.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.613+0000 7f6ce190c700 1 -- 172.21.15.80:0/312341605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cdc1034c0 msgr2=0x7f6cdc075720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:01.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.613+0000 7f6ce190c700 1 --2- 172.21.15.80:0/312341605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cdc1034c0 0x7f6cdc075720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:01.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.613+0000 7f6ce190c700 1 -- 172.21.15.80:0/312341605 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cdc1a7ff0 con 0x7f6cdc109560 2024-04-26T18:36:01.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.613+0000 7f6ce190c700 1 --2- 172.21.15.80:0/312341605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cdc109560 0x7f6cdc0761a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00c970 tx=0x7f6ccc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:01.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.613+0000 7f6cda7fc700 1 -- 172.21.15.80:0/312341605 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc004a30 con 0x7f6cdc109560 2024-04-26T18:36:01.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.613+0000 7f6ce336f700 1 -- 172.21.15.80:0/312341605 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cdc1a82e0 con 0x7f6cdc109560 2024-04-26T18:36:01.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.613+0000 7f6cda7fc700 1 -- 172.21.15.80:0/312341605 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ccc0054d0 con 0x7f6cdc109560 2024-04-26T18:36:01.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.614+0000 7f6cda7fc700 1 -- 172.21.15.80:0/312341605 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc00ec20 con 0x7f6cdc109560 2024-04-26T18:36:01.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.614+0000 7f6ce336f700 1 -- 172.21.15.80:0/312341605 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cdc1a8840 con 0x7f6cdc109560 2024-04-26T18:36:01.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.614+0000 7f6ce336f700 1 -- 172.21.15.80:0/312341605 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cdc104bd0 con 0x7f6cdc109560 2024-04-26T18:36:01.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.615+0000 7f6cda7fc700 1 -- 172.21.15.80:0/312341605 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f6ccc004fa0 con 0x7f6cdc109560 2024-04-26T18:36:01.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.616+0000 7f6cda7fc700 1 --2- 172.21.15.80:0/312341605 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6cc40a3c40 0x7f6cc40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:01.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.616+0000 7f6ce110b700 1 --2- 172.21.15.80:0/312341605 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6cc40a3c40 0x7f6cc40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:01.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.616+0000 7f6cda7fc700 1 -- 172.21.15.80:0/312341605 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f6ccc0d0180 con 0x7f6cdc109560 2024-04-26T18:36:01.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.616+0000 7f6ce110b700 1 --2- 172.21.15.80:0/312341605 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6cc40a3c40 0x7f6cc40a6100 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4007fd0 tx=0x7f6cd400c040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:01.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.620+0000 7f6cda7fc700 1 -- 172.21.15.80:0/312341605 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6ccc014030 con 0x7f6cdc109560 2024-04-26T18:36:01.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.867+0000 7f6ce336f700 1 -- 172.21.15.80:0/312341605 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6cdc076c50 con 0x7f6cdc109560 2024-04-26T18:36:01.867 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:01 smithi080 ceph-mon[29135]: pgmap v386: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:36:01.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.868+0000 7f6cda7fc700 1 -- 172.21.15.80:0/312341605 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11918 (secure 0 0 0) 0x7f6ccc09cb90 con 0x7f6cdc109560 2024-04-26T18:36:01.868 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:36:01.868 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1967550873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1967550873},{"type":"v1","addr":"172.21.15.80:6835","nonce":1967550873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/559541830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":559541830},{"type":"v1","addr":"172.21.15.80:6837","nonce":559541830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T18:33:08.347399+0000","modified":"2024-04-26T18:33:27.036209+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24434,"mds_1":24421,"mds_2":24404,"mds_3":24400,"mds_4":24394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14577":{"gid":14577,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6839/2137993298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":2137993298},{"type":"v1","addr":"172.21.15.80:6839","nonce":2137993298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6841/1544670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1544670},{"type":"v1","addr":"172.21.15.80:6841","nonce":1544670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24371":{"gid":24371,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/3564539039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3564539039},{"type":"v1","addr":"172.21.15.82:6833","nonce":3564539039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24379":{"gid":24379,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/572065563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":572065563},{"type":"v1","addr":"172.21.15.82:6835","nonce":572065563}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.192:6835/719058020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":719058020},{"type":"v1","addr":"172.21.15.192:6835","nonce":719058020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.192:6837/2361996920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2361996920},{"type":"v1","addr":"172.21.15.192:6837","nonce":2361996920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.82:6837/2084055551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2084055551},{"type":"v1","addr":"172.21.15.82:6837","nonce":2084055551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6839/2735406056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":2735406056},{"type":"v1","addr":"172.21.15.192:6839","nonce":2735406056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.82:6839/1482576497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1482576497},{"type":"v1","addr":"172.21.15.82:6839","nonce":1482576497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24434,"qdb_cluster":[24404,24434,24394,24400,24421]},"id":1}]} 2024-04-26T18:36:01.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.870+0000 7f6ce336f700 1 -- 172.21.15.80:0/312341605 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6cc40a3c40 msgr2=0x7f6cc40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:01.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.870+0000 7f6ce336f700 1 --2- 172.21.15.80:0/312341605 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6cc40a3c40 0x7f6cc40a6100 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4007fd0 tx=0x7f6cd400c040 comp rx=0 tx=0).stop 2024-04-26T18:36:01.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.870+0000 7f6ce336f700 1 -- 172.21.15.80:0/312341605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cdc109560 msgr2=0x7f6cdc0761a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:01.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.870+0000 7f6ce336f700 1 --2- 172.21.15.80:0/312341605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cdc109560 0x7f6cdc0761a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00c970 tx=0x7f6ccc00cc80 comp rx=0 tx=0).stop 2024-04-26T18:36:01.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.870+0000 7f6ce336f700 1 -- 172.21.15.80:0/312341605 shutdown_connections 2024-04-26T18:36:01.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.870+0000 7f6ce336f700 1 --2- 172.21.15.80:0/312341605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cdc109560 0x7f6cdc0761a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:01.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.870+0000 7f6ce336f700 1 --2- 172.21.15.80:0/312341605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cdc1034c0 0x7f6cdc075720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:01.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.870+0000 7f6ce336f700 1 --2- 172.21.15.80:0/312341605 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f6cc40a3c40 0x7f6cc40a6100 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:01.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.870+0000 7f6ce336f700 1 --2- 172.21.15.80:0/312341605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cdc103e80 0x7f6cdc075c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:01.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.870+0000 7f6ce336f700 1 -- 172.21.15.80:0/312341605 >> 172.21.15.80:0/312341605 conn(0x7f6cdc07a5d0 msgr2=0x7f6cdc1020a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:01.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.870+0000 7f6ce336f700 1 -- 172.21.15.80:0/312341605 shutdown_connections 2024-04-26T18:36:01.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:01.870+0000 7f6ce336f700 1 -- 172.21.15.80:0/312341605 wait complete. 2024-04-26T18:36:01.872 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 26 2024-04-26T18:36:01.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:01 smithi082 ceph-mon[32808]: pgmap v386: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:36:02.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:01 smithi192 ceph-mon[32842]: pgmap v386: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:36:02.681 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T18:36:02.920 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:36:02.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:02 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/312341605' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:36:02.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:02 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/312341605' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:36:03.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:02 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/312341605' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:36:03.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:03 smithi082 ceph-mon[32808]: pgmap v387: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:36:03.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:03 smithi080 ceph-mon[29135]: pgmap v387: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:36:04.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:03 smithi192 ceph-mon[32842]: pgmap v387: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:36:04.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:04 smithi080 ceph-mon[29135]: pgmap v388: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:36:04.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.756+0000 7fb2f67a1700 1 -- 172.21.15.80:0/1344049111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2f0102370 msgr2=0x7fb2f0102750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:04.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.756+0000 7fb2f67a1700 1 --2- 172.21.15.80:0/1344049111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2f0102370 0x7fb2f0102750 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009990 tx=0x7fb2ec009ca0 comp rx=0 tx=0).stop 2024-04-26T18:36:04.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.756+0000 7fb2f67a1700 1 -- 172.21.15.80:0/1344049111 shutdown_connections 2024-04-26T18:36:04.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.756+0000 7fb2f67a1700 1 --2- 172.21.15.80:0/1344049111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f0107780 0x7fb2f0107c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:04.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.756+0000 7fb2f67a1700 1 --2- 172.21.15.80:0/1344049111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2f0102370 0x7fb2f0102750 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:04.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.756+0000 7fb2f67a1700 1 --2- 172.21.15.80:0/1344049111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2f0102c90 0x7fb2f0107160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:04.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.756+0000 7fb2f67a1700 1 -- 172.21.15.80:0/1344049111 >> 172.21.15.80:0/1344049111 conn(0x7fb2f00fddd0 msgr2=0x7fb2f01001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:04.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.756+0000 7fb2f67a1700 1 -- 172.21.15.80:0/1344049111 shutdown_connections 2024-04-26T18:36:04.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.756+0000 7fb2f67a1700 1 -- 172.21.15.80:0/1344049111 wait complete. 2024-04-26T18:36:04.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.756+0000 7fb2f67a1700 1 Processor -- start 2024-04-26T18:36:04.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.756+0000 7fb2f67a1700 1 -- start start 2024-04-26T18:36:04.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.757+0000 7fb2f67a1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2f0102370 0x7fb2f01a00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:04.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.757+0000 7fb2f67a1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2f0102c90 0x7fb2f01a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:04.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.757+0000 7fb2f67a1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f0107780 0x7fb2f01a4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:04.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.757+0000 7fb2f67a1700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f0119ba0 con 0x7fb2f0102c90 2024-04-26T18:36:04.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.757+0000 7fb2f67a1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f0119a20 con 0x7fb2f0107780 2024-04-26T18:36:04.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.757+0000 7fb2f67a1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f0119d20 con 0x7fb2f0102370 2024-04-26T18:36:04.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.757+0000 7fb2f4f9e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2f0102c90 0x7fb2f01a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:04.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.757+0000 7fb2f4f9e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2f0102c90 0x7fb2f01a05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39328/0 (socket says 172.21.15.80:39328) 2024-04-26T18:36:04.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.757+0000 7fb2f4f9e700 1 -- 172.21.15.80:0/2687456462 learned_addr learned my addr 172.21.15.80:0/2687456462 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:04.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.757+0000 7fb2f5fa0700 1 --2- 172.21.15.80:0/2687456462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f0107780 0x7fb2f01a4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:04.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.757+0000 7fb2f579f700 1 --2- 172.21.15.80:0/2687456462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2f0102370 0x7fb2f01a00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:04.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.757+0000 7fb2f4f9e700 1 -- 172.21.15.80:0/2687456462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2f0102370 msgr2=0x7fb2f01a00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:04.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.757+0000 7fb2f4f9e700 1 --2- 172.21.15.80:0/2687456462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2f0102370 0x7fb2f01a00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:04.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.757+0000 7fb2f4f9e700 1 -- 172.21.15.80:0/2687456462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f0107780 msgr2=0x7fb2f01a4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:04.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.757+0000 7fb2f4f9e700 1 --2- 172.21.15.80:0/2687456462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f0107780 0x7fb2f01a4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:04.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.757+0000 7fb2f4f9e700 1 -- 172.21.15.80:0/2687456462 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f01a50c0 con 0x7fb2f0102c90 2024-04-26T18:36:04.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.757+0000 7fb2f4f9e700 1 --2- 172.21.15.80:0/2687456462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2f0102c90 0x7fb2f01a05f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb2e000d720 tx=0x7fb2e000da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:04.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.757+0000 7fb2e67fc700 1 -- 172.21.15.80:0/2687456462 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0016070 con 0x7fb2f0102c90 2024-04-26T18:36:04.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.757+0000 7fb2f67a1700 1 -- 172.21.15.80:0/2687456462 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2f01a53b0 con 0x7fb2f0102c90 2024-04-26T18:36:04.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.757+0000 7fb2e67fc700 1 -- 172.21.15.80:0/2687456462 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2e0004830 con 0x7fb2f0102c90 2024-04-26T18:36:04.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.757+0000 7fb2e67fc700 1 -- 172.21.15.80:0/2687456462 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0005520 con 0x7fb2f0102c90 2024-04-26T18:36:04.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.757+0000 7fb2f67a1700 1 -- 172.21.15.80:0/2687456462 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2f01acc30 con 0x7fb2f0102c90 2024-04-26T18:36:04.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.758+0000 7fb2f67a1700 1 -- 172.21.15.80:0/2687456462 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2f006a110 con 0x7fb2f0102c90 2024-04-26T18:36:04.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.760+0000 7fb2e67fc700 1 -- 172.21.15.80:0/2687456462 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fb2e0004220 con 0x7fb2f0102c90 2024-04-26T18:36:04.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.760+0000 7fb2e67fc700 1 --2- 172.21.15.80:0/2687456462 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb2dc0a3c40 0x7fb2dc0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:04.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.760+0000 7fb2f579f700 1 --2- 172.21.15.80:0/2687456462 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb2dc0a3c40 0x7fb2dc0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:04.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.760+0000 7fb2e67fc700 1 -- 172.21.15.80:0/2687456462 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fb2e00d05c0 con 0x7fb2f0102c90 2024-04-26T18:36:04.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.760+0000 7fb2f579f700 1 --2- 172.21.15.80:0/2687456462 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb2dc0a3c40 0x7fb2dc0a6100 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec00b2e0 tx=0x7fb2ec005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:04.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.764+0000 7fb2e67fc700 1 -- 172.21.15.80:0/2687456462 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb2e001f020 con 0x7fb2f0102c90 2024-04-26T18:36:04.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.964+0000 7fb2f67a1700 1 -- 172.21.15.80:0/2687456462 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb2f01acec0 con 0x7fb2f0102c90 2024-04-26T18:36:04.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.965+0000 7fb2e67fc700 1 -- 172.21.15.80:0/2687456462 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+22533 (secure 0 0 0) 0x7fb2e009cfd0 con 0x7fb2f0102c90 2024-04-26T18:36:04.966 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:36:04.966 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":91,"fsid":"2187ca98-03fa-11ef-bc93-c7b262605968","created":"2024-04-26T18:24:58.809431+0000","modified":"2024-04-26T18:33:51.637301+0000","last_up_change":"2024-04-26T18:32:02.550187+0000","last_in_change":"2024-04-26T18:31:41.630932+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T18:28:14.502290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T18:33:02.102135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T18:33:05.300979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a01cfe6-d13a-4828-8c20-ad7fee7e87ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6803","nonce":429487384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6805","nonce":429487384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6809","nonce":429487384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6807","nonce":429487384}]},"public_addr":"172.21.15.80:6803/429487384","cluster_addr":"172.21.15.80:6805/429487384","heartbeat_back_addr":"172.21.15.80:6809/429487384","heartbeat_front_addr":"172.21.15.80:6807/429487384","state":["exists","up"]},{"osd":1,"uuid":"1f815d88-30b1-4540-b4f5-cc3d62707318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913033849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913033849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913033849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913033849}]},"public_addr":"172.21.15.82:6801/3913033849","cluster_addr":"172.21.15.82:6803/3913033849","heartbeat_back_addr":"172.21.15.82:6807/3913033849","heartbeat_front_addr":"172.21.15.82:6805/3913033849","state":["exists","up"]},{"osd":2,"uuid":"b8625dd7-4c1d-4258-ac2b-463ff96f4cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6801","nonce":503427508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6803","nonce":503427508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6807","nonce":503427508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6805","nonce":503427508}]},"public_addr":"172.21.15.192:6801/503427508","cluster_addr":"172.21.15.192:6803/503427508","heartbeat_back_addr":"172.21.15.192:6807/503427508","heartbeat_front_addr":"172.21.15.192:6805/503427508","state":["exists","up"]},{"osd":3,"uuid":"3068321a-3070-44ae-9bbd-a3faac8c21fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6811","nonce":407817066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6813","nonce":407817066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6817","nonce":407817066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6815","nonce":407817066}]},"public_addr":"172.21.15.80:6811/407817066","cluster_addr":"172.21.15.80:6813/407817066","heartbeat_back_addr":"172.21.15.80:6817/407817066","heartbeat_front_addr":"172.21.15.80:6815/407817066","state":["exists","up"]},{"osd":4,"uuid":"6b3d6455-9495-435b-8193-a260b63504ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6809","nonce":2068291934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6811","nonce":2068291934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6815","nonce":2068291934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6813","nonce":2068291934}]},"public_addr":"172.21.15.82:6809/2068291934","cluster_addr":"172.21.15.82:6811/2068291934","heartbeat_back_addr":"172.21.15.82:6815/2068291934","heartbeat_front_addr":"172.21.15.82:6813/2068291934","state":["exists","up"]},{"osd":5,"uuid":"538863f1-1486-45b5-a675-ecb1d3035599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6809","nonce":1770809727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6811","nonce":1770809727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6815","nonce":1770809727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6813","nonce":1770809727}]},"public_addr":"172.21.15.192:6809/1770809727","cluster_addr":"172.21.15.192:6811/1770809727","heartbeat_back_addr":"172.21.15.192:6815/1770809727","heartbeat_front_addr":"172.21.15.192:6813/1770809727","state":["exists","up"]},{"osd":6,"uuid":"7b4374d8-98e6-48e1-924b-c9b70a4baf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6819","nonce":145064490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6821","nonce":145064490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6825","nonce":145064490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6823","nonce":145064490}]},"public_addr":"172.21.15.80:6819/145064490","cluster_addr":"172.21.15.80:6821/145064490","heartbeat_back_addr":"172.21.15.80:6825/145064490","heartbeat_front_addr":"172.21.15.80:6823/145064490","state":["exists","up"]},{"osd":7,"uuid":"f3bb3c7d-4cce-4f49-b924-72ebbaad58ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6817","nonce":208047447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6819","nonce":208047447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6823","nonce":208047447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6821","nonce":208047447}]},"public_addr":"172.21.15.82:6817/208047447","cluster_addr":"172.21.15.82:6819/208047447","heartbeat_back_addr":"172.21.15.82:6823/208047447","heartbeat_front_addr":"172.21.15.82:6821/208047447","state":["exists","up"]},{"osd":8,"uuid":"6557b536-a516-4b01-a607-7981620fb2a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6817","nonce":3763069187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6819","nonce":3763069187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6823","nonce":3763069187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6821","nonce":3763069187}]},"public_addr":"172.21.15.192:6817/3763069187","cluster_addr":"172.21.15.192:6819/3763069187","heartbeat_back_addr":"172.21.15.192:6823/3763069187","heartbeat_front_addr":"172.21.15.192:6821/3763069187","state":["exists","up"]},{"osd":9,"uuid":"838615a7-1e68-4e81-8b3a-fba0ea75f7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6827","nonce":2109877993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6829","nonce":2109877993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6833","nonce":2109877993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6831","nonce":2109877993}]},"public_addr":"172.21.15.80:6827/2109877993","cluster_addr":"172.21.15.80:6829/2109877993","heartbeat_back_addr":"172.21.15.80:6833/2109877993","heartbeat_front_addr":"172.21.15.80:6831/2109877993","state":["exists","up"]},{"osd":10,"uuid":"cd664e50-3217-453d-9a89-6e26d717e6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6825","nonce":2877220993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6827","nonce":2877220993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6831","nonce":2877220993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6829","nonce":2877220993}]},"public_addr":"172.21.15.82:6825/2877220993","cluster_addr":"172.21.15.82:6827/2877220993","heartbeat_back_addr":"172.21.15.82:6831/2877220993","heartbeat_front_addr":"172.21.15.82:6829/2877220993","state":["exists","up"]},{"osd":11,"uuid":"e52807c6-8890-4df7-a8c6-51a7ff4b467b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6825","nonce":3466865106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6827","nonce":3466865106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6831","nonce":3466865106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6829","nonce":3466865106}]},"public_addr":"172.21.15.192:6825/3466865106","cluster_addr":"172.21.15.192:6827/3466865106","heartbeat_back_addr":"172.21.15.192:6831/3466865106","heartbeat_front_addr":"172.21.15.192:6829/3466865106","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:27:23.385471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:27:46.648232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:10.578970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:34.922048+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:59.142838+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:29:24.492250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:29:49.721803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:30:15.177027+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:30:41.544775+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:31:07.562401+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:31:33.498042+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:32:00.584085+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/1997155783":"2024-04-27T18:25:50.413207+0000","172.21.15.80:0/323607684":"2024-04-27T18:25:50.413207+0000","172.21.15.80:0/586397709":"2024-04-27T18:25:50.413207+0000","172.21.15.80:6801/4208962819":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/1353083127":"2024-04-27T18:25:24.440373+0000","172.21.15.80:6800/1997155783":"2024-04-27T18:25:50.413207+0000","172.21.15.80:6800/4208962819":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2644175019":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/1853513470":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2122929159":"2024-04-27T18:25:50.413207+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T18:36:04.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.967+0000 7fb2f67a1700 1 -- 172.21.15.80:0/2687456462 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb2dc0a3c40 msgr2=0x7fb2dc0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:04.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.967+0000 7fb2f67a1700 1 --2- 172.21.15.80:0/2687456462 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb2dc0a3c40 0x7fb2dc0a6100 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec00b2e0 tx=0x7fb2ec005fb0 comp rx=0 tx=0).stop 2024-04-26T18:36:04.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.967+0000 7fb2f67a1700 1 -- 172.21.15.80:0/2687456462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2f0102c90 msgr2=0x7fb2f01a05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:04.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.967+0000 7fb2f67a1700 1 --2- 172.21.15.80:0/2687456462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2f0102c90 0x7fb2f01a05f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb2e000d720 tx=0x7fb2e000da30 comp rx=0 tx=0).stop 2024-04-26T18:36:04.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.967+0000 7fb2f67a1700 1 -- 172.21.15.80:0/2687456462 shutdown_connections 2024-04-26T18:36:04.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.967+0000 7fb2f67a1700 1 --2- 172.21.15.80:0/2687456462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f0107780 0x7fb2f01a4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:04.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.967+0000 7fb2f67a1700 1 --2- 172.21.15.80:0/2687456462 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fb2dc0a3c40 0x7fb2dc0a6100 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:04.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.967+0000 7fb2f67a1700 1 --2- 172.21.15.80:0/2687456462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2f0102370 0x7fb2f01a00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:04.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.967+0000 7fb2f67a1700 1 --2- 172.21.15.80:0/2687456462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2f0102c90 0x7fb2f01a05f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:04.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.967+0000 7fb2f67a1700 1 -- 172.21.15.80:0/2687456462 >> 172.21.15.80:0/2687456462 conn(0x7fb2f00fddd0 msgr2=0x7fb2f0110f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:04.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.967+0000 7fb2f67a1700 1 -- 172.21.15.80:0/2687456462 shutdown_connections 2024-04-26T18:36:04.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:04.967+0000 7fb2f67a1700 1 -- 172.21.15.80:0/2687456462 wait complete. 2024-04-26T18:36:04.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:04 smithi082 ceph-mon[32808]: pgmap v388: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:36:05.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:04 smithi192 ceph-mon[32842]: pgmap v388: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:36:05.659 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-26T18:33:08.347399+0000', 'modified': '2024-04-26T18:33:27.036209+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24434, 'mds_1': 24421, 'mds_2': 24404, 'mds_3': 24400, 'mds_4': 24394}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14577': {'gid': 14577, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.80:6839/2137993298', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6838', 'nonce': 2137993298}, {'type': 'v1', 'addr': '172.21.15.80:6839', 'nonce': 2137993298}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14583': {'gid': 14583, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.80:6841/1544670', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6840', 'nonce': 1544670}, {'type': 'v1', 'addr': '172.21.15.80:6841', 'nonce': 1544670}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24371': {'gid': 24371, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6833/3564539039', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6832', 'nonce': 3564539039}, {'type': 'v1', 'addr': '172.21.15.82:6833', 'nonce': 3564539039}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24379': {'gid': 24379, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.192:6833/2905926211', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6832', 'nonce': 2905926211}, {'type': 'v1', 'addr': '172.21.15.192:6833', 'nonce': 2905926211}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24392': {'gid': 24392, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6835/572065563', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6834', 'nonce': 572065563}, {'type': 'v1', 'addr': '172.21.15.82:6835', 'nonce': 572065563}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24394': {'gid': 24394, 'name': 'f', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.192:6835/719058020', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6834', 'nonce': 719058020}, {'type': 'v1', 'addr': '172.21.15.192:6835', 'nonce': 719058020}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24400': {'gid': 24400, 'name': 'c', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.192:6837/2361996920', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6836', 'nonce': 2361996920}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 2361996920}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24404': {'gid': 24404, 'name': 'h', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.82:6837/2084055551', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6836', 'nonce': 2084055551}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 2084055551}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24421': {'gid': 24421, 'name': 'i', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.192:6839/2735406056', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6838', 'nonce': 2735406056}, {'type': 'v1', 'addr': '172.21.15.192:6839', 'nonce': 2735406056}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24434': {'gid': 24434, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.82:6839/1482576497', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 1482576497}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 1482576497}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24434, 'qdb_cluster': [24404, 24434, 24394, 24400, 24421]} 2024-04-26T18:36:05.659 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-26T18:36:05.659 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell mds.f status 2024-04-26T18:36:05.901 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:36:05.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:05 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/2687456462' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:36:05.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:05 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2687456462' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:36:06.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:05 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/2687456462' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:36:06.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:06 smithi082 ceph-mon[32808]: pgmap v389: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:36:06.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:06 smithi080 ceph-mon[29135]: pgmap v389: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:36:07.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:06 smithi192 ceph-mon[32842]: pgmap v389: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:36:07.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.682+0000 7f347821d700 1 -- 172.21.15.80:0/769511282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3470102fc0 msgr2=0x7f3470106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:07.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.682+0000 7f347821d700 1 --2- 172.21.15.80:0/769511282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3470102fc0 0x7f3470106f80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f34600099c0 tx=0x7f3460009cd0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.683+0000 7f347821d700 1 -- 172.21.15.80:0/769511282 shutdown_connections 2024-04-26T18:36:07.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.683+0000 7f347821d700 1 --2- 172.21.15.80:0/769511282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3470107660 0x7f347010f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.683+0000 7f347821d700 1 --2- 172.21.15.80:0/769511282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3470102610 0x7f34701029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.683+0000 7f347821d700 1 --2- 172.21.15.80:0/769511282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3470102fc0 0x7f3470106f80 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.683+0000 7f347821d700 1 -- 172.21.15.80:0/769511282 >> 172.21.15.80:0/769511282 conn(0x7f3470078370 msgr2=0x7f3470078780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:07.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.683+0000 7f347821d700 1 -- 172.21.15.80:0/769511282 shutdown_connections 2024-04-26T18:36:07.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.683+0000 7f347821d700 1 -- 172.21.15.80:0/769511282 wait complete. 2024-04-26T18:36:07.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.683+0000 7f347821d700 1 Processor -- start 2024-04-26T18:36:07.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.683+0000 7f347821d700 1 -- start start 2024-04-26T18:36:07.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.683+0000 7f347821d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3470102610 0x7f347019a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:07.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.683+0000 7f347821d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3470102fc0 0x7f347019ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:07.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.683+0000 7f347821d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3470107660 0x7f34701a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:07.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.683+0000 7f347821d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f34701124f0 con 0x7f3470102fc0 2024-04-26T18:36:07.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.683+0000 7f347821d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3470112370 con 0x7f3470102610 2024-04-26T18:36:07.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.683+0000 7f347821d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3470112670 con 0x7f3470107660 2024-04-26T18:36:07.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.684+0000 7f34757b8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3470102fc0 0x7f347019ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:07.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.684+0000 7f34757b8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3470102fc0 0x7f347019ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39356/0 (socket says 172.21.15.80:39356) 2024-04-26T18:36:07.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.684+0000 7f34757b8700 1 -- 172.21.15.80:0/1887822419 learned_addr learned my addr 172.21.15.80:0/1887822419 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:07.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.684+0000 7f34767ba700 1 --2- 172.21.15.80:0/1887822419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3470107660 0x7f34701a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:07.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.684+0000 7f3475fb9700 1 --2- 172.21.15.80:0/1887822419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3470102610 0x7f347019a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:07.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.684+0000 7f34757b8700 1 -- 172.21.15.80:0/1887822419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3470107660 msgr2=0x7f34701a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:07.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.684+0000 7f34757b8700 1 --2- 172.21.15.80:0/1887822419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3470107660 0x7f34701a5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.684+0000 7f34757b8700 1 -- 172.21.15.80:0/1887822419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3470102610 msgr2=0x7f347019a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:07.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.684+0000 7f34757b8700 1 --2- 172.21.15.80:0/1887822419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3470102610 0x7f347019a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.684+0000 7f34757b8700 1 -- 172.21.15.80:0/1887822419 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34701a5ed0 con 0x7f3470102fc0 2024-04-26T18:36:07.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.684+0000 7f3475fb9700 1 --2- 172.21.15.80:0/1887822419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3470102610 0x7f347019a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:36:07.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.684+0000 7f34757b8700 1 --2- 172.21.15.80:0/1887822419 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3470102fc0 0x7f347019ae50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3460006010 tx=0x7f34600047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:07.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.684+0000 7f3466ffd700 1 -- 172.21.15.80:0/1887822419 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3460027070 con 0x7f3470102fc0 2024-04-26T18:36:07.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.684+0000 7f3466ffd700 1 -- 172.21.15.80:0/1887822419 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3460003f20 con 0x7f3470102fc0 2024-04-26T18:36:07.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.684+0000 7f347821d700 1 -- 172.21.15.80:0/1887822419 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34701a60a0 con 0x7f3470102fc0 2024-04-26T18:36:07.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.684+0000 7f3466ffd700 1 -- 172.21.15.80:0/1887822419 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3460022cd0 con 0x7f3470102fc0 2024-04-26T18:36:07.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.684+0000 7f347821d700 1 -- 172.21.15.80:0/1887822419 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34701a6550 con 0x7f3470102fc0 2024-04-26T18:36:07.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.686+0000 7f3466ffd700 1 -- 172.21.15.80:0/1887822419 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f346002a070 con 0x7f3470102fc0 2024-04-26T18:36:07.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.687+0000 7f3466ffd700 1 --2- 172.21.15.80:0/1887822419 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f345c0a3cc0 0x7f345c0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:07.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.687+0000 7f3475fb9700 1 --2- 172.21.15.80:0/1887822419 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f345c0a3cc0 0x7f345c0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:07.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.687+0000 7f3466ffd700 1 -- 172.21.15.80:0/1887822419 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f34600d11b0 con 0x7f3470102fc0 2024-04-26T18:36:07.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.687+0000 7f3475fb9700 1 --2- 172.21.15.80:0/1887822419 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f345c0a3cc0 0x7f345c0a6180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f346c005fd0 tx=0x7f346c005ee0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:07.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.688+0000 7f3482aafb80 1 Processor -- start 2024-04-26T18:36:07.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.688+0000 7f3482aafb80 1 -- start start 2024-04-26T18:36:07.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.688+0000 7f3482aafb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c896098a20 0x55c896098e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:07.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.688+0000 7f3482aafb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c896092d50 0x55c8960931b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:07.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.688+0000 7f3482aafb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8960936f0 0x55c89609f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:07.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.688+0000 7f3482aafb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55c895fe57e0 con 0x55c896092d50 2024-04-26T18:36:07.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.688+0000 7f3482aafb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c895f4b8e0 con 0x55c8960936f0 2024-04-26T18:36:07.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.688+0000 7f3482aafb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c895fe17a0 con 0x55c896098a20 2024-04-26T18:36:07.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.688+0000 7f34757b8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c896092d50 0x55c8960931b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:07.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.688+0000 7f34757b8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c896092d50 0x55c8960931b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39368/0 (socket says 172.21.15.80:39368) 2024-04-26T18:36:07.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.688+0000 7f34757b8700 1 -- 172.21.15.80:0/4052000937 learned_addr learned my addr 172.21.15.80:0/4052000937 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:07.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.688+0000 7f34767ba700 1 --2- 172.21.15.80:0/4052000937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8960936f0 0x55c89609f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:07.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.688+0000 7f3475fb9700 1 --2- 172.21.15.80:0/4052000937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c896098a20 0x55c896098e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:07.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.689+0000 7f34757b8700 1 -- 172.21.15.80:0/4052000937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c896098a20 msgr2=0x55c896098e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:07.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.689+0000 7f34757b8700 1 --2- 172.21.15.80:0/4052000937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c896098a20 0x55c896098e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.689+0000 7f34757b8700 1 -- 172.21.15.80:0/4052000937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8960936f0 msgr2=0x55c89609f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:07.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.689+0000 7f34757b8700 1 --2- 172.21.15.80:0/4052000937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8960936f0 0x55c89609f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.689+0000 7f34757b8700 1 -- 172.21.15.80:0/4052000937 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c895f32880 con 0x55c896092d50 2024-04-26T18:36:07.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.689+0000 7f34767ba700 1 --2- 172.21.15.80:0/4052000937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8960936f0 0x55c89609f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:36:07.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.689+0000 7f3475fb9700 1 --2- 172.21.15.80:0/4052000937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c896098a20 0x55c896098e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:36:07.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.689+0000 7f34757b8700 1 --2- 172.21.15.80:0/4052000937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c896092d50 0x55c8960931b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f346009d4e0 tx=0x7f3460003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6fe53a6ea68977 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:07.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.689+0000 7f345bfff700 1 -- 172.21.15.80:0/4052000937 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34600a1900 con 0x55c896092d50 2024-04-26T18:36:07.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.689+0000 7f345bfff700 1 -- 172.21.15.80:0/4052000937 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34600a6130 con 0x55c896092d50 2024-04-26T18:36:07.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.689+0000 7f345bfff700 1 -- 172.21.15.80:0/4052000937 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34600a5ca0 con 0x55c896092d50 2024-04-26T18:36:07.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.690+0000 7f3482aafb80 1 -- 172.21.15.80:0/4052000937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c896092d50 msgr2=0x55c8960931b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:07.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.690+0000 7f3482aafb80 1 --2- 172.21.15.80:0/4052000937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c896092d50 0x55c8960931b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f346009d4e0 tx=0x7f3460003780 comp rx=0 tx=0).stop 2024-04-26T18:36:07.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.690+0000 7f3482aafb80 1 -- 172.21.15.80:0/4052000937 shutdown_connections 2024-04-26T18:36:07.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.690+0000 7f3482aafb80 1 --2- 172.21.15.80:0/4052000937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8960936f0 0x55c89609f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.690+0000 7f3482aafb80 1 --2- 172.21.15.80:0/4052000937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c896098a20 0x55c896098e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.690+0000 7f3482aafb80 1 --2- 172.21.15.80:0/4052000937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c896092d50 0x55c8960931b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.690+0000 7f3482aafb80 1 -- 172.21.15.80:0/4052000937 >> 172.21.15.80:0/4052000937 conn(0x55c895fc1570 msgr2=0x55c89608d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:07.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.690+0000 7f3482aafb80 1 -- 172.21.15.80:0/4052000937 shutdown_connections 2024-04-26T18:36:07.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.690+0000 7f3482aafb80 1 -- 172.21.15.80:0/4052000937 wait complete. 2024-04-26T18:36:07.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.690+0000 7f3482aafb80 1 -- start start 2024-04-26T18:36:07.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.690+0000 7f3482aafb80 1 Processor -- start 2024-04-26T18:36:07.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.691+0000 7f3482aafb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c896092d50 0x55c89609f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:07.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.691+0000 7f3482aafb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8960936f0 0x55c89609c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:07.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.691+0000 7f3482aafb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c896098a20 0x55c89609cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:07.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.691+0000 7f3482aafb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55c896099420 con 0x55c896092d50 2024-04-26T18:36:07.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.691+0000 7f3482aafb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c895f9fa30 con 0x55c896098a20 2024-04-26T18:36:07.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.691+0000 7f3482aafb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c89609fcb0 con 0x55c8960936f0 2024-04-26T18:36:07.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.691+0000 7f3482aafb80 10 client.0 _ll_register_callbacks cb 0x55c895f7d900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:36:07.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.691+0000 7f3475fb9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c896092d50 0x55c89609f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:07.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.691+0000 7f3475fb9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c896092d50 0x55c89609f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39380/0 (socket says 172.21.15.80:39380) 2024-04-26T18:36:07.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.691+0000 7f3475fb9700 1 -- 172.21.15.80:0/2726543107 learned_addr learned my addr 172.21.15.80:0/2726543107 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:07.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.691+0000 7f34767ba700 1 --2- 172.21.15.80:0/2726543107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c896098a20 0x55c89609cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:07.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.691+0000 7f34757b8700 1 --2- 172.21.15.80:0/2726543107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8960936f0 0x55c89609c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:07.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.691+0000 7f3475fb9700 1 -- 172.21.15.80:0/2726543107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8960936f0 msgr2=0x55c89609c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:07.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.691+0000 7f3475fb9700 1 --2- 172.21.15.80:0/2726543107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8960936f0 0x55c89609c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.691+0000 7f3475fb9700 1 -- 172.21.15.80:0/2726543107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c896098a20 msgr2=0x55c89609cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:07.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.691+0000 7f3475fb9700 1 --2- 172.21.15.80:0/2726543107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c896098a20 0x55c89609cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.691+0000 7f3475fb9700 1 -- 172.21.15.80:0/2726543107 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c895fa3430 con 0x55c896092d50 2024-04-26T18:36:07.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.691+0000 7f34757b8700 1 --2- 172.21.15.80:0/2726543107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8960936f0 0x55c89609c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:36:07.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.692+0000 7f3475fb9700 1 --2- 172.21.15.80:0/2726543107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c896092d50 0x55c89609f370 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f346c011820 tx=0x7f346c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e667bbfbafeaee server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:07.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.692+0000 7f34597fa700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:36:07.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.692+0000 7f34597fa700 1 -- 172.21.15.80:0/2726543107 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c023070 con 0x55c896092d50 2024-04-26T18:36:07.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.692+0000 7f3482aafb80 1 -- 172.21.15.80:0/2726543107 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34600a6130 con 0x55c896092d50 2024-04-26T18:36:07.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.692+0000 7f34597fa700 1 -- 172.21.15.80:0/2726543107 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f346c010860 con 0x55c896092d50 2024-04-26T18:36:07.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.692+0000 7f34597fa700 1 -- 172.21.15.80:0/2726543107 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f346c02f050 con 0x55c896092d50 2024-04-26T18:36:07.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.692+0000 7f3482aafb80 10 client.15093 fetch_fsmap learned FSMap version 26 2024-04-26T18:36:07.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.692+0000 7f3482aafb80 1 -- 172.21.15.80:0/2726543107 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c8960aa240 con 0x55c896092d50 2024-04-26T18:36:07.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.692+0000 7f34597fa700 1 -- 172.21.15.80:0/2726543107 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34600a6130 con 0x55c896092d50 2024-04-26T18:36:07.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.692+0000 7f34597fa700 1 -- 172.21.15.80:0/2726543107 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f346c00f040 con 0x55c896092d50 2024-04-26T18:36:07.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.692+0000 7f3482aafb80 10 client.15093 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:36:07.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.692+0000 7f3482aafb80 10 client.15093 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-26T18:36:07.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.692+0000 7f3482aafb80 20 client.15093 populate_metadata read hostname 'smithi080' 2024-04-26T18:36:07.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.693+0000 7f3482aafb80 1 --2- 172.21.15.80:0/2726543107 >> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] conn(0x55c8960ac820 0x55c8960adc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:07.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.693+0000 7f3482aafb80 4 client.15093 mds_command: new command op to 24394 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:36:07.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.693+0000 7f3482aafb80 1 -- 172.21.15.80:0/2726543107 --> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c895ff31c0 con 0x55c8960ac820 2024-04-26T18:36:07.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.693+0000 7f34757b8700 1 --2- 172.21.15.80:0/2726543107 >> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] conn(0x55c8960ac820 0x55c8960adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:07.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.693+0000 7f34597fa700 10 client.15093 ms_handle_connect on v2:172.21.15.192:6834/719058020 2024-04-26T18:36:07.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.693+0000 7f34757b8700 1 --2- 172.21.15.80:0/2726543107 >> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] conn(0x55c8960ac820 0x55c8960adc90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b461f015c22d6e94 server_cookie=f114326685a4ce8d in_seq=0 out_seq=0 2024-04-26T18:36:07.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.694+0000 7f34597fa700 1 -- 172.21.15.80:0/2726543107 <== mds.4 v2:172.21.15.192:6834/719058020 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c895ff31c0 con 0x55c8960ac820 2024-04-26T18:36:07.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.694+0000 7f34597fa700 10 client.15093 handle_command_reply: tid=0 2024-04-26T18:36:07.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.694+0000 7f3482aafb80 1 client.15093 shutdown 2024-04-26T18:36:07.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.694+0000 7f3482aafb80 1 -- 172.21.15.80:0/2726543107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c896092d50 msgr2=0x55c89609f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:07.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.694+0000 7f3482aafb80 1 --2- 172.21.15.80:0/2726543107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c896092d50 0x55c89609f370 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f346c011820 tx=0x7f346c0047c0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.694+0000 7f3482aafb80 1 -- 172.21.15.80:0/2726543107 shutdown_connections 2024-04-26T18:36:07.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.694+0000 7f3482aafb80 1 --2- 172.21.15.80:0/2726543107 >> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] conn(0x55c8960ac820 0x55c8960adc90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.694+0000 7f3482aafb80 1 --2- 172.21.15.80:0/2726543107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c896098a20 0x55c89609cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.694+0000 7f3482aafb80 1 --2- 172.21.15.80:0/2726543107 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c896092d50 0x55c89609f370 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.694+0000 7f34597fa700 0 client.15093 ms_handle_reset on v2:172.21.15.192:6834/719058020 2024-04-26T18:36:07.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.694+0000 7f3482aafb80 1 --2- 172.21.15.80:0/2726543107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8960936f0 0x55c89609c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.694+0000 7f3482aafb80 1 -- 172.21.15.80:0/2726543107 >> 172.21.15.80:0/2726543107 conn(0x55c895fc1570 msgr2=0x55c896091d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:07.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.694+0000 7f3482aafb80 1 -- 172.21.15.80:0/2726543107 shutdown_connections 2024-04-26T18:36:07.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.694+0000 7f3482aafb80 1 -- 172.21.15.80:0/2726543107 wait complete. 2024-04-26T18:36:07.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.695+0000 7f3482aafb80 20 client.15093 trim_cache size 0 max 16384 2024-04-26T18:36:07.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.715+0000 7f3482aafb80 1 Processor -- start 2024-04-26T18:36:07.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.715+0000 7f3482aafb80 1 -- start start 2024-04-26T18:36:07.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.715+0000 7f3482aafb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c896092d50 0x55c896091d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:07.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.715+0000 7f3482aafb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8960936f0 0x55c89608d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:07.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.715+0000 7f3482aafb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c896098a20 0x55c89609c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:07.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.715+0000 7f3482aafb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55c8960abfd0 con 0x55c896098a20 2024-04-26T18:36:07.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.715+0000 7f3482aafb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c8960ac6a0 con 0x55c896092d50 2024-04-26T18:36:07.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.715+0000 7f3482aafb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c8960acd70 con 0x55c8960936f0 2024-04-26T18:36:07.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.715+0000 7f34767ba700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c896098a20 0x55c89609c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:07.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.715+0000 7f34767ba700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c896098a20 0x55c89609c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39390/0 (socket says 172.21.15.80:39390) 2024-04-26T18:36:07.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.715+0000 7f34767ba700 1 -- 172.21.15.80:0/1093717992 learned_addr learned my addr 172.21.15.80:0/1093717992 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:07.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.715+0000 7f34767ba700 1 -- 172.21.15.80:0/1093717992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8960936f0 msgr2=0x55c89608d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:07.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.715+0000 7f34767ba700 1 --2- 172.21.15.80:0/1093717992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8960936f0 0x55c89608d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.715+0000 7f34767ba700 1 -- 172.21.15.80:0/1093717992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c896092d50 msgr2=0x55c896091d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:07.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.715+0000 7f3475fb9700 1 --2- 172.21.15.80:0/1093717992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c896092d50 0x55c896091d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:07.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.715+0000 7f34767ba700 1 --2- 172.21.15.80:0/1093717992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c896092d50 0x55c896091d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.715+0000 7f34767ba700 1 -- 172.21.15.80:0/1093717992 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8960993d0 con 0x55c896098a20 2024-04-26T18:36:07.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.716+0000 7f34767ba700 1 --2- 172.21.15.80:0/1093717992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c896098a20 0x55c89609c720 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3468014690 tx=0x7f3468007950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e64adc04e062929 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:07.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.716+0000 7f345b7fe700 1 -- 172.21.15.80:0/1093717992 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346801a070 con 0x55c896098a20 2024-04-26T18:36:07.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.716+0000 7f345b7fe700 1 -- 172.21.15.80:0/1093717992 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3468016630 con 0x55c896098a20 2024-04-26T18:36:07.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.716+0000 7f345b7fe700 1 -- 172.21.15.80:0/1093717992 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3468004290 con 0x55c896098a20 2024-04-26T18:36:07.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.716+0000 7f3482aafb80 1 -- 172.21.15.80:0/1093717992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c896098a20 msgr2=0x55c89609c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:07.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.716+0000 7f3482aafb80 1 --2- 172.21.15.80:0/1093717992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c896098a20 0x55c89609c720 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3468014690 tx=0x7f3468007950 comp rx=0 tx=0).stop 2024-04-26T18:36:07.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.716+0000 7f3482aafb80 1 -- 172.21.15.80:0/1093717992 shutdown_connections 2024-04-26T18:36:07.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.716+0000 7f3482aafb80 1 --2- 172.21.15.80:0/1093717992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c896098a20 0x55c89609c720 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.716+0000 7f3482aafb80 1 --2- 172.21.15.80:0/1093717992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c896092d50 0x55c896091d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.716+0000 7f3482aafb80 1 --2- 172.21.15.80:0/1093717992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8960936f0 0x55c89608d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.716+0000 7f3482aafb80 1 -- 172.21.15.80:0/1093717992 >> 172.21.15.80:0/1093717992 conn(0x55c895fc1570 msgr2=0x55c896092590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:07.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.716+0000 7f3482aafb80 1 -- 172.21.15.80:0/1093717992 shutdown_connections 2024-04-26T18:36:07.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.716+0000 7f3482aafb80 1 -- 172.21.15.80:0/1093717992 wait complete. 2024-04-26T18:36:07.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.717+0000 7f3482aafb80 1 -- start start 2024-04-26T18:36:07.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.717+0000 7f3482aafb80 1 Processor -- start 2024-04-26T18:36:07.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.717+0000 7f3482aafb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c896092d50 0x55c8960b74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:07.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.717+0000 7f3482aafb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c8960936f0 0x55c8960b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:07.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.717+0000 7f3482aafb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c896098a20 0x55c8960b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:07.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.717+0000 7f3482aafb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55c8960adb10 con 0x55c8960936f0 2024-04-26T18:36:07.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.717+0000 7f3482aafb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c8960ad440 con 0x55c896098a20 2024-04-26T18:36:07.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.717+0000 7f3482aafb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c8960ae1e0 con 0x55c896092d50 2024-04-26T18:36:07.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.717+0000 7f3482aafb80 10 client.0 _ll_register_callbacks cb 0x55c895f7d900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:36:07.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.717+0000 7f34757b8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c8960936f0 0x55c8960b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:07.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.717+0000 7f34757b8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c8960936f0 0x55c8960b20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39394/0 (socket says 172.21.15.80:39394) 2024-04-26T18:36:07.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.717+0000 7f34757b8700 1 -- 172.21.15.80:0/4107697242 learned_addr learned my addr 172.21.15.80:0/4107697242 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:07.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.717+0000 7f3475fb9700 1 --2- 172.21.15.80:0/4107697242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c896092d50 0x55c8960b74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:07.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.718+0000 7f34757b8700 1 -- 172.21.15.80:0/4107697242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c896092d50 msgr2=0x55c8960b74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:07.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.718+0000 7f34757b8700 1 --2- 172.21.15.80:0/4107697242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c896092d50 0x55c8960b74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.718+0000 7f34767ba700 1 --2- 172.21.15.80:0/4107697242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c896098a20 0x55c8960b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:07.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.718+0000 7f34757b8700 1 -- 172.21.15.80:0/4107697242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c896098a20 msgr2=0x55c8960b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:07.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.718+0000 7f34757b8700 1 --2- 172.21.15.80:0/4107697242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c896098a20 0x55c8960b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.718+0000 7f34757b8700 1 -- 172.21.15.80:0/4107697242 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8960b2de0 con 0x55c8960936f0 2024-04-26T18:36:07.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.718+0000 7f34757b8700 1 --2- 172.21.15.80:0/4107697242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c8960936f0 0x55c8960b20c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3460099f20 tx=0x7f34600880b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7314cdba694ba5b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:07.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.718+0000 7f34597fa700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:36:07.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.718+0000 7f34597fa700 1 -- 172.21.15.80:0/4107697242 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34600b6060 con 0x55c8960936f0 2024-04-26T18:36:07.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.718+0000 7f3482aafb80 1 -- 172.21.15.80:0/4107697242 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3468016630 con 0x55c8960936f0 2024-04-26T18:36:07.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.718+0000 7f34597fa700 1 -- 172.21.15.80:0/4107697242 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f346009d7b0 con 0x55c8960936f0 2024-04-26T18:36:07.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.718+0000 7f34597fa700 1 -- 172.21.15.80:0/4107697242 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f34600a6130 con 0x55c8960936f0 2024-04-26T18:36:07.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.718+0000 7f3482aafb80 10 client.15099 fetch_fsmap learned FSMap version 26 2024-04-26T18:36:07.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.718+0000 7f3482aafb80 1 -- 172.21.15.80:0/4107697242 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c896114960 con 0x55c8960936f0 2024-04-26T18:36:07.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.718+0000 7f34597fa700 1 -- 172.21.15.80:0/4107697242 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3468016630 con 0x55c8960936f0 2024-04-26T18:36:07.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.718+0000 7f34597fa700 1 -- 172.21.15.80:0/4107697242 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f34600bc170 con 0x55c8960936f0 2024-04-26T18:36:07.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.718+0000 7f3482aafb80 10 client.15099 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:36:07.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.718+0000 7f3482aafb80 10 client.15099 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-26T18:36:07.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.718+0000 7f3482aafb80 20 client.15099 populate_metadata read hostname 'smithi080' 2024-04-26T18:36:07.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.718+0000 7f3482aafb80 1 --2- 172.21.15.80:0/4107697242 >> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] conn(0x55c8961191c0 0x55c896117ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:07.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.718+0000 7f3482aafb80 4 client.15099 mds_command: new command op to 24394 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T18:36:07.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.718+0000 7f3482aafb80 1 -- 172.21.15.80:0/4107697242 --> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] -- command(tid 0: {"prefix": "status"}) -- 0x55c895fed260 con 0x55c8961191c0 2024-04-26T18:36:07.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.719+0000 7f3475fb9700 1 --2- 172.21.15.80:0/4107697242 >> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] conn(0x55c8961191c0 0x55c896117ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:07.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.719+0000 7f3475fb9700 1 --2- 172.21.15.80:0/4107697242 >> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] conn(0x55c8961191c0 0x55c896117ed0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2ed6113314aec515 server_cookie=6d5c63c6e3c564f2 in_seq=0 out_seq=0 2024-04-26T18:36:07.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.719+0000 7f34597fa700 10 client.15099 ms_handle_connect on v2:172.21.15.192:6834/719058020 2024-04-26T18:36:07.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.719+0000 7f34597fa700 1 -- 172.21.15.80:0/4107697242 <== mds.4 v2:172.21.15.192:6834/719058020 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55c895fed260 con 0x55c8961191c0 2024-04-26T18:36:07.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.719+0000 7f34597fa700 10 client.15099 handle_command_reply: tid=0 2024-04-26T18:36:07.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.719+0000 7f3482aafb80 1 client.15099 shutdown 2024-04-26T18:36:07.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.719+0000 7f3482aafb80 1 -- 172.21.15.80:0/4107697242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c8960936f0 msgr2=0x55c8960b20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:07.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.719+0000 7f3482aafb80 1 --2- 172.21.15.80:0/4107697242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c8960936f0 0x55c8960b20c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3460099f20 tx=0x7f34600880b0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.720+0000 7f3482aafb80 1 -- 172.21.15.80:0/4107697242 shutdown_connections 2024-04-26T18:36:07.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.720+0000 7f3482aafb80 1 --2- 172.21.15.80:0/4107697242 >> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] conn(0x55c8961191c0 0x55c896117ed0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.720+0000 7f3482aafb80 1 --2- 172.21.15.80:0/4107697242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c896098a20 0x55c8960b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.720+0000 7f3482aafb80 1 --2- 172.21.15.80:0/4107697242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c896092d50 0x55c8960b74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.720+0000 7f3482aafb80 1 --2- 172.21.15.80:0/4107697242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c8960936f0 0x55c8960b20c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.720+0000 7f34597fa700 0 client.15099 ms_handle_reset on v2:172.21.15.192:6834/719058020 2024-04-26T18:36:07.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.720+0000 7f3482aafb80 1 -- 172.21.15.80:0/4107697242 >> 172.21.15.80:0/4107697242 conn(0x55c895fc1570 msgr2=0x55c89608d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:07.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.720+0000 7f3482aafb80 1 -- 172.21.15.80:0/4107697242 shutdown_connections 2024-04-26T18:36:07.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.720+0000 7f3482aafb80 1 -- 172.21.15.80:0/4107697242 wait complete. 2024-04-26T18:36:07.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.720+0000 7f3482aafb80 20 client.15099 trim_cache size 0 max 16384 2024-04-26T18:36:07.729 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:36:07.729 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "2187ca98-03fa-11ef-bc93-c7b262605968", 2024-04-26T18:36:07.729 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 4, 2024-04-26T18:36:07.729 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24394, 2024-04-26T18:36:07.729 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-26T18:36:07.729 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-26T18:36:07.729 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-26T18:36:07.729 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 164.05575569499999, 2024-04-26T18:36:07.729 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 26, 2024-04-26T18:36:07.729 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 91, 2024-04-26T18:36:07.729 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T18:36:07.729 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 215.07569362699999 2024-04-26T18:36:07.730 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:36:07.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.720+0000 7f347821d700 1 -- 172.21.15.80:0/1887822419 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f345c0a3cc0 msgr2=0x7f345c0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:07.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.720+0000 7f347821d700 1 --2- 172.21.15.80:0/1887822419 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f345c0a3cc0 0x7f345c0a6180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f346c005fd0 tx=0x7f346c005ee0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.720+0000 7f347821d700 1 -- 172.21.15.80:0/1887822419 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3470102fc0 msgr2=0x7f347019ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:07.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.720+0000 7f347821d700 1 --2- 172.21.15.80:0/1887822419 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3470102fc0 0x7f347019ae50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3460006010 tx=0x7f34600047b0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.720+0000 7f347821d700 1 -- 172.21.15.80:0/1887822419 shutdown_connections 2024-04-26T18:36:07.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.720+0000 7f347821d700 1 --2- 172.21.15.80:0/1887822419 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f345c0a3cc0 0x7f345c0a6180 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.720+0000 7f347821d700 1 --2- 172.21.15.80:0/1887822419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3470107660 0x7f34701a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.720+0000 7f347821d700 1 --2- 172.21.15.80:0/1887822419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3470102610 0x7f347019a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.720+0000 7f347821d700 1 --2- 172.21.15.80:0/1887822419 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3470102fc0 0x7f347019ae50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:07.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.720+0000 7f347821d700 1 -- 172.21.15.80:0/1887822419 >> 172.21.15.80:0/1887822419 conn(0x7f3470078370 msgr2=0x7f34701003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:07.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.721+0000 7f347821d700 1 -- 172.21.15.80:0/1887822419 shutdown_connections 2024-04-26T18:36:07.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:07.721+0000 7f347821d700 1 -- 172.21.15.80:0/1887822419 wait complete. 2024-04-26T18:36:08.552 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell mds.c status 2024-04-26T18:36:08.794 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:36:09.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:09 smithi192 ceph-mon[32842]: pgmap v390: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:36:09.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:09 smithi082 ceph-mon[32808]: pgmap v390: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:36:09.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:09 smithi080 ceph-mon[29135]: pgmap v390: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:36:10.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.579+0000 7efdf4dad700 1 -- 172.21.15.80:0/1375400560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdf0102cd0 msgr2=0x7efdf010f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:10.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.579+0000 7efdf4dad700 1 --2- 172.21.15.80:0/1375400560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdf0102cd0 0x7efdf010f1c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efde0009990 tx=0x7efde0009ca0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.579+0000 7efdf4dad700 1 -- 172.21.15.80:0/1375400560 shutdown_connections 2024-04-26T18:36:10.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.579+0000 7efdf4dad700 1 --2- 172.21.15.80:0/1375400560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdf0102cd0 0x7efdf010f1c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.579+0000 7efdf4dad700 1 --2- 172.21.15.80:0/1375400560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdf0108380 0x7efdf0108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.579+0000 7efdf4dad700 1 --2- 172.21.15.80:0/1375400560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdf0102310 0x7efdf0102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.579+0000 7efdf4dad700 1 -- 172.21.15.80:0/1375400560 >> 172.21.15.80:0/1375400560 conn(0x7efdf0079290 msgr2=0x7efdf00796a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:10.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.579+0000 7efdf4dad700 1 -- 172.21.15.80:0/1375400560 shutdown_connections 2024-04-26T18:36:10.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.579+0000 7efdf4dad700 1 -- 172.21.15.80:0/1375400560 wait complete. 2024-04-26T18:36:10.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.580+0000 7efdf4dad700 1 Processor -- start 2024-04-26T18:36:10.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.580+0000 7efdf4dad700 1 -- start start 2024-04-26T18:36:10.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.580+0000 7efdf4dad700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdf0102310 0x7efdf019a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:10.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.580+0000 7efdf4dad700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdf0102cd0 0x7efdf019ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:10.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.580+0000 7efdf4dad700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdf0108380 0x7efdf01a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:10.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.580+0000 7efdf4dad700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efdf01124a0 con 0x7efdf0108380 2024-04-26T18:36:10.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.580+0000 7efdf4dad700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efdf0112320 con 0x7efdf0102cd0 2024-04-26T18:36:10.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.580+0000 7efdf4dad700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efdf0112620 con 0x7efdf0102310 2024-04-26T18:36:10.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.580+0000 7efdeed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdf0108380 0x7efdf01a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:10.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.580+0000 7efdeed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdf0108380 0x7efdf01a58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39420/0 (socket says 172.21.15.80:39420) 2024-04-26T18:36:10.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.580+0000 7efdeed9d700 1 -- 172.21.15.80:0/4191779206 learned_addr learned my addr 172.21.15.80:0/4191779206 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:10.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.580+0000 7efdedd9b700 1 --2- 172.21.15.80:0/4191779206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdf0102cd0 0x7efdf019ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:10.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.580+0000 7efdee59c700 1 --2- 172.21.15.80:0/4191779206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdf0102310 0x7efdf019a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:10.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.581+0000 7efdeed9d700 1 -- 172.21.15.80:0/4191779206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdf0102310 msgr2=0x7efdf019a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:10.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.581+0000 7efdeed9d700 1 --2- 172.21.15.80:0/4191779206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdf0102310 0x7efdf019a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.581+0000 7efdeed9d700 1 -- 172.21.15.80:0/4191779206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdf0102cd0 msgr2=0x7efdf019ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:10.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.581+0000 7efdeed9d700 1 --2- 172.21.15.80:0/4191779206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdf0102cd0 0x7efdf019ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.581+0000 7efdeed9d700 1 -- 172.21.15.80:0/4191779206 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf01a5e00 con 0x7efdf0108380 2024-04-26T18:36:10.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.581+0000 7efdeed9d700 1 --2- 172.21.15.80:0/4191779206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdf0108380 0x7efdf01a58c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7efde00057c0 tx=0x7efde00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:10.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.581+0000 7efddf7fe700 1 -- 172.21.15.80:0/4191779206 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde0027070 con 0x7efdf0108380 2024-04-26T18:36:10.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.581+0000 7efddf7fe700 1 -- 172.21.15.80:0/4191779206 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efde0003680 con 0x7efdf0108380 2024-04-26T18:36:10.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.581+0000 7efdf4dad700 1 -- 172.21.15.80:0/4191779206 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdf01a5fd0 con 0x7efdf0108380 2024-04-26T18:36:10.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.581+0000 7efddf7fe700 1 -- 172.21.15.80:0/4191779206 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde0022b40 con 0x7efdf0108380 2024-04-26T18:36:10.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.581+0000 7efdf4dad700 1 -- 172.21.15.80:0/4191779206 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdf01a6420 con 0x7efdf0108380 2024-04-26T18:36:10.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.583+0000 7efddf7fe700 1 -- 172.21.15.80:0/4191779206 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7efde002a070 con 0x7efdf0108380 2024-04-26T18:36:10.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.584+0000 7efddf7fe700 1 --2- 172.21.15.80:0/4191779206 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7efdd80a3c40 0x7efdd80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:10.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.584+0000 7efdee59c700 1 --2- 172.21.15.80:0/4191779206 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7efdd80a3c40 0x7efdd80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:10.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.584+0000 7efddf7fe700 1 -- 172.21.15.80:0/4191779206 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7efde00d1340 con 0x7efdf0108380 2024-04-26T18:36:10.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.584+0000 7efdee59c700 1 --2- 172.21.15.80:0/4191779206 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7efdd80a3c40 0x7efdd80a6100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efde8009550 tx=0x7efde80091b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:10.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.584+0000 7efdff63fb80 1 Processor -- start 2024-04-26T18:36:10.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.585+0000 7efdff63fb80 1 -- start start 2024-04-26T18:36:10.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.585+0000 7efdff63fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561798365ad0 0x561798365eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:10.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.585+0000 7efdff63fb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617983663f0 0x56179835fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:10.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.585+0000 7efdff63fb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617983602d0 0x561798360710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:10.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.585+0000 7efdff63fb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5617982b26f0 con 0x5617983602d0 2024-04-26T18:36:10.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.585+0000 7efdff63fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561798251590 con 0x561798365ad0 2024-04-26T18:36:10.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.585+0000 7efdff63fb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5617982ae6b0 con 0x5617983663f0 2024-04-26T18:36:10.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.585+0000 7efdeed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617983602d0 0x561798360710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:10.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.585+0000 7efdeed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617983602d0 0x561798360710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39426/0 (socket says 172.21.15.80:39426) 2024-04-26T18:36:10.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.585+0000 7efdeed9d700 1 -- 172.21.15.80:0/1175457120 learned_addr learned my addr 172.21.15.80:0/1175457120 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:10.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.585+0000 7efdee59c700 1 --2- 172.21.15.80:0/1175457120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561798365ad0 0x561798365eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:10.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.585+0000 7efdedd9b700 1 --2- 172.21.15.80:0/1175457120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617983663f0 0x56179835fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:10.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.585+0000 7efdeed9d700 1 -- 172.21.15.80:0/1175457120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617983663f0 msgr2=0x56179835fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:10.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.585+0000 7efdeed9d700 1 --2- 172.21.15.80:0/1175457120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617983663f0 0x56179835fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.585+0000 7efdeed9d700 1 -- 172.21.15.80:0/1175457120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561798365ad0 msgr2=0x561798365eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:10.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.585+0000 7efdeed9d700 1 --2- 172.21.15.80:0/1175457120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561798365ad0 0x561798365eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.585+0000 7efdeed9d700 1 -- 172.21.15.80:0/1175457120 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617981ff880 con 0x5617983602d0 2024-04-26T18:36:10.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.585+0000 7efdee59c700 1 --2- 172.21.15.80:0/1175457120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561798365ad0 0x561798365eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:36:10.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.585+0000 7efdeed9d700 1 --2- 172.21.15.80:0/1175457120 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617983602d0 0x561798360710 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efde009d4c0 tx=0x7efde00059e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2026a54b154d99 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:10.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.585+0000 7efddcff9700 1 -- 172.21.15.80:0/1175457120 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde009d120 con 0x5617983602d0 2024-04-26T18:36:10.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.586+0000 7efddcff9700 1 -- 172.21.15.80:0/1175457120 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efde00a1a90 con 0x5617983602d0 2024-04-26T18:36:10.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.586+0000 7efddcff9700 1 -- 172.21.15.80:0/1175457120 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde00a6090 con 0x5617983602d0 2024-04-26T18:36:10.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.586+0000 7efdff63fb80 1 -- 172.21.15.80:0/1175457120 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617983602d0 msgr2=0x561798360710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:10.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.586+0000 7efdff63fb80 1 --2- 172.21.15.80:0/1175457120 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617983602d0 0x561798360710 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efde009d4c0 tx=0x7efde00059e0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.586+0000 7efdff63fb80 1 -- 172.21.15.80:0/1175457120 shutdown_connections 2024-04-26T18:36:10.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.586+0000 7efdff63fb80 1 --2- 172.21.15.80:0/1175457120 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617983602d0 0x561798360710 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.586+0000 7efdff63fb80 1 --2- 172.21.15.80:0/1175457120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561798365ad0 0x561798365eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.586+0000 7efdff63fb80 1 --2- 172.21.15.80:0/1175457120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617983663f0 0x56179835fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.586+0000 7efdff63fb80 1 -- 172.21.15.80:0/1175457120 >> 172.21.15.80:0/1175457120 conn(0x56179828ccf0 msgr2=0x56179835b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:10.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.586+0000 7efdff63fb80 1 -- 172.21.15.80:0/1175457120 shutdown_connections 2024-04-26T18:36:10.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.586+0000 7efdff63fb80 1 -- 172.21.15.80:0/1175457120 wait complete. 2024-04-26T18:36:10.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.587+0000 7efdff63fb80 1 -- start start 2024-04-26T18:36:10.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.587+0000 7efdff63fb80 1 Processor -- start 2024-04-26T18:36:10.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.587+0000 7efdff63fb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617983602d0 0x56179836c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:10.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.587+0000 7efdff63fb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561798365ad0 0x5617983694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:10.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.587+0000 7efdff63fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617983663f0 0x5617983699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:10.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.587+0000 7efdff63fb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56179836ccd0 con 0x561798365ad0 2024-04-26T18:36:10.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.587+0000 7efdff63fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561798218900 con 0x5617983663f0 2024-04-26T18:36:10.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.587+0000 7efdff63fb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56179836ce50 con 0x5617983602d0 2024-04-26T18:36:10.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.587+0000 7efdff63fb80 10 client.0 _ll_register_callbacks cb 0x561798246530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:36:10.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.587+0000 7efdedd9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561798365ad0 0x5617983694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:10.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.587+0000 7efdedd9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561798365ad0 0x5617983694a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39432/0 (socket says 172.21.15.80:39432) 2024-04-26T18:36:10.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.587+0000 7efdedd9b700 1 -- 172.21.15.80:0/656209426 learned_addr learned my addr 172.21.15.80:0/656209426 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:10.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.587+0000 7efdee59c700 1 --2- 172.21.15.80:0/656209426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617983602d0 0x56179836c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:10.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.587+0000 7efdeed9d700 1 --2- 172.21.15.80:0/656209426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617983663f0 0x5617983699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:10.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.587+0000 7efdedd9b700 1 -- 172.21.15.80:0/656209426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617983602d0 msgr2=0x56179836c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:10.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.587+0000 7efdedd9b700 1 --2- 172.21.15.80:0/656209426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617983602d0 0x56179836c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.587+0000 7efdedd9b700 1 -- 172.21.15.80:0/656209426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617983663f0 msgr2=0x5617983699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:10.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.588+0000 7efdedd9b700 1 --2- 172.21.15.80:0/656209426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617983663f0 0x5617983699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.588+0000 7efdedd9b700 1 -- 172.21.15.80:0/656209426 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56179836a090 con 0x561798365ad0 2024-04-26T18:36:10.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.588+0000 7efdeed9d700 1 --2- 172.21.15.80:0/656209426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617983663f0 0x5617983699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:36:10.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.588+0000 7efdedd9b700 1 --2- 172.21.15.80:0/656209426 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561798365ad0 0x5617983694a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efde4007ee0 tx=0x7efde4012730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd82dfa2c06e550 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:10.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.588+0000 7efdd5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:36:10.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.588+0000 7efdd5ffb700 1 -- 172.21.15.80:0/656209426 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde4012e60 con 0x561798365ad0 2024-04-26T18:36:10.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.588+0000 7efdd5ffb700 1 -- 172.21.15.80:0/656209426 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7efde4003680 con 0x561798365ad0 2024-04-26T18:36:10.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.588+0000 7efdff63fb80 1 -- 172.21.15.80:0/656209426 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efde00a1a90 con 0x561798365ad0 2024-04-26T18:36:10.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.588+0000 7efdd5ffb700 1 -- 172.21.15.80:0/656209426 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7efde4022070 con 0x561798365ad0 2024-04-26T18:36:10.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.588+0000 7efdff63fb80 10 client.15111 fetch_fsmap learned FSMap version 26 2024-04-26T18:36:10.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.588+0000 7efdff63fb80 1 -- 172.21.15.80:0/656209426 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5617983776a0 con 0x561798365ad0 2024-04-26T18:36:10.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.588+0000 7efdd5ffb700 1 -- 172.21.15.80:0/656209426 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efde00a1a90 con 0x561798365ad0 2024-04-26T18:36:10.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.588+0000 7efdd5ffb700 1 -- 172.21.15.80:0/656209426 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7efde4019020 con 0x561798365ad0 2024-04-26T18:36:10.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.588+0000 7efdff63fb80 10 client.15111 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:36:10.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.588+0000 7efdff63fb80 10 client.15111 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T18:36:10.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.589+0000 7efdff63fb80 20 client.15111 populate_metadata read hostname 'smithi080' 2024-04-26T18:36:10.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.589+0000 7efdff63fb80 1 --2- 172.21.15.80:0/656209426 >> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] conn(0x561798379cd0 0x56179837b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:10.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.589+0000 7efdff63fb80 4 client.15111 mds_command: new command op to 24400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:36:10.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.589+0000 7efdff63fb80 1 -- 172.21.15.80:0/656209426 --> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617982c00d0 con 0x561798379cd0 2024-04-26T18:36:10.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.589+0000 7efdee59c700 1 --2- 172.21.15.80:0/656209426 >> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] conn(0x561798379cd0 0x56179837b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:10.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.589+0000 7efdd5ffb700 10 client.15111 ms_handle_connect on v2:172.21.15.192:6836/2361996920 2024-04-26T18:36:10.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.589+0000 7efdee59c700 1 --2- 172.21.15.80:0/656209426 >> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] conn(0x561798379cd0 0x56179837b140 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f280830ddc39d6ee server_cookie=bd3b1e217384a97a in_seq=0 out_seq=0 2024-04-26T18:36:10.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.590+0000 7efdd5ffb700 1 -- 172.21.15.80:0/656209426 <== mds.3 v2:172.21.15.192:6836/2361996920 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5617982c00d0 con 0x561798379cd0 2024-04-26T18:36:10.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.590+0000 7efdd5ffb700 10 client.15111 handle_command_reply: tid=0 2024-04-26T18:36:10.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.590+0000 7efdff63fb80 1 client.15111 shutdown 2024-04-26T18:36:10.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.590+0000 7efdff63fb80 1 -- 172.21.15.80:0/656209426 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561798365ad0 msgr2=0x5617983694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:10.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.590+0000 7efdff63fb80 1 --2- 172.21.15.80:0/656209426 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561798365ad0 0x5617983694a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efde4007ee0 tx=0x7efde4012730 comp rx=0 tx=0).stop 2024-04-26T18:36:10.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.590+0000 7efdff63fb80 1 -- 172.21.15.80:0/656209426 shutdown_connections 2024-04-26T18:36:10.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.590+0000 7efdff63fb80 1 --2- 172.21.15.80:0/656209426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617983663f0 0x5617983699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.590+0000 7efdff63fb80 1 --2- 172.21.15.80:0/656209426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617983602d0 0x56179836c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.590+0000 7efdff63fb80 1 --2- 172.21.15.80:0/656209426 >> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] conn(0x561798379cd0 0x56179837b140 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.590+0000 7efdff63fb80 1 --2- 172.21.15.80:0/656209426 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561798365ad0 0x5617983694a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.590+0000 7efdff63fb80 1 -- 172.21.15.80:0/656209426 >> 172.21.15.80:0/656209426 conn(0x56179828ccf0 msgr2=0x56179835a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:10.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.590+0000 7efdd5ffb700 0 client.15111 ms_handle_reset on v2:172.21.15.192:6836/2361996920 2024-04-26T18:36:10.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.590+0000 7efdff63fb80 1 -- 172.21.15.80:0/656209426 shutdown_connections 2024-04-26T18:36:10.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.590+0000 7efdff63fb80 1 -- 172.21.15.80:0/656209426 wait complete. 2024-04-26T18:36:10.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.590+0000 7efdff63fb80 20 client.15111 trim_cache size 0 max 16384 2024-04-26T18:36:10.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.611+0000 7efdff63fb80 1 Processor -- start 2024-04-26T18:36:10.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.611+0000 7efdff63fb80 1 -- start start 2024-04-26T18:36:10.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.611+0000 7efdff63fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617983602d0 0x56179835fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:10.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.611+0000 7efdff63fb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561798365ad0 0x561798375cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:10.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.611+0000 7efdff63fb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617983663f0 0x5617983667d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:10.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.611+0000 7efdff63fb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x561798379480 con 0x5617983663f0 2024-04-26T18:36:10.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.611+0000 7efdff63fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561798379b50 con 0x5617983602d0 2024-04-26T18:36:10.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.611+0000 7efdff63fb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56179837a220 con 0x561798365ad0 2024-04-26T18:36:10.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.611+0000 7efdeed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617983663f0 0x5617983667d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:10.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.611+0000 7efdeed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617983663f0 0x5617983667d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39436/0 (socket says 172.21.15.80:39436) 2024-04-26T18:36:10.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.611+0000 7efdeed9d700 1 -- 172.21.15.80:0/3206905729 learned_addr learned my addr 172.21.15.80:0/3206905729 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:10.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.611+0000 7efdedd9b700 1 --2- 172.21.15.80:0/3206905729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561798365ad0 0x561798375cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:10.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.611+0000 7efdee59c700 1 --2- 172.21.15.80:0/3206905729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617983602d0 0x56179835fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:10.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.611+0000 7efdeed9d700 1 -- 172.21.15.80:0/3206905729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561798365ad0 msgr2=0x561798375cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:10.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.611+0000 7efdeed9d700 1 --2- 172.21.15.80:0/3206905729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561798365ad0 0x561798375cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.611+0000 7efdeed9d700 1 -- 172.21.15.80:0/3206905729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617983602d0 msgr2=0x56179835fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:10.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.611+0000 7efdeed9d700 1 --2- 172.21.15.80:0/3206905729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617983602d0 0x56179835fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.611+0000 7efdeed9d700 1 -- 172.21.15.80:0/3206905729 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56179835bc80 con 0x5617983663f0 2024-04-26T18:36:10.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.612+0000 7efdeed9d700 1 --2- 172.21.15.80:0/3206905729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617983663f0 0x5617983667d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efde00cf1e0 tx=0x7efde009d690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0052aadc658c62a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:10.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.612+0000 7efdd7fff700 1 -- 172.21.15.80:0/3206905729 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde00ba070 con 0x5617983663f0 2024-04-26T18:36:10.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.612+0000 7efdd7fff700 1 -- 172.21.15.80:0/3206905729 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efde00a1a90 con 0x5617983663f0 2024-04-26T18:36:10.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.612+0000 7efdd7fff700 1 -- 172.21.15.80:0/3206905729 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde00a5e30 con 0x5617983663f0 2024-04-26T18:36:10.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.612+0000 7efdff63fb80 1 -- 172.21.15.80:0/3206905729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617983663f0 msgr2=0x5617983667d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:10.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.612+0000 7efdff63fb80 1 --2- 172.21.15.80:0/3206905729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617983663f0 0x5617983667d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efde00cf1e0 tx=0x7efde009d690 comp rx=0 tx=0).stop 2024-04-26T18:36:10.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.613+0000 7efdff63fb80 1 -- 172.21.15.80:0/3206905729 shutdown_connections 2024-04-26T18:36:10.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.613+0000 7efdff63fb80 1 --2- 172.21.15.80:0/3206905729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617983663f0 0x5617983667d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.613+0000 7efdff63fb80 1 --2- 172.21.15.80:0/3206905729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617983602d0 0x56179835fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.613+0000 7efdff63fb80 1 --2- 172.21.15.80:0/3206905729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561798365ad0 0x561798375cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.613+0000 7efdff63fb80 1 -- 172.21.15.80:0/3206905729 >> 172.21.15.80:0/3206905729 conn(0x56179828ccf0 msgr2=0x561798367d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:10.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.613+0000 7efdff63fb80 1 -- 172.21.15.80:0/3206905729 shutdown_connections 2024-04-26T18:36:10.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.613+0000 7efdff63fb80 1 -- 172.21.15.80:0/3206905729 wait complete. 2024-04-26T18:36:10.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.613+0000 7efdff63fb80 1 -- start start 2024-04-26T18:36:10.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.613+0000 7efdff63fb80 1 Processor -- start 2024-04-26T18:36:10.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.613+0000 7efdff63fb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617983602d0 0x561798374e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:10.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.613+0000 7efdff63fb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561798365ad0 0x5617983753d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:10.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.613+0000 7efdff63fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617983663f0 0x5617983835b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:10.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.613+0000 7efdff63fb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56179837afc0 con 0x5617983602d0 2024-04-26T18:36:10.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.613+0000 7efdff63fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56179837a8f0 con 0x5617983663f0 2024-04-26T18:36:10.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.613+0000 7efdff63fb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56179837b690 con 0x561798365ad0 2024-04-26T18:36:10.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.613+0000 7efdff63fb80 10 client.0 _ll_register_callbacks cb 0x561798246530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:36:10.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.613+0000 7efdee59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617983602d0 0x561798374e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:10.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.613+0000 7efdee59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617983602d0 0x561798374e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39452/0 (socket says 172.21.15.80:39452) 2024-04-26T18:36:10.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.613+0000 7efdee59c700 1 -- 172.21.15.80:0/1991854518 learned_addr learned my addr 172.21.15.80:0/1991854518 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:10.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.613+0000 7efdeed9d700 1 --2- 172.21.15.80:0/1991854518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617983663f0 0x5617983835b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:10.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.614+0000 7efdedd9b700 1 --2- 172.21.15.80:0/1991854518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561798365ad0 0x5617983753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:10.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.614+0000 7efdee59c700 1 -- 172.21.15.80:0/1991854518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561798365ad0 msgr2=0x5617983753d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:10.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.614+0000 7efdee59c700 1 --2- 172.21.15.80:0/1991854518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561798365ad0 0x5617983753d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.614+0000 7efdee59c700 1 -- 172.21.15.80:0/1991854518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617983663f0 msgr2=0x5617983835b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:10.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.614+0000 7efdee59c700 1 --2- 172.21.15.80:0/1991854518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617983663f0 0x5617983835b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.614+0000 7efdee59c700 1 -- 172.21.15.80:0/1991854518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561798383b20 con 0x5617983602d0 2024-04-26T18:36:10.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.614+0000 7efdee59c700 1 --2- 172.21.15.80:0/1991854518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617983602d0 0x561798374e90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efde8004a10 tx=0x7efde8004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d931b6c338e80cb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:10.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.614+0000 7efdd5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:36:10.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.614+0000 7efdd5ffb700 1 -- 172.21.15.80:0/1991854518 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde801c040 con 0x5617983602d0 2024-04-26T18:36:10.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.614+0000 7efdd5ffb700 1 -- 172.21.15.80:0/1991854518 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7efde8029070 con 0x5617983602d0 2024-04-26T18:36:10.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.614+0000 7efdff63fb80 1 -- 172.21.15.80:0/1991854518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efde00a1a90 con 0x5617983602d0 2024-04-26T18:36:10.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.614+0000 7efdd5ffb700 1 -- 172.21.15.80:0/1991854518 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7efde8015440 con 0x5617983602d0 2024-04-26T18:36:10.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.614+0000 7efdff63fb80 10 client.15117 fetch_fsmap learned FSMap version 26 2024-04-26T18:36:10.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.614+0000 7efdff63fb80 1 -- 172.21.15.80:0/1991854518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561798384e80 con 0x5617983602d0 2024-04-26T18:36:10.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.614+0000 7efdd5ffb700 1 -- 172.21.15.80:0/1991854518 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efde00a1a90 con 0x5617983602d0 2024-04-26T18:36:10.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.614+0000 7efdd5ffb700 1 -- 172.21.15.80:0/1991854518 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7efde8023660 con 0x5617983602d0 2024-04-26T18:36:10.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.614+0000 7efdff63fb80 10 client.15117 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:36:10.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.614+0000 7efdff63fb80 10 client.15117 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T18:36:10.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.614+0000 7efdff63fb80 20 client.15117 populate_metadata read hostname 'smithi080' 2024-04-26T18:36:10.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.614+0000 7efdff63fb80 1 --2- 172.21.15.80:0/1991854518 >> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] conn(0x5617983e5940 0x5617983e4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:10.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.614+0000 7efdff63fb80 4 client.15117 mds_command: new command op to 24400 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T18:36:10.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.614+0000 7efdff63fb80 1 -- 172.21.15.80:0/1991854518 --> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] -- command(tid 0: {"prefix": "status"}) -- 0x5617982ba170 con 0x5617983e5940 2024-04-26T18:36:10.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.615+0000 7efdedd9b700 1 --2- 172.21.15.80:0/1991854518 >> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] conn(0x5617983e5940 0x5617983e4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:10.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.615+0000 7efdd5ffb700 10 client.15117 ms_handle_connect on v2:172.21.15.192:6836/2361996920 2024-04-26T18:36:10.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.615+0000 7efdedd9b700 1 --2- 172.21.15.80:0/1991854518 >> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] conn(0x5617983e5940 0x5617983e4650 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6f79684e597a0cc8 server_cookie=cb28206dc234c907 in_seq=0 out_seq=0 2024-04-26T18:36:10.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.615+0000 7efdd5ffb700 1 -- 172.21.15.80:0/1991854518 <== mds.3 v2:172.21.15.192:6836/2361996920 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5617982ba170 con 0x5617983e5940 2024-04-26T18:36:10.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.615+0000 7efdd5ffb700 10 client.15117 handle_command_reply: tid=0 2024-04-26T18:36:10.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.615+0000 7efdff63fb80 1 client.15117 shutdown 2024-04-26T18:36:10.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.615+0000 7efdff63fb80 1 -- 172.21.15.80:0/1991854518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617983602d0 msgr2=0x561798374e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:10.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.615+0000 7efdff63fb80 1 --2- 172.21.15.80:0/1991854518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617983602d0 0x561798374e90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efde8004a10 tx=0x7efde8004b40 comp rx=0 tx=0).stop 2024-04-26T18:36:10.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.615+0000 7efdff63fb80 1 -- 172.21.15.80:0/1991854518 shutdown_connections 2024-04-26T18:36:10.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.615+0000 7efdff63fb80 1 --2- 172.21.15.80:0/1991854518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617983663f0 0x5617983835b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.615+0000 7efdff63fb80 1 --2- 172.21.15.80:0/1991854518 >> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] conn(0x5617983e5940 0x5617983e4650 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.615+0000 7efdff63fb80 1 --2- 172.21.15.80:0/1991854518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5617983602d0 0x561798374e90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.615+0000 7efdff63fb80 1 --2- 172.21.15.80:0/1991854518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561798365ad0 0x5617983753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.615+0000 7efdd5ffb700 0 client.15117 ms_handle_reset on v2:172.21.15.192:6836/2361996920 2024-04-26T18:36:10.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.616+0000 7efdff63fb80 1 -- 172.21.15.80:0/1991854518 >> 172.21.15.80:0/1991854518 conn(0x56179828ccf0 msgr2=0x5617983667d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:10.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.616+0000 7efdff63fb80 1 -- 172.21.15.80:0/1991854518 shutdown_connections 2024-04-26T18:36:10.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.616+0000 7efdff63fb80 1 -- 172.21.15.80:0/1991854518 wait complete. 2024-04-26T18:36:10.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.616+0000 7efdff63fb80 20 client.15117 trim_cache size 0 max 16384 2024-04-26T18:36:10.624 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:36:10.624 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "2187ca98-03fa-11ef-bc93-c7b262605968", 2024-04-26T18:36:10.624 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 3, 2024-04-26T18:36:10.625 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24400, 2024-04-26T18:36:10.625 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-26T18:36:10.625 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-26T18:36:10.625 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-26T18:36:10.625 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 167.96040235300001, 2024-04-26T18:36:10.625 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 26, 2024-04-26T18:36:10.625 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 91, 2024-04-26T18:36:10.625 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T18:36:10.625 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 215.100176288 2024-04-26T18:36:10.625 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:36:10.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.616+0000 7efdf4dad700 1 -- 172.21.15.80:0/4191779206 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7efdd80a3c40 msgr2=0x7efdd80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:10.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.616+0000 7efdf4dad700 1 --2- 172.21.15.80:0/4191779206 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7efdd80a3c40 0x7efdd80a6100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efde8009550 tx=0x7efde80091b0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.616+0000 7efdf4dad700 1 -- 172.21.15.80:0/4191779206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdf0108380 msgr2=0x7efdf01a58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:10.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.616+0000 7efdf4dad700 1 --2- 172.21.15.80:0/4191779206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdf0108380 0x7efdf01a58c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7efde00057c0 tx=0x7efde00057f0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.616+0000 7efdf4dad700 1 -- 172.21.15.80:0/4191779206 shutdown_connections 2024-04-26T18:36:10.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.616+0000 7efdf4dad700 1 --2- 172.21.15.80:0/4191779206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdf0108380 0x7efdf01a58c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.616+0000 7efdf4dad700 1 --2- 172.21.15.80:0/4191779206 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7efdd80a3c40 0x7efdd80a6100 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.616+0000 7efdf4dad700 1 --2- 172.21.15.80:0/4191779206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdf0102310 0x7efdf019a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.616+0000 7efdf4dad700 1 --2- 172.21.15.80:0/4191779206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdf0102cd0 0x7efdf019ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:10.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.616+0000 7efdf4dad700 1 -- 172.21.15.80:0/4191779206 >> 172.21.15.80:0/4191779206 conn(0x7efdf0079290 msgr2=0x7efdf0100e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:10.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.616+0000 7efdf4dad700 1 -- 172.21.15.80:0/4191779206 shutdown_connections 2024-04-26T18:36:10.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:10.616+0000 7efdf4dad700 1 -- 172.21.15.80:0/4191779206 wait complete. 2024-04-26T18:36:11.412 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell mds.h status 2024-04-26T18:36:11.657 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:36:11.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:11 smithi080 ceph-mon[29135]: pgmap v391: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:36:11.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:11 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:36:11.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:11 smithi192 ceph-mon[32842]: pgmap v391: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:36:11.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:11 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:36:11.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:11 smithi082 ceph-mon[32808]: pgmap v391: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:36:11.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:11 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:36:13.193 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:36:13.193 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:13 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:36:13.193 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:13 smithi080 ceph-mon[29135]: pgmap v392: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:36:13.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:36:13.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:13 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:36:13.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:13 smithi192 ceph-mon[32842]: pgmap v392: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:36:13.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.454+0000 7f7f1e20a700 1 -- 172.21.15.80:0/440759583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f18075650 msgr2=0x7f7f18075a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:13.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.454+0000 7f7f1e20a700 1 --2- 172.21.15.80:0/440759583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f18075650 0x7f7f18075a30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009990 tx=0x7f7f08009ca0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.454+0000 7f7f1e20a700 1 -- 172.21.15.80:0/440759583 shutdown_connections 2024-04-26T18:36:13.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.454+0000 7f7f1e20a700 1 --2- 172.21.15.80:0/440759583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f181145f0 0x7f7f181169e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.454+0000 7f7f1e20a700 1 --2- 172.21.15.80:0/440759583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f18075650 0x7f7f18075a30 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.454+0000 7f7f1e20a700 1 --2- 172.21.15.80:0/440759583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f18075f70 0x7f7f181140b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.454+0000 7f7f1e20a700 1 -- 172.21.15.80:0/440759583 >> 172.21.15.80:0/440759583 conn(0x7f7f1807a580 msgr2=0x7f7f1807a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:13.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.454+0000 7f7f1e20a700 1 -- 172.21.15.80:0/440759583 shutdown_connections 2024-04-26T18:36:13.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.454+0000 7f7f1e20a700 1 -- 172.21.15.80:0/440759583 wait complete. 2024-04-26T18:36:13.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.455+0000 7f7f1e20a700 1 Processor -- start 2024-04-26T18:36:13.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.455+0000 7f7f1e20a700 1 -- start start 2024-04-26T18:36:13.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.455+0000 7f7f1e20a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f18075650 0x7f7f181a0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:13.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.455+0000 7f7f1e20a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f18075f70 0x7f7f181a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:13.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.455+0000 7f7f1e20a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f181145f0 0x7f7f181a4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:13.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.455+0000 7f7f1e20a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7f18119be0 con 0x7f7f18075f70 2024-04-26T18:36:13.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.455+0000 7f7f1e20a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7f18119a60 con 0x7f7f18075650 2024-04-26T18:36:13.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.455+0000 7f7f1e20a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7f18119d60 con 0x7f7f181145f0 2024-04-26T18:36:13.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.455+0000 7f7f16ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f18075f70 0x7f7f181a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:13.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.455+0000 7f7f16ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f18075f70 0x7f7f181a0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39472/0 (socket says 172.21.15.80:39472) 2024-04-26T18:36:13.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.455+0000 7f7f16ffd700 1 -- 172.21.15.80:0/407230672 learned_addr learned my addr 172.21.15.80:0/407230672 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:13.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.455+0000 7f7f177fe700 1 --2- 172.21.15.80:0/407230672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f18075650 0x7f7f181a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:13.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.455+0000 7f7f17fff700 1 --2- 172.21.15.80:0/407230672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f181145f0 0x7f7f181a4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:13.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.456+0000 7f7f16ffd700 1 -- 172.21.15.80:0/407230672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f181145f0 msgr2=0x7f7f181a4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:13.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.456+0000 7f7f16ffd700 1 --2- 172.21.15.80:0/407230672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f181145f0 0x7f7f181a4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.456+0000 7f7f16ffd700 1 -- 172.21.15.80:0/407230672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f18075650 msgr2=0x7f7f181a0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:13.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.456+0000 7f7f16ffd700 1 --2- 172.21.15.80:0/407230672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f18075650 0x7f7f181a0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.456+0000 7f7f16ffd700 1 -- 172.21.15.80:0/407230672 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f181a5140 con 0x7f7f18075f70 2024-04-26T18:36:13.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.456+0000 7f7f16ffd700 1 --2- 172.21.15.80:0/407230672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f18075f70 0x7f7f181a0670 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c00c920 tx=0x7f7f0c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:13.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.456+0000 7f7f14ff9700 1 -- 172.21.15.80:0/407230672 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c004a30 con 0x7f7f18075f70 2024-04-26T18:36:13.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.456+0000 7f7f1e20a700 1 -- 172.21.15.80:0/407230672 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f181a5430 con 0x7f7f18075f70 2024-04-26T18:36:13.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.456+0000 7f7f14ff9700 1 -- 172.21.15.80:0/407230672 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f0c0054d0 con 0x7f7f18075f70 2024-04-26T18:36:13.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.456+0000 7f7f14ff9700 1 -- 172.21.15.80:0/407230672 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c007bd0 con 0x7f7f18075f70 2024-04-26T18:36:13.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.456+0000 7f7f1e20a700 1 -- 172.21.15.80:0/407230672 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f181accb0 con 0x7f7f18075f70 2024-04-26T18:36:13.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.458+0000 7f7f14ff9700 1 -- 172.21.15.80:0/407230672 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f7f0c004bd0 con 0x7f7f18075f70 2024-04-26T18:36:13.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.459+0000 7f7f14ff9700 1 --2- 172.21.15.80:0/407230672 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f7f000a3c40 0x7f7f000a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:13.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.459+0000 7f7f177fe700 1 --2- 172.21.15.80:0/407230672 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f7f000a3c40 0x7f7f000a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:13.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.459+0000 7f7f14ff9700 1 -- 172.21.15.80:0/407230672 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f7f0c0cff30 con 0x7f7f18075f70 2024-04-26T18:36:13.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.459+0000 7f7f177fe700 1 --2- 172.21.15.80:0/407230672 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f7f000a3c40 0x7f7f000a6100 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7f0800b5c0 tx=0x7f7f08005960 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:13.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.460+0000 7f7f28a9cb80 1 Processor -- start 2024-04-26T18:36:13.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.460+0000 7f7f28a9cb80 1 -- start start 2024-04-26T18:36:13.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.460+0000 7f7f28a9cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5612cf5c4a20 0x5612cf5c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:13.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.460+0000 7f7f28a9cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612cf5bed50 0x5612cf5bf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:13.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.460+0000 7f7f28a9cb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bf6f0 0x5612cf5cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:13.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.460+0000 7f7f28a9cb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5612cf5117e0 con 0x5612cf5bf6f0 2024-04-26T18:36:13.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.460+0000 7f7f28a9cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5612cf4778e0 con 0x5612cf5bed50 2024-04-26T18:36:13.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.460+0000 7f7f28a9cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5612cf50d7a0 con 0x5612cf5c4a20 2024-04-26T18:36:13.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.460+0000 7f7f17fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bf6f0 0x5612cf5cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:13.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.460+0000 7f7f17fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bf6f0 0x5612cf5cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39478/0 (socket says 172.21.15.80:39478) 2024-04-26T18:36:13.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.460+0000 7f7f17fff700 1 -- 172.21.15.80:0/818020641 learned_addr learned my addr 172.21.15.80:0/818020641 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:13.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.460+0000 7f7f16ffd700 1 --2- 172.21.15.80:0/818020641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612cf5bed50 0x5612cf5bf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:13.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.460+0000 7f7f177fe700 1 --2- 172.21.15.80:0/818020641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5612cf5c4a20 0x5612cf5c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:13.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.461+0000 7f7f17fff700 1 -- 172.21.15.80:0/818020641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5612cf5c4a20 msgr2=0x5612cf5c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:13.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.461+0000 7f7f17fff700 1 --2- 172.21.15.80:0/818020641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5612cf5c4a20 0x5612cf5c4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.461+0000 7f7f17fff700 1 -- 172.21.15.80:0/818020641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612cf5bed50 msgr2=0x5612cf5bf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:13.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.461+0000 7f7f17fff700 1 --2- 172.21.15.80:0/818020641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612cf5bed50 0x5612cf5bf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.461+0000 7f7f17fff700 1 -- 172.21.15.80:0/818020641 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612cf45e880 con 0x5612cf5bf6f0 2024-04-26T18:36:13.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.461+0000 7f7f16ffd700 1 --2- 172.21.15.80:0/818020641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612cf5bed50 0x5612cf5bf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:36:13.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.461+0000 7f7f17fff700 1 --2- 172.21.15.80:0/818020641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bf6f0 0x5612cf5cb770 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000a580 tx=0x7f7f100078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6a15b01fc612eb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:13.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.461+0000 7f7efdffb700 1 -- 172.21.15.80:0/818020641 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f10003a00 con 0x5612cf5bf6f0 2024-04-26T18:36:13.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.461+0000 7f7efdffb700 1 -- 172.21.15.80:0/818020641 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f10003ba0 con 0x5612cf5bf6f0 2024-04-26T18:36:13.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.461+0000 7f7efdffb700 1 -- 172.21.15.80:0/818020641 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f10014660 con 0x5612cf5bf6f0 2024-04-26T18:36:13.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.462+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/818020641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bf6f0 msgr2=0x5612cf5cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:13.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.462+0000 7f7f28a9cb80 1 --2- 172.21.15.80:0/818020641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bf6f0 0x5612cf5cb770 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000a580 tx=0x7f7f100078d0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.462+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/818020641 shutdown_connections 2024-04-26T18:36:13.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.462+0000 7f7f28a9cb80 1 --2- 172.21.15.80:0/818020641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bf6f0 0x5612cf5cb770 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.462+0000 7f7f28a9cb80 1 --2- 172.21.15.80:0/818020641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5612cf5c4a20 0x5612cf5c4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.462+0000 7f7f28a9cb80 1 --2- 172.21.15.80:0/818020641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612cf5bed50 0x5612cf5bf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.462+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/818020641 >> 172.21.15.80:0/818020641 conn(0x5612cf4ed570 msgr2=0x5612cf5b9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:13.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.462+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/818020641 shutdown_connections 2024-04-26T18:36:13.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.462+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/818020641 wait complete. 2024-04-26T18:36:13.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.462+0000 7f7f28a9cb80 1 -- start start 2024-04-26T18:36:13.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.462+0000 7f7f28a9cb80 1 Processor -- start 2024-04-26T18:36:13.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.463+0000 7f7f28a9cb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bed50 0x5612cf5cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:13.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.463+0000 7f7f28a9cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5612cf5bf6f0 0x5612cf5c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:13.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.463+0000 7f7f28a9cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612cf5c4a20 0x5612cf5c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:13.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.463+0000 7f7f28a9cb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5612cf5cbcb0 con 0x5612cf5bed50 2024-04-26T18:36:13.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.463+0000 7f7f28a9cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5612cf4cba30 con 0x5612cf5c4a20 2024-04-26T18:36:13.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.463+0000 7f7f28a9cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5612cf5cbe30 con 0x5612cf5bf6f0 2024-04-26T18:36:13.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.463+0000 7f7f28a9cb80 10 client.0 _ll_register_callbacks cb 0x5612cf4a9900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:36:13.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.463+0000 7f7f177fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bed50 0x5612cf5cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:13.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.463+0000 7f7f177fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bed50 0x5612cf5cb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39482/0 (socket says 172.21.15.80:39482) 2024-04-26T18:36:13.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.463+0000 7f7f177fe700 1 -- 172.21.15.80:0/2634889420 learned_addr learned my addr 172.21.15.80:0/2634889420 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:13.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.463+0000 7f7f16ffd700 1 --2- 172.21.15.80:0/2634889420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5612cf5bf6f0 0x5612cf5c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:13.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.463+0000 7f7f17fff700 1 --2- 172.21.15.80:0/2634889420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612cf5c4a20 0x5612cf5c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:13.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.463+0000 7f7f177fe700 1 -- 172.21.15.80:0/2634889420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5612cf5bf6f0 msgr2=0x5612cf5c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:13.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.463+0000 7f7f177fe700 1 --2- 172.21.15.80:0/2634889420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5612cf5bf6f0 0x5612cf5c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.463+0000 7f7f177fe700 1 -- 172.21.15.80:0/2634889420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612cf5c4a20 msgr2=0x5612cf5c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:13.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.463+0000 7f7f177fe700 1 --2- 172.21.15.80:0/2634889420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612cf5c4a20 0x5612cf5c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.463+0000 7f7f177fe700 1 -- 172.21.15.80:0/2634889420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612cf4cf430 con 0x5612cf5bed50 2024-04-26T18:36:13.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.463+0000 7f7f177fe700 1 --2- 172.21.15.80:0/2634889420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bed50 0x5612cf5cb410 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7f08015000 tx=0x7f7f08009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f72f70aabedd8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:13.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.463+0000 7f7ef6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:36:13.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.463+0000 7f7ef6ffd700 1 -- 172.21.15.80:0/2634889420 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f08034060 con 0x5612cf5bed50 2024-04-26T18:36:13.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.463+0000 7f7ef6ffd700 1 -- 172.21.15.80:0/2634889420 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f7f0800f660 con 0x5612cf5bed50 2024-04-26T18:36:13.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.463+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/2634889420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f10003ba0 con 0x5612cf5bed50 2024-04-26T18:36:13.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.464+0000 7f7ef6ffd700 1 -- 172.21.15.80:0/2634889420 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7f0800f8a0 con 0x5612cf5bed50 2024-04-26T18:36:13.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.464+0000 7f7f28a9cb80 10 client.15129 fetch_fsmap learned FSMap version 26 2024-04-26T18:36:13.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.464+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/2634889420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5612cf5d6540 con 0x5612cf5bed50 2024-04-26T18:36:13.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.464+0000 7f7ef6ffd700 1 -- 172.21.15.80:0/2634889420 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f10003ba0 con 0x5612cf5bed50 2024-04-26T18:36:13.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.464+0000 7f7ef6ffd700 1 -- 172.21.15.80:0/2634889420 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f7f0802f960 con 0x5612cf5bed50 2024-04-26T18:36:13.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.464+0000 7f7f28a9cb80 10 client.15129 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:36:13.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.464+0000 7f7f28a9cb80 10 client.15129 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-26T18:36:13.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.464+0000 7f7f28a9cb80 20 client.15129 populate_metadata read hostname 'smithi080' 2024-04-26T18:36:13.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.464+0000 7f7f28a9cb80 1 --2- 172.21.15.80:0/2634889420 >> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] conn(0x5612cf5d8b90 0x5612cf5da000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:13.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.464+0000 7f7f28a9cb80 4 client.15129 mds_command: new command op to 24404 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:36:13.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.464+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/2634889420 --> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612cf51f1c0 con 0x5612cf5d8b90 2024-04-26T18:36:13.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.464+0000 7f7f16ffd700 1 --2- 172.21.15.80:0/2634889420 >> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] conn(0x5612cf5d8b90 0x5612cf5da000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:13.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.465+0000 7f7f16ffd700 1 --2- 172.21.15.80:0/2634889420 >> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] conn(0x5612cf5d8b90 0x5612cf5da000 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7d53ea6e2b3daf6 server_cookie=62536ad21bc803ce in_seq=0 out_seq=0 2024-04-26T18:36:13.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.465+0000 7f7ef6ffd700 10 client.15129 ms_handle_connect on v2:172.21.15.82:6836/2084055551 2024-04-26T18:36:13.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.465+0000 7f7ef6ffd700 1 -- 172.21.15.80:0/2634889420 <== mds.2 v2:172.21.15.82:6836/2084055551 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5612cf51f1c0 con 0x5612cf5d8b90 2024-04-26T18:36:13.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.465+0000 7f7ef6ffd700 10 client.15129 handle_command_reply: tid=0 2024-04-26T18:36:13.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.465+0000 7f7f28a9cb80 1 client.15129 shutdown 2024-04-26T18:36:13.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.466+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/2634889420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bed50 msgr2=0x5612cf5cb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:13.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.466+0000 7f7f28a9cb80 1 --2- 172.21.15.80:0/2634889420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bed50 0x5612cf5cb410 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7f08015000 tx=0x7f7f08009310 comp rx=0 tx=0).stop 2024-04-26T18:36:13.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.466+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/2634889420 shutdown_connections 2024-04-26T18:36:13.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.466+0000 7f7f28a9cb80 1 --2- 172.21.15.80:0/2634889420 >> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] conn(0x5612cf5d8b90 0x5612cf5da000 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.466+0000 7f7f28a9cb80 1 --2- 172.21.15.80:0/2634889420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612cf5c4a20 0x5612cf5c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.466+0000 7f7f28a9cb80 1 --2- 172.21.15.80:0/2634889420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bed50 0x5612cf5cb410 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.466+0000 7f7f28a9cb80 1 --2- 172.21.15.80:0/2634889420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5612cf5bf6f0 0x5612cf5c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.466+0000 7f7ef6ffd700 0 client.15129 ms_handle_reset on v2:172.21.15.82:6836/2084055551 2024-04-26T18:36:13.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.466+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/2634889420 >> 172.21.15.80:0/2634889420 conn(0x5612cf4ed570 msgr2=0x5612cf5bdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:13.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.466+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/2634889420 shutdown_connections 2024-04-26T18:36:13.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.466+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/2634889420 wait complete. 2024-04-26T18:36:13.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.466+0000 7f7f28a9cb80 20 client.15129 trim_cache size 0 max 16384 2024-04-26T18:36:13.475 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:36:13.475 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:13 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:36:13.475 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:13 smithi082 ceph-mon[32808]: pgmap v392: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T18:36:13.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.486+0000 7f7f28a9cb80 1 Processor -- start 2024-04-26T18:36:13.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.486+0000 7f7f28a9cb80 1 -- start start 2024-04-26T18:36:13.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.486+0000 7f7f28a9cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5612cf5bed50 0x5612cf5c8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:13.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.486+0000 7f7f28a9cb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bf6f0 0x5612cf5e3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:13.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.486+0000 7f7f28a9cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612cf5c4a20 0x5612cf5e39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:13.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.486+0000 7f7f28a9cb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5612cf5d8340 con 0x5612cf5bf6f0 2024-04-26T18:36:13.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.486+0000 7f7f28a9cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5612cf5d8a10 con 0x5612cf5c4a20 2024-04-26T18:36:13.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.486+0000 7f7f28a9cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5612cf5d90e0 con 0x5612cf5bed50 2024-04-26T18:36:13.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.486+0000 7f7f16ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bf6f0 0x5612cf5e3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:13.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.486+0000 7f7f16ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bf6f0 0x5612cf5e3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51144/0 (socket says 172.21.15.80:51144) 2024-04-26T18:36:13.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.486+0000 7f7f16ffd700 1 -- 172.21.15.80:0/3990340243 learned_addr learned my addr 172.21.15.80:0/3990340243 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:13.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.486+0000 7f7f17fff700 1 --2- 172.21.15.80:0/3990340243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612cf5c4a20 0x5612cf5e39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:13.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.486+0000 7f7f16ffd700 1 -- 172.21.15.80:0/3990340243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5612cf5bed50 msgr2=0x5612cf5c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:13.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.486+0000 7f7f16ffd700 1 --2- 172.21.15.80:0/3990340243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5612cf5bed50 0x5612cf5c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.486+0000 7f7f16ffd700 1 -- 172.21.15.80:0/3990340243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612cf5c4a20 msgr2=0x5612cf5e39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:13.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.486+0000 7f7f16ffd700 1 --2- 172.21.15.80:0/3990340243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612cf5c4a20 0x5612cf5e39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.486+0000 7f7f16ffd700 1 -- 172.21.15.80:0/3990340243 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612cf5b61f0 con 0x5612cf5bf6f0 2024-04-26T18:36:13.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.487+0000 7f7f16ffd700 1 --2- 172.21.15.80:0/3990340243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bf6f0 0x5612cf5e3470 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c00c8f0 tx=0x7f7f0c004f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c197a6ec90449cee server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:13.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.487+0000 7f7efd7fa700 1 -- 172.21.15.80:0/3990340243 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c0ba070 con 0x5612cf5bf6f0 2024-04-26T18:36:13.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.487+0000 7f7efd7fa700 1 -- 172.21.15.80:0/3990340243 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f0c09a280 con 0x5612cf5bf6f0 2024-04-26T18:36:13.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.487+0000 7f7efd7fa700 1 -- 172.21.15.80:0/3990340243 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c0b4030 con 0x5612cf5bf6f0 2024-04-26T18:36:13.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.487+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/3990340243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bf6f0 msgr2=0x5612cf5e3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:13.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.487+0000 7f7f28a9cb80 1 --2- 172.21.15.80:0/3990340243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bf6f0 0x5612cf5e3470 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c00c8f0 tx=0x7f7f0c004f70 comp rx=0 tx=0).stop 2024-04-26T18:36:13.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.487+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/3990340243 shutdown_connections 2024-04-26T18:36:13.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.487+0000 7f7f28a9cb80 1 --2- 172.21.15.80:0/3990340243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612cf5c4a20 0x5612cf5e39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.487+0000 7f7f28a9cb80 1 --2- 172.21.15.80:0/3990340243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5612cf5bed50 0x5612cf5c8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.487+0000 7f7f28a9cb80 1 --2- 172.21.15.80:0/3990340243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bf6f0 0x5612cf5e3470 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.487+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/3990340243 >> 172.21.15.80:0/3990340243 conn(0x5612cf4ed570 msgr2=0x5612cf5b97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:13.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.488+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/3990340243 shutdown_connections 2024-04-26T18:36:13.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.488+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/3990340243 wait complete. 2024-04-26T18:36:13.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.488+0000 7f7f28a9cb80 1 -- start start 2024-04-26T18:36:13.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.488+0000 7f7f28a9cb80 1 Processor -- start 2024-04-26T18:36:13.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.488+0000 7f7f28a9cb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bed50 0x5612cf637ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:13.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.488+0000 7f7f28a9cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612cf5bf6f0 0x5612cf638530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:13.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.488+0000 7f7f28a9cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5612cf5c4a20 0x5612cf5df750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:13.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.488+0000 7f7f28a9cb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5612cf5d9e80 con 0x5612cf5bed50 2024-04-26T18:36:13.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.488+0000 7f7f28a9cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5612cf5d97b0 con 0x5612cf5bf6f0 2024-04-26T18:36:13.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.488+0000 7f7f28a9cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5612cf5da550 con 0x5612cf5c4a20 2024-04-26T18:36:13.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.488+0000 7f7f28a9cb80 10 client.0 _ll_register_callbacks cb 0x5612cf4a9900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:36:13.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.488+0000 7f7f177fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bed50 0x5612cf637ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:13.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.488+0000 7f7f177fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bed50 0x5612cf637ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51156/0 (socket says 172.21.15.80:51156) 2024-04-26T18:36:13.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.488+0000 7f7f177fe700 1 -- 172.21.15.80:0/720644243 learned_addr learned my addr 172.21.15.80:0/720644243 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:13.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.489+0000 7f7f16ffd700 1 --2- 172.21.15.80:0/720644243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612cf5bf6f0 0x5612cf638530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:13.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.489+0000 7f7f17fff700 1 --2- 172.21.15.80:0/720644243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5612cf5c4a20 0x5612cf5df750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:13.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.489+0000 7f7f177fe700 1 -- 172.21.15.80:0/720644243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5612cf5c4a20 msgr2=0x5612cf5df750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:13.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.489+0000 7f7f177fe700 1 --2- 172.21.15.80:0/720644243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5612cf5c4a20 0x5612cf5df750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.489+0000 7f7f177fe700 1 -- 172.21.15.80:0/720644243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612cf5bf6f0 msgr2=0x5612cf638530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:13.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.489+0000 7f7f177fe700 1 --2- 172.21.15.80:0/720644243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612cf5bf6f0 0x5612cf638530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.489+0000 7f7f177fe700 1 -- 172.21.15.80:0/720644243 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612cf5dff90 con 0x5612cf5bed50 2024-04-26T18:36:13.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.489+0000 7f7f177fe700 1 --2- 172.21.15.80:0/720644243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bed50 0x5612cf637ff0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7f080098e0 tx=0x7f7f08009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b27931cd9f1c9b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:13.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.489+0000 7f7ef6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:36:13.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.489+0000 7f7ef6ffd700 1 -- 172.21.15.80:0/720644243 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0803f070 con 0x5612cf5bed50 2024-04-26T18:36:13.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.489+0000 7f7ef6ffd700 1 -- 172.21.15.80:0/720644243 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f7f0800fc50 con 0x5612cf5bed50 2024-04-26T18:36:13.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.489+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/720644243 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f0c09a280 con 0x5612cf5bed50 2024-04-26T18:36:13.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.489+0000 7f7ef6ffd700 1 -- 172.21.15.80:0/720644243 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7f0804b050 con 0x5612cf5bed50 2024-04-26T18:36:13.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.489+0000 7f7f28a9cb80 10 client.15135 fetch_fsmap learned FSMap version 26 2024-04-26T18:36:13.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.489+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/720644243 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5612cf6408d0 con 0x5612cf5bed50 2024-04-26T18:36:13.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.489+0000 7f7ef6ffd700 1 -- 172.21.15.80:0/720644243 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f0c09a280 con 0x5612cf5bed50 2024-04-26T18:36:13.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.490+0000 7f7ef6ffd700 1 -- 172.21.15.80:0/720644243 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f7f080177a0 con 0x5612cf5bed50 2024-04-26T18:36:13.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.490+0000 7f7f28a9cb80 10 client.15135 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:36:13.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.490+0000 7f7f28a9cb80 10 client.15135 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-26T18:36:13.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.490+0000 7f7f28a9cb80 20 client.15135 populate_metadata read hostname 'smithi080' 2024-04-26T18:36:13.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.490+0000 7f7f28a9cb80 1 --2- 172.21.15.80:0/720644243 >> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] conn(0x5612cf6453b0 0x5612cf6440c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:13.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.490+0000 7f7f28a9cb80 4 client.15135 mds_command: new command op to 24404 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T18:36:13.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.490+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/720644243 --> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] -- command(tid 0: {"prefix": "status"}) -- 0x5612cf519260 con 0x5612cf6453b0 2024-04-26T18:36:13.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.490+0000 7f7f16ffd700 1 --2- 172.21.15.80:0/720644243 >> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] conn(0x5612cf6453b0 0x5612cf6440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:13.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.490+0000 7f7ef6ffd700 10 client.15135 ms_handle_connect on v2:172.21.15.82:6836/2084055551 2024-04-26T18:36:13.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.490+0000 7f7f16ffd700 1 --2- 172.21.15.80:0/720644243 >> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] conn(0x5612cf6453b0 0x5612cf6440c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e3c9edaead02bbbb server_cookie=7caf7c465753c805 in_seq=0 out_seq=0 2024-04-26T18:36:13.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.490+0000 7f7ef6ffd700 1 -- 172.21.15.80:0/720644243 <== mds.2 v2:172.21.15.82:6836/2084055551 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x5612cf519260 con 0x5612cf6453b0 2024-04-26T18:36:13.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.490+0000 7f7ef6ffd700 10 client.15135 handle_command_reply: tid=0 2024-04-26T18:36:13.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.490+0000 7f7f28a9cb80 1 client.15135 shutdown 2024-04-26T18:36:13.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.491+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/720644243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bed50 msgr2=0x5612cf637ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:13.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.491+0000 7f7f28a9cb80 1 --2- 172.21.15.80:0/720644243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bed50 0x5612cf637ff0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7f080098e0 tx=0x7f7f08009f60 comp rx=0 tx=0).stop 2024-04-26T18:36:13.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.491+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/720644243 shutdown_connections 2024-04-26T18:36:13.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.491+0000 7f7f28a9cb80 1 --2- 172.21.15.80:0/720644243 >> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] conn(0x5612cf6453b0 0x5612cf6440c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.491+0000 7f7f28a9cb80 1 --2- 172.21.15.80:0/720644243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5612cf5c4a20 0x5612cf5df750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.491+0000 7f7f28a9cb80 1 --2- 172.21.15.80:0/720644243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612cf5bed50 0x5612cf637ff0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.491+0000 7f7ef6ffd700 0 client.15135 ms_handle_reset on v2:172.21.15.82:6836/2084055551 2024-04-26T18:36:13.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.491+0000 7f7f28a9cb80 1 --2- 172.21.15.80:0/720644243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612cf5bf6f0 0x5612cf638530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.491+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/720644243 >> 172.21.15.80:0/720644243 conn(0x5612cf4ed570 msgr2=0x5612cf5b9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:13.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.491+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/720644243 shutdown_connections 2024-04-26T18:36:13.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.491+0000 7f7f28a9cb80 1 -- 172.21.15.80:0/720644243 wait complete. 2024-04-26T18:36:13.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.491+0000 7f7f28a9cb80 20 client.15135 trim_cache size 0 max 16384 2024-04-26T18:36:13.499 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:36:13.499 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "2187ca98-03fa-11ef-bc93-c7b262605968", 2024-04-26T18:36:13.499 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 2, 2024-04-26T18:36:13.499 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24404, 2024-04-26T18:36:13.499 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-26T18:36:13.499 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-26T18:36:13.500 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-26T18:36:13.500 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 171.844437965, 2024-04-26T18:36:13.500 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 26, 2024-04-26T18:36:13.500 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 91, 2024-04-26T18:36:13.500 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T18:36:13.500 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 214.893640715 2024-04-26T18:36:13.500 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:36:13.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.491+0000 7f7f1e20a700 1 -- 172.21.15.80:0/407230672 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f7f000a3c40 msgr2=0x7f7f000a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:13.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.491+0000 7f7f1e20a700 1 --2- 172.21.15.80:0/407230672 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f7f000a3c40 0x7f7f000a6100 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7f0800b5c0 tx=0x7f7f08005960 comp rx=0 tx=0).stop 2024-04-26T18:36:13.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.491+0000 7f7f1e20a700 1 -- 172.21.15.80:0/407230672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f18075f70 msgr2=0x7f7f181a0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:13.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.491+0000 7f7f1e20a700 1 --2- 172.21.15.80:0/407230672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f18075f70 0x7f7f181a0670 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c00c920 tx=0x7f7f0c00cc30 comp rx=0 tx=0).stop 2024-04-26T18:36:13.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.491+0000 7f7f1e20a700 1 -- 172.21.15.80:0/407230672 shutdown_connections 2024-04-26T18:36:13.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.491+0000 7f7f1e20a700 1 --2- 172.21.15.80:0/407230672 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f7f000a3c40 0x7f7f000a6100 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.491+0000 7f7f1e20a700 1 --2- 172.21.15.80:0/407230672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f181145f0 0x7f7f181a4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.491+0000 7f7f1e20a700 1 --2- 172.21.15.80:0/407230672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f18075650 0x7f7f181a0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.491+0000 7f7f1e20a700 1 --2- 172.21.15.80:0/407230672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f18075f70 0x7f7f181a0670 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:13.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.491+0000 7f7f1e20a700 1 -- 172.21.15.80:0/407230672 >> 172.21.15.80:0/407230672 conn(0x7f7f1807a580 msgr2=0x7f7f18110090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:13.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.492+0000 7f7f1e20a700 1 -- 172.21.15.80:0/407230672 shutdown_connections 2024-04-26T18:36:13.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:13.492+0000 7f7f1e20a700 1 -- 172.21.15.80:0/407230672 wait complete. 2024-04-26T18:36:14.184 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:14 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:36:14.185 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:14 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:36:14.185 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:14 smithi080 ceph-mon[29135]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:36:14.212 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell mds.i status 2024-04-26T18:36:14.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:14 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:36:14.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:14 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:36:14.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:14 smithi192 ceph-mon[32842]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:36:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:36:14.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:14 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:36:14.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:14 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:36:14.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:14 smithi082 ceph-mon[32808]: from='mgr.14148 172.21.15.80:0/335582719' entity='mgr.x' 2024-04-26T18:36:15.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:15 smithi080 ceph-mon[29135]: pgmap v393: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:36:15.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:15 smithi192 ceph-mon[32842]: pgmap v393: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:36:15.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:15 smithi082 ceph-mon[32808]: pgmap v393: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:36:16.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.171+0000 7fc39d103700 1 -- 172.21.15.80:0/3552353358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3981094b0 msgr2=0x7fc398109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:16.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.171+0000 7fc39d103700 1 --2- 172.21.15.80:0/3552353358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3981094b0 0x7fc398109890 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc38c009990 tx=0x7fc38c009ca0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.171+0000 7fc39d103700 1 -- 172.21.15.80:0/3552353358 shutdown_connections 2024-04-26T18:36:16.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.171+0000 7fc39d103700 1 --2- 172.21.15.80:0/3552353358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc398102330 0x7fc3981102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.171+0000 7fc39d103700 1 --2- 172.21.15.80:0/3552353358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3981094b0 0x7fc398109890 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.171+0000 7fc39d103700 1 --2- 172.21.15.80:0/3552353358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc398101970 0x7fc398101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.171+0000 7fc39d103700 1 -- 172.21.15.80:0/3552353358 >> 172.21.15.80:0/3552353358 conn(0x7fc398078920 msgr2=0x7fc3980ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:16.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.171+0000 7fc39d103700 1 -- 172.21.15.80:0/3552353358 shutdown_connections 2024-04-26T18:36:16.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.171+0000 7fc39d103700 1 -- 172.21.15.80:0/3552353358 wait complete. 2024-04-26T18:36:16.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.172+0000 7fc39d103700 1 Processor -- start 2024-04-26T18:36:16.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.172+0000 7fc39d103700 1 -- start start 2024-04-26T18:36:16.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.172+0000 7fc39d103700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc398101970 0x7fc39819f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:16.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.172+0000 7fc39d103700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc398102330 0x7fc39819fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:16.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.172+0000 7fc39d103700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3981094b0 0x7fc3981997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:16.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.173+0000 7fc39d103700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc3981135c0 con 0x7fc398102330 2024-04-26T18:36:16.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.173+0000 7fc39d103700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc398113440 con 0x7fc398101970 2024-04-26T18:36:16.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.173+0000 7fc39d103700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc398113740 con 0x7fc3981094b0 2024-04-26T18:36:16.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.173+0000 7fc39659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc398102330 0x7fc39819fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:16.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.173+0000 7fc39659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc398102330 0x7fc39819fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51172/0 (socket says 172.21.15.80:51172) 2024-04-26T18:36:16.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.173+0000 7fc39659c700 1 -- 172.21.15.80:0/763177570 learned_addr learned my addr 172.21.15.80:0/763177570 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:16.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.173+0000 7fc396d9d700 1 --2- 172.21.15.80:0/763177570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc398101970 0x7fc39819f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:16.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.173+0000 7fc39759e700 1 --2- 172.21.15.80:0/763177570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3981094b0 0x7fc3981997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:16.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.173+0000 7fc39659c700 1 -- 172.21.15.80:0/763177570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3981094b0 msgr2=0x7fc3981997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:16.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.173+0000 7fc39659c700 1 --2- 172.21.15.80:0/763177570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3981094b0 0x7fc3981997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.173+0000 7fc39659c700 1 -- 172.21.15.80:0/763177570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc398101970 msgr2=0x7fc39819f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:16.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.173+0000 7fc39659c700 1 --2- 172.21.15.80:0/763177570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc398101970 0x7fc39819f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.173+0000 7fc39659c700 1 -- 172.21.15.80:0/763177570 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc398199fc0 con 0x7fc398102330 2024-04-26T18:36:16.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.173+0000 7fc39759e700 1 --2- 172.21.15.80:0/763177570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3981094b0 0x7fc3981997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:36:16.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.173+0000 7fc39659c700 1 --2- 172.21.15.80:0/763177570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc398102330 0x7fc39819fba0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc38800c9b0 tx=0x7fc38800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:16.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.173+0000 7fc37ffff700 1 -- 172.21.15.80:0/763177570 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc388007b00 con 0x7fc398102330 2024-04-26T18:36:16.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.173+0000 7fc39d103700 1 -- 172.21.15.80:0/763177570 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc39819a2b0 con 0x7fc398102330 2024-04-26T18:36:16.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.173+0000 7fc37ffff700 1 -- 172.21.15.80:0/763177570 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc388007ca0 con 0x7fc398102330 2024-04-26T18:36:16.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.173+0000 7fc37ffff700 1 -- 172.21.15.80:0/763177570 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc388018660 con 0x7fc398102330 2024-04-26T18:36:16.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.173+0000 7fc39d103700 1 -- 172.21.15.80:0/763177570 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3981a64c0 con 0x7fc398102330 2024-04-26T18:36:16.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.175+0000 7fc37ffff700 1 -- 172.21.15.80:0/763177570 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fc38800f450 con 0x7fc398102330 2024-04-26T18:36:16.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.176+0000 7fc37ffff700 1 --2- 172.21.15.80:0/763177570 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fc3800a3c40 0x7fc3800a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:16.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.176+0000 7fc396d9d700 1 --2- 172.21.15.80:0/763177570 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fc3800a3c40 0x7fc3800a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:16.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.176+0000 7fc37ffff700 1 -- 172.21.15.80:0/763177570 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fc3880d0390 con 0x7fc398102330 2024-04-26T18:36:16.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.176+0000 7fc396d9d700 1 --2- 172.21.15.80:0/763177570 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fc3800a3c40 0x7fc3800a6100 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc38c0098e0 tx=0x7fc38c005960 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:16.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.177+0000 7fc3a7995b80 1 Processor -- start 2024-04-26T18:36:16.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.177+0000 7fc3a7995b80 1 -- start start 2024-04-26T18:36:16.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.177+0000 7fc3a7995b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566100e4a20 0x5566100e4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.177+0000 7fc3a7995b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566100ded50 0x5566100df1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.177+0000 7fc3a7995b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100df6f0 0x5566100eb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.177+0000 7fc3a7995b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5566100317e0 con 0x5566100df6f0 2024-04-26T18:36:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.177+0000 7fc3a7995b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55660ff978e0 con 0x5566100e4a20 2024-04-26T18:36:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.177+0000 7fc3a7995b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55661002d7a0 con 0x5566100ded50 2024-04-26T18:36:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.177+0000 7fc39759e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100df6f0 0x5566100eb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.177+0000 7fc39759e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100df6f0 0x5566100eb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51178/0 (socket says 172.21.15.80:51178) 2024-04-26T18:36:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.177+0000 7fc39759e700 1 -- 172.21.15.80:0/672232494 learned_addr learned my addr 172.21.15.80:0/672232494 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.177+0000 7fc39659c700 1 --2- 172.21.15.80:0/672232494 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566100ded50 0x5566100df1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.177+0000 7fc396d9d700 1 --2- 172.21.15.80:0/672232494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566100e4a20 0x5566100e4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.178+0000 7fc39759e700 1 -- 172.21.15.80:0/672232494 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566100ded50 msgr2=0x5566100df1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.178+0000 7fc39759e700 1 --2- 172.21.15.80:0/672232494 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566100ded50 0x5566100df1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.178+0000 7fc39759e700 1 -- 172.21.15.80:0/672232494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566100e4a20 msgr2=0x5566100e4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:16.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.178+0000 7fc39759e700 1 --2- 172.21.15.80:0/672232494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566100e4a20 0x5566100e4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.178+0000 7fc39759e700 1 -- 172.21.15.80:0/672232494 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55660ff7e880 con 0x5566100df6f0 2024-04-26T18:36:16.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.178+0000 7fc396d9d700 1 --2- 172.21.15.80:0/672232494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566100e4a20 0x5566100e4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:36:16.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.178+0000 7fc39659c700 1 --2- 172.21.15.80:0/672232494 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566100ded50 0x5566100df1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:36:16.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.178+0000 7fc39759e700 1 --2- 172.21.15.80:0/672232494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100df6f0 0x5566100eb770 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc39000e160 tx=0x7fc39000e470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7d47fd8e0eec38 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:16.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.178+0000 7fc37d7fa700 1 -- 172.21.15.80:0/672232494 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39000edb0 con 0x5566100df6f0 2024-04-26T18:36:16.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.178+0000 7fc37d7fa700 1 -- 172.21.15.80:0/672232494 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc390004bb0 con 0x5566100df6f0 2024-04-26T18:36:16.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.178+0000 7fc37d7fa700 1 -- 172.21.15.80:0/672232494 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc390004400 con 0x5566100df6f0 2024-04-26T18:36:16.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.179+0000 7fc3a7995b80 1 -- 172.21.15.80:0/672232494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100df6f0 msgr2=0x5566100eb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:16.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.179+0000 7fc3a7995b80 1 --2- 172.21.15.80:0/672232494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100df6f0 0x5566100eb770 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc39000e160 tx=0x7fc39000e470 comp rx=0 tx=0).stop 2024-04-26T18:36:16.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.179+0000 7fc3a7995b80 1 -- 172.21.15.80:0/672232494 shutdown_connections 2024-04-26T18:36:16.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.179+0000 7fc3a7995b80 1 --2- 172.21.15.80:0/672232494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100df6f0 0x5566100eb770 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.179+0000 7fc3a7995b80 1 --2- 172.21.15.80:0/672232494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566100e4a20 0x5566100e4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.179+0000 7fc3a7995b80 1 --2- 172.21.15.80:0/672232494 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566100ded50 0x5566100df1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.179+0000 7fc3a7995b80 1 -- 172.21.15.80:0/672232494 >> 172.21.15.80:0/672232494 conn(0x55661000d570 msgr2=0x5566100d9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.179+0000 7fc3a7995b80 1 -- 172.21.15.80:0/672232494 shutdown_connections 2024-04-26T18:36:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.179+0000 7fc3a7995b80 1 -- 172.21.15.80:0/672232494 wait complete. 2024-04-26T18:36:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.179+0000 7fc3a7995b80 1 -- start start 2024-04-26T18:36:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.179+0000 7fc3a7995b80 1 Processor -- start 2024-04-26T18:36:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.180+0000 7fc3a7995b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566100ded50 0x5566100eb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.180+0000 7fc3a7995b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566100df6f0 0x5566100e8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.180+0000 7fc3a7995b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100e4a20 0x5566100e8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.180+0000 7fc3a7995b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5566100ebcb0 con 0x5566100e4a20 2024-04-26T18:36:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.180+0000 7fc3a7995b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55660ffeba30 con 0x5566100df6f0 2024-04-26T18:36:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.180+0000 7fc3a7995b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5566100ebe30 con 0x5566100ded50 2024-04-26T18:36:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.180+0000 7fc3a7995b80 10 client.0 _ll_register_callbacks cb 0x55660ffc9900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:36:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.180+0000 7fc39759e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100e4a20 0x5566100e8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.180+0000 7fc39759e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100e4a20 0x5566100e8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51188/0 (socket says 172.21.15.80:51188) 2024-04-26T18:36:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.180+0000 7fc39759e700 1 -- 172.21.15.80:0/1423325360 learned_addr learned my addr 172.21.15.80:0/1423325360 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.180+0000 7fc396d9d700 1 --2- 172.21.15.80:0/1423325360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566100ded50 0x5566100eb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.180+0000 7fc39659c700 1 --2- 172.21.15.80:0/1423325360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566100df6f0 0x5566100e8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.180+0000 7fc39759e700 1 -- 172.21.15.80:0/1423325360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566100ded50 msgr2=0x5566100eb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.180+0000 7fc39759e700 1 --2- 172.21.15.80:0/1423325360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566100ded50 0x5566100eb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.180+0000 7fc39759e700 1 -- 172.21.15.80:0/1423325360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566100df6f0 msgr2=0x5566100e8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.180+0000 7fc39759e700 1 --2- 172.21.15.80:0/1423325360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566100df6f0 0x5566100e8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.180+0000 7fc39759e700 1 -- 172.21.15.80:0/1423325360 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55660ffef430 con 0x5566100e4a20 2024-04-26T18:36:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.180+0000 7fc396d9d700 1 --2- 172.21.15.80:0/1423325360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566100ded50 0x5566100eb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:36:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.180+0000 7fc39759e700 1 --2- 172.21.15.80:0/1423325360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100e4a20 0x5566100e8bc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc390007cb0 tx=0x7fc390007880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687ecca517614a20 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.180+0000 7fc37aff5700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:36:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.180+0000 7fc37aff5700 1 -- 172.21.15.80:0/1423325360 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc390023020 con 0x5566100e4a20 2024-04-26T18:36:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.180+0000 7fc37aff5700 1 -- 172.21.15.80:0/1423325360 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fc390010040 con 0x5566100e4a20 2024-04-26T18:36:16.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.180+0000 7fc3a7995b80 1 -- 172.21.15.80:0/1423325360 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc390004bb0 con 0x5566100e4a20 2024-04-26T18:36:16.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.180+0000 7fc37aff5700 1 -- 172.21.15.80:0/1423325360 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc390004200 con 0x5566100e4a20 2024-04-26T18:36:16.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.181+0000 7fc3a7995b80 10 client.15147 fetch_fsmap learned FSMap version 26 2024-04-26T18:36:16.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.181+0000 7fc3a7995b80 1 -- 172.21.15.80:0/1423325360 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5566100f63a0 con 0x5566100e4a20 2024-04-26T18:36:16.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.181+0000 7fc37aff5700 1 -- 172.21.15.80:0/1423325360 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc390004bb0 con 0x5566100e4a20 2024-04-26T18:36:16.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.181+0000 7fc37aff5700 1 -- 172.21.15.80:0/1423325360 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fc390014ac0 con 0x5566100e4a20 2024-04-26T18:36:16.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.181+0000 7fc3a7995b80 10 client.15147 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:36:16.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.181+0000 7fc3a7995b80 10 client.15147 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T18:36:16.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.181+0000 7fc3a7995b80 20 client.15147 populate_metadata read hostname 'smithi080' 2024-04-26T18:36:16.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.181+0000 7fc3a7995b80 1 --2- 172.21.15.80:0/1423325360 >> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] conn(0x5566100f8630 0x5566100f9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:16.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.181+0000 7fc3a7995b80 4 client.15147 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:36:16.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.181+0000 7fc3a7995b80 1 -- 172.21.15.80:0/1423325360 --> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55661003f1c0 con 0x5566100f8630 2024-04-26T18:36:16.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.181+0000 7fc396d9d700 1 --2- 172.21.15.80:0/1423325360 >> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] conn(0x5566100f8630 0x5566100f9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:16.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.182+0000 7fc396d9d700 1 --2- 172.21.15.80:0/1423325360 >> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] conn(0x5566100f8630 0x5566100f9aa0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1383a73a02a15a6f server_cookie=892be7f51e65c411 in_seq=0 out_seq=0 2024-04-26T18:36:16.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.182+0000 7fc37aff5700 10 client.15147 ms_handle_connect on v2:172.21.15.192:6838/2735406056 2024-04-26T18:36:16.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.182+0000 7fc37aff5700 1 -- 172.21.15.80:0/1423325360 <== mds.1 v2:172.21.15.192:6838/2735406056 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55661003f1c0 con 0x5566100f8630 2024-04-26T18:36:16.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.182+0000 7fc37aff5700 10 client.15147 handle_command_reply: tid=0 2024-04-26T18:36:16.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.182+0000 7fc3a7995b80 1 client.15147 shutdown 2024-04-26T18:36:16.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.183+0000 7fc3a7995b80 1 -- 172.21.15.80:0/1423325360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100e4a20 msgr2=0x5566100e8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:16.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.183+0000 7fc3a7995b80 1 --2- 172.21.15.80:0/1423325360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100e4a20 0x5566100e8bc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc390007cb0 tx=0x7fc390007880 comp rx=0 tx=0).stop 2024-04-26T18:36:16.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.183+0000 7fc3a7995b80 1 -- 172.21.15.80:0/1423325360 shutdown_connections 2024-04-26T18:36:16.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.183+0000 7fc3a7995b80 1 --2- 172.21.15.80:0/1423325360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100e4a20 0x5566100e8bc0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.183+0000 7fc3a7995b80 1 --2- 172.21.15.80:0/1423325360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566100ded50 0x5566100eb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.183+0000 7fc3a7995b80 1 --2- 172.21.15.80:0/1423325360 >> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] conn(0x5566100f8630 0x5566100f9aa0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.183+0000 7fc3a7995b80 1 --2- 172.21.15.80:0/1423325360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566100df6f0 0x5566100e8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.183+0000 7fc3a7995b80 1 -- 172.21.15.80:0/1423325360 >> 172.21.15.80:0/1423325360 conn(0x55661000d570 msgr2=0x5566100ddd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:16.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.183+0000 7fc37aff5700 0 client.15147 ms_handle_reset on v2:172.21.15.192:6838/2735406056 2024-04-26T18:36:16.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.183+0000 7fc3a7995b80 1 -- 172.21.15.80:0/1423325360 shutdown_connections 2024-04-26T18:36:16.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.183+0000 7fc3a7995b80 1 -- 172.21.15.80:0/1423325360 wait complete. 2024-04-26T18:36:16.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.183+0000 7fc3a7995b80 20 client.15147 trim_cache size 0 max 16384 2024-04-26T18:36:16.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.202+0000 7fc3a7995b80 1 Processor -- start 2024-04-26T18:36:16.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.203+0000 7fc3a7995b80 1 -- start start 2024-04-26T18:36:16.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.203+0000 7fc3a7995b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100ded50 0x5566100d42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:16.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.203+0000 7fc3a7995b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566100df6f0 0x5566100e6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:16.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.203+0000 7fc3a7995b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566100e4a20 0x5566100e74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:16.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.203+0000 7fc3a7995b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5566100f7de0 con 0x5566100ded50 2024-04-26T18:36:16.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.203+0000 7fc3a7995b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5566100f84b0 con 0x5566100df6f0 2024-04-26T18:36:16.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.203+0000 7fc3a7995b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5566100f8b80 con 0x5566100e4a20 2024-04-26T18:36:16.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.203+0000 7fc396d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100ded50 0x5566100d42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:16.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.203+0000 7fc396d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100ded50 0x5566100d42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51202/0 (socket says 172.21.15.80:51202) 2024-04-26T18:36:16.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.203+0000 7fc396d9d700 1 -- 172.21.15.80:0/1546083039 learned_addr learned my addr 172.21.15.80:0/1546083039 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:16.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.203+0000 7fc39659c700 1 --2- 172.21.15.80:0/1546083039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566100df6f0 0x5566100e6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:16.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.203+0000 7fc396d9d700 1 -- 172.21.15.80:0/1546083039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566100e4a20 msgr2=0x5566100e74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:16.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.203+0000 7fc396d9d700 1 --2- 172.21.15.80:0/1546083039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566100e4a20 0x5566100e74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.203+0000 7fc396d9d700 1 -- 172.21.15.80:0/1546083039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566100df6f0 msgr2=0x5566100e6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:16.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.203+0000 7fc396d9d700 1 --2- 172.21.15.80:0/1546083039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566100df6f0 0x5566100e6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.203+0000 7fc396d9d700 1 -- 172.21.15.80:0/1546083039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566100f9070 con 0x5566100ded50 2024-04-26T18:36:16.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.203+0000 7fc396d9d700 1 --2- 172.21.15.80:0/1546083039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100ded50 0x5566100d42b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc38c005b40 tx=0x7fc38c024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e74eca0030e70a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:16.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.203+0000 7fc37cff9700 1 -- 172.21.15.80:0/1546083039 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c024a60 con 0x5566100ded50 2024-04-26T18:36:16.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.203+0000 7fc37cff9700 1 -- 172.21.15.80:0/1546083039 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc38c039070 con 0x5566100ded50 2024-04-26T18:36:16.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.203+0000 7fc37cff9700 1 -- 172.21.15.80:0/1546083039 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c00f6c0 con 0x5566100ded50 2024-04-26T18:36:16.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.204+0000 7fc3a7995b80 1 -- 172.21.15.80:0/1546083039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100ded50 msgr2=0x5566100d42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:16.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.204+0000 7fc3a7995b80 1 --2- 172.21.15.80:0/1546083039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100ded50 0x5566100d42b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc38c005b40 tx=0x7fc38c024000 comp rx=0 tx=0).stop 2024-04-26T18:36:16.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.204+0000 7fc3a7995b80 1 -- 172.21.15.80:0/1546083039 shutdown_connections 2024-04-26T18:36:16.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.204+0000 7fc3a7995b80 1 --2- 172.21.15.80:0/1546083039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566100e4a20 0x5566100e74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.204+0000 7fc3a7995b80 1 --2- 172.21.15.80:0/1546083039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100ded50 0x5566100d42b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.204+0000 7fc3a7995b80 1 --2- 172.21.15.80:0/1546083039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566100df6f0 0x5566100e6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.204+0000 7fc3a7995b80 1 -- 172.21.15.80:0/1546083039 >> 172.21.15.80:0/1546083039 conn(0x55661000d570 msgr2=0x5566100d94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:16.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.204+0000 7fc3a7995b80 1 -- 172.21.15.80:0/1546083039 shutdown_connections 2024-04-26T18:36:16.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.204+0000 7fc3a7995b80 1 -- 172.21.15.80:0/1546083039 wait complete. 2024-04-26T18:36:16.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.204+0000 7fc3a7995b80 1 -- start start 2024-04-26T18:36:16.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.204+0000 7fc3a7995b80 1 Processor -- start 2024-04-26T18:36:16.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.205+0000 7fc3a7995b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566100ded50 0x556610102f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:16.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.205+0000 7fc3a7995b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566100df6f0 0x556610103450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:16.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.205+0000 7fc3a7995b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100e4a20 0x5566100e33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:16.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.205+0000 7fc3a7995b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5566100f9920 con 0x5566100e4a20 2024-04-26T18:36:16.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.205+0000 7fc3a7995b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5566100f9250 con 0x5566100ded50 2024-04-26T18:36:16.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.205+0000 7fc3a7995b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5566100f9ff0 con 0x5566100df6f0 2024-04-26T18:36:16.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.205+0000 7fc3a7995b80 10 client.0 _ll_register_callbacks cb 0x55660ffc9900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:36:16.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.205+0000 7fc39759e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100e4a20 0x5566100e33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:16.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.205+0000 7fc39759e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100e4a20 0x5566100e33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51204/0 (socket says 172.21.15.80:51204) 2024-04-26T18:36:16.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.205+0000 7fc39759e700 1 -- 172.21.15.80:0/2722618220 learned_addr learned my addr 172.21.15.80:0/2722618220 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:16.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.205+0000 7fc396d9d700 1 --2- 172.21.15.80:0/2722618220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566100ded50 0x556610102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:16.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.205+0000 7fc39659c700 1 --2- 172.21.15.80:0/2722618220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566100df6f0 0x556610103450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:16.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.205+0000 7fc39759e700 1 -- 172.21.15.80:0/2722618220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566100df6f0 msgr2=0x556610103450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:16.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.205+0000 7fc39759e700 1 --2- 172.21.15.80:0/2722618220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566100df6f0 0x556610103450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.205+0000 7fc39759e700 1 -- 172.21.15.80:0/2722618220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566100ded50 msgr2=0x556610102f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:16.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.205+0000 7fc39759e700 1 --2- 172.21.15.80:0/2722618220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566100ded50 0x556610102f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.205+0000 7fc39759e700 1 -- 172.21.15.80:0/2722618220 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566100e3910 con 0x5566100e4a20 2024-04-26T18:36:16.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.205+0000 7fc39759e700 1 --2- 172.21.15.80:0/2722618220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100e4a20 0x5566100e33d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc3900074e0 tx=0x7fc390005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c69e2e5c5e9986 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:16.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.205+0000 7fc37aff5700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:36:16.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.205+0000 7fc37aff5700 1 -- 172.21.15.80:0/2722618220 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc390023070 con 0x5566100e4a20 2024-04-26T18:36:16.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.205+0000 7fc37aff5700 1 -- 172.21.15.80:0/2722618220 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fc390019040 con 0x5566100e4a20 2024-04-26T18:36:16.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.205+0000 7fc3a7995b80 1 -- 172.21.15.80:0/2722618220 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc38c039070 con 0x5566100e4a20 2024-04-26T18:36:16.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.206+0000 7fc37aff5700 1 -- 172.21.15.80:0/2722618220 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc390003be0 con 0x5566100e4a20 2024-04-26T18:36:16.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.206+0000 7fc3a7995b80 10 client.15153 fetch_fsmap learned FSMap version 26 2024-04-26T18:36:16.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.206+0000 7fc3a7995b80 1 -- 172.21.15.80:0/2722618220 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55661015fee0 con 0x5566100e4a20 2024-04-26T18:36:16.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.206+0000 7fc37aff5700 1 -- 172.21.15.80:0/2722618220 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc38c039070 con 0x5566100e4a20 2024-04-26T18:36:16.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.206+0000 7fc37aff5700 1 -- 172.21.15.80:0/2722618220 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fc3900058d0 con 0x5566100e4a20 2024-04-26T18:36:16.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.206+0000 7fc3a7995b80 10 client.15153 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:36:16.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.206+0000 7fc3a7995b80 10 client.15153 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T18:36:16.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.206+0000 7fc3a7995b80 20 client.15153 populate_metadata read hostname 'smithi080' 2024-04-26T18:36:16.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.206+0000 7fc3a7995b80 1 --2- 172.21.15.80:0/2722618220 >> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] conn(0x5566101649c0 0x5566101636d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:16.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.206+0000 7fc3a7995b80 4 client.15153 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T18:36:16.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.206+0000 7fc3a7995b80 1 -- 172.21.15.80:0/2722618220 --> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] -- command(tid 0: {"prefix": "status"}) -- 0x556610039260 con 0x5566101649c0 2024-04-26T18:36:16.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.206+0000 7fc396d9d700 1 --2- 172.21.15.80:0/2722618220 >> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] conn(0x5566101649c0 0x5566101636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:16.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.207+0000 7fc37aff5700 10 client.15153 ms_handle_connect on v2:172.21.15.192:6838/2735406056 2024-04-26T18:36:16.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.207+0000 7fc396d9d700 1 --2- 172.21.15.80:0/2722618220 >> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] conn(0x5566101649c0 0x5566101636d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b5610f5e18ee5269 server_cookie=705bdb9d7bf0cf86 in_seq=0 out_seq=0 2024-04-26T18:36:16.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.207+0000 7fc37aff5700 1 -- 172.21.15.80:0/2722618220 <== mds.1 v2:172.21.15.192:6838/2735406056 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x556610039260 con 0x5566101649c0 2024-04-26T18:36:16.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.207+0000 7fc37aff5700 10 client.15153 handle_command_reply: tid=0 2024-04-26T18:36:16.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.207+0000 7fc3a7995b80 1 client.15153 shutdown 2024-04-26T18:36:16.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.207+0000 7fc3a7995b80 1 -- 172.21.15.80:0/2722618220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100e4a20 msgr2=0x5566100e33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:16.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.207+0000 7fc3a7995b80 1 --2- 172.21.15.80:0/2722618220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100e4a20 0x5566100e33d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc3900074e0 tx=0x7fc390005f10 comp rx=0 tx=0).stop 2024-04-26T18:36:16.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.207+0000 7fc3a7995b80 1 -- 172.21.15.80:0/2722618220 shutdown_connections 2024-04-26T18:36:16.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.207+0000 7fc3a7995b80 1 --2- 172.21.15.80:0/2722618220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5566100e4a20 0x5566100e33d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.207+0000 7fc3a7995b80 1 --2- 172.21.15.80:0/2722618220 >> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] conn(0x5566101649c0 0x5566101636d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.207+0000 7fc3a7995b80 1 --2- 172.21.15.80:0/2722618220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566100ded50 0x556610102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.207+0000 7fc3a7995b80 1 --2- 172.21.15.80:0/2722618220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566100df6f0 0x556610103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.207+0000 7fc3a7995b80 1 -- 172.21.15.80:0/2722618220 >> 172.21.15.80:0/2722618220 conn(0x55661000d570 msgr2=0x5566100ddd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:16.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.207+0000 7fc37aff5700 0 client.15153 ms_handle_reset on v2:172.21.15.192:6838/2735406056 2024-04-26T18:36:16.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.207+0000 7fc3a7995b80 1 -- 172.21.15.80:0/2722618220 shutdown_connections 2024-04-26T18:36:16.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.207+0000 7fc3a7995b80 1 -- 172.21.15.80:0/2722618220 wait complete. 2024-04-26T18:36:16.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.207+0000 7fc3a7995b80 20 client.15153 trim_cache size 0 max 16384 2024-04-26T18:36:16.213 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:36:16.213 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "2187ca98-03fa-11ef-bc93-c7b262605968", 2024-04-26T18:36:16.214 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 1, 2024-04-26T18:36:16.214 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24421, 2024-04-26T18:36:16.214 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-26T18:36:16.214 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-26T18:36:16.214 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-26T18:36:16.214 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 175.56555819799999, 2024-04-26T18:36:16.214 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 26, 2024-04-26T18:36:16.214 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 91, 2024-04-26T18:36:16.214 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T18:36:16.214 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 214.645444981 2024-04-26T18:36:16.214 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:36:16.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.208+0000 7fc39d103700 1 -- 172.21.15.80:0/763177570 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fc3800a3c40 msgr2=0x7fc3800a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:16.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.208+0000 7fc39d103700 1 --2- 172.21.15.80:0/763177570 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fc3800a3c40 0x7fc3800a6100 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc38c0098e0 tx=0x7fc38c005960 comp rx=0 tx=0).stop 2024-04-26T18:36:16.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.208+0000 7fc39d103700 1 -- 172.21.15.80:0/763177570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc398102330 msgr2=0x7fc39819fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:16.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.208+0000 7fc39d103700 1 --2- 172.21.15.80:0/763177570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc398102330 0x7fc39819fba0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc38800c9b0 tx=0x7fc38800ccc0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.208+0000 7fc39d103700 1 -- 172.21.15.80:0/763177570 shutdown_connections 2024-04-26T18:36:16.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.208+0000 7fc39d103700 1 --2- 172.21.15.80:0/763177570 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fc3800a3c40 0x7fc3800a6100 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.208+0000 7fc39d103700 1 --2- 172.21.15.80:0/763177570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3981094b0 0x7fc3981997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.208+0000 7fc39d103700 1 --2- 172.21.15.80:0/763177570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc398101970 0x7fc39819f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.208+0000 7fc39d103700 1 --2- 172.21.15.80:0/763177570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc398102330 0x7fc39819fba0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:16.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.208+0000 7fc39d103700 1 -- 172.21.15.80:0/763177570 >> 172.21.15.80:0/763177570 conn(0x7fc398078920 msgr2=0x7fc3980ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:16.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.208+0000 7fc39d103700 1 -- 172.21.15.80:0/763177570 shutdown_connections 2024-04-26T18:36:16.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:16.208+0000 7fc39d103700 1 -- 172.21.15.80:0/763177570 wait complete. 2024-04-26T18:36:16.981 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell mds.b status 2024-04-26T18:36:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:36:17.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:17 smithi192 ceph-mon[32842]: pgmap v394: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:36:17.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:17 smithi082 ceph-mon[32808]: pgmap v394: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:36:17.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:17 smithi080 ceph-mon[29135]: pgmap v394: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T18:36:18.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.933+0000 7fd240ab7700 1 -- 172.21.15.80:0/91446828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd23c1094c0 msgr2=0x7fd23c1098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:18.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.933+0000 7fd240ab7700 1 --2- 172.21.15.80:0/91446828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd23c1094c0 0x7fd23c1098a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd230009990 tx=0x7fd230009ca0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.934+0000 7fd240ab7700 1 -- 172.21.15.80:0/91446828 shutdown_connections 2024-04-26T18:36:18.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.934+0000 7fd240ab7700 1 --2- 172.21.15.80:0/91446828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd23c103e30 0x7fd23c110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.934+0000 7fd240ab7700 1 --2- 172.21.15.80:0/91446828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd23c1094c0 0x7fd23c1098a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.934+0000 7fd240ab7700 1 --2- 172.21.15.80:0/91446828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd23c103470 0x7fd23c1038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.934+0000 7fd240ab7700 1 -- 172.21.15.80:0/91446828 >> 172.21.15.80:0/91446828 conn(0x7fd23c07a580 msgr2=0x7fd23c07a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:18.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.934+0000 7fd240ab7700 1 -- 172.21.15.80:0/91446828 shutdown_connections 2024-04-26T18:36:18.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.934+0000 7fd240ab7700 1 -- 172.21.15.80:0/91446828 wait complete. 2024-04-26T18:36:18.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.935+0000 7fd240ab7700 1 Processor -- start 2024-04-26T18:36:18.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.935+0000 7fd240ab7700 1 -- start start 2024-04-26T18:36:18.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.935+0000 7fd240ab7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd23c103470 0x7fd23c19f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:18.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.935+0000 7fd240ab7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd23c103e30 0x7fd23c19fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:18.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.935+0000 7fd240ab7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd23c1094c0 0x7fd23c199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:18.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.935+0000 7fd240ab7700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd23c1136c0 con 0x7fd23c1094c0 2024-04-26T18:36:18.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.935+0000 7fd240ab7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd23c113540 con 0x7fd23c103470 2024-04-26T18:36:18.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.935+0000 7fd240ab7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd23c113840 con 0x7fd23c103e30 2024-04-26T18:36:18.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.935+0000 7fd23ad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd23c1094c0 0x7fd23c199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:18.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.935+0000 7fd23ad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd23c1094c0 0x7fd23c199af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51222/0 (socket says 172.21.15.80:51222) 2024-04-26T18:36:18.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.935+0000 7fd23ad9d700 1 -- 172.21.15.80:0/2960522178 learned_addr learned my addr 172.21.15.80:0/2960522178 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:18.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.935+0000 7fd239d9b700 1 --2- 172.21.15.80:0/2960522178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd23c103e30 0x7fd23c19fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:18.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.935+0000 7fd23a59c700 1 --2- 172.21.15.80:0/2960522178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd23c103470 0x7fd23c19f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:18.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.935+0000 7fd23ad9d700 1 -- 172.21.15.80:0/2960522178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd23c103e30 msgr2=0x7fd23c19fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:18.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.935+0000 7fd23ad9d700 1 --2- 172.21.15.80:0/2960522178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd23c103e30 0x7fd23c19fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.935+0000 7fd23ad9d700 1 -- 172.21.15.80:0/2960522178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd23c103470 msgr2=0x7fd23c19f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:18.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.935+0000 7fd23ad9d700 1 --2- 172.21.15.80:0/2960522178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd23c103470 0x7fd23c19f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.935+0000 7fd23ad9d700 1 -- 172.21.15.80:0/2960522178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd23c19a250 con 0x7fd23c1094c0 2024-04-26T18:36:18.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.935+0000 7fd23ad9d700 1 --2- 172.21.15.80:0/2960522178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd23c1094c0 0x7fd23c199af0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd23400b970 tx=0x7fd23400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:18.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.936+0000 7fd22b7fe700 1 -- 172.21.15.80:0/2960522178 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd234019070 con 0x7fd23c1094c0 2024-04-26T18:36:18.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.936+0000 7fd240ab7700 1 -- 172.21.15.80:0/2960522178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd23c19a540 con 0x7fd23c1094c0 2024-04-26T18:36:18.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.936+0000 7fd22b7fe700 1 -- 172.21.15.80:0/2960522178 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd234014440 con 0x7fd23c1094c0 2024-04-26T18:36:18.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.936+0000 7fd22b7fe700 1 -- 172.21.15.80:0/2960522178 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23400ce60 con 0x7fd23c1094c0 2024-04-26T18:36:18.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.936+0000 7fd240ab7700 1 -- 172.21.15.80:0/2960522178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd23c1a6800 con 0x7fd23c1094c0 2024-04-26T18:36:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.938+0000 7fd22b7fe700 1 -- 172.21.15.80:0/2960522178 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fd23401c070 con 0x7fd23c1094c0 2024-04-26T18:36:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.939+0000 7fd22b7fe700 1 --2- 172.21.15.80:0/2960522178 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd2240a3c40 0x7fd2240a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.939+0000 7fd23a59c700 1 --2- 172.21.15.80:0/2960522178 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd2240a3c40 0x7fd2240a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.939+0000 7fd22b7fe700 1 -- 172.21.15.80:0/2960522178 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fd2340cf820 con 0x7fd23c1094c0 2024-04-26T18:36:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.939+0000 7fd23a59c700 1 --2- 172.21.15.80:0/2960522178 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd2240a3c40 0x7fd2240a6100 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd230006010 tx=0x7fd23001a040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.939+0000 7fd24b349b80 1 Processor -- start 2024-04-26T18:36:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.940+0000 7fd24b349b80 1 -- start start 2024-04-26T18:36:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.940+0000 7fd24b349b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b9245a20 0x55c3b9245e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.940+0000 7fd24b349b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3b923fd50 0x55c3b92401b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.940+0000 7fd24b349b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b92406f0 0x55c3b924c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.940+0000 7fd24b349b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55c3b91927e0 con 0x55c3b92406f0 2024-04-26T18:36:18.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.940+0000 7fd24b349b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c3b90f88e0 con 0x55c3b923fd50 2024-04-26T18:36:18.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.940+0000 7fd24b349b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c3b918e7a0 con 0x55c3b9245a20 2024-04-26T18:36:18.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.940+0000 7fd23ad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b92406f0 0x55c3b924c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:18.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.940+0000 7fd23ad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b92406f0 0x55c3b924c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51228/0 (socket says 172.21.15.80:51228) 2024-04-26T18:36:18.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.940+0000 7fd23ad9d700 1 -- 172.21.15.80:0/3293605806 learned_addr learned my addr 172.21.15.80:0/3293605806 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:18.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.940+0000 7fd239d9b700 1 --2- 172.21.15.80:0/3293605806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3b923fd50 0x55c3b92401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:18.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.940+0000 7fd23a59c700 1 --2- 172.21.15.80:0/3293605806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b9245a20 0x55c3b9245e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:18.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.940+0000 7fd23ad9d700 1 -- 172.21.15.80:0/3293605806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b9245a20 msgr2=0x55c3b9245e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:18.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.940+0000 7fd23ad9d700 1 --2- 172.21.15.80:0/3293605806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b9245a20 0x55c3b9245e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.940+0000 7fd23ad9d700 1 -- 172.21.15.80:0/3293605806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3b923fd50 msgr2=0x55c3b92401b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:18.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.940+0000 7fd23ad9d700 1 --2- 172.21.15.80:0/3293605806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3b923fd50 0x55c3b92401b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.940+0000 7fd23ad9d700 1 -- 172.21.15.80:0/3293605806 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3b90df880 con 0x55c3b92406f0 2024-04-26T18:36:18.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.940+0000 7fd239d9b700 1 --2- 172.21.15.80:0/3293605806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3b923fd50 0x55c3b92401b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:36:18.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.941+0000 7fd23ad9d700 1 --2- 172.21.15.80:0/3293605806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b92406f0 0x55c3b924c770 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd23409b7d0 tx=0x7fd234004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d15e52e1c9b6a6e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:18.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.941+0000 7fd228ff9700 1 -- 172.21.15.80:0/3293605806 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23409fe80 con 0x55c3b92406f0 2024-04-26T18:36:18.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.941+0000 7fd228ff9700 1 -- 172.21.15.80:0/3293605806 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2340a4740 con 0x55c3b92406f0 2024-04-26T18:36:18.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.941+0000 7fd228ff9700 1 -- 172.21.15.80:0/3293605806 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23409bf90 con 0x55c3b92406f0 2024-04-26T18:36:18.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.942+0000 7fd24b349b80 1 -- 172.21.15.80:0/3293605806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b92406f0 msgr2=0x55c3b924c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:18.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.942+0000 7fd24b349b80 1 --2- 172.21.15.80:0/3293605806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b92406f0 0x55c3b924c770 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd23409b7d0 tx=0x7fd234004ad0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.942+0000 7fd24b349b80 1 -- 172.21.15.80:0/3293605806 shutdown_connections 2024-04-26T18:36:18.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.942+0000 7fd24b349b80 1 --2- 172.21.15.80:0/3293605806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b92406f0 0x55c3b924c770 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.942+0000 7fd24b349b80 1 --2- 172.21.15.80:0/3293605806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b9245a20 0x55c3b9245e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.942+0000 7fd24b349b80 1 --2- 172.21.15.80:0/3293605806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3b923fd50 0x55c3b92401b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.942+0000 7fd24b349b80 1 -- 172.21.15.80:0/3293605806 >> 172.21.15.80:0/3293605806 conn(0x55c3b916e570 msgr2=0x55c3b923a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:18.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.942+0000 7fd24b349b80 1 -- 172.21.15.80:0/3293605806 shutdown_connections 2024-04-26T18:36:18.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.942+0000 7fd24b349b80 1 -- 172.21.15.80:0/3293605806 wait complete. 2024-04-26T18:36:18.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.942+0000 7fd24b349b80 1 -- start start 2024-04-26T18:36:18.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.942+0000 7fd24b349b80 1 Processor -- start 2024-04-26T18:36:18.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.943+0000 7fd24b349b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3b923fd50 0x55c3b924c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:18.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.943+0000 7fd24b349b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b92406f0 0x55c3b9249800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:18.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.943+0000 7fd24b349b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b9245a20 0x55c3b9249d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:18.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.943+0000 7fd24b349b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55c3b924ccb0 con 0x55c3b9245a20 2024-04-26T18:36:18.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.943+0000 7fd24b349b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c3b914ca30 con 0x55c3b923fd50 2024-04-26T18:36:18.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.943+0000 7fd24b349b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c3b924ce30 con 0x55c3b92406f0 2024-04-26T18:36:18.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.943+0000 7fd24b349b80 10 client.0 _ll_register_callbacks cb 0x55c3b912a900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:36:18.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.943+0000 7fd23ad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b9245a20 0x55c3b9249d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:18.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.943+0000 7fd23a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3b923fd50 0x55c3b924c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:18.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.943+0000 7fd23ad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b9245a20 0x55c3b9249d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51234/0 (socket says 172.21.15.80:51234) 2024-04-26T18:36:18.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.943+0000 7fd23ad9d700 1 -- 172.21.15.80:0/4159299688 learned_addr learned my addr 172.21.15.80:0/4159299688 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:18.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.943+0000 7fd239d9b700 1 --2- 172.21.15.80:0/4159299688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b92406f0 0x55c3b9249800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:18.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.943+0000 7fd23ad9d700 1 -- 172.21.15.80:0/4159299688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b92406f0 msgr2=0x55c3b9249800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:18.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.943+0000 7fd23ad9d700 1 --2- 172.21.15.80:0/4159299688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b92406f0 0x55c3b9249800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.943+0000 7fd23ad9d700 1 -- 172.21.15.80:0/4159299688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3b923fd50 msgr2=0x55c3b924c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:18.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.943+0000 7fd23ad9d700 1 --2- 172.21.15.80:0/4159299688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3b923fd50 0x55c3b924c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.943+0000 7fd23ad9d700 1 -- 172.21.15.80:0/4159299688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3b9150430 con 0x55c3b9245a20 2024-04-26T18:36:18.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.943+0000 7fd239d9b700 1 --2- 172.21.15.80:0/4159299688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b92406f0 0x55c3b9249800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:36:18.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.943+0000 7fd23ad9d700 1 --2- 172.21.15.80:0/4159299688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b9245a20 0x55c3b9249d40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd2340984a0 tx=0x7fd23409bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67bd6b946acfc915 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:18.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.943+0000 7fd221ffb700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:36:18.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.943+0000 7fd221ffb700 1 -- 172.21.15.80:0/4159299688 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2340148f0 con 0x55c3b9245a20 2024-04-26T18:36:18.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.944+0000 7fd221ffb700 1 -- 172.21.15.80:0/4159299688 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fd2340a42b0 con 0x55c3b9245a20 2024-04-26T18:36:18.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.944+0000 7fd24b349b80 1 -- 172.21.15.80:0/4159299688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2340a4740 con 0x55c3b9245a20 2024-04-26T18:36:18.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.944+0000 7fd221ffb700 1 -- 172.21.15.80:0/4159299688 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd2340a44b0 con 0x55c3b9245a20 2024-04-26T18:36:18.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.944+0000 7fd24b349b80 10 client.15165 fetch_fsmap learned FSMap version 26 2024-04-26T18:36:18.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.944+0000 7fd24b349b80 1 -- 172.21.15.80:0/4159299688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c3b92575d0 con 0x55c3b9245a20 2024-04-26T18:36:18.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.944+0000 7fd221ffb700 1 -- 172.21.15.80:0/4159299688 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2340a4740 con 0x55c3b9245a20 2024-04-26T18:36:18.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.944+0000 7fd221ffb700 1 -- 172.21.15.80:0/4159299688 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fd2340b7030 con 0x55c3b9245a20 2024-04-26T18:36:18.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.944+0000 7fd24b349b80 10 client.15165 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:36:18.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.944+0000 7fd24b349b80 10 client.15165 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T18:36:18.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.944+0000 7fd24b349b80 20 client.15165 populate_metadata read hostname 'smithi080' 2024-04-26T18:36:18.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.944+0000 7fd24b349b80 1 --2- 172.21.15.80:0/4159299688 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55c3b9258920 0x55c3b925aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:18.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.944+0000 7fd24b349b80 4 client.15165 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:36:18.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.944+0000 7fd24b349b80 1 -- 172.21.15.80:0/4159299688 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3b91a01c0 con 0x55c3b9258920 2024-04-26T18:36:18.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.944+0000 7fd23a59c700 1 --2- 172.21.15.80:0/4159299688 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55c3b9258920 0x55c3b925aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:18.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.945+0000 7fd221ffb700 10 client.15165 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:36:18.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.945+0000 7fd23a59c700 1 --2- 172.21.15.80:0/4159299688 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55c3b9258920 0x55c3b925aaf0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae5808d5f1facfe2 server_cookie=25acb70ac597f27a in_seq=0 out_seq=0 2024-04-26T18:36:18.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.946+0000 7fd221ffb700 1 -- 172.21.15.80:0/4159299688 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c3b91a01c0 con 0x55c3b9258920 2024-04-26T18:36:18.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.946+0000 7fd221ffb700 10 client.15165 handle_command_reply: tid=0 2024-04-26T18:36:18.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.946+0000 7fd24b349b80 1 client.15165 shutdown 2024-04-26T18:36:18.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.946+0000 7fd24b349b80 1 -- 172.21.15.80:0/4159299688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b9245a20 msgr2=0x55c3b9249d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:18.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.946+0000 7fd24b349b80 1 --2- 172.21.15.80:0/4159299688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b9245a20 0x55c3b9249d40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd2340984a0 tx=0x7fd23409bc10 comp rx=0 tx=0).stop 2024-04-26T18:36:18.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.946+0000 7fd24b349b80 1 -- 172.21.15.80:0/4159299688 shutdown_connections 2024-04-26T18:36:18.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.946+0000 7fd24b349b80 1 --2- 172.21.15.80:0/4159299688 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55c3b9258920 0x55c3b925aaf0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.946+0000 7fd24b349b80 1 --2- 172.21.15.80:0/4159299688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b9245a20 0x55c3b9249d40 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.946+0000 7fd24b349b80 1 --2- 172.21.15.80:0/4159299688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3b923fd50 0x55c3b924c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.946+0000 7fd221ffb700 0 client.15165 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:36:18.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.946+0000 7fd24b349b80 1 --2- 172.21.15.80:0/4159299688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b92406f0 0x55c3b9249800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.946+0000 7fd24b349b80 1 -- 172.21.15.80:0/4159299688 >> 172.21.15.80:0/4159299688 conn(0x55c3b916e570 msgr2=0x55c3b923ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:18.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.946+0000 7fd24b349b80 1 -- 172.21.15.80:0/4159299688 shutdown_connections 2024-04-26T18:36:18.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.946+0000 7fd24b349b80 1 -- 172.21.15.80:0/4159299688 wait complete. 2024-04-26T18:36:18.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.946+0000 7fd24b349b80 20 client.15165 trim_cache size 0 max 16384 2024-04-26T18:36:18.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.966+0000 7fd24b349b80 1 Processor -- start 2024-04-26T18:36:18.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.966+0000 7fd24b349b80 1 -- start start 2024-04-26T18:36:18.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.966+0000 7fd24b349b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b923fd50 0x55c3b924ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:18.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.966+0000 7fd24b349b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3b92406f0 0x55c3b9263f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:18.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.966+0000 7fd24b349b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b9245a20 0x55c3b92644a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:18.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.966+0000 7fd24b349b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55c3b9258e30 con 0x55c3b923fd50 2024-04-26T18:36:18.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.966+0000 7fd24b349b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c3b9259500 con 0x55c3b92406f0 2024-04-26T18:36:18.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.966+0000 7fd24b349b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c3b9259bd0 con 0x55c3b9245a20 2024-04-26T18:36:18.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.966+0000 7fd23a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b923fd50 0x55c3b924ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:18.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.966+0000 7fd23a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b923fd50 0x55c3b924ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51240/0 (socket says 172.21.15.80:51240) 2024-04-26T18:36:18.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.966+0000 7fd23a59c700 1 -- 172.21.15.80:0/3939601464 learned_addr learned my addr 172.21.15.80:0/3939601464 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:18.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.966+0000 7fd23a59c700 1 -- 172.21.15.80:0/3939601464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b9245a20 msgr2=0x55c3b92644a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:18.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.966+0000 7fd23a59c700 1 --2- 172.21.15.80:0/3939601464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b9245a20 0x55c3b92644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.966+0000 7fd23a59c700 1 -- 172.21.15.80:0/3939601464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3b92406f0 msgr2=0x55c3b9263f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:18.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.966+0000 7fd23a59c700 1 --2- 172.21.15.80:0/3939601464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3b92406f0 0x55c3b9263f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.966+0000 7fd23a59c700 1 -- 172.21.15.80:0/3939601464 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3b924ce40 con 0x55c3b923fd50 2024-04-26T18:36:18.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.967+0000 7fd23a59c700 1 --2- 172.21.15.80:0/3939601464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b923fd50 0x55c3b924ad60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd230000c00 tx=0x7fd23001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df99265800e79348 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:18.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.967+0000 7fd223fff700 1 -- 172.21.15.80:0/3939601464 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23000f840 con 0x55c3b923fd50 2024-04-26T18:36:18.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.967+0000 7fd223fff700 1 -- 172.21.15.80:0/3939601464 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd23003b070 con 0x55c3b923fd50 2024-04-26T18:36:18.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.967+0000 7fd223fff700 1 -- 172.21.15.80:0/3939601464 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd230023410 con 0x55c3b923fd50 2024-04-26T18:36:18.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.967+0000 7fd24b349b80 1 -- 172.21.15.80:0/3939601464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b923fd50 msgr2=0x55c3b924ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:18.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.967+0000 7fd24b349b80 1 --2- 172.21.15.80:0/3939601464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b923fd50 0x55c3b924ad60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd230000c00 tx=0x7fd23001e000 comp rx=0 tx=0).stop 2024-04-26T18:36:18.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.967+0000 7fd24b349b80 1 -- 172.21.15.80:0/3939601464 shutdown_connections 2024-04-26T18:36:18.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.967+0000 7fd24b349b80 1 --2- 172.21.15.80:0/3939601464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b9245a20 0x55c3b92644a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.967+0000 7fd24b349b80 1 --2- 172.21.15.80:0/3939601464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b923fd50 0x55c3b924ad60 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.968+0000 7fd24b349b80 1 --2- 172.21.15.80:0/3939601464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3b92406f0 0x55c3b9263f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.968+0000 7fd24b349b80 1 -- 172.21.15.80:0/3939601464 >> 172.21.15.80:0/3939601464 conn(0x55c3b916e570 msgr2=0x55c3b923a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:18.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.968+0000 7fd24b349b80 1 -- 172.21.15.80:0/3939601464 shutdown_connections 2024-04-26T18:36:18.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.968+0000 7fd24b349b80 1 -- 172.21.15.80:0/3939601464 wait complete. 2024-04-26T18:36:18.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.968+0000 7fd24b349b80 1 -- start start 2024-04-26T18:36:18.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.968+0000 7fd24b349b80 1 Processor -- start 2024-04-26T18:36:18.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.968+0000 7fd24b349b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3b923fd50 0x55c3b92b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:18.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.968+0000 7fd24b349b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b92406f0 0x55c3b92b8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:18.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.968+0000 7fd24b349b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b9245a20 0x55c3b92601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:18.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.968+0000 7fd24b349b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55c3b925a970 con 0x55c3b9245a20 2024-04-26T18:36:18.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.968+0000 7fd24b349b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c3b925a2a0 con 0x55c3b923fd50 2024-04-26T18:36:18.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.968+0000 7fd24b349b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c3b925b040 con 0x55c3b92406f0 2024-04-26T18:36:18.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.968+0000 7fd24b349b80 10 client.0 _ll_register_callbacks cb 0x55c3b912a900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:36:18.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.968+0000 7fd23ad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b9245a20 0x55c3b92601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:18.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.968+0000 7fd23ad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b9245a20 0x55c3b92601d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51252/0 (socket says 172.21.15.80:51252) 2024-04-26T18:36:18.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.968+0000 7fd23ad9d700 1 -- 172.21.15.80:0/3228362225 learned_addr learned my addr 172.21.15.80:0/3228362225 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:18.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.968+0000 7fd239d9b700 1 --2- 172.21.15.80:0/3228362225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b92406f0 0x55c3b92b8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:18.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.969+0000 7fd23a59c700 1 --2- 172.21.15.80:0/3228362225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3b923fd50 0x55c3b92b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:18.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.969+0000 7fd23ad9d700 1 -- 172.21.15.80:0/3228362225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b92406f0 msgr2=0x55c3b92b8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:18.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.969+0000 7fd23ad9d700 1 --2- 172.21.15.80:0/3228362225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b92406f0 0x55c3b92b8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.969+0000 7fd23ad9d700 1 -- 172.21.15.80:0/3228362225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3b923fd50 msgr2=0x55c3b92b8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:18.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.969+0000 7fd23ad9d700 1 --2- 172.21.15.80:0/3228362225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3b923fd50 0x55c3b92b8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.969+0000 7fd23ad9d700 1 -- 172.21.15.80:0/3228362225 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3b92608a0 con 0x55c3b9245a20 2024-04-26T18:36:18.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.969+0000 7fd23ad9d700 1 --2- 172.21.15.80:0/3228362225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b9245a20 0x55c3b92601d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd234000f80 tx=0x7fd234014b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39dba1b11d3b5075 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:18.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.969+0000 7fd221ffb700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:36:18.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.969+0000 7fd221ffb700 1 -- 172.21.15.80:0/3228362225 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd234097d70 con 0x55c3b9245a20 2024-04-26T18:36:18.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.969+0000 7fd221ffb700 1 -- 172.21.15.80:0/3228362225 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fd2340a42b0 con 0x55c3b9245a20 2024-04-26T18:36:18.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.969+0000 7fd24b349b80 1 -- 172.21.15.80:0/3228362225 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd23003b070 con 0x55c3b9245a20 2024-04-26T18:36:18.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.969+0000 7fd221ffb700 1 -- 172.21.15.80:0/3228362225 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd2340a4740 con 0x55c3b9245a20 2024-04-26T18:36:18.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.969+0000 7fd24b349b80 10 client.15171 fetch_fsmap learned FSMap version 26 2024-04-26T18:36:18.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.969+0000 7fd24b349b80 1 -- 172.21.15.80:0/3228362225 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c3b92c1350 con 0x55c3b9245a20 2024-04-26T18:36:18.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.969+0000 7fd221ffb700 1 -- 172.21.15.80:0/3228362225 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd23003b070 con 0x55c3b9245a20 2024-04-26T18:36:18.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.969+0000 7fd221ffb700 1 -- 172.21.15.80:0/3228362225 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fd2340b7070 con 0x55c3b9245a20 2024-04-26T18:36:18.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.969+0000 7fd24b349b80 10 client.15171 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:36:18.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.969+0000 7fd24b349b80 10 client.15171 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T18:36:18.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.969+0000 7fd24b349b80 20 client.15171 populate_metadata read hostname 'smithi080' 2024-04-26T18:36:18.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.969+0000 7fd24b349b80 1 --2- 172.21.15.80:0/3228362225 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55c3b92c5bb0 0x55c3b92c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:18.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.969+0000 7fd24b349b80 4 client.15171 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T18:36:18.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.969+0000 7fd24b349b80 1 -- 172.21.15.80:0/3228362225 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "status"}) -- 0x55c3b919a260 con 0x55c3b92c5bb0 2024-04-26T18:36:18.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.970+0000 7fd23a59c700 1 --2- 172.21.15.80:0/3228362225 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55c3b92c5bb0 0x55c3b92c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:18.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.970+0000 7fd23a59c700 1 --2- 172.21.15.80:0/3228362225 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55c3b92c5bb0 0x55c3b92c48c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e406b87ada5bbef1 server_cookie=8012fbd1bc5b4df9 in_seq=0 out_seq=0 2024-04-26T18:36:18.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.970+0000 7fd221ffb700 10 client.15171 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:36:18.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.970+0000 7fd221ffb700 1 -- 172.21.15.80:0/3228362225 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55c3b919a260 con 0x55c3b92c5bb0 2024-04-26T18:36:18.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.970+0000 7fd221ffb700 10 client.15171 handle_command_reply: tid=0 2024-04-26T18:36:18.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.970+0000 7fd24b349b80 1 client.15171 shutdown 2024-04-26T18:36:18.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.970+0000 7fd24b349b80 1 -- 172.21.15.80:0/3228362225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b9245a20 msgr2=0x55c3b92601d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:18.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.970+0000 7fd24b349b80 1 --2- 172.21.15.80:0/3228362225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b9245a20 0x55c3b92601d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd234000f80 tx=0x7fd234014b00 comp rx=0 tx=0).stop 2024-04-26T18:36:18.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.970+0000 7fd24b349b80 1 -- 172.21.15.80:0/3228362225 shutdown_connections 2024-04-26T18:36:18.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.970+0000 7fd24b349b80 1 --2- 172.21.15.80:0/3228362225 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55c3b92c5bb0 0x55c3b92c48c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.970+0000 7fd24b349b80 1 --2- 172.21.15.80:0/3228362225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c3b9245a20 0x55c3b92601d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.970+0000 7fd24b349b80 1 --2- 172.21.15.80:0/3228362225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3b923fd50 0x55c3b92b8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.970+0000 7fd24b349b80 1 --2- 172.21.15.80:0/3228362225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b92406f0 0x55c3b92b8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.970+0000 7fd24b349b80 1 -- 172.21.15.80:0/3228362225 >> 172.21.15.80:0/3228362225 conn(0x55c3b916e570 msgr2=0x55c3b924ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:18.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.970+0000 7fd221ffb700 0 client.15171 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:36:18.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.971+0000 7fd24b349b80 1 -- 172.21.15.80:0/3228362225 shutdown_connections 2024-04-26T18:36:18.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.971+0000 7fd24b349b80 1 -- 172.21.15.80:0/3228362225 wait complete. 2024-04-26T18:36:18.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.971+0000 7fd24b349b80 20 client.15171 trim_cache size 0 max 16384 2024-04-26T18:36:18.979 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:36:18.979 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "2187ca98-03fa-11ef-bc93-c7b262605968", 2024-04-26T18:36:18.979 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2024-04-26T18:36:18.979 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24434, 2024-04-26T18:36:18.979 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-26T18:36:18.979 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-26T18:36:18.979 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-26T18:36:18.979 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 190.418027661, 2024-04-26T18:36:18.980 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 26, 2024-04-26T18:36:18.980 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 91, 2024-04-26T18:36:18.980 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T18:36:18.980 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 207.118885578 2024-04-26T18:36:18.980 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:36:18.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.971+0000 7fd240ab7700 1 -- 172.21.15.80:0/2960522178 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd2240a3c40 msgr2=0x7fd2240a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:18.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.971+0000 7fd240ab7700 1 --2- 172.21.15.80:0/2960522178 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd2240a3c40 0x7fd2240a6100 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd230006010 tx=0x7fd23001a040 comp rx=0 tx=0).stop 2024-04-26T18:36:18.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.971+0000 7fd240ab7700 1 -- 172.21.15.80:0/2960522178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd23c1094c0 msgr2=0x7fd23c199af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:18.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.971+0000 7fd240ab7700 1 --2- 172.21.15.80:0/2960522178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd23c1094c0 0x7fd23c199af0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd23400b970 tx=0x7fd23400bd30 comp rx=0 tx=0).stop 2024-04-26T18:36:18.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.971+0000 7fd240ab7700 1 -- 172.21.15.80:0/2960522178 shutdown_connections 2024-04-26T18:36:18.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.971+0000 7fd240ab7700 1 --2- 172.21.15.80:0/2960522178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd23c1094c0 0x7fd23c199af0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.971+0000 7fd240ab7700 1 --2- 172.21.15.80:0/2960522178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd23c103470 0x7fd23c19f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.971+0000 7fd240ab7700 1 --2- 172.21.15.80:0/2960522178 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd2240a3c40 0x7fd2240a6100 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.971+0000 7fd240ab7700 1 --2- 172.21.15.80:0/2960522178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd23c103e30 0x7fd23c19fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:18.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.971+0000 7fd240ab7700 1 -- 172.21.15.80:0/2960522178 >> 172.21.15.80:0/2960522178 conn(0x7fd23c07a580 msgr2=0x7fd23c1022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:18.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.971+0000 7fd240ab7700 1 -- 172.21.15.80:0/2960522178 shutdown_connections 2024-04-26T18:36:18.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:18.971+0000 7fd240ab7700 1 -- 172.21.15.80:0/2960522178 wait complete. 2024-04-26T18:36:19.750 INFO:teuthology.run_tasks:Running task sequential... 2024-04-26T18:36:19.760 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-26T18:36:19.760 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-26T18:36:19.760 INFO:teuthology.task.print:Enabling mgr modules 2024-04-26T18:36:19.760 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-04-26T18:36:19.761 INFO:teuthology.task.exec:Executing custom commands... 2024-04-26T18:36:19.761 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi080.front.sepia.ceph.com 2024-04-26T18:36:19.762 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-04-26T18:36:19.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.861+0000 7fe896b91640 1 -- 172.21.15.80:0/2351738701 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe890102a80 msgr2=0x7fe890102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:19.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.861+0000 7fe896b91640 1 --2- 172.21.15.80:0/2351738701 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe890102a80 0x7fe890102f00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe884009900 tx=0x7fe88402a410 comp rx=0 tx=0).stop 2024-04-26T18:36:19.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.862+0000 7fe896b91640 1 -- 172.21.15.80:0/2351738701 shutdown_connections 2024-04-26T18:36:19.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.862+0000 7fe896b91640 1 --2- 172.21.15.80:0/2351738701 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe890102a80 0x7fe890102f00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:19.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.862+0000 7fe896b91640 1 --2- 172.21.15.80:0/2351738701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe890103440 0x7fe890109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:19.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.862+0000 7fe896b91640 1 --2- 172.21.15.80:0/2351738701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe890101890 0x7fe890101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:19.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.862+0000 7fe896b91640 1 -- 172.21.15.80:0/2351738701 >> 172.21.15.80:0/2351738701 conn(0x7fe8900fce20 msgr2=0x7fe8900ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:19.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.862+0000 7fe896b91640 1 -- 172.21.15.80:0/2351738701 shutdown_connections 2024-04-26T18:36:19.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.862+0000 7fe896b91640 1 -- 172.21.15.80:0/2351738701 wait complete. 2024-04-26T18:36:19.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.862+0000 7fe896b91640 1 Processor -- start 2024-04-26T18:36:19.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.862+0000 7fe896b91640 1 -- start start 2024-04-26T18:36:19.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.862+0000 7fe896b91640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe890101890 0x7fe890198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:19.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.862+0000 7fe896b91640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe890102a80 0x7fe890199040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:19.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.862+0000 7fe896b91640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe890103440 0x7fe8901a00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:19.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.862+0000 7fe896b91640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe89010e4e0 con 0x7fe890101890 2024-04-26T18:36:19.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.862+0000 7fe896b91640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe89010e360 con 0x7fe890102a80 2024-04-26T18:36:19.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.862+0000 7fe896b91640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe89010e660 con 0x7fe890103440 2024-04-26T18:36:19.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.862+0000 7fe89492d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe890101890 0x7fe890198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:19.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.862+0000 7fe89492d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe890101890 0x7fe890198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51268/0 (socket says 172.21.15.80:51268) 2024-04-26T18:36:19.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.862+0000 7fe89492d640 1 -- 172.21.15.80:0/2075917713 learned_addr learned my addr 172.21.15.80:0/2075917713 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:19.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.862+0000 7fe89512e640 1 --2- 172.21.15.80:0/2075917713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe890103440 0x7fe8901a00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:19.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.862+0000 7fe88ffff640 1 --2- 172.21.15.80:0/2075917713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe890102a80 0x7fe890199040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:19.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.863+0000 7fe89492d640 1 -- 172.21.15.80:0/2075917713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe890103440 msgr2=0x7fe8901a00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:19.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.863+0000 7fe89492d640 1 --2- 172.21.15.80:0/2075917713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe890103440 0x7fe8901a00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:19.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.863+0000 7fe89492d640 1 -- 172.21.15.80:0/2075917713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe890102a80 msgr2=0x7fe890199040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:19.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.863+0000 7fe89492d640 1 --2- 172.21.15.80:0/2075917713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe890102a80 0x7fe890199040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:19.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.863+0000 7fe89492d640 1 -- 172.21.15.80:0/2075917713 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8901a0720 con 0x7fe890101890 2024-04-26T18:36:19.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.863+0000 7fe89512e640 1 --2- 172.21.15.80:0/2075917713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe890103440 0x7fe8901a00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:36:19.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.863+0000 7fe89492d640 1 --2- 172.21.15.80:0/2075917713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe890101890 0x7fe890198b00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe88000d770 tx=0x7fe88000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:19.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.863+0000 7fe88dffb640 1 -- 172.21.15.80:0/2075917713 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe880017070 con 0x7fe890101890 2024-04-26T18:36:19.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.863+0000 7fe896b91640 1 -- 172.21.15.80:0/2075917713 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8901a0a10 con 0x7fe890101890 2024-04-26T18:36:19.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.863+0000 7fe88dffb640 1 -- 172.21.15.80:0/2075917713 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe880009c30 con 0x7fe890101890 2024-04-26T18:36:19.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.863+0000 7fe88dffb640 1 -- 172.21.15.80:0/2075917713 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe880003cc0 con 0x7fe890101890 2024-04-26T18:36:19.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.863+0000 7fe896b91640 1 -- 172.21.15.80:0/2075917713 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8901a0fb0 con 0x7fe890101890 2024-04-26T18:36:19.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.864+0000 7fe896b91640 1 -- 172.21.15.80:0/2075917713 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe890108bb0 con 0x7fe890101890 2024-04-26T18:36:19.868 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:19 smithi192 ceph-mon[32842]: pgmap v395: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:36:19.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.865+0000 7fe88dffb640 1 -- 172.21.15.80:0/2075917713 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fe880003e60 con 0x7fe890101890 2024-04-26T18:36:19.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.866+0000 7fe88dffb640 1 --2- 172.21.15.80:0/2075917713 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe8780a3c50 0x7fe8780a6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:19.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.866+0000 7fe88ffff640 1 --2- 172.21.15.80:0/2075917713 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe8780a3c50 0x7fe8780a6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:19.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.866+0000 7fe88dffb640 1 -- 172.21.15.80:0/2075917713 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fe8800cfe10 con 0x7fe890101890 2024-04-26T18:36:19.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.866+0000 7fe88ffff640 1 --2- 172.21.15.80:0/2075917713 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe8780a3c50 0x7fe8780a6110 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe89019a010 tx=0x7fe8840314a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:19.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:19.870+0000 7fe88dffb640 1 -- 172.21.15.80:0/2075917713 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe88009c820 con 0x7fe890101890 2024-04-26T18:36:19.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:19 smithi082 ceph-mon[32808]: pgmap v395: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:36:19.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:19 smithi080 ceph-mon[29135]: pgmap v395: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T18:36:20.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.100+0000 7fe896b91640 1 -- 172.21.15.80:0/2075917713 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7fe89002dad0 con 0x7fe890101890 2024-04-26T18:36:20.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.604+0000 7fe88dffb640 1 -- 172.21.15.80:0/2075917713 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7fe89002dad0 con 0x7fe890101890 2024-04-26T18:36:20.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.607+0000 7fe896b91640 1 -- 172.21.15.80:0/2075917713 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe8780a3c50 msgr2=0x7fe8780a6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:20.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.607+0000 7fe896b91640 1 --2- 172.21.15.80:0/2075917713 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe8780a3c50 0x7fe8780a6110 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe89019a010 tx=0x7fe8840314a0 comp rx=0 tx=0).stop 2024-04-26T18:36:20.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.607+0000 7fe896b91640 1 -- 172.21.15.80:0/2075917713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe890101890 msgr2=0x7fe890198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:20.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.607+0000 7fe896b91640 1 --2- 172.21.15.80:0/2075917713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe890101890 0x7fe890198b00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe88000d770 tx=0x7fe88000dc30 comp rx=0 tx=0).stop 2024-04-26T18:36:20.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.607+0000 7fe896b91640 1 -- 172.21.15.80:0/2075917713 shutdown_connections 2024-04-26T18:36:20.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.607+0000 7fe896b91640 1 --2- 172.21.15.80:0/2075917713 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe8780a3c50 0x7fe8780a6110 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:20.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.607+0000 7fe896b91640 1 --2- 172.21.15.80:0/2075917713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe890103440 0x7fe8901a00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:20.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.607+0000 7fe896b91640 1 --2- 172.21.15.80:0/2075917713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe890102a80 0x7fe890199040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:20.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.607+0000 7fe896b91640 1 --2- 172.21.15.80:0/2075917713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe890101890 0x7fe890198b00 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:20.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.607+0000 7fe896b91640 1 -- 172.21.15.80:0/2075917713 >> 172.21.15.80:0/2075917713 conn(0x7fe8900fce20 msgr2=0x7fe890105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:20.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.608+0000 7fe896b91640 1 -- 172.21.15.80:0/2075917713 shutdown_connections 2024-04-26T18:36:20.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.608+0000 7fe896b91640 1 -- 172.21.15.80:0/2075917713 wait complete. 2024-04-26T18:36:20.625 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-04-26T18:36:20.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.730+0000 7f62fc9da640 1 -- 172.21.15.80:0/555411729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62f81034d0 msgr2=0x7f62f81058c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:20.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.730+0000 7f62fc9da640 1 --2- 172.21.15.80:0/555411729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62f81034d0 0x7f62f81058c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009900 tx=0x7f62e802a410 comp rx=0 tx=0).stop 2024-04-26T18:36:20.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.730+0000 7f62fc9da640 1 -- 172.21.15.80:0/555411729 shutdown_connections 2024-04-26T18:36:20.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.730+0000 7f62fc9da640 1 --2- 172.21.15.80:0/555411729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62f8108730 0x7f62f810ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:20.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.730+0000 7f62fc9da640 1 --2- 172.21.15.80:0/555411729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62f8105e00 0x7f62f81081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:20.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.730+0000 7f62fc9da640 1 --2- 172.21.15.80:0/555411729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62f81034d0 0x7f62f81058c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:20.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.730+0000 7f62fc9da640 1 -- 172.21.15.80:0/555411729 >> 172.21.15.80:0/555411729 conn(0x7f62f80fce00 msgr2=0x7f62f80ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:20.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.730+0000 7f62fc9da640 1 -- 172.21.15.80:0/555411729 shutdown_connections 2024-04-26T18:36:20.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.730+0000 7f62fc9da640 1 -- 172.21.15.80:0/555411729 wait complete. 2024-04-26T18:36:20.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.731+0000 7f62fc9da640 1 Processor -- start 2024-04-26T18:36:20.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.731+0000 7f62fc9da640 1 -- start start 2024-04-26T18:36:20.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.732+0000 7f62fc9da640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62f81034d0 0x7f62f8198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:20.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.732+0000 7f62fc9da640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62f8105e00 0x7f62f8199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:20.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.732+0000 7f62fc9da640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62f8108730 0x7f62f81a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:20.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.732+0000 7f62fc9da640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f62f810e540 con 0x7f62f8108730 2024-04-26T18:36:20.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.732+0000 7f62fc9da640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f62f810e3c0 con 0x7f62f81034d0 2024-04-26T18:36:20.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.732+0000 7f62fc9da640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f62f810e6c0 con 0x7f62f8105e00 2024-04-26T18:36:20.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.732+0000 7f62f6d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62f8108730 0x7f62f81a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:20.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.732+0000 7f62f6d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62f8108730 0x7f62f81a0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51290/0 (socket says 172.21.15.80:51290) 2024-04-26T18:36:20.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.732+0000 7f62f659c640 1 --2- 172.21.15.80:0/57778204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62f81034d0 0x7f62f8198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:20.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.732+0000 7f62f6d9d640 1 -- 172.21.15.80:0/57778204 learned_addr learned my addr 172.21.15.80:0/57778204 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:20.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.732+0000 7f62f5d9b640 1 --2- 172.21.15.80:0/57778204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62f8105e00 0x7f62f8199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:20.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.732+0000 7f62f659c640 1 -- 172.21.15.80:0/57778204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62f8105e00 msgr2=0x7f62f8199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:20.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.732+0000 7f62f659c640 1 --2- 172.21.15.80:0/57778204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62f8105e00 0x7f62f8199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:20.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.732+0000 7f62f659c640 1 -- 172.21.15.80:0/57778204 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62f8108730 msgr2=0x7f62f81a0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:20.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.732+0000 7f62f659c640 1 --2- 172.21.15.80:0/57778204 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62f8108730 0x7f62f81a0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:20.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.732+0000 7f62f659c640 1 -- 172.21.15.80:0/57778204 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f81a07e0 con 0x7f62f81034d0 2024-04-26T18:36:20.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.732+0000 7f62f5d9b640 1 --2- 172.21.15.80:0/57778204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62f8105e00 0x7f62f8199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:36:20.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.732+0000 7f62f659c640 1 --2- 172.21.15.80:0/57778204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62f81034d0 0x7f62f8198bc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f62e802aa00 tx=0x7f62e8003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:20.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.732+0000 7f62e77fe640 1 -- 172.21.15.80:0/57778204 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e803f070 con 0x7f62f81034d0 2024-04-26T18:36:20.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.733+0000 7f62fc9da640 1 -- 172.21.15.80:0/57778204 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f81a0a70 con 0x7f62f81034d0 2024-04-26T18:36:20.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.733+0000 7f62e77fe640 1 -- 172.21.15.80:0/57778204 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62e8031c50 con 0x7f62f81034d0 2024-04-26T18:36:20.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.733+0000 7f62e77fe640 1 -- 172.21.15.80:0/57778204 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e8035030 con 0x7f62f81034d0 2024-04-26T18:36:20.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.733+0000 7f62fc9da640 1 -- 172.21.15.80:0/57778204 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f81a0f80 con 0x7f62f81034d0 2024-04-26T18:36:20.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.733+0000 7f62fc9da640 1 -- 172.21.15.80:0/57778204 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62f80fe8f0 con 0x7f62f81034d0 2024-04-26T18:36:20.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.735+0000 7f62e77fe640 1 -- 172.21.15.80:0/57778204 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7f62e8042070 con 0x7f62f81034d0 2024-04-26T18:36:20.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.735+0000 7f62e77fe640 1 --2- 172.21.15.80:0/57778204 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f62e00a3ca0 0x7f62e00a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:20.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.735+0000 7f62f5d9b640 1 -- 172.21.15.80:0/57778204 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f62e00a3ca0 msgr2=0x7f62e00a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/179326828 2024-04-26T18:36:20.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.736+0000 7f62e77fe640 1 -- 172.21.15.80:0/57778204 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f62e80f11b0 con 0x7f62f81034d0 2024-04-26T18:36:20.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.736+0000 7f62f5d9b640 1 --2- 172.21.15.80:0/57778204 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f62e00a3ca0 0x7f62e00a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T18:36:20.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.739+0000 7f62e77fe640 1 -- 172.21.15.80:0/57778204 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f62e80bd510 con 0x7f62f81034d0 2024-04-26T18:36:20.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:20 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/2075917713' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-26T18:36:20.862 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:20 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: ignoring --setuser ceph since I am not root 2024-04-26T18:36:20.862 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:20 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: ignoring --setgroup ceph since I am not root 2024-04-26T18:36:20.863 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:20 smithi192 ceph-mgr[34699]: -- 172.21.15.192:0/4292034997 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561ee7a4e5a0 con 0x561ee7a22800 2024-04-26T18:36:20.863 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:20 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:20.805+0000 7f2699549200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T18:36:20.913 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:20 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2075917713' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-26T18:36:20.963 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:20 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: ignoring --setuser ceph since I am not root 2024-04-26T18:36:20.963 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:20 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: ignoring --setgroup ceph since I am not root 2024-04-26T18:36:20.963 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:20 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:20.801+0000 7f47695ae200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T18:36:20.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.926+0000 7f62fc9da640 1 -- 172.21.15.80:0/57778204 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f62f802dad0 con 0x7f62f81034d0 2024-04-26T18:36:20.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.933+0000 7f62e77fe640 1 -- 172.21.15.80:0/57778204 <== mon.2 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) ==== 138+0+0 (secure 0 0 0) 0x7f62e80c1810 con 0x7f62f81034d0 2024-04-26T18:36:20.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.935+0000 7f62fc9da640 1 -- 172.21.15.80:0/57778204 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f62e00a3ca0 msgr2=0x7f62e00a6160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T18:36:20.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.935+0000 7f62fc9da640 1 --2- 172.21.15.80:0/57778204 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f62e00a3ca0 0x7f62e00a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:20.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.935+0000 7f62fc9da640 1 -- 172.21.15.80:0/57778204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62f81034d0 msgr2=0x7f62f8198bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:20.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.935+0000 7f62fc9da640 1 --2- 172.21.15.80:0/57778204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62f81034d0 0x7f62f8198bc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f62e802aa00 tx=0x7f62e8003c10 comp rx=0 tx=0).stop 2024-04-26T18:36:20.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.935+0000 7f62fc9da640 1 -- 172.21.15.80:0/57778204 shutdown_connections 2024-04-26T18:36:20.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.935+0000 7f62fc9da640 1 --2- 172.21.15.80:0/57778204 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62f8108730 0x7f62f81a0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:20.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.935+0000 7f62fc9da640 1 --2- 172.21.15.80:0/57778204 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f62e00a3ca0 0x7f62e00a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:20.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.935+0000 7f62fc9da640 1 --2- 172.21.15.80:0/57778204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62f8105e00 0x7f62f8199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:20.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.935+0000 7f62fc9da640 1 --2- 172.21.15.80:0/57778204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62f81034d0 0x7f62f8198bc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:20.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.935+0000 7f62fc9da640 1 -- 172.21.15.80:0/57778204 >> 172.21.15.80:0/57778204 conn(0x7f62f80fce00 msgr2=0x7f62f8103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:20.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.936+0000 7f62fc9da640 1 -- 172.21.15.80:0/57778204 shutdown_connections 2024-04-26T18:36:20.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:20.936+0000 7f62fc9da640 1 -- 172.21.15.80:0/57778204 wait complete. 2024-04-26T18:36:20.967 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-04-26T18:36:20.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:20 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/2075917713' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-26T18:36:20.970 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:20 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: ignoring --setuser ceph since I am not root 2024-04-26T18:36:20.970 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:20 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: ignoring --setgroup ceph since I am not root 2024-04-26T18:36:20.970 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:20 smithi082 ceph-mgr[34195]: -- 172.21.15.82:0/2047398290 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d6c477c5a0 con 0x55d6c4750800 2024-04-26T18:36:20.970 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:20 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:20.786+0000 7f16f0331200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T18:36:21.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.072+0000 7f7157b2c640 1 -- 172.21.15.80:0/340250220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7150101200 msgr2=0x7f7150103630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:21.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.072+0000 7f7157b2c640 1 --2- 172.21.15.80:0/340250220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7150101200 0x7f7150103630 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f714c009900 tx=0x7f714c02a410 comp rx=0 tx=0).stop 2024-04-26T18:36:21.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.072+0000 7f7157b2c640 1 -- 172.21.15.80:0/340250220 shutdown_connections 2024-04-26T18:36:21.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.072+0000 7f7157b2c640 1 --2- 172.21.15.80:0/340250220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7150106520 0x7f71501069a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:21.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.072+0000 7f7157b2c640 1 --2- 172.21.15.80:0/340250220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7150103b70 0x7f7150105fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:21.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.072+0000 7f7157b2c640 1 --2- 172.21.15.80:0/340250220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7150101200 0x7f7150103630 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:21.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.072+0000 7f7157b2c640 1 -- 172.21.15.80:0/340250220 >> 172.21.15.80:0/340250220 conn(0x7f71500fce00 msgr2=0x7f71500ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:21.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.072+0000 7f7157b2c640 1 -- 172.21.15.80:0/340250220 shutdown_connections 2024-04-26T18:36:21.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.072+0000 7f7157b2c640 1 -- 172.21.15.80:0/340250220 wait complete. 2024-04-26T18:36:21.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.072+0000 7f7157b2c640 1 Processor -- start 2024-04-26T18:36:21.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.072+0000 7f7157b2c640 1 -- start start 2024-04-26T18:36:21.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.072+0000 7f7157b2c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7150101200 0x7f715019f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:21.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.072+0000 7f7157b2c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7150103b70 0x7f715019f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:21.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.072+0000 7f7157b2c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7150106520 0x7f71501a66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:21.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.072+0000 7f7157b2c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7150114ae0 con 0x7f7150106520 2024-04-26T18:36:21.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.072+0000 7f7157b2c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7150114960 con 0x7f7150101200 2024-04-26T18:36:21.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.072+0000 7f7157b2c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7150114c60 con 0x7f7150103b70 2024-04-26T18:36:21.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.073+0000 7f71558c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7150101200 0x7f715019f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:21.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.073+0000 7f71560c9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7150106520 0x7f71501a66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:21.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.073+0000 7f71558c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7150101200 0x7f715019f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:49692/0 (socket says 172.21.15.80:49692) 2024-04-26T18:36:21.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.073+0000 7f71558c8640 1 -- 172.21.15.80:0/3724867891 learned_addr learned my addr 172.21.15.80:0/3724867891 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:21.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.073+0000 7f71550c7640 1 --2- 172.21.15.80:0/3724867891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7150103b70 0x7f715019f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:21.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.073+0000 7f71558c8640 1 -- 172.21.15.80:0/3724867891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7150103b70 msgr2=0x7f715019f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:21.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.073+0000 7f71558c8640 1 --2- 172.21.15.80:0/3724867891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7150103b70 0x7f715019f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:21.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.073+0000 7f71558c8640 1 -- 172.21.15.80:0/3724867891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7150106520 msgr2=0x7f71501a66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:21.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.073+0000 7f71558c8640 1 --2- 172.21.15.80:0/3724867891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7150106520 0x7f71501a66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:21.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.073+0000 7f71558c8640 1 -- 172.21.15.80:0/3724867891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71501a6d10 con 0x7f7150101200 2024-04-26T18:36:21.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.073+0000 7f71560c9640 1 --2- 172.21.15.80:0/3724867891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7150106520 0x7f71501a66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:36:21.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.073+0000 7f71550c7640 1 --2- 172.21.15.80:0/3724867891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7150103b70 0x7f715019f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:36:21.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.073+0000 7f71558c8640 1 --2- 172.21.15.80:0/3724867891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7150101200 0x7f715019f0f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f714c005940 tx=0x7f714c0042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:21.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.073+0000 7f7146ffd640 1 -- 172.21.15.80:0/3724867891 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c03f030 con 0x7f7150101200 2024-04-26T18:36:21.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.073+0000 7f7157b2c640 1 -- 172.21.15.80:0/3724867891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71501a6fa0 con 0x7f7150101200 2024-04-26T18:36:21.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.073+0000 7f7146ffd640 1 -- 172.21.15.80:0/3724867891 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f714c003cb0 con 0x7f7150101200 2024-04-26T18:36:21.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.073+0000 7f7146ffd640 1 -- 172.21.15.80:0/3724867891 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c035070 con 0x7f7150101200 2024-04-26T18:36:21.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.073+0000 7f7157b2c640 1 -- 172.21.15.80:0/3724867891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71501a73b0 con 0x7f7150101200 2024-04-26T18:36:21.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.074+0000 7f7157b2c640 1 -- 172.21.15.80:0/3724867891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71500fe8f0 con 0x7f7150101200 2024-04-26T18:36:21.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.076+0000 7f7146ffd640 1 -- 172.21.15.80:0/3724867891 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7f714c042030 con 0x7f7150101200 2024-04-26T18:36:21.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.077+0000 7f7146ffd640 1 --2- 172.21.15.80:0/3724867891 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f713c0a3ca0 0x7f713c0a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:21.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.077+0000 7f71550c7640 1 -- 172.21.15.80:0/3724867891 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f713c0a3ca0 msgr2=0x7f713c0a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/179326828 2024-04-26T18:36:21.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.077+0000 7f7146ffd640 1 -- 172.21.15.80:0/3724867891 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7f714c0f0c20 con 0x7f7150101200 2024-04-26T18:36:21.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.077+0000 7f71550c7640 1 --2- 172.21.15.80:0/3724867891 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f713c0a3ca0 0x7f713c0a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T18:36:21.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.080+0000 7f7146ffd640 1 -- 172.21.15.80:0/3724867891 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f714c003e60 con 0x7f7150101200 2024-04-26T18:36:21.243 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:20 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:20.997+0000 7f47695ae200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T18:36:21.243 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:21 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:21.110+0000 7f47695ae200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T18:36:21.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.265+0000 7f7157b2c640 1 -- 172.21.15.80:0/3724867891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f715002dad0 con 0x7f7150101200 2024-04-26T18:36:21.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.273+0000 7f7146ffd640 1 -- 172.21.15.80:0/3724867891 <== mon.2 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) ==== 133+0+0 (secure 0 0 0) 0x7f714c0bcfe0 con 0x7f7150101200 2024-04-26T18:36:21.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.275+0000 7f7157b2c640 1 -- 172.21.15.80:0/3724867891 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f713c0a3ca0 msgr2=0x7f713c0a6160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T18:36:21.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.275+0000 7f7157b2c640 1 --2- 172.21.15.80:0/3724867891 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f713c0a3ca0 0x7f713c0a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:21.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.275+0000 7f7157b2c640 1 -- 172.21.15.80:0/3724867891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7150101200 msgr2=0x7f715019f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:21.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.275+0000 7f7157b2c640 1 --2- 172.21.15.80:0/3724867891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7150101200 0x7f715019f0f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f714c005940 tx=0x7f714c0042f0 comp rx=0 tx=0).stop 2024-04-26T18:36:21.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.275+0000 7f7157b2c640 1 -- 172.21.15.80:0/3724867891 shutdown_connections 2024-04-26T18:36:21.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.275+0000 7f7157b2c640 1 --2- 172.21.15.80:0/3724867891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7150106520 0x7f71501a66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:21.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.275+0000 7f7157b2c640 1 --2- 172.21.15.80:0/3724867891 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7f713c0a3ca0 0x7f713c0a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:21.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.275+0000 7f7157b2c640 1 --2- 172.21.15.80:0/3724867891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7150103b70 0x7f715019f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:21.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.275+0000 7f7157b2c640 1 --2- 172.21.15.80:0/3724867891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7150101200 0x7f715019f0f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:21.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.275+0000 7f7157b2c640 1 -- 172.21.15.80:0/3724867891 >> 172.21.15.80:0/3724867891 conn(0x7f71500fce00 msgr2=0x7f71501045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:21.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.275+0000 7f7157b2c640 1 -- 172.21.15.80:0/3724867891 shutdown_connections 2024-04-26T18:36:21.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:21.275+0000 7f7157b2c640 1 -- 172.21.15.80:0/3724867891 wait complete. 2024-04-26T18:36:21.287 INFO:teuthology.run_tasks:Running task kclient... 2024-04-26T18:36:21.312 INFO:tasks.kclient:Mounting kernel clients... 2024-04-26T18:36:21.313 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-26T18:36:21.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T18:36:21.313 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-26T18:36:21.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T18:36:21.330 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link delete ceph-brx 2024-04-26T18:36:21.362 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:20 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:20.989+0000 7f2699549200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T18:36:21.362 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:21 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:21.091+0000 7f2699549200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T18:36:21.381 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:20 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:20.969+0000 7f16f0331200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T18:36:21.381 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:21 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:21.072+0000 7f16f0331200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T18:36:21.381 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:21 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:21.381+0000 7f16f0331200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T18:36:21.395 INFO:teuthology.orchestra.run.smithi080.stderr:Cannot find device "ceph-brx" 2024-04-26T18:36:21.396 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T18:36:21.397 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-04-26T18:36:21.397 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T18:36:21.397 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T18:36:21.398 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-26T18:36:21.606 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:21 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:21.437+0000 7f47695ae200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T18:36:21.606 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:21 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:21.526+0000 7f47695ae200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T18:36:21.695 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:36:21.719 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:21 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:21.465+0000 7f16f0331200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T18:36:21.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:21 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/2075917713' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-26T18:36:21.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:21 smithi082 ceph-mon[32808]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-04-26T18:36:21.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:21 smithi082 ceph-mon[32808]: from='client.? ' entity='client.admin' 2024-04-26T18:36:21.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:21 smithi082 ceph-mon[32808]: from='client.? ' entity='client.admin' 2024-04-26T18:36:21.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:21 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/2075917713' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-26T18:36:21.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:21 smithi192 ceph-mon[32842]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-04-26T18:36:21.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:21 smithi192 ceph-mon[32842]: from='client.? ' entity='client.admin' 2024-04-26T18:36:21.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:21 smithi192 ceph-mon[32842]: from='client.? ' entity='client.admin' 2024-04-26T18:36:21.863 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:21 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:21.399+0000 7f2699549200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T18:36:21.863 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:21 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:21.484+0000 7f2699549200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T18:36:21.949 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:21 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2075917713' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-26T18:36:21.949 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:21 smithi080 ceph-mon[29135]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-04-26T18:36:21.949 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:21 smithi080 ceph-mon[29135]: from='client.? ' entity='client.admin' 2024-04-26T18:36:21.949 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:21 smithi080 ceph-mon[29135]: from='client.? ' entity='client.admin' 2024-04-26T18:36:22.969 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:22 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:22.635+0000 7f16f0331200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T18:36:22.970 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:22 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:22.806+0000 7f16f0331200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T18:36:23.003 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:22 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:22.662+0000 7f2699549200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T18:36:23.003 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:22 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:22.832+0000 7f2699549200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T18:36:23.003 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:23 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:23.003+0000 7f2699549200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T18:36:23.044 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:22 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:22.747+0000 7f47695ae200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T18:36:23.044 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:22 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:22.921+0000 7f47695ae200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T18:36:23.263 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:22 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:22.975+0000 7f16f0331200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T18:36:23.345 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:23.098+0000 7f47695ae200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T18:36:23.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.447+0000 7fd1b88be700 1 -- 172.21.15.80:0/2672253729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1b4107a90 msgr2=0x7fd1b4107e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:23.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.447+0000 7fd1b88be700 1 --2- 172.21.15.80:0/2672253729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1b4107a90 0x7fd1b4107e70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd19c009990 tx=0x7fd19c009ca0 comp rx=0 tx=0).stop 2024-04-26T18:36:23.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.447+0000 7fd1b88be700 1 -- 172.21.15.80:0/2672253729 shutdown_connections 2024-04-26T18:36:23.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.447+0000 7fd1b88be700 1 --2- 172.21.15.80:0/2672253729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1b41024a0 0x7fd1b410e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:23.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.447+0000 7fd1b88be700 1 --2- 172.21.15.80:0/2672253729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1b4107a90 0x7fd1b4107e70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:23.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.447+0000 7fd1b88be700 1 --2- 172.21.15.80:0/2672253729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b4101ae0 0x7fd1b4101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:23.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.447+0000 7fd1b88be700 1 -- 172.21.15.80:0/2672253729 >> 172.21.15.80:0/2672253729 conn(0x7fd1b4078990 msgr2=0x7fd1b40ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:23.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.447+0000 7fd1b88be700 1 -- 172.21.15.80:0/2672253729 shutdown_connections 2024-04-26T18:36:23.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.447+0000 7fd1b88be700 1 -- 172.21.15.80:0/2672253729 wait complete. 2024-04-26T18:36:23.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.448+0000 7fd1b88be700 1 Processor -- start 2024-04-26T18:36:23.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.448+0000 7fd1b88be700 1 -- start start 2024-04-26T18:36:23.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.448+0000 7fd1b88be700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b4101ae0 0x7fd1b419a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:23.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.448+0000 7fd1b88be700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1b41024a0 0x7fd1b419ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:23.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.448+0000 7fd1b88be700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1b4107a90 0x7fd1b419b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:23.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.448+0000 7fd1b88be700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b41124d0 con 0x7fd1b4107a90 2024-04-26T18:36:23.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.448+0000 7fd1b88be700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b4112350 con 0x7fd1b4101ae0 2024-04-26T18:36:23.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.448+0000 7fd1b88be700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b4112650 con 0x7fd1b41024a0 2024-04-26T18:36:23.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.448+0000 7fd1b2d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1b4107a90 0x7fd1b419b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:23.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.448+0000 7fd1b2d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1b4107a90 0x7fd1b419b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51312/0 (socket says 172.21.15.80:51312) 2024-04-26T18:36:23.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.449+0000 7fd1b2d9d700 1 -- 172.21.15.80:0/3433153667 learned_addr learned my addr 172.21.15.80:0/3433153667 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:23.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.449+0000 7fd1b259c700 1 --2- 172.21.15.80:0/3433153667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b4101ae0 0x7fd1b419a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:23.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.449+0000 7fd1b1d9b700 1 --2- 172.21.15.80:0/3433153667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1b41024a0 0x7fd1b419ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:23.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.449+0000 7fd1b2d9d700 1 -- 172.21.15.80:0/3433153667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1b41024a0 msgr2=0x7fd1b419ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:23.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.449+0000 7fd1b2d9d700 1 --2- 172.21.15.80:0/3433153667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1b41024a0 0x7fd1b419ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:23.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.449+0000 7fd1b2d9d700 1 -- 172.21.15.80:0/3433153667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b4101ae0 msgr2=0x7fd1b419a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:23.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.449+0000 7fd1b2d9d700 1 --2- 172.21.15.80:0/3433153667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b4101ae0 0x7fd1b419a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:23.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.449+0000 7fd1b2d9d700 1 -- 172.21.15.80:0/3433153667 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1b41a5d70 con 0x7fd1b4107a90 2024-04-26T18:36:23.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.449+0000 7fd1b259c700 1 --2- 172.21.15.80:0/3433153667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b4101ae0 0x7fd1b419a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:36:23.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.449+0000 7fd1b2d9d700 1 --2- 172.21.15.80:0/3433153667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1b4107a90 0x7fd1b419b3f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00ada0 tx=0x7fd1ac00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:23.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.449+0000 7fd1ab7fe700 1 -- 172.21.15.80:0/3433153667 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac017020 con 0x7fd1b4107a90 2024-04-26T18:36:23.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.449+0000 7fd1ab7fe700 1 -- 172.21.15.80:0/3433153667 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1ac00cd80 con 0x7fd1b4107a90 2024-04-26T18:36:23.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.449+0000 7fd1b88be700 1 -- 172.21.15.80:0/3433153667 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1b4198780 con 0x7fd1b4107a90 2024-04-26T18:36:23.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.449+0000 7fd1ab7fe700 1 -- 172.21.15.80:0/3433153667 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac005260 con 0x7fd1b4107a90 2024-04-26T18:36:23.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.449+0000 7fd1b88be700 1 -- 172.21.15.80:0/3433153667 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1b4198c70 con 0x7fd1b4107a90 2024-04-26T18:36:23.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.451+0000 7fd1b88be700 1 -- 172.21.15.80:0/3433153667 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1b41031d0 con 0x7fd1b4107a90 2024-04-26T18:36:23.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.452+0000 7fd1ab7fe700 1 -- 172.21.15.80:0/3433153667 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7fd1ac00c8d0 con 0x7fd1b4107a90 2024-04-26T18:36:23.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.452+0000 7fd1ab7fe700 1 --2- 172.21.15.80:0/3433153667 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd1a00a3c90 0x7fd1a00a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:23.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.452+0000 7fd1b259c700 1 -- 172.21.15.80:0/3433153667 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd1a00a3c90 msgr2=0x7fd1a00a6150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/179326828 2024-04-26T18:36:23.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.452+0000 7fd1ab7fe700 1 -- 172.21.15.80:0/3433153667 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fd1ac0cfaa0 con 0x7fd1b4107a90 2024-04-26T18:36:23.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.452+0000 7fd1b259c700 1 --2- 172.21.15.80:0/3433153667 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd1a00a3c90 0x7fd1a00a6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T18:36:23.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.457+0000 7fd1ab7fe700 1 -- 172.21.15.80:0/3433153667 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd1ac021020 con 0x7fd1b4107a90 2024-04-26T18:36:23.559 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:23 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:23.263+0000 7f16f0331200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T18:36:23.559 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:23 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:23.356+0000 7f16f0331200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T18:36:23.587 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:23 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:23.290+0000 7f2699549200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T18:36:23.587 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:23 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:23.382+0000 7f2699549200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T18:36:23.588 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:23 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:23.587+0000 7f2699549200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T18:36:23.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.653+0000 7fd1b259c700 1 -- 172.21.15.80:0/3433153667 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd1a00a3c90 msgr2=0x7fd1a00a6150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/179326828 2024-04-26T18:36:23.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.653+0000 7fd1b259c700 1 --2- 172.21.15.80:0/3433153667 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd1a00a3c90 0x7fd1a00a6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T18:36:23.653 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:23.393+0000 7f47695ae200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T18:36:23.653 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:23.492+0000 7f47695ae200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T18:36:23.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.713+0000 7fd1b88be700 1 -- 172.21.15.80:0/3433153667 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd1b402e490 con 0x7fd1b4107a90 2024-04-26T18:36:23.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.714+0000 7fd1ab7fe700 1 -- 172.21.15.80:0/3433153667 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+73 (secure 0 0 0) 0x7fd1ac09c540 con 0x7fd1b4107a90 2024-04-26T18:36:23.714 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T18:36:23.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.716+0000 7fd1b88be700 1 -- 172.21.15.80:0/3433153667 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd1a00a3c90 msgr2=0x7fd1a00a6150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T18:36:23.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.716+0000 7fd1b88be700 1 --2- 172.21.15.80:0/3433153667 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd1a00a3c90 0x7fd1a00a6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:23.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.716+0000 7fd1b88be700 1 -- 172.21.15.80:0/3433153667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1b4107a90 msgr2=0x7fd1b419b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:23.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.716+0000 7fd1b88be700 1 --2- 172.21.15.80:0/3433153667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1b4107a90 0x7fd1b419b3f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00ada0 tx=0x7fd1ac00c330 comp rx=0 tx=0).stop 2024-04-26T18:36:23.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.716+0000 7fd1b88be700 1 -- 172.21.15.80:0/3433153667 shutdown_connections 2024-04-26T18:36:23.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.716+0000 7fd1b88be700 1 --2- 172.21.15.80:0/3433153667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1b4107a90 0x7fd1b419b3f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:23.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.716+0000 7fd1b88be700 1 --2- 172.21.15.80:0/3433153667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b4101ae0 0x7fd1b419a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:23.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.716+0000 7fd1b88be700 1 --2- 172.21.15.80:0/3433153667 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fd1a00a3c90 0x7fd1a00a6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:23.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.716+0000 7fd1b88be700 1 --2- 172.21.15.80:0/3433153667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1b41024a0 0x7fd1b419ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:23.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.716+0000 7fd1b88be700 1 -- 172.21.15.80:0/3433153667 >> 172.21.15.80:0/3433153667 conn(0x7fd1b4078990 msgr2=0x7fd1b4104910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:23.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.716+0000 7fd1b88be700 1 -- 172.21.15.80:0/3433153667 shutdown_connections 2024-04-26T18:36:23.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:23.716+0000 7fd1b88be700 1 -- 172.21.15.80:0/3433153667 wait complete. 2024-04-26T18:36:23.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:23 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3433153667' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T18:36:23.862 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:23 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:23.783+0000 7f2699549200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T18:36:23.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:23 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3433153667' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T18:36:23.970 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:23 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:23.559+0000 7f16f0331200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T18:36:23.970 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:23 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:23.751+0000 7f16f0331200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T18:36:23.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:23 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3433153667' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T18:36:23.993 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:23.701+0000 7f47695ae200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T18:36:23.993 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:23.902+0000 7f47695ae200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T18:36:24.440 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T18:36:24.440 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T18:36:24.440 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2024-04-26T18:36:24.440 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T18:36:24.440 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T18:36:24.440 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T18:36:24.440 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T18:36:24.440 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T18:36:24.440 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T18:36:24.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T18:36:24.441 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2024-04-26T18:36:24.457 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T18:36:24.457 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T18:36:24.458 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T18:36:24.458 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-26T18:36:24.458 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-04-26T18:36:24.458 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-26T18:36:24.458 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T18:36:24.458 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2024-04-26T18:36:24.458 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2024-04-26T18:36:24.458 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T18:36:24.458 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2024-04-26T18:36:24.458 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2024-04-26T18:36:24.458 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T18:36:24.458 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2024-04-26T18:36:24.458 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T18:36:24.458 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2024-04-26T18:36:24.459 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T18:36:24.459 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 42051sec preferred_lft 42051sec 2024-04-26T18:36:24.459 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::476c:c833:d463:130a/64 scope link noprefixroute 2024-04-26T18:36:24.459 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-26T18:36:24.459 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T18:36:24.460 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T18:36:24.460 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-26T18:36:24.460 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add name ceph-brx type bridge 2024-04-26T18:36:24.460 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip addr flush dev ceph-brx 2024-04-26T18:36:24.460 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set ceph-brx up 2024-04-26T18:36:24.460 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T18:36:24.460 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-26T18:36:24.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T18:36:24.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T18:36:24.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T18:36:24.659 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T18:36:24.674 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:24 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:24.514+0000 7f47695ae200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T18:36:24.682 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-04-26T18:36:24.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T18:36:24.684 DEBUG:teuthology.orchestra.run.smithi080:> route 2024-04-26T18:36:24.720 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:24 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:24.353+0000 7f16f0331200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T18:36:24.745 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2024-04-26T18:36:24.745 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T18:36:24.745 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T18:36:24.745 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T18:36:24.745 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T18:36:24.746 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T18:36:24.746 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-26T18:36:24.746 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T18:36:24.746 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T18:36:24.746 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T18:36:24.746 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-26T18:36:24.805 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:24 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:24.386+0000 7f2699549200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T18:36:24.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T18:36:24.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T18:36:25.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T18:36:25.005 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-26T18:36:25.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T18:36:25.020 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list-id 2024-04-26T18:36:25.073 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:24 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:24.774+0000 7f16f0331200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T18:36:25.073 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:24 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:24.871+0000 7f16f0331200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T18:36:25.075 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T18:36:25.075 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-26T18:36:25.075 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T18:36:25.075 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T18:36:25.075 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-26T18:36:25.105 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:24 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:24.805+0000 7f2699549200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T18:36:25.105 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:24 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:24.902+0000 7f2699549200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T18:36:25.106 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:25 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:25.103+0000 7f2699549200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T18:36:25.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T18:36:25.182 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:24 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:24.968+0000 7f47695ae200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T18:36:25.182 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:25 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:25.071+0000 7f47695ae200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T18:36:25.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T18:36:25.192 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T18:36:25.192 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T18:36:25.192 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-26T18:36:25.192 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T18:36:25.192 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T18:36:25.192 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T18:36:25.192 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T18:36:25.192 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T18:36:25.192 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-26T18:36:25.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T18:36:25.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T18:36:25.318 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T18:36:25.318 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-26T18:36:25.318 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.0 up 2024-04-26T18:36:25.318 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T18:36:25.318 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-26T18:36:25.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T18:36:25.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T18:36:25.395 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T18:36:25.395 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T18:36:25.410 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T18:36:25.410 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T18:36:25.410 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T18:36:25.465 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-04-26T18:36:25.465 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-04-26T18:36:25.465 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/9d1fbf3d-f487-4990-88c4-35f4a747e017 2024-04-26T18:36:25.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T18:36:25.466 DEBUG:teuthology.orchestra.run.smithi080:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/9d1fbf3d-f487-4990-88c4-35f4a747e017 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-04-26T18:36:25.469 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:25 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:25.073+0000 7f16f0331200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T18:36:25.493 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:25 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:25.293+0000 7f47695ae200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T18:36:25.542 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-04-26T18:36:25.542 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2024-04-26T18:36:25.542 INFO:teuthology.orchestra.run.smithi080.stdout:invalid new device string format 2024-04-26T18:36:25.649 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-04-26T18:36:25.649 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2024-04-26T18:36:25.649 INFO:teuthology.orchestra.run.smithi080.stdout:invalid new device string format 2024-04-26T18:36:25.649 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.82:3300,172.21.15.192:3300" 2024-04-26T18:36:25.649 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.80:3300,172.21.15.82:3300,172.21.15.192:3300:/volumes/qa/sv_1/9d1fbf3d-f487-4990-88c4-35f4a747e017 2024-04-26T18:36:25.649 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,key=0,fsid=2187ca98-03fa-11ef-bc93-c7b262605968" will pass to kernel 2024-04-26T18:36:25.650 INFO:teuthology.orchestra.run.smithi080.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-26T18:36:25.650 INFO:teuthology.orchestra.run.smithi080.stdout: You just mounted a file system that supports labels which does not 2024-04-26T18:36:25.650 INFO:teuthology.orchestra.run.smithi080.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T18:36:25.650 INFO:teuthology.orchestra.run.smithi080.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T18:36:25.650 INFO:teuthology.orchestra.run.smithi080.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T18:36:25.652 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T18:36:25.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T18:36:25.652 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T18:36:25.679 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T18:36:25.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T18:36:25.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T18:36:25.777 INFO:teuthology.orchestra.run.smithi080.stdout:client24809 2024-04-26T18:36:25.777 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T18:36:25.777 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T18:36:25.793 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T18:36:25.847 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:25 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:25.847+0000 7f47695ae200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T18:36:25.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T18:36:25.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T18:36:25.890 INFO:teuthology.orchestra.run.smithi080.stdout:client24809 2024-04-26T18:36:25.890 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T18:36:25.927 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:25 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:25.591+0000 7f16f0331200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T18:36:25.928 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:25 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:25.684+0000 7f16f0331200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T18:36:25.961 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:25 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:25.626+0000 7f2699549200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T18:36:25.961 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:25 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:25.721+0000 7f2699549200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T18:36:25.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T18:36:25.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T18:36:25.986 INFO:teuthology.orchestra.run.smithi080.stdout:client24809 2024-04-26T18:36:25.987 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/2187ca98-03fa-11ef-bc93-c7b262605968.client24809/status') 2024-04-26T18:36:26.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T18:36:26.046 INFO:teuthology.orchestra.run.smithi080.stdout:instance: client.24809 (3)172.21.15.80:0/2761672841 2024-04-26T18:36:26.046 INFO:teuthology.orchestra.run.smithi080.stdout:blocklisted: false 2024-04-26T18:36:26.046 INFO:teuthology.orchestra.run.smithi080.stderr:0+1 records in 2024-04-26T18:36:26.046 INFO:teuthology.orchestra.run.smithi080.stderr:0+1 records out 2024-04-26T18:36:26.046 INFO:teuthology.orchestra.run.smithi080.stderr:71 bytes copied, 2.246e-05 s, 3.2 MB/s 2024-04-26T18:36:26.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T18:36:26.053 INFO:teuthology.run_tasks:Running task exec... 2024-04-26T18:36:26.062 INFO:teuthology.task.exec:Executing custom commands... 2024-04-26T18:36:26.062 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi080.front.sepia.ceph.com 2024-04-26T18:36:26.062 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-04-26T18:36:26.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.165+0000 7fe8657da640 1 -- 172.21.15.80:0/1304333713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe860076970 msgr2=0x7fe860074dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:26.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.165+0000 7fe8657da640 1 --2- 172.21.15.80:0/1304333713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe860076970 0x7fe860074dc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe850009900 tx=0x7fe85002a410 comp rx=0 tx=0).stop 2024-04-26T18:36:26.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.165+0000 7fe8657da640 1 -- 172.21.15.80:0/1304333713 shutdown_connections 2024-04-26T18:36:26.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.165+0000 7fe8657da640 1 --2- 172.21.15.80:0/1304333713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe86010a850 0x7fe86010cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:26.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.165+0000 7fe8657da640 1 --2- 172.21.15.80:0/1304333713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe860075390 0x7fe860075810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:26.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.165+0000 7fe8657da640 1 --2- 172.21.15.80:0/1304333713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe860076970 0x7fe860074dc0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:26.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.165+0000 7fe8657da640 1 -- 172.21.15.80:0/1304333713 >> 172.21.15.80:0/1304333713 conn(0x7fe8600fdf20 msgr2=0x7fe860100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:26.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.165+0000 7fe8657da640 1 -- 172.21.15.80:0/1304333713 shutdown_connections 2024-04-26T18:36:26.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.165+0000 7fe8657da640 1 -- 172.21.15.80:0/1304333713 wait complete. 2024-04-26T18:36:26.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.165+0000 7fe8657da640 1 Processor -- start 2024-04-26T18:36:26.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.165+0000 7fe8657da640 1 -- start start 2024-04-26T18:36:26.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.165+0000 7fe8657da640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe860075390 0x7fe86019ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:26.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.165+0000 7fe8657da640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe860076970 0x7fe86019b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:26.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.165+0000 7fe8657da640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe86010a850 0x7fe8601a2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:26.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.166+0000 7fe8657da640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe8601106a0 con 0x7fe860075390 2024-04-26T18:36:26.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.166+0000 7fe8657da640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe860110520 con 0x7fe86010a850 2024-04-26T18:36:26.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.166+0000 7fe8657da640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe860110820 con 0x7fe860076970 2024-04-26T18:36:26.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.166+0000 7fe85effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe860075390 0x7fe86019ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:26.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.166+0000 7fe85effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe860075390 0x7fe86019ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37260/0 (socket says 172.21.15.80:37260) 2024-04-26T18:36:26.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.166+0000 7fe85effd640 1 -- 172.21.15.80:0/417455866 learned_addr learned my addr 172.21.15.80:0/417455866 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:26.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.166+0000 7fe85f7fe640 1 --2- 172.21.15.80:0/417455866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe86010a850 0x7fe8601a2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:26.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.166+0000 7fe857fff640 1 --2- 172.21.15.80:0/417455866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe860076970 0x7fe86019b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:26.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.166+0000 7fe85effd640 1 -- 172.21.15.80:0/417455866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe860076970 msgr2=0x7fe86019b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:26.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.166+0000 7fe85effd640 1 --2- 172.21.15.80:0/417455866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe860076970 0x7fe86019b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:26.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.166+0000 7fe85effd640 1 -- 172.21.15.80:0/417455866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe86010a850 msgr2=0x7fe8601a2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:26.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.166+0000 7fe85effd640 1 --2- 172.21.15.80:0/417455866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe86010a850 0x7fe8601a2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:26.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.166+0000 7fe85effd640 1 -- 172.21.15.80:0/417455866 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8601a2920 con 0x7fe860075390 2024-04-26T18:36:26.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.166+0000 7fe85f7fe640 1 --2- 172.21.15.80:0/417455866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe86010a850 0x7fe8601a2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:36:26.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.166+0000 7fe85effd640 1 --2- 172.21.15.80:0/417455866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe860075390 0x7fe86019ad10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe850005940 tx=0x7fe8500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:26.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.166+0000 7fe85cff9640 1 -- 172.21.15.80:0/417455866 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85003f030 con 0x7fe860075390 2024-04-26T18:36:26.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.166+0000 7fe85cff9640 1 -- 172.21.15.80:0/417455866 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe850003cb0 con 0x7fe860075390 2024-04-26T18:36:26.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.166+0000 7fe8657da640 1 -- 172.21.15.80:0/417455866 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8601a2bb0 con 0x7fe860075390 2024-04-26T18:36:26.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.166+0000 7fe85cff9640 1 -- 172.21.15.80:0/417455866 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe850035070 con 0x7fe860075390 2024-04-26T18:36:26.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.166+0000 7fe8657da640 1 -- 172.21.15.80:0/417455866 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8601a30a0 con 0x7fe860075390 2024-04-26T18:36:26.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.168+0000 7fe8657da640 1 -- 172.21.15.80:0/417455866 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe860109580 con 0x7fe860075390 2024-04-26T18:36:26.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.168+0000 7fe85cff9640 1 -- 172.21.15.80:0/417455866 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7fe850042030 con 0x7fe860075390 2024-04-26T18:36:26.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.169+0000 7fe85cff9640 1 --2- 172.21.15.80:0/417455866 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe84c0a3ca0 0x7fe84c0a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:26.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.169+0000 7fe857fff640 1 -- 172.21.15.80:0/417455866 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe84c0a3ca0 msgr2=0x7fe84c0a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/179326828 2024-04-26T18:36:26.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.169+0000 7fe85cff9640 1 -- 172.21.15.80:0/417455866 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7fe8500f0870 con 0x7fe860075390 2024-04-26T18:36:26.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.169+0000 7fe857fff640 1 --2- 172.21.15.80:0/417455866 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe84c0a3ca0 0x7fe84c0a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T18:36:26.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.173+0000 7fe85cff9640 1 -- 172.21.15.80:0/417455866 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe850003e60 con 0x7fe860075390 2024-04-26T18:36:26.209 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:25 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:25.945+0000 7f47695ae200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T18:36:26.219 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:25 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:25.927+0000 7f16f0331200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T18:36:26.219 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:26 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:26.061+0000 7f16f0331200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T18:36:26.219 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:26 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:26.157+0000 7f16f0331200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T18:36:26.305 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:25 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:25.961+0000 7f2699549200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T18:36:26.306 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:26 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:26.093+0000 7f2699549200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T18:36:26.306 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:26 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:26.189+0000 7f2699549200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T18:36:26.306 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:26 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:26.305+0000 7f2699549200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T18:36:26.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.370+0000 7fe857fff640 1 -- 172.21.15.80:0/417455866 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe84c0a3ca0 msgr2=0x7fe84c0a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/179326828 2024-04-26T18:36:26.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.370+0000 7fe857fff640 1 --2- 172.21.15.80:0/417455866 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe84c0a3ca0 0x7fe84c0a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T18:36:26.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.400+0000 7fe8657da640 1 -- 172.21.15.80:0/417455866 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7fe860063530 con 0x7fe860075390 2024-04-26T18:36:26.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.452+0000 7fe85cff9640 1 -- 172.21.15.80:0/417455866 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v27) ==== 118+0+0 (secure 0 0 0) 0x7fe8500bcc30 con 0x7fe860075390 2024-04-26T18:36:26.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.455+0000 7fe8657da640 1 -- 172.21.15.80:0/417455866 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe84c0a3ca0 msgr2=0x7fe84c0a6160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T18:36:26.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.455+0000 7fe8657da640 1 --2- 172.21.15.80:0/417455866 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe84c0a3ca0 0x7fe84c0a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:26.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.455+0000 7fe8657da640 1 -- 172.21.15.80:0/417455866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe860075390 msgr2=0x7fe86019ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:26.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.455+0000 7fe8657da640 1 --2- 172.21.15.80:0/417455866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe860075390 0x7fe86019ad10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe850005940 tx=0x7fe8500042f0 comp rx=0 tx=0).stop 2024-04-26T18:36:26.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.455+0000 7fe8657da640 1 -- 172.21.15.80:0/417455866 shutdown_connections 2024-04-26T18:36:26.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.455+0000 7fe8657da640 1 --2- 172.21.15.80:0/417455866 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7fe84c0a3ca0 0x7fe84c0a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:26.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.455+0000 7fe8657da640 1 --2- 172.21.15.80:0/417455866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe86010a850 0x7fe8601a2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:26.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.455+0000 7fe8657da640 1 --2- 172.21.15.80:0/417455866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe860076970 0x7fe86019b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:26.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.455+0000 7fe8657da640 1 --2- 172.21.15.80:0/417455866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe860075390 0x7fe86019ad10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:26.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.455+0000 7fe8657da640 1 -- 172.21.15.80:0/417455866 >> 172.21.15.80:0/417455866 conn(0x7fe8600fdf20 msgr2=0x7fe860106750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:26.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.455+0000 7fe8657da640 1 -- 172.21.15.80:0/417455866 shutdown_connections 2024-04-26T18:36:26.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.455+0000 7fe8657da640 1 -- 172.21.15.80:0/417455866 wait complete. 2024-04-26T18:36:26.466 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:26 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/417455866' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-04-26T18:36:26.466 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:26 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:26.208+0000 7f47695ae200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T18:36:26.466 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:26 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:26.347+0000 7f47695ae200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T18:36:26.466 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:26 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:26.447+0000 7f47695ae200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T18:36:26.467 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-04-26T18:36:26.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.572+0000 7ff3e5cbd640 1 -- 172.21.15.80:0/3492969469 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3e0102a80 msgr2=0x7ff3e0102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:26.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.572+0000 7ff3e5cbd640 1 --2- 172.21.15.80:0/3492969469 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3e0102a80 0x7ff3e0102f00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009900 tx=0x7ff3d402a410 comp rx=0 tx=0).stop 2024-04-26T18:36:26.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.572+0000 7ff3e5cbd640 1 -- 172.21.15.80:0/3492969469 shutdown_connections 2024-04-26T18:36:26.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.572+0000 7ff3e5cbd640 1 --2- 172.21.15.80:0/3492969469 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3e0102a80 0x7ff3e0102f00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:26.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.572+0000 7ff3e5cbd640 1 --2- 172.21.15.80:0/3492969469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3e0103440 0x7ff3e0109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:26.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.572+0000 7ff3e5cbd640 1 --2- 172.21.15.80:0/3492969469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3e0101890 0x7ff3e0101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:26.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.572+0000 7ff3e5cbd640 1 -- 172.21.15.80:0/3492969469 >> 172.21.15.80:0/3492969469 conn(0x7ff3e00fce00 msgr2=0x7ff3e00ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:26.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.572+0000 7ff3e5cbd640 1 -- 172.21.15.80:0/3492969469 shutdown_connections 2024-04-26T18:36:26.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.573+0000 7ff3e5cbd640 1 -- 172.21.15.80:0/3492969469 wait complete. 2024-04-26T18:36:26.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.573+0000 7ff3e5cbd640 1 Processor -- start 2024-04-26T18:36:26.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.573+0000 7ff3e5cbd640 1 -- start start 2024-04-26T18:36:26.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.573+0000 7ff3e5cbd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3e0101890 0x7ff3e006ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:26.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.573+0000 7ff3e5cbd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3e0102a80 0x7ff3e019d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:26.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.573+0000 7ff3e5cbd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3e0103440 0x7ff3e019fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:26.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.573+0000 7ff3e5cbd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e010d3c0 con 0x7ff3e0103440 2024-04-26T18:36:26.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.573+0000 7ff3e5cbd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e010d240 con 0x7ff3e0101890 2024-04-26T18:36:26.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.573+0000 7ff3e5cbd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e010d540 con 0x7ff3e0102a80 2024-04-26T18:36:26.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.574+0000 7ff3df7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3e0101890 0x7ff3e006ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:26.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.574+0000 7ff3dffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3e0103440 0x7ff3e019fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:26.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.574+0000 7ff3df7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3e0101890 0x7ff3e006ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:58802/0 (socket says 172.21.15.80:58802) 2024-04-26T18:36:26.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.574+0000 7ff3df7fe640 1 -- 172.21.15.80:0/2097852184 learned_addr learned my addr 172.21.15.80:0/2097852184 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:26.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.574+0000 7ff3deffd640 1 --2- 172.21.15.80:0/2097852184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3e0102a80 0x7ff3e019d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:26.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.574+0000 7ff3df7fe640 1 -- 172.21.15.80:0/2097852184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3e0102a80 msgr2=0x7ff3e019d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:26.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.574+0000 7ff3df7fe640 1 --2- 172.21.15.80:0/2097852184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3e0102a80 0x7ff3e019d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:26.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.574+0000 7ff3df7fe640 1 -- 172.21.15.80:0/2097852184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3e0103440 msgr2=0x7ff3e019fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:26.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.574+0000 7ff3df7fe640 1 --2- 172.21.15.80:0/2097852184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3e0103440 0x7ff3e019fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:26.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.574+0000 7ff3df7fe640 1 -- 172.21.15.80:0/2097852184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e01a07b0 con 0x7ff3e0101890 2024-04-26T18:36:26.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.574+0000 7ff3dffff640 1 --2- 172.21.15.80:0/2097852184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3e0103440 0x7ff3e019fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:36:26.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.574+0000 7ff3df7fe640 1 --2- 172.21.15.80:0/2097852184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3e0101890 0x7ff3e006ab50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff3d000e9c0 tx=0x7ff3d000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:26.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.574+0000 7ff3dcff9640 1 -- 172.21.15.80:0/2097852184 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d000cd80 con 0x7ff3e0101890 2024-04-26T18:36:26.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.574+0000 7ff3e5cbd640 1 -- 172.21.15.80:0/2097852184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e01a0a40 con 0x7ff3e0101890 2024-04-26T18:36:26.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.574+0000 7ff3dcff9640 1 -- 172.21.15.80:0/2097852184 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3d00035f0 con 0x7ff3e0101890 2024-04-26T18:36:26.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.574+0000 7ff3dcff9640 1 -- 172.21.15.80:0/2097852184 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d0010690 con 0x7ff3e0101890 2024-04-26T18:36:26.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.574+0000 7ff3e5cbd640 1 -- 172.21.15.80:0/2097852184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e01a0fb0 con 0x7ff3e0101890 2024-04-26T18:36:26.578 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:26 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/417455866' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-04-26T18:36:26.578 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:26 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:26.272+0000 7f16f0331200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T18:36:26.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.575+0000 7ff3e5cbd640 1 -- 172.21.15.80:0/2097852184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3e00506c0 con 0x7ff3e0101890 2024-04-26T18:36:26.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.576+0000 7ff3dcff9640 1 -- 172.21.15.80:0/2097852184 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7ff3d00037a0 con 0x7ff3e0101890 2024-04-26T18:36:26.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.577+0000 7ff3dcff9640 1 --2- 172.21.15.80:0/2097852184 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff3c80a3ca0 0x7ff3c80a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:26.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.577+0000 7ff3deffd640 1 -- 172.21.15.80:0/2097852184 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff3c80a3ca0 msgr2=0x7ff3c80a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/179326828 2024-04-26T18:36:26.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.577+0000 7ff3dcff9640 1 -- 172.21.15.80:0/2097852184 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8182+0+0 (secure 0 0 0) 0x7ff3d00d0970 con 0x7ff3e0101890 2024-04-26T18:36:26.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.577+0000 7ff3deffd640 1 --2- 172.21.15.80:0/2097852184 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff3c80a3ca0 0x7ff3c80a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T18:36:26.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.585+0000 7ff3dcff9640 1 -- 172.21.15.80:0/2097852184 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff3d0053ff0 con 0x7ff3e0101890 2024-04-26T18:36:26.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:26 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/417455866' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-04-26T18:36:26.743 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:26 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:26.576+0000 7f47695ae200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T18:36:26.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.778+0000 7ff3deffd640 1 -- 172.21.15.80:0/2097852184 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff3c80a3ca0 msgr2=0x7ff3c80a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/179326828 2024-04-26T18:36:26.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.778+0000 7ff3deffd640 1 --2- 172.21.15.80:0/2097852184 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff3c80a3ca0 0x7ff3c80a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T18:36:26.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:26.796+0000 7ff3e5cbd640 1 -- 172.21.15.80:0/2097852184 --> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7ff3e0062f70 con 0x7ff3c80a3ca0 2024-04-26T18:36:26.969 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:26 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:26.573+0000 7f16f0331200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T18:36:27.112 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:26 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:26.615+0000 7f2699549200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T18:36:27.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:27.179+0000 7ff3deffd640 1 -- 172.21.15.80:0/2097852184 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff3c80a3ca0 msgr2=0x7ff3c80a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/179326828 2024-04-26T18:36:27.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:27.179+0000 7ff3deffd640 1 --2- 172.21.15.80:0/2097852184 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff3c80a3ca0 0x7ff3c80a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T18:36:27.243 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:26 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:26.886+0000 7f47695ae200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T18:36:27.459 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:27 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:27.181+0000 7f16f0331200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T18:36:27.459 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:36:27 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y[34191]: 2024-04-26T18:36:27.397+0000 7f16f0331200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T18:36:27.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:27.471+0000 7ff3dcff9640 1 -- 172.21.15.80:0/2097852184 <== mon.2 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 20) ==== 138663+0+0 (secure 0 0 0) 0x7ff3d00992f0 con 0x7ff3e0101890 2024-04-26T18:36:27.612 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:27 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:27.210+0000 7f2699549200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T18:36:27.612 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:36:27 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z[34695]: 2024-04-26T18:36:27.424+0000 7f2699549200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T18:36:27.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:27 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/417455866' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-04-26T18:36:27.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:27 smithi192 ceph-mon[32842]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T18:36:27.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:27 smithi192 ceph-mon[32842]: Standby manager daemon y restarted 2024-04-26T18:36:27.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:27 smithi192 ceph-mon[32842]: Standby manager daemon y started 2024-04-26T18:36:27.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:27 smithi192 ceph-mon[32842]: from='mgr.? 172.21.15.82:0/569838084' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T18:36:27.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:27 smithi192 ceph-mon[32842]: from='mgr.? 172.21.15.82:0/569838084' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T18:36:27.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:27 smithi192 ceph-mon[32842]: from='mgr.? 172.21.15.82:0/569838084' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T18:36:27.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:27 smithi192 ceph-mon[32842]: from='mgr.? 172.21.15.82:0/569838084' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T18:36:27.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:27 smithi192 ceph-mon[32842]: Standby manager daemon z restarted 2024-04-26T18:36:27.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:27 smithi192 ceph-mon[32842]: Standby manager daemon z started 2024-04-26T18:36:27.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:27 smithi192 ceph-mon[32842]: from='mgr.? 172.21.15.192:0/208239478' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T18:36:27.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:27 smithi192 ceph-mon[32842]: from='mgr.? 172.21.15.192:0/208239478' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T18:36:27.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:27 smithi192 ceph-mon[32842]: from='mgr.? 172.21.15.192:0/208239478' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T18:36:27.614 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:27 smithi192 ceph-mon[32842]: from='mgr.? 172.21.15.192:0/208239478' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T18:36:27.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:27 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/417455866' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-04-26T18:36:27.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:27 smithi082 ceph-mon[32808]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T18:36:27.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:27 smithi082 ceph-mon[32808]: Standby manager daemon y restarted 2024-04-26T18:36:27.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:27 smithi082 ceph-mon[32808]: Standby manager daemon y started 2024-04-26T18:36:27.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:27 smithi082 ceph-mon[32808]: from='mgr.? 172.21.15.82:0/569838084' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T18:36:27.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:27 smithi082 ceph-mon[32808]: from='mgr.? 172.21.15.82:0/569838084' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T18:36:27.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:27 smithi082 ceph-mon[32808]: from='mgr.? 172.21.15.82:0/569838084' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T18:36:27.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:27 smithi082 ceph-mon[32808]: from='mgr.? 172.21.15.82:0/569838084' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T18:36:27.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:27 smithi082 ceph-mon[32808]: Standby manager daemon z restarted 2024-04-26T18:36:27.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:27 smithi082 ceph-mon[32808]: Standby manager daemon z started 2024-04-26T18:36:27.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:27 smithi082 ceph-mon[32808]: from='mgr.? 172.21.15.192:0/208239478' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T18:36:27.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:27 smithi082 ceph-mon[32808]: from='mgr.? 172.21.15.192:0/208239478' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T18:36:27.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:27 smithi082 ceph-mon[32808]: from='mgr.? 172.21.15.192:0/208239478' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T18:36:27.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:27 smithi082 ceph-mon[32808]: from='mgr.? 172.21.15.192:0/208239478' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T18:36:27.721 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:27.499+0000 7f47695ae200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T18:36:27.721 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/417455866' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-04-26T18:36:27.721 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-mon[29135]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T18:36:27.721 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-mon[29135]: Standby manager daemon y restarted 2024-04-26T18:36:27.721 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-mon[29135]: Standby manager daemon y started 2024-04-26T18:36:27.721 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-mon[29135]: from='mgr.? 172.21.15.82:0/569838084' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T18:36:27.721 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-mon[29135]: from='mgr.? 172.21.15.82:0/569838084' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T18:36:27.722 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-mon[29135]: from='mgr.? 172.21.15.82:0/569838084' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T18:36:27.722 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-mon[29135]: from='mgr.? 172.21.15.82:0/569838084' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T18:36:27.722 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-mon[29135]: Standby manager daemon z restarted 2024-04-26T18:36:27.722 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-mon[29135]: Standby manager daemon z started 2024-04-26T18:36:27.722 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-mon[29135]: from='mgr.? 172.21.15.192:0/208239478' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T18:36:27.722 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-mon[29135]: from='mgr.? 172.21.15.192:0/208239478' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T18:36:27.722 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-mon[29135]: from='mgr.? 172.21.15.192:0/208239478' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T18:36:27.722 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-mon[29135]: from='mgr.? 172.21.15.192:0/208239478' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T18:36:27.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:27.734+0000 7ff3dcff9640 1 -- 172.21.15.80:0/2097852184 <== mon.2 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 21) ==== 138331+0+0 (secure 0 0 0) 0x7ff3d00a43b0 con 0x7ff3e0101890 2024-04-26T18:36:27.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:27.735+0000 7ff3dcff9640 1 -- 172.21.15.80:0/2097852184 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff3c80a3ca0 msgr2=0x7ff3c80a6160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T18:36:27.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:27.735+0000 7ff3dcff9640 1 --2- 172.21.15.80:0/2097852184 >> [v2:172.21.15.80:6800/179326828,v1:172.21.15.80:6801/179326828] conn(0x7ff3c80a3ca0 0x7ff3c80a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:27.993 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:27.720+0000 7f47695ae200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T18:36:27.993 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:27.966+0000 7f46cb74f700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:36:27.993 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:27.966+0000 7f46cb74f700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:36:27.994 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:27.966+0000 7f46cb74f700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:36:27.994 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:27.966+0000 7f46cb74f700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:36:27.994 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:27.966+0000 7f46cb74f700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:36:27.994 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:27.967+0000 7f46c8709700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:36:27.994 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:27.967+0000 7f46c8709700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:36:27.994 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:27.967+0000 7f46c8709700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:36:27.994 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:27.967+0000 7f46c8709700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:36:27.994 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:27 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:27.967+0000 7f46c8709700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:36:28.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-04-26T18:36:28.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: Active manager daemon x restarted 2024-04-26T18:36:28.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: Activating manager daemon x 2024-04-26T18:36:28.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: osdmap e92: 12 total, 12 up, 12 in 2024-04-26T18:36:28.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: mgrmap e21: x(active, starting, since 0.010697s), standbys: z, y 2024-04-26T18:36:28.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T18:36:28.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:36:28.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T18:36:28.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T18:36:28.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T18:36:28.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T18:36:28.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T18:36:28.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T18:36:28.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T18:36:28.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T18:36:28.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T18:36:28.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T18:36:28.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T18:36:28.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T18:36:28.722 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T18:36:28.722 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T18:36:28.722 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T18:36:28.722 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T18:36:28.722 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T18:36:28.722 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T18:36:28.722 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T18:36:28.722 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T18:36:28.722 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T18:36:28.722 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T18:36:28.722 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T18:36:28.722 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T18:36:28.722 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T18:36:28.722 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T18:36:28.723 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T18:36:28.723 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T18:36:28.723 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T18:36:28.723 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T18:36:28.723 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T18:36:28.723 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: Manager daemon x is now available 2024-04-26T18:36:28.723 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:36:28.723 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T18:36:28.723 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:28 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T18:36:28.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.739+0000 7ff3dcff9640 1 -- 172.21.15.80:0/2097852184 <== mon.2 v2:172.21.15.82:3300/0 9 ==== mgrmap(e 22) ==== 138458+0+0 (secure 0 0 0) 0x7ff3d00ce4f0 con 0x7ff3e0101890 2024-04-26T18:36:28.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.739+0000 7ff3dcff9640 1 --2- 172.21.15.80:0/2097852184 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7ff3c8035480 0x7ff3c8035860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:28.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.740+0000 7ff3dcff9640 1 -- 172.21.15.80:0/2097852184 --> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7ff3d009b970 con 0x7ff3c8035480 2024-04-26T18:36:28.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-04-26T18:36:28.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: Active manager daemon x restarted 2024-04-26T18:36:28.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: Activating manager daemon x 2024-04-26T18:36:28.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: osdmap e92: 12 total, 12 up, 12 in 2024-04-26T18:36:28.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: mgrmap e21: x(active, starting, since 0.010697s), standbys: z, y 2024-04-26T18:36:28.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T18:36:28.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:36:28.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T18:36:28.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T18:36:28.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T18:36:28.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T18:36:28.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T18:36:28.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T18:36:28.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T18:36:28.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T18:36:28.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T18:36:28.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T18:36:28.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T18:36:28.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T18:36:28.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T18:36:28.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T18:36:28.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T18:36:28.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T18:36:28.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T18:36:28.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T18:36:28.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T18:36:28.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T18:36:28.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T18:36:28.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T18:36:28.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T18:36:28.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T18:36:28.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T18:36:28.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T18:36:28.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T18:36:28.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T18:36:28.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T18:36:28.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T18:36:28.746 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T18:36:28.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: Manager daemon x is now available 2024-04-26T18:36:28.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:36:28.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T18:36:28.747 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T18:36:28.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.745+0000 7ff3deffd640 1 --2- 172.21.15.80:0/2097852184 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7ff3c8035480 0x7ff3c8035860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:28.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.750+0000 7ff3deffd640 1 --2- 172.21.15.80:0/2097852184 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7ff3c8035480 0x7ff3c8035860 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4000c00 tx=0x7ff3d40314a0 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:28.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.766+0000 7ff3dcff9640 1 -- 172.21.15.80:0/2097852184 <== mgr.24736 v2:172.21.15.80:6800/1522002759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7ff3d009b970 con 0x7ff3c8035480 2024-04-26T18:36:28.766 INFO:teuthology.orchestra.run.smithi080.stdout:{} 2024-04-26T18:36:28.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.768+0000 7ff3e5cbd640 1 -- 172.21.15.80:0/2097852184 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7ff3c8035480 msgr2=0x7ff3c8035860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:28.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.768+0000 7ff3e5cbd640 1 --2- 172.21.15.80:0/2097852184 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7ff3c8035480 0x7ff3c8035860 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4000c00 tx=0x7ff3d40314a0 comp rx=0 tx=0).stop 2024-04-26T18:36:28.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.768+0000 7ff3e5cbd640 1 -- 172.21.15.80:0/2097852184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3e0101890 msgr2=0x7ff3e006ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:28.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.768+0000 7ff3e5cbd640 1 --2- 172.21.15.80:0/2097852184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3e0101890 0x7ff3e006ab50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff3d000e9c0 tx=0x7ff3d000ee80 comp rx=0 tx=0).stop 2024-04-26T18:36:28.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.769+0000 7ff3dffff640 1 -- 172.21.15.80:0/2097852184 reap_dead start 2024-04-26T18:36:28.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.769+0000 7ff3e5cbd640 1 -- 172.21.15.80:0/2097852184 shutdown_connections 2024-04-26T18:36:28.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.769+0000 7ff3e5cbd640 1 -- 172.21.15.80:0/2097852184 >> 172.21.15.80:0/2097852184 conn(0x7ff3e00fce00 msgr2=0x7ff3e0105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:28.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.769+0000 7ff3e5cbd640 1 -- 172.21.15.80:0/2097852184 shutdown_connections 2024-04-26T18:36:28.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.769+0000 7ff3e5cbd640 1 -- 172.21.15.80:0/2097852184 wait complete. 2024-04-26T18:36:28.783 INFO:teuthology.run_tasks:Running task check-counter... 2024-04-26T18:36:28.797 INFO:teuthology.run_tasks:Running task exec... 2024-04-26T18:36:28.808 INFO:teuthology.task.exec:Executing custom commands... 2024-04-26T18:36:28.808 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi080.front.sepia.ceph.com 2024-04-26T18:36:28.809 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-04-26T18:36:28.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-04-26T18:36:28.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: Active manager daemon x restarted 2024-04-26T18:36:28.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: Activating manager daemon x 2024-04-26T18:36:28.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: osdmap e92: 12 total, 12 up, 12 in 2024-04-26T18:36:28.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: mgrmap e21: x(active, starting, since 0.010697s), standbys: z, y 2024-04-26T18:36:28.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T18:36:28.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T18:36:28.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T18:36:28.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T18:36:28.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T18:36:28.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T18:36:28.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T18:36:28.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T18:36:28.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T18:36:28.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T18:36:28.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T18:36:28.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T18:36:28.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T18:36:28.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T18:36:28.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T18:36:28.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T18:36:28.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T18:36:28.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T18:36:28.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T18:36:28.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T18:36:28.865 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T18:36:28.865 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T18:36:28.865 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T18:36:28.865 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T18:36:28.865 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T18:36:28.865 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T18:36:28.865 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T18:36:28.865 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T18:36:28.865 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T18:36:28.865 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T18:36:28.865 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T18:36:28.865 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T18:36:28.865 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T18:36:28.865 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: Manager daemon x is now available 2024-04-26T18:36:28.865 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:36:28.866 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T18:36:28.866 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:28 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T18:36:28.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.910+0000 7f241f233640 1 -- 172.21.15.80:0/3944329850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2418103410 msgr2=0x7f2418105800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:28.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.910+0000 7f241f233640 1 --2- 172.21.15.80:0/3944329850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2418103410 0x7f2418105800 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f240c009900 tx=0x7f240c02a410 comp rx=0 tx=0).stop 2024-04-26T18:36:28.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.910+0000 7f241f233640 1 -- 172.21.15.80:0/3944329850 shutdown_connections 2024-04-26T18:36:28.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.910+0000 7f241f233640 1 --2- 172.21.15.80:0/3944329850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2418108670 0x7f241810aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:28.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.910+0000 7f241f233640 1 --2- 172.21.15.80:0/3944329850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2418105d40 0x7f2418108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:28.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.910+0000 7f241f233640 1 --2- 172.21.15.80:0/3944329850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2418103410 0x7f2418105800 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:28.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.910+0000 7f241f233640 1 -- 172.21.15.80:0/3944329850 >> 172.21.15.80:0/3944329850 conn(0x7f24180fce00 msgr2=0x7f24180ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:28.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.910+0000 7f241f233640 1 -- 172.21.15.80:0/3944329850 shutdown_connections 2024-04-26T18:36:28.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.910+0000 7f241f233640 1 -- 172.21.15.80:0/3944329850 wait complete. 2024-04-26T18:36:28.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.910+0000 7f241f233640 1 Processor -- start 2024-04-26T18:36:28.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.910+0000 7f241f233640 1 -- start start 2024-04-26T18:36:28.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.910+0000 7f241f233640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2418103410 0x7f2418198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:28.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.910+0000 7f241f233640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2418105d40 0x7f24181990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:28.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.910+0000 7f241f233640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2418108670 0x7f24181a0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:28.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.910+0000 7f241f233640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f241810e4c0 con 0x7f2418103410 2024-04-26T18:36:28.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.910+0000 7f241f233640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f241810e340 con 0x7f2418105d40 2024-04-26T18:36:28.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.910+0000 7f241f233640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f241810e640 con 0x7f2418108670 2024-04-26T18:36:28.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.911+0000 7f241cfcf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2418103410 0x7f2418198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:28.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.911+0000 7f241cfcf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2418103410 0x7f2418198b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37422/0 (socket says 172.21.15.80:37422) 2024-04-26T18:36:28.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.911+0000 7f241cfcf640 1 -- 172.21.15.80:0/1475921092 learned_addr learned my addr 172.21.15.80:0/1475921092 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:28.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.911+0000 7f2417fff640 1 --2- 172.21.15.80:0/1475921092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2418105d40 0x7f24181990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:28.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.911+0000 7f241d7d0640 1 --2- 172.21.15.80:0/1475921092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2418108670 0x7f24181a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:28.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.911+0000 7f241cfcf640 1 -- 172.21.15.80:0/1475921092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2418108670 msgr2=0x7f24181a0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:28.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.911+0000 7f241cfcf640 1 --2- 172.21.15.80:0/1475921092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2418108670 0x7f24181a0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:28.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.911+0000 7f241cfcf640 1 -- 172.21.15.80:0/1475921092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2418105d40 msgr2=0x7f24181990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:28.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.911+0000 7f241cfcf640 1 --2- 172.21.15.80:0/1475921092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2418105d40 0x7f24181990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:28.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.911+0000 7f241cfcf640 1 -- 172.21.15.80:0/1475921092 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24181a0790 con 0x7f2418103410 2024-04-26T18:36:28.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.911+0000 7f2417fff640 1 --2- 172.21.15.80:0/1475921092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2418105d40 0x7f24181990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:36:28.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.911+0000 7f241cfcf640 1 --2- 172.21.15.80:0/1475921092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2418103410 0x7f2418198b70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f240c005940 tx=0x7f240c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:28.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.911+0000 7f2415ffb640 1 -- 172.21.15.80:0/1475921092 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c03f030 con 0x7f2418103410 2024-04-26T18:36:28.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.911+0000 7f241f233640 1 -- 172.21.15.80:0/1475921092 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24181a0a20 con 0x7f2418103410 2024-04-26T18:36:28.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.911+0000 7f2415ffb640 1 -- 172.21.15.80:0/1475921092 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f240c003aa0 con 0x7f2418103410 2024-04-26T18:36:28.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.911+0000 7f2415ffb640 1 -- 172.21.15.80:0/1475921092 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c035070 con 0x7f2418103410 2024-04-26T18:36:28.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.911+0000 7f241f233640 1 -- 172.21.15.80:0/1475921092 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24181a0f60 con 0x7f2418103410 2024-04-26T18:36:28.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.912+0000 7f241f233640 1 -- 172.21.15.80:0/1475921092 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24180fe8f0 con 0x7f2418103410 2024-04-26T18:36:28.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.913+0000 7f2415ffb640 1 -- 172.21.15.80:0/1475921092 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 22) ==== 138458+0+0 (secure 0 0 0) 0x7f240c042030 con 0x7f2418103410 2024-04-26T18:36:28.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.914+0000 7f2415ffb640 1 --2- 172.21.15.80:0/1475921092 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f24080a3a60 0x7f24080a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:28.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.914+0000 7f2417fff640 1 --2- 172.21.15.80:0/1475921092 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f24080a3a60 0x7f24080a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:28.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.914+0000 7f2415ffb640 1 -- 172.21.15.80:0/1475921092 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f240c0f0660 con 0x7f2418103410 2024-04-26T18:36:28.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.914+0000 7f2417fff640 1 --2- 172.21.15.80:0/1475921092 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f24080a3a60 0x7f24080a5f20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f241819a080 tx=0x7f2404005f90 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:28.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:28.918+0000 7f2415ffb640 1 -- 172.21.15.80:0/1475921092 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f240c0bcc10 con 0x7f2418103410 2024-04-26T18:36:29.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.129+0000 7f241f233640 1 -- 172.21.15.80:0/1475921092 --> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f2418062d70 con 0x7f24080a3a60 2024-04-26T18:36:29.136 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:28.757+0000 7f46c5703700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:36:29.136 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:28.757+0000 7f46c5703700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:36:29.137 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:28.757+0000 7f46c5703700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:36:29.137 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:28.757+0000 7f46c5703700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:36:29.137 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:36:28 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:36:28.757+0000 7f46c5703700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:36:29.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.190+0000 7f2415ffb640 1 -- 172.21.15.80:0/1475921092 <== mgr.24736 v2:172.21.15.80:6800/1522002759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2418062d70 con 0x7f24080a3a60 2024-04-26T18:36:29.190 INFO:teuthology.orchestra.run.smithi080.stdout:Schedule set for path / 2024-04-26T18:36:29.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.192+0000 7f241f233640 1 -- 172.21.15.80:0/1475921092 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f24080a3a60 msgr2=0x7f24080a5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:29.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.192+0000 7f241f233640 1 --2- 172.21.15.80:0/1475921092 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f24080a3a60 0x7f24080a5f20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f241819a080 tx=0x7f2404005f90 comp rx=0 tx=0).stop 2024-04-26T18:36:29.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.192+0000 7f241f233640 1 -- 172.21.15.80:0/1475921092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2418103410 msgr2=0x7f2418198b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:29.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.192+0000 7f241f233640 1 --2- 172.21.15.80:0/1475921092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2418103410 0x7f2418198b70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f240c005940 tx=0x7f240c031a50 comp rx=0 tx=0).stop 2024-04-26T18:36:29.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.192+0000 7f241f233640 1 -- 172.21.15.80:0/1475921092 shutdown_connections 2024-04-26T18:36:29.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.192+0000 7f241f233640 1 --2- 172.21.15.80:0/1475921092 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f24080a3a60 0x7f24080a5f20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:29.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.192+0000 7f241f233640 1 --2- 172.21.15.80:0/1475921092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2418108670 0x7f24181a0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:29.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.192+0000 7f241f233640 1 --2- 172.21.15.80:0/1475921092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2418105d40 0x7f24181990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:29.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.192+0000 7f241f233640 1 --2- 172.21.15.80:0/1475921092 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2418103410 0x7f2418198b70 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:29.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.192+0000 7f241f233640 1 -- 172.21.15.80:0/1475921092 >> 172.21.15.80:0/1475921092 conn(0x7f24180fce00 msgr2=0x7f2418103d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:29.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.192+0000 7f241f233640 1 -- 172.21.15.80:0/1475921092 shutdown_connections 2024-04-26T18:36:29.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.192+0000 7f241f233640 1 -- 172.21.15.80:0/1475921092 wait complete. 2024-04-26T18:36:29.203 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-04-26T18:36:29.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.306+0000 7f6916c52640 1 -- 172.21.15.80:0/2529845331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6910103440 msgr2=0x7f6910109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:29.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.306+0000 7f6916c52640 1 --2- 172.21.15.80:0/2529845331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6910103440 0x7f6910109cd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6908009ca0 tx=0x7f690802a8c0 comp rx=0 tx=0).stop 2024-04-26T18:36:29.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.306+0000 7f6916c52640 1 -- 172.21.15.80:0/2529845331 shutdown_connections 2024-04-26T18:36:29.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.306+0000 7f6916c52640 1 --2- 172.21.15.80:0/2529845331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6910103440 0x7f6910109cd0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:29.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.306+0000 7f6916c52640 1 --2- 172.21.15.80:0/2529845331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6910102a80 0x7f6910102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:29.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.306+0000 7f6916c52640 1 --2- 172.21.15.80:0/2529845331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6910101890 0x7f6910101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:29.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.306+0000 7f6916c52640 1 -- 172.21.15.80:0/2529845331 >> 172.21.15.80:0/2529845331 conn(0x7f69100fce00 msgr2=0x7f69100ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:29.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.306+0000 7f6916c52640 1 -- 172.21.15.80:0/2529845331 shutdown_connections 2024-04-26T18:36:29.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.306+0000 7f6916c52640 1 -- 172.21.15.80:0/2529845331 wait complete. 2024-04-26T18:36:29.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.307+0000 7f6916c52640 1 Processor -- start 2024-04-26T18:36:29.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.307+0000 7f6916c52640 1 -- start start 2024-04-26T18:36:29.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.307+0000 7f6916c52640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6910101890 0x7f691019ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:29.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.307+0000 7f6916c52640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6910102a80 0x7f691019b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:29.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.307+0000 7f6916c52640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6910103440 0x7f69101a2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:29.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.307+0000 7f6916c52640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f691010d3a0 con 0x7f6910103440 2024-04-26T18:36:29.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.307+0000 7f6916c52640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f691010d220 con 0x7f6910101890 2024-04-26T18:36:29.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.307+0000 7f6916c52640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f691010d520 con 0x7f6910102a80 2024-04-26T18:36:29.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.307+0000 7f69151ef640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6910103440 0x7f69101a2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:29.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.307+0000 7f69151ef640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6910103440 0x7f69101a2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37442/0 (socket says 172.21.15.80:37442) 2024-04-26T18:36:29.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.307+0000 7f69151ef640 1 -- 172.21.15.80:0/358714627 learned_addr learned my addr 172.21.15.80:0/358714627 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:29.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.307+0000 7f69149ee640 1 --2- 172.21.15.80:0/358714627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6910101890 0x7f691019ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:29.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.307+0000 7f6907fff640 1 --2- 172.21.15.80:0/358714627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6910102a80 0x7f691019b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:29.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.307+0000 7f69151ef640 1 -- 172.21.15.80:0/358714627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6910102a80 msgr2=0x7f691019b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:29.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.307+0000 7f69151ef640 1 --2- 172.21.15.80:0/358714627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6910102a80 0x7f691019b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:29.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.307+0000 7f69151ef640 1 -- 172.21.15.80:0/358714627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6910101890 msgr2=0x7f691019ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:29.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.307+0000 7f69151ef640 1 --2- 172.21.15.80:0/358714627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6910101890 0x7f691019ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:29.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.307+0000 7f69151ef640 1 -- 172.21.15.80:0/358714627 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69101a2910 con 0x7f6910103440 2024-04-26T18:36:29.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.307+0000 7f69151ef640 1 --2- 172.21.15.80:0/358714627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6910103440 0x7f69101a2270 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f69080097b0 tx=0x7f6908031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:29.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.308+0000 7f6905ffb640 1 -- 172.21.15.80:0/358714627 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6908003bf0 con 0x7f6910103440 2024-04-26T18:36:29.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.308+0000 7f6905ffb640 1 -- 172.21.15.80:0/358714627 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6908003d90 con 0x7f6910103440 2024-04-26T18:36:29.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.308+0000 7f6905ffb640 1 -- 172.21.15.80:0/358714627 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690802fc70 con 0x7f6910103440 2024-04-26T18:36:29.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.308+0000 7f6916c52640 1 -- 172.21.15.80:0/358714627 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69101a2ba0 con 0x7f6910103440 2024-04-26T18:36:29.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.308+0000 7f6916c52640 1 -- 172.21.15.80:0/358714627 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69101a30f0 con 0x7f6910103440 2024-04-26T18:36:29.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.309+0000 7f6916c52640 1 -- 172.21.15.80:0/358714627 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69101a32c0 con 0x7f6910103440 2024-04-26T18:36:29.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.310+0000 7f6905ffb640 1 -- 172.21.15.80:0/358714627 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 22) ==== 138458+0+0 (secure 0 0 0) 0x7f6908004040 con 0x7f6910103440 2024-04-26T18:36:29.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.310+0000 7f6905ffb640 1 --2- 172.21.15.80:0/358714627 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f68f80a3a60 0x7f68f80a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:29.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.310+0000 7f69149ee640 1 --2- 172.21.15.80:0/358714627 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f68f80a3a60 0x7f68f80a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:29.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.311+0000 7f6905ffb640 1 -- 172.21.15.80:0/358714627 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f69080f16f0 con 0x7f6910103440 2024-04-26T18:36:29.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.311+0000 7f69149ee640 1 --2- 172.21.15.80:0/358714627 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f68f80a3a60 0x7f68f80a5f20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f691019c1d0 tx=0x7f690c00b390 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:29.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.315+0000 7f6905ffb640 1 -- 172.21.15.80:0/358714627 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f69080be2f0 con 0x7f6910103440 2024-04-26T18:36:29.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.523+0000 7f6916c52640 1 -- 172.21.15.80:0/358714627 --> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f69100fef80 con 0x7f68f80a3a60 2024-04-26T18:36:29.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.580+0000 7f6905ffb640 1 -- 172.21.15.80:0/358714627 <== mgr.24736 v2:172.21.15.80:6800/1522002759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f69100fef80 con 0x7f68f80a3a60 2024-04-26T18:36:29.581 INFO:teuthology.orchestra.run.smithi080.stdout:Retention added to path / 2024-04-26T18:36:29.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.582+0000 7f6916c52640 1 -- 172.21.15.80:0/358714627 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f68f80a3a60 msgr2=0x7f68f80a5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:29.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.582+0000 7f6916c52640 1 --2- 172.21.15.80:0/358714627 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f68f80a3a60 0x7f68f80a5f20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f691019c1d0 tx=0x7f690c00b390 comp rx=0 tx=0).stop 2024-04-26T18:36:29.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.582+0000 7f6916c52640 1 -- 172.21.15.80:0/358714627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6910103440 msgr2=0x7f69101a2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:29.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.582+0000 7f6916c52640 1 --2- 172.21.15.80:0/358714627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6910103440 0x7f69101a2270 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f69080097b0 tx=0x7f6908031840 comp rx=0 tx=0).stop 2024-04-26T18:36:29.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.582+0000 7f6916c52640 1 -- 172.21.15.80:0/358714627 shutdown_connections 2024-04-26T18:36:29.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.582+0000 7f6916c52640 1 --2- 172.21.15.80:0/358714627 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f68f80a3a60 0x7f68f80a5f20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:29.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.582+0000 7f6916c52640 1 --2- 172.21.15.80:0/358714627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6910103440 0x7f69101a2270 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:29.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.582+0000 7f6916c52640 1 --2- 172.21.15.80:0/358714627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6910102a80 0x7f691019b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:29.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.582+0000 7f6916c52640 1 --2- 172.21.15.80:0/358714627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6910101890 0x7f691019ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:29.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.582+0000 7f6916c52640 1 -- 172.21.15.80:0/358714627 >> 172.21.15.80:0/358714627 conn(0x7f69100fce00 msgr2=0x7f69100fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:29.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.582+0000 7f6916c52640 1 -- 172.21.15.80:0/358714627 shutdown_connections 2024-04-26T18:36:29.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.582+0000 7f6916c52640 1 -- 172.21.15.80:0/358714627 wait complete. 2024-04-26T18:36:29.594 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-26T18:36:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.702+0000 7fa01bebd640 1 -- 172.21.15.80:0/3045138432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01410a860 msgr2=0x7fa01410ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.702+0000 7fa01bebd640 1 --2- 172.21.15.80:0/3045138432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01410a860 0x7fa01410ccf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa00c009ca0 tx=0x7fa00c02a950 comp rx=0 tx=0).stop 2024-04-26T18:36:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.702+0000 7fa01bebd640 1 -- 172.21.15.80:0/3045138432 shutdown_connections 2024-04-26T18:36:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.702+0000 7fa01bebd640 1 --2- 172.21.15.80:0/3045138432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01410a860 0x7fa01410ccf0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.702+0000 7fa01bebd640 1 --2- 172.21.15.80:0/3045138432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa014075310 0x7fa014075770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.702+0000 7fa01bebd640 1 --2- 172.21.15.80:0/3045138432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0140768f0 0x7fa014074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.702+0000 7fa01bebd640 1 -- 172.21.15.80:0/3045138432 >> 172.21.15.80:0/3045138432 conn(0x7fa0140fdf20 msgr2=0x7fa014100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.702+0000 7fa01bebd640 1 -- 172.21.15.80:0/3045138432 shutdown_connections 2024-04-26T18:36:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.702+0000 7fa01bebd640 1 -- 172.21.15.80:0/3045138432 wait complete. 2024-04-26T18:36:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.703+0000 7fa01bebd640 1 Processor -- start 2024-04-26T18:36:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.703+0000 7fa01bebd640 1 -- start start 2024-04-26T18:36:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.703+0000 7fa01bebd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa014075310 0x7fa01419ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.703+0000 7fa01bebd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0140768f0 0x7fa01419b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.703+0000 7fa01bebd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01410a860 0x7fa0141a21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.703+0000 7fa01bebd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa0141106d0 con 0x7fa01410a860 2024-04-26T18:36:29.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.703+0000 7fa01bebd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa014110550 con 0x7fa0140768f0 2024-04-26T18:36:29.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.703+0000 7fa01bebd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa014110850 con 0x7fa014075310 2024-04-26T18:36:29.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.703+0000 7fa01a45a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01410a860 0x7fa0141a21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:29.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.703+0000 7fa01a45a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01410a860 0x7fa0141a21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37464/0 (socket says 172.21.15.80:37464) 2024-04-26T18:36:29.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.703+0000 7fa019458640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0140768f0 0x7fa01419b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:29.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.703+0000 7fa01a45a640 1 -- 172.21.15.80:0/3186404161 learned_addr learned my addr 172.21.15.80:0/3186404161 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:29.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.703+0000 7fa019c59640 1 --2- 172.21.15.80:0/3186404161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa014075310 0x7fa01419ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:29.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.703+0000 7fa01a45a640 1 -- 172.21.15.80:0/3186404161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa014075310 msgr2=0x7fa01419ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:29.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.703+0000 7fa01a45a640 1 --2- 172.21.15.80:0/3186404161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa014075310 0x7fa01419ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:29.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.703+0000 7fa01a45a640 1 -- 172.21.15.80:0/3186404161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0140768f0 msgr2=0x7fa01419b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:29.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.703+0000 7fa01a45a640 1 --2- 172.21.15.80:0/3186404161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0140768f0 0x7fa01419b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:29.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.703+0000 7fa01a45a640 1 -- 172.21.15.80:0/3186404161 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0141a2850 con 0x7fa01410a860 2024-04-26T18:36:29.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.703+0000 7fa019458640 1 --2- 172.21.15.80:0/3186404161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0140768f0 0x7fa01419b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:36:29.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.703+0000 7fa01a45a640 1 --2- 172.21.15.80:0/3186404161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01410a860 0x7fa0141a21b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa00c006010 tx=0x7fa00c02fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:29.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.704+0000 7fa00affd640 1 -- 172.21.15.80:0/3186404161 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00c034040 con 0x7fa01410a860 2024-04-26T18:36:29.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.704+0000 7fa01bebd640 1 -- 172.21.15.80:0/3186404161 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0141a2ae0 con 0x7fa01410a860 2024-04-26T18:36:29.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.704+0000 7fa00affd640 1 -- 172.21.15.80:0/3186404161 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa00c0308f0 con 0x7fa01410a860 2024-04-26T18:36:29.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.704+0000 7fa00affd640 1 -- 172.21.15.80:0/3186404161 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00c039450 con 0x7fa01410a860 2024-04-26T18:36:29.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.704+0000 7fa01bebd640 1 -- 172.21.15.80:0/3186404161 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0141a3020 con 0x7fa01410a860 2024-04-26T18:36:29.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.705+0000 7fa01bebd640 1 -- 172.21.15.80:0/3186404161 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa014109620 con 0x7fa01410a860 2024-04-26T18:36:29.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.706+0000 7fa00affd640 1 -- 172.21.15.80:0/3186404161 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 22) ==== 138458+0+0 (secure 0 0 0) 0x7fa00c037020 con 0x7fa01410a860 2024-04-26T18:36:29.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.706+0000 7fa00affd640 1 --2- 172.21.15.80:0/3186404161 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fa0000a3a60 0x7fa0000a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:29.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.707+0000 7fa019c59640 1 --2- 172.21.15.80:0/3186404161 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fa0000a3a60 0x7fa0000a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:29.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.707+0000 7fa00affd640 1 -- 172.21.15.80:0/3186404161 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fa00c0f1600 con 0x7fa01410a860 2024-04-26T18:36:29.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.707+0000 7fa019c59640 1 --2- 172.21.15.80:0/3186404161 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fa0000a3a60 0x7fa0000a5f20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa01419c110 tx=0x7fa00400b390 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:29.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.711+0000 7fa00affd640 1 -- 172.21.15.80:0/3186404161 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa00c0be200 con 0x7fa01410a860 2024-04-26T18:36:29.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:29 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:29.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:29 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:29.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:29 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:29.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:29 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:29.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:29 smithi192 ceph-mon[32842]: mgrmap e22: x(active, since 1.01872s), standbys: z, y 2024-04-26T18:36:29.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.939+0000 7fa01bebd640 1 -- 172.21.15.80:0/3186404161 --> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fa014062d70 con 0x7fa0000a3a60 2024-04-26T18:36:29.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.946+0000 7fa00affd640 1 -- 172.21.15.80:0/3186404161 <== mgr.24736 v2:172.21.15.80:6800/1522002759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7fa014062d70 con 0x7fa0000a3a60 2024-04-26T18:36:29.947 INFO:teuthology.orchestra.run.smithi080.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-26T00:00:00", "created": "2024-04-26T18:36:29", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-04-26T18:36:29.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.949+0000 7fa01bebd640 1 -- 172.21.15.80:0/3186404161 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fa0000a3a60 msgr2=0x7fa0000a5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:29.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.949+0000 7fa01bebd640 1 --2- 172.21.15.80:0/3186404161 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fa0000a3a60 0x7fa0000a5f20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa01419c110 tx=0x7fa00400b390 comp rx=0 tx=0).stop 2024-04-26T18:36:29.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.949+0000 7fa01bebd640 1 -- 172.21.15.80:0/3186404161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01410a860 msgr2=0x7fa0141a21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:29.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.949+0000 7fa01bebd640 1 --2- 172.21.15.80:0/3186404161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01410a860 0x7fa0141a21b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa00c006010 tx=0x7fa00c02fc00 comp rx=0 tx=0).stop 2024-04-26T18:36:29.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.949+0000 7fa01bebd640 1 -- 172.21.15.80:0/3186404161 shutdown_connections 2024-04-26T18:36:29.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.949+0000 7fa01bebd640 1 --2- 172.21.15.80:0/3186404161 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fa0000a3a60 0x7fa0000a5f20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:29.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.949+0000 7fa01bebd640 1 --2- 172.21.15.80:0/3186404161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01410a860 0x7fa0141a21b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:29.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.949+0000 7fa01bebd640 1 --2- 172.21.15.80:0/3186404161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0140768f0 0x7fa01419b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:29.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.949+0000 7fa01bebd640 1 --2- 172.21.15.80:0/3186404161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa014075310 0x7fa01419ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:29.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.949+0000 7fa01bebd640 1 -- 172.21.15.80:0/3186404161 >> 172.21.15.80:0/3186404161 conn(0x7fa0140fdf20 msgr2=0x7fa0141067f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:29.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.949+0000 7fa01bebd640 1 -- 172.21.15.80:0/3186404161 shutdown_connections 2024-04-26T18:36:29.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:29.949+0000 7fa01bebd640 1 -- 172.21.15.80:0/3186404161 wait complete. 2024-04-26T18:36:29.959 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:29 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:29.959 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:29 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:29.959 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:29 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:29.959 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:29 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:29.959 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:29 smithi080 ceph-mon[29135]: mgrmap e22: x(active, since 1.01872s), standbys: z, y 2024-04-26T18:36:29.960 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-26T18:36:29.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:29 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:29.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:29 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:29.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:29 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:29.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:29 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:29.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:29 smithi082 ceph-mon[32808]: mgrmap e22: x(active, since 1.01872s), standbys: z, y 2024-04-26T18:36:30.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.062+0000 7fb7a59e7640 1 -- 172.21.15.80:0/2543721659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a0105de0 msgr2=0x7fb7a01081d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:30.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.062+0000 7fb7a59e7640 1 --2- 172.21.15.80:0/2543721659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a0105de0 0x7fb7a01081d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb790009900 tx=0x7fb79002a410 comp rx=0 tx=0).stop 2024-04-26T18:36:30.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.062+0000 7fb7a59e7640 1 -- 172.21.15.80:0/2543721659 shutdown_connections 2024-04-26T18:36:30.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.062+0000 7fb7a59e7640 1 --2- 172.21.15.80:0/2543721659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a0105de0 0x7fb7a01081d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:30.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.062+0000 7fb7a59e7640 1 --2- 172.21.15.80:0/2543721659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7a0108710 0x7fb7a010ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:30.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.062+0000 7fb7a59e7640 1 --2- 172.21.15.80:0/2543721659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a01034b0 0x7fb7a01058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:30.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.062+0000 7fb7a59e7640 1 -- 172.21.15.80:0/2543721659 >> 172.21.15.80:0/2543721659 conn(0x7fb7a00fce00 msgr2=0x7fb7a00ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:30.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.062+0000 7fb7a59e7640 1 -- 172.21.15.80:0/2543721659 shutdown_connections 2024-04-26T18:36:30.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.062+0000 7fb7a59e7640 1 -- 172.21.15.80:0/2543721659 wait complete. 2024-04-26T18:36:30.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.063+0000 7fb7a59e7640 1 Processor -- start 2024-04-26T18:36:30.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.063+0000 7fb7a59e7640 1 -- start start 2024-04-26T18:36:30.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.063+0000 7fb7a59e7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a01034b0 0x7fb7a0198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:30.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.063+0000 7fb7a59e7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7a0105de0 0x7fb7a01990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:30.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.063+0000 7fb7a59e7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a0108710 0x7fb7a01a0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:30.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.063+0000 7fb7a59e7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a010e490 con 0x7fb7a01034b0 2024-04-26T18:36:30.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.063+0000 7fb7a59e7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a010e310 con 0x7fb7a0105de0 2024-04-26T18:36:30.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.063+0000 7fb7a59e7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a010e610 con 0x7fb7a0108710 2024-04-26T18:36:30.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.064+0000 7fb79effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a01034b0 0x7fb7a0198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:30.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.064+0000 7fb79effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a01034b0 0x7fb7a0198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37492/0 (socket says 172.21.15.80:37492) 2024-04-26T18:36:30.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.064+0000 7fb79effd640 1 -- 172.21.15.80:0/3556051628 learned_addr learned my addr 172.21.15.80:0/3556051628 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:30.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.064+0000 7fb79f7fe640 1 --2- 172.21.15.80:0/3556051628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a0108710 0x7fb7a01a0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:30.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.064+0000 7fb79e7fc640 1 --2- 172.21.15.80:0/3556051628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7a0105de0 0x7fb7a01990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:30.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.064+0000 7fb79effd640 1 -- 172.21.15.80:0/3556051628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a0108710 msgr2=0x7fb7a01a0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:30.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.064+0000 7fb79effd640 1 --2- 172.21.15.80:0/3556051628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a0108710 0x7fb7a01a0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:30.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.064+0000 7fb79effd640 1 -- 172.21.15.80:0/3556051628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7a0105de0 msgr2=0x7fb7a01990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:30.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.064+0000 7fb79effd640 1 --2- 172.21.15.80:0/3556051628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7a0105de0 0x7fb7a01990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:30.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.064+0000 7fb79effd640 1 -- 172.21.15.80:0/3556051628 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a01a07b0 con 0x7fb7a01034b0 2024-04-26T18:36:30.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.064+0000 7fb79e7fc640 1 --2- 172.21.15.80:0/3556051628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7a0105de0 0x7fb7a01990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:36:30.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.064+0000 7fb79effd640 1 --2- 172.21.15.80:0/3556051628 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a01034b0 0x7fb7a0198b90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb79400e9f0 tx=0x7fb79400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:30.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.064+0000 7fb7a49e5640 1 -- 172.21.15.80:0/3556051628 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79400cd80 con 0x7fb7a01034b0 2024-04-26T18:36:30.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.064+0000 7fb7a49e5640 1 -- 172.21.15.80:0/3556051628 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7940108e0 con 0x7fb7a01034b0 2024-04-26T18:36:30.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.064+0000 7fb7a49e5640 1 -- 172.21.15.80:0/3556051628 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb794018980 con 0x7fb7a01034b0 2024-04-26T18:36:30.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.064+0000 7fb7a59e7640 1 -- 172.21.15.80:0/3556051628 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a01a0aa0 con 0x7fb7a01034b0 2024-04-26T18:36:30.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.064+0000 7fb7a59e7640 1 -- 172.21.15.80:0/3556051628 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a01a0fc0 con 0x7fb7a01034b0 2024-04-26T18:36:30.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.065+0000 7fb7a59e7640 1 -- 172.21.15.80:0/3556051628 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7a00fe8f0 con 0x7fb7a01034b0 2024-04-26T18:36:30.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.066+0000 7fb7a49e5640 1 -- 172.21.15.80:0/3556051628 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 22) ==== 138458+0+0 (secure 0 0 0) 0x7fb794010430 con 0x7fb7a01034b0 2024-04-26T18:36:30.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.067+0000 7fb7a49e5640 1 --2- 172.21.15.80:0/3556051628 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fb7880a3a60 0x7fb7880a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:30.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.067+0000 7fb7a49e5640 1 -- 172.21.15.80:0/3556051628 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fb7940d0450 con 0x7fb7a01034b0 2024-04-26T18:36:30.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.067+0000 7fb79e7fc640 1 --2- 172.21.15.80:0/3556051628 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fb7880a3a60 0x7fb7880a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:30.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.068+0000 7fb79e7fc640 1 --2- 172.21.15.80:0/3556051628 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fb7880a3a60 0x7fb7880a5f20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb790000c00 tx=0x7fb7900314a0 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:30.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.072+0000 7fb7a49e5640 1 -- 172.21.15.80:0/3556051628 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb79409d050 con 0x7fb7a01034b0 2024-04-26T18:36:30.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.289+0000 7fb7a59e7640 1 -- 172.21.15.80:0/3556051628 --> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fb7a0062d70 con 0x7fb7880a3a60 2024-04-26T18:36:30.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.295+0000 7fb7a49e5640 1 -- 172.21.15.80:0/3556051628 <== mgr.24736 v2:172.21.15.80:6800/1522002759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fb7a0062d70 con 0x7fb7880a3a60 2024-04-26T18:36:30.296 INFO:teuthology.orchestra.run.smithi080.stdout:/ 1m 6m3h 2024-04-26T18:36:30.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.298+0000 7fb7a59e7640 1 -- 172.21.15.80:0/3556051628 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fb7880a3a60 msgr2=0x7fb7880a5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:30.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.298+0000 7fb7a59e7640 1 --2- 172.21.15.80:0/3556051628 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fb7880a3a60 0x7fb7880a5f20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb790000c00 tx=0x7fb7900314a0 comp rx=0 tx=0).stop 2024-04-26T18:36:30.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.298+0000 7fb7a59e7640 1 -- 172.21.15.80:0/3556051628 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a01034b0 msgr2=0x7fb7a0198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:30.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.298+0000 7fb7a59e7640 1 --2- 172.21.15.80:0/3556051628 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a01034b0 0x7fb7a0198b90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb79400e9f0 tx=0x7fb79400eeb0 comp rx=0 tx=0).stop 2024-04-26T18:36:30.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.298+0000 7fb7a59e7640 1 -- 172.21.15.80:0/3556051628 shutdown_connections 2024-04-26T18:36:30.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.298+0000 7fb7a59e7640 1 --2- 172.21.15.80:0/3556051628 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fb7880a3a60 0x7fb7880a5f20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:30.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.298+0000 7fb7a59e7640 1 --2- 172.21.15.80:0/3556051628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a0108710 0x7fb7a01a0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:30.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.298+0000 7fb7a59e7640 1 --2- 172.21.15.80:0/3556051628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7a0105de0 0x7fb7a01990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:30.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.298+0000 7fb7a59e7640 1 --2- 172.21.15.80:0/3556051628 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7a01034b0 0x7fb7a0198b90 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:30.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.298+0000 7fb7a59e7640 1 -- 172.21.15.80:0/3556051628 >> 172.21.15.80:0/3556051628 conn(0x7fb7a00fce00 msgr2=0x7fb7a0103f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:30.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.299+0000 7fb7a59e7640 1 -- 172.21.15.80:0/3556051628 shutdown_connections 2024-04-26T18:36:30.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:30.299+0000 7fb7a59e7640 1 -- 172.21.15.80:0/3556051628 wait complete. 2024-04-26T18:36:30.311 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-04-26T18:36:30.335 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-04-26T18:36:30.346 INFO:teuthology.run_tasks:Running task background_exec... 2024-04-26T18:36:30.358 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi080.front.sepia.ceph.com 2024-04-26T18:36:30.358 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-04-26T18:36:30.379 INFO:teuthology.run_tasks:Running task quiescer... 2024-04-26T18:36:30.392 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-26T18:36:30.392 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T18:36:30.635 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:36:30.899 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:30 smithi080 ceph-mon[29135]: [26/Apr/2024:18:36:28] ENGINE Bus STARTING 2024-04-26T18:36:30.899 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:30 smithi080 ceph-mon[29135]: [26/Apr/2024:18:36:29] ENGINE Serving on https://172.21.15.80:7150 2024-04-26T18:36:30.899 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:30 smithi080 ceph-mon[29135]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:36:30.899 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:30 smithi080 ceph-mon[29135]: [26/Apr/2024:18:36:29] ENGINE Serving on http://172.21.15.80:8765 2024-04-26T18:36:30.899 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:30 smithi080 ceph-mon[29135]: [26/Apr/2024:18:36:29] ENGINE Bus STARTED 2024-04-26T18:36:30.899 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:30 smithi080 ceph-mon[29135]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:36:30.899 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:30 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:30.899 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:30 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:30.899 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:30 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:30.899 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:30 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:30.899 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:30 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:30.900 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:30 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:30.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:30 smithi082 ceph-mon[32808]: [26/Apr/2024:18:36:28] ENGINE Bus STARTING 2024-04-26T18:36:30.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:30 smithi082 ceph-mon[32808]: [26/Apr/2024:18:36:29] ENGINE Serving on https://172.21.15.80:7150 2024-04-26T18:36:30.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:30 smithi082 ceph-mon[32808]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:36:30.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:30 smithi082 ceph-mon[32808]: [26/Apr/2024:18:36:29] ENGINE Serving on http://172.21.15.80:8765 2024-04-26T18:36:30.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:30 smithi082 ceph-mon[32808]: [26/Apr/2024:18:36:29] ENGINE Bus STARTED 2024-04-26T18:36:30.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:30 smithi082 ceph-mon[32808]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:36:30.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:30 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:30.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:30 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:30.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:30 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:30.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:30 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:30.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:30 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:30.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:30 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:31.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:30 smithi192 ceph-mon[32842]: [26/Apr/2024:18:36:28] ENGINE Bus STARTING 2024-04-26T18:36:31.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:30 smithi192 ceph-mon[32842]: [26/Apr/2024:18:36:29] ENGINE Serving on https://172.21.15.80:7150 2024-04-26T18:36:31.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:30 smithi192 ceph-mon[32842]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:36:31.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:30 smithi192 ceph-mon[32842]: [26/Apr/2024:18:36:29] ENGINE Serving on http://172.21.15.80:8765 2024-04-26T18:36:31.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:30 smithi192 ceph-mon[32842]: [26/Apr/2024:18:36:29] ENGINE Bus STARTED 2024-04-26T18:36:31.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:30 smithi192 ceph-mon[32842]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:36:31.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:30 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:31.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:30 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:31.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:30 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:31.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:30 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:31.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:30 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:31.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:30 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:31.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:31 smithi082 ceph-mon[32808]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:36:31.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:31 smithi082 ceph-mon[32808]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:36:31.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:31 smithi082 ceph-mon[32808]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:36:31.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:31 smithi082 ceph-mon[32808]: mgrmap e23: x(active, since 2s), standbys: z, y 2024-04-26T18:36:31.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:31 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:31.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:31 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:31.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:31 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:31.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:31 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:31.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:31 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:31.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:31 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:31.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:31 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:31.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:31 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:31.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:31 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:31.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:31 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:31.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:31 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:31.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:31 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:31.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:31 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:31.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:31 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:31.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:31 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:31.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:31 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:31.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:31 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:31.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:31 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:31.972 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:31 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:36:31.972 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:31 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:36:31.986 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:31 smithi080 ceph-mon[29135]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:36:31.986 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:31 smithi080 ceph-mon[29135]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:36:31.986 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:31 smithi080 ceph-mon[29135]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:36:31.986 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:31 smithi080 ceph-mon[29135]: mgrmap e23: x(active, since 2s), standbys: z, y 2024-04-26T18:36:31.986 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:31 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:31.986 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:31 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:31.986 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:31 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:31.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:31 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:31.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:31 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:31.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:31 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:31.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:31 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:31.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:31 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:31.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:31 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:31.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:31 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:31.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:31 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:31.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:31 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:31.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:31 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:31.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:31 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:31.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:31 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:31.987 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:31 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:31.988 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:31 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:31.988 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:31 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:31.988 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:31 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:36:31.988 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:31 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:36:32.013 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:31 smithi192 ceph-mon[32842]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:36:32.013 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:31 smithi192 ceph-mon[32842]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:36:32.013 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:31 smithi192 ceph-mon[32842]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:36:32.013 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:31 smithi192 ceph-mon[32842]: mgrmap e23: x(active, since 2s), standbys: z, y 2024-04-26T18:36:32.013 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:31 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:32.014 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:31 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:32.014 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:31 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:32.014 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:31 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:32.014 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:31 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:32.014 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:31 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:32.014 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:31 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:32.014 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:31 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:32.014 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:31 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:32.014 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:31 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:32.014 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:31 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:32.014 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:31 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:32.014 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:31 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:32.014 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:31 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:32.014 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:31 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:32.015 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:31 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:32.015 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:31 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:32.015 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:31 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:36:32.015 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:31 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:36:32.015 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:31 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:36:32.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.469+0000 7f864419c700 1 -- 172.21.15.80:0/1104963616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863c1083c0 msgr2=0x7f863c1087a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:32.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.469+0000 7f864419c700 1 --2- 172.21.15.80:0/1104963616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863c1083c0 0x7f863c1087a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8638009990 tx=0x7f8638009ca0 comp rx=0 tx=0).stop 2024-04-26T18:36:32.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.469+0000 7f864419c700 1 -- 172.21.15.80:0/1104963616 shutdown_connections 2024-04-26T18:36:32.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.469+0000 7f864419c700 1 --2- 172.21.15.80:0/1104963616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f863c102d10 0x7f863c10f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:32.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.469+0000 7f864419c700 1 --2- 172.21.15.80:0/1104963616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863c1083c0 0x7f863c1087a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:32.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.469+0000 7f864419c700 1 --2- 172.21.15.80:0/1104963616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f863c102350 0x7f863c1027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:32.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.469+0000 7f864419c700 1 -- 172.21.15.80:0/1104963616 >> 172.21.15.80:0/1104963616 conn(0x7f863c079360 msgr2=0x7f863c079770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:32.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.470+0000 7f864419c700 1 -- 172.21.15.80:0/1104963616 shutdown_connections 2024-04-26T18:36:32.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.470+0000 7f864419c700 1 -- 172.21.15.80:0/1104963616 wait complete. 2024-04-26T18:36:32.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.470+0000 7f864419c700 1 Processor -- start 2024-04-26T18:36:32.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.470+0000 7f864419c700 1 -- start start 2024-04-26T18:36:32.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.470+0000 7f864419c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f863c102350 0x7f863c19a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:32.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.470+0000 7f864419c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f863c102d10 0x7f863c19ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:32.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.470+0000 7f864419c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863c1083c0 0x7f863c1a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:32.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.470+0000 7f864419c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f863c1124e0 con 0x7f863c1083c0 2024-04-26T18:36:32.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.470+0000 7f864419c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f863c112360 con 0x7f863c102d10 2024-04-26T18:36:32.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.470+0000 7f864419c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f863c112660 con 0x7f863c102350 2024-04-26T18:36:32.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.471+0000 7f8642739700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863c1083c0 0x7f863c1a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:32.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.471+0000 7f8641737700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f863c102d10 0x7f863c19ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:32.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.471+0000 7f8642739700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863c1083c0 0x7f863c1a59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37518/0 (socket says 172.21.15.80:37518) 2024-04-26T18:36:32.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.471+0000 7f8642739700 1 -- 172.21.15.80:0/3227656042 learned_addr learned my addr 172.21.15.80:0/3227656042 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:32.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.471+0000 7f8641f38700 1 --2- 172.21.15.80:0/3227656042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f863c102350 0x7f863c19a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:32.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.471+0000 7f8642739700 1 -- 172.21.15.80:0/3227656042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f863c102350 msgr2=0x7f863c19a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:32.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.471+0000 7f8642739700 1 --2- 172.21.15.80:0/3227656042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f863c102350 0x7f863c19a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:32.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.471+0000 7f8642739700 1 -- 172.21.15.80:0/3227656042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f863c102d10 msgr2=0x7f863c19ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:32.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.471+0000 7f8642739700 1 --2- 172.21.15.80:0/3227656042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f863c102d10 0x7f863c19ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:32.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.471+0000 7f8642739700 1 -- 172.21.15.80:0/3227656042 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863c1a5ee0 con 0x7f863c1083c0 2024-04-26T18:36:32.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.471+0000 7f8641737700 1 --2- 172.21.15.80:0/3227656042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f863c102d10 0x7f863c19ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:36:32.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.471+0000 7f8642739700 1 --2- 172.21.15.80:0/3227656042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863c1083c0 0x7f863c1a59a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f863400ef30 tx=0x7f863400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:32.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.471+0000 7f8632ffd700 1 -- 172.21.15.80:0/3227656042 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86340092e0 con 0x7f863c1083c0 2024-04-26T18:36:32.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.471+0000 7f864419c700 1 -- 172.21.15.80:0/3227656042 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f863c1a60b0 con 0x7f863c1083c0 2024-04-26T18:36:32.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.471+0000 7f8632ffd700 1 -- 172.21.15.80:0/3227656042 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8634004bb0 con 0x7f863c1083c0 2024-04-26T18:36:32.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.471+0000 7f8632ffd700 1 -- 172.21.15.80:0/3227656042 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8634004020 con 0x7f863c1083c0 2024-04-26T18:36:32.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.471+0000 7f864419c700 1 -- 172.21.15.80:0/3227656042 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f863c1a65f0 con 0x7f863c1083c0 2024-04-26T18:36:32.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.472+0000 7f864419c700 1 -- 172.21.15.80:0/3227656042 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f863c103a70 con 0x7f863c1083c0 2024-04-26T18:36:32.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.473+0000 7f8632ffd700 1 -- 172.21.15.80:0/3227656042 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 23) ==== 138817+0+0 (secure 0 0 0) 0x7f863401b030 con 0x7f863c1083c0 2024-04-26T18:36:32.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.474+0000 7f8632ffd700 1 --2- 172.21.15.80:0/3227656042 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f86280a3e40 0x7f86280a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:32.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.474+0000 7f8641f38700 1 --2- 172.21.15.80:0/3227656042 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f86280a3e40 0x7f86280a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:32.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.474+0000 7f8632ffd700 1 -- 172.21.15.80:0/3227656042 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f86340d03a0 con 0x7f863c1083c0 2024-04-26T18:36:32.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.474+0000 7f8641f38700 1 --2- 172.21.15.80:0/3227656042 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f86280a3e40 0x7f86280a6300 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f863800b2e0 tx=0x7f8638005960 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:32.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.478+0000 7f8632ffd700 1 -- 172.21.15.80:0/3227656042 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8634022020 con 0x7f863c1083c0 2024-04-26T18:36:32.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.666+0000 7f8632ffd700 1 -- 172.21.15.80:0/3227656042 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mgrmap(e 24) ==== 138873+0+0 (secure 0 0 0) 0x7f8634012050 con 0x7f863c1083c0 2024-04-26T18:36:32.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.701+0000 7f864419c700 1 -- 172.21.15.80:0/3227656042 --> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f863c063860 con 0x7f86280a3e40 2024-04-26T18:36:32.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.708+0000 7f8632ffd700 1 -- 172.21.15.80:0/3227656042 <== mgr.24736 v2:172.21.15.80:6800/1522002759 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258054 (secure 0 0 0) 0x7f8638067020 con 0x7f86280a3e40 2024-04-26T18:36:32.713 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:36:32.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.712+0000 7f864419c700 1 -- 172.21.15.80:0/3227656042 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f86280a3e40 msgr2=0x7f86280a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:32.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.712+0000 7f864419c700 1 --2- 172.21.15.80:0/3227656042 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f86280a3e40 0x7f86280a6300 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f863800b2e0 tx=0x7f8638005960 comp rx=0 tx=0).stop 2024-04-26T18:36:32.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.712+0000 7f864419c700 1 -- 172.21.15.80:0/3227656042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863c1083c0 msgr2=0x7f863c1a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:32.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.712+0000 7f864419c700 1 --2- 172.21.15.80:0/3227656042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863c1083c0 0x7f863c1a59a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f863400ef30 tx=0x7f863400c3a0 comp rx=0 tx=0).stop 2024-04-26T18:36:32.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.712+0000 7f864419c700 1 -- 172.21.15.80:0/3227656042 shutdown_connections 2024-04-26T18:36:32.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.712+0000 7f864419c700 1 --2- 172.21.15.80:0/3227656042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863c1083c0 0x7f863c1a59a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:32.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.712+0000 7f864419c700 1 --2- 172.21.15.80:0/3227656042 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f86280a3e40 0x7f86280a6300 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:32.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.712+0000 7f864419c700 1 --2- 172.21.15.80:0/3227656042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f863c102350 0x7f863c19a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:32.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.712+0000 7f864419c700 1 --2- 172.21.15.80:0/3227656042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f863c102d10 0x7f863c19ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:32.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.712+0000 7f864419c700 1 -- 172.21.15.80:0/3227656042 >> 172.21.15.80:0/3227656042 conn(0x7f863c079360 msgr2=0x7f863c101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:32.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.712+0000 7f864419c700 1 -- 172.21.15.80:0/3227656042 shutdown_connections 2024-04-26T18:36:32.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:32.712+0000 7f864419c700 1 -- 172.21.15.80:0/3227656042 wait complete. 2024-04-26T18:36:32.716 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-26T18:36:32.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:32 smithi082 ceph-mon[32808]: Adjusting osd_memory_target on smithi082 to 176.2M 2024-04-26T18:36:32.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:32 smithi082 ceph-mon[32808]: Unable to set osd_memory_target on smithi082 to 184763084: error parsing value: Value '184763084' is below minimum 939524096 2024-04-26T18:36:32.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:32 smithi082 ceph-mon[32808]: Adjusting osd_memory_target on smithi192 to 176.2M 2024-04-26T18:36:32.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:32 smithi082 ceph-mon[32808]: Unable to set osd_memory_target on smithi192 to 184769536: error parsing value: Value '184769536' is below minimum 939524096 2024-04-26T18:36:32.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:32 smithi082 ceph-mon[32808]: Adjusting osd_memory_target on smithi080 to 176.2M 2024-04-26T18:36:32.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:32 smithi082 ceph-mon[32808]: Unable to set osd_memory_target on smithi080 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T18:36:32.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:32 smithi082 ceph-mon[32808]: Updating smithi080:/etc/ceph/ceph.conf 2024-04-26T18:36:32.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:32 smithi082 ceph-mon[32808]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-26T18:36:32.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:32 smithi082 ceph-mon[32808]: Updating smithi192:/etc/ceph/ceph.conf 2024-04-26T18:36:32.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:32 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:32.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:32 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:32.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:32 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:32.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:32 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:32.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:32 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:32.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:32 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:32.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:32 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:32.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:32 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:36:32.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:32 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:36:32.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:32 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:36:32.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:32 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:32.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:32 smithi080 ceph-mon[29135]: Adjusting osd_memory_target on smithi082 to 176.2M 2024-04-26T18:36:32.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:32 smithi080 ceph-mon[29135]: Unable to set osd_memory_target on smithi082 to 184763084: error parsing value: Value '184763084' is below minimum 939524096 2024-04-26T18:36:32.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:32 smithi080 ceph-mon[29135]: Adjusting osd_memory_target on smithi192 to 176.2M 2024-04-26T18:36:32.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:32 smithi080 ceph-mon[29135]: Unable to set osd_memory_target on smithi192 to 184769536: error parsing value: Value '184769536' is below minimum 939524096 2024-04-26T18:36:32.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:32 smithi080 ceph-mon[29135]: Adjusting osd_memory_target on smithi080 to 176.2M 2024-04-26T18:36:32.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:32 smithi080 ceph-mon[29135]: Unable to set osd_memory_target on smithi080 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T18:36:32.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:32 smithi080 ceph-mon[29135]: Updating smithi080:/etc/ceph/ceph.conf 2024-04-26T18:36:32.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:32 smithi080 ceph-mon[29135]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-26T18:36:32.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:32 smithi080 ceph-mon[29135]: Updating smithi192:/etc/ceph/ceph.conf 2024-04-26T18:36:32.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:32 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:32.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:32 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:32.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:32 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:32.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:32 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:32.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:32 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:32.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:32 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:32.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:32 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:32.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:32 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:36:32.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:32 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:36:32.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:32 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:36:32.995 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:32 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:33.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:32 smithi192 ceph-mon[32842]: Adjusting osd_memory_target on smithi082 to 176.2M 2024-04-26T18:36:33.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:32 smithi192 ceph-mon[32842]: Unable to set osd_memory_target on smithi082 to 184763084: error parsing value: Value '184763084' is below minimum 939524096 2024-04-26T18:36:33.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:32 smithi192 ceph-mon[32842]: Adjusting osd_memory_target on smithi192 to 176.2M 2024-04-26T18:36:33.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:32 smithi192 ceph-mon[32842]: Unable to set osd_memory_target on smithi192 to 184769536: error parsing value: Value '184769536' is below minimum 939524096 2024-04-26T18:36:33.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:32 smithi192 ceph-mon[32842]: Adjusting osd_memory_target on smithi080 to 176.2M 2024-04-26T18:36:33.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:32 smithi192 ceph-mon[32842]: Unable to set osd_memory_target on smithi080 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T18:36:33.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:32 smithi192 ceph-mon[32842]: Updating smithi080:/etc/ceph/ceph.conf 2024-04-26T18:36:33.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:32 smithi192 ceph-mon[32842]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-26T18:36:33.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:32 smithi192 ceph-mon[32842]: Updating smithi192:/etc/ceph/ceph.conf 2024-04-26T18:36:33.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:32 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:33.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:32 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:33.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:32 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:33.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:32 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:33.114 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:32 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:33.114 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:32 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:33.114 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:32 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:33.114 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:32 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:36:33.114 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:32 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:36:33.114 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:32 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:36:33.114 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:32 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:36:33.417 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-04-26T18:36:31.744126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1191332,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":2116,"num_read_kb":1221,"num_write":563,"num_write_kb":4406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1181430,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":943,"ondisk_log_size":943,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365864,"kb_used_data":12516,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575960,"statfs":{"total":1151940427776,"available":1151565783040,"internally_reserved":0,"allocated":12816384,"data_stored":9327463,"data_compressed":207840,"data_compressed_allocated":270336,"data_compressed_original":3280896,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.987668"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.733075+0000","last_change":"2024-04-26T18:33:06.565673+0000","last_active":"2024-04-26T18:36:27.733075+0000","last_peered":"2024-04-26T18:36:27.733075+0000","last_clean":"2024-04-26T18:36:27.733075+0000","last_became_active":"2024-04-26T18:33:06.565065+0000","last_became_peered":"2024-04-26T18:33:06.565065+0000","last_unstale":"2024-04-26T18:36:27.733075+0000","last_undegraded":"2024-04-26T18:36:27.733075+0000","last_fullsized":"2024-04-26T18:36:27.733075+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:54:10.833343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.975622+0000","last_change":"2024-04-26T18:33:06.552350+0000","last_active":"2024-04-26T18:36:27.975622+0000","last_peered":"2024-04-26T18:36:27.975622+0000","last_clean":"2024-04-26T18:36:27.975622+0000","last_became_active":"2024-04-26T18:33:06.551941+0000","last_became_peered":"2024-04-26T18:33:06.551941+0000","last_unstale":"2024-04-26T18:36:27.975622+0000","last_undegraded":"2024-04-26T18:36:27.975622+0000","last_fullsized":"2024-04-26T18:36:27.975622+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:40.702995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.975532+0000","last_change":"2024-04-26T18:33:06.561456+0000","last_active":"2024-04-26T18:36:27.975532+0000","last_peered":"2024-04-26T18:36:27.975532+0000","last_clean":"2024-04-26T18:36:27.975532+0000","last_became_active":"2024-04-26T18:33:06.561032+0000","last_became_peered":"2024-04-26T18:33:06.561032+0000","last_unstale":"2024-04-26T18:36:27.975532+0000","last_undegraded":"2024-04-26T18:36:27.975532+0000","last_fullsized":"2024-04-26T18:36:27.975532+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:56:56.228873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.973428+0000","last_change":"2024-04-26T18:33:06.556597+0000","last_active":"2024-04-26T18:36:27.973428+0000","last_peered":"2024-04-26T18:36:27.973428+0000","last_clean":"2024-04-26T18:36:27.973428+0000","last_became_active":"2024-04-26T18:33:06.555356+0000","last_became_peered":"2024-04-26T18:33:06.555356+0000","last_unstale":"2024-04-26T18:36:27.973428+0000","last_undegraded":"2024-04-26T18:36:27.973428+0000","last_fullsized":"2024-04-26T18:36:27.973428+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:55.860495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821498+0000","last_change":"2024-04-26T18:33:06.549480+0000","last_active":"2024-04-26T18:36:27.821498+0000","last_peered":"2024-04-26T18:36:27.821498+0000","last_clean":"2024-04-26T18:36:27.821498+0000","last_became_active":"2024-04-26T18:33:06.549086+0000","last_became_peered":"2024-04-26T18:33:06.549086+0000","last_unstale":"2024-04-26T18:36:27.821498+0000","last_undegraded":"2024-04-26T18:36:27.821498+0000","last_fullsized":"2024-04-26T18:36:27.821498+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:13.012745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.730369+0000","last_change":"2024-04-26T18:33:06.558539+0000","last_active":"2024-04-26T18:36:27.730369+0000","last_peered":"2024-04-26T18:36:27.730369+0000","last_clean":"2024-04-26T18:36:27.730369+0000","last_became_active":"2024-04-26T18:33:06.558185+0000","last_became_peered":"2024-04-26T18:33:06.558185+0000","last_unstale":"2024-04-26T18:36:27.730369+0000","last_undegraded":"2024-04-26T18:36:27.730369+0000","last_fullsized":"2024-04-26T18:36:27.730369+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:59:31.299478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879561+0000","last_change":"2024-04-26T18:33:06.557336+0000","last_active":"2024-04-26T18:36:27.879561+0000","last_peered":"2024-04-26T18:36:27.879561+0000","last_clean":"2024-04-26T18:36:27.879561+0000","last_became_active":"2024-04-26T18:33:06.556988+0000","last_became_peered":"2024-04-26T18:33:06.556988+0000","last_unstale":"2024-04-26T18:36:27.879561+0000","last_undegraded":"2024-04-26T18:36:27.879561+0000","last_fullsized":"2024-04-26T18:36:27.879561+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:48.814042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821264+0000","last_change":"2024-04-26T18:33:06.556355+0000","last_active":"2024-04-26T18:36:27.821264+0000","last_peered":"2024-04-26T18:36:27.821264+0000","last_clean":"2024-04-26T18:36:27.821264+0000","last_became_active":"2024-04-26T18:33:06.555947+0000","last_became_peered":"2024-04-26T18:33:06.555947+0000","last_unstale":"2024-04-26T18:36:27.821264+0000","last_undegraded":"2024-04-26T18:36:27.821264+0000","last_fullsized":"2024-04-26T18:36:27.821264+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:36.607305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.973088+0000","last_change":"2024-04-26T18:33:06.569673+0000","last_active":"2024-04-26T18:36:27.973088+0000","last_peered":"2024-04-26T18:36:27.973088+0000","last_clean":"2024-04-26T18:36:27.973088+0000","last_became_active":"2024-04-26T18:33:06.568453+0000","last_became_peered":"2024-04-26T18:33:06.568453+0000","last_unstale":"2024-04-26T18:36:27.973088+0000","last_undegraded":"2024-04-26T18:36:27.973088+0000","last_fullsized":"2024-04-26T18:36:27.973088+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:38.428723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.730773+0000","last_change":"2024-04-26T18:33:06.564286+0000","last_active":"2024-04-26T18:36:27.730773+0000","last_peered":"2024-04-26T18:36:27.730773+0000","last_clean":"2024-04-26T18:36:27.730773+0000","last_became_active":"2024-04-26T18:33:06.563830+0000","last_became_peered":"2024-04-26T18:33:06.563830+0000","last_unstale":"2024-04-26T18:36:27.730773+0000","last_undegraded":"2024-04-26T18:36:27.730773+0000","last_fullsized":"2024-04-26T18:36:27.730773+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:36.518838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879754+0000","last_change":"2024-04-26T18:33:06.560724+0000","last_active":"2024-04-26T18:36:27.879754+0000","last_peered":"2024-04-26T18:36:27.879754+0000","last_clean":"2024-04-26T18:36:27.879754+0000","last_became_active":"2024-04-26T18:33:06.560393+0000","last_became_peered":"2024-04-26T18:33:06.560393+0000","last_unstale":"2024-04-26T18:36:27.879754+0000","last_undegraded":"2024-04-26T18:36:27.879754+0000","last_fullsized":"2024-04-26T18:36:27.879754+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:41.286466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.727850+0000","last_change":"2024-04-26T18:33:51.859986+0000","last_active":"2024-04-26T18:36:27.727850+0000","last_peered":"2024-04-26T18:36:27.727850+0000","last_clean":"2024-04-26T18:36:27.727850+0000","last_became_active":"2024-04-26T18:33:51.859656+0000","last_became_peered":"2024-04-26T18:33:51.859656+0000","last_unstale":"2024-04-26T18:36:27.727850+0000","last_undegraded":"2024-04-26T18:36:27.727850+0000","last_fullsized":"2024-04-26T18:36:27.727850+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:09:48.471097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972836+0000","last_change":"2024-04-26T18:33:06.555813+0000","last_active":"2024-04-26T18:36:27.972836+0000","last_peered":"2024-04-26T18:36:27.972836+0000","last_clean":"2024-04-26T18:36:27.972836+0000","last_became_active":"2024-04-26T18:33:06.555498+0000","last_became_peered":"2024-04-26T18:33:06.555498+0000","last_unstale":"2024-04-26T18:36:27.972836+0000","last_undegraded":"2024-04-26T18:36:27.972836+0000","last_fullsized":"2024-04-26T18:36:27.972836+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:21.531142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.975070+0000","last_change":"2024-04-26T18:33:06.551833+0000","last_active":"2024-04-26T18:36:27.975070+0000","last_peered":"2024-04-26T18:36:27.975070+0000","last_clean":"2024-04-26T18:36:27.975070+0000","last_became_active":"2024-04-26T18:33:06.551503+0000","last_became_peered":"2024-04-26T18:33:06.551503+0000","last_unstale":"2024-04-26T18:36:27.975070+0000","last_undegraded":"2024-04-26T18:36:27.975070+0000","last_fullsized":"2024-04-26T18:36:27.975070+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:20.560656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.975057+0000","last_change":"2024-04-26T18:33:06.555971+0000","last_active":"2024-04-26T18:36:27.975057+0000","last_peered":"2024-04-26T18:36:27.975057+0000","last_clean":"2024-04-26T18:36:27.975057+0000","last_became_active":"2024-04-26T18:33:06.555312+0000","last_became_peered":"2024-04-26T18:33:06.555312+0000","last_unstale":"2024-04-26T18:36:27.975057+0000","last_undegraded":"2024-04-26T18:36:27.975057+0000","last_fullsized":"2024-04-26T18:36:27.975057+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:05.066403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972532+0000","last_change":"2024-04-26T18:33:06.567762+0000","last_active":"2024-04-26T18:36:27.972532+0000","last_peered":"2024-04-26T18:36:27.972532+0000","last_clean":"2024-04-26T18:36:27.972532+0000","last_became_active":"2024-04-26T18:33:06.567368+0000","last_became_peered":"2024-04-26T18:33:06.567368+0000","last_unstale":"2024-04-26T18:36:27.972532+0000","last_undegraded":"2024-04-26T18:36:27.972532+0000","last_fullsized":"2024-04-26T18:36:27.972532+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:27.428529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.732899+0000","last_change":"2024-04-26T18:33:06.565334+0000","last_active":"2024-04-26T18:36:27.732899+0000","last_peered":"2024-04-26T18:36:27.732899+0000","last_clean":"2024-04-26T18:36:27.732899+0000","last_became_active":"2024-04-26T18:33:06.564997+0000","last_became_peered":"2024-04-26T18:33:06.564997+0000","last_unstale":"2024-04-26T18:36:27.732899+0000","last_undegraded":"2024-04-26T18:36:27.732899+0000","last_fullsized":"2024-04-26T18:36:27.732899+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:57.892318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.727970+0000","last_change":"2024-04-26T18:33:06.562242+0000","last_active":"2024-04-26T18:36:27.727970+0000","last_peered":"2024-04-26T18:36:27.727970+0000","last_clean":"2024-04-26T18:36:27.727970+0000","last_became_active":"2024-04-26T18:33:06.561863+0000","last_became_peered":"2024-04-26T18:33:06.561863+0000","last_unstale":"2024-04-26T18:36:27.727970+0000","last_undegraded":"2024-04-26T18:36:27.727970+0000","last_fullsized":"2024-04-26T18:36:27.727970+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:22.745294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.976550+0000","last_change":"2024-04-26T18:33:06.555511+0000","last_active":"2024-04-26T18:36:27.976550+0000","last_peered":"2024-04-26T18:36:27.976550+0000","last_clean":"2024-04-26T18:36:27.976550+0000","last_became_active":"2024-04-26T18:33:06.555201+0000","last_became_peered":"2024-04-26T18:33:06.555201+0000","last_unstale":"2024-04-26T18:36:27.976550+0000","last_undegraded":"2024-04-26T18:36:27.976550+0000","last_fullsized":"2024-04-26T18:36:27.976550+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:09.644167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'14","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.728073+0000","last_change":"2024-04-26T18:33:51.664154+0000","last_active":"2024-04-26T18:36:27.728073+0000","last_peered":"2024-04-26T18:36:27.728073+0000","last_clean":"2024-04-26T18:36:27.728073+0000","last_became_active":"2024-04-26T18:33:51.653330+0000","last_became_peered":"2024-04-26T18:33:51.653330+0000","last_unstale":"2024-04-26T18:36:27.728073+0000","last_undegraded":"2024-04-26T18:36:27.728073+0000","last_fullsized":"2024-04-26T18:36:27.728073+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:55:49.100993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.822051+0000","last_change":"2024-04-26T18:33:06.560652+0000","last_active":"2024-04-26T18:36:27.822051+0000","last_peered":"2024-04-26T18:36:27.822051+0000","last_clean":"2024-04-26T18:36:27.822051+0000","last_became_active":"2024-04-26T18:33:06.560311+0000","last_became_peered":"2024-04-26T18:33:06.560311+0000","last_unstale":"2024-04-26T18:36:27.822051+0000","last_undegraded":"2024-04-26T18:36:27.822051+0000","last_fullsized":"2024-04-26T18:36:27.822051+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:22.653995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.822203+0000","last_change":"2024-04-26T18:33:03.860585+0000","last_active":"2024-04-26T18:36:27.822203+0000","last_peered":"2024-04-26T18:36:27.822203+0000","last_clean":"2024-04-26T18:36:27.822203+0000","last_became_active":"2024-04-26T18:33:03.860232+0000","last_became_peered":"2024-04-26T18:33:03.860232+0000","last_unstale":"2024-04-26T18:36:27.822203+0000","last_undegraded":"2024-04-26T18:36:27.822203+0000","last_fullsized":"2024-04-26T18:36:27.822203+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:04.685495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.975810+0000","last_change":"2024-04-26T18:33:06.563764+0000","last_active":"2024-04-26T18:36:27.975810+0000","last_peered":"2024-04-26T18:36:27.975810+0000","last_clean":"2024-04-26T18:36:27.975810+0000","last_became_active":"2024-04-26T18:33:06.563322+0000","last_became_peered":"2024-04-26T18:33:06.563322+0000","last_unstale":"2024-04-26T18:36:27.975810+0000","last_undegraded":"2024-04-26T18:36:27.975810+0000","last_fullsized":"2024-04-26T18:36:27.975810+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:17:53.144144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"91'13","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821711+0000","last_change":"2024-04-26T18:33:03.533057+0000","last_active":"2024-04-26T18:36:27.821711+0000","last_peered":"2024-04-26T18:36:27.821711+0000","last_clean":"2024-04-26T18:36:27.821711+0000","last_became_active":"2024-04-26T18:33:03.532665+0000","last_became_peered":"2024-04-26T18:33:03.532665+0000","last_unstale":"2024-04-26T18:36:27.821711+0000","last_undegraded":"2024-04-26T18:36:27.821711+0000","last_fullsized":"2024-04-26T18:36:27.821711+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:29.125064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972615+0000","last_change":"2024-04-26T18:33:06.567612+0000","last_active":"2024-04-26T18:36:27.972615+0000","last_peered":"2024-04-26T18:36:27.972615+0000","last_clean":"2024-04-26T18:36:27.972615+0000","last_became_active":"2024-04-26T18:33:06.565883+0000","last_became_peered":"2024-04-26T18:33:06.565883+0000","last_unstale":"2024-04-26T18:36:27.972615+0000","last_undegraded":"2024-04-26T18:36:27.972615+0000","last_fullsized":"2024-04-26T18:36:27.972615+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:59.721305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821757+0000","last_change":"2024-04-26T18:33:03.532075+0000","last_active":"2024-04-26T18:36:27.821757+0000","last_peered":"2024-04-26T18:36:27.821757+0000","last_clean":"2024-04-26T18:36:27.821757+0000","last_became_active":"2024-04-26T18:33:03.531729+0000","last_became_peered":"2024-04-26T18:33:03.531729+0000","last_unstale":"2024-04-26T18:36:27.821757+0000","last_undegraded":"2024-04-26T18:36:27.821757+0000","last_fullsized":"2024-04-26T18:36:27.821757+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:23.748292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.828278+0000","last_change":"2024-04-26T18:33:06.569377+0000","last_active":"2024-04-26T18:36:27.828278+0000","last_peered":"2024-04-26T18:36:27.828278+0000","last_clean":"2024-04-26T18:36:27.828278+0000","last_became_active":"2024-04-26T18:33:06.569057+0000","last_became_peered":"2024-04-26T18:33:06.569057+0000","last_unstale":"2024-04-26T18:36:27.828278+0000","last_undegraded":"2024-04-26T18:36:27.828278+0000","last_fullsized":"2024-04-26T18:36:27.828278+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:10.968017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"92'8","reported_seq":226,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:28.164114+0000","last_change":"2024-04-26T18:33:03.525186+0000","last_active":"2024-04-26T18:36:28.164114+0000","last_peered":"2024-04-26T18:36:28.164114+0000","last_clean":"2024-04-26T18:36:28.164114+0000","last_became_active":"2024-04-26T18:33:03.524880+0000","last_became_peered":"2024-04-26T18:33:03.524880+0000","last_unstale":"2024-04-26T18:36:28.164114+0000","last_undegraded":"2024-04-26T18:36:28.164114+0000","last_fullsized":"2024-04-26T18:36:28.164114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:51:30.130244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":190,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821361+0000","last_change":"2024-04-26T18:33:06.558034+0000","last_active":"2024-04-26T18:36:27.821361+0000","last_peered":"2024-04-26T18:36:27.821361+0000","last_clean":"2024-04-26T18:36:27.821361+0000","last_became_active":"2024-04-26T18:33:06.557694+0000","last_became_peered":"2024-04-26T18:33:06.557694+0000","last_unstale":"2024-04-26T18:36:27.821361+0000","last_undegraded":"2024-04-26T18:36:27.821361+0000","last_fullsized":"2024-04-26T18:36:27.821361+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:02.497601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.730278+0000","last_change":"2024-04-26T18:33:03.528750+0000","last_active":"2024-04-26T18:36:27.730278+0000","last_peered":"2024-04-26T18:36:27.730278+0000","last_clean":"2024-04-26T18:36:27.730278+0000","last_became_active":"2024-04-26T18:33:03.528442+0000","last_became_peered":"2024-04-26T18:33:03.528442+0000","last_unstale":"2024-04-26T18:36:27.730278+0000","last_undegraded":"2024-04-26T18:36:27.730278+0000","last_fullsized":"2024-04-26T18:36:27.730278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:13.931280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.828278+0000","last_change":"2024-04-26T18:33:06.561274+0000","last_active":"2024-04-26T18:36:27.828278+0000","last_peered":"2024-04-26T18:36:27.828278+0000","last_clean":"2024-04-26T18:36:27.828278+0000","last_became_active":"2024-04-26T18:33:06.560622+0000","last_became_peered":"2024-04-26T18:33:06.560622+0000","last_unstale":"2024-04-26T18:36:27.828278+0000","last_undegraded":"2024-04-26T18:36:27.828278+0000","last_fullsized":"2024-04-26T18:36:27.828278+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:27.875181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972610+0000","last_change":"2024-04-26T18:33:03.529634+0000","last_active":"2024-04-26T18:36:27.972610+0000","last_peered":"2024-04-26T18:36:27.972610+0000","last_clean":"2024-04-26T18:36:27.972610+0000","last_became_active":"2024-04-26T18:33:03.529303+0000","last_became_peered":"2024-04-26T18:33:03.529303+0000","last_unstale":"2024-04-26T18:36:27.972610+0000","last_undegraded":"2024-04-26T18:36:27.972610+0000","last_fullsized":"2024-04-26T18:36:27.972610+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:37.580542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821227+0000","last_change":"2024-04-26T18:33:06.550896+0000","last_active":"2024-04-26T18:36:27.821227+0000","last_peered":"2024-04-26T18:36:27.821227+0000","last_clean":"2024-04-26T18:36:27.821227+0000","last_became_active":"2024-04-26T18:33:06.550571+0000","last_became_peered":"2024-04-26T18:33:06.550571+0000","last_unstale":"2024-04-26T18:36:27.821227+0000","last_undegraded":"2024-04-26T18:36:27.821227+0000","last_fullsized":"2024-04-26T18:36:27.821227+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:26.715158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.828072+0000","last_change":"2024-04-26T18:33:03.530875+0000","last_active":"2024-04-26T18:36:27.828072+0000","last_peered":"2024-04-26T18:36:27.828072+0000","last_clean":"2024-04-26T18:36:27.828072+0000","last_became_active":"2024-04-26T18:33:03.530564+0000","last_became_peered":"2024-04-26T18:33:03.530564+0000","last_unstale":"2024-04-26T18:36:27.828072+0000","last_undegraded":"2024-04-26T18:36:27.828072+0000","last_fullsized":"2024-04-26T18:36:27.828072+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:20.320591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.727649+0000","last_change":"2024-04-26T18:33:06.553434+0000","last_active":"2024-04-26T18:36:27.727649+0000","last_peered":"2024-04-26T18:36:27.727649+0000","last_clean":"2024-04-26T18:36:27.727649+0000","last_became_active":"2024-04-26T18:33:06.551897+0000","last_became_peered":"2024-04-26T18:33:06.551897+0000","last_unstale":"2024-04-26T18:36:27.727649+0000","last_undegraded":"2024-04-26T18:36:27.727649+0000","last_fullsized":"2024-04-26T18:36:27.727649+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:56.503266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"92'6","reported_seq":404,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:28.163620+0000","last_change":"2024-04-26T18:33:03.524239+0000","last_active":"2024-04-26T18:36:28.163620+0000","last_peered":"2024-04-26T18:36:28.163620+0000","last_clean":"2024-04-26T18:36:28.163620+0000","last_became_active":"2024-04-26T18:33:03.523848+0000","last_became_peered":"2024-04-26T18:33:03.523848+0000","last_unstale":"2024-04-26T18:36:28.163620+0000","last_undegraded":"2024-04-26T18:36:28.163620+0000","last_fullsized":"2024-04-26T18:36:28.163620+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:29.354430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":370,"num_read_kb":370,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972992+0000","last_change":"2024-04-26T18:33:06.569557+0000","last_active":"2024-04-26T18:36:27.972992+0000","last_peered":"2024-04-26T18:36:27.972992+0000","last_clean":"2024-04-26T18:36:27.972992+0000","last_became_active":"2024-04-26T18:33:06.568414+0000","last_became_peered":"2024-04-26T18:33:06.568414+0000","last_unstale":"2024-04-26T18:36:27.972992+0000","last_undegraded":"2024-04-26T18:36:27.972992+0000","last_fullsized":"2024-04-26T18:36:27.972992+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:30.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879761+0000","last_change":"2024-04-26T18:33:03.528554+0000","last_active":"2024-04-26T18:36:27.879761+0000","last_peered":"2024-04-26T18:36:27.879761+0000","last_clean":"2024-04-26T18:36:27.879761+0000","last_became_active":"2024-04-26T18:33:03.527611+0000","last_became_peered":"2024-04-26T18:33:03.527611+0000","last_unstale":"2024-04-26T18:36:27.879761+0000","last_undegraded":"2024-04-26T18:36:27.879761+0000","last_fullsized":"2024-04-26T18:36:27.879761+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:28.387779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.975762+0000","last_change":"2024-04-26T18:33:06.561415+0000","last_active":"2024-04-26T18:36:27.975762+0000","last_peered":"2024-04-26T18:36:27.975762+0000","last_clean":"2024-04-26T18:36:27.975762+0000","last_became_active":"2024-04-26T18:33:06.560518+0000","last_became_peered":"2024-04-26T18:33:06.560518+0000","last_unstale":"2024-04-26T18:36:27.975762+0000","last_undegraded":"2024-04-26T18:36:27.975762+0000","last_fullsized":"2024-04-26T18:36:27.975762+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:49.824157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.828368+0000","last_change":"2024-04-26T18:33:03.861087+0000","last_active":"2024-04-26T18:36:27.828368+0000","last_peered":"2024-04-26T18:36:27.828368+0000","last_clean":"2024-04-26T18:36:27.828368+0000","last_became_active":"2024-04-26T18:33:03.860531+0000","last_became_peered":"2024-04-26T18:33:03.860531+0000","last_unstale":"2024-04-26T18:36:27.828368+0000","last_undegraded":"2024-04-26T18:36:27.828368+0000","last_fullsized":"2024-04-26T18:36:27.828368+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:22:07.086887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972830+0000","last_change":"2024-04-26T18:33:06.565910+0000","last_active":"2024-04-26T18:36:27.972830+0000","last_peered":"2024-04-26T18:36:27.972830+0000","last_clean":"2024-04-26T18:36:27.972830+0000","last_became_active":"2024-04-26T18:33:06.565402+0000","last_became_peered":"2024-04-26T18:33:06.565402+0000","last_unstale":"2024-04-26T18:36:27.972830+0000","last_undegraded":"2024-04-26T18:36:27.972830+0000","last_fullsized":"2024-04-26T18:36:27.972830+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:40.418513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"92'39","reported_seq":450,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:28.164065+0000","last_change":"2024-04-26T18:33:03.527871+0000","last_active":"2024-04-26T18:36:28.164065+0000","last_peered":"2024-04-26T18:36:28.164065+0000","last_clean":"2024-04-26T18:36:28.164065+0000","last_became_active":"2024-04-26T18:33:03.527546+0000","last_became_peered":"2024-04-26T18:33:03.527546+0000","last_unstale":"2024-04-26T18:36:28.164065+0000","last_undegraded":"2024-04-26T18:36:28.164065+0000","last_fullsized":"2024-04-26T18:36:28.164065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:24.749505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67479,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":383,"num_read_kb":257,"num_write":41,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821511+0000","last_change":"2024-04-26T18:33:06.546735+0000","last_active":"2024-04-26T18:36:27.821511+0000","last_peered":"2024-04-26T18:36:27.821511+0000","last_clean":"2024-04-26T18:36:27.821511+0000","last_became_active":"2024-04-26T18:33:06.546360+0000","last_became_peered":"2024-04-26T18:33:06.546360+0000","last_unstale":"2024-04-26T18:36:27.821511+0000","last_undegraded":"2024-04-26T18:36:27.821511+0000","last_fullsized":"2024-04-26T18:36:27.821511+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:15.736669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.976284+0000","last_change":"2024-04-26T18:33:03.526081+0000","last_active":"2024-04-26T18:36:27.976284+0000","last_peered":"2024-04-26T18:36:27.976284+0000","last_clean":"2024-04-26T18:36:27.976284+0000","last_became_active":"2024-04-26T18:33:03.525717+0000","last_became_peered":"2024-04-26T18:33:03.525717+0000","last_unstale":"2024-04-26T18:36:27.976284+0000","last_undegraded":"2024-04-26T18:36:27.976284+0000","last_fullsized":"2024-04-26T18:36:27.976284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:15.137654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972542+0000","last_change":"2024-04-26T18:33:06.552689+0000","last_active":"2024-04-26T18:36:27.972542+0000","last_peered":"2024-04-26T18:36:27.972542+0000","last_clean":"2024-04-26T18:36:27.972542+0000","last_became_active":"2024-04-26T18:33:06.552404+0000","last_became_peered":"2024-04-26T18:33:06.552404+0000","last_unstale":"2024-04-26T18:36:27.972542+0000","last_undegraded":"2024-04-26T18:36:27.972542+0000","last_fullsized":"2024-04-26T18:36:27.972542+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:58:32.681037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.828120+0000","last_change":"2024-04-26T18:33:03.526092+0000","last_active":"2024-04-26T18:36:27.828120+0000","last_peered":"2024-04-26T18:36:27.828120+0000","last_clean":"2024-04-26T18:36:27.828120+0000","last_became_active":"2024-04-26T18:33:03.525782+0000","last_became_peered":"2024-04-26T18:33:03.525782+0000","last_unstale":"2024-04-26T18:36:27.828120+0000","last_undegraded":"2024-04-26T18:36:27.828120+0000","last_fullsized":"2024-04-26T18:36:27.828120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:56.564484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879762+0000","last_change":"2024-04-26T18:33:51.952244+0000","last_active":"2024-04-26T18:36:27.879762+0000","last_peered":"2024-04-26T18:36:27.879762+0000","last_clean":"2024-04-26T18:36:27.879762+0000","last_became_active":"2024-04-26T18:33:51.951795+0000","last_became_peered":"2024-04-26T18:33:51.951795+0000","last_unstale":"2024-04-26T18:36:27.879762+0000","last_undegraded":"2024-04-26T18:36:27.879762+0000","last_fullsized":"2024-04-26T18:36:27.879762+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:39.268117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"92'6","reported_seq":222,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:28.163670+0000","last_change":"2024-04-26T18:33:03.531232+0000","last_active":"2024-04-26T18:36:28.163670+0000","last_peered":"2024-04-26T18:36:28.163670+0000","last_clean":"2024-04-26T18:36:28.163670+0000","last_became_active":"2024-04-26T18:33:03.530861+0000","last_became_peered":"2024-04-26T18:33:03.530861+0000","last_unstale":"2024-04-26T18:36:28.163670+0000","last_undegraded":"2024-04-26T18:36:28.163670+0000","last_fullsized":"2024-04-26T18:36:28.163670+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:07:44.576659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":189,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879514+0000","last_change":"2024-04-26T18:33:06.559471+0000","last_active":"2024-04-26T18:36:27.879514+0000","last_peered":"2024-04-26T18:36:27.879514+0000","last_clean":"2024-04-26T18:36:27.879514+0000","last_became_active":"2024-04-26T18:33:06.559156+0000","last_became_peered":"2024-04-26T18:33:06.559156+0000","last_unstale":"2024-04-26T18:36:27.879514+0000","last_undegraded":"2024-04-26T18:36:27.879514+0000","last_fullsized":"2024-04-26T18:36:27.879514+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:37.624415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821319+0000","last_change":"2024-04-26T18:33:03.860900+0000","last_active":"2024-04-26T18:36:27.821319+0000","last_peered":"2024-04-26T18:36:27.821319+0000","last_clean":"2024-04-26T18:36:27.821319+0000","last_became_active":"2024-04-26T18:33:03.860601+0000","last_became_peered":"2024-04-26T18:33:03.860601+0000","last_unstale":"2024-04-26T18:36:27.821319+0000","last_undegraded":"2024-04-26T18:36:27.821319+0000","last_fullsized":"2024-04-26T18:36:27.821319+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:56.527624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.727809+0000","last_change":"2024-04-26T18:33:51.861484+0000","last_active":"2024-04-26T18:36:27.727809+0000","last_peered":"2024-04-26T18:36:27.727809+0000","last_clean":"2024-04-26T18:36:27.727809+0000","last_became_active":"2024-04-26T18:33:51.861066+0000","last_became_peered":"2024-04-26T18:33:51.861066+0000","last_unstale":"2024-04-26T18:36:27.727809+0000","last_undegraded":"2024-04-26T18:36:27.727809+0000","last_fullsized":"2024-04-26T18:36:27.727809+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:48.477037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.732769+0000","last_change":"2024-04-26T18:33:51.667455+0000","last_active":"2024-04-26T18:36:27.732769+0000","last_peered":"2024-04-26T18:36:27.732769+0000","last_clean":"2024-04-26T18:36:27.732769+0000","last_became_active":"2024-04-26T18:33:51.653472+0000","last_became_peered":"2024-04-26T18:33:51.653472+0000","last_unstale":"2024-04-26T18:36:27.732769+0000","last_undegraded":"2024-04-26T18:36:27.732769+0000","last_fullsized":"2024-04-26T18:36:27.732769+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:19.828738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.732940+0000","last_change":"2024-04-26T18:33:06.557597+0000","last_active":"2024-04-26T18:36:27.732940+0000","last_peered":"2024-04-26T18:36:27.732940+0000","last_clean":"2024-04-26T18:36:27.732940+0000","last_became_active":"2024-04-26T18:33:06.557249+0000","last_became_peered":"2024-04-26T18:33:06.557249+0000","last_unstale":"2024-04-26T18:36:27.732940+0000","last_undegraded":"2024-04-26T18:36:27.732940+0000","last_fullsized":"2024-04-26T18:36:27.732940+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:22.258691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.727925+0000","last_change":"2024-04-26T18:33:03.861082+0000","last_active":"2024-04-26T18:36:27.727925+0000","last_peered":"2024-04-26T18:36:27.727925+0000","last_clean":"2024-04-26T18:36:27.727925+0000","last_became_active":"2024-04-26T18:33:03.860661+0000","last_became_peered":"2024-04-26T18:33:03.860661+0000","last_unstale":"2024-04-26T18:36:27.727925+0000","last_undegraded":"2024-04-26T18:36:27.727925+0000","last_fullsized":"2024-04-26T18:36:27.727925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:46.653421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.730335+0000","last_change":"2024-04-26T18:33:06.558268+0000","last_active":"2024-04-26T18:36:27.730335+0000","last_peered":"2024-04-26T18:36:27.730335+0000","last_clean":"2024-04-26T18:36:27.730335+0000","last_became_active":"2024-04-26T18:33:06.557899+0000","last_became_peered":"2024-04-26T18:33:06.557899+0000","last_unstale":"2024-04-26T18:36:27.730335+0000","last_undegraded":"2024-04-26T18:36:27.730335+0000","last_fullsized":"2024-04-26T18:36:27.730335+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:03:47.016288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"92'7","reported_seq":221,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.880058+0000","last_change":"2024-04-26T18:33:03.528398+0000","last_active":"2024-04-26T18:36:27.880058+0000","last_peered":"2024-04-26T18:36:27.880058+0000","last_clean":"2024-04-26T18:36:27.880058+0000","last_became_active":"2024-04-26T18:33:03.528008+0000","last_became_peered":"2024-04-26T18:33:03.528008+0000","last_unstale":"2024-04-26T18:36:27.880058+0000","last_undegraded":"2024-04-26T18:36:27.880058+0000","last_fullsized":"2024-04-26T18:36:27.880058+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:27.027873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1287,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.730411+0000","last_change":"2024-04-26T18:33:06.556035+0000","last_active":"2024-04-26T18:36:27.730411+0000","last_peered":"2024-04-26T18:36:27.730411+0000","last_clean":"2024-04-26T18:36:27.730411+0000","last_became_active":"2024-04-26T18:33:06.555703+0000","last_became_peered":"2024-04-26T18:33:06.555703+0000","last_unstale":"2024-04-26T18:36:27.730411+0000","last_undegraded":"2024-04-26T18:36:27.730411+0000","last_fullsized":"2024-04-26T18:36:27.730411+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:30:02.064205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.828317+0000","last_change":"2024-04-26T18:33:06.556447+0000","last_active":"2024-04-26T18:36:27.828317+0000","last_peered":"2024-04-26T18:36:27.828317+0000","last_clean":"2024-04-26T18:36:27.828317+0000","last_became_active":"2024-04-26T18:33:06.556124+0000","last_became_peered":"2024-04-26T18:33:06.556124+0000","last_unstale":"2024-04-26T18:36:27.828317+0000","last_undegraded":"2024-04-26T18:36:27.828317+0000","last_fullsized":"2024-04-26T18:36:27.828317+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:43:07.915584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"92'6","reported_seq":221,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.974747+0000","last_change":"2024-04-26T18:33:03.860440+0000","last_active":"2024-04-26T18:36:27.974747+0000","last_peered":"2024-04-26T18:36:27.974747+0000","last_clean":"2024-04-26T18:36:27.974747+0000","last_became_active":"2024-04-26T18:33:03.860112+0000","last_became_peered":"2024-04-26T18:33:03.860112+0000","last_unstale":"2024-04-26T18:36:27.974747+0000","last_undegraded":"2024-04-26T18:36:27.974747+0000","last_fullsized":"2024-04-26T18:36:27.974747+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:19:05.661597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":186,"num_read_kb":186,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821540+0000","last_change":"2024-04-26T18:33:06.561688+0000","last_active":"2024-04-26T18:36:27.821540+0000","last_peered":"2024-04-26T18:36:27.821540+0000","last_clean":"2024-04-26T18:36:27.821540+0000","last_became_active":"2024-04-26T18:33:06.561285+0000","last_became_peered":"2024-04-26T18:33:06.561285+0000","last_unstale":"2024-04-26T18:36:27.821540+0000","last_undegraded":"2024-04-26T18:36:27.821540+0000","last_fullsized":"2024-04-26T18:36:27.821540+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:13.272896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.973292+0000","last_change":"2024-04-26T18:33:03.531237+0000","last_active":"2024-04-26T18:36:27.973292+0000","last_peered":"2024-04-26T18:36:27.973292+0000","last_clean":"2024-04-26T18:36:27.973292+0000","last_became_active":"2024-04-26T18:33:03.530843+0000","last_became_peered":"2024-04-26T18:33:03.530843+0000","last_unstale":"2024-04-26T18:36:27.973292+0000","last_undegraded":"2024-04-26T18:36:27.973292+0000","last_fullsized":"2024-04-26T18:36:27.973292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:24.454752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":362,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879655+0000","last_change":"2024-04-26T18:31:39.402840+0000","last_active":"2024-04-26T18:36:27.879655+0000","last_peered":"2024-04-26T18:36:27.879655+0000","last_clean":"2024-04-26T18:36:27.879655+0000","last_became_active":"2024-04-26T18:31:39.402341+0000","last_became_peered":"2024-04-26T18:31:39.402341+0000","last_unstale":"2024-04-26T18:36:27.879655+0000","last_undegraded":"2024-04-26T18:36:27.879655+0000","last_fullsized":"2024-04-26T18:36:27.879655+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:28:14.522548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:28:14.522548+0000","last_clean_scrub_stamp":"2024-04-26T18:28:14.522548+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:32.052085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972457+0000","last_change":"2024-04-26T18:33:06.557695+0000","last_active":"2024-04-26T18:36:27.972457+0000","last_peered":"2024-04-26T18:36:27.972457+0000","last_clean":"2024-04-26T18:36:27.972457+0000","last_became_active":"2024-04-26T18:33:06.557369+0000","last_became_peered":"2024-04-26T18:33:06.557369+0000","last_unstale":"2024-04-26T18:36:27.972457+0000","last_undegraded":"2024-04-26T18:36:27.972457+0000","last_fullsized":"2024-04-26T18:36:27.972457+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:35.666232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879757+0000","last_change":"2024-04-26T18:33:03.527897+0000","last_active":"2024-04-26T18:36:27.879757+0000","last_peered":"2024-04-26T18:36:27.879757+0000","last_clean":"2024-04-26T18:36:27.879757+0000","last_became_active":"2024-04-26T18:33:03.527345+0000","last_became_peered":"2024-04-26T18:33:03.527345+0000","last_unstale":"2024-04-26T18:36:27.879757+0000","last_undegraded":"2024-04-26T18:36:27.879757+0000","last_fullsized":"2024-04-26T18:36:27.879757+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:31.144555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821580+0000","last_change":"2024-04-26T18:33:03.860572+0000","last_active":"2024-04-26T18:36:27.821580+0000","last_peered":"2024-04-26T18:36:27.821580+0000","last_clean":"2024-04-26T18:36:27.821580+0000","last_became_active":"2024-04-26T18:33:03.860188+0000","last_became_peered":"2024-04-26T18:33:03.860188+0000","last_unstale":"2024-04-26T18:36:27.821580+0000","last_undegraded":"2024-04-26T18:36:27.821580+0000","last_fullsized":"2024-04-26T18:36:27.821580+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:24:34.811572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972827+0000","last_change":"2024-04-26T18:33:06.558075+0000","last_active":"2024-04-26T18:36:27.972827+0000","last_peered":"2024-04-26T18:36:27.972827+0000","last_clean":"2024-04-26T18:36:27.972827+0000","last_became_active":"2024-04-26T18:33:06.557293+0000","last_became_peered":"2024-04-26T18:33:06.557293+0000","last_unstale":"2024-04-26T18:36:27.972827+0000","last_undegraded":"2024-04-26T18:36:27.972827+0000","last_fullsized":"2024-04-26T18:36:27.972827+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:12.635253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"92'53","reported_seq":104,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.936921+0000","last_change":"2024-04-26T18:33:03.528196+0000","last_active":"2024-04-26T18:36:27.936921+0000","last_peered":"2024-04-26T18:36:27.936921+0000","last_clean":"2024-04-26T18:36:27.936921+0000","last_became_active":"2024-04-26T18:33:03.527846+0000","last_became_peered":"2024-04-26T18:33:03.527846+0000","last_unstale":"2024-04-26T18:36:27.936921+0000","last_undegraded":"2024-04-26T18:36:27.936921+0000","last_fullsized":"2024-04-26T18:36:27.936921+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:13:46.073405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":94,"num_write_kb":839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.822230+0000","last_change":"2024-04-26T18:33:06.550260+0000","last_active":"2024-04-26T18:36:27.822230+0000","last_peered":"2024-04-26T18:36:27.822230+0000","last_clean":"2024-04-26T18:36:27.822230+0000","last_became_active":"2024-04-26T18:33:06.549925+0000","last_became_peered":"2024-04-26T18:33:06.549925+0000","last_unstale":"2024-04-26T18:36:27.822230+0000","last_undegraded":"2024-04-26T18:36:27.822230+0000","last_fullsized":"2024-04-26T18:36:27.822230+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:17:01.777381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.973782+0000","last_change":"2024-04-26T18:33:03.876609+0000","last_active":"2024-04-26T18:36:27.973782+0000","last_peered":"2024-04-26T18:36:27.973782+0000","last_clean":"2024-04-26T18:36:27.973782+0000","last_became_active":"2024-04-26T18:33:03.876284+0000","last_became_peered":"2024-04-26T18:33:03.876284+0000","last_unstale":"2024-04-26T18:36:27.973782+0000","last_undegraded":"2024-04-26T18:36:27.973782+0000","last_fullsized":"2024-04-26T18:36:27.973782+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:22.995000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.975703+0000","last_change":"2024-04-26T18:33:06.558735+0000","last_active":"2024-04-26T18:36:27.975703+0000","last_peered":"2024-04-26T18:36:27.975703+0000","last_clean":"2024-04-26T18:36:27.975703+0000","last_became_active":"2024-04-26T18:33:06.558416+0000","last_became_peered":"2024-04-26T18:33:06.558416+0000","last_unstale":"2024-04-26T18:36:27.975703+0000","last_undegraded":"2024-04-26T18:36:27.975703+0000","last_fullsized":"2024-04-26T18:36:27.975703+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:27.627055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972536+0000","last_change":"2024-04-26T18:33:03.861073+0000","last_active":"2024-04-26T18:36:27.972536+0000","last_peered":"2024-04-26T18:36:27.972536+0000","last_clean":"2024-04-26T18:36:27.972536+0000","last_became_active":"2024-04-26T18:33:03.860661+0000","last_became_peered":"2024-04-26T18:33:03.860661+0000","last_unstale":"2024-04-26T18:36:27.972536+0000","last_undegraded":"2024-04-26T18:36:27.972536+0000","last_fullsized":"2024-04-26T18:36:27.972536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:19.429969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821326+0000","last_change":"2024-04-26T18:33:06.553160+0000","last_active":"2024-04-26T18:36:27.821326+0000","last_peered":"2024-04-26T18:36:27.821326+0000","last_clean":"2024-04-26T18:36:27.821326+0000","last_became_active":"2024-04-26T18:33:06.552791+0000","last_became_peered":"2024-04-26T18:33:06.552791+0000","last_unstale":"2024-04-26T18:36:27.821326+0000","last_undegraded":"2024-04-26T18:36:27.821326+0000","last_fullsized":"2024-04-26T18:36:27.821326+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:31.675069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821250+0000","last_change":"2024-04-26T18:33:03.524443+0000","last_active":"2024-04-26T18:36:27.821250+0000","last_peered":"2024-04-26T18:36:27.821250+0000","last_clean":"2024-04-26T18:36:27.821250+0000","last_became_active":"2024-04-26T18:33:03.524137+0000","last_became_peered":"2024-04-26T18:33:03.524137+0000","last_unstale":"2024-04-26T18:36:27.821250+0000","last_undegraded":"2024-04-26T18:36:27.821250+0000","last_fullsized":"2024-04-26T18:36:27.821250+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:43.021778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.732498+0000","last_change":"2024-04-26T18:33:06.553698+0000","last_active":"2024-04-26T18:36:27.732498+0000","last_peered":"2024-04-26T18:36:27.732498+0000","last_clean":"2024-04-26T18:36:27.732498+0000","last_became_active":"2024-04-26T18:33:06.552995+0000","last_became_peered":"2024-04-26T18:33:06.552995+0000","last_unstale":"2024-04-26T18:36:27.732498+0000","last_undegraded":"2024-04-26T18:36:27.732498+0000","last_fullsized":"2024-04-26T18:36:27.732498+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:27.135435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"92'4","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.732832+0000","last_change":"2024-04-26T18:33:51.656557+0000","last_active":"2024-04-26T18:36:27.732832+0000","last_peered":"2024-04-26T18:36:27.732832+0000","last_clean":"2024-04-26T18:36:27.732832+0000","last_became_active":"2024-04-26T18:33:51.652009+0000","last_became_peered":"2024-04-26T18:33:51.652009+0000","last_unstale":"2024-04-26T18:36:27.732832+0000","last_undegraded":"2024-04-26T18:36:27.732832+0000","last_fullsized":"2024-04-26T18:36:27.732832+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:05.047482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821858+0000","last_change":"2024-04-26T18:33:06.553596+0000","last_active":"2024-04-26T18:36:27.821858+0000","last_peered":"2024-04-26T18:36:27.821858+0000","last_clean":"2024-04-26T18:36:27.821858+0000","last_became_active":"2024-04-26T18:33:06.553284+0000","last_became_peered":"2024-04-26T18:33:06.553284+0000","last_unstale":"2024-04-26T18:36:27.821858+0000","last_undegraded":"2024-04-26T18:36:27.821858+0000","last_fullsized":"2024-04-26T18:36:27.821858+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.245437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821437+0000","last_change":"2024-04-26T18:33:51.865849+0000","last_active":"2024-04-26T18:36:27.821437+0000","last_peered":"2024-04-26T18:36:27.821437+0000","last_clean":"2024-04-26T18:36:27.821437+0000","last_became_active":"2024-04-26T18:33:51.861408+0000","last_became_peered":"2024-04-26T18:33:51.861408+0000","last_unstale":"2024-04-26T18:36:27.821437+0000","last_undegraded":"2024-04-26T18:36:27.821437+0000","last_fullsized":"2024-04-26T18:36:27.821437+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:12.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879862+0000","last_change":"2024-04-26T18:33:06.566899+0000","last_active":"2024-04-26T18:36:27.879862+0000","last_peered":"2024-04-26T18:36:27.879862+0000","last_clean":"2024-04-26T18:36:27.879862+0000","last_became_active":"2024-04-26T18:33:06.566548+0000","last_became_peered":"2024-04-26T18:33:06.566548+0000","last_unstale":"2024-04-26T18:36:27.879862+0000","last_undegraded":"2024-04-26T18:36:27.879862+0000","last_fullsized":"2024-04-26T18:36:27.879862+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:07.751063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'5","reported_seq":220,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.976545+0000","last_change":"2024-04-26T18:33:03.876589+0000","last_active":"2024-04-26T18:36:27.976545+0000","last_peered":"2024-04-26T18:36:27.976545+0000","last_clean":"2024-04-26T18:36:27.976545+0000","last_became_active":"2024-04-26T18:33:03.876262+0000","last_became_peered":"2024-04-26T18:33:03.876262+0000","last_unstale":"2024-04-26T18:36:27.976545+0000","last_undegraded":"2024-04-26T18:36:27.976545+0000","last_fullsized":"2024-04-26T18:36:27.976545+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:04.959745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":187,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879892+0000","last_change":"2024-04-26T18:33:06.561848+0000","last_active":"2024-04-26T18:36:27.879892+0000","last_peered":"2024-04-26T18:36:27.879892+0000","last_clean":"2024-04-26T18:36:27.879892+0000","last_became_active":"2024-04-26T18:33:06.561514+0000","last_became_peered":"2024-04-26T18:33:06.561514+0000","last_unstale":"2024-04-26T18:36:27.879892+0000","last_undegraded":"2024-04-26T18:36:27.879892+0000","last_fullsized":"2024-04-26T18:36:27.879892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:46.326261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"92'41","reported_seq":77,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.929940+0000","last_change":"2024-04-26T18:33:03.527237+0000","last_active":"2024-04-26T18:36:27.929940+0000","last_peered":"2024-04-26T18:36:27.929940+0000","last_clean":"2024-04-26T18:36:27.929940+0000","last_became_active":"2024-04-26T18:33:03.526618+0000","last_became_peered":"2024-04-26T18:33:03.526618+0000","last_unstale":"2024-04-26T18:36:27.929940+0000","last_undegraded":"2024-04-26T18:36:27.929940+0000","last_fullsized":"2024-04-26T18:36:27.929940+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:28.232597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879697+0000","last_change":"2024-04-26T18:33:06.555276+0000","last_active":"2024-04-26T18:36:27.879697+0000","last_peered":"2024-04-26T18:36:27.879697+0000","last_clean":"2024-04-26T18:36:27.879697+0000","last_became_active":"2024-04-26T18:33:06.554889+0000","last_became_peered":"2024-04-26T18:33:06.554889+0000","last_unstale":"2024-04-26T18:36:27.879697+0000","last_undegraded":"2024-04-26T18:36:27.879697+0000","last_fullsized":"2024-04-26T18:36:27.879697+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:33:13.614662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.973156+0000","last_change":"2024-04-26T18:33:03.527108+0000","last_active":"2024-04-26T18:36:27.973156+0000","last_peered":"2024-04-26T18:36:27.973156+0000","last_clean":"2024-04-26T18:36:27.973156+0000","last_became_active":"2024-04-26T18:33:03.526648+0000","last_became_peered":"2024-04-26T18:33:03.526648+0000","last_unstale":"2024-04-26T18:36:27.973156+0000","last_undegraded":"2024-04-26T18:36:27.973156+0000","last_fullsized":"2024-04-26T18:36:27.973156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:40.915022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879890+0000","last_change":"2024-04-26T18:33:06.551605+0000","last_active":"2024-04-26T18:36:27.879890+0000","last_peered":"2024-04-26T18:36:27.879890+0000","last_clean":"2024-04-26T18:36:27.879890+0000","last_became_active":"2024-04-26T18:33:06.550772+0000","last_became_peered":"2024-04-26T18:33:06.550772+0000","last_unstale":"2024-04-26T18:36:27.879890+0000","last_undegraded":"2024-04-26T18:36:27.879890+0000","last_fullsized":"2024-04-26T18:36:27.879890+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:33.124989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.732576+0000","last_change":"2024-04-26T18:33:06.558971+0000","last_active":"2024-04-26T18:36:27.732576+0000","last_peered":"2024-04-26T18:36:27.732576+0000","last_clean":"2024-04-26T18:36:27.732576+0000","last_became_active":"2024-04-26T18:33:06.558594+0000","last_became_peered":"2024-04-26T18:33:06.558594+0000","last_unstale":"2024-04-26T18:36:27.732576+0000","last_undegraded":"2024-04-26T18:36:27.732576+0000","last_fullsized":"2024-04-26T18:36:27.732576+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:12.974472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.976355+0000","last_change":"2024-04-26T18:33:06.558928+0000","last_active":"2024-04-26T18:36:27.976355+0000","last_peered":"2024-04-26T18:36:27.976355+0000","last_clean":"2024-04-26T18:36:27.976355+0000","last_became_active":"2024-04-26T18:33:06.558348+0000","last_became_peered":"2024-04-26T18:33:06.558348+0000","last_unstale":"2024-04-26T18:36:27.976355+0000","last_undegraded":"2024-04-26T18:36:27.976355+0000","last_fullsized":"2024-04-26T18:36:27.976355+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:04.266404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.976230+0000","last_change":"2024-04-26T18:33:06.555182+0000","last_active":"2024-04-26T18:36:27.976230+0000","last_peered":"2024-04-26T18:36:27.976230+0000","last_clean":"2024-04-26T18:36:27.976230+0000","last_became_active":"2024-04-26T18:33:06.554830+0000","last_became_peered":"2024-04-26T18:33:06.554830+0000","last_unstale":"2024-04-26T18:36:27.976230+0000","last_undegraded":"2024-04-26T18:36:27.976230+0000","last_fullsized":"2024-04-26T18:36:27.976230+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:48.841634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.975313+0000","last_change":"2024-04-26T18:33:06.558962+0000","last_active":"2024-04-26T18:36:27.975313+0000","last_peered":"2024-04-26T18:36:27.975313+0000","last_clean":"2024-04-26T18:36:27.975313+0000","last_became_active":"2024-04-26T18:33:06.557995+0000","last_became_peered":"2024-04-26T18:33:06.557995+0000","last_unstale":"2024-04-26T18:36:27.975313+0000","last_undegraded":"2024-04-26T18:36:27.975313+0000","last_fullsized":"2024-04-26T18:36:27.975313+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:54.207205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.973002+0000","last_change":"2024-04-26T18:33:06.558055+0000","last_active":"2024-04-26T18:36:27.973002+0000","last_peered":"2024-04-26T18:36:27.973002+0000","last_clean":"2024-04-26T18:36:27.973002+0000","last_became_active":"2024-04-26T18:33:06.557299+0000","last_became_peered":"2024-04-26T18:33:06.557299+0000","last_unstale":"2024-04-26T18:36:27.973002+0000","last_undegraded":"2024-04-26T18:36:27.973002+0000","last_fullsized":"2024-04-26T18:36:27.973002+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:21.143017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.732894+0000","last_change":"2024-04-26T18:33:06.558680+0000","last_active":"2024-04-26T18:36:27.732894+0000","last_peered":"2024-04-26T18:36:27.732894+0000","last_clean":"2024-04-26T18:36:27.732894+0000","last_became_active":"2024-04-26T18:33:06.558139+0000","last_became_peered":"2024-04-26T18:33:06.558139+0000","last_unstale":"2024-04-26T18:36:27.732894+0000","last_undegraded":"2024-04-26T18:36:27.732894+0000","last_fullsized":"2024-04-26T18:36:27.732894+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:31.511770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.976583+0000","last_change":"2024-04-26T18:33:06.563832+0000","last_active":"2024-04-26T18:36:27.976583+0000","last_peered":"2024-04-26T18:36:27.976583+0000","last_clean":"2024-04-26T18:36:27.976583+0000","last_became_active":"2024-04-26T18:33:06.562193+0000","last_became_peered":"2024-04-26T18:33:06.562193+0000","last_unstale":"2024-04-26T18:36:27.976583+0000","last_undegraded":"2024-04-26T18:36:27.976583+0000","last_fullsized":"2024-04-26T18:36:27.976583+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:35.384552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.822222+0000","last_change":"2024-04-26T18:33:06.562368+0000","last_active":"2024-04-26T18:36:27.822222+0000","last_peered":"2024-04-26T18:36:27.822222+0000","last_clean":"2024-04-26T18:36:27.822222+0000","last_became_active":"2024-04-26T18:33:06.562024+0000","last_became_peered":"2024-04-26T18:33:06.562024+0000","last_unstale":"2024-04-26T18:36:27.822222+0000","last_undegraded":"2024-04-26T18:36:27.822222+0000","last_fullsized":"2024-04-26T18:36:27.822222+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:01.562885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.828141+0000","last_change":"2024-04-26T18:33:06.560953+0000","last_active":"2024-04-26T18:36:27.828141+0000","last_peered":"2024-04-26T18:36:27.828141+0000","last_clean":"2024-04-26T18:36:27.828141+0000","last_became_active":"2024-04-26T18:33:06.560593+0000","last_became_peered":"2024-04-26T18:33:06.560593+0000","last_unstale":"2024-04-26T18:36:27.828141+0000","last_undegraded":"2024-04-26T18:36:27.828141+0000","last_fullsized":"2024-04-26T18:36:27.828141+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:18.168564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821227+0000","last_change":"2024-04-26T18:33:06.555389+0000","last_active":"2024-04-26T18:36:27.821227+0000","last_peered":"2024-04-26T18:36:27.821227+0000","last_clean":"2024-04-26T18:36:27.821227+0000","last_became_active":"2024-04-26T18:33:06.555055+0000","last_became_peered":"2024-04-26T18:33:06.555055+0000","last_unstale":"2024-04-26T18:36:27.821227+0000","last_undegraded":"2024-04-26T18:36:27.821227+0000","last_fullsized":"2024-04-26T18:36:27.821227+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:32.802687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972845+0000","last_change":"2024-04-26T18:33:06.563791+0000","last_active":"2024-04-26T18:36:27.972845+0000","last_peered":"2024-04-26T18:36:27.972845+0000","last_clean":"2024-04-26T18:36:27.972845+0000","last_became_active":"2024-04-26T18:33:06.561959+0000","last_became_peered":"2024-04-26T18:33:06.561959+0000","last_unstale":"2024-04-26T18:36:27.972845+0000","last_undegraded":"2024-04-26T18:36:27.972845+0000","last_fullsized":"2024-04-26T18:36:27.972845+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:35.280202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972808+0000","last_change":"2024-04-26T18:33:06.554270+0000","last_active":"2024-04-26T18:36:27.972808+0000","last_peered":"2024-04-26T18:36:27.972808+0000","last_clean":"2024-04-26T18:36:27.972808+0000","last_became_active":"2024-04-26T18:33:06.553931+0000","last_became_peered":"2024-04-26T18:33:06.553931+0000","last_unstale":"2024-04-26T18:36:27.972808+0000","last_undegraded":"2024-04-26T18:36:27.972808+0000","last_fullsized":"2024-04-26T18:36:27.972808+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:40.587824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.732694+0000","last_change":"2024-04-26T18:33:06.556766+0000","last_active":"2024-04-26T18:36:27.732694+0000","last_peered":"2024-04-26T18:36:27.732694+0000","last_clean":"2024-04-26T18:36:27.732694+0000","last_became_active":"2024-04-26T18:33:06.556361+0000","last_became_peered":"2024-04-26T18:33:06.556361+0000","last_unstale":"2024-04-26T18:36:27.732694+0000","last_undegraded":"2024-04-26T18:36:27.732694+0000","last_fullsized":"2024-04-26T18:36:27.732694+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:10.101747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":106677,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":600730,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1980,"num_read_kb":1102,"num_write":380,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":724992,"data_stored":1802190,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351032,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1011712,"data_stored":492367,"data_compressed":2887,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612669,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32340,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712812,"statfs":{"total":95995035648,"available":95961919488,"internally_reserved":0,"allocated":1191936,"data_stored":1282844,"data_compressed":44602,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776195,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1056768,"data_stored":885491,"data_compressed":22033,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037831,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1040384,"data_stored":885175,"data_compressed":22033,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299469,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712916,"statfs":{"total":95995035648,"available":95962025984,"internally_reserved":0,"allocated":1081344,"data_stored":1086793,"data_compressed":38446,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462994,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1015808,"data_stored":492691,"data_compressed":2887,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36400,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708752,"statfs":{"total":95995035648,"available":95957762048,"internally_reserved":0,"allocated":1085440,"data_stored":561083,"data_compressed":2887,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738479,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":493331,"data_compressed":2887,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411430,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1105920,"data_stored":561527,"data_compressed":2887,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149793,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1064960,"data_stored":885553,"data_compressed":21689,"data_compressed_allocated":28672,"data_compressed_original":397312,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888156,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":483627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724629,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1114112,"data_stored":1216981,"data_compressed":44602,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":70374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":525246,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":135343,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394022,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":201206,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T18:36:33.422 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T18:36:33.661 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:36:33.916 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:33 smithi080 ceph-mon[29135]: Updating smithi080:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T18:36:33.916 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:33 smithi080 ceph-mon[29135]: Updating smithi082:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T18:36:33.916 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:33 smithi080 ceph-mon[29135]: Updating smithi192:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T18:36:33.917 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:33 smithi080 ceph-mon[29135]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:36:33.917 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:33 smithi080 ceph-mon[29135]: Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2024-04-26T18:36:33.917 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:33 smithi080 ceph-mon[29135]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-04-26T18:36:33.917 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:33 smithi080 ceph-mon[29135]: Updating smithi192:/etc/ceph/ceph.client.admin.keyring 2024-04-26T18:36:33.917 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:33 smithi080 ceph-mon[29135]: Updating smithi080:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T18:36:33.917 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:33 smithi080 ceph-mon[29135]: Updating smithi082:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T18:36:33.917 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:33 smithi080 ceph-mon[29135]: Updating smithi192:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T18:36:33.917 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:33 smithi080 ceph-mon[29135]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-04-26T18:36:33.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:33 smithi082 ceph-mon[32808]: Updating smithi080:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T18:36:33.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:33 smithi082 ceph-mon[32808]: Updating smithi082:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T18:36:33.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:33 smithi082 ceph-mon[32808]: Updating smithi192:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T18:36:33.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:33 smithi082 ceph-mon[32808]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:36:33.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:33 smithi082 ceph-mon[32808]: Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2024-04-26T18:36:33.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:33 smithi082 ceph-mon[32808]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-04-26T18:36:33.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:33 smithi082 ceph-mon[32808]: Updating smithi192:/etc/ceph/ceph.client.admin.keyring 2024-04-26T18:36:33.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:33 smithi082 ceph-mon[32808]: Updating smithi080:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T18:36:33.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:33 smithi082 ceph-mon[32808]: Updating smithi082:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T18:36:33.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:33 smithi082 ceph-mon[32808]: Updating smithi192:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T18:36:33.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:33 smithi082 ceph-mon[32808]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-04-26T18:36:34.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:33 smithi192 ceph-mon[32842]: Updating smithi080:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T18:36:34.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:33 smithi192 ceph-mon[32842]: Updating smithi082:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T18:36:34.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:33 smithi192 ceph-mon[32842]: Updating smithi192:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T18:36:34.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:33 smithi192 ceph-mon[32842]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:36:34.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:33 smithi192 ceph-mon[32842]: Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2024-04-26T18:36:34.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:33 smithi192 ceph-mon[32842]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-04-26T18:36:34.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:33 smithi192 ceph-mon[32842]: Updating smithi192:/etc/ceph/ceph.client.admin.keyring 2024-04-26T18:36:34.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:33 smithi192 ceph-mon[32842]: Updating smithi080:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T18:36:34.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:33 smithi192 ceph-mon[32842]: Updating smithi082:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T18:36:34.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:33 smithi192 ceph-mon[32842]: Updating smithi192:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T18:36:34.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:33 smithi192 ceph-mon[32842]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-04-26T18:36:34.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:34 smithi080 ceph-mon[29135]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T18:36:34.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:34 smithi082 ceph-mon[32808]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T18:36:35.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:34 smithi192 ceph-mon[32842]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T18:36:35.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.344+0000 7fcd9a2f9700 1 -- 172.21.15.80:0/116004975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd9406bad0 msgr2=0x7fcd941102e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:35.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.344+0000 7fcd9a2f9700 1 --2- 172.21.15.80:0/116004975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd9406bad0 0x7fcd941102e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c00b0a0 tx=0x7fcd8c00b3b0 comp rx=0 tx=0).stop 2024-04-26T18:36:35.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.344+0000 7fcd9a2f9700 1 -- 172.21.15.80:0/116004975 shutdown_connections 2024-04-26T18:36:35.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.344+0000 7fcd9a2f9700 1 --2- 172.21.15.80:0/116004975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd9406bad0 0x7fcd941102e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:35.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.344+0000 7fcd9a2f9700 1 --2- 172.21.15.80:0/116004975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd941094a0 0x7fcd94109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:35.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.344+0000 7fcd9a2f9700 1 --2- 172.21.15.80:0/116004975 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd9406b130 0x7fcd9406b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:35.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.344+0000 7fcd9a2f9700 1 -- 172.21.15.80:0/116004975 >> 172.21.15.80:0/116004975 conn(0x7fcd940792d0 msgr2=0x7fcd940796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:35.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.344+0000 7fcd9a2f9700 1 -- 172.21.15.80:0/116004975 shutdown_connections 2024-04-26T18:36:35.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.344+0000 7fcd9a2f9700 1 -- 172.21.15.80:0/116004975 wait complete. 2024-04-26T18:36:35.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.345+0000 7fcd9a2f9700 1 Processor -- start 2024-04-26T18:36:35.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.345+0000 7fcd9a2f9700 1 -- start start 2024-04-26T18:36:35.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.345+0000 7fcd9a2f9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd9406b130 0x7fcd941a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:35.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.345+0000 7fcd9a2f9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd9406bad0 0x7fcd941a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:35.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.345+0000 7fcd9a2f9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd941094a0 0x7fcd9419bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:35.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.345+0000 7fcd9a2f9700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcd941135d0 con 0x7fcd9406b130 2024-04-26T18:36:35.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.345+0000 7fcd9a2f9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcd94113450 con 0x7fcd941094a0 2024-04-26T18:36:35.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.345+0000 7fcd9a2f9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcd94113750 con 0x7fcd9406bad0 2024-04-26T18:36:35.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.345+0000 7fcd93fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd9406b130 0x7fcd941a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:35.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.345+0000 7fcd93fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd9406b130 0x7fcd941a1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34852/0 (socket says 172.21.15.80:34852) 2024-04-26T18:36:35.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.345+0000 7fcd93fff700 1 -- 172.21.15.80:0/1477968233 learned_addr learned my addr 172.21.15.80:0/1477968233 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:35.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.345+0000 7fcd937fe700 1 --2- 172.21.15.80:0/1477968233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd9406bad0 0x7fcd941a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:35.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.346+0000 7fcd98896700 1 --2- 172.21.15.80:0/1477968233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd941094a0 0x7fcd9419bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:35.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.346+0000 7fcd93fff700 1 -- 172.21.15.80:0/1477968233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd9406bad0 msgr2=0x7fcd941a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:35.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.346+0000 7fcd93fff700 1 --2- 172.21.15.80:0/1477968233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd9406bad0 0x7fcd941a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:35.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.346+0000 7fcd93fff700 1 -- 172.21.15.80:0/1477968233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd941094a0 msgr2=0x7fcd9419bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:35.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.346+0000 7fcd93fff700 1 --2- 172.21.15.80:0/1477968233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd941094a0 0x7fcd9419bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:35.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.346+0000 7fcd93fff700 1 -- 172.21.15.80:0/1477968233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd9419c230 con 0x7fcd9406b130 2024-04-26T18:36:35.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.346+0000 7fcd937fe700 1 --2- 172.21.15.80:0/1477968233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd9406bad0 0x7fcd941a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:36:35.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.346+0000 7fcd98896700 1 --2- 172.21.15.80:0/1477968233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd941094a0 0x7fcd9419bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:36:35.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.346+0000 7fcd93fff700 1 --2- 172.21.15.80:0/1477968233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd9406b130 0x7fcd941a1910 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fcd8400d980 tx=0x7fcd8400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:35.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.346+0000 7fcd917fa700 1 -- 172.21.15.80:0/1477968233 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd84016070 con 0x7fcd9406b130 2024-04-26T18:36:35.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.346+0000 7fcd917fa700 1 -- 172.21.15.80:0/1477968233 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd84004830 con 0x7fcd9406b130 2024-04-26T18:36:35.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.346+0000 7fcd9a2f9700 1 -- 172.21.15.80:0/1477968233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd9419c520 con 0x7fcd9406b130 2024-04-26T18:36:35.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.346+0000 7fcd917fa700 1 -- 172.21.15.80:0/1477968233 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd840054c0 con 0x7fcd9406b130 2024-04-26T18:36:35.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.346+0000 7fcd9a2f9700 1 -- 172.21.15.80:0/1477968233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd941a87e0 con 0x7fcd9406b130 2024-04-26T18:36:35.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.347+0000 7fcd9a2f9700 1 -- 172.21.15.80:0/1477968233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd9406a110 con 0x7fcd9406b130 2024-04-26T18:36:35.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.348+0000 7fcd917fa700 1 -- 172.21.15.80:0/1477968233 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 24) ==== 138873+0+0 (secure 0 0 0) 0x7fcd84004220 con 0x7fcd9406b130 2024-04-26T18:36:35.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.349+0000 7fcd917fa700 1 --2- 172.21.15.80:0/1477968233 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fcd7c0a3ed0 0x7fcd7c0a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:35.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.349+0000 7fcd937fe700 1 --2- 172.21.15.80:0/1477968233 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fcd7c0a3ed0 0x7fcd7c0a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:35.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.349+0000 7fcd917fa700 1 -- 172.21.15.80:0/1477968233 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fcd840d07e0 con 0x7fcd9406b130 2024-04-26T18:36:35.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.349+0000 7fcd937fe700 1 --2- 172.21.15.80:0/1477968233 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fcd7c0a3ed0 0x7fcd7c0a6390 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcd94079940 tx=0x7fcd88009260 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:35.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.353+0000 7fcd917fa700 1 -- 172.21.15.80:0/1477968233 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcd8401f020 con 0x7fcd9406b130 2024-04-26T18:36:35.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.551+0000 7fcd9a2f9700 1 -- 172.21.15.80:0/1477968233 --> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcd94063860 con 0x7fcd7c0a3ed0 2024-04-26T18:36:35.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.559+0000 7fcd917fa700 1 -- 172.21.15.80:0/1477968233 <== mgr.24736 v2:172.21.15.80:6800/1522002759 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258057 (secure 0 0 0) 0x7fcd94063860 con 0x7fcd7c0a3ed0 2024-04-26T18:36:35.562 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:36:35.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.562+0000 7fcd9a2f9700 1 -- 172.21.15.80:0/1477968233 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fcd7c0a3ed0 msgr2=0x7fcd7c0a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:35.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.562+0000 7fcd9a2f9700 1 --2- 172.21.15.80:0/1477968233 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fcd7c0a3ed0 0x7fcd7c0a6390 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcd94079940 tx=0x7fcd88009260 comp rx=0 tx=0).stop 2024-04-26T18:36:35.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.562+0000 7fcd9a2f9700 1 -- 172.21.15.80:0/1477968233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd9406b130 msgr2=0x7fcd941a1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:35.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.562+0000 7fcd9a2f9700 1 --2- 172.21.15.80:0/1477968233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd9406b130 0x7fcd941a1910 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fcd8400d980 tx=0x7fcd8400dc90 comp rx=0 tx=0).stop 2024-04-26T18:36:35.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.562+0000 7fcd9a2f9700 1 -- 172.21.15.80:0/1477968233 shutdown_connections 2024-04-26T18:36:35.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.562+0000 7fcd9a2f9700 1 --2- 172.21.15.80:0/1477968233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd941094a0 0x7fcd9419bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:35.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.562+0000 7fcd9a2f9700 1 --2- 172.21.15.80:0/1477968233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd9406b130 0x7fcd941a1910 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:35.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.562+0000 7fcd9a2f9700 1 --2- 172.21.15.80:0/1477968233 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fcd7c0a3ed0 0x7fcd7c0a6390 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:35.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.562+0000 7fcd9a2f9700 1 --2- 172.21.15.80:0/1477968233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd9406bad0 0x7fcd941a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:35.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.562+0000 7fcd9a2f9700 1 -- 172.21.15.80:0/1477968233 >> 172.21.15.80:0/1477968233 conn(0x7fcd940792d0 msgr2=0x7fcd9410e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:35.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.562+0000 7fcd9a2f9700 1 -- 172.21.15.80:0/1477968233 shutdown_connections 2024-04-26T18:36:35.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:35.562+0000 7fcd9a2f9700 1 -- 172.21.15.80:0/1477968233 wait complete. 2024-04-26T18:36:35.565 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-26T18:36:35.914 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:35 smithi080 ceph-mon[29135]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:36:35.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:35 smithi082 ceph-mon[32808]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:36:36.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:35 smithi192 ceph-mon[32842]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:36:36.276 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2024-04-26T18:36:33.744471+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1191332,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":2126,"num_read_kb":1226,"num_write":563,"num_write_kb":4406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1181430,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":943,"ondisk_log_size":943,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370060,"kb_used_data":12556,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571764,"statfs":{"total":1151940427776,"available":1151561486336,"internally_reserved":0,"allocated":12857344,"data_stored":9658086,"data_compressed":223672,"data_compressed_allocated":290816,"data_compressed_original":3592192,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.988014"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.733075+0000","last_change":"2024-04-26T18:33:06.565673+0000","last_active":"2024-04-26T18:36:27.733075+0000","last_peered":"2024-04-26T18:36:27.733075+0000","last_clean":"2024-04-26T18:36:27.733075+0000","last_became_active":"2024-04-26T18:33:06.565065+0000","last_became_peered":"2024-04-26T18:33:06.565065+0000","last_unstale":"2024-04-26T18:36:27.733075+0000","last_undegraded":"2024-04-26T18:36:27.733075+0000","last_fullsized":"2024-04-26T18:36:27.733075+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:54:10.833343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.975622+0000","last_change":"2024-04-26T18:33:06.552350+0000","last_active":"2024-04-26T18:36:27.975622+0000","last_peered":"2024-04-26T18:36:27.975622+0000","last_clean":"2024-04-26T18:36:27.975622+0000","last_became_active":"2024-04-26T18:33:06.551941+0000","last_became_peered":"2024-04-26T18:33:06.551941+0000","last_unstale":"2024-04-26T18:36:27.975622+0000","last_undegraded":"2024-04-26T18:36:27.975622+0000","last_fullsized":"2024-04-26T18:36:27.975622+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:40.702995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.975532+0000","last_change":"2024-04-26T18:33:06.561456+0000","last_active":"2024-04-26T18:36:27.975532+0000","last_peered":"2024-04-26T18:36:27.975532+0000","last_clean":"2024-04-26T18:36:27.975532+0000","last_became_active":"2024-04-26T18:33:06.561032+0000","last_became_peered":"2024-04-26T18:33:06.561032+0000","last_unstale":"2024-04-26T18:36:27.975532+0000","last_undegraded":"2024-04-26T18:36:27.975532+0000","last_fullsized":"2024-04-26T18:36:27.975532+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:56:56.228873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.973428+0000","last_change":"2024-04-26T18:33:06.556597+0000","last_active":"2024-04-26T18:36:27.973428+0000","last_peered":"2024-04-26T18:36:27.973428+0000","last_clean":"2024-04-26T18:36:27.973428+0000","last_became_active":"2024-04-26T18:33:06.555356+0000","last_became_peered":"2024-04-26T18:33:06.555356+0000","last_unstale":"2024-04-26T18:36:27.973428+0000","last_undegraded":"2024-04-26T18:36:27.973428+0000","last_fullsized":"2024-04-26T18:36:27.973428+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:55.860495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821498+0000","last_change":"2024-04-26T18:33:06.549480+0000","last_active":"2024-04-26T18:36:27.821498+0000","last_peered":"2024-04-26T18:36:27.821498+0000","last_clean":"2024-04-26T18:36:27.821498+0000","last_became_active":"2024-04-26T18:33:06.549086+0000","last_became_peered":"2024-04-26T18:33:06.549086+0000","last_unstale":"2024-04-26T18:36:27.821498+0000","last_undegraded":"2024-04-26T18:36:27.821498+0000","last_fullsized":"2024-04-26T18:36:27.821498+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:13.012745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.730369+0000","last_change":"2024-04-26T18:33:06.558539+0000","last_active":"2024-04-26T18:36:27.730369+0000","last_peered":"2024-04-26T18:36:27.730369+0000","last_clean":"2024-04-26T18:36:27.730369+0000","last_became_active":"2024-04-26T18:33:06.558185+0000","last_became_peered":"2024-04-26T18:33:06.558185+0000","last_unstale":"2024-04-26T18:36:27.730369+0000","last_undegraded":"2024-04-26T18:36:27.730369+0000","last_fullsized":"2024-04-26T18:36:27.730369+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:59:31.299478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879561+0000","last_change":"2024-04-26T18:33:06.557336+0000","last_active":"2024-04-26T18:36:27.879561+0000","last_peered":"2024-04-26T18:36:27.879561+0000","last_clean":"2024-04-26T18:36:27.879561+0000","last_became_active":"2024-04-26T18:33:06.556988+0000","last_became_peered":"2024-04-26T18:33:06.556988+0000","last_unstale":"2024-04-26T18:36:27.879561+0000","last_undegraded":"2024-04-26T18:36:27.879561+0000","last_fullsized":"2024-04-26T18:36:27.879561+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:48.814042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821264+0000","last_change":"2024-04-26T18:33:06.556355+0000","last_active":"2024-04-26T18:36:27.821264+0000","last_peered":"2024-04-26T18:36:27.821264+0000","last_clean":"2024-04-26T18:36:27.821264+0000","last_became_active":"2024-04-26T18:33:06.555947+0000","last_became_peered":"2024-04-26T18:33:06.555947+0000","last_unstale":"2024-04-26T18:36:27.821264+0000","last_undegraded":"2024-04-26T18:36:27.821264+0000","last_fullsized":"2024-04-26T18:36:27.821264+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:36.607305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.973088+0000","last_change":"2024-04-26T18:33:06.569673+0000","last_active":"2024-04-26T18:36:27.973088+0000","last_peered":"2024-04-26T18:36:27.973088+0000","last_clean":"2024-04-26T18:36:27.973088+0000","last_became_active":"2024-04-26T18:33:06.568453+0000","last_became_peered":"2024-04-26T18:33:06.568453+0000","last_unstale":"2024-04-26T18:36:27.973088+0000","last_undegraded":"2024-04-26T18:36:27.973088+0000","last_fullsized":"2024-04-26T18:36:27.973088+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:38.428723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.730773+0000","last_change":"2024-04-26T18:33:06.564286+0000","last_active":"2024-04-26T18:36:27.730773+0000","last_peered":"2024-04-26T18:36:27.730773+0000","last_clean":"2024-04-26T18:36:27.730773+0000","last_became_active":"2024-04-26T18:33:06.563830+0000","last_became_peered":"2024-04-26T18:33:06.563830+0000","last_unstale":"2024-04-26T18:36:27.730773+0000","last_undegraded":"2024-04-26T18:36:27.730773+0000","last_fullsized":"2024-04-26T18:36:27.730773+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:36.518838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879754+0000","last_change":"2024-04-26T18:33:06.560724+0000","last_active":"2024-04-26T18:36:27.879754+0000","last_peered":"2024-04-26T18:36:27.879754+0000","last_clean":"2024-04-26T18:36:27.879754+0000","last_became_active":"2024-04-26T18:33:06.560393+0000","last_became_peered":"2024-04-26T18:33:06.560393+0000","last_unstale":"2024-04-26T18:36:27.879754+0000","last_undegraded":"2024-04-26T18:36:27.879754+0000","last_fullsized":"2024-04-26T18:36:27.879754+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:41.286466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.727850+0000","last_change":"2024-04-26T18:33:51.859986+0000","last_active":"2024-04-26T18:36:27.727850+0000","last_peered":"2024-04-26T18:36:27.727850+0000","last_clean":"2024-04-26T18:36:27.727850+0000","last_became_active":"2024-04-26T18:33:51.859656+0000","last_became_peered":"2024-04-26T18:33:51.859656+0000","last_unstale":"2024-04-26T18:36:27.727850+0000","last_undegraded":"2024-04-26T18:36:27.727850+0000","last_fullsized":"2024-04-26T18:36:27.727850+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:09:48.471097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972836+0000","last_change":"2024-04-26T18:33:06.555813+0000","last_active":"2024-04-26T18:36:27.972836+0000","last_peered":"2024-04-26T18:36:27.972836+0000","last_clean":"2024-04-26T18:36:27.972836+0000","last_became_active":"2024-04-26T18:33:06.555498+0000","last_became_peered":"2024-04-26T18:33:06.555498+0000","last_unstale":"2024-04-26T18:36:27.972836+0000","last_undegraded":"2024-04-26T18:36:27.972836+0000","last_fullsized":"2024-04-26T18:36:27.972836+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:21.531142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.975070+0000","last_change":"2024-04-26T18:33:06.551833+0000","last_active":"2024-04-26T18:36:27.975070+0000","last_peered":"2024-04-26T18:36:27.975070+0000","last_clean":"2024-04-26T18:36:27.975070+0000","last_became_active":"2024-04-26T18:33:06.551503+0000","last_became_peered":"2024-04-26T18:33:06.551503+0000","last_unstale":"2024-04-26T18:36:27.975070+0000","last_undegraded":"2024-04-26T18:36:27.975070+0000","last_fullsized":"2024-04-26T18:36:27.975070+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:20.560656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.975057+0000","last_change":"2024-04-26T18:33:06.555971+0000","last_active":"2024-04-26T18:36:27.975057+0000","last_peered":"2024-04-26T18:36:27.975057+0000","last_clean":"2024-04-26T18:36:27.975057+0000","last_became_active":"2024-04-26T18:33:06.555312+0000","last_became_peered":"2024-04-26T18:33:06.555312+0000","last_unstale":"2024-04-26T18:36:27.975057+0000","last_undegraded":"2024-04-26T18:36:27.975057+0000","last_fullsized":"2024-04-26T18:36:27.975057+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:05.066403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972532+0000","last_change":"2024-04-26T18:33:06.567762+0000","last_active":"2024-04-26T18:36:27.972532+0000","last_peered":"2024-04-26T18:36:27.972532+0000","last_clean":"2024-04-26T18:36:27.972532+0000","last_became_active":"2024-04-26T18:33:06.567368+0000","last_became_peered":"2024-04-26T18:33:06.567368+0000","last_unstale":"2024-04-26T18:36:27.972532+0000","last_undegraded":"2024-04-26T18:36:27.972532+0000","last_fullsized":"2024-04-26T18:36:27.972532+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:27.428529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.732899+0000","last_change":"2024-04-26T18:33:06.565334+0000","last_active":"2024-04-26T18:36:27.732899+0000","last_peered":"2024-04-26T18:36:27.732899+0000","last_clean":"2024-04-26T18:36:27.732899+0000","last_became_active":"2024-04-26T18:33:06.564997+0000","last_became_peered":"2024-04-26T18:33:06.564997+0000","last_unstale":"2024-04-26T18:36:27.732899+0000","last_undegraded":"2024-04-26T18:36:27.732899+0000","last_fullsized":"2024-04-26T18:36:27.732899+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:57.892318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.727970+0000","last_change":"2024-04-26T18:33:06.562242+0000","last_active":"2024-04-26T18:36:27.727970+0000","last_peered":"2024-04-26T18:36:27.727970+0000","last_clean":"2024-04-26T18:36:27.727970+0000","last_became_active":"2024-04-26T18:33:06.561863+0000","last_became_peered":"2024-04-26T18:33:06.561863+0000","last_unstale":"2024-04-26T18:36:27.727970+0000","last_undegraded":"2024-04-26T18:36:27.727970+0000","last_fullsized":"2024-04-26T18:36:27.727970+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:22.745294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.976550+0000","last_change":"2024-04-26T18:33:06.555511+0000","last_active":"2024-04-26T18:36:27.976550+0000","last_peered":"2024-04-26T18:36:27.976550+0000","last_clean":"2024-04-26T18:36:27.976550+0000","last_became_active":"2024-04-26T18:33:06.555201+0000","last_became_peered":"2024-04-26T18:33:06.555201+0000","last_unstale":"2024-04-26T18:36:27.976550+0000","last_undegraded":"2024-04-26T18:36:27.976550+0000","last_fullsized":"2024-04-26T18:36:27.976550+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:09.644167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'14","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.728073+0000","last_change":"2024-04-26T18:33:51.664154+0000","last_active":"2024-04-26T18:36:27.728073+0000","last_peered":"2024-04-26T18:36:27.728073+0000","last_clean":"2024-04-26T18:36:27.728073+0000","last_became_active":"2024-04-26T18:33:51.653330+0000","last_became_peered":"2024-04-26T18:33:51.653330+0000","last_unstale":"2024-04-26T18:36:27.728073+0000","last_undegraded":"2024-04-26T18:36:27.728073+0000","last_fullsized":"2024-04-26T18:36:27.728073+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:55:49.100993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.822051+0000","last_change":"2024-04-26T18:33:06.560652+0000","last_active":"2024-04-26T18:36:27.822051+0000","last_peered":"2024-04-26T18:36:27.822051+0000","last_clean":"2024-04-26T18:36:27.822051+0000","last_became_active":"2024-04-26T18:33:06.560311+0000","last_became_peered":"2024-04-26T18:33:06.560311+0000","last_unstale":"2024-04-26T18:36:27.822051+0000","last_undegraded":"2024-04-26T18:36:27.822051+0000","last_fullsized":"2024-04-26T18:36:27.822051+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:22.653995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.822203+0000","last_change":"2024-04-26T18:33:03.860585+0000","last_active":"2024-04-26T18:36:27.822203+0000","last_peered":"2024-04-26T18:36:27.822203+0000","last_clean":"2024-04-26T18:36:27.822203+0000","last_became_active":"2024-04-26T18:33:03.860232+0000","last_became_peered":"2024-04-26T18:33:03.860232+0000","last_unstale":"2024-04-26T18:36:27.822203+0000","last_undegraded":"2024-04-26T18:36:27.822203+0000","last_fullsized":"2024-04-26T18:36:27.822203+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:04.685495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.975810+0000","last_change":"2024-04-26T18:33:06.563764+0000","last_active":"2024-04-26T18:36:27.975810+0000","last_peered":"2024-04-26T18:36:27.975810+0000","last_clean":"2024-04-26T18:36:27.975810+0000","last_became_active":"2024-04-26T18:33:06.563322+0000","last_became_peered":"2024-04-26T18:33:06.563322+0000","last_unstale":"2024-04-26T18:36:27.975810+0000","last_undegraded":"2024-04-26T18:36:27.975810+0000","last_fullsized":"2024-04-26T18:36:27.975810+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:17:53.144144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"91'13","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821711+0000","last_change":"2024-04-26T18:33:03.533057+0000","last_active":"2024-04-26T18:36:27.821711+0000","last_peered":"2024-04-26T18:36:27.821711+0000","last_clean":"2024-04-26T18:36:27.821711+0000","last_became_active":"2024-04-26T18:33:03.532665+0000","last_became_peered":"2024-04-26T18:33:03.532665+0000","last_unstale":"2024-04-26T18:36:27.821711+0000","last_undegraded":"2024-04-26T18:36:27.821711+0000","last_fullsized":"2024-04-26T18:36:27.821711+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:29.125064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972615+0000","last_change":"2024-04-26T18:33:06.567612+0000","last_active":"2024-04-26T18:36:27.972615+0000","last_peered":"2024-04-26T18:36:27.972615+0000","last_clean":"2024-04-26T18:36:27.972615+0000","last_became_active":"2024-04-26T18:33:06.565883+0000","last_became_peered":"2024-04-26T18:33:06.565883+0000","last_unstale":"2024-04-26T18:36:27.972615+0000","last_undegraded":"2024-04-26T18:36:27.972615+0000","last_fullsized":"2024-04-26T18:36:27.972615+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:59.721305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821757+0000","last_change":"2024-04-26T18:33:03.532075+0000","last_active":"2024-04-26T18:36:27.821757+0000","last_peered":"2024-04-26T18:36:27.821757+0000","last_clean":"2024-04-26T18:36:27.821757+0000","last_became_active":"2024-04-26T18:33:03.531729+0000","last_became_peered":"2024-04-26T18:33:03.531729+0000","last_unstale":"2024-04-26T18:36:27.821757+0000","last_undegraded":"2024-04-26T18:36:27.821757+0000","last_fullsized":"2024-04-26T18:36:27.821757+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:23.748292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.828278+0000","last_change":"2024-04-26T18:33:06.569377+0000","last_active":"2024-04-26T18:36:27.828278+0000","last_peered":"2024-04-26T18:36:27.828278+0000","last_clean":"2024-04-26T18:36:27.828278+0000","last_became_active":"2024-04-26T18:33:06.569057+0000","last_became_peered":"2024-04-26T18:33:06.569057+0000","last_unstale":"2024-04-26T18:36:27.828278+0000","last_undegraded":"2024-04-26T18:36:27.828278+0000","last_fullsized":"2024-04-26T18:36:27.828278+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:10.968017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"92'8","reported_seq":226,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:28.164114+0000","last_change":"2024-04-26T18:33:03.525186+0000","last_active":"2024-04-26T18:36:28.164114+0000","last_peered":"2024-04-26T18:36:28.164114+0000","last_clean":"2024-04-26T18:36:28.164114+0000","last_became_active":"2024-04-26T18:33:03.524880+0000","last_became_peered":"2024-04-26T18:33:03.524880+0000","last_unstale":"2024-04-26T18:36:28.164114+0000","last_undegraded":"2024-04-26T18:36:28.164114+0000","last_fullsized":"2024-04-26T18:36:28.164114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:51:30.130244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":190,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821361+0000","last_change":"2024-04-26T18:33:06.558034+0000","last_active":"2024-04-26T18:36:27.821361+0000","last_peered":"2024-04-26T18:36:27.821361+0000","last_clean":"2024-04-26T18:36:27.821361+0000","last_became_active":"2024-04-26T18:33:06.557694+0000","last_became_peered":"2024-04-26T18:33:06.557694+0000","last_unstale":"2024-04-26T18:36:27.821361+0000","last_undegraded":"2024-04-26T18:36:27.821361+0000","last_fullsized":"2024-04-26T18:36:27.821361+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:02.497601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.730278+0000","last_change":"2024-04-26T18:33:03.528750+0000","last_active":"2024-04-26T18:36:27.730278+0000","last_peered":"2024-04-26T18:36:27.730278+0000","last_clean":"2024-04-26T18:36:27.730278+0000","last_became_active":"2024-04-26T18:33:03.528442+0000","last_became_peered":"2024-04-26T18:33:03.528442+0000","last_unstale":"2024-04-26T18:36:27.730278+0000","last_undegraded":"2024-04-26T18:36:27.730278+0000","last_fullsized":"2024-04-26T18:36:27.730278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:13.931280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.828278+0000","last_change":"2024-04-26T18:33:06.561274+0000","last_active":"2024-04-26T18:36:27.828278+0000","last_peered":"2024-04-26T18:36:27.828278+0000","last_clean":"2024-04-26T18:36:27.828278+0000","last_became_active":"2024-04-26T18:33:06.560622+0000","last_became_peered":"2024-04-26T18:33:06.560622+0000","last_unstale":"2024-04-26T18:36:27.828278+0000","last_undegraded":"2024-04-26T18:36:27.828278+0000","last_fullsized":"2024-04-26T18:36:27.828278+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:27.875181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972610+0000","last_change":"2024-04-26T18:33:03.529634+0000","last_active":"2024-04-26T18:36:27.972610+0000","last_peered":"2024-04-26T18:36:27.972610+0000","last_clean":"2024-04-26T18:36:27.972610+0000","last_became_active":"2024-04-26T18:33:03.529303+0000","last_became_peered":"2024-04-26T18:33:03.529303+0000","last_unstale":"2024-04-26T18:36:27.972610+0000","last_undegraded":"2024-04-26T18:36:27.972610+0000","last_fullsized":"2024-04-26T18:36:27.972610+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:37.580542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821227+0000","last_change":"2024-04-26T18:33:06.550896+0000","last_active":"2024-04-26T18:36:27.821227+0000","last_peered":"2024-04-26T18:36:27.821227+0000","last_clean":"2024-04-26T18:36:27.821227+0000","last_became_active":"2024-04-26T18:33:06.550571+0000","last_became_peered":"2024-04-26T18:33:06.550571+0000","last_unstale":"2024-04-26T18:36:27.821227+0000","last_undegraded":"2024-04-26T18:36:27.821227+0000","last_fullsized":"2024-04-26T18:36:27.821227+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:26.715158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.828072+0000","last_change":"2024-04-26T18:33:03.530875+0000","last_active":"2024-04-26T18:36:27.828072+0000","last_peered":"2024-04-26T18:36:27.828072+0000","last_clean":"2024-04-26T18:36:27.828072+0000","last_became_active":"2024-04-26T18:33:03.530564+0000","last_became_peered":"2024-04-26T18:33:03.530564+0000","last_unstale":"2024-04-26T18:36:27.828072+0000","last_undegraded":"2024-04-26T18:36:27.828072+0000","last_fullsized":"2024-04-26T18:36:27.828072+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:20.320591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.727649+0000","last_change":"2024-04-26T18:33:06.553434+0000","last_active":"2024-04-26T18:36:27.727649+0000","last_peered":"2024-04-26T18:36:27.727649+0000","last_clean":"2024-04-26T18:36:27.727649+0000","last_became_active":"2024-04-26T18:33:06.551897+0000","last_became_peered":"2024-04-26T18:33:06.551897+0000","last_unstale":"2024-04-26T18:36:27.727649+0000","last_undegraded":"2024-04-26T18:36:27.727649+0000","last_fullsized":"2024-04-26T18:36:27.727649+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:56.503266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"92'6","reported_seq":404,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:28.163620+0000","last_change":"2024-04-26T18:33:03.524239+0000","last_active":"2024-04-26T18:36:28.163620+0000","last_peered":"2024-04-26T18:36:28.163620+0000","last_clean":"2024-04-26T18:36:28.163620+0000","last_became_active":"2024-04-26T18:33:03.523848+0000","last_became_peered":"2024-04-26T18:33:03.523848+0000","last_unstale":"2024-04-26T18:36:28.163620+0000","last_undegraded":"2024-04-26T18:36:28.163620+0000","last_fullsized":"2024-04-26T18:36:28.163620+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:29.354430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":370,"num_read_kb":370,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972992+0000","last_change":"2024-04-26T18:33:06.569557+0000","last_active":"2024-04-26T18:36:27.972992+0000","last_peered":"2024-04-26T18:36:27.972992+0000","last_clean":"2024-04-26T18:36:27.972992+0000","last_became_active":"2024-04-26T18:33:06.568414+0000","last_became_peered":"2024-04-26T18:33:06.568414+0000","last_unstale":"2024-04-26T18:36:27.972992+0000","last_undegraded":"2024-04-26T18:36:27.972992+0000","last_fullsized":"2024-04-26T18:36:27.972992+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:30.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879761+0000","last_change":"2024-04-26T18:33:03.528554+0000","last_active":"2024-04-26T18:36:27.879761+0000","last_peered":"2024-04-26T18:36:27.879761+0000","last_clean":"2024-04-26T18:36:27.879761+0000","last_became_active":"2024-04-26T18:33:03.527611+0000","last_became_peered":"2024-04-26T18:33:03.527611+0000","last_unstale":"2024-04-26T18:36:27.879761+0000","last_undegraded":"2024-04-26T18:36:27.879761+0000","last_fullsized":"2024-04-26T18:36:27.879761+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:28.387779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.975762+0000","last_change":"2024-04-26T18:33:06.561415+0000","last_active":"2024-04-26T18:36:27.975762+0000","last_peered":"2024-04-26T18:36:27.975762+0000","last_clean":"2024-04-26T18:36:27.975762+0000","last_became_active":"2024-04-26T18:33:06.560518+0000","last_became_peered":"2024-04-26T18:33:06.560518+0000","last_unstale":"2024-04-26T18:36:27.975762+0000","last_undegraded":"2024-04-26T18:36:27.975762+0000","last_fullsized":"2024-04-26T18:36:27.975762+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:49.824157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.828368+0000","last_change":"2024-04-26T18:33:03.861087+0000","last_active":"2024-04-26T18:36:27.828368+0000","last_peered":"2024-04-26T18:36:27.828368+0000","last_clean":"2024-04-26T18:36:27.828368+0000","last_became_active":"2024-04-26T18:33:03.860531+0000","last_became_peered":"2024-04-26T18:33:03.860531+0000","last_unstale":"2024-04-26T18:36:27.828368+0000","last_undegraded":"2024-04-26T18:36:27.828368+0000","last_fullsized":"2024-04-26T18:36:27.828368+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:22:07.086887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972830+0000","last_change":"2024-04-26T18:33:06.565910+0000","last_active":"2024-04-26T18:36:27.972830+0000","last_peered":"2024-04-26T18:36:27.972830+0000","last_clean":"2024-04-26T18:36:27.972830+0000","last_became_active":"2024-04-26T18:33:06.565402+0000","last_became_peered":"2024-04-26T18:33:06.565402+0000","last_unstale":"2024-04-26T18:36:27.972830+0000","last_undegraded":"2024-04-26T18:36:27.972830+0000","last_fullsized":"2024-04-26T18:36:27.972830+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:40.418513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"92'39","reported_seq":450,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:28.164065+0000","last_change":"2024-04-26T18:33:03.527871+0000","last_active":"2024-04-26T18:36:28.164065+0000","last_peered":"2024-04-26T18:36:28.164065+0000","last_clean":"2024-04-26T18:36:28.164065+0000","last_became_active":"2024-04-26T18:33:03.527546+0000","last_became_peered":"2024-04-26T18:33:03.527546+0000","last_unstale":"2024-04-26T18:36:28.164065+0000","last_undegraded":"2024-04-26T18:36:28.164065+0000","last_fullsized":"2024-04-26T18:36:28.164065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:24.749505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67479,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":383,"num_read_kb":257,"num_write":41,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821511+0000","last_change":"2024-04-26T18:33:06.546735+0000","last_active":"2024-04-26T18:36:27.821511+0000","last_peered":"2024-04-26T18:36:27.821511+0000","last_clean":"2024-04-26T18:36:27.821511+0000","last_became_active":"2024-04-26T18:33:06.546360+0000","last_became_peered":"2024-04-26T18:33:06.546360+0000","last_unstale":"2024-04-26T18:36:27.821511+0000","last_undegraded":"2024-04-26T18:36:27.821511+0000","last_fullsized":"2024-04-26T18:36:27.821511+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:15.736669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.976284+0000","last_change":"2024-04-26T18:33:03.526081+0000","last_active":"2024-04-26T18:36:27.976284+0000","last_peered":"2024-04-26T18:36:27.976284+0000","last_clean":"2024-04-26T18:36:27.976284+0000","last_became_active":"2024-04-26T18:33:03.525717+0000","last_became_peered":"2024-04-26T18:33:03.525717+0000","last_unstale":"2024-04-26T18:36:27.976284+0000","last_undegraded":"2024-04-26T18:36:27.976284+0000","last_fullsized":"2024-04-26T18:36:27.976284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:15.137654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972542+0000","last_change":"2024-04-26T18:33:06.552689+0000","last_active":"2024-04-26T18:36:27.972542+0000","last_peered":"2024-04-26T18:36:27.972542+0000","last_clean":"2024-04-26T18:36:27.972542+0000","last_became_active":"2024-04-26T18:33:06.552404+0000","last_became_peered":"2024-04-26T18:33:06.552404+0000","last_unstale":"2024-04-26T18:36:27.972542+0000","last_undegraded":"2024-04-26T18:36:27.972542+0000","last_fullsized":"2024-04-26T18:36:27.972542+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:58:32.681037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.828120+0000","last_change":"2024-04-26T18:33:03.526092+0000","last_active":"2024-04-26T18:36:27.828120+0000","last_peered":"2024-04-26T18:36:27.828120+0000","last_clean":"2024-04-26T18:36:27.828120+0000","last_became_active":"2024-04-26T18:33:03.525782+0000","last_became_peered":"2024-04-26T18:33:03.525782+0000","last_unstale":"2024-04-26T18:36:27.828120+0000","last_undegraded":"2024-04-26T18:36:27.828120+0000","last_fullsized":"2024-04-26T18:36:27.828120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:56.564484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879762+0000","last_change":"2024-04-26T18:33:51.952244+0000","last_active":"2024-04-26T18:36:27.879762+0000","last_peered":"2024-04-26T18:36:27.879762+0000","last_clean":"2024-04-26T18:36:27.879762+0000","last_became_active":"2024-04-26T18:33:51.951795+0000","last_became_peered":"2024-04-26T18:33:51.951795+0000","last_unstale":"2024-04-26T18:36:27.879762+0000","last_undegraded":"2024-04-26T18:36:27.879762+0000","last_fullsized":"2024-04-26T18:36:27.879762+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:39.268117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"92'6","reported_seq":222,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:28.163670+0000","last_change":"2024-04-26T18:33:03.531232+0000","last_active":"2024-04-26T18:36:28.163670+0000","last_peered":"2024-04-26T18:36:28.163670+0000","last_clean":"2024-04-26T18:36:28.163670+0000","last_became_active":"2024-04-26T18:33:03.530861+0000","last_became_peered":"2024-04-26T18:33:03.530861+0000","last_unstale":"2024-04-26T18:36:28.163670+0000","last_undegraded":"2024-04-26T18:36:28.163670+0000","last_fullsized":"2024-04-26T18:36:28.163670+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:07:44.576659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":189,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879514+0000","last_change":"2024-04-26T18:33:06.559471+0000","last_active":"2024-04-26T18:36:27.879514+0000","last_peered":"2024-04-26T18:36:27.879514+0000","last_clean":"2024-04-26T18:36:27.879514+0000","last_became_active":"2024-04-26T18:33:06.559156+0000","last_became_peered":"2024-04-26T18:33:06.559156+0000","last_unstale":"2024-04-26T18:36:27.879514+0000","last_undegraded":"2024-04-26T18:36:27.879514+0000","last_fullsized":"2024-04-26T18:36:27.879514+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:37.624415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821319+0000","last_change":"2024-04-26T18:33:03.860900+0000","last_active":"2024-04-26T18:36:27.821319+0000","last_peered":"2024-04-26T18:36:27.821319+0000","last_clean":"2024-04-26T18:36:27.821319+0000","last_became_active":"2024-04-26T18:33:03.860601+0000","last_became_peered":"2024-04-26T18:33:03.860601+0000","last_unstale":"2024-04-26T18:36:27.821319+0000","last_undegraded":"2024-04-26T18:36:27.821319+0000","last_fullsized":"2024-04-26T18:36:27.821319+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:56.527624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.727809+0000","last_change":"2024-04-26T18:33:51.861484+0000","last_active":"2024-04-26T18:36:27.727809+0000","last_peered":"2024-04-26T18:36:27.727809+0000","last_clean":"2024-04-26T18:36:27.727809+0000","last_became_active":"2024-04-26T18:33:51.861066+0000","last_became_peered":"2024-04-26T18:33:51.861066+0000","last_unstale":"2024-04-26T18:36:27.727809+0000","last_undegraded":"2024-04-26T18:36:27.727809+0000","last_fullsized":"2024-04-26T18:36:27.727809+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:48.477037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.732769+0000","last_change":"2024-04-26T18:33:51.667455+0000","last_active":"2024-04-26T18:36:27.732769+0000","last_peered":"2024-04-26T18:36:27.732769+0000","last_clean":"2024-04-26T18:36:27.732769+0000","last_became_active":"2024-04-26T18:33:51.653472+0000","last_became_peered":"2024-04-26T18:33:51.653472+0000","last_unstale":"2024-04-26T18:36:27.732769+0000","last_undegraded":"2024-04-26T18:36:27.732769+0000","last_fullsized":"2024-04-26T18:36:27.732769+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:19.828738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.732940+0000","last_change":"2024-04-26T18:33:06.557597+0000","last_active":"2024-04-26T18:36:27.732940+0000","last_peered":"2024-04-26T18:36:27.732940+0000","last_clean":"2024-04-26T18:36:27.732940+0000","last_became_active":"2024-04-26T18:33:06.557249+0000","last_became_peered":"2024-04-26T18:33:06.557249+0000","last_unstale":"2024-04-26T18:36:27.732940+0000","last_undegraded":"2024-04-26T18:36:27.732940+0000","last_fullsized":"2024-04-26T18:36:27.732940+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:22.258691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.727925+0000","last_change":"2024-04-26T18:33:03.861082+0000","last_active":"2024-04-26T18:36:27.727925+0000","last_peered":"2024-04-26T18:36:27.727925+0000","last_clean":"2024-04-26T18:36:27.727925+0000","last_became_active":"2024-04-26T18:33:03.860661+0000","last_became_peered":"2024-04-26T18:33:03.860661+0000","last_unstale":"2024-04-26T18:36:27.727925+0000","last_undegraded":"2024-04-26T18:36:27.727925+0000","last_fullsized":"2024-04-26T18:36:27.727925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:46.653421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.730335+0000","last_change":"2024-04-26T18:33:06.558268+0000","last_active":"2024-04-26T18:36:27.730335+0000","last_peered":"2024-04-26T18:36:27.730335+0000","last_clean":"2024-04-26T18:36:27.730335+0000","last_became_active":"2024-04-26T18:33:06.557899+0000","last_became_peered":"2024-04-26T18:33:06.557899+0000","last_unstale":"2024-04-26T18:36:27.730335+0000","last_undegraded":"2024-04-26T18:36:27.730335+0000","last_fullsized":"2024-04-26T18:36:27.730335+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:03:47.016288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"92'7","reported_seq":221,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.880058+0000","last_change":"2024-04-26T18:33:03.528398+0000","last_active":"2024-04-26T18:36:27.880058+0000","last_peered":"2024-04-26T18:36:27.880058+0000","last_clean":"2024-04-26T18:36:27.880058+0000","last_became_active":"2024-04-26T18:33:03.528008+0000","last_became_peered":"2024-04-26T18:33:03.528008+0000","last_unstale":"2024-04-26T18:36:27.880058+0000","last_undegraded":"2024-04-26T18:36:27.880058+0000","last_fullsized":"2024-04-26T18:36:27.880058+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:27.027873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1287,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.730411+0000","last_change":"2024-04-26T18:33:06.556035+0000","last_active":"2024-04-26T18:36:27.730411+0000","last_peered":"2024-04-26T18:36:27.730411+0000","last_clean":"2024-04-26T18:36:27.730411+0000","last_became_active":"2024-04-26T18:33:06.555703+0000","last_became_peered":"2024-04-26T18:33:06.555703+0000","last_unstale":"2024-04-26T18:36:27.730411+0000","last_undegraded":"2024-04-26T18:36:27.730411+0000","last_fullsized":"2024-04-26T18:36:27.730411+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:30:02.064205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.828317+0000","last_change":"2024-04-26T18:33:06.556447+0000","last_active":"2024-04-26T18:36:27.828317+0000","last_peered":"2024-04-26T18:36:27.828317+0000","last_clean":"2024-04-26T18:36:27.828317+0000","last_became_active":"2024-04-26T18:33:06.556124+0000","last_became_peered":"2024-04-26T18:33:06.556124+0000","last_unstale":"2024-04-26T18:36:27.828317+0000","last_undegraded":"2024-04-26T18:36:27.828317+0000","last_fullsized":"2024-04-26T18:36:27.828317+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:43:07.915584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"92'6","reported_seq":226,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:32.168593+0000","last_change":"2024-04-26T18:33:03.860440+0000","last_active":"2024-04-26T18:36:32.168593+0000","last_peered":"2024-04-26T18:36:32.168593+0000","last_clean":"2024-04-26T18:36:32.168593+0000","last_became_active":"2024-04-26T18:33:03.860112+0000","last_became_peered":"2024-04-26T18:33:03.860112+0000","last_unstale":"2024-04-26T18:36:32.168593+0000","last_undegraded":"2024-04-26T18:36:32.168593+0000","last_fullsized":"2024-04-26T18:36:32.168593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:19:05.661597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":191,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821540+0000","last_change":"2024-04-26T18:33:06.561688+0000","last_active":"2024-04-26T18:36:27.821540+0000","last_peered":"2024-04-26T18:36:27.821540+0000","last_clean":"2024-04-26T18:36:27.821540+0000","last_became_active":"2024-04-26T18:33:06.561285+0000","last_became_peered":"2024-04-26T18:33:06.561285+0000","last_unstale":"2024-04-26T18:36:27.821540+0000","last_undegraded":"2024-04-26T18:36:27.821540+0000","last_fullsized":"2024-04-26T18:36:27.821540+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:13.272896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.973292+0000","last_change":"2024-04-26T18:33:03.531237+0000","last_active":"2024-04-26T18:36:27.973292+0000","last_peered":"2024-04-26T18:36:27.973292+0000","last_clean":"2024-04-26T18:36:27.973292+0000","last_became_active":"2024-04-26T18:33:03.530843+0000","last_became_peered":"2024-04-26T18:33:03.530843+0000","last_unstale":"2024-04-26T18:36:27.973292+0000","last_undegraded":"2024-04-26T18:36:27.973292+0000","last_fullsized":"2024-04-26T18:36:27.973292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:24.454752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":362,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879655+0000","last_change":"2024-04-26T18:31:39.402840+0000","last_active":"2024-04-26T18:36:27.879655+0000","last_peered":"2024-04-26T18:36:27.879655+0000","last_clean":"2024-04-26T18:36:27.879655+0000","last_became_active":"2024-04-26T18:31:39.402341+0000","last_became_peered":"2024-04-26T18:31:39.402341+0000","last_unstale":"2024-04-26T18:36:27.879655+0000","last_undegraded":"2024-04-26T18:36:27.879655+0000","last_fullsized":"2024-04-26T18:36:27.879655+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:28:14.522548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:28:14.522548+0000","last_clean_scrub_stamp":"2024-04-26T18:28:14.522548+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:32.052085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972457+0000","last_change":"2024-04-26T18:33:06.557695+0000","last_active":"2024-04-26T18:36:27.972457+0000","last_peered":"2024-04-26T18:36:27.972457+0000","last_clean":"2024-04-26T18:36:27.972457+0000","last_became_active":"2024-04-26T18:33:06.557369+0000","last_became_peered":"2024-04-26T18:33:06.557369+0000","last_unstale":"2024-04-26T18:36:27.972457+0000","last_undegraded":"2024-04-26T18:36:27.972457+0000","last_fullsized":"2024-04-26T18:36:27.972457+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:35.666232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879757+0000","last_change":"2024-04-26T18:33:03.527897+0000","last_active":"2024-04-26T18:36:27.879757+0000","last_peered":"2024-04-26T18:36:27.879757+0000","last_clean":"2024-04-26T18:36:27.879757+0000","last_became_active":"2024-04-26T18:33:03.527345+0000","last_became_peered":"2024-04-26T18:33:03.527345+0000","last_unstale":"2024-04-26T18:36:27.879757+0000","last_undegraded":"2024-04-26T18:36:27.879757+0000","last_fullsized":"2024-04-26T18:36:27.879757+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:31.144555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821580+0000","last_change":"2024-04-26T18:33:03.860572+0000","last_active":"2024-04-26T18:36:27.821580+0000","last_peered":"2024-04-26T18:36:27.821580+0000","last_clean":"2024-04-26T18:36:27.821580+0000","last_became_active":"2024-04-26T18:33:03.860188+0000","last_became_peered":"2024-04-26T18:33:03.860188+0000","last_unstale":"2024-04-26T18:36:27.821580+0000","last_undegraded":"2024-04-26T18:36:27.821580+0000","last_fullsized":"2024-04-26T18:36:27.821580+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:24:34.811572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972827+0000","last_change":"2024-04-26T18:33:06.558075+0000","last_active":"2024-04-26T18:36:27.972827+0000","last_peered":"2024-04-26T18:36:27.972827+0000","last_clean":"2024-04-26T18:36:27.972827+0000","last_became_active":"2024-04-26T18:33:06.557293+0000","last_became_peered":"2024-04-26T18:33:06.557293+0000","last_unstale":"2024-04-26T18:36:27.972827+0000","last_undegraded":"2024-04-26T18:36:27.972827+0000","last_fullsized":"2024-04-26T18:36:27.972827+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:12.635253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"92'53","reported_seq":104,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.936921+0000","last_change":"2024-04-26T18:33:03.528196+0000","last_active":"2024-04-26T18:36:27.936921+0000","last_peered":"2024-04-26T18:36:27.936921+0000","last_clean":"2024-04-26T18:36:27.936921+0000","last_became_active":"2024-04-26T18:33:03.527846+0000","last_became_peered":"2024-04-26T18:33:03.527846+0000","last_unstale":"2024-04-26T18:36:27.936921+0000","last_undegraded":"2024-04-26T18:36:27.936921+0000","last_fullsized":"2024-04-26T18:36:27.936921+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:13:46.073405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":94,"num_write_kb":839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.822230+0000","last_change":"2024-04-26T18:33:06.550260+0000","last_active":"2024-04-26T18:36:27.822230+0000","last_peered":"2024-04-26T18:36:27.822230+0000","last_clean":"2024-04-26T18:36:27.822230+0000","last_became_active":"2024-04-26T18:33:06.549925+0000","last_became_peered":"2024-04-26T18:33:06.549925+0000","last_unstale":"2024-04-26T18:36:27.822230+0000","last_undegraded":"2024-04-26T18:36:27.822230+0000","last_fullsized":"2024-04-26T18:36:27.822230+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:17:01.777381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.973782+0000","last_change":"2024-04-26T18:33:03.876609+0000","last_active":"2024-04-26T18:36:27.973782+0000","last_peered":"2024-04-26T18:36:27.973782+0000","last_clean":"2024-04-26T18:36:27.973782+0000","last_became_active":"2024-04-26T18:33:03.876284+0000","last_became_peered":"2024-04-26T18:33:03.876284+0000","last_unstale":"2024-04-26T18:36:27.973782+0000","last_undegraded":"2024-04-26T18:36:27.973782+0000","last_fullsized":"2024-04-26T18:36:27.973782+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:22.995000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.975703+0000","last_change":"2024-04-26T18:33:06.558735+0000","last_active":"2024-04-26T18:36:27.975703+0000","last_peered":"2024-04-26T18:36:27.975703+0000","last_clean":"2024-04-26T18:36:27.975703+0000","last_became_active":"2024-04-26T18:33:06.558416+0000","last_became_peered":"2024-04-26T18:33:06.558416+0000","last_unstale":"2024-04-26T18:36:27.975703+0000","last_undegraded":"2024-04-26T18:36:27.975703+0000","last_fullsized":"2024-04-26T18:36:27.975703+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:27.627055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972536+0000","last_change":"2024-04-26T18:33:03.861073+0000","last_active":"2024-04-26T18:36:27.972536+0000","last_peered":"2024-04-26T18:36:27.972536+0000","last_clean":"2024-04-26T18:36:27.972536+0000","last_became_active":"2024-04-26T18:33:03.860661+0000","last_became_peered":"2024-04-26T18:33:03.860661+0000","last_unstale":"2024-04-26T18:36:27.972536+0000","last_undegraded":"2024-04-26T18:36:27.972536+0000","last_fullsized":"2024-04-26T18:36:27.972536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:19.429969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821326+0000","last_change":"2024-04-26T18:33:06.553160+0000","last_active":"2024-04-26T18:36:27.821326+0000","last_peered":"2024-04-26T18:36:27.821326+0000","last_clean":"2024-04-26T18:36:27.821326+0000","last_became_active":"2024-04-26T18:33:06.552791+0000","last_became_peered":"2024-04-26T18:33:06.552791+0000","last_unstale":"2024-04-26T18:36:27.821326+0000","last_undegraded":"2024-04-26T18:36:27.821326+0000","last_fullsized":"2024-04-26T18:36:27.821326+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:31.675069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821250+0000","last_change":"2024-04-26T18:33:03.524443+0000","last_active":"2024-04-26T18:36:27.821250+0000","last_peered":"2024-04-26T18:36:27.821250+0000","last_clean":"2024-04-26T18:36:27.821250+0000","last_became_active":"2024-04-26T18:33:03.524137+0000","last_became_peered":"2024-04-26T18:33:03.524137+0000","last_unstale":"2024-04-26T18:36:27.821250+0000","last_undegraded":"2024-04-26T18:36:27.821250+0000","last_fullsized":"2024-04-26T18:36:27.821250+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:43.021778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.732498+0000","last_change":"2024-04-26T18:33:06.553698+0000","last_active":"2024-04-26T18:36:27.732498+0000","last_peered":"2024-04-26T18:36:27.732498+0000","last_clean":"2024-04-26T18:36:27.732498+0000","last_became_active":"2024-04-26T18:33:06.552995+0000","last_became_peered":"2024-04-26T18:33:06.552995+0000","last_unstale":"2024-04-26T18:36:27.732498+0000","last_undegraded":"2024-04-26T18:36:27.732498+0000","last_fullsized":"2024-04-26T18:36:27.732498+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:27.135435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"92'4","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.732832+0000","last_change":"2024-04-26T18:33:51.656557+0000","last_active":"2024-04-26T18:36:27.732832+0000","last_peered":"2024-04-26T18:36:27.732832+0000","last_clean":"2024-04-26T18:36:27.732832+0000","last_became_active":"2024-04-26T18:33:51.652009+0000","last_became_peered":"2024-04-26T18:33:51.652009+0000","last_unstale":"2024-04-26T18:36:27.732832+0000","last_undegraded":"2024-04-26T18:36:27.732832+0000","last_fullsized":"2024-04-26T18:36:27.732832+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:05.047482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821858+0000","last_change":"2024-04-26T18:33:06.553596+0000","last_active":"2024-04-26T18:36:27.821858+0000","last_peered":"2024-04-26T18:36:27.821858+0000","last_clean":"2024-04-26T18:36:27.821858+0000","last_became_active":"2024-04-26T18:33:06.553284+0000","last_became_peered":"2024-04-26T18:33:06.553284+0000","last_unstale":"2024-04-26T18:36:27.821858+0000","last_undegraded":"2024-04-26T18:36:27.821858+0000","last_fullsized":"2024-04-26T18:36:27.821858+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.245437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821437+0000","last_change":"2024-04-26T18:33:51.865849+0000","last_active":"2024-04-26T18:36:27.821437+0000","last_peered":"2024-04-26T18:36:27.821437+0000","last_clean":"2024-04-26T18:36:27.821437+0000","last_became_active":"2024-04-26T18:33:51.861408+0000","last_became_peered":"2024-04-26T18:33:51.861408+0000","last_unstale":"2024-04-26T18:36:27.821437+0000","last_undegraded":"2024-04-26T18:36:27.821437+0000","last_fullsized":"2024-04-26T18:36:27.821437+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:12.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879862+0000","last_change":"2024-04-26T18:33:06.566899+0000","last_active":"2024-04-26T18:36:27.879862+0000","last_peered":"2024-04-26T18:36:27.879862+0000","last_clean":"2024-04-26T18:36:27.879862+0000","last_became_active":"2024-04-26T18:33:06.566548+0000","last_became_peered":"2024-04-26T18:33:06.566548+0000","last_unstale":"2024-04-26T18:36:27.879862+0000","last_undegraded":"2024-04-26T18:36:27.879862+0000","last_fullsized":"2024-04-26T18:36:27.879862+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:07.751063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'5","reported_seq":225,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:32.205619+0000","last_change":"2024-04-26T18:33:03.876589+0000","last_active":"2024-04-26T18:36:32.205619+0000","last_peered":"2024-04-26T18:36:32.205619+0000","last_clean":"2024-04-26T18:36:32.205619+0000","last_became_active":"2024-04-26T18:33:03.876262+0000","last_became_peered":"2024-04-26T18:33:03.876262+0000","last_unstale":"2024-04-26T18:36:32.205619+0000","last_undegraded":"2024-04-26T18:36:32.205619+0000","last_fullsized":"2024-04-26T18:36:32.205619+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:04.959745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879892+0000","last_change":"2024-04-26T18:33:06.561848+0000","last_active":"2024-04-26T18:36:27.879892+0000","last_peered":"2024-04-26T18:36:27.879892+0000","last_clean":"2024-04-26T18:36:27.879892+0000","last_became_active":"2024-04-26T18:33:06.561514+0000","last_became_peered":"2024-04-26T18:33:06.561514+0000","last_unstale":"2024-04-26T18:36:27.879892+0000","last_undegraded":"2024-04-26T18:36:27.879892+0000","last_fullsized":"2024-04-26T18:36:27.879892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:46.326261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"92'41","reported_seq":77,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.929940+0000","last_change":"2024-04-26T18:33:03.527237+0000","last_active":"2024-04-26T18:36:27.929940+0000","last_peered":"2024-04-26T18:36:27.929940+0000","last_clean":"2024-04-26T18:36:27.929940+0000","last_became_active":"2024-04-26T18:33:03.526618+0000","last_became_peered":"2024-04-26T18:33:03.526618+0000","last_unstale":"2024-04-26T18:36:27.929940+0000","last_undegraded":"2024-04-26T18:36:27.929940+0000","last_fullsized":"2024-04-26T18:36:27.929940+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:28.232597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879697+0000","last_change":"2024-04-26T18:33:06.555276+0000","last_active":"2024-04-26T18:36:27.879697+0000","last_peered":"2024-04-26T18:36:27.879697+0000","last_clean":"2024-04-26T18:36:27.879697+0000","last_became_active":"2024-04-26T18:33:06.554889+0000","last_became_peered":"2024-04-26T18:33:06.554889+0000","last_unstale":"2024-04-26T18:36:27.879697+0000","last_undegraded":"2024-04-26T18:36:27.879697+0000","last_fullsized":"2024-04-26T18:36:27.879697+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:33:13.614662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.973156+0000","last_change":"2024-04-26T18:33:03.527108+0000","last_active":"2024-04-26T18:36:27.973156+0000","last_peered":"2024-04-26T18:36:27.973156+0000","last_clean":"2024-04-26T18:36:27.973156+0000","last_became_active":"2024-04-26T18:33:03.526648+0000","last_became_peered":"2024-04-26T18:33:03.526648+0000","last_unstale":"2024-04-26T18:36:27.973156+0000","last_undegraded":"2024-04-26T18:36:27.973156+0000","last_fullsized":"2024-04-26T18:36:27.973156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:40.915022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879890+0000","last_change":"2024-04-26T18:33:06.551605+0000","last_active":"2024-04-26T18:36:27.879890+0000","last_peered":"2024-04-26T18:36:27.879890+0000","last_clean":"2024-04-26T18:36:27.879890+0000","last_became_active":"2024-04-26T18:33:06.550772+0000","last_became_peered":"2024-04-26T18:33:06.550772+0000","last_unstale":"2024-04-26T18:36:27.879890+0000","last_undegraded":"2024-04-26T18:36:27.879890+0000","last_fullsized":"2024-04-26T18:36:27.879890+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:33.124989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.732576+0000","last_change":"2024-04-26T18:33:06.558971+0000","last_active":"2024-04-26T18:36:27.732576+0000","last_peered":"2024-04-26T18:36:27.732576+0000","last_clean":"2024-04-26T18:36:27.732576+0000","last_became_active":"2024-04-26T18:33:06.558594+0000","last_became_peered":"2024-04-26T18:33:06.558594+0000","last_unstale":"2024-04-26T18:36:27.732576+0000","last_undegraded":"2024-04-26T18:36:27.732576+0000","last_fullsized":"2024-04-26T18:36:27.732576+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:12.974472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.976355+0000","last_change":"2024-04-26T18:33:06.558928+0000","last_active":"2024-04-26T18:36:27.976355+0000","last_peered":"2024-04-26T18:36:27.976355+0000","last_clean":"2024-04-26T18:36:27.976355+0000","last_became_active":"2024-04-26T18:33:06.558348+0000","last_became_peered":"2024-04-26T18:33:06.558348+0000","last_unstale":"2024-04-26T18:36:27.976355+0000","last_undegraded":"2024-04-26T18:36:27.976355+0000","last_fullsized":"2024-04-26T18:36:27.976355+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:04.266404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.976230+0000","last_change":"2024-04-26T18:33:06.555182+0000","last_active":"2024-04-26T18:36:27.976230+0000","last_peered":"2024-04-26T18:36:27.976230+0000","last_clean":"2024-04-26T18:36:27.976230+0000","last_became_active":"2024-04-26T18:33:06.554830+0000","last_became_peered":"2024-04-26T18:33:06.554830+0000","last_unstale":"2024-04-26T18:36:27.976230+0000","last_undegraded":"2024-04-26T18:36:27.976230+0000","last_fullsized":"2024-04-26T18:36:27.976230+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:48.841634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.975313+0000","last_change":"2024-04-26T18:33:06.558962+0000","last_active":"2024-04-26T18:36:27.975313+0000","last_peered":"2024-04-26T18:36:27.975313+0000","last_clean":"2024-04-26T18:36:27.975313+0000","last_became_active":"2024-04-26T18:33:06.557995+0000","last_became_peered":"2024-04-26T18:33:06.557995+0000","last_unstale":"2024-04-26T18:36:27.975313+0000","last_undegraded":"2024-04-26T18:36:27.975313+0000","last_fullsized":"2024-04-26T18:36:27.975313+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:54.207205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.973002+0000","last_change":"2024-04-26T18:33:06.558055+0000","last_active":"2024-04-26T18:36:27.973002+0000","last_peered":"2024-04-26T18:36:27.973002+0000","last_clean":"2024-04-26T18:36:27.973002+0000","last_became_active":"2024-04-26T18:33:06.557299+0000","last_became_peered":"2024-04-26T18:33:06.557299+0000","last_unstale":"2024-04-26T18:36:27.973002+0000","last_undegraded":"2024-04-26T18:36:27.973002+0000","last_fullsized":"2024-04-26T18:36:27.973002+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:21.143017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.732894+0000","last_change":"2024-04-26T18:33:06.558680+0000","last_active":"2024-04-26T18:36:27.732894+0000","last_peered":"2024-04-26T18:36:27.732894+0000","last_clean":"2024-04-26T18:36:27.732894+0000","last_became_active":"2024-04-26T18:33:06.558139+0000","last_became_peered":"2024-04-26T18:33:06.558139+0000","last_unstale":"2024-04-26T18:36:27.732894+0000","last_undegraded":"2024-04-26T18:36:27.732894+0000","last_fullsized":"2024-04-26T18:36:27.732894+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:31.511770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.976583+0000","last_change":"2024-04-26T18:33:06.563832+0000","last_active":"2024-04-26T18:36:27.976583+0000","last_peered":"2024-04-26T18:36:27.976583+0000","last_clean":"2024-04-26T18:36:27.976583+0000","last_became_active":"2024-04-26T18:33:06.562193+0000","last_became_peered":"2024-04-26T18:33:06.562193+0000","last_unstale":"2024-04-26T18:36:27.976583+0000","last_undegraded":"2024-04-26T18:36:27.976583+0000","last_fullsized":"2024-04-26T18:36:27.976583+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:35.384552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.822222+0000","last_change":"2024-04-26T18:33:06.562368+0000","last_active":"2024-04-26T18:36:27.822222+0000","last_peered":"2024-04-26T18:36:27.822222+0000","last_clean":"2024-04-26T18:36:27.822222+0000","last_became_active":"2024-04-26T18:33:06.562024+0000","last_became_peered":"2024-04-26T18:33:06.562024+0000","last_unstale":"2024-04-26T18:36:27.822222+0000","last_undegraded":"2024-04-26T18:36:27.822222+0000","last_fullsized":"2024-04-26T18:36:27.822222+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:01.562885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.828141+0000","last_change":"2024-04-26T18:33:06.560953+0000","last_active":"2024-04-26T18:36:27.828141+0000","last_peered":"2024-04-26T18:36:27.828141+0000","last_clean":"2024-04-26T18:36:27.828141+0000","last_became_active":"2024-04-26T18:33:06.560593+0000","last_became_peered":"2024-04-26T18:33:06.560593+0000","last_unstale":"2024-04-26T18:36:27.828141+0000","last_undegraded":"2024-04-26T18:36:27.828141+0000","last_fullsized":"2024-04-26T18:36:27.828141+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:18.168564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821227+0000","last_change":"2024-04-26T18:33:06.555389+0000","last_active":"2024-04-26T18:36:27.821227+0000","last_peered":"2024-04-26T18:36:27.821227+0000","last_clean":"2024-04-26T18:36:27.821227+0000","last_became_active":"2024-04-26T18:33:06.555055+0000","last_became_peered":"2024-04-26T18:33:06.555055+0000","last_unstale":"2024-04-26T18:36:27.821227+0000","last_undegraded":"2024-04-26T18:36:27.821227+0000","last_fullsized":"2024-04-26T18:36:27.821227+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:32.802687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972845+0000","last_change":"2024-04-26T18:33:06.563791+0000","last_active":"2024-04-26T18:36:27.972845+0000","last_peered":"2024-04-26T18:36:27.972845+0000","last_clean":"2024-04-26T18:36:27.972845+0000","last_became_active":"2024-04-26T18:33:06.561959+0000","last_became_peered":"2024-04-26T18:33:06.561959+0000","last_unstale":"2024-04-26T18:36:27.972845+0000","last_undegraded":"2024-04-26T18:36:27.972845+0000","last_fullsized":"2024-04-26T18:36:27.972845+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:35.280202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972808+0000","last_change":"2024-04-26T18:33:06.554270+0000","last_active":"2024-04-26T18:36:27.972808+0000","last_peered":"2024-04-26T18:36:27.972808+0000","last_clean":"2024-04-26T18:36:27.972808+0000","last_became_active":"2024-04-26T18:33:06.553931+0000","last_became_peered":"2024-04-26T18:33:06.553931+0000","last_unstale":"2024-04-26T18:36:27.972808+0000","last_undegraded":"2024-04-26T18:36:27.972808+0000","last_fullsized":"2024-04-26T18:36:27.972808+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:40.587824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.732694+0000","last_change":"2024-04-26T18:33:06.556766+0000","last_active":"2024-04-26T18:36:27.732694+0000","last_peered":"2024-04-26T18:36:27.732694+0000","last_clean":"2024-04-26T18:36:27.732694+0000","last_became_active":"2024-04-26T18:33:06.556361+0000","last_became_peered":"2024-04-26T18:33:06.556361+0000","last_unstale":"2024-04-26T18:36:27.732694+0000","last_undegraded":"2024-04-26T18:36:27.732694+0000","last_fullsized":"2024-04-26T18:36:27.732694+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:10.101747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":106677,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":600730,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1990,"num_read_kb":1107,"num_write":380,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":753664,"data_stored":2001733,"data_compressed":85238,"data_compressed_allocated":110592,"data_compressed_original":1732608,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351033,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1011712,"data_stored":492367,"data_compressed":2887,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612669,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32340,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712812,"statfs":{"total":95995035648,"available":95961919488,"internally_reserved":0,"allocated":1191936,"data_stored":1282844,"data_compressed":44602,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776195,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1056768,"data_stored":885491,"data_compressed":22033,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037832,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1040384,"data_stored":885175,"data_compressed":22176,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299469,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712916,"statfs":{"total":95995035648,"available":95962025984,"internally_reserved":0,"allocated":1081344,"data_stored":1086793,"data_compressed":38446,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462995,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1015808,"data_stored":492691,"data_compressed":2887,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36400,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708752,"statfs":{"total":95995035648,"available":95957762048,"internally_reserved":0,"allocated":1085440,"data_stored":561083,"data_compressed":2887,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738480,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":493331,"data_compressed":2887,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411431,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":564438,"data_compressed":2887,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149794,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36420,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708732,"statfs":{"total":95995035648,"available":95957741568,"internally_reserved":0,"allocated":1101824,"data_stored":1213265,"data_compressed":37378,"data_compressed_allocated":49152,"data_compressed_original":708608,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888156,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":483627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724629,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1114112,"data_stored":1216981,"data_compressed":44602,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":73285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":721878,"data_compressed":34491,"data_compressed_allocated":45056,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":135343,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394022,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":201206,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T18:36:36.281 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-26T18:36:36.281 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T18:36:36.519 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:36:36.911 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:36 smithi080 ceph-mon[29135]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T18:36:36.971 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:36 smithi082 ceph-mon[32808]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T18:36:37.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:36 smithi192 ceph-mon[32842]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T18:36:37.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:37 smithi082 ceph-mon[32808]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 131 KiB/s wr, 79 op/s 2024-04-26T18:36:37.972 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:37 smithi080 ceph-mon[29135]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 131 KiB/s wr, 79 op/s 2024-04-26T18:36:38.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:37 smithi192 ceph-mon[32842]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 131 KiB/s wr, 79 op/s 2024-04-26T18:36:38.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.225+0000 7f849095a700 1 -- 172.21.15.80:0/4085562386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f848c06c4c0 msgr2=0x7f848c110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:38.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.225+0000 7f849095a700 1 --2- 172.21.15.80:0/4085562386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f848c06c4c0 0x7f848c110310 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f848400b0a0 tx=0x7f848400b3b0 comp rx=0 tx=0).stop 2024-04-26T18:36:38.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.225+0000 7f849095a700 1 -- 172.21.15.80:0/4085562386 shutdown_connections 2024-04-26T18:36:38.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.225+0000 7f849095a700 1 --2- 172.21.15.80:0/4085562386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f848c06c4c0 0x7f848c110310 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:38.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.225+0000 7f849095a700 1 --2- 172.21.15.80:0/4085562386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f848c1094d0 0x7f848c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:38.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.225+0000 7f849095a700 1 --2- 172.21.15.80:0/4085562386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848c06bb20 0x7f848c06bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:38.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.225+0000 7f849095a700 1 -- 172.21.15.80:0/4085562386 >> 172.21.15.80:0/4085562386 conn(0x7f848c079360 msgr2=0x7f848c079770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:38.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.225+0000 7f849095a700 1 -- 172.21.15.80:0/4085562386 shutdown_connections 2024-04-26T18:36:38.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.225+0000 7f849095a700 1 -- 172.21.15.80:0/4085562386 wait complete. 2024-04-26T18:36:38.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.226+0000 7f849095a700 1 Processor -- start 2024-04-26T18:36:38.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.226+0000 7f849095a700 1 -- start start 2024-04-26T18:36:38.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.226+0000 7f849095a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f848c06bb20 0x7f848c1a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:38.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.226+0000 7f849095a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848c06c4c0 0x7f848c1a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:38.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.226+0000 7f849095a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f848c1094d0 0x7f848c19bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:38.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.226+0000 7f849095a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f848c1135d0 con 0x7f848c1094d0 2024-04-26T18:36:38.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.226+0000 7f849095a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f848c113450 con 0x7f848c06c4c0 2024-04-26T18:36:38.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.226+0000 7f849095a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f848c113750 con 0x7f848c06bb20 2024-04-26T18:36:38.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.226+0000 7f8481d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848c06c4c0 0x7f848c1a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:38.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.226+0000 7f8481d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848c06c4c0 0x7f848c1a1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:59534/0 (socket says 172.21.15.80:59534) 2024-04-26T18:36:38.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.226+0000 7f8481d9b700 1 -- 172.21.15.80:0/2044875692 learned_addr learned my addr 172.21.15.80:0/2044875692 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:38.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.226+0000 7f848a59c700 1 --2- 172.21.15.80:0/2044875692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f848c06bb20 0x7f848c1a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:38.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.226+0000 7f848ad9d700 1 --2- 172.21.15.80:0/2044875692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f848c1094d0 0x7f848c19bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:38.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.227+0000 7f8481d9b700 1 -- 172.21.15.80:0/2044875692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f848c06bb20 msgr2=0x7f848c1a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:38.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.227+0000 7f8481d9b700 1 --2- 172.21.15.80:0/2044875692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f848c06bb20 0x7f848c1a18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:38.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.227+0000 7f8481d9b700 1 -- 172.21.15.80:0/2044875692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f848c1094d0 msgr2=0x7f848c19bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:38.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.227+0000 7f8481d9b700 1 --2- 172.21.15.80:0/2044875692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f848c1094d0 0x7f848c19bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:38.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.227+0000 7f8481d9b700 1 -- 172.21.15.80:0/2044875692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f848c19c210 con 0x7f848c06c4c0 2024-04-26T18:36:38.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.227+0000 7f848ad9d700 1 --2- 172.21.15.80:0/2044875692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f848c1094d0 0x7f848c19bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:36:38.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.227+0000 7f8481d9b700 1 --2- 172.21.15.80:0/2044875692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848c06c4c0 0x7f848c1a1e30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f847400d950 tx=0x7f847400dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:38.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.227+0000 7f8483fff700 1 -- 172.21.15.80:0/2044875692 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8474016070 con 0x7f848c06c4c0 2024-04-26T18:36:38.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.227+0000 7f849095a700 1 -- 172.21.15.80:0/2044875692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f848c19c500 con 0x7f848c06c4c0 2024-04-26T18:36:38.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.227+0000 7f849095a700 1 -- 172.21.15.80:0/2044875692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f848c1a87c0 con 0x7f848c06c4c0 2024-04-26T18:36:38.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.227+0000 7f8483fff700 1 -- 172.21.15.80:0/2044875692 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f847400fd40 con 0x7f848c06c4c0 2024-04-26T18:36:38.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.227+0000 7f8483fff700 1 -- 172.21.15.80:0/2044875692 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8474020060 con 0x7f848c06c4c0 2024-04-26T18:36:38.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.228+0000 7f849095a700 1 -- 172.21.15.80:0/2044875692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f846c005330 con 0x7f848c06c4c0 2024-04-26T18:36:38.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.230+0000 7f8483fff700 1 -- 172.21.15.80:0/2044875692 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 24) ==== 138873+0+0 (secure 0 0 0) 0x7f8474019070 con 0x7f848c06c4c0 2024-04-26T18:36:38.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.230+0000 7f8483fff700 1 --2- 172.21.15.80:0/2044875692 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f84780a3f50 0x7f84780a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:38.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.230+0000 7f8483fff700 1 -- 172.21.15.80:0/2044875692 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f84740d0940 con 0x7f848c06c4c0 2024-04-26T18:36:38.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.230+0000 7f848a59c700 1 --2- 172.21.15.80:0/2044875692 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f84780a3f50 0x7f84780a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:38.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.230+0000 7f848a59c700 1 --2- 172.21.15.80:0/2044875692 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f84780a3f50 0x7f84780a6410 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f848c19cbf0 tx=0x7f847c00b410 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:38.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.234+0000 7f8483fff700 1 -- 172.21.15.80:0/2044875692 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f847409cd80 con 0x7f848c06c4c0 2024-04-26T18:36:38.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.428+0000 7f849095a700 1 -- 172.21.15.80:0/2044875692 --> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f846c000bc0 con 0x7f84780a3f50 2024-04-26T18:36:38.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.435+0000 7f8483fff700 1 -- 172.21.15.80:0/2044875692 <== mgr.24736 v2:172.21.15.80:6800/1522002759 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258095 (secure 0 0 0) 0x7f846c000bc0 con 0x7f84780a3f50 2024-04-26T18:36:38.439 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:36:38.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.438+0000 7f849095a700 1 -- 172.21.15.80:0/2044875692 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f84780a3f50 msgr2=0x7f84780a6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:38.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.438+0000 7f849095a700 1 --2- 172.21.15.80:0/2044875692 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f84780a3f50 0x7f84780a6410 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f848c19cbf0 tx=0x7f847c00b410 comp rx=0 tx=0).stop 2024-04-26T18:36:38.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.438+0000 7f849095a700 1 -- 172.21.15.80:0/2044875692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848c06c4c0 msgr2=0x7f848c1a1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:38.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.438+0000 7f849095a700 1 --2- 172.21.15.80:0/2044875692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848c06c4c0 0x7f848c1a1e30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f847400d950 tx=0x7f847400dc60 comp rx=0 tx=0).stop 2024-04-26T18:36:38.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.438+0000 7f849095a700 1 -- 172.21.15.80:0/2044875692 shutdown_connections 2024-04-26T18:36:38.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.438+0000 7f849095a700 1 --2- 172.21.15.80:0/2044875692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f848c1094d0 0x7f848c19bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:38.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.438+0000 7f849095a700 1 --2- 172.21.15.80:0/2044875692 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f84780a3f50 0x7f84780a6410 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:38.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.438+0000 7f849095a700 1 --2- 172.21.15.80:0/2044875692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f848c06bb20 0x7f848c1a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:38.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.438+0000 7f849095a700 1 --2- 172.21.15.80:0/2044875692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848c06c4c0 0x7f848c1a1e30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:38.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.438+0000 7f849095a700 1 -- 172.21.15.80:0/2044875692 >> 172.21.15.80:0/2044875692 conn(0x7f848c079360 msgr2=0x7f848c10e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:38.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.438+0000 7f849095a700 1 -- 172.21.15.80:0/2044875692 shutdown_connections 2024-04-26T18:36:38.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:38.438+0000 7f849095a700 1 -- 172.21.15.80:0/2044875692 wait complete. 2024-04-26T18:36:38.442 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-26T18:36:38.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:38 smithi080 ceph-mon[29135]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 102 KiB/s wr, 61 op/s 2024-04-26T18:36:38.813 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:38 smithi080 ceph-mon[29135]: from='client.24902 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T18:36:38.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:38 smithi082 ceph-mon[32808]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 102 KiB/s wr, 61 op/s 2024-04-26T18:36:38.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:38 smithi082 ceph-mon[32808]: from='client.24902 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T18:36:39.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:38 smithi192 ceph-mon[32842]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 102 KiB/s wr, 61 op/s 2024-04-26T18:36:39.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:38 smithi192 ceph-mon[32842]: from='client.24902 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T18:36:39.149 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2024-04-26T18:36:37.745577+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1390875,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":2523,"num_read_kb":1692,"num_write":713,"num_write_kb":5325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1181430,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1036,"ondisk_log_size":1036,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370132,"kb_used_data":12624,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571692,"statfs":{"total":1151940427776,"available":1151561412608,"internally_reserved":0,"allocated":12926976,"data_stored":10066461,"data_compressed":244794,"data_compressed_allocated":319488,"data_compressed_original":3969024,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":199543,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":471,"num_write":150,"num_write_kb":919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.989119"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.733075+0000","last_change":"2024-04-26T18:33:06.565673+0000","last_active":"2024-04-26T18:36:27.733075+0000","last_peered":"2024-04-26T18:36:27.733075+0000","last_clean":"2024-04-26T18:36:27.733075+0000","last_became_active":"2024-04-26T18:33:06.565065+0000","last_became_peered":"2024-04-26T18:33:06.565065+0000","last_unstale":"2024-04-26T18:36:27.733075+0000","last_undegraded":"2024-04-26T18:36:27.733075+0000","last_fullsized":"2024-04-26T18:36:27.733075+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:54:10.833343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.975622+0000","last_change":"2024-04-26T18:33:06.552350+0000","last_active":"2024-04-26T18:36:27.975622+0000","last_peered":"2024-04-26T18:36:27.975622+0000","last_clean":"2024-04-26T18:36:27.975622+0000","last_became_active":"2024-04-26T18:33:06.551941+0000","last_became_peered":"2024-04-26T18:33:06.551941+0000","last_unstale":"2024-04-26T18:36:27.975622+0000","last_undegraded":"2024-04-26T18:36:27.975622+0000","last_fullsized":"2024-04-26T18:36:27.975622+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:40.702995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.975532+0000","last_change":"2024-04-26T18:33:06.561456+0000","last_active":"2024-04-26T18:36:27.975532+0000","last_peered":"2024-04-26T18:36:27.975532+0000","last_clean":"2024-04-26T18:36:27.975532+0000","last_became_active":"2024-04-26T18:33:06.561032+0000","last_became_peered":"2024-04-26T18:33:06.561032+0000","last_unstale":"2024-04-26T18:36:27.975532+0000","last_undegraded":"2024-04-26T18:36:27.975532+0000","last_fullsized":"2024-04-26T18:36:27.975532+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:56:56.228873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.973428+0000","last_change":"2024-04-26T18:33:06.556597+0000","last_active":"2024-04-26T18:36:27.973428+0000","last_peered":"2024-04-26T18:36:27.973428+0000","last_clean":"2024-04-26T18:36:27.973428+0000","last_became_active":"2024-04-26T18:33:06.555356+0000","last_became_peered":"2024-04-26T18:33:06.555356+0000","last_unstale":"2024-04-26T18:36:27.973428+0000","last_undegraded":"2024-04-26T18:36:27.973428+0000","last_fullsized":"2024-04-26T18:36:27.973428+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:55.860495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821498+0000","last_change":"2024-04-26T18:33:06.549480+0000","last_active":"2024-04-26T18:36:27.821498+0000","last_peered":"2024-04-26T18:36:27.821498+0000","last_clean":"2024-04-26T18:36:27.821498+0000","last_became_active":"2024-04-26T18:33:06.549086+0000","last_became_peered":"2024-04-26T18:33:06.549086+0000","last_unstale":"2024-04-26T18:36:27.821498+0000","last_undegraded":"2024-04-26T18:36:27.821498+0000","last_fullsized":"2024-04-26T18:36:27.821498+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:13.012745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.730369+0000","last_change":"2024-04-26T18:33:06.558539+0000","last_active":"2024-04-26T18:36:27.730369+0000","last_peered":"2024-04-26T18:36:27.730369+0000","last_clean":"2024-04-26T18:36:27.730369+0000","last_became_active":"2024-04-26T18:33:06.558185+0000","last_became_peered":"2024-04-26T18:33:06.558185+0000","last_unstale":"2024-04-26T18:36:27.730369+0000","last_undegraded":"2024-04-26T18:36:27.730369+0000","last_fullsized":"2024-04-26T18:36:27.730369+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:59:31.299478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879561+0000","last_change":"2024-04-26T18:33:06.557336+0000","last_active":"2024-04-26T18:36:27.879561+0000","last_peered":"2024-04-26T18:36:27.879561+0000","last_clean":"2024-04-26T18:36:27.879561+0000","last_became_active":"2024-04-26T18:33:06.556988+0000","last_became_peered":"2024-04-26T18:33:06.556988+0000","last_unstale":"2024-04-26T18:36:27.879561+0000","last_undegraded":"2024-04-26T18:36:27.879561+0000","last_fullsized":"2024-04-26T18:36:27.879561+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:48.814042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821264+0000","last_change":"2024-04-26T18:33:06.556355+0000","last_active":"2024-04-26T18:36:27.821264+0000","last_peered":"2024-04-26T18:36:27.821264+0000","last_clean":"2024-04-26T18:36:27.821264+0000","last_became_active":"2024-04-26T18:33:06.555947+0000","last_became_peered":"2024-04-26T18:33:06.555947+0000","last_unstale":"2024-04-26T18:36:27.821264+0000","last_undegraded":"2024-04-26T18:36:27.821264+0000","last_fullsized":"2024-04-26T18:36:27.821264+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:36.607305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.973088+0000","last_change":"2024-04-26T18:33:06.569673+0000","last_active":"2024-04-26T18:36:27.973088+0000","last_peered":"2024-04-26T18:36:27.973088+0000","last_clean":"2024-04-26T18:36:27.973088+0000","last_became_active":"2024-04-26T18:33:06.568453+0000","last_became_peered":"2024-04-26T18:33:06.568453+0000","last_unstale":"2024-04-26T18:36:27.973088+0000","last_undegraded":"2024-04-26T18:36:27.973088+0000","last_fullsized":"2024-04-26T18:36:27.973088+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:38.428723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.730773+0000","last_change":"2024-04-26T18:33:06.564286+0000","last_active":"2024-04-26T18:36:27.730773+0000","last_peered":"2024-04-26T18:36:27.730773+0000","last_clean":"2024-04-26T18:36:27.730773+0000","last_became_active":"2024-04-26T18:33:06.563830+0000","last_became_peered":"2024-04-26T18:33:06.563830+0000","last_unstale":"2024-04-26T18:36:27.730773+0000","last_undegraded":"2024-04-26T18:36:27.730773+0000","last_fullsized":"2024-04-26T18:36:27.730773+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:36.518838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879754+0000","last_change":"2024-04-26T18:33:06.560724+0000","last_active":"2024-04-26T18:36:27.879754+0000","last_peered":"2024-04-26T18:36:27.879754+0000","last_clean":"2024-04-26T18:36:27.879754+0000","last_became_active":"2024-04-26T18:33:06.560393+0000","last_became_peered":"2024-04-26T18:33:06.560393+0000","last_unstale":"2024-04-26T18:36:27.879754+0000","last_undegraded":"2024-04-26T18:36:27.879754+0000","last_fullsized":"2024-04-26T18:36:27.879754+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:41.286466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.727850+0000","last_change":"2024-04-26T18:33:51.859986+0000","last_active":"2024-04-26T18:36:27.727850+0000","last_peered":"2024-04-26T18:36:27.727850+0000","last_clean":"2024-04-26T18:36:27.727850+0000","last_became_active":"2024-04-26T18:33:51.859656+0000","last_became_peered":"2024-04-26T18:33:51.859656+0000","last_unstale":"2024-04-26T18:36:27.727850+0000","last_undegraded":"2024-04-26T18:36:27.727850+0000","last_fullsized":"2024-04-26T18:36:27.727850+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:09:48.471097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972836+0000","last_change":"2024-04-26T18:33:06.555813+0000","last_active":"2024-04-26T18:36:27.972836+0000","last_peered":"2024-04-26T18:36:27.972836+0000","last_clean":"2024-04-26T18:36:27.972836+0000","last_became_active":"2024-04-26T18:33:06.555498+0000","last_became_peered":"2024-04-26T18:33:06.555498+0000","last_unstale":"2024-04-26T18:36:27.972836+0000","last_undegraded":"2024-04-26T18:36:27.972836+0000","last_fullsized":"2024-04-26T18:36:27.972836+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:21.531142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.975070+0000","last_change":"2024-04-26T18:33:06.551833+0000","last_active":"2024-04-26T18:36:27.975070+0000","last_peered":"2024-04-26T18:36:27.975070+0000","last_clean":"2024-04-26T18:36:27.975070+0000","last_became_active":"2024-04-26T18:33:06.551503+0000","last_became_peered":"2024-04-26T18:33:06.551503+0000","last_unstale":"2024-04-26T18:36:27.975070+0000","last_undegraded":"2024-04-26T18:36:27.975070+0000","last_fullsized":"2024-04-26T18:36:27.975070+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:20.560656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.975057+0000","last_change":"2024-04-26T18:33:06.555971+0000","last_active":"2024-04-26T18:36:27.975057+0000","last_peered":"2024-04-26T18:36:27.975057+0000","last_clean":"2024-04-26T18:36:27.975057+0000","last_became_active":"2024-04-26T18:33:06.555312+0000","last_became_peered":"2024-04-26T18:33:06.555312+0000","last_unstale":"2024-04-26T18:36:27.975057+0000","last_undegraded":"2024-04-26T18:36:27.975057+0000","last_fullsized":"2024-04-26T18:36:27.975057+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:05.066403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972532+0000","last_change":"2024-04-26T18:33:06.567762+0000","last_active":"2024-04-26T18:36:27.972532+0000","last_peered":"2024-04-26T18:36:27.972532+0000","last_clean":"2024-04-26T18:36:27.972532+0000","last_became_active":"2024-04-26T18:33:06.567368+0000","last_became_peered":"2024-04-26T18:33:06.567368+0000","last_unstale":"2024-04-26T18:36:27.972532+0000","last_undegraded":"2024-04-26T18:36:27.972532+0000","last_fullsized":"2024-04-26T18:36:27.972532+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:27.428529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.732899+0000","last_change":"2024-04-26T18:33:06.565334+0000","last_active":"2024-04-26T18:36:27.732899+0000","last_peered":"2024-04-26T18:36:27.732899+0000","last_clean":"2024-04-26T18:36:27.732899+0000","last_became_active":"2024-04-26T18:33:06.564997+0000","last_became_peered":"2024-04-26T18:33:06.564997+0000","last_unstale":"2024-04-26T18:36:27.732899+0000","last_undegraded":"2024-04-26T18:36:27.732899+0000","last_fullsized":"2024-04-26T18:36:27.732899+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:57.892318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.727970+0000","last_change":"2024-04-26T18:33:06.562242+0000","last_active":"2024-04-26T18:36:27.727970+0000","last_peered":"2024-04-26T18:36:27.727970+0000","last_clean":"2024-04-26T18:36:27.727970+0000","last_became_active":"2024-04-26T18:33:06.561863+0000","last_became_peered":"2024-04-26T18:33:06.561863+0000","last_unstale":"2024-04-26T18:36:27.727970+0000","last_undegraded":"2024-04-26T18:36:27.727970+0000","last_fullsized":"2024-04-26T18:36:27.727970+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:22.745294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.976550+0000","last_change":"2024-04-26T18:33:06.555511+0000","last_active":"2024-04-26T18:36:27.976550+0000","last_peered":"2024-04-26T18:36:27.976550+0000","last_clean":"2024-04-26T18:36:27.976550+0000","last_became_active":"2024-04-26T18:33:06.555201+0000","last_became_peered":"2024-04-26T18:33:06.555201+0000","last_unstale":"2024-04-26T18:36:27.976550+0000","last_undegraded":"2024-04-26T18:36:27.976550+0000","last_fullsized":"2024-04-26T18:36:27.976550+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:09.644167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'14","reported_seq":252,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:31.884985+0000","last_change":"2024-04-26T18:33:51.664154+0000","last_active":"2024-04-26T18:36:31.884985+0000","last_peered":"2024-04-26T18:36:31.884985+0000","last_clean":"2024-04-26T18:36:31.884985+0000","last_became_active":"2024-04-26T18:33:51.653330+0000","last_became_peered":"2024-04-26T18:33:51.653330+0000","last_unstale":"2024-04-26T18:36:31.884985+0000","last_undegraded":"2024-04-26T18:36:31.884985+0000","last_fullsized":"2024-04-26T18:36:31.884985+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:55:49.100993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":183,"num_read_kb":183,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.822051+0000","last_change":"2024-04-26T18:33:06.560652+0000","last_active":"2024-04-26T18:36:27.822051+0000","last_peered":"2024-04-26T18:36:27.822051+0000","last_clean":"2024-04-26T18:36:27.822051+0000","last_became_active":"2024-04-26T18:33:06.560311+0000","last_became_peered":"2024-04-26T18:33:06.560311+0000","last_unstale":"2024-04-26T18:36:27.822051+0000","last_undegraded":"2024-04-26T18:36:27.822051+0000","last_fullsized":"2024-04-26T18:36:27.822051+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:22.653995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.822203+0000","last_change":"2024-04-26T18:33:03.860585+0000","last_active":"2024-04-26T18:36:27.822203+0000","last_peered":"2024-04-26T18:36:27.822203+0000","last_clean":"2024-04-26T18:36:27.822203+0000","last_became_active":"2024-04-26T18:33:03.860232+0000","last_became_peered":"2024-04-26T18:33:03.860232+0000","last_unstale":"2024-04-26T18:36:27.822203+0000","last_undegraded":"2024-04-26T18:36:27.822203+0000","last_fullsized":"2024-04-26T18:36:27.822203+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:04.685495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.975810+0000","last_change":"2024-04-26T18:33:06.563764+0000","last_active":"2024-04-26T18:36:27.975810+0000","last_peered":"2024-04-26T18:36:27.975810+0000","last_clean":"2024-04-26T18:36:27.975810+0000","last_became_active":"2024-04-26T18:33:06.563322+0000","last_became_peered":"2024-04-26T18:33:06.563322+0000","last_unstale":"2024-04-26T18:36:27.975810+0000","last_undegraded":"2024-04-26T18:36:27.975810+0000","last_fullsized":"2024-04-26T18:36:27.975810+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:17:53.144144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"91'13","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821711+0000","last_change":"2024-04-26T18:33:03.533057+0000","last_active":"2024-04-26T18:36:27.821711+0000","last_peered":"2024-04-26T18:36:27.821711+0000","last_clean":"2024-04-26T18:36:27.821711+0000","last_became_active":"2024-04-26T18:33:03.532665+0000","last_became_peered":"2024-04-26T18:33:03.532665+0000","last_unstale":"2024-04-26T18:36:27.821711+0000","last_undegraded":"2024-04-26T18:36:27.821711+0000","last_fullsized":"2024-04-26T18:36:27.821711+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:29.125064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972615+0000","last_change":"2024-04-26T18:33:06.567612+0000","last_active":"2024-04-26T18:36:27.972615+0000","last_peered":"2024-04-26T18:36:27.972615+0000","last_clean":"2024-04-26T18:36:27.972615+0000","last_became_active":"2024-04-26T18:33:06.565883+0000","last_became_peered":"2024-04-26T18:33:06.565883+0000","last_unstale":"2024-04-26T18:36:27.972615+0000","last_undegraded":"2024-04-26T18:36:27.972615+0000","last_fullsized":"2024-04-26T18:36:27.972615+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:59.721305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821757+0000","last_change":"2024-04-26T18:33:03.532075+0000","last_active":"2024-04-26T18:36:27.821757+0000","last_peered":"2024-04-26T18:36:27.821757+0000","last_clean":"2024-04-26T18:36:27.821757+0000","last_became_active":"2024-04-26T18:33:03.531729+0000","last_became_peered":"2024-04-26T18:33:03.531729+0000","last_unstale":"2024-04-26T18:36:27.821757+0000","last_undegraded":"2024-04-26T18:36:27.821757+0000","last_fullsized":"2024-04-26T18:36:27.821757+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:23.748292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.828278+0000","last_change":"2024-04-26T18:33:06.569377+0000","last_active":"2024-04-26T18:36:27.828278+0000","last_peered":"2024-04-26T18:36:27.828278+0000","last_clean":"2024-04-26T18:36:27.828278+0000","last_became_active":"2024-04-26T18:33:06.569057+0000","last_became_peered":"2024-04-26T18:33:06.569057+0000","last_unstale":"2024-04-26T18:36:27.828278+0000","last_undegraded":"2024-04-26T18:36:27.828278+0000","last_fullsized":"2024-04-26T18:36:27.828278+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:10.968017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"92'8","reported_seq":231,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:32.169751+0000","last_change":"2024-04-26T18:33:03.525186+0000","last_active":"2024-04-26T18:36:32.169751+0000","last_peered":"2024-04-26T18:36:32.169751+0000","last_clean":"2024-04-26T18:36:32.169751+0000","last_became_active":"2024-04-26T18:33:03.524880+0000","last_became_peered":"2024-04-26T18:33:03.524880+0000","last_unstale":"2024-04-26T18:36:32.169751+0000","last_undegraded":"2024-04-26T18:36:32.169751+0000","last_fullsized":"2024-04-26T18:36:32.169751+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:51:30.130244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":195,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821361+0000","last_change":"2024-04-26T18:33:06.558034+0000","last_active":"2024-04-26T18:36:27.821361+0000","last_peered":"2024-04-26T18:36:27.821361+0000","last_clean":"2024-04-26T18:36:27.821361+0000","last_became_active":"2024-04-26T18:33:06.557694+0000","last_became_peered":"2024-04-26T18:33:06.557694+0000","last_unstale":"2024-04-26T18:36:27.821361+0000","last_undegraded":"2024-04-26T18:36:27.821361+0000","last_fullsized":"2024-04-26T18:36:27.821361+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:02.497601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.730278+0000","last_change":"2024-04-26T18:33:03.528750+0000","last_active":"2024-04-26T18:36:27.730278+0000","last_peered":"2024-04-26T18:36:27.730278+0000","last_clean":"2024-04-26T18:36:27.730278+0000","last_became_active":"2024-04-26T18:33:03.528442+0000","last_became_peered":"2024-04-26T18:33:03.528442+0000","last_unstale":"2024-04-26T18:36:27.730278+0000","last_undegraded":"2024-04-26T18:36:27.730278+0000","last_fullsized":"2024-04-26T18:36:27.730278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:13.931280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.828278+0000","last_change":"2024-04-26T18:33:06.561274+0000","last_active":"2024-04-26T18:36:27.828278+0000","last_peered":"2024-04-26T18:36:27.828278+0000","last_clean":"2024-04-26T18:36:27.828278+0000","last_became_active":"2024-04-26T18:33:06.560622+0000","last_became_peered":"2024-04-26T18:33:06.560622+0000","last_unstale":"2024-04-26T18:36:27.828278+0000","last_undegraded":"2024-04-26T18:36:27.828278+0000","last_fullsized":"2024-04-26T18:36:27.828278+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:27.875181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972610+0000","last_change":"2024-04-26T18:33:03.529634+0000","last_active":"2024-04-26T18:36:27.972610+0000","last_peered":"2024-04-26T18:36:27.972610+0000","last_clean":"2024-04-26T18:36:27.972610+0000","last_became_active":"2024-04-26T18:33:03.529303+0000","last_became_peered":"2024-04-26T18:33:03.529303+0000","last_unstale":"2024-04-26T18:36:27.972610+0000","last_undegraded":"2024-04-26T18:36:27.972610+0000","last_fullsized":"2024-04-26T18:36:27.972610+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:37.580542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821227+0000","last_change":"2024-04-26T18:33:06.550896+0000","last_active":"2024-04-26T18:36:27.821227+0000","last_peered":"2024-04-26T18:36:27.821227+0000","last_clean":"2024-04-26T18:36:27.821227+0000","last_became_active":"2024-04-26T18:33:06.550571+0000","last_became_peered":"2024-04-26T18:33:06.550571+0000","last_unstale":"2024-04-26T18:36:27.821227+0000","last_undegraded":"2024-04-26T18:36:27.821227+0000","last_fullsized":"2024-04-26T18:36:27.821227+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:26.715158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.828072+0000","last_change":"2024-04-26T18:33:03.530875+0000","last_active":"2024-04-26T18:36:27.828072+0000","last_peered":"2024-04-26T18:36:27.828072+0000","last_clean":"2024-04-26T18:36:27.828072+0000","last_became_active":"2024-04-26T18:33:03.530564+0000","last_became_peered":"2024-04-26T18:33:03.530564+0000","last_unstale":"2024-04-26T18:36:27.828072+0000","last_undegraded":"2024-04-26T18:36:27.828072+0000","last_fullsized":"2024-04-26T18:36:27.828072+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:20.320591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.727649+0000","last_change":"2024-04-26T18:33:06.553434+0000","last_active":"2024-04-26T18:36:27.727649+0000","last_peered":"2024-04-26T18:36:27.727649+0000","last_clean":"2024-04-26T18:36:27.727649+0000","last_became_active":"2024-04-26T18:33:06.551897+0000","last_became_peered":"2024-04-26T18:33:06.551897+0000","last_unstale":"2024-04-26T18:36:27.727649+0000","last_undegraded":"2024-04-26T18:36:27.727649+0000","last_fullsized":"2024-04-26T18:36:27.727649+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:56.503266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"92'6","reported_seq":414,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:33.170442+0000","last_change":"2024-04-26T18:33:03.524239+0000","last_active":"2024-04-26T18:36:33.170442+0000","last_peered":"2024-04-26T18:36:33.170442+0000","last_clean":"2024-04-26T18:36:33.170442+0000","last_became_active":"2024-04-26T18:33:03.523848+0000","last_became_peered":"2024-04-26T18:33:03.523848+0000","last_unstale":"2024-04-26T18:36:33.170442+0000","last_undegraded":"2024-04-26T18:36:33.170442+0000","last_fullsized":"2024-04-26T18:36:33.170442+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:29.354430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":380,"num_read_kb":380,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972992+0000","last_change":"2024-04-26T18:33:06.569557+0000","last_active":"2024-04-26T18:36:27.972992+0000","last_peered":"2024-04-26T18:36:27.972992+0000","last_clean":"2024-04-26T18:36:27.972992+0000","last_became_active":"2024-04-26T18:33:06.568414+0000","last_became_peered":"2024-04-26T18:33:06.568414+0000","last_unstale":"2024-04-26T18:36:27.972992+0000","last_undegraded":"2024-04-26T18:36:27.972992+0000","last_fullsized":"2024-04-26T18:36:27.972992+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:30.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879761+0000","last_change":"2024-04-26T18:33:03.528554+0000","last_active":"2024-04-26T18:36:27.879761+0000","last_peered":"2024-04-26T18:36:27.879761+0000","last_clean":"2024-04-26T18:36:27.879761+0000","last_became_active":"2024-04-26T18:33:03.527611+0000","last_became_peered":"2024-04-26T18:33:03.527611+0000","last_unstale":"2024-04-26T18:36:27.879761+0000","last_undegraded":"2024-04-26T18:36:27.879761+0000","last_fullsized":"2024-04-26T18:36:27.879761+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:28.387779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.975762+0000","last_change":"2024-04-26T18:33:06.561415+0000","last_active":"2024-04-26T18:36:27.975762+0000","last_peered":"2024-04-26T18:36:27.975762+0000","last_clean":"2024-04-26T18:36:27.975762+0000","last_became_active":"2024-04-26T18:33:06.560518+0000","last_became_peered":"2024-04-26T18:33:06.560518+0000","last_unstale":"2024-04-26T18:36:27.975762+0000","last_undegraded":"2024-04-26T18:36:27.975762+0000","last_fullsized":"2024-04-26T18:36:27.975762+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:49.824157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.828368+0000","last_change":"2024-04-26T18:33:03.861087+0000","last_active":"2024-04-26T18:36:27.828368+0000","last_peered":"2024-04-26T18:36:27.828368+0000","last_clean":"2024-04-26T18:36:27.828368+0000","last_became_active":"2024-04-26T18:33:03.860531+0000","last_became_peered":"2024-04-26T18:33:03.860531+0000","last_unstale":"2024-04-26T18:36:27.828368+0000","last_undegraded":"2024-04-26T18:36:27.828368+0000","last_fullsized":"2024-04-26T18:36:27.828368+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:22:07.086887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972830+0000","last_change":"2024-04-26T18:33:06.565910+0000","last_active":"2024-04-26T18:36:27.972830+0000","last_peered":"2024-04-26T18:36:27.972830+0000","last_clean":"2024-04-26T18:36:27.972830+0000","last_became_active":"2024-04-26T18:33:06.565402+0000","last_became_peered":"2024-04-26T18:33:06.565402+0000","last_unstale":"2024-04-26T18:36:27.972830+0000","last_undegraded":"2024-04-26T18:36:27.972830+0000","last_fullsized":"2024-04-26T18:36:27.972830+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:40.418513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"92'41","reported_seq":464,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:33.170430+0000","last_change":"2024-04-26T18:33:03.527871+0000","last_active":"2024-04-26T18:36:33.170430+0000","last_peered":"2024-04-26T18:36:33.170430+0000","last_clean":"2024-04-26T18:36:33.170430+0000","last_became_active":"2024-04-26T18:33:03.527546+0000","last_became_peered":"2024-04-26T18:33:03.527546+0000","last_unstale":"2024-04-26T18:36:33.170430+0000","last_undegraded":"2024-04-26T18:36:33.170430+0000","last_fullsized":"2024-04-26T18:36:33.170430+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:24.749505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70390,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":395,"num_read_kb":266,"num_write":43,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821511+0000","last_change":"2024-04-26T18:33:06.546735+0000","last_active":"2024-04-26T18:36:27.821511+0000","last_peered":"2024-04-26T18:36:27.821511+0000","last_clean":"2024-04-26T18:36:27.821511+0000","last_became_active":"2024-04-26T18:33:06.546360+0000","last_became_peered":"2024-04-26T18:33:06.546360+0000","last_unstale":"2024-04-26T18:36:27.821511+0000","last_undegraded":"2024-04-26T18:36:27.821511+0000","last_fullsized":"2024-04-26T18:36:27.821511+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:15.736669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.976284+0000","last_change":"2024-04-26T18:33:03.526081+0000","last_active":"2024-04-26T18:36:27.976284+0000","last_peered":"2024-04-26T18:36:27.976284+0000","last_clean":"2024-04-26T18:36:27.976284+0000","last_became_active":"2024-04-26T18:33:03.525717+0000","last_became_peered":"2024-04-26T18:33:03.525717+0000","last_unstale":"2024-04-26T18:36:27.976284+0000","last_undegraded":"2024-04-26T18:36:27.976284+0000","last_fullsized":"2024-04-26T18:36:27.976284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:15.137654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972542+0000","last_change":"2024-04-26T18:33:06.552689+0000","last_active":"2024-04-26T18:36:27.972542+0000","last_peered":"2024-04-26T18:36:27.972542+0000","last_clean":"2024-04-26T18:36:27.972542+0000","last_became_active":"2024-04-26T18:33:06.552404+0000","last_became_peered":"2024-04-26T18:33:06.552404+0000","last_unstale":"2024-04-26T18:36:27.972542+0000","last_undegraded":"2024-04-26T18:36:27.972542+0000","last_fullsized":"2024-04-26T18:36:27.972542+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:58:32.681037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.828120+0000","last_change":"2024-04-26T18:33:03.526092+0000","last_active":"2024-04-26T18:36:27.828120+0000","last_peered":"2024-04-26T18:36:27.828120+0000","last_clean":"2024-04-26T18:36:27.828120+0000","last_became_active":"2024-04-26T18:33:03.525782+0000","last_became_peered":"2024-04-26T18:33:03.525782+0000","last_unstale":"2024-04-26T18:36:27.828120+0000","last_undegraded":"2024-04-26T18:36:27.828120+0000","last_fullsized":"2024-04-26T18:36:27.828120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:56.564484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879762+0000","last_change":"2024-04-26T18:33:51.952244+0000","last_active":"2024-04-26T18:36:27.879762+0000","last_peered":"2024-04-26T18:36:27.879762+0000","last_clean":"2024-04-26T18:36:27.879762+0000","last_became_active":"2024-04-26T18:33:51.951795+0000","last_became_peered":"2024-04-26T18:33:51.951795+0000","last_unstale":"2024-04-26T18:36:27.879762+0000","last_undegraded":"2024-04-26T18:36:27.879762+0000","last_fullsized":"2024-04-26T18:36:27.879762+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:39.268117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"92'6","reported_seq":227,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:32.169007+0000","last_change":"2024-04-26T18:33:03.531232+0000","last_active":"2024-04-26T18:36:32.169007+0000","last_peered":"2024-04-26T18:36:32.169007+0000","last_clean":"2024-04-26T18:36:32.169007+0000","last_became_active":"2024-04-26T18:33:03.530861+0000","last_became_peered":"2024-04-26T18:33:03.530861+0000","last_unstale":"2024-04-26T18:36:32.169007+0000","last_undegraded":"2024-04-26T18:36:32.169007+0000","last_fullsized":"2024-04-26T18:36:32.169007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:07:44.576659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":194,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879514+0000","last_change":"2024-04-26T18:33:06.559471+0000","last_active":"2024-04-26T18:36:27.879514+0000","last_peered":"2024-04-26T18:36:27.879514+0000","last_clean":"2024-04-26T18:36:27.879514+0000","last_became_active":"2024-04-26T18:33:06.559156+0000","last_became_peered":"2024-04-26T18:33:06.559156+0000","last_unstale":"2024-04-26T18:36:27.879514+0000","last_undegraded":"2024-04-26T18:36:27.879514+0000","last_fullsized":"2024-04-26T18:36:27.879514+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:37.624415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821319+0000","last_change":"2024-04-26T18:33:03.860900+0000","last_active":"2024-04-26T18:36:27.821319+0000","last_peered":"2024-04-26T18:36:27.821319+0000","last_clean":"2024-04-26T18:36:27.821319+0000","last_became_active":"2024-04-26T18:33:03.860601+0000","last_became_peered":"2024-04-26T18:33:03.860601+0000","last_unstale":"2024-04-26T18:36:27.821319+0000","last_undegraded":"2024-04-26T18:36:27.821319+0000","last_fullsized":"2024-04-26T18:36:27.821319+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:56.527624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.727809+0000","last_change":"2024-04-26T18:33:51.861484+0000","last_active":"2024-04-26T18:36:27.727809+0000","last_peered":"2024-04-26T18:36:27.727809+0000","last_clean":"2024-04-26T18:36:27.727809+0000","last_became_active":"2024-04-26T18:33:51.861066+0000","last_became_peered":"2024-04-26T18:33:51.861066+0000","last_unstale":"2024-04-26T18:36:27.727809+0000","last_undegraded":"2024-04-26T18:36:27.727809+0000","last_fullsized":"2024-04-26T18:36:27.727809+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:48.477037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.732769+0000","last_change":"2024-04-26T18:33:51.667455+0000","last_active":"2024-04-26T18:36:27.732769+0000","last_peered":"2024-04-26T18:36:27.732769+0000","last_clean":"2024-04-26T18:36:27.732769+0000","last_became_active":"2024-04-26T18:33:51.653472+0000","last_became_peered":"2024-04-26T18:33:51.653472+0000","last_unstale":"2024-04-26T18:36:27.732769+0000","last_undegraded":"2024-04-26T18:36:27.732769+0000","last_fullsized":"2024-04-26T18:36:27.732769+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:19.828738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.732940+0000","last_change":"2024-04-26T18:33:06.557597+0000","last_active":"2024-04-26T18:36:27.732940+0000","last_peered":"2024-04-26T18:36:27.732940+0000","last_clean":"2024-04-26T18:36:27.732940+0000","last_became_active":"2024-04-26T18:33:06.557249+0000","last_became_peered":"2024-04-26T18:33:06.557249+0000","last_unstale":"2024-04-26T18:36:27.732940+0000","last_undegraded":"2024-04-26T18:36:27.732940+0000","last_fullsized":"2024-04-26T18:36:27.732940+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:22.258691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.727925+0000","last_change":"2024-04-26T18:33:03.861082+0000","last_active":"2024-04-26T18:36:27.727925+0000","last_peered":"2024-04-26T18:36:27.727925+0000","last_clean":"2024-04-26T18:36:27.727925+0000","last_became_active":"2024-04-26T18:33:03.860661+0000","last_became_peered":"2024-04-26T18:33:03.860661+0000","last_unstale":"2024-04-26T18:36:27.727925+0000","last_undegraded":"2024-04-26T18:36:27.727925+0000","last_fullsized":"2024-04-26T18:36:27.727925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:46.653421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.730335+0000","last_change":"2024-04-26T18:33:06.558268+0000","last_active":"2024-04-26T18:36:27.730335+0000","last_peered":"2024-04-26T18:36:27.730335+0000","last_clean":"2024-04-26T18:36:27.730335+0000","last_became_active":"2024-04-26T18:33:06.557899+0000","last_became_peered":"2024-04-26T18:33:06.557899+0000","last_unstale":"2024-04-26T18:36:27.730335+0000","last_undegraded":"2024-04-26T18:36:27.730335+0000","last_fullsized":"2024-04-26T18:36:27.730335+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:03:47.016288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"92'7","reported_seq":227,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:31.885457+0000","last_change":"2024-04-26T18:33:03.528398+0000","last_active":"2024-04-26T18:36:31.885457+0000","last_peered":"2024-04-26T18:36:31.885457+0000","last_clean":"2024-04-26T18:36:31.885457+0000","last_became_active":"2024-04-26T18:33:03.528008+0000","last_became_peered":"2024-04-26T18:33:03.528008+0000","last_unstale":"2024-04-26T18:36:31.885457+0000","last_undegraded":"2024-04-26T18:36:31.885457+0000","last_fullsized":"2024-04-26T18:36:31.885457+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:27.027873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1287,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":192,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.730411+0000","last_change":"2024-04-26T18:33:06.556035+0000","last_active":"2024-04-26T18:36:27.730411+0000","last_peered":"2024-04-26T18:36:27.730411+0000","last_clean":"2024-04-26T18:36:27.730411+0000","last_became_active":"2024-04-26T18:33:06.555703+0000","last_became_peered":"2024-04-26T18:33:06.555703+0000","last_unstale":"2024-04-26T18:36:27.730411+0000","last_undegraded":"2024-04-26T18:36:27.730411+0000","last_fullsized":"2024-04-26T18:36:27.730411+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:30:02.064205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.828317+0000","last_change":"2024-04-26T18:33:06.556447+0000","last_active":"2024-04-26T18:36:27.828317+0000","last_peered":"2024-04-26T18:36:27.828317+0000","last_clean":"2024-04-26T18:36:27.828317+0000","last_became_active":"2024-04-26T18:33:06.556124+0000","last_became_peered":"2024-04-26T18:33:06.556124+0000","last_unstale":"2024-04-26T18:36:27.828317+0000","last_undegraded":"2024-04-26T18:36:27.828317+0000","last_fullsized":"2024-04-26T18:36:27.828317+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:43:07.915584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"92'6","reported_seq":226,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:32.168593+0000","last_change":"2024-04-26T18:33:03.860440+0000","last_active":"2024-04-26T18:36:32.168593+0000","last_peered":"2024-04-26T18:36:32.168593+0000","last_clean":"2024-04-26T18:36:32.168593+0000","last_became_active":"2024-04-26T18:33:03.860112+0000","last_became_peered":"2024-04-26T18:33:03.860112+0000","last_unstale":"2024-04-26T18:36:32.168593+0000","last_undegraded":"2024-04-26T18:36:32.168593+0000","last_fullsized":"2024-04-26T18:36:32.168593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:19:05.661597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":191,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821540+0000","last_change":"2024-04-26T18:33:06.561688+0000","last_active":"2024-04-26T18:36:27.821540+0000","last_peered":"2024-04-26T18:36:27.821540+0000","last_clean":"2024-04-26T18:36:27.821540+0000","last_became_active":"2024-04-26T18:33:06.561285+0000","last_became_peered":"2024-04-26T18:33:06.561285+0000","last_unstale":"2024-04-26T18:36:27.821540+0000","last_undegraded":"2024-04-26T18:36:27.821540+0000","last_fullsized":"2024-04-26T18:36:27.821540+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:13.272896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.973292+0000","last_change":"2024-04-26T18:33:03.531237+0000","last_active":"2024-04-26T18:36:27.973292+0000","last_peered":"2024-04-26T18:36:27.973292+0000","last_clean":"2024-04-26T18:36:27.973292+0000","last_became_active":"2024-04-26T18:33:03.530843+0000","last_became_peered":"2024-04-26T18:33:03.530843+0000","last_unstale":"2024-04-26T18:36:27.973292+0000","last_undegraded":"2024-04-26T18:36:27.973292+0000","last_fullsized":"2024-04-26T18:36:27.973292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:24.454752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"92'148","reported_seq":406,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:29.835948+0000","last_change":"2024-04-26T18:31:39.402840+0000","last_active":"2024-04-26T18:36:29.835948+0000","last_peered":"2024-04-26T18:36:29.835948+0000","last_clean":"2024-04-26T18:36:29.835948+0000","last_became_active":"2024-04-26T18:31:39.402341+0000","last_became_peered":"2024-04-26T18:31:39.402341+0000","last_unstale":"2024-04-26T18:36:29.835948+0000","last_undegraded":"2024-04-26T18:36:29.835948+0000","last_fullsized":"2024-04-26T18:36:29.835948+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:28:14.522548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:28:14.522548+0000","last_clean_scrub_stamp":"2024-04-26T18:28:14.522548+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:32.052085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972457+0000","last_change":"2024-04-26T18:33:06.557695+0000","last_active":"2024-04-26T18:36:27.972457+0000","last_peered":"2024-04-26T18:36:27.972457+0000","last_clean":"2024-04-26T18:36:27.972457+0000","last_became_active":"2024-04-26T18:33:06.557369+0000","last_became_peered":"2024-04-26T18:33:06.557369+0000","last_unstale":"2024-04-26T18:36:27.972457+0000","last_undegraded":"2024-04-26T18:36:27.972457+0000","last_fullsized":"2024-04-26T18:36:27.972457+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:35.666232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879757+0000","last_change":"2024-04-26T18:33:03.527897+0000","last_active":"2024-04-26T18:36:27.879757+0000","last_peered":"2024-04-26T18:36:27.879757+0000","last_clean":"2024-04-26T18:36:27.879757+0000","last_became_active":"2024-04-26T18:33:03.527345+0000","last_became_peered":"2024-04-26T18:33:03.527345+0000","last_unstale":"2024-04-26T18:36:27.879757+0000","last_undegraded":"2024-04-26T18:36:27.879757+0000","last_fullsized":"2024-04-26T18:36:27.879757+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:31.144555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821580+0000","last_change":"2024-04-26T18:33:03.860572+0000","last_active":"2024-04-26T18:36:27.821580+0000","last_peered":"2024-04-26T18:36:27.821580+0000","last_clean":"2024-04-26T18:36:27.821580+0000","last_became_active":"2024-04-26T18:33:03.860188+0000","last_became_peered":"2024-04-26T18:33:03.860188+0000","last_unstale":"2024-04-26T18:36:27.821580+0000","last_undegraded":"2024-04-26T18:36:27.821580+0000","last_fullsized":"2024-04-26T18:36:27.821580+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:24:34.811572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972827+0000","last_change":"2024-04-26T18:33:06.558075+0000","last_active":"2024-04-26T18:36:27.972827+0000","last_peered":"2024-04-26T18:36:27.972827+0000","last_clean":"2024-04-26T18:36:27.972827+0000","last_became_active":"2024-04-26T18:33:06.557293+0000","last_became_peered":"2024-04-26T18:33:06.557293+0000","last_unstale":"2024-04-26T18:36:27.972827+0000","last_undegraded":"2024-04-26T18:36:27.972827+0000","last_fullsized":"2024-04-26T18:36:27.972827+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:12.635253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"92'107","reported_seq":227,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:30.294924+0000","last_change":"2024-04-26T18:33:03.528196+0000","last_active":"2024-04-26T18:36:30.294924+0000","last_peered":"2024-04-26T18:36:30.294924+0000","last_clean":"2024-04-26T18:36:30.294924+0000","last_became_active":"2024-04-26T18:33:03.527846+0000","last_became_peered":"2024-04-26T18:33:03.527846+0000","last_unstale":"2024-04-26T18:36:30.294924+0000","last_undegraded":"2024-04-26T18:36:30.294924+0000","last_fullsized":"2024-04-26T18:36:30.294924+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:13:46.073405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":195,"num_write_kb":1288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.822230+0000","last_change":"2024-04-26T18:33:06.550260+0000","last_active":"2024-04-26T18:36:27.822230+0000","last_peered":"2024-04-26T18:36:27.822230+0000","last_clean":"2024-04-26T18:36:27.822230+0000","last_became_active":"2024-04-26T18:33:06.549925+0000","last_became_peered":"2024-04-26T18:33:06.549925+0000","last_unstale":"2024-04-26T18:36:27.822230+0000","last_undegraded":"2024-04-26T18:36:27.822230+0000","last_fullsized":"2024-04-26T18:36:27.822230+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:17:01.777381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.973782+0000","last_change":"2024-04-26T18:33:03.876609+0000","last_active":"2024-04-26T18:36:27.973782+0000","last_peered":"2024-04-26T18:36:27.973782+0000","last_clean":"2024-04-26T18:36:27.973782+0000","last_became_active":"2024-04-26T18:33:03.876284+0000","last_became_peered":"2024-04-26T18:33:03.876284+0000","last_unstale":"2024-04-26T18:36:27.973782+0000","last_undegraded":"2024-04-26T18:36:27.973782+0000","last_fullsized":"2024-04-26T18:36:27.973782+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:22.995000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.975703+0000","last_change":"2024-04-26T18:33:06.558735+0000","last_active":"2024-04-26T18:36:27.975703+0000","last_peered":"2024-04-26T18:36:27.975703+0000","last_clean":"2024-04-26T18:36:27.975703+0000","last_became_active":"2024-04-26T18:33:06.558416+0000","last_became_peered":"2024-04-26T18:33:06.558416+0000","last_unstale":"2024-04-26T18:36:27.975703+0000","last_undegraded":"2024-04-26T18:36:27.975703+0000","last_fullsized":"2024-04-26T18:36:27.975703+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:27.627055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972536+0000","last_change":"2024-04-26T18:33:03.861073+0000","last_active":"2024-04-26T18:36:27.972536+0000","last_peered":"2024-04-26T18:36:27.972536+0000","last_clean":"2024-04-26T18:36:27.972536+0000","last_became_active":"2024-04-26T18:33:03.860661+0000","last_became_peered":"2024-04-26T18:33:03.860661+0000","last_unstale":"2024-04-26T18:36:27.972536+0000","last_undegraded":"2024-04-26T18:36:27.972536+0000","last_fullsized":"2024-04-26T18:36:27.972536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:19.429969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821326+0000","last_change":"2024-04-26T18:33:06.553160+0000","last_active":"2024-04-26T18:36:27.821326+0000","last_peered":"2024-04-26T18:36:27.821326+0000","last_clean":"2024-04-26T18:36:27.821326+0000","last_became_active":"2024-04-26T18:33:06.552791+0000","last_became_peered":"2024-04-26T18:33:06.552791+0000","last_unstale":"2024-04-26T18:36:27.821326+0000","last_undegraded":"2024-04-26T18:36:27.821326+0000","last_fullsized":"2024-04-26T18:36:27.821326+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:31.675069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821250+0000","last_change":"2024-04-26T18:33:03.524443+0000","last_active":"2024-04-26T18:36:27.821250+0000","last_peered":"2024-04-26T18:36:27.821250+0000","last_clean":"2024-04-26T18:36:27.821250+0000","last_became_active":"2024-04-26T18:33:03.524137+0000","last_became_peered":"2024-04-26T18:33:03.524137+0000","last_unstale":"2024-04-26T18:36:27.821250+0000","last_undegraded":"2024-04-26T18:36:27.821250+0000","last_fullsized":"2024-04-26T18:36:27.821250+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:43.021778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.732498+0000","last_change":"2024-04-26T18:33:06.553698+0000","last_active":"2024-04-26T18:36:27.732498+0000","last_peered":"2024-04-26T18:36:27.732498+0000","last_clean":"2024-04-26T18:36:27.732498+0000","last_became_active":"2024-04-26T18:33:06.552995+0000","last_became_peered":"2024-04-26T18:33:06.552995+0000","last_unstale":"2024-04-26T18:36:27.732498+0000","last_undegraded":"2024-04-26T18:36:27.732498+0000","last_fullsized":"2024-04-26T18:36:27.732498+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:27.135435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"92'4","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.732832+0000","last_change":"2024-04-26T18:33:51.656557+0000","last_active":"2024-04-26T18:36:27.732832+0000","last_peered":"2024-04-26T18:36:27.732832+0000","last_clean":"2024-04-26T18:36:27.732832+0000","last_became_active":"2024-04-26T18:33:51.652009+0000","last_became_peered":"2024-04-26T18:33:51.652009+0000","last_unstale":"2024-04-26T18:36:27.732832+0000","last_undegraded":"2024-04-26T18:36:27.732832+0000","last_fullsized":"2024-04-26T18:36:27.732832+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:05.047482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821858+0000","last_change":"2024-04-26T18:33:06.553596+0000","last_active":"2024-04-26T18:36:27.821858+0000","last_peered":"2024-04-26T18:36:27.821858+0000","last_clean":"2024-04-26T18:36:27.821858+0000","last_became_active":"2024-04-26T18:33:06.553284+0000","last_became_peered":"2024-04-26T18:33:06.553284+0000","last_unstale":"2024-04-26T18:36:27.821858+0000","last_undegraded":"2024-04-26T18:36:27.821858+0000","last_fullsized":"2024-04-26T18:36:27.821858+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:24.245437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821437+0000","last_change":"2024-04-26T18:33:51.865849+0000","last_active":"2024-04-26T18:36:27.821437+0000","last_peered":"2024-04-26T18:36:27.821437+0000","last_clean":"2024-04-26T18:36:27.821437+0000","last_became_active":"2024-04-26T18:33:51.861408+0000","last_became_peered":"2024-04-26T18:33:51.861408+0000","last_unstale":"2024-04-26T18:36:27.821437+0000","last_undegraded":"2024-04-26T18:36:27.821437+0000","last_fullsized":"2024-04-26T18:36:27.821437+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:12.074699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879862+0000","last_change":"2024-04-26T18:33:06.566899+0000","last_active":"2024-04-26T18:36:27.879862+0000","last_peered":"2024-04-26T18:36:27.879862+0000","last_clean":"2024-04-26T18:36:27.879862+0000","last_became_active":"2024-04-26T18:33:06.566548+0000","last_became_peered":"2024-04-26T18:33:06.566548+0000","last_unstale":"2024-04-26T18:36:27.879862+0000","last_undegraded":"2024-04-26T18:36:27.879862+0000","last_fullsized":"2024-04-26T18:36:27.879862+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:07.751063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'5","reported_seq":225,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:32.205619+0000","last_change":"2024-04-26T18:33:03.876589+0000","last_active":"2024-04-26T18:36:32.205619+0000","last_peered":"2024-04-26T18:36:32.205619+0000","last_clean":"2024-04-26T18:36:32.205619+0000","last_became_active":"2024-04-26T18:33:03.876262+0000","last_became_peered":"2024-04-26T18:33:03.876262+0000","last_unstale":"2024-04-26T18:36:32.205619+0000","last_undegraded":"2024-04-26T18:36:32.205619+0000","last_fullsized":"2024-04-26T18:36:32.205619+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:04.959745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879892+0000","last_change":"2024-04-26T18:33:06.561848+0000","last_active":"2024-04-26T18:36:27.879892+0000","last_peered":"2024-04-26T18:36:27.879892+0000","last_clean":"2024-04-26T18:36:27.879892+0000","last_became_active":"2024-04-26T18:33:06.561514+0000","last_became_peered":"2024-04-26T18:33:06.561514+0000","last_unstale":"2024-04-26T18:36:27.879892+0000","last_undegraded":"2024-04-26T18:36:27.879892+0000","last_fullsized":"2024-04-26T18:36:27.879892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:46.326261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"92'67","reported_seq":126,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:29.944464+0000","last_change":"2024-04-26T18:33:03.527237+0000","last_active":"2024-04-26T18:36:29.944464+0000","last_peered":"2024-04-26T18:36:29.944464+0000","last_clean":"2024-04-26T18:36:29.944464+0000","last_became_active":"2024-04-26T18:33:03.526618+0000","last_became_peered":"2024-04-26T18:33:03.526618+0000","last_unstale":"2024-04-26T18:36:29.944464+0000","last_undegraded":"2024-04-26T18:36:29.944464+0000","last_fullsized":"2024-04-26T18:36:29.944464+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:28.232597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879697+0000","last_change":"2024-04-26T18:33:06.555276+0000","last_active":"2024-04-26T18:36:27.879697+0000","last_peered":"2024-04-26T18:36:27.879697+0000","last_clean":"2024-04-26T18:36:27.879697+0000","last_became_active":"2024-04-26T18:33:06.554889+0000","last_became_peered":"2024-04-26T18:33:06.554889+0000","last_unstale":"2024-04-26T18:36:27.879697+0000","last_undegraded":"2024-04-26T18:36:27.879697+0000","last_fullsized":"2024-04-26T18:36:27.879697+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:33:13.614662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.973156+0000","last_change":"2024-04-26T18:33:03.527108+0000","last_active":"2024-04-26T18:36:27.973156+0000","last_peered":"2024-04-26T18:36:27.973156+0000","last_clean":"2024-04-26T18:36:27.973156+0000","last_became_active":"2024-04-26T18:33:03.526648+0000","last_became_peered":"2024-04-26T18:33:03.526648+0000","last_unstale":"2024-04-26T18:36:27.973156+0000","last_undegraded":"2024-04-26T18:36:27.973156+0000","last_fullsized":"2024-04-26T18:36:27.973156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:02.506084+0000","last_clean_scrub_stamp":"2024-04-26T18:33:02.506084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:40.915022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.879890+0000","last_change":"2024-04-26T18:33:06.551605+0000","last_active":"2024-04-26T18:36:27.879890+0000","last_peered":"2024-04-26T18:36:27.879890+0000","last_clean":"2024-04-26T18:36:27.879890+0000","last_became_active":"2024-04-26T18:33:06.550772+0000","last_became_peered":"2024-04-26T18:33:06.550772+0000","last_unstale":"2024-04-26T18:36:27.879890+0000","last_undegraded":"2024-04-26T18:36:27.879890+0000","last_fullsized":"2024-04-26T18:36:27.879890+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:33.124989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.732576+0000","last_change":"2024-04-26T18:33:06.558971+0000","last_active":"2024-04-26T18:36:27.732576+0000","last_peered":"2024-04-26T18:36:27.732576+0000","last_clean":"2024-04-26T18:36:27.732576+0000","last_became_active":"2024-04-26T18:33:06.558594+0000","last_became_peered":"2024-04-26T18:33:06.558594+0000","last_unstale":"2024-04-26T18:36:27.732576+0000","last_undegraded":"2024-04-26T18:36:27.732576+0000","last_fullsized":"2024-04-26T18:36:27.732576+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:12.974472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.976355+0000","last_change":"2024-04-26T18:33:06.558928+0000","last_active":"2024-04-26T18:36:27.976355+0000","last_peered":"2024-04-26T18:36:27.976355+0000","last_clean":"2024-04-26T18:36:27.976355+0000","last_became_active":"2024-04-26T18:33:06.558348+0000","last_became_peered":"2024-04-26T18:33:06.558348+0000","last_unstale":"2024-04-26T18:36:27.976355+0000","last_undegraded":"2024-04-26T18:36:27.976355+0000","last_fullsized":"2024-04-26T18:36:27.976355+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:04.266404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.976230+0000","last_change":"2024-04-26T18:33:06.555182+0000","last_active":"2024-04-26T18:36:27.976230+0000","last_peered":"2024-04-26T18:36:27.976230+0000","last_clean":"2024-04-26T18:36:27.976230+0000","last_became_active":"2024-04-26T18:33:06.554830+0000","last_became_peered":"2024-04-26T18:33:06.554830+0000","last_unstale":"2024-04-26T18:36:27.976230+0000","last_undegraded":"2024-04-26T18:36:27.976230+0000","last_fullsized":"2024-04-26T18:36:27.976230+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:48.841634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.975313+0000","last_change":"2024-04-26T18:33:06.558962+0000","last_active":"2024-04-26T18:36:27.975313+0000","last_peered":"2024-04-26T18:36:27.975313+0000","last_clean":"2024-04-26T18:36:27.975313+0000","last_became_active":"2024-04-26T18:33:06.557995+0000","last_became_peered":"2024-04-26T18:33:06.557995+0000","last_unstale":"2024-04-26T18:36:27.975313+0000","last_undegraded":"2024-04-26T18:36:27.975313+0000","last_fullsized":"2024-04-26T18:36:27.975313+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:54.207205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.973002+0000","last_change":"2024-04-26T18:33:06.558055+0000","last_active":"2024-04-26T18:36:27.973002+0000","last_peered":"2024-04-26T18:36:27.973002+0000","last_clean":"2024-04-26T18:36:27.973002+0000","last_became_active":"2024-04-26T18:33:06.557299+0000","last_became_peered":"2024-04-26T18:33:06.557299+0000","last_unstale":"2024-04-26T18:36:27.973002+0000","last_undegraded":"2024-04-26T18:36:27.973002+0000","last_fullsized":"2024-04-26T18:36:27.973002+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:21.143017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.732894+0000","last_change":"2024-04-26T18:33:06.558680+0000","last_active":"2024-04-26T18:36:27.732894+0000","last_peered":"2024-04-26T18:36:27.732894+0000","last_clean":"2024-04-26T18:36:27.732894+0000","last_became_active":"2024-04-26T18:33:06.558139+0000","last_became_peered":"2024-04-26T18:33:06.558139+0000","last_unstale":"2024-04-26T18:36:27.732894+0000","last_undegraded":"2024-04-26T18:36:27.732894+0000","last_fullsized":"2024-04-26T18:36:27.732894+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:31.511770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.976583+0000","last_change":"2024-04-26T18:33:06.563832+0000","last_active":"2024-04-26T18:36:27.976583+0000","last_peered":"2024-04-26T18:36:27.976583+0000","last_clean":"2024-04-26T18:36:27.976583+0000","last_became_active":"2024-04-26T18:33:06.562193+0000","last_became_peered":"2024-04-26T18:33:06.562193+0000","last_unstale":"2024-04-26T18:36:27.976583+0000","last_undegraded":"2024-04-26T18:36:27.976583+0000","last_fullsized":"2024-04-26T18:36:27.976583+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:35.384552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.822222+0000","last_change":"2024-04-26T18:33:06.562368+0000","last_active":"2024-04-26T18:36:27.822222+0000","last_peered":"2024-04-26T18:36:27.822222+0000","last_clean":"2024-04-26T18:36:27.822222+0000","last_became_active":"2024-04-26T18:33:06.562024+0000","last_became_peered":"2024-04-26T18:33:06.562024+0000","last_unstale":"2024-04-26T18:36:27.822222+0000","last_undegraded":"2024-04-26T18:36:27.822222+0000","last_fullsized":"2024-04-26T18:36:27.822222+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:01.562885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.828141+0000","last_change":"2024-04-26T18:33:06.560953+0000","last_active":"2024-04-26T18:36:27.828141+0000","last_peered":"2024-04-26T18:36:27.828141+0000","last_clean":"2024-04-26T18:36:27.828141+0000","last_became_active":"2024-04-26T18:33:06.560593+0000","last_became_peered":"2024-04-26T18:33:06.560593+0000","last_unstale":"2024-04-26T18:36:27.828141+0000","last_undegraded":"2024-04-26T18:36:27.828141+0000","last_fullsized":"2024-04-26T18:36:27.828141+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:18.168564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.821227+0000","last_change":"2024-04-26T18:33:06.555389+0000","last_active":"2024-04-26T18:36:27.821227+0000","last_peered":"2024-04-26T18:36:27.821227+0000","last_clean":"2024-04-26T18:36:27.821227+0000","last_became_active":"2024-04-26T18:33:06.555055+0000","last_became_peered":"2024-04-26T18:33:06.555055+0000","last_unstale":"2024-04-26T18:36:27.821227+0000","last_undegraded":"2024-04-26T18:36:27.821227+0000","last_fullsized":"2024-04-26T18:36:27.821227+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:32.802687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972845+0000","last_change":"2024-04-26T18:33:06.563791+0000","last_active":"2024-04-26T18:36:27.972845+0000","last_peered":"2024-04-26T18:36:27.972845+0000","last_clean":"2024-04-26T18:36:27.972845+0000","last_became_active":"2024-04-26T18:33:06.561959+0000","last_became_peered":"2024-04-26T18:33:06.561959+0000","last_unstale":"2024-04-26T18:36:27.972845+0000","last_undegraded":"2024-04-26T18:36:27.972845+0000","last_fullsized":"2024-04-26T18:36:27.972845+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:35.280202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.972808+0000","last_change":"2024-04-26T18:33:06.554270+0000","last_active":"2024-04-26T18:36:27.972808+0000","last_peered":"2024-04-26T18:36:27.972808+0000","last_clean":"2024-04-26T18:36:27.972808+0000","last_became_active":"2024-04-26T18:33:06.553931+0000","last_became_peered":"2024-04-26T18:33:06.553931+0000","last_unstale":"2024-04-26T18:36:27.972808+0000","last_undegraded":"2024-04-26T18:36:27.972808+0000","last_fullsized":"2024-04-26T18:36:27.972808+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:40.587824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-26T18:36:27.732694+0000","last_change":"2024-04-26T18:33:06.556766+0000","last_active":"2024-04-26T18:36:27.732694+0000","last_peered":"2024-04-26T18:36:27.732694+0000","last_clean":"2024-04-26T18:36:27.732694+0000","last_became_active":"2024-04-26T18:33:06.556361+0000","last_became_peered":"2024-04-26T18:33:06.556361+0000","last_unstale":"2024-04-26T18:36:27.732694+0000","last_undegraded":"2024-04-26T18:36:27.732694+0000","last_fullsized":"2024-04-26T18:36:27.732694+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:33:05.524732+0000","last_clean_scrub_stamp":"2024-04-26T18:33:05.524732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:10.101747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":106677,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":800273,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":2286,"num_read_kb":1362,"num_write":510,"num_write_kb":2385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":811008,"data_stored":2400819,"data_compressed":103473,"data_compressed_allocated":135168,"data_compressed_original":2101248,"omap_allocated":0,"internal_metadata":0},"log_size":386,"ondisk_log_size":386,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351033,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1011712,"data_stored":492367,"data_compressed":2887,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612670,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32368,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712784,"statfs":{"total":95995035648,"available":95961890816,"internally_reserved":0,"allocated":1220608,"data_stored":1482387,"data_compressed":53648,"data_compressed_allocated":69632,"data_compressed_original":905216,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776196,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1056768,"data_stored":885491,"data_compressed":22176,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037832,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1040384,"data_stored":885175,"data_compressed":22176,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299470,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32232,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712920,"statfs":{"total":95995035648,"available":95962030080,"internally_reserved":0,"allocated":1081344,"data_stored":1086793,"data_compressed":38446,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462995,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1015808,"data_stored":492691,"data_compressed":2887,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36400,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708752,"statfs":{"total":95995035648,"available":95957762048,"internally_reserved":0,"allocated":1089536,"data_stored":563994,"data_compressed":2887,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738480,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":493331,"data_compressed":2887,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411431,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":564438,"data_compressed":2887,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149794,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36420,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708732,"statfs":{"total":95995035648,"available":95957741568,"internally_reserved":0,"allocated":1101824,"data_stored":1213265,"data_compressed":37378,"data_compressed_allocated":49152,"data_compressed_original":708608,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888157,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1024000,"data_stored":492916,"data_compressed":2887,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724630,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28136,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717016,"statfs":{"total":95995035648,"available":95966224384,"internally_reserved":0,"allocated":1138688,"data_stored":1413613,"data_compressed":53648,"data_compressed_allocated":69632,"data_compressed_original":905216,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35559,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":72841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":73285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":721878,"data_compressed":34491,"data_compressed_allocated":45056,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":331975,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394022,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":400749,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T18:36:39.153 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:36:39.391 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:36:41.094 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:40 smithi080 ceph-mon[29135]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-04-26T18:36:41.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.097+0000 7fa8e22c5700 1 -- 172.21.15.80:0/4205979026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8dc10b630 msgr2=0x7fa8dc10ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:41.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.097+0000 7fa8e22c5700 1 --2- 172.21.15.80:0/4205979026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8dc10b630 0x7fa8dc10ba10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009990 tx=0x7fa8d0009ca0 comp rx=0 tx=0).stop 2024-04-26T18:36:41.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.097+0000 7fa8e22c5700 1 -- 172.21.15.80:0/4205979026 shutdown_connections 2024-04-26T18:36:41.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.097+0000 7fa8e22c5700 1 --2- 172.21.15.80:0/4205979026 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8dc105ff0 0x7fa8dc112500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:41.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.097+0000 7fa8e22c5700 1 --2- 172.21.15.80:0/4205979026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8dc10b630 0x7fa8dc10ba10 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:41.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.097+0000 7fa8e22c5700 1 --2- 172.21.15.80:0/4205979026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8dc105630 0x7fa8dc105ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:41.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.097+0000 7fa8e22c5700 1 -- 172.21.15.80:0/4205979026 >> 172.21.15.80:0/4205979026 conn(0x7fa8dc101160 msgr2=0x7fa8dc103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:41.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.097+0000 7fa8e22c5700 1 -- 172.21.15.80:0/4205979026 shutdown_connections 2024-04-26T18:36:41.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.097+0000 7fa8e22c5700 1 -- 172.21.15.80:0/4205979026 wait complete. 2024-04-26T18:36:41.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.097+0000 7fa8e22c5700 1 Processor -- start 2024-04-26T18:36:41.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.097+0000 7fa8e22c5700 1 -- start start 2024-04-26T18:36:41.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.098+0000 7fa8e22c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8dc105630 0x7fa8dc1a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:41.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.098+0000 7fa8e22c5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8dc105ff0 0x7fa8dc1a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:41.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.098+0000 7fa8e22c5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8dc10b630 0x7fa8dc19ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:41.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.098+0000 7fa8e22c5700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc115810 con 0x7fa8dc10b630 2024-04-26T18:36:41.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.098+0000 7fa8e22c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc115690 con 0x7fa8dc105630 2024-04-26T18:36:41.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.098+0000 7fa8e22c5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc115990 con 0x7fa8dc105ff0 2024-04-26T18:36:41.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.098+0000 7fa8e0862700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8dc10b630 0x7fa8dc19ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:41.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.098+0000 7fa8e0862700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8dc10b630 0x7fa8dc19ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34894/0 (socket says 172.21.15.80:34894) 2024-04-26T18:36:41.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.098+0000 7fa8e0862700 1 -- 172.21.15.80:0/1663491282 learned_addr learned my addr 172.21.15.80:0/1663491282 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:41.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.098+0000 7fa8dbfff700 1 --2- 172.21.15.80:0/1663491282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8dc105630 0x7fa8dc1a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:41.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.098+0000 7fa8db7fe700 1 --2- 172.21.15.80:0/1663491282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8dc105ff0 0x7fa8dc1a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:41.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.098+0000 7fa8e0862700 1 -- 172.21.15.80:0/1663491282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8dc105ff0 msgr2=0x7fa8dc1a1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:41.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.098+0000 7fa8e0862700 1 --2- 172.21.15.80:0/1663491282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8dc105ff0 0x7fa8dc1a1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:41.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.098+0000 7fa8e0862700 1 -- 172.21.15.80:0/1663491282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8dc105630 msgr2=0x7fa8dc1a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:41.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.098+0000 7fa8e0862700 1 --2- 172.21.15.80:0/1663491282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8dc105630 0x7fa8dc1a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:41.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.098+0000 7fa8e0862700 1 -- 172.21.15.80:0/1663491282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8dc19c1d0 con 0x7fa8dc10b630 2024-04-26T18:36:41.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.098+0000 7fa8e0862700 1 --2- 172.21.15.80:0/1663491282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8dc10b630 0x7fa8dc19ba70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4007ee0 tx=0x7fa8d400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:41.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.099+0000 7fa8d97fa700 1 -- 172.21.15.80:0/1663491282 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d400dbd0 con 0x7fa8dc10b630 2024-04-26T18:36:41.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.099+0000 7fa8d97fa700 1 -- 172.21.15.80:0/1663491282 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8d400dd70 con 0x7fa8dc10b630 2024-04-26T18:36:41.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.099+0000 7fa8d97fa700 1 -- 172.21.15.80:0/1663491282 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4005990 con 0x7fa8dc10b630 2024-04-26T18:36:41.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.099+0000 7fa8e22c5700 1 -- 172.21.15.80:0/1663491282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8dc19c4c0 con 0x7fa8dc10b630 2024-04-26T18:36:41.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.099+0000 7fa8e22c5700 1 -- 172.21.15.80:0/1663491282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8dc1a8780 con 0x7fa8dc10b630 2024-04-26T18:36:41.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.100+0000 7fa8e22c5700 1 -- 172.21.15.80:0/1663491282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8dc06a110 con 0x7fa8dc10b630 2024-04-26T18:36:41.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.101+0000 7fa8d97fa700 1 -- 172.21.15.80:0/1663491282 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 24) ==== 138873+0+0 (secure 0 0 0) 0x7fa8d401a020 con 0x7fa8dc10b630 2024-04-26T18:36:41.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.102+0000 7fa8d97fa700 1 --2- 172.21.15.80:0/1663491282 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fa8c40a3ed0 0x7fa8c40a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:41.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.102+0000 7fa8dbfff700 1 --2- 172.21.15.80:0/1663491282 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fa8c40a3ed0 0x7fa8c40a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:41.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.102+0000 7fa8d97fa700 1 -- 172.21.15.80:0/1663491282 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fa8d40d01f0 con 0x7fa8dc10b630 2024-04-26T18:36:41.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.102+0000 7fa8dbfff700 1 --2- 172.21.15.80:0/1663491282 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fa8c40a3ed0 0x7fa8c40a6390 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa8d000b5c0 tx=0x7fa8d0005960 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:41.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.106+0000 7fa8d97fa700 1 -- 172.21.15.80:0/1663491282 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa8d4010070 con 0x7fa8dc10b630 2024-04-26T18:36:41.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:40 smithi192 ceph-mon[32842]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-04-26T18:36:41.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:40 smithi082 ceph-mon[32808]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-04-26T18:36:41.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.349+0000 7fa8e22c5700 1 -- 172.21.15.80:0/1663491282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8dc02e490 con 0x7fa8dc10b630 2024-04-26T18:36:41.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.350+0000 7fa8d97fa700 1 -- 172.21.15.80:0/1663491282 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11918 (secure 0 0 0) 0x7fa8d409c670 con 0x7fa8dc10b630 2024-04-26T18:36:41.350 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:36:41.350 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1967550873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1967550873},{"type":"v1","addr":"172.21.15.80:6835","nonce":1967550873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/559541830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":559541830},{"type":"v1","addr":"172.21.15.80:6837","nonce":559541830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T18:33:08.347399+0000","modified":"2024-04-26T18:36:26.401600+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24434,"mds_1":24421,"mds_2":24404,"mds_3":24400,"mds_4":24394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14577":{"gid":14577,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6839/2137993298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":2137993298},{"type":"v1","addr":"172.21.15.80:6839","nonce":2137993298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6841/1544670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1544670},{"type":"v1","addr":"172.21.15.80:6841","nonce":1544670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24371":{"gid":24371,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/3564539039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3564539039},{"type":"v1","addr":"172.21.15.82:6833","nonce":3564539039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24379":{"gid":24379,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/572065563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":572065563},{"type":"v1","addr":"172.21.15.82:6835","nonce":572065563}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.192:6835/719058020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":719058020},{"type":"v1","addr":"172.21.15.192:6835","nonce":719058020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.192:6837/2361996920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2361996920},{"type":"v1","addr":"172.21.15.192:6837","nonce":2361996920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.82:6837/2084055551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2084055551},{"type":"v1","addr":"172.21.15.82:6837","nonce":2084055551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6839/2735406056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":2735406056},{"type":"v1","addr":"172.21.15.192:6839","nonce":2735406056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.82:6839/1482576497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1482576497},{"type":"v1","addr":"172.21.15.82:6839","nonce":1482576497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24434,"qdb_cluster":[24421,24400,24394,24404,24434]},"id":1}]} 2024-04-26T18:36:41.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.352+0000 7fa8e22c5700 1 -- 172.21.15.80:0/1663491282 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fa8c40a3ed0 msgr2=0x7fa8c40a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:41.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.352+0000 7fa8e22c5700 1 --2- 172.21.15.80:0/1663491282 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fa8c40a3ed0 0x7fa8c40a6390 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa8d000b5c0 tx=0x7fa8d0005960 comp rx=0 tx=0).stop 2024-04-26T18:36:41.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.352+0000 7fa8e22c5700 1 -- 172.21.15.80:0/1663491282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8dc10b630 msgr2=0x7fa8dc19ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:41.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.352+0000 7fa8e22c5700 1 --2- 172.21.15.80:0/1663491282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8dc10b630 0x7fa8dc19ba70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4007ee0 tx=0x7fa8d400d3b0 comp rx=0 tx=0).stop 2024-04-26T18:36:41.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.352+0000 7fa8e22c5700 1 -- 172.21.15.80:0/1663491282 shutdown_connections 2024-04-26T18:36:41.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.352+0000 7fa8e22c5700 1 --2- 172.21.15.80:0/1663491282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8dc10b630 0x7fa8dc19ba70 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:41.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.352+0000 7fa8e22c5700 1 --2- 172.21.15.80:0/1663491282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8dc105630 0x7fa8dc1a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:41.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.352+0000 7fa8e22c5700 1 --2- 172.21.15.80:0/1663491282 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fa8c40a3ed0 0x7fa8c40a6390 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:41.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.352+0000 7fa8e22c5700 1 --2- 172.21.15.80:0/1663491282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8dc105ff0 0x7fa8dc1a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:41.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.352+0000 7fa8e22c5700 1 -- 172.21.15.80:0/1663491282 >> 172.21.15.80:0/1663491282 conn(0x7fa8dc101160 msgr2=0x7fa8dc101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:41.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.352+0000 7fa8e22c5700 1 -- 172.21.15.80:0/1663491282 shutdown_connections 2024-04-26T18:36:41.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:41.352+0000 7fa8e22c5700 1 -- 172.21.15.80:0/1663491282 wait complete. 2024-04-26T18:36:41.354 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 27 2024-04-26T18:36:41.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:41 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1663491282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:36:42.052 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:36:42.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:41 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1663491282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:36:42.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:41 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1663491282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:36:42.289 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:36:42.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:42 smithi080 ceph-mon[29135]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-04-26T18:36:43.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:42 smithi192 ceph-mon[32842]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-04-26T18:36:43.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:42 smithi082 ceph-mon[32808]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-04-26T18:36:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.515+0000 7f4674178640 1 -- 172.21.15.80:0/1658224457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f466c105320 msgr2=0x7f466c1057a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.515+0000 7f4674178640 1 --2- 172.21.15.80:0/1658224457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f466c105320 0x7f466c1057a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4664009ca0 tx=0x7f466402a8c0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.515+0000 7f4674178640 1 -- 172.21.15.80:0/1658224457 shutdown_connections 2024-04-26T18:36:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.515+0000 7f4674178640 1 --2- 172.21.15.80:0/1658224457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f466c105320 0x7f466c1057a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.515+0000 7f4674178640 1 --2- 172.21.15.80:0/1658224457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f466c06b6a0 0x7f466c06bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.515+0000 7f4674178640 1 --2- 172.21.15.80:0/1658224457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f466c107980 0x7f466c06b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.515+0000 7f4674178640 1 -- 172.21.15.80:0/1658224457 >> 172.21.15.80:0/1658224457 conn(0x7f466c077630 msgr2=0x7f466c077a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.515+0000 7f4674178640 1 -- 172.21.15.80:0/1658224457 shutdown_connections 2024-04-26T18:36:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.515+0000 7f4674178640 1 -- 172.21.15.80:0/1658224457 wait complete. 2024-04-26T18:36:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.515+0000 7f4674178640 1 Processor -- start 2024-04-26T18:36:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.515+0000 7f4674178640 1 -- start start 2024-04-26T18:36:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.516+0000 7f4674178640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f466c06b6a0 0x7f466c19f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.516+0000 7f4674178640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f466c105320 0x7f466c19fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.516+0000 7f4674178640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f466c107980 0x7f466c1a3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.516+0000 7f4674178640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f466c119110 con 0x7f466c105320 2024-04-26T18:36:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.516+0000 7f4674178640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f466c118f90 con 0x7f466c06b6a0 2024-04-26T18:36:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.516+0000 7f4674178640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f466c119290 con 0x7f466c107980 2024-04-26T18:36:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.516+0000 7f4671713640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f466c105320 0x7f466c19fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.516+0000 7f4671f14640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f466c06b6a0 0x7f466c19f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.516+0000 7f4671f14640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f466c06b6a0 0x7f466c19f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:34298/0 (socket says 172.21.15.80:34298) 2024-04-26T18:36:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.516+0000 7f4671713640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f466c105320 0x7f466c19fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55784/0 (socket says 172.21.15.80:55784) 2024-04-26T18:36:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.516+0000 7f4671f14640 1 -- 172.21.15.80:0/601939317 learned_addr learned my addr 172.21.15.80:0/601939317 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.516+0000 7f4672715640 1 --2- 172.21.15.80:0/601939317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f466c107980 0x7f466c1a3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.516+0000 7f4671f14640 1 -- 172.21.15.80:0/601939317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f466c107980 msgr2=0x7f466c1a3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.516+0000 7f4671f14640 1 --2- 172.21.15.80:0/601939317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f466c107980 0x7f466c1a3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.516+0000 7f4671f14640 1 -- 172.21.15.80:0/601939317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f466c105320 msgr2=0x7f466c19fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.516+0000 7f4671f14640 1 --2- 172.21.15.80:0/601939317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f466c105320 0x7f466c19fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.516+0000 7f4671f14640 1 -- 172.21.15.80:0/601939317 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466c1a4500 con 0x7f466c06b6a0 2024-04-26T18:36:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.516+0000 7f4671713640 1 --2- 172.21.15.80:0/601939317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f466c105320 0x7f466c19fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:36:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.516+0000 7f4671f14640 1 --2- 172.21.15.80:0/601939317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f466c06b6a0 0x7f466c19f510 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f466800e9f0 tx=0x7f466800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.516+0000 7f4662ffd640 1 -- 172.21.15.80:0/601939317 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466800cd80 con 0x7f466c06b6a0 2024-04-26T18:36:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.516+0000 7f4674178640 1 -- 172.21.15.80:0/601939317 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f466c1a47f0 con 0x7f466c06b6a0 2024-04-26T18:36:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.517+0000 7f4662ffd640 1 -- 172.21.15.80:0/601939317 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46680054d0 con 0x7f466c06b6a0 2024-04-26T18:36:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.517+0000 7f4662ffd640 1 -- 172.21.15.80:0/601939317 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668010690 con 0x7f466c06b6a0 2024-04-26T18:36:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.517+0000 7f4674178640 1 -- 172.21.15.80:0/601939317 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f466c1ac080 con 0x7f466c06b6a0 2024-04-26T18:36:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.519+0000 7f4662ffd640 1 -- 172.21.15.80:0/601939317 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 24) ==== 138873+0+0 (secure 0 0 0) 0x7f4668004e90 con 0x7f466c06b6a0 2024-04-26T18:36:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.519+0000 7f4676f6d740 1 Processor -- start 2024-04-26T18:36:43.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.519+0000 7f4676f6d740 1 -- start start 2024-04-26T18:36:43.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.519+0000 7f4676f6d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556d47545f00 0x556d475462e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:43.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.519+0000 7f4676f6d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d47546820 0x556d47550ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:43.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.519+0000 7f4676f6d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d475510e0 0x556d475534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:43.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.519+0000 7f4676f6d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x556d474ac460 con 0x556d475510e0 2024-04-26T18:36:43.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.519+0000 7f4676f6d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556d47466590 con 0x556d47546820 2024-04-26T18:36:43.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.519+0000 7f4676f6d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x556d474a8420 con 0x556d47545f00 2024-04-26T18:36:43.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.519+0000 7f4662ffd640 1 --2- 172.21.15.80:0/601939317 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f46580a3ee0 0x7f46580a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:43.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.520+0000 7f4671713640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d475510e0 0x556d475534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:43.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.520+0000 7f4671f14640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d47546820 0x556d47550ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:43.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.520+0000 7f4671713640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d475510e0 0x556d475534d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55798/0 (socket says 172.21.15.80:55798) 2024-04-26T18:36:43.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.520+0000 7f4671713640 1 -- 172.21.15.80:0/4048079054 learned_addr learned my addr 172.21.15.80:0/4048079054 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.520+0000 7f4672715640 1 --2- 172.21.15.80:0/4048079054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556d47545f00 0x556d475462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.520+0000 7f4672715640 1 --2- 172.21.15.80:0/601939317 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f46580a3ee0 0x7f46580a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.520+0000 7f4662ffd640 1 -- 172.21.15.80:0/601939317 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f46680d0f00 con 0x7f466c06b6a0 2024-04-26T18:36:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.520+0000 7f4671713640 1 -- 172.21.15.80:0/4048079054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556d47545f00 msgr2=0x556d475462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.520+0000 7f4671713640 1 --2- 172.21.15.80:0/4048079054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556d47545f00 0x556d475462e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.520+0000 7f4671713640 1 -- 172.21.15.80:0/4048079054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d47546820 msgr2=0x556d47550ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.520+0000 7f4671713640 1 --2- 172.21.15.80:0/4048079054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d47546820 0x556d47550ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.520+0000 7f4671713640 1 -- 172.21.15.80:0/4048079054 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d474730d0 con 0x556d475510e0 2024-04-26T18:36:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.520+0000 7f4671713640 1 --2- 172.21.15.80:0/4048079054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d475510e0 0x556d475534d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f465c0114f0 tx=0x7f465c0119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fab5c86f7e38ed0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.520+0000 7f4672715640 1 --2- 172.21.15.80:0/601939317 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f46580a3ee0 0x7f46580a63a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4664006010 tx=0x7f46640095c0 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.520+0000 7f4657fff640 1 -- 172.21.15.80:0/4048079054 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c01e070 con 0x556d475510e0 2024-04-26T18:36:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.520+0000 7f4657fff640 1 -- 172.21.15.80:0/4048079054 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f465c00fa70 con 0x556d475510e0 2024-04-26T18:36:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.520+0000 7f4657fff640 1 -- 172.21.15.80:0/4048079054 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c019b00 con 0x556d475510e0 2024-04-26T18:36:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.521+0000 7f4676f6d740 1 -- 172.21.15.80:0/4048079054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d475510e0 msgr2=0x556d475534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.521+0000 7f4676f6d740 1 --2- 172.21.15.80:0/4048079054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d475510e0 0x556d475534d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f465c0114f0 tx=0x7f465c0119b0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.521+0000 7f4676f6d740 1 -- 172.21.15.80:0/4048079054 shutdown_connections 2024-04-26T18:36:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.521+0000 7f4676f6d740 1 --2- 172.21.15.80:0/4048079054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d475510e0 0x556d475534d0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.521+0000 7f4676f6d740 1 --2- 172.21.15.80:0/4048079054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d47546820 0x556d47550ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.521+0000 7f4676f6d740 1 --2- 172.21.15.80:0/4048079054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556d47545f00 0x556d475462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.521+0000 7f4676f6d740 1 -- 172.21.15.80:0/4048079054 >> 172.21.15.80:0/4048079054 conn(0x556d47542410 msgr2=0x556d475427f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.521+0000 7f4676f6d740 1 -- 172.21.15.80:0/4048079054 shutdown_connections 2024-04-26T18:36:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.521+0000 7f4676f6d740 1 -- 172.21.15.80:0/4048079054 wait complete. 2024-04-26T18:36:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.521+0000 7f4676f6d740 1 -- start start 2024-04-26T18:36:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.521+0000 7f4676f6d740 1 Processor -- start 2024-04-26T18:36:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.522+0000 7f4676f6d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d47545f00 0x556d4754e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.522+0000 7f4676f6d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d47546820 0x556d4754e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.522+0000 7f4676f6d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556d475510e0 0x556d4754ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.522+0000 7f4676f6d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x556d47553d10 con 0x556d47545f00 2024-04-26T18:36:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.522+0000 7f4676f6d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556d47433b60 con 0x556d47546820 2024-04-26T18:36:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.522+0000 7f4676f6d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x556d47553e90 con 0x556d475510e0 2024-04-26T18:36:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.522+0000 7f4676f6d740 10 client.0 _ll_register_callbacks cb 0x556d474582b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:36:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.522+0000 7f4671f14640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d47545f00 0x556d4754e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.522+0000 7f4671f14640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d47545f00 0x556d4754e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55806/0 (socket says 172.21.15.80:55806) 2024-04-26T18:36:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.522+0000 7f4671f14640 1 -- 172.21.15.80:0/3295432800 learned_addr learned my addr 172.21.15.80:0/3295432800 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.522+0000 7f4671713640 1 --2- 172.21.15.80:0/3295432800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d47546820 0x556d4754e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.522+0000 7f4672715640 1 --2- 172.21.15.80:0/3295432800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556d475510e0 0x556d4754ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.522+0000 7f4671f14640 1 -- 172.21.15.80:0/3295432800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556d475510e0 msgr2=0x556d4754ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.522+0000 7f4671f14640 1 --2- 172.21.15.80:0/3295432800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556d475510e0 0x556d4754ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.522+0000 7f4671f14640 1 -- 172.21.15.80:0/3295432800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d47546820 msgr2=0x556d4754e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.522+0000 7f4671f14640 1 --2- 172.21.15.80:0/3295432800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d47546820 0x556d4754e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.522+0000 7f4671f14640 1 -- 172.21.15.80:0/3295432800 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d471be210 con 0x556d47545f00 2024-04-26T18:36:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.522+0000 7f4672715640 1 --2- 172.21.15.80:0/3295432800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556d475510e0 0x556d4754ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:36:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.522+0000 7f4671f14640 1 --2- 172.21.15.80:0/3295432800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d47545f00 0x556d4754e050 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4668099100 tx=0x7f466809cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c0680f8ae055ab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.522+0000 7f46557fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:36:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.523+0000 7f46557fa640 1 -- 172.21.15.80:0/3295432800 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46680bbe60 con 0x556d47545f00 2024-04-26T18:36:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.523+0000 7f46557fa640 1 -- 172.21.15.80:0/3295432800 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f46680046c0 con 0x556d47545f00 2024-04-26T18:36:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.523+0000 7f4676f6d740 1 -- 172.21.15.80:0/3295432800 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f465c00fa70 con 0x556d47545f00 2024-04-26T18:36:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.523+0000 7f46557fa640 1 -- 172.21.15.80:0/3295432800 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f46680b5030 con 0x556d47545f00 2024-04-26T18:36:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.523+0000 7f4676f6d740 10 client.15333 fetch_fsmap learned FSMap version 27 2024-04-26T18:36:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.523+0000 7f4676f6d740 1 -- 172.21.15.80:0/3295432800 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556d4728a620 con 0x556d47545f00 2024-04-26T18:36:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.523+0000 7f46557fa640 1 -- 172.21.15.80:0/3295432800 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f465c00fa70 con 0x556d47545f00 2024-04-26T18:36:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.523+0000 7f46557fa640 1 -- 172.21.15.80:0/3295432800 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f4668061ce0 con 0x556d47545f00 2024-04-26T18:36:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.523+0000 7f4676f6d740 10 client.15333 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:36:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.523+0000 7f4676f6d740 10 client.15333 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:36:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.523+0000 7f4676f6d740 20 client.15333 populate_metadata read hostname 'smithi080' 2024-04-26T18:36:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.523+0000 7f4676f6d740 1 --2- 172.21.15.80:0/3295432800 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x556d47561200 0x556d47563610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.523+0000 7f4676f6d740 4 client.15333 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:36:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.523+0000 7f4676f6d740 1 -- 172.21.15.80:0/3295432800 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d474ba070 con 0x556d47561200 2024-04-26T18:36:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.523+0000 7f4671713640 1 --2- 172.21.15.80:0/3295432800 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x556d47561200 0x556d47563610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.524+0000 7f4671713640 1 --2- 172.21.15.80:0/3295432800 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x556d47561200 0x556d47563610 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=561519622e181cdf server_cookie=f163183f7c114a98 in_seq=0 out_seq=0 2024-04-26T18:36:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.524+0000 7f46557fa640 10 client.15333 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:36:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.524+0000 7f46557fa640 1 -- 172.21.15.80:0/3295432800 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556d474ba070 con 0x556d47561200 2024-04-26T18:36:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.524+0000 7f46557fa640 10 client.15333 handle_command_reply: tid=0 2024-04-26T18:36:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.524+0000 7f4676f6d740 1 client.15333 shutdown 2024-04-26T18:36:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.525+0000 7f4676f6d740 1 -- 172.21.15.80:0/3295432800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d47545f00 msgr2=0x556d4754e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.525+0000 7f4676f6d740 1 --2- 172.21.15.80:0/3295432800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d47545f00 0x556d4754e050 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4668099100 tx=0x7f466809cba0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.525+0000 7f4676f6d740 1 -- 172.21.15.80:0/3295432800 shutdown_connections 2024-04-26T18:36:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.525+0000 7f4676f6d740 1 --2- 172.21.15.80:0/3295432800 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x556d47561200 0x556d47563610 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.525+0000 7f4676f6d740 1 --2- 172.21.15.80:0/3295432800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556d475510e0 0x556d4754ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.525+0000 7f46557fa640 0 client.15333 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:36:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.525+0000 7f4676f6d740 1 --2- 172.21.15.80:0/3295432800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d47546820 0x556d4754e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.525+0000 7f4676f6d740 1 --2- 172.21.15.80:0/3295432800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d47545f00 0x556d4754e050 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.525+0000 7f4676f6d740 1 -- 172.21.15.80:0/3295432800 >> 172.21.15.80:0/3295432800 conn(0x556d47542410 msgr2=0x556d475415b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.525+0000 7f4676f6d740 1 -- 172.21.15.80:0/3295432800 shutdown_connections 2024-04-26T18:36:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.525+0000 7f4676f6d740 1 -- 172.21.15.80:0/3295432800 wait complete. 2024-04-26T18:36:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.525+0000 7f4676f6d740 20 client.15333 trim_cache size 0 max 16384 2024-04-26T18:36:43.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.539+0000 7f4676f6d740 1 Processor -- start 2024-04-26T18:36:43.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.539+0000 7f4676f6d740 1 -- start start 2024-04-26T18:36:43.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.539+0000 7f4676f6d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d47545f00 0x556d4755cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:43.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.539+0000 7f4676f6d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d47546820 0x556d475488c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:43.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.539+0000 7f4676f6d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556d475510e0 0x556d47568f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:43.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.539+0000 7f4676f6d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f466c1b4870 con 0x556d47546820 2024-04-26T18:36:43.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.539+0000 7f4676f6d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f466c1b63b0 con 0x556d47545f00 2024-04-26T18:36:43.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.539+0000 7f4676f6d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f466c1b4f40 con 0x556d475510e0 2024-04-26T18:36:43.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.539+0000 7f4671713640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d47546820 0x556d475488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:43.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.539+0000 7f4671713640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d47546820 0x556d475488c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55818/0 (socket says 172.21.15.80:55818) 2024-04-26T18:36:43.544 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.539+0000 7f4671713640 1 -- 172.21.15.80:0/3374207742 learned_addr learned my addr 172.21.15.80:0/3374207742 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.540+0000 7f4671713640 1 -- 172.21.15.80:0/3374207742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556d475510e0 msgr2=0x556d47568f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.540+0000 7f4671713640 1 --2- 172.21.15.80:0/3374207742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556d475510e0 0x556d47568f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.540+0000 7f4671f14640 1 --2- 172.21.15.80:0/3374207742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d47545f00 0x556d4755cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.540+0000 7f4671713640 1 -- 172.21.15.80:0/3374207742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d47545f00 msgr2=0x556d4755cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.540+0000 7f4671713640 1 --2- 172.21.15.80:0/3374207742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d47545f00 0x556d4755cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.540+0000 7f4671713640 1 -- 172.21.15.80:0/3374207742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d47548e00 con 0x556d47546820 2024-04-26T18:36:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.540+0000 7f4671713640 1 --2- 172.21.15.80:0/3374207742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d47546820 0x556d475488c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f465c0114f0 tx=0x7f465c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214fa530e28e36fc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.540+0000 7f46577fe640 1 -- 172.21.15.80:0/3374207742 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c02ae60 con 0x556d47546820 2024-04-26T18:36:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.540+0000 7f46577fe640 1 -- 172.21.15.80:0/3374207742 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f465c00fa70 con 0x556d47546820 2024-04-26T18:36:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.540+0000 7f46577fe640 1 -- 172.21.15.80:0/3374207742 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c029020 con 0x556d47546820 2024-04-26T18:36:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.541+0000 7f4676f6d740 1 -- 172.21.15.80:0/3374207742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d47546820 msgr2=0x556d475488c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.541+0000 7f4676f6d740 1 --2- 172.21.15.80:0/3374207742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d47546820 0x556d475488c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f465c0114f0 tx=0x7f465c005850 comp rx=0 tx=0).stop 2024-04-26T18:36:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.541+0000 7f4676f6d740 1 -- 172.21.15.80:0/3374207742 shutdown_connections 2024-04-26T18:36:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.541+0000 7f4676f6d740 1 --2- 172.21.15.80:0/3374207742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d47546820 0x556d475488c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.541+0000 7f4676f6d740 1 --2- 172.21.15.80:0/3374207742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556d475510e0 0x556d47568f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.541+0000 7f4676f6d740 1 --2- 172.21.15.80:0/3374207742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d47545f00 0x556d4755cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.541+0000 7f4676f6d740 1 -- 172.21.15.80:0/3374207742 >> 172.21.15.80:0/3374207742 conn(0x556d47542410 msgr2=0x556d475427f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.541+0000 7f4676f6d740 1 -- 172.21.15.80:0/3374207742 shutdown_connections 2024-04-26T18:36:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.541+0000 7f4676f6d740 1 -- 172.21.15.80:0/3374207742 wait complete. 2024-04-26T18:36:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.541+0000 7f4676f6d740 1 -- start start 2024-04-26T18:36:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.541+0000 7f4676f6d740 1 Processor -- start 2024-04-26T18:36:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.541+0000 7f4676f6d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d47545f00 0x556d4754ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.541+0000 7f4676f6d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556d47546820 0x556d4754b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.541+0000 7f4676f6d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d475510e0 0x556d4754b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.541+0000 7f4676f6d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f466c1b5ce0 con 0x556d475510e0 2024-04-26T18:36:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.541+0000 7f4676f6d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f466c1b5610 con 0x556d47545f00 2024-04-26T18:36:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.541+0000 7f4676f6d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f466c1b2850 con 0x556d47546820 2024-04-26T18:36:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.541+0000 7f4676f6d740 10 client.0 _ll_register_callbacks cb 0x7f466800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:36:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.542+0000 7f4672715640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d475510e0 0x556d4754b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.542+0000 7f4672715640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d475510e0 0x556d4754b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55820/0 (socket says 172.21.15.80:55820) 2024-04-26T18:36:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.542+0000 7f4672715640 1 -- 172.21.15.80:0/3726371624 learned_addr learned my addr 172.21.15.80:0/3726371624 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.542+0000 7f4671713640 1 --2- 172.21.15.80:0/3726371624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556d47546820 0x556d4754b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.542+0000 7f4671f14640 1 --2- 172.21.15.80:0/3726371624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d47545f00 0x556d4754ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.542+0000 7f4672715640 1 -- 172.21.15.80:0/3726371624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556d47546820 msgr2=0x556d4754b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.542+0000 7f4672715640 1 --2- 172.21.15.80:0/3726371624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556d47546820 0x556d4754b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.542+0000 7f4672715640 1 -- 172.21.15.80:0/3726371624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d47545f00 msgr2=0x556d4754ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.542+0000 7f4672715640 1 --2- 172.21.15.80:0/3726371624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d47545f00 0x556d4754ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.542+0000 7f4672715640 1 -- 172.21.15.80:0/3726371624 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d475c6910 con 0x556d475510e0 2024-04-26T18:36:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.542+0000 7f4671713640 1 --2- 172.21.15.80:0/3726371624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556d47546820 0x556d4754b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:36:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.542+0000 7f4672715640 1 --2- 172.21.15.80:0/3726371624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d475510e0 0x556d4754b8b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4664035000 tx=0x7f46640093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e2841beb15ee12 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.542+0000 7f46557fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:36:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.542+0000 7f46557fa640 1 -- 172.21.15.80:0/3726371624 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4664051070 con 0x556d475510e0 2024-04-26T18:36:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.542+0000 7f46557fa640 1 -- 172.21.15.80:0/3726371624 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f4664003b80 con 0x556d475510e0 2024-04-26T18:36:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.542+0000 7f4676f6d740 1 -- 172.21.15.80:0/3726371624 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f465c00fa70 con 0x556d475510e0 2024-04-26T18:36:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.542+0000 7f46557fa640 1 -- 172.21.15.80:0/3726371624 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4664003d80 con 0x556d475510e0 2024-04-26T18:36:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.542+0000 7f4676f6d740 10 client.15339 fetch_fsmap learned FSMap version 27 2024-04-26T18:36:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.542+0000 7f4676f6d740 1 -- 172.21.15.80:0/3726371624 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556d475c7c00 con 0x556d475510e0 2024-04-26T18:36:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.542+0000 7f46557fa640 1 -- 172.21.15.80:0/3726371624 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f465c00fa70 con 0x556d475510e0 2024-04-26T18:36:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.543+0000 7f46557fa640 1 -- 172.21.15.80:0/3726371624 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f466402f8c0 con 0x556d475510e0 2024-04-26T18:36:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.543+0000 7f4676f6d740 10 client.15339 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:36:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.543+0000 7f4676f6d740 10 client.15339 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:36:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.543+0000 7f4676f6d740 20 client.15339 populate_metadata read hostname 'smithi080' 2024-04-26T18:36:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.543+0000 7f4676f6d740 1 --2- 172.21.15.80:0/3726371624 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x556d475c8360 0x556d475ca780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.543+0000 7f4676f6d740 4 client.15339 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:36:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.543+0000 7f4676f6d740 1 -- 172.21.15.80:0/3726371624 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556d474b3ee0 con 0x556d475c8360 2024-04-26T18:36:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.543+0000 7f4671f14640 1 --2- 172.21.15.80:0/3726371624 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x556d475c8360 0x556d475ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:43.549 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.543+0000 7f4671f14640 1 --2- 172.21.15.80:0/3726371624 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x556d475c8360 0x556d475ca780 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d2759238fff9d27 server_cookie=e105a24e6db28d7f in_seq=0 out_seq=0 2024-04-26T18:36:43.549 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.543+0000 7f46557fa640 10 client.15339 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:36:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.553+0000 7f46557fa640 1 -- 172.21.15.80:0/3726371624 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556d474b3ee0 con 0x556d475c8360 2024-04-26T18:36:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.553+0000 7f46557fa640 10 client.15339 handle_command_reply: tid=0 2024-04-26T18:36:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.553+0000 7f4676f6d740 1 client.15339 shutdown 2024-04-26T18:36:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.553+0000 7f4676f6d740 1 -- 172.21.15.80:0/3726371624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d475510e0 msgr2=0x556d4754b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.553+0000 7f4676f6d740 1 --2- 172.21.15.80:0/3726371624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d475510e0 0x556d4754b8b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4664035000 tx=0x7f46640093f0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.553+0000 7f4676f6d740 1 -- 172.21.15.80:0/3726371624 shutdown_connections 2024-04-26T18:36:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.553+0000 7f4676f6d740 1 --2- 172.21.15.80:0/3726371624 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x556d475c8360 0x556d475ca780 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.554+0000 7f4676f6d740 1 --2- 172.21.15.80:0/3726371624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556d475510e0 0x556d4754b8b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.554+0000 7f4676f6d740 1 --2- 172.21.15.80:0/3726371624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556d47546820 0x556d4754b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.554+0000 7f46557fa640 0 client.15339 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:36:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.554+0000 7f4676f6d740 1 --2- 172.21.15.80:0/3726371624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d47545f00 0x556d4754ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.554+0000 7f4676f6d740 1 -- 172.21.15.80:0/3726371624 >> 172.21.15.80:0/3726371624 conn(0x556d47542410 msgr2=0x556d4754e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.554+0000 7f4676f6d740 1 -- 172.21.15.80:0/3726371624 shutdown_connections 2024-04-26T18:36:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.554+0000 7f4676f6d740 1 -- 172.21.15.80:0/3726371624 wait complete. 2024-04-26T18:36:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.554+0000 7f4676f6d740 20 client.15339 trim_cache size 0 max 16384 2024-04-26T18:36:43.556 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:{ 2024-04-26T18:36:43.556 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "message": "", 2024-04-26T18:36:43.556 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "return_code": 0 2024-04-26T18:36:43.556 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:} 2024-04-26T18:36:43.557 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.554+0000 7f4674178640 1 -- 172.21.15.80:0/601939317 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f46580a3ee0 msgr2=0x7f46580a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:43.557 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.554+0000 7f4674178640 1 --2- 172.21.15.80:0/601939317 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f46580a3ee0 0x7f46580a63a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4664006010 tx=0x7f46640095c0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.557 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.554+0000 7f4674178640 1 -- 172.21.15.80:0/601939317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f466c06b6a0 msgr2=0x7f466c19f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:43.557 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.554+0000 7f4674178640 1 --2- 172.21.15.80:0/601939317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f466c06b6a0 0x7f466c19f510 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f466800e9f0 tx=0x7f466800edf0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.557 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.554+0000 7f4674178640 1 -- 172.21.15.80:0/601939317 shutdown_connections 2024-04-26T18:36:43.557 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.554+0000 7f4674178640 1 --2- 172.21.15.80:0/601939317 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f46580a3ee0 0x7f46580a63a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.557 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.554+0000 7f4674178640 1 --2- 172.21.15.80:0/601939317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f466c105320 0x7f466c19fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.557 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.554+0000 7f4674178640 1 --2- 172.21.15.80:0/601939317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f466c107980 0x7f466c1a3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.557 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.554+0000 7f4674178640 1 --2- 172.21.15.80:0/601939317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f466c06b6a0 0x7f466c19f510 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:43.557 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.554+0000 7f4674178640 1 -- 172.21.15.80:0/601939317 >> 172.21.15.80:0/601939317 conn(0x7f466c077630 msgr2=0x7f466c104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:43.557 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.554+0000 7f4674178640 1 -- 172.21.15.80:0/601939317 shutdown_connections 2024-04-26T18:36:43.558 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:43.554+0000 7f4674178640 1 -- 172.21.15.80:0/601939317 wait complete. 2024-04-26T18:36:44.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.130+0000 7f65f2898700 1 -- 172.21.15.80:0/3761323899 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65ec108340 msgr2=0x7f65ec06bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:44.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.130+0000 7f65f2898700 1 --2- 172.21.15.80:0/3761323899 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65ec108340 0x7f65ec06bb50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f65dc009990 tx=0x7f65dc009ca0 comp rx=0 tx=0).stop 2024-04-26T18:36:44.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.130+0000 7f65f2898700 1 -- 172.21.15.80:0/3761323899 shutdown_connections 2024-04-26T18:36:44.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.130+0000 7f65f2898700 1 --2- 172.21.15.80:0/3761323899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65ec105e50 0x7f65ec106300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:44.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.130+0000 7f65f2898700 1 --2- 172.21.15.80:0/3761323899 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65ec108340 0x7f65ec06bb50 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:44.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.130+0000 7f65f2898700 1 --2- 172.21.15.80:0/3761323899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65ec06c090 0x7f65ec06c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:44.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.130+0000 7f65f2898700 1 -- 172.21.15.80:0/3761323899 >> 172.21.15.80:0/3761323899 conn(0x7f65ec0792d0 msgr2=0x7f65ec0796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:44.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.130+0000 7f65f2898700 1 -- 172.21.15.80:0/3761323899 shutdown_connections 2024-04-26T18:36:44.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.130+0000 7f65f2898700 1 -- 172.21.15.80:0/3761323899 wait complete. 2024-04-26T18:36:44.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.130+0000 7f65f2898700 1 Processor -- start 2024-04-26T18:36:44.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.130+0000 7f65f2898700 1 -- start start 2024-04-26T18:36:44.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.131+0000 7f65f2898700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65ec06c090 0x7f65ec1a00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:44.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.131+0000 7f65f2898700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65ec105e50 0x7f65ec1a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:44.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.131+0000 7f65f2898700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65ec108340 0x7f65ec1a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:44.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.131+0000 7f65f2898700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f65ec119ba0 con 0x7f65ec105e50 2024-04-26T18:36:44.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.131+0000 7f65f2898700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f65ec119a20 con 0x7f65ec06c090 2024-04-26T18:36:44.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.131+0000 7f65f2898700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f65ec119d20 con 0x7f65ec108340 2024-04-26T18:36:44.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.131+0000 7f65eb7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65ec105e50 0x7f65ec1a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:44.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.131+0000 7f65eb7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65ec105e50 0x7f65ec1a0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55850/0 (socket says 172.21.15.80:55850) 2024-04-26T18:36:44.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.131+0000 7f65ebfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65ec06c090 0x7f65ec1a00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:44.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.131+0000 7f65eb7fe700 1 -- 172.21.15.80:0/680661373 learned_addr learned my addr 172.21.15.80:0/680661373 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:44.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.131+0000 7f65f0e35700 1 --2- 172.21.15.80:0/680661373 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65ec108340 0x7f65ec1a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:44.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.131+0000 7f65eb7fe700 1 -- 172.21.15.80:0/680661373 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65ec108340 msgr2=0x7f65ec1a49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:44.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.131+0000 7f65eb7fe700 1 --2- 172.21.15.80:0/680661373 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65ec108340 0x7f65ec1a49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:44.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.131+0000 7f65eb7fe700 1 -- 172.21.15.80:0/680661373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65ec06c090 msgr2=0x7f65ec1a00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:44.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.131+0000 7f65eb7fe700 1 --2- 172.21.15.80:0/680661373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65ec06c090 0x7f65ec1a00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:44.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.131+0000 7f65eb7fe700 1 -- 172.21.15.80:0/680661373 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ec1a50e0 con 0x7f65ec105e50 2024-04-26T18:36:44.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.131+0000 7f65f0e35700 1 --2- 172.21.15.80:0/680661373 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65ec108340 0x7f65ec1a49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:36:44.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.131+0000 7f65ebfff700 1 --2- 172.21.15.80:0/680661373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65ec06c090 0x7f65ec1a00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:36:44.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.131+0000 7f65eb7fe700 1 --2- 172.21.15.80:0/680661373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65ec105e50 0x7f65ec1a0610 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f65e000d950 tx=0x7f65e000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:44.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.132+0000 7f65e97fa700 1 -- 172.21.15.80:0/680661373 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e0016070 con 0x7f65ec105e50 2024-04-26T18:36:44.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.132+0000 7f65e97fa700 1 -- 172.21.15.80:0/680661373 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65e0009df0 con 0x7f65ec105e50 2024-04-26T18:36:44.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.132+0000 7f65f2898700 1 -- 172.21.15.80:0/680661373 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65ec1a53d0 con 0x7f65ec105e50 2024-04-26T18:36:44.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.132+0000 7f65e97fa700 1 -- 172.21.15.80:0/680661373 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e000f3c0 con 0x7f65ec105e50 2024-04-26T18:36:44.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.132+0000 7f65f2898700 1 -- 172.21.15.80:0/680661373 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65ec1acc50 con 0x7f65ec105e50 2024-04-26T18:36:44.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.133+0000 7f65f2898700 1 -- 172.21.15.80:0/680661373 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65ec06a110 con 0x7f65ec105e50 2024-04-26T18:36:44.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.134+0000 7f65e97fa700 1 -- 172.21.15.80:0/680661373 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 24) ==== 138873+0+0 (secure 0 0 0) 0x7f65e0019070 con 0x7f65ec105e50 2024-04-26T18:36:44.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.134+0000 7f65e97fa700 1 --2- 172.21.15.80:0/680661373 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f65d40a3ed0 0x7f65d40a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:44.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.135+0000 7f65ebfff700 1 --2- 172.21.15.80:0/680661373 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f65d40a3ed0 0x7f65d40a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:44.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.135+0000 7f65e97fa700 1 -- 172.21.15.80:0/680661373 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f65e00d0640 con 0x7f65ec105e50 2024-04-26T18:36:44.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.135+0000 7f65ebfff700 1 --2- 172.21.15.80:0/680661373 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f65d40a3ed0 0x7f65d40a6390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00b2e0 tx=0x7f65dc01a040 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:44.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.138+0000 7f65e97fa700 1 -- 172.21.15.80:0/680661373 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f65e009cae0 con 0x7f65ec105e50 2024-04-26T18:36:44.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.381+0000 7f65f2898700 1 -- 172.21.15.80:0/680661373 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65ec1ace50 con 0x7f65ec105e50 2024-04-26T18:36:44.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.382+0000 7f65e97fa700 1 -- 172.21.15.80:0/680661373 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11918 (secure 0 0 0) 0x7f65e009c3e0 con 0x7f65ec105e50 2024-04-26T18:36:44.383 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:36:44.383 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1967550873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1967550873},{"type":"v1","addr":"172.21.15.80:6835","nonce":1967550873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/559541830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":559541830},{"type":"v1","addr":"172.21.15.80:6837","nonce":559541830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T18:33:08.347399+0000","modified":"2024-04-26T18:36:26.401600+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24434,"mds_1":24421,"mds_2":24404,"mds_3":24400,"mds_4":24394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14577":{"gid":14577,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6839/2137993298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":2137993298},{"type":"v1","addr":"172.21.15.80:6839","nonce":2137993298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6841/1544670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1544670},{"type":"v1","addr":"172.21.15.80:6841","nonce":1544670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24371":{"gid":24371,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/3564539039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3564539039},{"type":"v1","addr":"172.21.15.82:6833","nonce":3564539039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24379":{"gid":24379,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/572065563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":572065563},{"type":"v1","addr":"172.21.15.82:6835","nonce":572065563}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.192:6835/719058020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":719058020},{"type":"v1","addr":"172.21.15.192:6835","nonce":719058020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.192:6837/2361996920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2361996920},{"type":"v1","addr":"172.21.15.192:6837","nonce":2361996920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.82:6837/2084055551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2084055551},{"type":"v1","addr":"172.21.15.82:6837","nonce":2084055551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6839/2735406056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":2735406056},{"type":"v1","addr":"172.21.15.192:6839","nonce":2735406056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.82:6839/1482576497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1482576497},{"type":"v1","addr":"172.21.15.82:6839","nonce":1482576497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24434,"qdb_cluster":[24421,24400,24394,24404,24434]},"id":1}]} 2024-04-26T18:36:44.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.384+0000 7f65f2898700 1 -- 172.21.15.80:0/680661373 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f65d40a3ed0 msgr2=0x7f65d40a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:44.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.384+0000 7f65f2898700 1 --2- 172.21.15.80:0/680661373 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f65d40a3ed0 0x7f65d40a6390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00b2e0 tx=0x7f65dc01a040 comp rx=0 tx=0).stop 2024-04-26T18:36:44.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.384+0000 7f65f2898700 1 -- 172.21.15.80:0/680661373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65ec105e50 msgr2=0x7f65ec1a0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:44.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.384+0000 7f65f2898700 1 --2- 172.21.15.80:0/680661373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65ec105e50 0x7f65ec1a0610 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f65e000d950 tx=0x7f65e000dc60 comp rx=0 tx=0).stop 2024-04-26T18:36:44.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.384+0000 7f65f2898700 1 -- 172.21.15.80:0/680661373 shutdown_connections 2024-04-26T18:36:44.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.384+0000 7f65f2898700 1 --2- 172.21.15.80:0/680661373 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f65d40a3ed0 0x7f65d40a6390 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:44.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.384+0000 7f65f2898700 1 --2- 172.21.15.80:0/680661373 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65ec108340 0x7f65ec1a49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:44.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.384+0000 7f65f2898700 1 --2- 172.21.15.80:0/680661373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65ec06c090 0x7f65ec1a00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:44.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.384+0000 7f65f2898700 1 --2- 172.21.15.80:0/680661373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65ec105e50 0x7f65ec1a0610 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:44.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.384+0000 7f65f2898700 1 -- 172.21.15.80:0/680661373 >> 172.21.15.80:0/680661373 conn(0x7f65ec0792d0 msgr2=0x7f65ec104540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:44.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.384+0000 7f65f2898700 1 -- 172.21.15.80:0/680661373 shutdown_connections 2024-04-26T18:36:44.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:44.384+0000 7f65f2898700 1 -- 172.21.15.80:0/680661373 wait complete. 2024-04-26T18:36:44.385 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 27 2024-04-26T18:36:44.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:44 smithi080 ceph-mon[29135]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 52 op/s 2024-04-26T18:36:44.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:44 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/680661373' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:36:45.075 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T18:36:45.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:44 smithi192 ceph-mon[32842]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 52 op/s 2024-04-26T18:36:45.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:44 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/680661373' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:36:45.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:44 smithi082 ceph-mon[32808]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 52 op/s 2024-04-26T18:36:45.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:44 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/680661373' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:36:45.317 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:36:46.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.976+0000 7fd14844e700 1 -- 172.21.15.80:0/91383740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd140103e90 msgr2=0x7fd1401102c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:46.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.976+0000 7fd14844e700 1 --2- 172.21.15.80:0/91383740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd140103e90 0x7fd1401102c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd138009990 tx=0x7fd138009ca0 comp rx=0 tx=0).stop 2024-04-26T18:36:46.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.976+0000 7fd14844e700 1 -- 172.21.15.80:0/91383740 shutdown_connections 2024-04-26T18:36:46.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.976+0000 7fd14844e700 1 --2- 172.21.15.80:0/91383740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd140103e90 0x7fd1401102c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:46.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.976+0000 7fd14844e700 1 --2- 172.21.15.80:0/91383740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1401094f0 0x7fd1401098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:46.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.976+0000 7fd14844e700 1 --2- 172.21.15.80:0/91383740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1401034d0 0x7fd140103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:46.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.976+0000 7fd14844e700 1 -- 172.21.15.80:0/91383740 >> 172.21.15.80:0/91383740 conn(0x7fd14007a500 msgr2=0x7fd14007a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:46.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.976+0000 7fd14844e700 1 -- 172.21.15.80:0/91383740 shutdown_connections 2024-04-26T18:36:46.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.976+0000 7fd14844e700 1 -- 172.21.15.80:0/91383740 wait complete. 2024-04-26T18:36:46.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.977+0000 7fd14844e700 1 Processor -- start 2024-04-26T18:36:46.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.977+0000 7fd14844e700 1 -- start start 2024-04-26T18:36:46.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.977+0000 7fd14844e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1401034d0 0x7fd14019f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:46.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.977+0000 7fd14844e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd140103e90 0x7fd14019fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:46.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.977+0000 7fd14844e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1401094f0 0x7fd1401998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:46.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.977+0000 7fd14844e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd140113610 con 0x7fd1401034d0 2024-04-26T18:36:46.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.977+0000 7fd14844e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd140113490 con 0x7fd1401094f0 2024-04-26T18:36:46.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.977+0000 7fd14844e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd140113790 con 0x7fd140103e90 2024-04-26T18:36:46.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.977+0000 7fd1461ea700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1401034d0 0x7fd14019f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:46.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.977+0000 7fd1461ea700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1401034d0 0x7fd14019f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55862/0 (socket says 172.21.15.80:55862) 2024-04-26T18:36:46.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.977+0000 7fd1461ea700 1 -- 172.21.15.80:0/1952678553 learned_addr learned my addr 172.21.15.80:0/1952678553 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:46.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.977+0000 7fd1469eb700 1 --2- 172.21.15.80:0/1952678553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1401094f0 0x7fd1401998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:46.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.977+0000 7fd1459e9700 1 --2- 172.21.15.80:0/1952678553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd140103e90 0x7fd14019fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:46.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.978+0000 7fd1461ea700 1 -- 172.21.15.80:0/1952678553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd140103e90 msgr2=0x7fd14019fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:46.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.978+0000 7fd1461ea700 1 --2- 172.21.15.80:0/1952678553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd140103e90 0x7fd14019fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:46.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.978+0000 7fd1461ea700 1 -- 172.21.15.80:0/1952678553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1401094f0 msgr2=0x7fd1401998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:46.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.978+0000 7fd1461ea700 1 --2- 172.21.15.80:0/1952678553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1401094f0 0x7fd1401998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:46.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.978+0000 7fd1461ea700 1 -- 172.21.15.80:0/1952678553 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd14019a030 con 0x7fd1401034d0 2024-04-26T18:36:46.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.978+0000 7fd1459e9700 1 --2- 172.21.15.80:0/1952678553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd140103e90 0x7fd14019fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:36:46.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.978+0000 7fd1461ea700 1 --2- 172.21.15.80:0/1952678553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1401034d0 0x7fd14019f710 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00ef30 tx=0x7fd13c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:46.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.978+0000 7fd1377fe700 1 -- 172.21.15.80:0/1952678553 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13c0092e0 con 0x7fd1401034d0 2024-04-26T18:36:46.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.978+0000 7fd14844e700 1 -- 172.21.15.80:0/1952678553 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd14019a2c0 con 0x7fd1401034d0 2024-04-26T18:36:46.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.978+0000 7fd1377fe700 1 -- 172.21.15.80:0/1952678553 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd13c004bb0 con 0x7fd1401034d0 2024-04-26T18:36:46.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.978+0000 7fd1377fe700 1 -- 172.21.15.80:0/1952678553 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13c004280 con 0x7fd1401034d0 2024-04-26T18:36:46.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.978+0000 7fd14844e700 1 -- 172.21.15.80:0/1952678553 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1401a65e0 con 0x7fd1401034d0 2024-04-26T18:36:46.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.979+0000 7fd14844e700 1 -- 172.21.15.80:0/1952678553 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd14006a110 con 0x7fd1401034d0 2024-04-26T18:36:46.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.980+0000 7fd1377fe700 1 -- 172.21.15.80:0/1952678553 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 24) ==== 138873+0+0 (secure 0 0 0) 0x7fd13c01b030 con 0x7fd1401034d0 2024-04-26T18:36:46.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.981+0000 7fd1377fe700 1 --2- 172.21.15.80:0/1952678553 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fd12c0a3ed0 0x7fd12c0a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:46.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.981+0000 7fd1459e9700 1 --2- 172.21.15.80:0/1952678553 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fd12c0a3ed0 0x7fd12c0a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:46.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.981+0000 7fd1377fe700 1 -- 172.21.15.80:0/1952678553 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fd13c0d0f50 con 0x7fd1401034d0 2024-04-26T18:36:46.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.981+0000 7fd1459e9700 1 --2- 172.21.15.80:0/1952678553 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fd12c0a3ed0 0x7fd12c0a6390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd14007ab00 tx=0x7fd13000b5f0 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:46.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:46.985+0000 7fd1377fe700 1 -- 172.21.15.80:0/1952678553 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd13c022020 con 0x7fd1401034d0 2024-04-26T18:36:46.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:46 smithi080 ceph-mon[29135]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 78 KiB/s wr, 57 op/s 2024-04-26T18:36:47.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:46 smithi192 ceph-mon[32842]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 78 KiB/s wr, 57 op/s 2024-04-26T18:36:47.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:47.185+0000 7fd14844e700 1 -- 172.21.15.80:0/1952678553 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd14002e490 con 0x7fd1401034d0 2024-04-26T18:36:47.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:47.186+0000 7fd1377fe700 1 -- 172.21.15.80:0/1952678553 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+22907 (secure 0 0 0) 0x7fd13c010040 con 0x7fd1401034d0 2024-04-26T18:36:47.187 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:36:47.187 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":92,"fsid":"2187ca98-03fa-11ef-bc93-c7b262605968","created":"2024-04-26T18:24:58.809431+0000","modified":"2024-04-26T18:36:27.723526+0000","last_up_change":"2024-04-26T18:32:02.550187+0000","last_in_change":"2024-04-26T18:31:41.630932+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T18:28:14.502290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T18:33:02.102135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T18:33:05.300979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a01cfe6-d13a-4828-8c20-ad7fee7e87ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6803","nonce":429487384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6805","nonce":429487384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6809","nonce":429487384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6807","nonce":429487384}]},"public_addr":"172.21.15.80:6803/429487384","cluster_addr":"172.21.15.80:6805/429487384","heartbeat_back_addr":"172.21.15.80:6809/429487384","heartbeat_front_addr":"172.21.15.80:6807/429487384","state":["exists","up"]},{"osd":1,"uuid":"1f815d88-30b1-4540-b4f5-cc3d62707318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913033849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913033849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913033849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913033849}]},"public_addr":"172.21.15.82:6801/3913033849","cluster_addr":"172.21.15.82:6803/3913033849","heartbeat_back_addr":"172.21.15.82:6807/3913033849","heartbeat_front_addr":"172.21.15.82:6805/3913033849","state":["exists","up"]},{"osd":2,"uuid":"b8625dd7-4c1d-4258-ac2b-463ff96f4cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6801","nonce":503427508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6803","nonce":503427508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6807","nonce":503427508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6805","nonce":503427508}]},"public_addr":"172.21.15.192:6801/503427508","cluster_addr":"172.21.15.192:6803/503427508","heartbeat_back_addr":"172.21.15.192:6807/503427508","heartbeat_front_addr":"172.21.15.192:6805/503427508","state":["exists","up"]},{"osd":3,"uuid":"3068321a-3070-44ae-9bbd-a3faac8c21fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6811","nonce":407817066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6813","nonce":407817066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6817","nonce":407817066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6815","nonce":407817066}]},"public_addr":"172.21.15.80:6811/407817066","cluster_addr":"172.21.15.80:6813/407817066","heartbeat_back_addr":"172.21.15.80:6817/407817066","heartbeat_front_addr":"172.21.15.80:6815/407817066","state":["exists","up"]},{"osd":4,"uuid":"6b3d6455-9495-435b-8193-a260b63504ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6809","nonce":2068291934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6811","nonce":2068291934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6815","nonce":2068291934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6813","nonce":2068291934}]},"public_addr":"172.21.15.82:6809/2068291934","cluster_addr":"172.21.15.82:6811/2068291934","heartbeat_back_addr":"172.21.15.82:6815/2068291934","heartbeat_front_addr":"172.21.15.82:6813/2068291934","state":["exists","up"]},{"osd":5,"uuid":"538863f1-1486-45b5-a675-ecb1d3035599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6809","nonce":1770809727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6811","nonce":1770809727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6815","nonce":1770809727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6813","nonce":1770809727}]},"public_addr":"172.21.15.192:6809/1770809727","cluster_addr":"172.21.15.192:6811/1770809727","heartbeat_back_addr":"172.21.15.192:6815/1770809727","heartbeat_front_addr":"172.21.15.192:6813/1770809727","state":["exists","up"]},{"osd":6,"uuid":"7b4374d8-98e6-48e1-924b-c9b70a4baf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6819","nonce":145064490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6821","nonce":145064490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6825","nonce":145064490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6823","nonce":145064490}]},"public_addr":"172.21.15.80:6819/145064490","cluster_addr":"172.21.15.80:6821/145064490","heartbeat_back_addr":"172.21.15.80:6825/145064490","heartbeat_front_addr":"172.21.15.80:6823/145064490","state":["exists","up"]},{"osd":7,"uuid":"f3bb3c7d-4cce-4f49-b924-72ebbaad58ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6817","nonce":208047447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6819","nonce":208047447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6823","nonce":208047447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6821","nonce":208047447}]},"public_addr":"172.21.15.82:6817/208047447","cluster_addr":"172.21.15.82:6819/208047447","heartbeat_back_addr":"172.21.15.82:6823/208047447","heartbeat_front_addr":"172.21.15.82:6821/208047447","state":["exists","up"]},{"osd":8,"uuid":"6557b536-a516-4b01-a607-7981620fb2a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6817","nonce":3763069187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6819","nonce":3763069187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6823","nonce":3763069187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6821","nonce":3763069187}]},"public_addr":"172.21.15.192:6817/3763069187","cluster_addr":"172.21.15.192:6819/3763069187","heartbeat_back_addr":"172.21.15.192:6823/3763069187","heartbeat_front_addr":"172.21.15.192:6821/3763069187","state":["exists","up"]},{"osd":9,"uuid":"838615a7-1e68-4e81-8b3a-fba0ea75f7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6827","nonce":2109877993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6829","nonce":2109877993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6833","nonce":2109877993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6831","nonce":2109877993}]},"public_addr":"172.21.15.80:6827/2109877993","cluster_addr":"172.21.15.80:6829/2109877993","heartbeat_back_addr":"172.21.15.80:6833/2109877993","heartbeat_front_addr":"172.21.15.80:6831/2109877993","state":["exists","up"]},{"osd":10,"uuid":"cd664e50-3217-453d-9a89-6e26d717e6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6825","nonce":2877220993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6827","nonce":2877220993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6831","nonce":2877220993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6829","nonce":2877220993}]},"public_addr":"172.21.15.82:6825/2877220993","cluster_addr":"172.21.15.82:6827/2877220993","heartbeat_back_addr":"172.21.15.82:6831/2877220993","heartbeat_front_addr":"172.21.15.82:6829/2877220993","state":["exists","up"]},{"osd":11,"uuid":"e52807c6-8890-4df7-a8c6-51a7ff4b467b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6825","nonce":3466865106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6827","nonce":3466865106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6831","nonce":3466865106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6829","nonce":3466865106}]},"public_addr":"172.21.15.192:6825/3466865106","cluster_addr":"172.21.15.192:6827/3466865106","heartbeat_back_addr":"172.21.15.192:6831/3466865106","heartbeat_front_addr":"172.21.15.192:6829/3466865106","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:27:23.385471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:27:46.648232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:10.578970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:34.922048+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:59.142838+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:29:24.492250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:29:49.721803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:30:15.177027+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:30:41.544775+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:31:07.562401+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:31:33.498042+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:32:00.584085+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6800/179326828":"2024-04-27T18:36:27.723494+0000","172.21.15.80:0/601829731":"2024-04-27T18:36:27.723494+0000","172.21.15.80:0/2539501834":"2024-04-27T18:36:27.723494+0000","172.21.15.80:0/444150730":"2024-04-27T18:36:27.723494+0000","172.21.15.80:6801/1997155783":"2024-04-27T18:25:50.413207+0000","172.21.15.80:0/323607684":"2024-04-27T18:25:50.413207+0000","172.21.15.80:0/586397709":"2024-04-27T18:25:50.413207+0000","172.21.15.80:6801/4208962819":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/1353083127":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2453252862":"2024-04-27T18:36:27.723494+0000","172.21.15.80:6801/179326828":"2024-04-27T18:36:27.723494+0000","172.21.15.80:6800/1997155783":"2024-04-27T18:25:50.413207+0000","172.21.15.80:6800/4208962819":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2644175019":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/1853513470":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2122929159":"2024-04-27T18:25:50.413207+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T18:36:47.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:47.188+0000 7fd14844e700 1 -- 172.21.15.80:0/1952678553 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fd12c0a3ed0 msgr2=0x7fd12c0a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:47.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:47.188+0000 7fd14844e700 1 --2- 172.21.15.80:0/1952678553 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fd12c0a3ed0 0x7fd12c0a6390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd14007ab00 tx=0x7fd13000b5f0 comp rx=0 tx=0).stop 2024-04-26T18:36:47.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:47.188+0000 7fd14844e700 1 -- 172.21.15.80:0/1952678553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1401034d0 msgr2=0x7fd14019f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:47.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:47.188+0000 7fd14844e700 1 --2- 172.21.15.80:0/1952678553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1401034d0 0x7fd14019f710 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00ef30 tx=0x7fd13c00c3a0 comp rx=0 tx=0).stop 2024-04-26T18:36:47.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:47.188+0000 7fd14844e700 1 -- 172.21.15.80:0/1952678553 shutdown_connections 2024-04-26T18:36:47.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:47.188+0000 7fd14844e700 1 --2- 172.21.15.80:0/1952678553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1401094f0 0x7fd1401998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:47.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:47.188+0000 7fd14844e700 1 --2- 172.21.15.80:0/1952678553 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1401034d0 0x7fd14019f710 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:47.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:47.188+0000 7fd14844e700 1 --2- 172.21.15.80:0/1952678553 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fd12c0a3ed0 0x7fd12c0a6390 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:47.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:47.188+0000 7fd14844e700 1 --2- 172.21.15.80:0/1952678553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd140103e90 0x7fd14019fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:47.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:47.188+0000 7fd14844e700 1 -- 172.21.15.80:0/1952678553 >> 172.21.15.80:0/1952678553 conn(0x7fd14007a500 msgr2=0x7fd1401021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:47.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:47.189+0000 7fd14844e700 1 -- 172.21.15.80:0/1952678553 shutdown_connections 2024-04-26T18:36:47.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:47.189+0000 7fd14844e700 1 -- 172.21.15.80:0/1952678553 wait complete. 2024-04-26T18:36:47.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:46 smithi082 ceph-mon[32808]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 78 KiB/s wr, 57 op/s 2024-04-26T18:36:47.927 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-04-26T18:36:48.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:47 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1952678553' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:36:48.164 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:36:48.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:47 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1952678553' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:36:48.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:47 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1952678553' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:36:49.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:48 smithi192 ceph-mon[32842]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-04-26T18:36:49.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:48 smithi082 ceph-mon[32808]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-04-26T18:36:49.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:48 smithi080 ceph-mon[29135]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-04-26T18:36:50.581 INFO:teuthology.orchestra.run.smithi080.stdout:{"run_dir":"/var/run/ceph"} 2024-04-26T18:36:50.582 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-04-26T18:36:50.582 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 9496 2024-04-26T18:36:50.582 DEBUG:tasks.quiescer:Yielding 2024-04-26T18:36:50.582 INFO:teuthology.run_tasks:Running task workunit... 2024-04-26T18:36:50.597 INFO:tasks.workunit:Pulling workunits from ref bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T18:36:50.598 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-26T18:36:50.598 INFO:tasks.workunit:timeout=3h 2024-04-26T18:36:50.598 INFO:tasks.workunit:cleanup=True 2024-04-26T18:36:50.598 DEBUG:teuthology.orchestra.run.smithi080:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-26T18:36:50.599 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:36:50.615 INFO:teuthology.orchestra.run.smithi080.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-26T18:36:50.615 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-26T18:36:50.615 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 73h/115d Inode: 1099511628283 Links: 2 2024-04-26T18:36:50.615 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T18:36:50.615 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-26T18:36:50.615 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-26 18:33:39.470231761 +0000 2024-04-26T18:36:50.615 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-26 18:33:39.470231761 +0000 2024-04-26T18:36:50.615 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-26 18:36:25.674881283 +0000 2024-04-26T18:36:50.615 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-26 18:33:39.470231761 +0000 2024-04-26T18:36:50.615 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-26T18:36:50.616 DEBUG:teuthology.orchestra.run.smithi080:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-26T18:36:50.688 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T18:36:50.743 INFO:tasks.workunit.client.0.smithi080.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-26T18:36:50.850 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:36:51.105 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:50 smithi080 ceph-mon[29135]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.5 KiB/s wr, 16 op/s 2024-04-26T18:36:51.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:50 smithi192 ceph-mon[32842]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.5 KiB/s wr, 16 op/s 2024-04-26T18:36:51.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:50 smithi082 ceph-mon[32808]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.5 KiB/s wr, 16 op/s 2024-04-26T18:36:52.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.590+0000 7fb93e438700 1 -- 172.21.15.80:0/73076818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb938103e30 msgr2=0x7fb938110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:52.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.590+0000 7fb93e438700 1 --2- 172.21.15.80:0/73076818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb938103e30 0x7fb938110290 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb93000b0a0 tx=0x7fb93000b3b0 comp rx=0 tx=0).stop 2024-04-26T18:36:52.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.590+0000 7fb93e438700 1 -- 172.21.15.80:0/73076818 shutdown_connections 2024-04-26T18:36:52.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.590+0000 7fb93e438700 1 --2- 172.21.15.80:0/73076818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb938103e30 0x7fb938110290 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:52.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.590+0000 7fb93e438700 1 --2- 172.21.15.80:0/73076818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9381094c0 0x7fb9381098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:52.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.590+0000 7fb93e438700 1 --2- 172.21.15.80:0/73076818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb938103470 0x7fb9381038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:52.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.590+0000 7fb93e438700 1 -- 172.21.15.80:0/73076818 >> 172.21.15.80:0/73076818 conn(0x7fb93807a580 msgr2=0x7fb93807a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:52.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.590+0000 7fb93e438700 1 -- 172.21.15.80:0/73076818 shutdown_connections 2024-04-26T18:36:52.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.591+0000 7fb93e438700 1 -- 172.21.15.80:0/73076818 wait complete. 2024-04-26T18:36:52.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.591+0000 7fb93e438700 1 Processor -- start 2024-04-26T18:36:52.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.591+0000 7fb93e438700 1 -- start start 2024-04-26T18:36:52.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.591+0000 7fb93e438700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb938103470 0x7fb938075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:52.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.592+0000 7fb93e438700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb938103e30 0x7fb938075c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:52.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.592+0000 7fb93e438700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9381094c0 0x7fb9380761a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:52.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.592+0000 7fb93e438700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb9381135c0 con 0x7fb938103470 2024-04-26T18:36:52.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.592+0000 7fb93e438700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb938113440 con 0x7fb9381094c0 2024-04-26T18:36:52.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.592+0000 7fb93e438700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb938113740 con 0x7fb938103e30 2024-04-26T18:36:52.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.592+0000 7fb937fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb938103470 0x7fb938075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:52.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.592+0000 7fb937fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb938103470 0x7fb938075720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55888/0 (socket says 172.21.15.80:55888) 2024-04-26T18:36:52.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.592+0000 7fb937fff700 1 -- 172.21.15.80:0/2311220422 learned_addr learned my addr 172.21.15.80:0/2311220422 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:52.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.592+0000 7fb9377fe700 1 --2- 172.21.15.80:0/2311220422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb938103e30 0x7fb938075c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:52.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.592+0000 7fb93c9d5700 1 --2- 172.21.15.80:0/2311220422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9381094c0 0x7fb9380761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:52.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.592+0000 7fb937fff700 1 -- 172.21.15.80:0/2311220422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb938103e30 msgr2=0x7fb938075c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:52.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.592+0000 7fb937fff700 1 --2- 172.21.15.80:0/2311220422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb938103e30 0x7fb938075c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:52.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.592+0000 7fb937fff700 1 -- 172.21.15.80:0/2311220422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9381094c0 msgr2=0x7fb9380761a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:52.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.592+0000 7fb937fff700 1 --2- 172.21.15.80:0/2311220422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9381094c0 0x7fb9380761a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:52.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.592+0000 7fb937fff700 1 -- 172.21.15.80:0/2311220422 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9381a7f20 con 0x7fb938103470 2024-04-26T18:36:52.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.592+0000 7fb9377fe700 1 --2- 172.21.15.80:0/2311220422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb938103e30 0x7fb938075c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:36:52.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.592+0000 7fb937fff700 1 --2- 172.21.15.80:0/2311220422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb938103470 0x7fb938075720 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb92800d950 tx=0x7fb92800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:52.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.592+0000 7fb9357fa700 1 -- 172.21.15.80:0/2311220422 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb928016070 con 0x7fb938103470 2024-04-26T18:36:52.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.592+0000 7fb93e438700 1 -- 172.21.15.80:0/2311220422 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9381a8210 con 0x7fb938103470 2024-04-26T18:36:52.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.592+0000 7fb9357fa700 1 -- 172.21.15.80:0/2311220422 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb928010460 con 0x7fb938103470 2024-04-26T18:36:52.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.592+0000 7fb9357fa700 1 -- 172.21.15.80:0/2311220422 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92800f620 con 0x7fb938103470 2024-04-26T18:36:52.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.592+0000 7fb93e438700 1 -- 172.21.15.80:0/2311220422 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9381a8750 con 0x7fb938103470 2024-04-26T18:36:52.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.593+0000 7fb93e438700 1 -- 172.21.15.80:0/2311220422 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb93806a110 con 0x7fb938103470 2024-04-26T18:36:52.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.594+0000 7fb9357fa700 1 -- 172.21.15.80:0/2311220422 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 24) ==== 138873+0+0 (secure 0 0 0) 0x7fb928019070 con 0x7fb938103470 2024-04-26T18:36:52.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.595+0000 7fb9357fa700 1 --2- 172.21.15.80:0/2311220422 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fb9200a3ed0 0x7fb9200a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:52.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.595+0000 7fb9377fe700 1 --2- 172.21.15.80:0/2311220422 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fb9200a3ed0 0x7fb9200a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:52.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.595+0000 7fb9357fa700 1 -- 172.21.15.80:0/2311220422 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fb9280d0660 con 0x7fb938103470 2024-04-26T18:36:52.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.596+0000 7fb9377fe700 1 --2- 172.21.15.80:0/2311220422 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fb9200a3ed0 0x7fb9200a6390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb92c005fd0 tx=0x7fb92c005e30 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:52.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.600+0000 7fb9357fa700 1 -- 172.21.15.80:0/2311220422 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb92809cb00 con 0x7fb938103470 2024-04-26T18:36:52.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.849+0000 7fb93e438700 1 -- 172.21.15.80:0/2311220422 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb93802e650 con 0x7fb938103470 2024-04-26T18:36:52.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.849+0000 7fb9357fa700 1 -- 172.21.15.80:0/2311220422 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11918 (secure 0 0 0) 0x7fb92809c400 con 0x7fb938103470 2024-04-26T18:36:52.850 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:36:52.850 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1967550873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1967550873},{"type":"v1","addr":"172.21.15.80:6835","nonce":1967550873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/559541830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":559541830},{"type":"v1","addr":"172.21.15.80:6837","nonce":559541830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T18:33:08.347399+0000","modified":"2024-04-26T18:36:26.401600+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24434,"mds_1":24421,"mds_2":24404,"mds_3":24400,"mds_4":24394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14577":{"gid":14577,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6839/2137993298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":2137993298},{"type":"v1","addr":"172.21.15.80:6839","nonce":2137993298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6841/1544670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1544670},{"type":"v1","addr":"172.21.15.80:6841","nonce":1544670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24371":{"gid":24371,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/3564539039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3564539039},{"type":"v1","addr":"172.21.15.82:6833","nonce":3564539039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24379":{"gid":24379,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/572065563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":572065563},{"type":"v1","addr":"172.21.15.82:6835","nonce":572065563}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.192:6835/719058020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":719058020},{"type":"v1","addr":"172.21.15.192:6835","nonce":719058020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.192:6837/2361996920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2361996920},{"type":"v1","addr":"172.21.15.192:6837","nonce":2361996920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.82:6837/2084055551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2084055551},{"type":"v1","addr":"172.21.15.82:6837","nonce":2084055551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6839/2735406056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":2735406056},{"type":"v1","addr":"172.21.15.192:6839","nonce":2735406056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.82:6839/1482576497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1482576497},{"type":"v1","addr":"172.21.15.82:6839","nonce":1482576497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24434,"qdb_cluster":[24421,24400,24394,24404,24434]},"id":1}]} 2024-04-26T18:36:52.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.852+0000 7fb93e438700 1 -- 172.21.15.80:0/2311220422 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fb9200a3ed0 msgr2=0x7fb9200a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:52.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.852+0000 7fb93e438700 1 --2- 172.21.15.80:0/2311220422 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fb9200a3ed0 0x7fb9200a6390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb92c005fd0 tx=0x7fb92c005e30 comp rx=0 tx=0).stop 2024-04-26T18:36:52.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.852+0000 7fb93e438700 1 -- 172.21.15.80:0/2311220422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb938103470 msgr2=0x7fb938075720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:52.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.852+0000 7fb93e438700 1 --2- 172.21.15.80:0/2311220422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb938103470 0x7fb938075720 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb92800d950 tx=0x7fb92800dd10 comp rx=0 tx=0).stop 2024-04-26T18:36:52.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.852+0000 7fb93e438700 1 -- 172.21.15.80:0/2311220422 shutdown_connections 2024-04-26T18:36:52.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.852+0000 7fb93e438700 1 --2- 172.21.15.80:0/2311220422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9381094c0 0x7fb9380761a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:52.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.852+0000 7fb93e438700 1 --2- 172.21.15.80:0/2311220422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb938103470 0x7fb938075720 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:52.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.852+0000 7fb93e438700 1 --2- 172.21.15.80:0/2311220422 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fb9200a3ed0 0x7fb9200a6390 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:52.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.852+0000 7fb93e438700 1 --2- 172.21.15.80:0/2311220422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb938103e30 0x7fb938075c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:52.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.852+0000 7fb93e438700 1 -- 172.21.15.80:0/2311220422 >> 172.21.15.80:0/2311220422 conn(0x7fb93807a580 msgr2=0x7fb9381020a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:52.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.852+0000 7fb93e438700 1 -- 172.21.15.80:0/2311220422 shutdown_connections 2024-04-26T18:36:52.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:52.852+0000 7fb93e438700 1 -- 172.21.15.80:0/2311220422 wait complete. 2024-04-26T18:36:52.853 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 27 2024-04-26T18:36:53.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:52 smithi192 ceph-mon[32842]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-04-26T18:36:53.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:52 smithi082 ceph-mon[32808]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-04-26T18:36:53.220 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:52 smithi080 ceph-mon[29135]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-04-26T18:36:53.566 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-26T18:33:08.347399+0000', 'modified': '2024-04-26T18:36:26.401600+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24434, 'mds_1': 24421, 'mds_2': 24404, 'mds_3': 24400, 'mds_4': 24394}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14577': {'gid': 14577, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.80:6839/2137993298', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6838', 'nonce': 2137993298}, {'type': 'v1', 'addr': '172.21.15.80:6839', 'nonce': 2137993298}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14583': {'gid': 14583, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.80:6841/1544670', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6840', 'nonce': 1544670}, {'type': 'v1', 'addr': '172.21.15.80:6841', 'nonce': 1544670}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24371': {'gid': 24371, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6833/3564539039', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6832', 'nonce': 3564539039}, {'type': 'v1', 'addr': '172.21.15.82:6833', 'nonce': 3564539039}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24379': {'gid': 24379, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.192:6833/2905926211', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6832', 'nonce': 2905926211}, {'type': 'v1', 'addr': '172.21.15.192:6833', 'nonce': 2905926211}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24392': {'gid': 24392, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6835/572065563', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6834', 'nonce': 572065563}, {'type': 'v1', 'addr': '172.21.15.82:6835', 'nonce': 572065563}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24394': {'gid': 24394, 'name': 'f', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.192:6835/719058020', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6834', 'nonce': 719058020}, {'type': 'v1', 'addr': '172.21.15.192:6835', 'nonce': 719058020}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24400': {'gid': 24400, 'name': 'c', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.192:6837/2361996920', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6836', 'nonce': 2361996920}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 2361996920}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24404': {'gid': 24404, 'name': 'h', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.82:6837/2084055551', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6836', 'nonce': 2084055551}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 2084055551}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24421': {'gid': 24421, 'name': 'i', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.192:6839/2735406056', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6838', 'nonce': 2735406056}, {'type': 'v1', 'addr': '172.21.15.192:6839', 'nonce': 2735406056}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24434': {'gid': 24434, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.82:6839/1482576497', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 1482576497}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 1482576497}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24434, 'qdb_cluster': [24421, 24400, 24394, 24404, 24434]} 2024-04-26T18:36:53.566 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-26T18:36:53.566 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell mds.f status 2024-04-26T18:36:53.847 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:36:54.106 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:53 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2311220422' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:36:54.113 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:53 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/2311220422' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:36:54.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:53 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/2311220422' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:36:54.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:54 smithi080 ceph-mon[29135]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-04-26T18:36:55.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:54 smithi192 ceph-mon[32842]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-04-26T18:36:55.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:54 smithi082 ceph-mon[32808]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-04-26T18:36:55.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.553+0000 7f616f00a700 1 -- 172.21.15.80:0/110765826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6168102ce0 msgr2=0x7f616810f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:55.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.553+0000 7f616f00a700 1 --2- 172.21.15.80:0/110765826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6168102ce0 0x7f616810f1d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f616000b0a0 tx=0x7f616000b3b0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.553+0000 7f616f00a700 1 -- 172.21.15.80:0/110765826 shutdown_connections 2024-04-26T18:36:55.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.553+0000 7f616f00a700 1 --2- 172.21.15.80:0/110765826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6168102ce0 0x7f616810f1d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.553+0000 7f616f00a700 1 --2- 172.21.15.80:0/110765826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6168108390 0x7f6168108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.553+0000 7f616f00a700 1 --2- 172.21.15.80:0/110765826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6168102320 0x7f61681027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.553+0000 7f616f00a700 1 -- 172.21.15.80:0/110765826 >> 172.21.15.80:0/110765826 conn(0x7f61680792d0 msgr2=0x7f61680796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:55.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.553+0000 7f616f00a700 1 -- 172.21.15.80:0/110765826 shutdown_connections 2024-04-26T18:36:55.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.553+0000 7f616f00a700 1 -- 172.21.15.80:0/110765826 wait complete. 2024-04-26T18:36:55.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.554+0000 7f616f00a700 1 Processor -- start 2024-04-26T18:36:55.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.554+0000 7f616f00a700 1 -- start start 2024-04-26T18:36:55.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.554+0000 7f616f00a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6168102320 0x7f616819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:55.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.554+0000 7f616f00a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6168102ce0 0x7f616819af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:55.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.554+0000 7f616f00a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6168108390 0x7f61681a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:55.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.554+0000 7f616f00a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6168112530 con 0x7f6168108390 2024-04-26T18:36:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.554+0000 7f616f00a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f61681123b0 con 0x7f6168102ce0 2024-04-26T18:36:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.554+0000 7f616f00a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f61681126b0 con 0x7f6168102320 2024-04-26T18:36:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.554+0000 7f616d5a7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6168108390 0x7f61681a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.554+0000 7f616d5a7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6168108390 0x7f61681a5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47950/0 (socket says 172.21.15.80:47950) 2024-04-26T18:36:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.554+0000 7f616d5a7700 1 -- 172.21.15.80:0/138414943 learned_addr learned my addr 172.21.15.80:0/138414943 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.554+0000 7f6167fff700 1 --2- 172.21.15.80:0/138414943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6168102ce0 0x7f616819af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.554+0000 7f616cda6700 1 --2- 172.21.15.80:0/138414943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6168102320 0x7f616819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.554+0000 7f616d5a7700 1 -- 172.21.15.80:0/138414943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6168102320 msgr2=0x7f616819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.554+0000 7f616d5a7700 1 --2- 172.21.15.80:0/138414943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6168102320 0x7f616819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.554+0000 7f616d5a7700 1 -- 172.21.15.80:0/138414943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6168102ce0 msgr2=0x7f616819af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.554+0000 7f616d5a7700 1 --2- 172.21.15.80:0/138414943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6168102ce0 0x7f616819af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.554+0000 7f616d5a7700 1 -- 172.21.15.80:0/138414943 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61681a5ff0 con 0x7f6168108390 2024-04-26T18:36:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.554+0000 7f6167fff700 1 --2- 172.21.15.80:0/138414943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6168102ce0 0x7f616819af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:36:55.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.555+0000 7f616d5a7700 1 --2- 172.21.15.80:0/138414943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6168108390 0x7f61681a5ab0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f616000b830 tx=0x7f6160004d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.555+0000 7f6165ffb700 1 -- 172.21.15.80:0/138414943 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6160021070 con 0x7f6168108390 2024-04-26T18:36:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.555+0000 7f6165ffb700 1 -- 172.21.15.80:0/138414943 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6160003c00 con 0x7f6168108390 2024-04-26T18:36:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.555+0000 7f616f00a700 1 -- 172.21.15.80:0/138414943 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61681a61c0 con 0x7f6168108390 2024-04-26T18:36:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.555+0000 7f6165ffb700 1 -- 172.21.15.80:0/138414943 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6160004730 con 0x7f6168108390 2024-04-26T18:36:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.555+0000 7f616f00a700 1 -- 172.21.15.80:0/138414943 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61681a65c0 con 0x7f6168108390 2024-04-26T18:36:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.557+0000 7f6165ffb700 1 -- 172.21.15.80:0/138414943 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 24) ==== 138873+0+0 (secure 0 0 0) 0x7f6160007a00 con 0x7f6168108390 2024-04-26T18:36:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.557+0000 7f6165ffb700 1 --2- 172.21.15.80:0/138414943 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f61580a3ed0 0x7f61580a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.558+0000 7f616cda6700 1 --2- 172.21.15.80:0/138414943 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f61580a3ed0 0x7f61580a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.558+0000 7f6165ffb700 1 -- 172.21.15.80:0/138414943 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f616000f020 con 0x7f6168108390 2024-04-26T18:36:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.558+0000 7f616cda6700 1 --2- 172.21.15.80:0/138414943 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f61580a3ed0 0x7f61580a6390 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f615c005950 tx=0x7f615c0058e0 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.558+0000 7f617989cb80 1 Processor -- start 2024-04-26T18:36:55.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.558+0000 7f617989cb80 1 -- start start 2024-04-26T18:36:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.559+0000 7f617989cb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baabad0 0x55805baabeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.559+0000 7f617989cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55805baac3f0 0x55805baa5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.559+0000 7f617989cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805baa62d0 0x55805baa6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.559+0000 7f617989cb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55805b9f86f0 con 0x55805baabad0 2024-04-26T18:36:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.559+0000 7f617989cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55805b997590 con 0x55805baac3f0 2024-04-26T18:36:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.559+0000 7f617989cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55805b9f46b0 con 0x55805baa62d0 2024-04-26T18:36:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.559+0000 7f616cda6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baabad0 0x55805baabeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.559+0000 7f616cda6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baabad0 0x55805baabeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47966/0 (socket says 172.21.15.80:47966) 2024-04-26T18:36:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.559+0000 7f616cda6700 1 -- 172.21.15.80:0/2148453303 learned_addr learned my addr 172.21.15.80:0/2148453303 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.559+0000 7f616d5a7700 1 --2- 172.21.15.80:0/2148453303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805baa62d0 0x55805baa6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.559+0000 7f6167fff700 1 --2- 172.21.15.80:0/2148453303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55805baac3f0 0x55805baa5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.559+0000 7f616cda6700 1 -- 172.21.15.80:0/2148453303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805baa62d0 msgr2=0x55805baa6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:55.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.559+0000 7f616cda6700 1 --2- 172.21.15.80:0/2148453303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805baa62d0 0x55805baa6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.559+0000 7f616cda6700 1 -- 172.21.15.80:0/2148453303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55805baac3f0 msgr2=0x55805baa5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:55.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.559+0000 7f616cda6700 1 --2- 172.21.15.80:0/2148453303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55805baac3f0 0x55805baa5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.559+0000 7f616cda6700 1 -- 172.21.15.80:0/2148453303 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55805b945880 con 0x55805baabad0 2024-04-26T18:36:55.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.559+0000 7f6167fff700 1 --2- 172.21.15.80:0/2148453303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55805baac3f0 0x55805baa5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:36:55.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.559+0000 7f616cda6700 1 --2- 172.21.15.80:0/2148453303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baabad0 0x55805baabeb0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f615c00fd70 tx=0x7f615c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb4b7a79a3adf5f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:55.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.559+0000 7f6152ffd700 1 -- 172.21.15.80:0/2148453303 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f615c022070 con 0x55805baabad0 2024-04-26T18:36:55.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.559+0000 7f6152ffd700 1 -- 172.21.15.80:0/2148453303 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f615c011bb0 con 0x55805baabad0 2024-04-26T18:36:55.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.559+0000 7f6152ffd700 1 -- 172.21.15.80:0/2148453303 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f615c01d610 con 0x55805baabad0 2024-04-26T18:36:55.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.560+0000 7f617989cb80 1 -- 172.21.15.80:0/2148453303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baabad0 msgr2=0x55805baabeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:55.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.560+0000 7f617989cb80 1 --2- 172.21.15.80:0/2148453303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baabad0 0x55805baabeb0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f615c00fd70 tx=0x7f615c012000 comp rx=0 tx=0).stop 2024-04-26T18:36:55.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.560+0000 7f617989cb80 1 -- 172.21.15.80:0/2148453303 shutdown_connections 2024-04-26T18:36:55.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.560+0000 7f617989cb80 1 --2- 172.21.15.80:0/2148453303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805baa62d0 0x55805baa6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.560+0000 7f617989cb80 1 --2- 172.21.15.80:0/2148453303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baabad0 0x55805baabeb0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.560+0000 7f617989cb80 1 --2- 172.21.15.80:0/2148453303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55805baac3f0 0x55805baa5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.560+0000 7f617989cb80 1 -- 172.21.15.80:0/2148453303 >> 172.21.15.80:0/2148453303 conn(0x55805b9d2cf0 msgr2=0x55805baa11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:55.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.560+0000 7f617989cb80 1 -- 172.21.15.80:0/2148453303 shutdown_connections 2024-04-26T18:36:55.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.560+0000 7f617989cb80 1 -- 172.21.15.80:0/2148453303 wait complete. 2024-04-26T18:36:55.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.560+0000 7f617989cb80 1 -- start start 2024-04-26T18:36:55.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.561+0000 7f617989cb80 1 Processor -- start 2024-04-26T18:36:55.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.561+0000 7f617989cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55805baa62d0 0x55805bab2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:55.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.561+0000 7f617989cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805baabad0 0x55805baaf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:55.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.561+0000 7f617989cb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baac3f0 0x55805baafa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:55.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.561+0000 7f617989cb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55805bab2f10 con 0x55805baac3f0 2024-04-26T18:36:55.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.561+0000 7f617989cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55805b95e900 con 0x55805baa62d0 2024-04-26T18:36:55.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.561+0000 7f617989cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55805bab3090 con 0x55805baabad0 2024-04-26T18:36:55.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.561+0000 7f617989cb80 10 client.0 _ll_register_callbacks cb 0x55805b98c530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:36:55.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.561+0000 7f616d5a7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baac3f0 0x55805baafa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:55.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.561+0000 7f616d5a7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baac3f0 0x55805baafa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47972/0 (socket says 172.21.15.80:47972) 2024-04-26T18:36:55.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.561+0000 7f616d5a7700 1 -- 172.21.15.80:0/1456520325 learned_addr learned my addr 172.21.15.80:0/1456520325 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:55.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.561+0000 7f6167fff700 1 --2- 172.21.15.80:0/1456520325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805baabad0 0x55805baaf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:55.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.561+0000 7f616cda6700 1 --2- 172.21.15.80:0/1456520325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55805baa62d0 0x55805bab2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:55.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.561+0000 7f616d5a7700 1 -- 172.21.15.80:0/1456520325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805baabad0 msgr2=0x55805baaf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:55.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.561+0000 7f616d5a7700 1 --2- 172.21.15.80:0/1456520325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805baabad0 0x55805baaf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.561+0000 7f616d5a7700 1 -- 172.21.15.80:0/1456520325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55805baa62d0 msgr2=0x55805bab2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:55.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.561+0000 7f616d5a7700 1 --2- 172.21.15.80:0/1456520325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55805baa62d0 0x55805bab2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.561+0000 7f616d5a7700 1 -- 172.21.15.80:0/1456520325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55805bab0160 con 0x55805baac3f0 2024-04-26T18:36:55.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.562+0000 7f616d5a7700 1 --2- 172.21.15.80:0/1456520325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baac3f0 0x55805baafa50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f616009a420 tx=0x7f616009dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c67c15f0e080fe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:55.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.562+0000 7f6147fff700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:36:55.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.562+0000 7f6147fff700 1 -- 172.21.15.80:0/1456520325 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61600b6020 con 0x55805baac3f0 2024-04-26T18:36:55.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.562+0000 7f6147fff700 1 -- 172.21.15.80:0/1456520325 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f6160003fb0 con 0x55805baac3f0 2024-04-26T18:36:55.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.562+0000 7f617989cb80 1 -- 172.21.15.80:0/1456520325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f615c011bb0 con 0x55805baac3f0 2024-04-26T18:36:55.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.562+0000 7f6147fff700 1 -- 172.21.15.80:0/1456520325 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f616009e6c0 con 0x55805baac3f0 2024-04-26T18:36:55.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.562+0000 7f617989cb80 10 client.15369 fetch_fsmap learned FSMap version 27 2024-04-26T18:36:55.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.562+0000 7f617989cb80 1 -- 172.21.15.80:0/1456520325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55805babda10 con 0x55805baac3f0 2024-04-26T18:36:55.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.562+0000 7f6147fff700 1 -- 172.21.15.80:0/1456520325 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f615c011bb0 con 0x55805baac3f0 2024-04-26T18:36:55.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.562+0000 7f6147fff700 1 -- 172.21.15.80:0/1456520325 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f61600a0030 con 0x55805baac3f0 2024-04-26T18:36:55.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.562+0000 7f617989cb80 10 client.15369 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:36:55.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.562+0000 7f617989cb80 10 client.15369 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-26T18:36:55.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.562+0000 7f617989cb80 20 client.15369 populate_metadata read hostname 'smithi080' 2024-04-26T18:36:55.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.562+0000 7f617989cb80 1 --2- 172.21.15.80:0/1456520325 >> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] conn(0x55805bac0040 0x55805bac14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:55.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.562+0000 7f617989cb80 4 client.15369 mds_command: new command op to 24394 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:36:55.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.563+0000 7f617989cb80 1 -- 172.21.15.80:0/1456520325 --> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55805ba060d0 con 0x55805bac0040 2024-04-26T18:36:55.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.563+0000 7f616cda6700 1 --2- 172.21.15.80:0/1456520325 >> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] conn(0x55805bac0040 0x55805bac14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:55.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.563+0000 7f6147fff700 10 client.15369 ms_handle_connect on v2:172.21.15.192:6834/719058020 2024-04-26T18:36:55.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.563+0000 7f616cda6700 1 --2- 172.21.15.80:0/1456520325 >> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] conn(0x55805bac0040 0x55805bac14b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2961b4faf5db6f4d server_cookie=1c7aeb4ca1f0ca20 in_seq=0 out_seq=0 2024-04-26T18:36:55.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.564+0000 7f6147fff700 1 -- 172.21.15.80:0/1456520325 <== mds.4 v2:172.21.15.192:6834/719058020 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55805ba060d0 con 0x55805bac0040 2024-04-26T18:36:55.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.564+0000 7f6147fff700 10 client.15369 handle_command_reply: tid=0 2024-04-26T18:36:55.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.564+0000 7f617989cb80 1 client.15369 shutdown 2024-04-26T18:36:55.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.564+0000 7f617989cb80 1 -- 172.21.15.80:0/1456520325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baac3f0 msgr2=0x55805baafa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:55.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.564+0000 7f617989cb80 1 --2- 172.21.15.80:0/1456520325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baac3f0 0x55805baafa50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f616009a420 tx=0x7f616009dbf0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.564+0000 7f617989cb80 1 -- 172.21.15.80:0/1456520325 shutdown_connections 2024-04-26T18:36:55.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.564+0000 7f617989cb80 1 --2- 172.21.15.80:0/1456520325 >> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] conn(0x55805bac0040 0x55805bac14b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.564+0000 7f6147fff700 0 client.15369 ms_handle_reset on v2:172.21.15.192:6834/719058020 2024-04-26T18:36:55.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.564+0000 7f617989cb80 1 --2- 172.21.15.80:0/1456520325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baac3f0 0x55805baafa50 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.564+0000 7f617989cb80 1 --2- 172.21.15.80:0/1456520325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55805baa62d0 0x55805bab2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.564+0000 7f617989cb80 1 --2- 172.21.15.80:0/1456520325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805baabad0 0x55805baaf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.564+0000 7f617989cb80 1 -- 172.21.15.80:0/1456520325 >> 172.21.15.80:0/1456520325 conn(0x55805b9d2cf0 msgr2=0x55805baa0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:55.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.564+0000 7f617989cb80 1 -- 172.21.15.80:0/1456520325 shutdown_connections 2024-04-26T18:36:55.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.564+0000 7f617989cb80 1 -- 172.21.15.80:0/1456520325 wait complete. 2024-04-26T18:36:55.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.564+0000 7f617989cb80 20 client.15369 trim_cache size 0 max 16384 2024-04-26T18:36:55.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.584+0000 7f617989cb80 1 Processor -- start 2024-04-26T18:36:55.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.584+0000 7f617989cb80 1 -- start start 2024-04-26T18:36:55.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.585+0000 7f617989cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805baa62d0 0x55805baa5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:55.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.585+0000 7f617989cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55805baabad0 0x55805babc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:55.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.585+0000 7f617989cb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baac3f0 0x55805baa0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:55.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.585+0000 7f617989cb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55805babf7f0 con 0x55805baac3f0 2024-04-26T18:36:55.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.585+0000 7f617989cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55805babfec0 con 0x55805baabad0 2024-04-26T18:36:55.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.585+0000 7f617989cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55805bac0590 con 0x55805baa62d0 2024-04-26T18:36:55.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.585+0000 7f616d5a7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baac3f0 0x55805baa0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:55.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.585+0000 7f616d5a7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baac3f0 0x55805baa0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47988/0 (socket says 172.21.15.80:47988) 2024-04-26T18:36:55.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.585+0000 7f616d5a7700 1 -- 172.21.15.80:0/4078471511 learned_addr learned my addr 172.21.15.80:0/4078471511 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:55.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.585+0000 7f6167fff700 1 --2- 172.21.15.80:0/4078471511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55805baabad0 0x55805babc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:55.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.585+0000 7f616d5a7700 1 -- 172.21.15.80:0/4078471511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805baa62d0 msgr2=0x55805baa5cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T18:36:55.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.585+0000 7f616d5a7700 1 --2- 172.21.15.80:0/4078471511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805baa62d0 0x55805baa5cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.585+0000 7f616d5a7700 1 -- 172.21.15.80:0/4078471511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55805baabad0 msgr2=0x55805babc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:55.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.585+0000 7f616d5a7700 1 --2- 172.21.15.80:0/4078471511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55805baabad0 0x55805babc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.585+0000 7f616d5a7700 1 -- 172.21.15.80:0/4078471511 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55805bab26e0 con 0x55805baac3f0 2024-04-26T18:36:55.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.585+0000 7f616d5a7700 1 --2- 172.21.15.80:0/4078471511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baac3f0 0x55805baa0c90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6160009fd0 tx=0x7f616009c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34858138ffb83ea6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:55.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.585+0000 7f61527fc700 1 -- 172.21.15.80:0/4078471511 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61600b6070 con 0x55805baac3f0 2024-04-26T18:36:55.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.586+0000 7f61527fc700 1 -- 172.21.15.80:0/4078471511 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61600a2370 con 0x55805baac3f0 2024-04-26T18:36:55.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.586+0000 7f61527fc700 1 -- 172.21.15.80:0/4078471511 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61600cf9c0 con 0x55805baac3f0 2024-04-26T18:36:55.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.586+0000 7f617989cb80 1 -- 172.21.15.80:0/4078471511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baac3f0 msgr2=0x55805baa0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.586+0000 7f617989cb80 1 --2- 172.21.15.80:0/4078471511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baac3f0 0x55805baa0c90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6160009fd0 tx=0x7f616009c4d0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.586+0000 7f617989cb80 1 -- 172.21.15.80:0/4078471511 shutdown_connections 2024-04-26T18:36:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.586+0000 7f617989cb80 1 --2- 172.21.15.80:0/4078471511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baac3f0 0x55805baa0c90 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.586+0000 7f617989cb80 1 --2- 172.21.15.80:0/4078471511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805baa62d0 0x55805baa5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.586+0000 7f617989cb80 1 --2- 172.21.15.80:0/4078471511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55805baabad0 0x55805babc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.586+0000 7f617989cb80 1 -- 172.21.15.80:0/4078471511 >> 172.21.15.80:0/4078471511 conn(0x55805b9d2cf0 msgr2=0x55805babed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.586+0000 7f617989cb80 1 -- 172.21.15.80:0/4078471511 shutdown_connections 2024-04-26T18:36:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.586+0000 7f617989cb80 1 -- 172.21.15.80:0/4078471511 wait complete. 2024-04-26T18:36:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.587+0000 7f617989cb80 1 -- start start 2024-04-26T18:36:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.587+0000 7f617989cb80 1 Processor -- start 2024-04-26T18:36:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.587+0000 7f617989cb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baa62d0 0x55805bab1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.587+0000 7f617989cb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805baabad0 0x55805bab1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:55.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.587+0000 7f617989cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55805baac3f0 0x55805bab1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.587+0000 7f617989cb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55805bac1330 con 0x55805baa62d0 2024-04-26T18:36:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.587+0000 7f617989cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55805bac0c60 con 0x55805baac3f0 2024-04-26T18:36:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.587+0000 7f617989cb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55805bac1a00 con 0x55805baabad0 2024-04-26T18:36:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.587+0000 7f617989cb80 10 client.0 _ll_register_callbacks cb 0x55805b98c530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:36:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.587+0000 7f616cda6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baa62d0 0x55805bab1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.587+0000 7f616cda6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baa62d0 0x55805bab1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47992/0 (socket says 172.21.15.80:47992) 2024-04-26T18:36:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.587+0000 7f616cda6700 1 -- 172.21.15.80:0/2696014830 learned_addr learned my addr 172.21.15.80:0/2696014830 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.587+0000 7f6167fff700 1 --2- 172.21.15.80:0/2696014830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805baabad0 0x55805bab1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.587+0000 7f616d5a7700 1 --2- 172.21.15.80:0/2696014830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55805baac3f0 0x55805bab1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.588+0000 7f616cda6700 1 -- 172.21.15.80:0/2696014830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805baabad0 msgr2=0x55805bab1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.588+0000 7f616cda6700 1 --2- 172.21.15.80:0/2696014830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805baabad0 0x55805bab1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.588+0000 7f616cda6700 1 -- 172.21.15.80:0/2696014830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55805baac3f0 msgr2=0x55805bab1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.588+0000 7f616cda6700 1 --2- 172.21.15.80:0/2696014830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55805baac3f0 0x55805bab1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.588+0000 7f616cda6700 1 -- 172.21.15.80:0/2696014830 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55805bac7a80 con 0x55805baa62d0 2024-04-26T18:36:55.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.588+0000 7f6167fff700 1 --2- 172.21.15.80:0/2696014830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805baabad0 0x55805bab1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:36:55.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.588+0000 7f616cda6700 1 --2- 172.21.15.80:0/2696014830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baa62d0 0x55805bab1300 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f615c011a00 tx=0x7f615c00bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6b93c5a1b76b1e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:55.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.588+0000 7f6147fff700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:36:55.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.588+0000 7f6147fff700 1 -- 172.21.15.80:0/2696014830 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f615c022030 con 0x55805baa62d0 2024-04-26T18:36:55.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.588+0000 7f6147fff700 1 -- 172.21.15.80:0/2696014830 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f615c005240 con 0x55805baa62d0 2024-04-26T18:36:55.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.588+0000 7f617989cb80 1 -- 172.21.15.80:0/2696014830 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61600a2370 con 0x55805baa62d0 2024-04-26T18:36:55.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.588+0000 7f6147fff700 1 -- 172.21.15.80:0/2696014830 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f615c042050 con 0x55805baa62d0 2024-04-26T18:36:55.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.588+0000 7f617989cb80 10 client.15375 fetch_fsmap learned FSMap version 27 2024-04-26T18:36:55.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.588+0000 7f617989cb80 1 -- 172.21.15.80:0/2696014830 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55805bb2b8c0 con 0x55805baa62d0 2024-04-26T18:36:55.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.588+0000 7f6147fff700 1 -- 172.21.15.80:0/2696014830 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61600a2370 con 0x55805baa62d0 2024-04-26T18:36:55.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.589+0000 7f6147fff700 1 -- 172.21.15.80:0/2696014830 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f615c01e450 con 0x55805baa62d0 2024-04-26T18:36:55.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.589+0000 7f617989cb80 10 client.15375 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:36:55.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.589+0000 7f617989cb80 10 client.15375 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-26T18:36:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.589+0000 7f617989cb80 20 client.15375 populate_metadata read hostname 'smithi080' 2024-04-26T18:36:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.589+0000 7f617989cb80 1 --2- 172.21.15.80:0/2696014830 >> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] conn(0x55805bb302c0 0x55805bb2efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.589+0000 7f617989cb80 4 client.15375 mds_command: new command op to 24394 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T18:36:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.589+0000 7f617989cb80 1 -- 172.21.15.80:0/2696014830 --> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] -- command(tid 0: {"prefix": "status"}) -- 0x55805ba00170 con 0x55805bb302c0 2024-04-26T18:36:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.589+0000 7f6167fff700 1 --2- 172.21.15.80:0/2696014830 >> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] conn(0x55805bb302c0 0x55805bb2efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.589+0000 7f6167fff700 1 --2- 172.21.15.80:0/2696014830 >> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] conn(0x55805bb302c0 0x55805bb2efd0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=10c3995770026ca4 server_cookie=c3a1c0b8d26377fd in_seq=0 out_seq=0 2024-04-26T18:36:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.589+0000 7f6147fff700 10 client.15375 ms_handle_connect on v2:172.21.15.192:6834/719058020 2024-04-26T18:36:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.590+0000 7f6147fff700 1 -- 172.21.15.80:0/2696014830 <== mds.4 v2:172.21.15.192:6834/719058020 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55805ba00170 con 0x55805bb302c0 2024-04-26T18:36:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.590+0000 7f6147fff700 10 client.15375 handle_command_reply: tid=0 2024-04-26T18:36:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.590+0000 7f617989cb80 1 client.15375 shutdown 2024-04-26T18:36:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.590+0000 7f617989cb80 1 -- 172.21.15.80:0/2696014830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baa62d0 msgr2=0x55805bab1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.590+0000 7f617989cb80 1 --2- 172.21.15.80:0/2696014830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baa62d0 0x55805bab1300 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f615c011a00 tx=0x7f615c00bad0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.590+0000 7f617989cb80 1 -- 172.21.15.80:0/2696014830 shutdown_connections 2024-04-26T18:36:55.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.590+0000 7f617989cb80 1 --2- 172.21.15.80:0/2696014830 >> [v2:172.21.15.192:6834/719058020,v1:172.21.15.192:6835/719058020] conn(0x55805bb302c0 0x55805bb2efd0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.590+0000 7f6147fff700 0 client.15375 ms_handle_reset on v2:172.21.15.192:6834/719058020 2024-04-26T18:36:55.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.590+0000 7f617989cb80 1 --2- 172.21.15.80:0/2696014830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55805baac3f0 0x55805bab1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.590+0000 7f617989cb80 1 --2- 172.21.15.80:0/2696014830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805baa62d0 0x55805bab1300 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.590+0000 7f617989cb80 1 --2- 172.21.15.80:0/2696014830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55805baabad0 0x55805bab1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.590+0000 7f617989cb80 1 -- 172.21.15.80:0/2696014830 >> 172.21.15.80:0/2696014830 conn(0x55805b9d2cf0 msgr2=0x55805baa9620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:55.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.590+0000 7f617989cb80 1 -- 172.21.15.80:0/2696014830 shutdown_connections 2024-04-26T18:36:55.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.590+0000 7f617989cb80 1 -- 172.21.15.80:0/2696014830 wait complete. 2024-04-26T18:36:55.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.590+0000 7f617989cb80 20 client.15375 trim_cache size 0 max 16384 2024-04-26T18:36:55.596 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:36:55.596 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "2187ca98-03fa-11ef-bc93-c7b262605968", 2024-04-26T18:36:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 4, 2024-04-26T18:36:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24394, 2024-04-26T18:36:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-26T18:36:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-26T18:36:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-26T18:36:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 211.92602928299999, 2024-04-26T18:36:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 27, 2024-04-26T18:36:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 92, 2024-04-26T18:36:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 91, 2024-04-26T18:36:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 262.94596755600003 2024-04-26T18:36:55.597 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:36:55.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.591+0000 7f616f00a700 1 -- 172.21.15.80:0/138414943 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f61580a3ed0 msgr2=0x7f61580a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:55.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.591+0000 7f616f00a700 1 --2- 172.21.15.80:0/138414943 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f61580a3ed0 0x7f61580a6390 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f615c005950 tx=0x7f615c0058e0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.591+0000 7f616f00a700 1 -- 172.21.15.80:0/138414943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6168108390 msgr2=0x7f61681a5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:55.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.591+0000 7f616f00a700 1 --2- 172.21.15.80:0/138414943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6168108390 0x7f61681a5ab0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f616000b830 tx=0x7f6160004d90 comp rx=0 tx=0).stop 2024-04-26T18:36:55.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.591+0000 7f616f00a700 1 -- 172.21.15.80:0/138414943 shutdown_connections 2024-04-26T18:36:55.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.591+0000 7f616f00a700 1 --2- 172.21.15.80:0/138414943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6168108390 0x7f61681a5ab0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.591+0000 7f616f00a700 1 --2- 172.21.15.80:0/138414943 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f61580a3ed0 0x7f61580a6390 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.591+0000 7f616f00a700 1 --2- 172.21.15.80:0/138414943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6168102320 0x7f616819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.591+0000 7f616f00a700 1 --2- 172.21.15.80:0/138414943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6168102ce0 0x7f616819af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:55.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.591+0000 7f616f00a700 1 -- 172.21.15.80:0/138414943 >> 172.21.15.80:0/138414943 conn(0x7f61680792d0 msgr2=0x7f6168100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:55.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.591+0000 7f616f00a700 1 -- 172.21.15.80:0/138414943 shutdown_connections 2024-04-26T18:36:55.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:55.591+0000 7f616f00a700 1 -- 172.21.15.80:0/138414943 wait complete. 2024-04-26T18:36:56.296 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell mds.c status 2024-04-26T18:36:56.537 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:36:56.644 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.641+0000 7f3c55b66640 1 -- 172.21.15.80:0/1823710166 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c5006b6a0 msgr2=0x7f3c5006bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:56.644 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.641+0000 7f3c55b66640 1 --2- 172.21.15.80:0/1823710166 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c5006b6a0 0x7f3c5006bb20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009900 tx=0x7f3c4402a410 comp rx=0 tx=0).stop 2024-04-26T18:36:56.644 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.641+0000 7f3c55b66640 1 -- 172.21.15.80:0/1823710166 shutdown_connections 2024-04-26T18:36:56.644 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.641+0000 7f3c55b66640 1 --2- 172.21.15.80:0/1823710166 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c5006b6a0 0x7f3c5006bb20 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.644 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.641+0000 7f3c55b66640 1 --2- 172.21.15.80:0/1823710166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c5010f280 0x7f3c50111670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.644 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.641+0000 7f3c55b66640 1 --2- 172.21.15.80:0/1823710166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c501038e0 0x7f3c5006b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.644 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.641+0000 7f3c55b66640 1 -- 172.21.15.80:0/1823710166 >> 172.21.15.80:0/1823710166 conn(0x7f3c50077630 msgr2=0x7f3c50077a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:56.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.641+0000 7f3c55b66640 1 -- 172.21.15.80:0/1823710166 shutdown_connections 2024-04-26T18:36:56.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.641+0000 7f3c55b66640 1 -- 172.21.15.80:0/1823710166 wait complete. 2024-04-26T18:36:56.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.642+0000 7f3c55b66640 1 Processor -- start 2024-04-26T18:36:56.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.642+0000 7f3c55b66640 1 -- start start 2024-04-26T18:36:56.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.642+0000 7f3c55b66640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c5006b6a0 0x7f3c5019b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:56.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.642+0000 7f3c55b66640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c501038e0 0x7f3c5019b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:56.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.642+0000 7f3c55b66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c5010f280 0x7f3c5019fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:56.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.642+0000 7f3c55b66640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3c50114e80 con 0x7f3c5006b6a0 2024-04-26T18:36:56.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.642+0000 7f3c55b66640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3c50114d00 con 0x7f3c5010f280 2024-04-26T18:36:56.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.642+0000 7f3c55b66640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3c50115000 con 0x7f3c501038e0 2024-04-26T18:36:56.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.642+0000 7f3c4f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c5006b6a0 0x7f3c5019b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:56.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.642+0000 7f3c4f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c5006b6a0 0x7f3c5019b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48002/0 (socket says 172.21.15.80:48002) 2024-04-26T18:36:56.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.642+0000 7f3c4f7fe640 1 -- 172.21.15.80:0/652773973 learned_addr learned my addr 172.21.15.80:0/652773973 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.643+0000 7f3c4effd640 1 --2- 172.21.15.80:0/652773973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c501038e0 0x7f3c5019b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.643+0000 7f3c4ffff640 1 --2- 172.21.15.80:0/652773973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c5010f280 0x7f3c5019fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.643+0000 7f3c4f7fe640 1 -- 172.21.15.80:0/652773973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c501038e0 msgr2=0x7f3c5019b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.643+0000 7f3c4f7fe640 1 --2- 172.21.15.80:0/652773973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c501038e0 0x7f3c5019b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.643+0000 7f3c4f7fe640 1 -- 172.21.15.80:0/652773973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c5010f280 msgr2=0x7f3c5019fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.643+0000 7f3c4f7fe640 1 --2- 172.21.15.80:0/652773973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c5010f280 0x7f3c5019fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.643+0000 7f3c4f7fe640 1 -- 172.21.15.80:0/652773973 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c501a0250 con 0x7f3c5006b6a0 2024-04-26T18:36:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.643+0000 7f3c4f7fe640 1 --2- 172.21.15.80:0/652773973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c5006b6a0 0x7f3c5019b260 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000c920 tx=0x7f3c4000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.643+0000 7f3c4cff9640 1 -- 172.21.15.80:0/652773973 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c40007c70 con 0x7f3c5006b6a0 2024-04-26T18:36:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.643+0000 7f3c4cff9640 1 -- 172.21.15.80:0/652773973 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c40007e10 con 0x7f3c5006b6a0 2024-04-26T18:36:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.643+0000 7f3c55b66640 1 -- 172.21.15.80:0/652773973 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c501a0540 con 0x7f3c5006b6a0 2024-04-26T18:36:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.643+0000 7f3c4cff9640 1 -- 172.21.15.80:0/652773973 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c40018820 con 0x7f3c5006b6a0 2024-04-26T18:36:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.643+0000 7f3c55b66640 1 -- 172.21.15.80:0/652773973 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c501a7dd0 con 0x7f3c5006b6a0 2024-04-26T18:36:56.652 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.645+0000 7f3c4cff9640 1 -- 172.21.15.80:0/652773973 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 24) ==== 138873+0+0 (secure 0 0 0) 0x7f3c4000f450 con 0x7f3c5006b6a0 2024-04-26T18:36:56.652 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.646+0000 7f3c5887f740 1 Processor -- start 2024-04-26T18:36:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.646+0000 7f3c4cff9640 1 --2- 172.21.15.80:0/652773973 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f3c380a3ee0 0x7f3c380a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.646+0000 7f3c5887f740 1 -- start start 2024-04-26T18:36:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.646+0000 7f3c4cff9640 1 -- 172.21.15.80:0/652773973 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f3c400d0b90 con 0x7f3c5006b6a0 2024-04-26T18:36:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.646+0000 7f3c4ffff640 1 --2- 172.21.15.80:0/652773973 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f3c380a3ee0 0x7f3c380a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.646+0000 7f3c5887f740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b00f00 0x562982b012e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.646+0000 7f3c5887f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562982b01820 0x562982b0bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.646+0000 7f3c5887f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562982b0c0e0 0x562982b0e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.646+0000 7f3c5887f740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562982a67460 con 0x562982b00f00 2024-04-26T18:36:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.646+0000 7f3c5887f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562982a21590 con 0x562982b01820 2024-04-26T18:36:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.646+0000 7f3c5887f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562982a63420 con 0x562982b0c0e0 2024-04-26T18:36:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.646+0000 7f3c4f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b00f00 0x562982b012e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:56.654 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.646+0000 7f3c4f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b00f00 0x562982b012e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48004/0 (socket says 172.21.15.80:48004) 2024-04-26T18:36:56.654 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.646+0000 7f3c4f7fe640 1 -- 172.21.15.80:0/4121396581 learned_addr learned my addr 172.21.15.80:0/4121396581 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:56.654 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.646+0000 7f3c4ffff640 1 --2- 172.21.15.80:0/4121396581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562982b0c0e0 0x562982b0e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:56.654 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.646+0000 7f3c4ffff640 1 --2- 172.21.15.80:0/652773973 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f3c380a3ee0 0x7f3c380a63a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3c48005fd0 tx=0x7f3c48010740 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:56.654 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.646+0000 7f3c4effd640 1 --2- 172.21.15.80:0/4121396581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562982b01820 0x562982b0bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:56.654 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.646+0000 7f3c4f7fe640 1 -- 172.21.15.80:0/4121396581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562982b0c0e0 msgr2=0x562982b0e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:56.654 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.646+0000 7f3c4f7fe640 1 --2- 172.21.15.80:0/4121396581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562982b0c0e0 0x562982b0e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.654 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.646+0000 7f3c4f7fe640 1 -- 172.21.15.80:0/4121396581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562982b01820 msgr2=0x562982b0bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:56.654 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.646+0000 7f3c4f7fe640 1 --2- 172.21.15.80:0/4121396581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562982b01820 0x562982b0bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.654 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.646+0000 7f3c4f7fe640 1 -- 172.21.15.80:0/4121396581 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562982a2e0d0 con 0x562982b00f00 2024-04-26T18:36:56.654 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.646+0000 7f3c4ffff640 1 --2- 172.21.15.80:0/4121396581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562982b0c0e0 0x562982b0e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:36:56.654 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.646+0000 7f3c4f7fe640 1 --2- 172.21.15.80:0/4121396581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b00f00 0x562982b012e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3c4009c630 tx=0x7f3c4009c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645c8a05dd626547 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:56.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.647+0000 7f3c35ffb640 1 -- 172.21.15.80:0/4121396581 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c400a0ce0 con 0x562982b00f00 2024-04-26T18:36:56.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.647+0000 7f3c35ffb640 1 -- 172.21.15.80:0/4121396581 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c400a55a0 con 0x562982b00f00 2024-04-26T18:36:56.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.647+0000 7f3c35ffb640 1 -- 172.21.15.80:0/4121396581 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c40099120 con 0x562982b00f00 2024-04-26T18:36:56.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.647+0000 7f3c5887f740 1 -- 172.21.15.80:0/4121396581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b00f00 msgr2=0x562982b012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:56.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.647+0000 7f3c5887f740 1 --2- 172.21.15.80:0/4121396581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b00f00 0x562982b012e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3c4009c630 tx=0x7f3c4009c350 comp rx=0 tx=0).stop 2024-04-26T18:36:56.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.647+0000 7f3c5887f740 1 -- 172.21.15.80:0/4121396581 shutdown_connections 2024-04-26T18:36:56.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.647+0000 7f3c5887f740 1 --2- 172.21.15.80:0/4121396581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562982b0c0e0 0x562982b0e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.647+0000 7f3c5887f740 1 --2- 172.21.15.80:0/4121396581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562982b01820 0x562982b0bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.647+0000 7f3c5887f740 1 --2- 172.21.15.80:0/4121396581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b00f00 0x562982b012e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.647+0000 7f3c5887f740 1 -- 172.21.15.80:0/4121396581 >> 172.21.15.80:0/4121396581 conn(0x562982afd410 msgr2=0x562982afd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:56.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.647+0000 7f3c5887f740 1 -- 172.21.15.80:0/4121396581 shutdown_connections 2024-04-26T18:36:56.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.647+0000 7f3c5887f740 1 -- 172.21.15.80:0/4121396581 wait complete. 2024-04-26T18:36:56.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.647+0000 7f3c5887f740 1 -- start start 2024-04-26T18:36:56.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.648+0000 7f3c5887f740 1 Processor -- start 2024-04-26T18:36:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.648+0000 7f3c5887f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562982b00f00 0x562982b09030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.648+0000 7f3c5887f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562982b01820 0x562982b09570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.648+0000 7f3c5887f740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b0c0e0 0x562982b09ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.648+0000 7f3c5887f740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562982b0ed10 con 0x562982b0c0e0 2024-04-26T18:36:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.648+0000 7f3c5887f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5629829eeb60 con 0x562982b01820 2024-04-26T18:36:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.648+0000 7f3c5887f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562982b0ee90 con 0x562982b00f00 2024-04-26T18:36:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.648+0000 7f3c5887f740 10 client.0 _ll_register_callbacks cb 0x562982a132b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:36:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.648+0000 7f3c4ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b0c0e0 0x562982b09ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.648+0000 7f3c4ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b0c0e0 0x562982b09ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48018/0 (socket says 172.21.15.80:48018) 2024-04-26T18:36:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.648+0000 7f3c4ffff640 1 -- 172.21.15.80:0/457837924 learned_addr learned my addr 172.21.15.80:0/457837924 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.648+0000 7f3c4effd640 1 --2- 172.21.15.80:0/457837924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562982b01820 0x562982b09570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.648+0000 7f3c4f7fe640 1 --2- 172.21.15.80:0/457837924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562982b00f00 0x562982b09030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.648+0000 7f3c4ffff640 1 -- 172.21.15.80:0/457837924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562982b00f00 msgr2=0x562982b09030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.648+0000 7f3c4ffff640 1 --2- 172.21.15.80:0/457837924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562982b00f00 0x562982b09030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.648+0000 7f3c4ffff640 1 -- 172.21.15.80:0/457837924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562982b01820 msgr2=0x562982b09570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.648+0000 7f3c4ffff640 1 --2- 172.21.15.80:0/457837924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562982b01820 0x562982b09570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.648+0000 7f3c4ffff640 1 -- 172.21.15.80:0/457837924 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562982779210 con 0x562982b0c0e0 2024-04-26T18:36:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.649+0000 7f3c4ffff640 1 --2- 172.21.15.80:0/457837924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b0c0e0 0x562982b09ab0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3c480138e0 tx=0x7f3c48004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9768276910488633 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.649+0000 7f3c2effd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:36:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.649+0000 7f3c2effd640 1 -- 172.21.15.80:0/457837924 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c48013e60 con 0x562982b0c0e0 2024-04-26T18:36:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.649+0000 7f3c2effd640 1 -- 172.21.15.80:0/457837924 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f3c48011cf0 con 0x562982b0c0e0 2024-04-26T18:36:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.649+0000 7f3c5887f740 1 -- 172.21.15.80:0/457837924 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c400a55a0 con 0x562982b0c0e0 2024-04-26T18:36:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.649+0000 7f3c2effd640 1 -- 172.21.15.80:0/457837924 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3c4802c020 con 0x562982b0c0e0 2024-04-26T18:36:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.649+0000 7f3c5887f740 10 client.15387 fetch_fsmap learned FSMap version 27 2024-04-26T18:36:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.649+0000 7f3c5887f740 1 -- 172.21.15.80:0/457837924 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562982845620 con 0x562982b0c0e0 2024-04-26T18:36:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.649+0000 7f3c2effd640 1 -- 172.21.15.80:0/457837924 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c400a55a0 con 0x562982b0c0e0 2024-04-26T18:36:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.649+0000 7f3c2effd640 1 -- 172.21.15.80:0/457837924 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3c4800f040 con 0x562982b0c0e0 2024-04-26T18:36:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.649+0000 7f3c5887f740 10 client.15387 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:36:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.649+0000 7f3c5887f740 10 client.15387 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:36:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.649+0000 7f3c5887f740 20 client.15387 populate_metadata read hostname 'smithi080' 2024-04-26T18:36:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.649+0000 7f3c5887f740 1 --2- 172.21.15.80:0/457837924 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x562982b1c1a0 0x562982b1e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.649+0000 7f3c5887f740 4 client.15387 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:36:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.649+0000 7f3c5887f740 1 -- 172.21.15.80:0/457837924 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562982a75070 con 0x562982b1c1a0 2024-04-26T18:36:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.650+0000 7f3c4f7fe640 1 --2- 172.21.15.80:0/457837924 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x562982b1c1a0 0x562982b1e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.650+0000 7f3c4f7fe640 1 --2- 172.21.15.80:0/457837924 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x562982b1c1a0 0x562982b1e590 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a800444db30a206b server_cookie=8a8e526de1547777 in_seq=0 out_seq=0 2024-04-26T18:36:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.650+0000 7f3c2effd640 10 client.15387 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:36:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.651+0000 7f3c2effd640 1 -- 172.21.15.80:0/457837924 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562982a75070 con 0x562982b1c1a0 2024-04-26T18:36:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.651+0000 7f3c2effd640 10 client.15387 handle_command_reply: tid=0 2024-04-26T18:36:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.651+0000 7f3c5887f740 1 client.15387 shutdown 2024-04-26T18:36:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.651+0000 7f3c5887f740 1 -- 172.21.15.80:0/457837924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b0c0e0 msgr2=0x562982b09ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.651+0000 7f3c5887f740 1 --2- 172.21.15.80:0/457837924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b0c0e0 0x562982b09ab0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3c480138e0 tx=0x7f3c48004ab0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.651+0000 7f3c5887f740 1 -- 172.21.15.80:0/457837924 shutdown_connections 2024-04-26T18:36:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.651+0000 7f3c5887f740 1 --2- 172.21.15.80:0/457837924 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x562982b1c1a0 0x562982b1e590 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.651+0000 7f3c5887f740 1 --2- 172.21.15.80:0/457837924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b0c0e0 0x562982b09ab0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.651+0000 7f3c5887f740 1 --2- 172.21.15.80:0/457837924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562982b01820 0x562982b09570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.651+0000 7f3c2effd640 0 client.15387 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:36:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.651+0000 7f3c5887f740 1 --2- 172.21.15.80:0/457837924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562982b00f00 0x562982b09030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.651+0000 7f3c5887f740 1 -- 172.21.15.80:0/457837924 >> 172.21.15.80:0/457837924 conn(0x562982afd410 msgr2=0x562982b03190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.651+0000 7f3c5887f740 1 -- 172.21.15.80:0/457837924 shutdown_connections 2024-04-26T18:36:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.651+0000 7f3c5887f740 1 -- 172.21.15.80:0/457837924 wait complete. 2024-04-26T18:36:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.651+0000 7f3c5887f740 20 client.15387 trim_cache size 0 max 16384 2024-04-26T18:36:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.666+0000 7f3c5887f740 1 Processor -- start 2024-04-26T18:36:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.666+0000 7f3c5887f740 1 -- start start 2024-04-26T18:36:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.666+0000 7f3c5887f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562982b00f00 0x562982b17bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.666+0000 7f3c5887f740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b01820 0x562982b23e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.666+0000 7f3c5887f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562982b0c0e0 0x562982b243c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.666+0000 7f3c5887f740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3c501b0570 con 0x562982b01820 2024-04-26T18:36:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.666+0000 7f3c5887f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3c501b20b0 con 0x562982b00f00 2024-04-26T18:36:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.666+0000 7f3c5887f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3c501b0c40 con 0x562982b0c0e0 2024-04-26T18:36:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.666+0000 7f3c4effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b01820 0x562982b23e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.666+0000 7f3c4effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b01820 0x562982b23e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48030/0 (socket says 172.21.15.80:48030) 2024-04-26T18:36:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.666+0000 7f3c4effd640 1 -- 172.21.15.80:0/546010490 learned_addr learned my addr 172.21.15.80:0/546010490 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.666+0000 7f3c4f7fe640 1 --2- 172.21.15.80:0/546010490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562982b00f00 0x562982b17bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.666+0000 7f3c4ffff640 1 --2- 172.21.15.80:0/546010490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562982b0c0e0 0x562982b243c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.666+0000 7f3c4effd640 1 -- 172.21.15.80:0/546010490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562982b0c0e0 msgr2=0x562982b243c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.666+0000 7f3c4effd640 1 --2- 172.21.15.80:0/546010490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562982b0c0e0 0x562982b243c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.666+0000 7f3c4effd640 1 -- 172.21.15.80:0/546010490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562982b00f00 msgr2=0x562982b17bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.666+0000 7f3c4effd640 1 --2- 172.21.15.80:0/546010490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562982b00f00 0x562982b17bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.666+0000 7f3c4effd640 1 -- 172.21.15.80:0/546010490 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562982af8d60 con 0x562982b01820 2024-04-26T18:36:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.666+0000 7f3c4ffff640 1 --2- 172.21.15.80:0/546010490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562982b0c0e0 0x562982b243c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:36:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.666+0000 7f3c4effd640 1 --2- 172.21.15.80:0/546010490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b01820 0x562982b23e80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009900 tx=0x7f3c44032e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e1b449c08102e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.666+0000 7f3c357fa640 1 -- 172.21.15.80:0/546010490 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c44035040 con 0x562982b01820 2024-04-26T18:36:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.666+0000 7f3c357fa640 1 -- 172.21.15.80:0/546010490 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c44041070 con 0x562982b01820 2024-04-26T18:36:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.666+0000 7f3c357fa640 1 -- 172.21.15.80:0/546010490 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c440052a0 con 0x562982b01820 2024-04-26T18:36:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.667+0000 7f3c5887f740 1 -- 172.21.15.80:0/546010490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b01820 msgr2=0x562982b23e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.667+0000 7f3c5887f740 1 --2- 172.21.15.80:0/546010490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b01820 0x562982b23e80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009900 tx=0x7f3c44032e50 comp rx=0 tx=0).stop 2024-04-26T18:36:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.667+0000 7f3c5887f740 1 -- 172.21.15.80:0/546010490 shutdown_connections 2024-04-26T18:36:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.667+0000 7f3c5887f740 1 --2- 172.21.15.80:0/546010490 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b01820 0x562982b23e80 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.667+0000 7f3c5887f740 1 --2- 172.21.15.80:0/546010490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562982b0c0e0 0x562982b243c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.667+0000 7f3c5887f740 1 --2- 172.21.15.80:0/546010490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562982b00f00 0x562982b17bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.667+0000 7f3c5887f740 1 -- 172.21.15.80:0/546010490 >> 172.21.15.80:0/546010490 conn(0x562982afd410 msgr2=0x562982b0b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.667+0000 7f3c5887f740 1 -- 172.21.15.80:0/546010490 shutdown_connections 2024-04-26T18:36:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.667+0000 7f3c5887f740 1 -- 172.21.15.80:0/546010490 wait complete. 2024-04-26T18:36:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.667+0000 7f3c5887f740 1 -- start start 2024-04-26T18:36:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.668+0000 7f3c5887f740 1 Processor -- start 2024-04-26T18:36:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.668+0000 7f3c5887f740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b00f00 0x562982b06480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.668+0000 7f3c5887f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562982b01820 0x562982b069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.668+0000 7f3c5887f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562982b0c0e0 0x562982b816f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.668+0000 7f3c5887f740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3c501b19e0 con 0x562982b00f00 2024-04-26T18:36:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.668+0000 7f3c5887f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3c501b1310 con 0x562982b01820 2024-04-26T18:36:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.668+0000 7f3c5887f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3c501ae550 con 0x562982b0c0e0 2024-04-26T18:36:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.668+0000 7f3c5887f740 10 client.0 _ll_register_callbacks cb 0x7f3c48009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:36:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.668+0000 7f3c4f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b00f00 0x562982b06480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.668+0000 7f3c4f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b00f00 0x562982b06480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48036/0 (socket says 172.21.15.80:48036) 2024-04-26T18:36:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.668+0000 7f3c4f7fe640 1 -- 172.21.15.80:0/1766514928 learned_addr learned my addr 172.21.15.80:0/1766514928 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.668+0000 7f3c4ffff640 1 --2- 172.21.15.80:0/1766514928 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562982b0c0e0 0x562982b816f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.668+0000 7f3c4f7fe640 1 -- 172.21.15.80:0/1766514928 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562982b0c0e0 msgr2=0x562982b816f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.668+0000 7f3c4effd640 1 --2- 172.21.15.80:0/1766514928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562982b01820 0x562982b069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.668+0000 7f3c4f7fe640 1 --2- 172.21.15.80:0/1766514928 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562982b0c0e0 0x562982b816f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.668+0000 7f3c4f7fe640 1 -- 172.21.15.80:0/1766514928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562982b01820 msgr2=0x562982b069c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.668+0000 7f3c4f7fe640 1 --2- 172.21.15.80:0/1766514928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562982b01820 0x562982b069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.668+0000 7f3c4f7fe640 1 -- 172.21.15.80:0/1766514928 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562982b81c60 con 0x562982b00f00 2024-04-26T18:36:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.668+0000 7f3c4f7fe640 1 --2- 172.21.15.80:0/1766514928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b00f00 0x562982b06480 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3c40099300 tx=0x7f3c4000fe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6314d4c54ce7fdd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.668+0000 7f3c2effd640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:36:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.668+0000 7f3c2effd640 1 -- 172.21.15.80:0/1766514928 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c400a55a0 con 0x562982b00f00 2024-04-26T18:36:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.669+0000 7f3c5887f740 1 -- 172.21.15.80:0/1766514928 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c44041070 con 0x562982b00f00 2024-04-26T18:36:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.669+0000 7f3c2effd640 1 -- 172.21.15.80:0/1766514928 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f3c4000f740 con 0x562982b00f00 2024-04-26T18:36:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.669+0000 7f3c2effd640 1 -- 172.21.15.80:0/1766514928 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3c400672b0 con 0x562982b00f00 2024-04-26T18:36:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.669+0000 7f3c5887f740 10 client.15393 fetch_fsmap learned FSMap version 27 2024-04-26T18:36:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.669+0000 7f3c5887f740 1 -- 172.21.15.80:0/1766514928 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562982b82ee0 con 0x562982b00f00 2024-04-26T18:36:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.669+0000 7f3c2effd640 1 -- 172.21.15.80:0/1766514928 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c44041070 con 0x562982b00f00 2024-04-26T18:36:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.669+0000 7f3c2effd640 1 -- 172.21.15.80:0/1766514928 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3c400a5110 con 0x562982b00f00 2024-04-26T18:36:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.669+0000 7f3c5887f740 10 client.15393 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:36:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.669+0000 7f3c5887f740 10 client.15393 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:36:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.669+0000 7f3c5887f740 20 client.15393 populate_metadata read hostname 'smithi080' 2024-04-26T18:36:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.669+0000 7f3c5887f740 1 --2- 172.21.15.80:0/1766514928 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x562982b83230 0x562982b85650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.669+0000 7f3c5887f740 4 client.15393 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:36:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.669+0000 7f3c5887f740 1 -- 172.21.15.80:0/1766514928 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562982a6eee0 con 0x562982b83230 2024-04-26T18:36:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.669+0000 7f3c4effd640 1 --2- 172.21.15.80:0/1766514928 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x562982b83230 0x562982b85650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.670+0000 7f3c4effd640 1 --2- 172.21.15.80:0/1766514928 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x562982b83230 0x562982b85650 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7736f7f396f94c9 server_cookie=39dc349de894ce52 in_seq=0 out_seq=0 2024-04-26T18:36:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.670+0000 7f3c2effd640 10 client.15393 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:36:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.677+0000 7f3c2effd640 1 -- 172.21.15.80:0/1766514928 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562982a6eee0 con 0x562982b83230 2024-04-26T18:36:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.677+0000 7f3c2effd640 10 client.15393 handle_command_reply: tid=0 2024-04-26T18:36:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.678+0000 7f3c5887f740 1 client.15393 shutdown 2024-04-26T18:36:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.678+0000 7f3c5887f740 1 -- 172.21.15.80:0/1766514928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b00f00 msgr2=0x562982b06480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.678+0000 7f3c5887f740 1 --2- 172.21.15.80:0/1766514928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b00f00 0x562982b06480 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3c40099300 tx=0x7f3c4000fe60 comp rx=0 tx=0).stop 2024-04-26T18:36:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.678+0000 7f3c5887f740 1 -- 172.21.15.80:0/1766514928 shutdown_connections 2024-04-26T18:36:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.678+0000 7f3c5887f740 1 --2- 172.21.15.80:0/1766514928 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x562982b83230 0x562982b85650 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.678+0000 7f3c5887f740 1 --2- 172.21.15.80:0/1766514928 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562982b0c0e0 0x562982b816f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.678+0000 7f3c2effd640 0 client.15393 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:36:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.678+0000 7f3c5887f740 1 --2- 172.21.15.80:0/1766514928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562982b01820 0x562982b069c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.678+0000 7f3c5887f740 1 --2- 172.21.15.80:0/1766514928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562982b00f00 0x562982b06480 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.678+0000 7f3c5887f740 1 -- 172.21.15.80:0/1766514928 >> 172.21.15.80:0/1766514928 conn(0x562982afd410 msgr2=0x562982afc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.678+0000 7f3c5887f740 1 -- 172.21.15.80:0/1766514928 shutdown_connections 2024-04-26T18:36:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.678+0000 7f3c5887f740 1 -- 172.21.15.80:0/1766514928 wait complete. 2024-04-26T18:36:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.678+0000 7f3c5887f740 20 client.15393 trim_cache size 0 max 16384 2024-04-26T18:36:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:{ 2024-04-26T18:36:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "message": "", 2024-04-26T18:36:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "return_code": 0 2024-04-26T18:36:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:} 2024-04-26T18:36:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.679+0000 7f3c55b66640 1 -- 172.21.15.80:0/652773973 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f3c380a3ee0 msgr2=0x7f3c380a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.679+0000 7f3c55b66640 1 --2- 172.21.15.80:0/652773973 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f3c380a3ee0 0x7f3c380a63a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3c48005fd0 tx=0x7f3c48010740 comp rx=0 tx=0).stop 2024-04-26T18:36:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.679+0000 7f3c55b66640 1 -- 172.21.15.80:0/652773973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c5006b6a0 msgr2=0x7f3c5019b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.679+0000 7f3c55b66640 1 --2- 172.21.15.80:0/652773973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c5006b6a0 0x7f3c5019b260 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000c920 tx=0x7f3c4000cde0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.679+0000 7f3c55b66640 1 -- 172.21.15.80:0/652773973 shutdown_connections 2024-04-26T18:36:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.679+0000 7f3c55b66640 1 --2- 172.21.15.80:0/652773973 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f3c380a3ee0 0x7f3c380a63a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.679+0000 7f3c55b66640 1 --2- 172.21.15.80:0/652773973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c5010f280 0x7f3c5019fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.679+0000 7f3c55b66640 1 --2- 172.21.15.80:0/652773973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c501038e0 0x7f3c5019b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.679+0000 7f3c55b66640 1 --2- 172.21.15.80:0/652773973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c5006b6a0 0x7f3c5019b260 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.679+0000 7f3c55b66640 1 -- 172.21.15.80:0/652773973 >> 172.21.15.80:0/652773973 conn(0x7f3c50077630 msgr2=0x7f3c50100b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.679+0000 7f3c55b66640 1 -- 172.21.15.80:0/652773973 shutdown_connections 2024-04-26T18:36:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:36:56.679+0000 7f3c55b66640 1 -- 172.21.15.80:0/652773973 wait complete. 2024-04-26T18:36:56.912 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:56 smithi080 ceph-mon[29135]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.2 KiB/s wr, 15 op/s 2024-04-26T18:36:57.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:56 smithi192 ceph-mon[32842]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.2 KiB/s wr, 15 op/s 2024-04-26T18:36:57.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:56 smithi082 ceph-mon[32808]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.2 KiB/s wr, 15 op/s 2024-04-26T18:36:58.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.273+0000 7f2734a7e700 1 -- 172.21.15.80:0/4191334001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27301094c0 msgr2=0x7f27301098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:58.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.273+0000 7f2734a7e700 1 --2- 172.21.15.80:0/4191334001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27301094c0 0x7f27301098a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2720009990 tx=0x7f2720009ca0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.273+0000 7f2734a7e700 1 -- 172.21.15.80:0/4191334001 shutdown_connections 2024-04-26T18:36:58.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.273+0000 7f2734a7e700 1 --2- 172.21.15.80:0/4191334001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f273006c550 0x7f2730110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.273+0000 7f2734a7e700 1 --2- 172.21.15.80:0/4191334001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27301094c0 0x7f27301098a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.273+0000 7f2734a7e700 1 --2- 172.21.15.80:0/4191334001 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f273006bb90 0x7f273006c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.273+0000 7f2734a7e700 1 -- 172.21.15.80:0/4191334001 >> 172.21.15.80:0/4191334001 conn(0x7f2730078370 msgr2=0x7f2730078780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:58.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.273+0000 7f2734a7e700 1 -- 172.21.15.80:0/4191334001 shutdown_connections 2024-04-26T18:36:58.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.273+0000 7f2734a7e700 1 -- 172.21.15.80:0/4191334001 wait complete. 2024-04-26T18:36:58.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.273+0000 7f2734a7e700 1 Processor -- start 2024-04-26T18:36:58.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.274+0000 7f2734a7e700 1 -- start start 2024-04-26T18:36:58.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.274+0000 7f2734a7e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f273006bb90 0x7f273019f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:58.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.274+0000 7f2734a7e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f273006c550 0x7f273019fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:58.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.274+0000 7f2734a7e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27301094c0 0x7f27301998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:58.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.274+0000 7f2734a7e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f27301135f0 con 0x7f273006bb90 2024-04-26T18:36:58.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.274+0000 7f2734a7e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2730113470 con 0x7f273006c550 2024-04-26T18:36:58.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.274+0000 7f2734a7e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2730113770 con 0x7f27301094c0 2024-04-26T18:36:58.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.274+0000 7f272e59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f273006bb90 0x7f273019f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:58.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.274+0000 7f272e59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f273006bb90 0x7f273019f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48042/0 (socket says 172.21.15.80:48042) 2024-04-26T18:36:58.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.274+0000 7f272e59c700 1 -- 172.21.15.80:0/4119996531 learned_addr learned my addr 172.21.15.80:0/4119996531 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:58.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.274+0000 7f2727fff700 1 --2- 172.21.15.80:0/4119996531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f273006c550 0x7f273019fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:58.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.274+0000 7f272ed9d700 1 --2- 172.21.15.80:0/4119996531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27301094c0 0x7f27301998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:58.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.274+0000 7f272e59c700 1 -- 172.21.15.80:0/4119996531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27301094c0 msgr2=0x7f27301998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:58.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.274+0000 7f272e59c700 1 --2- 172.21.15.80:0/4119996531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27301094c0 0x7f27301998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.274+0000 7f272e59c700 1 -- 172.21.15.80:0/4119996531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f273006c550 msgr2=0x7f273019fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:58.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.274+0000 7f272e59c700 1 --2- 172.21.15.80:0/4119996531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f273006c550 0x7f273019fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.274+0000 7f272e59c700 1 -- 172.21.15.80:0/4119996531 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273019a030 con 0x7f273006bb90 2024-04-26T18:36:58.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.274+0000 7f272e59c700 1 --2- 172.21.15.80:0/4119996531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f273006bb90 0x7f273019f710 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2720000c00 tx=0x7f27200047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:58.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.275+0000 7f27277fe700 1 -- 172.21.15.80:0/4119996531 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2720027070 con 0x7f273006bb90 2024-04-26T18:36:58.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.275+0000 7f27277fe700 1 -- 172.21.15.80:0/4119996531 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2720003f20 con 0x7f273006bb90 2024-04-26T18:36:58.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.275+0000 7f2734a7e700 1 -- 172.21.15.80:0/4119996531 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f273019a2c0 con 0x7f273006bb90 2024-04-26T18:36:58.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.275+0000 7f27277fe700 1 -- 172.21.15.80:0/4119996531 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2720022ca0 con 0x7f273006bb90 2024-04-26T18:36:58.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.275+0000 7f2734a7e700 1 -- 172.21.15.80:0/4119996531 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27301023b0 con 0x7f273006bb90 2024-04-26T18:36:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.277+0000 7f27277fe700 1 -- 172.21.15.80:0/4119996531 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 24) ==== 138873+0+0 (secure 0 0 0) 0x7f272002a070 con 0x7f273006bb90 2024-04-26T18:36:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.277+0000 7f27277fe700 1 --2- 172.21.15.80:0/4119996531 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f271c0a3f50 0x7f271c0a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.277+0000 7f27277fe700 1 -- 172.21.15.80:0/4119996531 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f27200d17e0 con 0x7f273006bb90 2024-04-26T18:36:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.277+0000 7f2727fff700 1 --2- 172.21.15.80:0/4119996531 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f271c0a3f50 0x7f271c0a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.278+0000 7f2727fff700 1 --2- 172.21.15.80:0/4119996531 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f271c0a3f50 0x7f271c0a6410 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f27300789e0 tx=0x7f271800a300 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.278+0000 7f273f310b80 1 Processor -- start 2024-04-26T18:36:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.278+0000 7f273f310b80 1 -- start start 2024-04-26T18:36:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.279+0000 7f273f310b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd613a20 0x55cddd613e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.279+0000 7f273f310b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cddd60dd50 0x55cddd60e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.279+0000 7f273f310b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cddd60e6f0 0x55cddd61a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.279+0000 7f273f310b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55cddd5607e0 con 0x55cddd613a20 2024-04-26T18:36:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.279+0000 7f273f310b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cddd4c68e0 con 0x55cddd60dd50 2024-04-26T18:36:58.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.279+0000 7f273f310b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55cddd55c7a0 con 0x55cddd60e6f0 2024-04-26T18:36:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.279+0000 7f272e59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd613a20 0x55cddd613e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.279+0000 7f272e59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd613a20 0x55cddd613e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48050/0 (socket says 172.21.15.80:48050) 2024-04-26T18:36:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.279+0000 7f272e59c700 1 -- 172.21.15.80:0/1799881129 learned_addr learned my addr 172.21.15.80:0/1799881129 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.279+0000 7f2727fff700 1 --2- 172.21.15.80:0/1799881129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cddd60dd50 0x55cddd60e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.279+0000 7f272ed9d700 1 --2- 172.21.15.80:0/1799881129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cddd60e6f0 0x55cddd61a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.279+0000 7f272e59c700 1 -- 172.21.15.80:0/1799881129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cddd60e6f0 msgr2=0x55cddd61a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.279+0000 7f272e59c700 1 --2- 172.21.15.80:0/1799881129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cddd60e6f0 0x55cddd61a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.279+0000 7f272e59c700 1 -- 172.21.15.80:0/1799881129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cddd60dd50 msgr2=0x55cddd60e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.279+0000 7f272e59c700 1 --2- 172.21.15.80:0/1799881129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cddd60dd50 0x55cddd60e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.279+0000 7f272e59c700 1 -- 172.21.15.80:0/1799881129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cddd4ad880 con 0x55cddd613a20 2024-04-26T18:36:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.279+0000 7f272e59c700 1 --2- 172.21.15.80:0/1799881129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd613a20 0x55cddd613e00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2720099a70 tx=0x7f272009d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f511f8290b20ad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.279+0000 7f2724ff9700 1 -- 172.21.15.80:0/1799881129 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27200a19c0 con 0x55cddd613a20 2024-04-26T18:36:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.279+0000 7f2724ff9700 1 -- 172.21.15.80:0/1799881129 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2720099040 con 0x55cddd613a20 2024-04-26T18:36:58.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.279+0000 7f2724ff9700 1 -- 172.21.15.80:0/1799881129 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27200a5d60 con 0x55cddd613a20 2024-04-26T18:36:58.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.280+0000 7f273f310b80 1 -- 172.21.15.80:0/1799881129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd613a20 msgr2=0x55cddd613e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:58.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.280+0000 7f273f310b80 1 --2- 172.21.15.80:0/1799881129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd613a20 0x55cddd613e00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2720099a70 tx=0x7f272009d040 comp rx=0 tx=0).stop 2024-04-26T18:36:58.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.280+0000 7f273f310b80 1 -- 172.21.15.80:0/1799881129 shutdown_connections 2024-04-26T18:36:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.280+0000 7f273f310b80 1 --2- 172.21.15.80:0/1799881129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cddd60e6f0 0x55cddd61a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.280+0000 7f273f310b80 1 --2- 172.21.15.80:0/1799881129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd613a20 0x55cddd613e00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.280+0000 7f273f310b80 1 --2- 172.21.15.80:0/1799881129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cddd60dd50 0x55cddd60e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.280+0000 7f273f310b80 1 -- 172.21.15.80:0/1799881129 >> 172.21.15.80:0/1799881129 conn(0x55cddd53c570 msgr2=0x55cddd608900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.280+0000 7f273f310b80 1 -- 172.21.15.80:0/1799881129 shutdown_connections 2024-04-26T18:36:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.280+0000 7f273f310b80 1 -- 172.21.15.80:0/1799881129 wait complete. 2024-04-26T18:36:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.281+0000 7f273f310b80 1 -- start start 2024-04-26T18:36:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.281+0000 7f273f310b80 1 Processor -- start 2024-04-26T18:36:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.281+0000 7f273f310b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cddd60dd50 0x55cddd61a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.281+0000 7f273f310b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cddd60e6f0 0x55cddd6176c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.281+0000 7f273f310b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd613a20 0x55cddd617c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:58.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.281+0000 7f273f310b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55cddd614420 con 0x55cddd613a20 2024-04-26T18:36:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.281+0000 7f273f310b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cddd51aa30 con 0x55cddd60e6f0 2024-04-26T18:36:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.281+0000 7f273f310b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55cddd61acb0 con 0x55cddd60dd50 2024-04-26T18:36:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.281+0000 7f273f310b80 10 client.0 _ll_register_callbacks cb 0x55cddd4f8900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:36:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.281+0000 7f272ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd613a20 0x55cddd617c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.281+0000 7f272ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd613a20 0x55cddd617c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48058/0 (socket says 172.21.15.80:48058) 2024-04-26T18:36:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.281+0000 7f2727fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cddd60e6f0 0x55cddd6176c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.281+0000 7f272ed9d700 1 -- 172.21.15.80:0/4036398508 learned_addr learned my addr 172.21.15.80:0/4036398508 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.281+0000 7f272e59c700 1 --2- 172.21.15.80:0/4036398508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cddd60dd50 0x55cddd61a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.281+0000 7f272ed9d700 1 -- 172.21.15.80:0/4036398508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cddd60dd50 msgr2=0x55cddd61a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.281+0000 7f272ed9d700 1 --2- 172.21.15.80:0/4036398508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cddd60dd50 0x55cddd61a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.281+0000 7f272ed9d700 1 -- 172.21.15.80:0/4036398508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cddd60e6f0 msgr2=0x55cddd6176c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.281+0000 7f272ed9d700 1 --2- 172.21.15.80:0/4036398508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cddd60e6f0 0x55cddd6176c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.281+0000 7f272ed9d700 1 -- 172.21.15.80:0/4036398508 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cddd51e430 con 0x55cddd613a20 2024-04-26T18:36:58.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.281+0000 7f272e59c700 1 --2- 172.21.15.80:0/4036398508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cddd60dd50 0x55cddd61a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:36:58.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.282+0000 7f272ed9d700 1 --2- 172.21.15.80:0/4036398508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd613a20 0x55cddd617c00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2728009f30 tx=0x7f2728004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff16fa577ec2fb96 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:58.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.282+0000 7f2715ffb700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:36:58.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.282+0000 7f2715ffb700 1 -- 172.21.15.80:0/4036398508 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2728019020 con 0x55cddd613a20 2024-04-26T18:36:58.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.282+0000 7f2715ffb700 1 -- 172.21.15.80:0/4036398508 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f2728007710 con 0x55cddd613a20 2024-04-26T18:36:58.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.282+0000 7f273f310b80 1 -- 172.21.15.80:0/4036398508 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2720099040 con 0x55cddd613a20 2024-04-26T18:36:58.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.282+0000 7f2715ffb700 1 -- 172.21.15.80:0/4036398508 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2728024050 con 0x55cddd613a20 2024-04-26T18:36:58.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.282+0000 7f273f310b80 10 client.15405 fetch_fsmap learned FSMap version 27 2024-04-26T18:36:58.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.282+0000 7f273f310b80 1 -- 172.21.15.80:0/4036398508 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cddd625230 con 0x55cddd613a20 2024-04-26T18:36:58.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.282+0000 7f2715ffb700 1 -- 172.21.15.80:0/4036398508 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2720099040 con 0x55cddd613a20 2024-04-26T18:36:58.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.282+0000 7f2715ffb700 1 -- 172.21.15.80:0/4036398508 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f2728015970 con 0x55cddd613a20 2024-04-26T18:36:58.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.282+0000 7f273f310b80 10 client.15405 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:36:58.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.282+0000 7f273f310b80 10 client.15405 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T18:36:58.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.282+0000 7f273f310b80 20 client.15405 populate_metadata read hostname 'smithi080' 2024-04-26T18:36:58.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.282+0000 7f273f310b80 1 --2- 172.21.15.80:0/4036398508 >> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] conn(0x55cddd6278d0 0x55cddd628d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:58.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.282+0000 7f273f310b80 4 client.15405 mds_command: new command op to 24400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:36:58.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.282+0000 7f273f310b80 1 -- 172.21.15.80:0/4036398508 --> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cddd56e1c0 con 0x55cddd6278d0 2024-04-26T18:36:58.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.283+0000 7f272e59c700 1 --2- 172.21.15.80:0/4036398508 >> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] conn(0x55cddd6278d0 0x55cddd628d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:58.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.283+0000 7f272e59c700 1 --2- 172.21.15.80:0/4036398508 >> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] conn(0x55cddd6278d0 0x55cddd628d40 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9f64b04a9953c5b9 server_cookie=46a6176769fe097c in_seq=0 out_seq=0 2024-04-26T18:36:58.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.283+0000 7f2715ffb700 10 client.15405 ms_handle_connect on v2:172.21.15.192:6836/2361996920 2024-04-26T18:36:58.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.284+0000 7f2715ffb700 1 -- 172.21.15.80:0/4036398508 <== mds.3 v2:172.21.15.192:6836/2361996920 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cddd56e1c0 con 0x55cddd6278d0 2024-04-26T18:36:58.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.284+0000 7f2715ffb700 10 client.15405 handle_command_reply: tid=0 2024-04-26T18:36:58.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.284+0000 7f273f310b80 1 client.15405 shutdown 2024-04-26T18:36:58.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.284+0000 7f273f310b80 1 -- 172.21.15.80:0/4036398508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd613a20 msgr2=0x55cddd617c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:58.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.284+0000 7f273f310b80 1 --2- 172.21.15.80:0/4036398508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd613a20 0x55cddd617c00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2728009f30 tx=0x7f2728004320 comp rx=0 tx=0).stop 2024-04-26T18:36:58.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.284+0000 7f273f310b80 1 -- 172.21.15.80:0/4036398508 shutdown_connections 2024-04-26T18:36:58.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.284+0000 7f273f310b80 1 --2- 172.21.15.80:0/4036398508 >> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] conn(0x55cddd6278d0 0x55cddd628d40 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.284+0000 7f273f310b80 1 --2- 172.21.15.80:0/4036398508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd613a20 0x55cddd617c00 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.284+0000 7f273f310b80 1 --2- 172.21.15.80:0/4036398508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cddd60dd50 0x55cddd61a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.284+0000 7f273f310b80 1 --2- 172.21.15.80:0/4036398508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cddd60e6f0 0x55cddd6176c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.284+0000 7f273f310b80 1 -- 172.21.15.80:0/4036398508 >> 172.21.15.80:0/4036398508 conn(0x55cddd53c570 msgr2=0x55cddd60cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:58.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.284+0000 7f2715ffb700 0 client.15405 ms_handle_reset on v2:172.21.15.192:6836/2361996920 2024-04-26T18:36:58.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.284+0000 7f273f310b80 1 -- 172.21.15.80:0/4036398508 shutdown_connections 2024-04-26T18:36:58.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.284+0000 7f273f310b80 1 -- 172.21.15.80:0/4036398508 wait complete. 2024-04-26T18:36:58.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.284+0000 7f273f310b80 20 client.15405 trim_cache size 0 max 16384 2024-04-26T18:36:58.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.304+0000 7f273f310b80 1 Processor -- start 2024-04-26T18:36:58.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.304+0000 7f273f310b80 1 -- start start 2024-04-26T18:36:58.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.304+0000 7f273f310b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cddd60dd50 0x55cddd623970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:58.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.304+0000 7f273f310b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd60e6f0 0x55cddd610360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:58.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.304+0000 7f273f310b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cddd613a20 0x55cddd6108a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:58.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.304+0000 7f273f310b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55cddd627080 con 0x55cddd60e6f0 2024-04-26T18:36:58.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.304+0000 7f273f310b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cddd627750 con 0x55cddd613a20 2024-04-26T18:36:58.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.304+0000 7f273f310b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55cddd627e20 con 0x55cddd60dd50 2024-04-26T18:36:58.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.304+0000 7f2727fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd60e6f0 0x55cddd610360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:58.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.304+0000 7f2727fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd60e6f0 0x55cddd610360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48074/0 (socket says 172.21.15.80:48074) 2024-04-26T18:36:58.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.304+0000 7f2727fff700 1 -- 172.21.15.80:0/118554525 learned_addr learned my addr 172.21.15.80:0/118554525 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:58.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.305+0000 7f272e59c700 1 --2- 172.21.15.80:0/118554525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cddd60dd50 0x55cddd623970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:58.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.305+0000 7f272ed9d700 1 --2- 172.21.15.80:0/118554525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cddd613a20 0x55cddd6108a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:58.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.305+0000 7f2727fff700 1 -- 172.21.15.80:0/118554525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cddd60dd50 msgr2=0x55cddd623970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:58.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.305+0000 7f2727fff700 1 --2- 172.21.15.80:0/118554525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cddd60dd50 0x55cddd623970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.305+0000 7f2727fff700 1 -- 172.21.15.80:0/118554525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cddd613a20 msgr2=0x55cddd6108a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:58.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.305+0000 7f2727fff700 1 --2- 172.21.15.80:0/118554525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cddd613a20 0x55cddd6108a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.305+0000 7f2727fff700 1 -- 172.21.15.80:0/118554525 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cddd624470 con 0x55cddd60e6f0 2024-04-26T18:36:58.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.305+0000 7f272e59c700 1 --2- 172.21.15.80:0/118554525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cddd60dd50 0x55cddd623970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:36:58.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.305+0000 7f2727fff700 1 --2- 172.21.15.80:0/118554525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd60e6f0 0x55cddd610360 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f271800fed0 tx=0x7f2718012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d02739be3f6156 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:58.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.305+0000 7f2717fff700 1 -- 172.21.15.80:0/118554525 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2718016070 con 0x55cddd60e6f0 2024-04-26T18:36:58.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.305+0000 7f2717fff700 1 -- 172.21.15.80:0/118554525 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2718004830 con 0x55cddd60e6f0 2024-04-26T18:36:58.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.305+0000 7f2717fff700 1 -- 172.21.15.80:0/118554525 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2718005360 con 0x55cddd60e6f0 2024-04-26T18:36:58.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.306+0000 7f273f310b80 1 -- 172.21.15.80:0/118554525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd60e6f0 msgr2=0x55cddd610360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:58.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.306+0000 7f273f310b80 1 --2- 172.21.15.80:0/118554525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd60e6f0 0x55cddd610360 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f271800fed0 tx=0x7f2718012000 comp rx=0 tx=0).stop 2024-04-26T18:36:58.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.306+0000 7f273f310b80 1 -- 172.21.15.80:0/118554525 shutdown_connections 2024-04-26T18:36:58.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.306+0000 7f273f310b80 1 --2- 172.21.15.80:0/118554525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cddd613a20 0x55cddd6108a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.306+0000 7f273f310b80 1 --2- 172.21.15.80:0/118554525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cddd60dd50 0x55cddd623970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.306+0000 7f273f310b80 1 --2- 172.21.15.80:0/118554525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd60e6f0 0x55cddd610360 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.306+0000 7f273f310b80 1 -- 172.21.15.80:0/118554525 >> 172.21.15.80:0/118554525 conn(0x55cddd53c570 msgr2=0x55cddd615fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:58.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.306+0000 7f273f310b80 1 -- 172.21.15.80:0/118554525 shutdown_connections 2024-04-26T18:36:58.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.306+0000 7f273f310b80 1 -- 172.21.15.80:0/118554525 wait complete. 2024-04-26T18:36:58.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.307+0000 7f273f310b80 1 -- start start 2024-04-26T18:36:58.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.307+0000 7f273f310b80 1 Processor -- start 2024-04-26T18:36:58.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.307+0000 7f273f310b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cddd60dd50 0x55cddd60fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:58.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.307+0000 7f273f310b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd60e6f0 0x55cddd610080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:58.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.307+0000 7f273f310b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cddd613a20 0x55cddd6105c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:58.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.307+0000 7f273f310b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55cddd628bc0 con 0x55cddd60e6f0 2024-04-26T18:36:58.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.307+0000 7f273f310b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cddd6284f0 con 0x55cddd613a20 2024-04-26T18:36:58.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.307+0000 7f273f310b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55cddd629290 con 0x55cddd60dd50 2024-04-26T18:36:58.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.307+0000 7f273f310b80 10 client.0 _ll_register_callbacks cb 0x55cddd4f8900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:36:58.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.307+0000 7f2727fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd60e6f0 0x55cddd610080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:58.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.307+0000 7f2727fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd60e6f0 0x55cddd610080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48082/0 (socket says 172.21.15.80:48082) 2024-04-26T18:36:58.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.307+0000 7f2727fff700 1 -- 172.21.15.80:0/3230354214 learned_addr learned my addr 172.21.15.80:0/3230354214 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:36:58.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.307+0000 7f272ed9d700 1 --2- 172.21.15.80:0/3230354214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cddd613a20 0x55cddd6105c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:58.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.307+0000 7f272e59c700 1 --2- 172.21.15.80:0/3230354214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cddd60dd50 0x55cddd60fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:58.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.307+0000 7f2727fff700 1 -- 172.21.15.80:0/3230354214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cddd60dd50 msgr2=0x55cddd60fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:58.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.307+0000 7f2727fff700 1 --2- 172.21.15.80:0/3230354214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cddd60dd50 0x55cddd60fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.307+0000 7f2727fff700 1 -- 172.21.15.80:0/3230354214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cddd613a20 msgr2=0x55cddd6105c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:36:58.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.307+0000 7f2727fff700 1 --2- 172.21.15.80:0/3230354214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cddd613a20 0x55cddd6105c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.308+0000 7f2727fff700 1 -- 172.21.15.80:0/3230354214 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cddd62e180 con 0x55cddd60e6f0 2024-04-26T18:36:58.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.308+0000 7f2727fff700 1 --2- 172.21.15.80:0/3230354214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd60e6f0 0x55cddd610080 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2718027040 tx=0x7f2718004c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b379dcd03d3b4b0f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:36:58.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.308+0000 7f2715ffb700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:36:58.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.308+0000 7f2715ffb700 1 -- 172.21.15.80:0/3230354214 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2718032020 con 0x55cddd60e6f0 2024-04-26T18:36:58.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.308+0000 7f2715ffb700 1 -- 172.21.15.80:0/3230354214 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f2718005210 con 0x55cddd60e6f0 2024-04-26T18:36:58.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.308+0000 7f273f310b80 1 -- 172.21.15.80:0/3230354214 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2718004830 con 0x55cddd60e6f0 2024-04-26T18:36:58.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.308+0000 7f2715ffb700 1 -- 172.21.15.80:0/3230354214 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2718004e00 con 0x55cddd60e6f0 2024-04-26T18:36:58.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.308+0000 7f273f310b80 10 client.15411 fetch_fsmap learned FSMap version 27 2024-04-26T18:36:58.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.308+0000 7f273f310b80 1 -- 172.21.15.80:0/3230354214 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cddd68eb80 con 0x55cddd60e6f0 2024-04-26T18:36:58.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.308+0000 7f2715ffb700 1 -- 172.21.15.80:0/3230354214 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2718004830 con 0x55cddd60e6f0 2024-04-26T18:36:58.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.308+0000 7f2715ffb700 1 -- 172.21.15.80:0/3230354214 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f271801c420 con 0x55cddd60e6f0 2024-04-26T18:36:58.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.308+0000 7f273f310b80 10 client.15411 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:36:58.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.309+0000 7f273f310b80 10 client.15411 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T18:36:58.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.309+0000 7f273f310b80 20 client.15411 populate_metadata read hostname 'smithi080' 2024-04-26T18:36:58.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.309+0000 7f273f310b80 1 --2- 172.21.15.80:0/3230354214 >> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] conn(0x55cddd6933c0 0x55cddd6920d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:36:58.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.309+0000 7f273f310b80 4 client.15411 mds_command: new command op to 24400 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T18:36:58.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.309+0000 7f273f310b80 1 -- 172.21.15.80:0/3230354214 --> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] -- command(tid 0: {"prefix": "status"}) -- 0x55cddd568260 con 0x55cddd6933c0 2024-04-26T18:36:58.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.309+0000 7f272e59c700 1 --2- 172.21.15.80:0/3230354214 >> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] conn(0x55cddd6933c0 0x55cddd6920d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:36:58.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.309+0000 7f2715ffb700 10 client.15411 ms_handle_connect on v2:172.21.15.192:6836/2361996920 2024-04-26T18:36:58.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.309+0000 7f272e59c700 1 --2- 172.21.15.80:0/3230354214 >> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] conn(0x55cddd6933c0 0x55cddd6920d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f1870d65ece8db5e server_cookie=7c512cd5f96a3f9f in_seq=0 out_seq=0 2024-04-26T18:36:58.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.309+0000 7f2715ffb700 1 -- 172.21.15.80:0/3230354214 <== mds.3 v2:172.21.15.192:6836/2361996920 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55cddd568260 con 0x55cddd6933c0 2024-04-26T18:36:58.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.309+0000 7f2715ffb700 10 client.15411 handle_command_reply: tid=0 2024-04-26T18:36:58.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.309+0000 7f273f310b80 1 client.15411 shutdown 2024-04-26T18:36:58.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.310+0000 7f273f310b80 1 -- 172.21.15.80:0/3230354214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd60e6f0 msgr2=0x55cddd610080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:58.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.310+0000 7f273f310b80 1 --2- 172.21.15.80:0/3230354214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd60e6f0 0x55cddd610080 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2718027040 tx=0x7f2718004c10 comp rx=0 tx=0).stop 2024-04-26T18:36:58.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.310+0000 7f273f310b80 1 -- 172.21.15.80:0/3230354214 shutdown_connections 2024-04-26T18:36:58.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.310+0000 7f273f310b80 1 --2- 172.21.15.80:0/3230354214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cddd613a20 0x55cddd6105c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.310+0000 7f273f310b80 1 --2- 172.21.15.80:0/3230354214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cddd60dd50 0x55cddd60fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.310+0000 7f273f310b80 1 --2- 172.21.15.80:0/3230354214 >> [v2:172.21.15.192:6836/2361996920,v1:172.21.15.192:6837/2361996920] conn(0x55cddd6933c0 0x55cddd6920d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.310+0000 7f273f310b80 1 --2- 172.21.15.80:0/3230354214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cddd60e6f0 0x55cddd610080 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.310+0000 7f273f310b80 1 -- 172.21.15.80:0/3230354214 >> 172.21.15.80:0/3230354214 conn(0x55cddd53c570 msgr2=0x55cddd60d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:58.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.310+0000 7f2715ffb700 0 client.15411 ms_handle_reset on v2:172.21.15.192:6836/2361996920 2024-04-26T18:36:58.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.310+0000 7f273f310b80 1 -- 172.21.15.80:0/3230354214 shutdown_connections 2024-04-26T18:36:58.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.310+0000 7f273f310b80 1 -- 172.21.15.80:0/3230354214 wait complete. 2024-04-26T18:36:58.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.310+0000 7f273f310b80 20 client.15411 trim_cache size 0 max 16384 2024-04-26T18:36:58.319 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:36:58.319 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "2187ca98-03fa-11ef-bc93-c7b262605968", 2024-04-26T18:36:58.319 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 3, 2024-04-26T18:36:58.319 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24400, 2024-04-26T18:36:58.319 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-26T18:36:58.319 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-26T18:36:58.319 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-26T18:36:58.319 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 215.65462710700001, 2024-04-26T18:36:58.319 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 27, 2024-04-26T18:36:58.319 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 92, 2024-04-26T18:36:58.320 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 91, 2024-04-26T18:36:58.320 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 262.79439474700001 2024-04-26T18:36:58.320 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:36:58.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.311+0000 7f2734a7e700 1 -- 172.21.15.80:0/4119996531 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f271c0a3f50 msgr2=0x7f271c0a6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:58.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.311+0000 7f2734a7e700 1 --2- 172.21.15.80:0/4119996531 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f271c0a3f50 0x7f271c0a6410 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f27300789e0 tx=0x7f271800a300 comp rx=0 tx=0).stop 2024-04-26T18:36:58.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.311+0000 7f2734a7e700 1 -- 172.21.15.80:0/4119996531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f273006bb90 msgr2=0x7f273019f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:36:58.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.311+0000 7f2734a7e700 1 --2- 172.21.15.80:0/4119996531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f273006bb90 0x7f273019f710 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2720000c00 tx=0x7f27200047b0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.311+0000 7f2734a7e700 1 -- 172.21.15.80:0/4119996531 shutdown_connections 2024-04-26T18:36:58.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.311+0000 7f2734a7e700 1 --2- 172.21.15.80:0/4119996531 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f271c0a3f50 0x7f271c0a6410 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.311+0000 7f2734a7e700 1 --2- 172.21.15.80:0/4119996531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27301094c0 0x7f27301998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.311+0000 7f2734a7e700 1 --2- 172.21.15.80:0/4119996531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f273006bb90 0x7f273019f710 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.311+0000 7f2734a7e700 1 --2- 172.21.15.80:0/4119996531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f273006c550 0x7f273019fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:36:58.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.311+0000 7f2734a7e700 1 -- 172.21.15.80:0/4119996531 >> 172.21.15.80:0/4119996531 conn(0x7f2730078370 msgr2=0x7f2730100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:36:58.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.311+0000 7f2734a7e700 1 -- 172.21.15.80:0/4119996531 shutdown_connections 2024-04-26T18:36:58.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:36:58.311+0000 7f2734a7e700 1 -- 172.21.15.80:0/4119996531 wait complete. 2024-04-26T18:36:58.977 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:36:58 smithi080 ceph-mon[29135]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-04-26T18:36:59.005 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell mds.h status 2024-04-26T18:36:59.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:36:58 smithi192 ceph-mon[32842]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-04-26T18:36:59.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:36:58 smithi082 ceph-mon[32808]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-04-26T18:36:59.244 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:37:00.690 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:37:00 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:37:00.589+0000 7f46a4a82700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:37:00.690 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:37:00 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:37:00.589+0000 7f46a4a82700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:37:00.690 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:37:00 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:37:00.589+0000 7f46a4a82700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:37:00.691 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:37:00 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:37:00.589+0000 7f46a4a82700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:37:00.691 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:37:00 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:37:00.589+0000 7f46a4a82700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:37:00.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.917+0000 7f49199d7700 1 -- 172.21.15.80:0/1320611499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49141034a0 msgr2=0x7f4914103900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:00.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.917+0000 7f49199d7700 1 --2- 172.21.15.80:0/1320611499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49141034a0 0x7f4914103900 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f48fc009990 tx=0x7f48fc009ca0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.917+0000 7f49199d7700 1 -- 172.21.15.80:0/1320611499 shutdown_connections 2024-04-26T18:37:00.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.917+0000 7f49199d7700 1 --2- 172.21.15.80:0/1320611499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4914103e40 0x7f4914110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.917+0000 7f49199d7700 1 --2- 172.21.15.80:0/1320611499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49141094e0 0x7f49141098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.917+0000 7f49199d7700 1 --2- 172.21.15.80:0/1320611499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49141034a0 0x7f4914103900 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.917+0000 7f49199d7700 1 -- 172.21.15.80:0/1320611499 >> 172.21.15.80:0/1320611499 conn(0x7f491407a5d0 msgr2=0x7f491407a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:00.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.917+0000 7f49199d7700 1 -- 172.21.15.80:0/1320611499 shutdown_connections 2024-04-26T18:37:00.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.917+0000 7f49199d7700 1 -- 172.21.15.80:0/1320611499 wait complete. 2024-04-26T18:37:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.918+0000 7f49199d7700 1 Processor -- start 2024-04-26T18:37:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.918+0000 7f49199d7700 1 -- start start 2024-04-26T18:37:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.918+0000 7f49199d7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49141034a0 0x7f4914075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.918+0000 7f49199d7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4914103e40 0x7f4914075c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.918+0000 7f49199d7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49141094e0 0x7f49140761a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.918+0000 7f49199d7700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f49141135f0 con 0x7f4914103e40 2024-04-26T18:37:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.918+0000 7f49199d7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4914113470 con 0x7f49141034a0 2024-04-26T18:37:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.918+0000 7f49199d7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4914113770 con 0x7f49141094e0 2024-04-26T18:37:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.918+0000 7f49127fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4914103e40 0x7f4914075c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.918+0000 7f49127fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4914103e40 0x7f4914075c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48104/0 (socket says 172.21.15.80:48104) 2024-04-26T18:37:00.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.918+0000 7f49127fc700 1 -- 172.21.15.80:0/1471348771 learned_addr learned my addr 172.21.15.80:0/1471348771 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:00.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.918+0000 7f4912ffd700 1 --2- 172.21.15.80:0/1471348771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49141034a0 0x7f4914075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:00.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.918+0000 7f49137fe700 1 --2- 172.21.15.80:0/1471348771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49141094e0 0x7f49140761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:00.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.919+0000 7f49127fc700 1 -- 172.21.15.80:0/1471348771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49141094e0 msgr2=0x7f49140761a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:00.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.919+0000 7f49127fc700 1 --2- 172.21.15.80:0/1471348771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49141094e0 0x7f49140761a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.919+0000 7f49127fc700 1 -- 172.21.15.80:0/1471348771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49141034a0 msgr2=0x7f4914075720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:00.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.919+0000 7f49127fc700 1 --2- 172.21.15.80:0/1471348771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49141034a0 0x7f4914075720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.919+0000 7f49127fc700 1 -- 172.21.15.80:0/1471348771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49141a7fa0 con 0x7f4914103e40 2024-04-26T18:37:00.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.919+0000 7f49137fe700 1 --2- 172.21.15.80:0/1471348771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49141094e0 0x7f49140761a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:37:00.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.919+0000 7f49127fc700 1 --2- 172.21.15.80:0/1471348771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4914103e40 0x7f4914075c60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0057c0 tx=0x7f48fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:00.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.919+0000 7f49189d5700 1 -- 172.21.15.80:0/1471348771 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc027070 con 0x7f4914103e40 2024-04-26T18:37:00.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.919+0000 7f49199d7700 1 -- 172.21.15.80:0/1471348771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49141a8230 con 0x7f4914103e40 2024-04-26T18:37:00.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.919+0000 7f49189d5700 1 -- 172.21.15.80:0/1471348771 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48fc003f20 con 0x7f4914103e40 2024-04-26T18:37:00.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.919+0000 7f49189d5700 1 -- 172.21.15.80:0/1471348771 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc022ba0 con 0x7f4914103e40 2024-04-26T18:37:00.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.919+0000 7f49199d7700 1 -- 172.21.15.80:0/1471348771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49141a8760 con 0x7f4914103e40 2024-04-26T18:37:00.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.922+0000 7f49189d5700 1 -- 172.21.15.80:0/1471348771 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 24) ==== 138873+0+0 (secure 0 0 0) 0x7f48fc02a070 con 0x7f4914103e40 2024-04-26T18:37:00.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.922+0000 7f49189d5700 1 --2- 172.21.15.80:0/1471348771 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f49000a3ed0 0x7f49000a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:00.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.922+0000 7f4912ffd700 1 --2- 172.21.15.80:0/1471348771 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f49000a3ed0 0x7f49000a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:00.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.922+0000 7f49189d5700 1 -- 172.21.15.80:0/1471348771 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f48fc0d19c0 con 0x7f4914103e40 2024-04-26T18:37:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.923+0000 7f4912ffd700 1 --2- 172.21.15.80:0/1471348771 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f49000a3ed0 0x7f49000a6390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4904005950 tx=0x7f490400b410 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.923+0000 7f4924269b80 1 Processor -- start 2024-04-26T18:37:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.923+0000 7f4924269b80 1 -- start start 2024-04-26T18:37:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.923+0000 7f4924269b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd7c7e3ad0 0x55bd7c7e3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.923+0000 7f4924269b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bd7c7e43f0 0x55bd7c7ddcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.923+0000 7f4924269b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7de2d0 0x55bd7c7de710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.923+0000 7f4924269b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55bd7c7306f0 con 0x55bd7c7de2d0 2024-04-26T18:37:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.923+0000 7f4924269b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bd7c6cf590 con 0x55bd7c7e3ad0 2024-04-26T18:37:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.923+0000 7f4924269b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55bd7c72c6b0 con 0x55bd7c7e43f0 2024-04-26T18:37:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.924+0000 7f49137fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7de2d0 0x55bd7c7de710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.924+0000 7f49137fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7de2d0 0x55bd7c7de710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48120/0 (socket says 172.21.15.80:48120) 2024-04-26T18:37:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.924+0000 7f49137fe700 1 -- 172.21.15.80:0/3438595785 learned_addr learned my addr 172.21.15.80:0/3438595785 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.924+0000 7f4912ffd700 1 --2- 172.21.15.80:0/3438595785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd7c7e3ad0 0x55bd7c7e3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.924+0000 7f49127fc700 1 --2- 172.21.15.80:0/3438595785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bd7c7e43f0 0x55bd7c7ddcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.924+0000 7f49137fe700 1 -- 172.21.15.80:0/3438595785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bd7c7e43f0 msgr2=0x55bd7c7ddcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.924+0000 7f49137fe700 1 --2- 172.21.15.80:0/3438595785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bd7c7e43f0 0x55bd7c7ddcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.924+0000 7f49137fe700 1 -- 172.21.15.80:0/3438595785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd7c7e3ad0 msgr2=0x55bd7c7e3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.924+0000 7f49137fe700 1 --2- 172.21.15.80:0/3438595785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd7c7e3ad0 0x55bd7c7e3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.924+0000 7f49137fe700 1 -- 172.21.15.80:0/3438595785 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd7c67d880 con 0x55bd7c7de2d0 2024-04-26T18:37:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.924+0000 7f4912ffd700 1 --2- 172.21.15.80:0/3438595785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd7c7e3ad0 0x55bd7c7e3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:37:00.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.924+0000 7f49137fe700 1 --2- 172.21.15.80:0/3438595785 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7de2d0 0x55bd7c7de710 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f490c00e230 tx=0x7f490c00e540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51602f94be285a24 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:00.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.924+0000 7f4909ffb700 1 -- 172.21.15.80:0/3438595785 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490c00edd0 con 0x55bd7c7de2d0 2024-04-26T18:37:00.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.924+0000 7f4909ffb700 1 -- 172.21.15.80:0/3438595785 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f490c004bb0 con 0x55bd7c7de2d0 2024-04-26T18:37:00.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.924+0000 7f4909ffb700 1 -- 172.21.15.80:0/3438595785 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490c005020 con 0x55bd7c7de2d0 2024-04-26T18:37:00.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.925+0000 7f4924269b80 1 -- 172.21.15.80:0/3438595785 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7de2d0 msgr2=0x55bd7c7de710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:00.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.925+0000 7f4924269b80 1 --2- 172.21.15.80:0/3438595785 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7de2d0 0x55bd7c7de710 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f490c00e230 tx=0x7f490c00e540 comp rx=0 tx=0).stop 2024-04-26T18:37:00.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.925+0000 7f4924269b80 1 -- 172.21.15.80:0/3438595785 shutdown_connections 2024-04-26T18:37:00.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.925+0000 7f4924269b80 1 --2- 172.21.15.80:0/3438595785 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7de2d0 0x55bd7c7de710 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.925+0000 7f4924269b80 1 --2- 172.21.15.80:0/3438595785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd7c7e3ad0 0x55bd7c7e3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.925+0000 7f4924269b80 1 --2- 172.21.15.80:0/3438595785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bd7c7e43f0 0x55bd7c7ddcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.925+0000 7f4924269b80 1 -- 172.21.15.80:0/3438595785 >> 172.21.15.80:0/3438595785 conn(0x55bd7c70acf0 msgr2=0x55bd7c7d91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:00.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.925+0000 7f4924269b80 1 -- 172.21.15.80:0/3438595785 shutdown_connections 2024-04-26T18:37:00.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.925+0000 7f4924269b80 1 -- 172.21.15.80:0/3438595785 wait complete. 2024-04-26T18:37:00.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.925+0000 7f4924269b80 1 -- start start 2024-04-26T18:37:00.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.926+0000 7f4924269b80 1 Processor -- start 2024-04-26T18:37:00.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.926+0000 7f4924269b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7de2d0 0x55bd7c7ea190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:00.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.926+0000 7f4924269b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bd7c7e3ad0 0x55bd7c7e7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:00.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.926+0000 7f4924269b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd7c7e43f0 0x55bd7c7e79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:00.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.926+0000 7f4924269b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55bd7c7eaf10 con 0x55bd7c7de2d0 2024-04-26T18:37:00.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.926+0000 7f4924269b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bd7c696900 con 0x55bd7c7e43f0 2024-04-26T18:37:00.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.926+0000 7f4924269b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55bd7c7eb090 con 0x55bd7c7e3ad0 2024-04-26T18:37:00.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.926+0000 7f4924269b80 10 client.0 _ll_register_callbacks cb 0x55bd7c6c4530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:37:00.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.926+0000 7f4912ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7de2d0 0x55bd7c7ea190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:00.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.926+0000 7f4912ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7de2d0 0x55bd7c7ea190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48124/0 (socket says 172.21.15.80:48124) 2024-04-26T18:37:00.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.926+0000 7f4912ffd700 1 -- 172.21.15.80:0/2005154983 learned_addr learned my addr 172.21.15.80:0/2005154983 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:00.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.926+0000 7f49127fc700 1 --2- 172.21.15.80:0/2005154983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bd7c7e3ad0 0x55bd7c7e7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:00.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.926+0000 7f4912ffd700 1 -- 172.21.15.80:0/2005154983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bd7c7e3ad0 msgr2=0x55bd7c7e7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:00.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.926+0000 7f4912ffd700 1 --2- 172.21.15.80:0/2005154983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bd7c7e3ad0 0x55bd7c7e7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.926+0000 7f4912ffd700 1 -- 172.21.15.80:0/2005154983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd7c7e43f0 msgr2=0x55bd7c7e79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:00.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.926+0000 7f4912ffd700 1 --2- 172.21.15.80:0/2005154983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd7c7e43f0 0x55bd7c7e79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.926+0000 7f4912ffd700 1 -- 172.21.15.80:0/2005154983 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd7c7e8080 con 0x55bd7c7de2d0 2024-04-26T18:37:00.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.926+0000 7f4912ffd700 1 --2- 172.21.15.80:0/2005154983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7de2d0 0x55bd7c7ea190 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f49040116f0 tx=0x7f49040047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96025aac11169f22 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:00.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.927+0000 7f48f2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:37:00.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.927+0000 7f48f2ffd700 1 -- 172.21.15.80:0/2005154983 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4904004a30 con 0x55bd7c7de2d0 2024-04-26T18:37:00.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.927+0000 7f48f2ffd700 1 -- 172.21.15.80:0/2005154983 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f4904004bd0 con 0x55bd7c7de2d0 2024-04-26T18:37:00.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.927+0000 7f4924269b80 1 -- 172.21.15.80:0/2005154983 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f490c004bb0 con 0x55bd7c7de2d0 2024-04-26T18:37:00.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.927+0000 7f48f2ffd700 1 -- 172.21.15.80:0/2005154983 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4904004dd0 con 0x55bd7c7de2d0 2024-04-26T18:37:00.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.927+0000 7f4924269b80 10 client.15429 fetch_fsmap learned FSMap version 27 2024-04-26T18:37:00.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.927+0000 7f4924269b80 1 -- 172.21.15.80:0/2005154983 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bd7c7f59f0 con 0x55bd7c7de2d0 2024-04-26T18:37:00.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.927+0000 7f48f2ffd700 1 -- 172.21.15.80:0/2005154983 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f490c004bb0 con 0x55bd7c7de2d0 2024-04-26T18:37:00.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.927+0000 7f48f2ffd700 1 -- 172.21.15.80:0/2005154983 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f49040307a0 con 0x55bd7c7de2d0 2024-04-26T18:37:00.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.927+0000 7f4924269b80 10 client.15429 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:37:00.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.927+0000 7f4924269b80 10 client.15429 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-26T18:37:00.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.927+0000 7f4924269b80 20 client.15429 populate_metadata read hostname 'smithi080' 2024-04-26T18:37:00.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.927+0000 7f4924269b80 1 --2- 172.21.15.80:0/2005154983 >> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] conn(0x55bd7c7f8030 0x55bd7c7f94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:00.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.927+0000 7f4924269b80 4 client.15429 mds_command: new command op to 24404 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:37:00.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.927+0000 7f4924269b80 1 -- 172.21.15.80:0/2005154983 --> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd7c73e0d0 con 0x55bd7c7f8030 2024-04-26T18:37:00.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.928+0000 7f49127fc700 1 --2- 172.21.15.80:0/2005154983 >> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] conn(0x55bd7c7f8030 0x55bd7c7f94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:00.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.928+0000 7f48f2ffd700 10 client.15429 ms_handle_connect on v2:172.21.15.82:6836/2084055551 2024-04-26T18:37:00.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.928+0000 7f49127fc700 1 --2- 172.21.15.80:0/2005154983 >> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] conn(0x55bd7c7f8030 0x55bd7c7f94a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3aa122bd675bc2b7 server_cookie=eea6ee53e839a737 in_seq=0 out_seq=0 2024-04-26T18:37:00.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.929+0000 7f48f2ffd700 1 -- 172.21.15.80:0/2005154983 <== mds.2 v2:172.21.15.82:6836/2084055551 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bd7c73e0d0 con 0x55bd7c7f8030 2024-04-26T18:37:00.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.929+0000 7f48f2ffd700 10 client.15429 handle_command_reply: tid=0 2024-04-26T18:37:00.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.929+0000 7f4924269b80 1 client.15429 shutdown 2024-04-26T18:37:00.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.929+0000 7f4924269b80 1 -- 172.21.15.80:0/2005154983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7de2d0 msgr2=0x55bd7c7ea190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:00.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.929+0000 7f4924269b80 1 --2- 172.21.15.80:0/2005154983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7de2d0 0x55bd7c7ea190 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f49040116f0 tx=0x7f49040047c0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.929+0000 7f4924269b80 1 -- 172.21.15.80:0/2005154983 shutdown_connections 2024-04-26T18:37:00.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.929+0000 7f4924269b80 1 --2- 172.21.15.80:0/2005154983 >> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] conn(0x55bd7c7f8030 0x55bd7c7f94a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.929+0000 7f4924269b80 1 --2- 172.21.15.80:0/2005154983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd7c7e43f0 0x55bd7c7e79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.929+0000 7f4924269b80 1 --2- 172.21.15.80:0/2005154983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7de2d0 0x55bd7c7ea190 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.929+0000 7f4924269b80 1 --2- 172.21.15.80:0/2005154983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bd7c7e3ad0 0x55bd7c7e7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.929+0000 7f4924269b80 1 -- 172.21.15.80:0/2005154983 >> 172.21.15.80:0/2005154983 conn(0x55bd7c70acf0 msgr2=0x55bd7c7d8390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:00.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.929+0000 7f48f2ffd700 0 client.15429 ms_handle_reset on v2:172.21.15.82:6836/2084055551 2024-04-26T18:37:00.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.929+0000 7f4924269b80 1 -- 172.21.15.80:0/2005154983 shutdown_connections 2024-04-26T18:37:00.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.929+0000 7f4924269b80 1 -- 172.21.15.80:0/2005154983 wait complete. 2024-04-26T18:37:00.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.929+0000 7f4924269b80 20 client.15429 trim_cache size 0 max 16384 2024-04-26T18:37:00.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.950+0000 7f4924269b80 1 Processor -- start 2024-04-26T18:37:00.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.950+0000 7f4924269b80 1 -- start start 2024-04-26T18:37:00.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.950+0000 7f4924269b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bd7c7de2d0 0x55bd7c7ddcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:00.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.950+0000 7f4924269b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd7c7e3ad0 0x55bd7c7e5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:00.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.950+0000 7f4924269b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7e43f0 0x55bd7c7e62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:00.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.950+0000 7f4924269b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55bd7c7f77e0 con 0x55bd7c7e43f0 2024-04-26T18:37:00.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.950+0000 7f4924269b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bd7c7f7eb0 con 0x55bd7c7e3ad0 2024-04-26T18:37:00.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.950+0000 7f4924269b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55bd7c7f8580 con 0x55bd7c7de2d0 2024-04-26T18:37:00.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.950+0000 7f49137fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7e43f0 0x55bd7c7e62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:00.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.950+0000 7f49137fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7e43f0 0x55bd7c7e62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48140/0 (socket says 172.21.15.80:48140) 2024-04-26T18:37:00.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.950+0000 7f49137fe700 1 -- 172.21.15.80:0/3632370066 learned_addr learned my addr 172.21.15.80:0/3632370066 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:00.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.951+0000 7f4912ffd700 1 --2- 172.21.15.80:0/3632370066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bd7c7de2d0 0x55bd7c7ddcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:00.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.951+0000 7f49127fc700 1 --2- 172.21.15.80:0/3632370066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd7c7e3ad0 0x55bd7c7e5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:00.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.951+0000 7f49137fe700 1 -- 172.21.15.80:0/3632370066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bd7c7de2d0 msgr2=0x55bd7c7ddcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:00.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.951+0000 7f49137fe700 1 --2- 172.21.15.80:0/3632370066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bd7c7de2d0 0x55bd7c7ddcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.951+0000 7f49137fe700 1 -- 172.21.15.80:0/3632370066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd7c7e3ad0 msgr2=0x55bd7c7e5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:00.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.951+0000 7f49137fe700 1 --2- 172.21.15.80:0/3632370066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd7c7e3ad0 0x55bd7c7e5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.951+0000 7f49137fe700 1 -- 172.21.15.80:0/3632370066 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd7c7e5a20 con 0x55bd7c7e43f0 2024-04-26T18:37:00.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.951+0000 7f49127fc700 1 --2- 172.21.15.80:0/3632370066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd7c7e3ad0 0x55bd7c7e5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:37:00.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.951+0000 7f49137fe700 1 --2- 172.21.15.80:0/3632370066 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7e43f0 0x55bd7c7e62e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f490c00ef90 tx=0x7f490c00efc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74785e9f4338b852 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:00.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.951+0000 7f49097fa700 1 -- 172.21.15.80:0/3632370066 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490c021070 con 0x55bd7c7e43f0 2024-04-26T18:37:00.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.951+0000 7f49097fa700 1 -- 172.21.15.80:0/3632370066 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f490c014480 con 0x55bd7c7e43f0 2024-04-26T18:37:00.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.951+0000 7f49097fa700 1 -- 172.21.15.80:0/3632370066 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490c005040 con 0x55bd7c7e43f0 2024-04-26T18:37:00.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.952+0000 7f4924269b80 1 -- 172.21.15.80:0/3632370066 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7e43f0 msgr2=0x55bd7c7e62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:00.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.952+0000 7f4924269b80 1 --2- 172.21.15.80:0/3632370066 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7e43f0 0x55bd7c7e62e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f490c00ef90 tx=0x7f490c00efc0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.952+0000 7f4924269b80 1 -- 172.21.15.80:0/3632370066 shutdown_connections 2024-04-26T18:37:00.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.952+0000 7f4924269b80 1 --2- 172.21.15.80:0/3632370066 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7e43f0 0x55bd7c7e62e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.952+0000 7f4924269b80 1 --2- 172.21.15.80:0/3632370066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bd7c7de2d0 0x55bd7c7ddcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.952+0000 7f4924269b80 1 --2- 172.21.15.80:0/3632370066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd7c7e3ad0 0x55bd7c7e5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.952+0000 7f4924269b80 1 -- 172.21.15.80:0/3632370066 >> 172.21.15.80:0/3632370066 conn(0x55bd7c70acf0 msgr2=0x55bd7c7e1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:00.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.952+0000 7f4924269b80 1 -- 172.21.15.80:0/3632370066 shutdown_connections 2024-04-26T18:37:00.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.952+0000 7f4924269b80 1 -- 172.21.15.80:0/3632370066 wait complete. 2024-04-26T18:37:00.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.952+0000 7f4924269b80 1 -- start start 2024-04-26T18:37:00.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.953+0000 7f4924269b80 1 Processor -- start 2024-04-26T18:37:00.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.953+0000 7f4924269b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7de2d0 0x55bd7c7f3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:00.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.953+0000 7f4924269b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bd7c7e3ad0 0x55bd7c7f3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:00.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.953+0000 7f4924269b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd7c7e43f0 0x55bd7c7f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:00.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.953+0000 7f4924269b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55bd7c7f9320 con 0x55bd7c7de2d0 2024-04-26T18:37:00.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.953+0000 7f4924269b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bd7c7f8c50 con 0x55bd7c7e43f0 2024-04-26T18:37:00.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.953+0000 7f4924269b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55bd7c7f99f0 con 0x55bd7c7e3ad0 2024-04-26T18:37:00.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.953+0000 7f4924269b80 10 client.0 _ll_register_callbacks cb 0x55bd7c6c4530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:37:00.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.953+0000 7f4912ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7de2d0 0x55bd7c7f3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:00.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.953+0000 7f4912ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7de2d0 0x55bd7c7f3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48146/0 (socket says 172.21.15.80:48146) 2024-04-26T18:37:00.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.953+0000 7f4912ffd700 1 -- 172.21.15.80:0/2161832132 learned_addr learned my addr 172.21.15.80:0/2161832132 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:00.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.953+0000 7f49137fe700 1 --2- 172.21.15.80:0/2161832132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd7c7e43f0 0x55bd7c7f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:00.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.953+0000 7f49127fc700 1 --2- 172.21.15.80:0/2161832132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bd7c7e3ad0 0x55bd7c7f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:00.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.953+0000 7f4912ffd700 1 -- 172.21.15.80:0/2161832132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bd7c7e3ad0 msgr2=0x55bd7c7f3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:00.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.953+0000 7f4912ffd700 1 --2- 172.21.15.80:0/2161832132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bd7c7e3ad0 0x55bd7c7f3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.953+0000 7f4912ffd700 1 -- 172.21.15.80:0/2161832132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd7c7e43f0 msgr2=0x55bd7c7f3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:00.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.953+0000 7f4912ffd700 1 --2- 172.21.15.80:0/2161832132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd7c7e43f0 0x55bd7c7f3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.953+0000 7f4912ffd700 1 -- 172.21.15.80:0/2161832132 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd7c800970 con 0x55bd7c7de2d0 2024-04-26T18:37:00.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.954+0000 7f4912ffd700 1 --2- 172.21.15.80:0/2161832132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7de2d0 0x55bd7c7f3320 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f49040116f0 tx=0x7f49040306e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c10933bf84b578 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:00.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.954+0000 7f48f2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:37:00.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.954+0000 7f48f2ffd700 1 -- 172.21.15.80:0/2161832132 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4904036040 con 0x55bd7c7de2d0 2024-04-26T18:37:00.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.954+0000 7f48f2ffd700 1 -- 172.21.15.80:0/2161832132 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f4904005170 con 0x55bd7c7de2d0 2024-04-26T18:37:00.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.954+0000 7f4924269b80 1 -- 172.21.15.80:0/2161832132 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f490c014480 con 0x55bd7c7de2d0 2024-04-26T18:37:00.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.954+0000 7f48f2ffd700 1 -- 172.21.15.80:0/2161832132 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4904048050 con 0x55bd7c7de2d0 2024-04-26T18:37:00.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.954+0000 7f4924269b80 10 client.15435 fetch_fsmap learned FSMap version 27 2024-04-26T18:37:00.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.954+0000 7f4924269b80 1 -- 172.21.15.80:0/2161832132 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bd7c85f390 con 0x55bd7c7de2d0 2024-04-26T18:37:00.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.954+0000 7f48f2ffd700 1 -- 172.21.15.80:0/2161832132 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f490c014480 con 0x55bd7c7de2d0 2024-04-26T18:37:00.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.955+0000 7f48f2ffd700 1 -- 172.21.15.80:0/2161832132 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f4904039070 con 0x55bd7c7de2d0 2024-04-26T18:37:00.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.955+0000 7f4924269b80 10 client.15435 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:37:00.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.955+0000 7f4924269b80 10 client.15435 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-26T18:37:00.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.955+0000 7f4924269b80 20 client.15435 populate_metadata read hostname 'smithi080' 2024-04-26T18:37:00.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.955+0000 7f4924269b80 1 --2- 172.21.15.80:0/2161832132 >> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] conn(0x55bd7c863ff0 0x55bd7c862d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:00.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.955+0000 7f4924269b80 4 client.15435 mds_command: new command op to 24404 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T18:37:00.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.955+0000 7f4924269b80 1 -- 172.21.15.80:0/2161832132 --> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] -- command(tid 0: {"prefix": "status"}) -- 0x55bd7c738170 con 0x55bd7c863ff0 2024-04-26T18:37:00.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.955+0000 7f49127fc700 1 --2- 172.21.15.80:0/2161832132 >> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] conn(0x55bd7c863ff0 0x55bd7c862d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:00.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.956+0000 7f49127fc700 1 --2- 172.21.15.80:0/2161832132 >> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] conn(0x55bd7c863ff0 0x55bd7c862d00 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=78c6c12d9e50256e server_cookie=c10870831e06e55c in_seq=0 out_seq=0 2024-04-26T18:37:00.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.956+0000 7f48f2ffd700 10 client.15435 ms_handle_connect on v2:172.21.15.82:6836/2084055551 2024-04-26T18:37:00.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.956+0000 7f48f2ffd700 1 -- 172.21.15.80:0/2161832132 <== mds.2 v2:172.21.15.82:6836/2084055551 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55bd7c738170 con 0x55bd7c863ff0 2024-04-26T18:37:00.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.956+0000 7f48f2ffd700 10 client.15435 handle_command_reply: tid=0 2024-04-26T18:37:00.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.956+0000 7f4924269b80 1 client.15435 shutdown 2024-04-26T18:37:00.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.956+0000 7f4924269b80 1 -- 172.21.15.80:0/2161832132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7de2d0 msgr2=0x55bd7c7f3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:00.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.956+0000 7f4924269b80 1 --2- 172.21.15.80:0/2161832132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7de2d0 0x55bd7c7f3320 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f49040116f0 tx=0x7f49040306e0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.956+0000 7f4924269b80 1 -- 172.21.15.80:0/2161832132 shutdown_connections 2024-04-26T18:37:00.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.956+0000 7f4924269b80 1 --2- 172.21.15.80:0/2161832132 >> [v2:172.21.15.82:6836/2084055551,v1:172.21.15.82:6837/2084055551] conn(0x55bd7c863ff0 0x55bd7c862d00 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.956+0000 7f4924269b80 1 --2- 172.21.15.80:0/2161832132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd7c7e43f0 0x55bd7c7f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.956+0000 7f48f2ffd700 0 client.15435 ms_handle_reset on v2:172.21.15.82:6836/2084055551 2024-04-26T18:37:00.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.956+0000 7f4924269b80 1 --2- 172.21.15.80:0/2161832132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bd7c7de2d0 0x55bd7c7f3320 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.956+0000 7f4924269b80 1 --2- 172.21.15.80:0/2161832132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bd7c7e3ad0 0x55bd7c7f3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.956+0000 7f4924269b80 1 -- 172.21.15.80:0/2161832132 >> 172.21.15.80:0/2161832132 conn(0x55bd7c70acf0 msgr2=0x55bd7c7e5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:00.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.956+0000 7f4924269b80 1 -- 172.21.15.80:0/2161832132 shutdown_connections 2024-04-26T18:37:00.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.956+0000 7f4924269b80 1 -- 172.21.15.80:0/2161832132 wait complete. 2024-04-26T18:37:00.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.957+0000 7f4924269b80 20 client.15435 trim_cache size 0 max 16384 2024-04-26T18:37:00.962 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:37:00.962 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "2187ca98-03fa-11ef-bc93-c7b262605968", 2024-04-26T18:37:00.962 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 2, 2024-04-26T18:37:00.962 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24404, 2024-04-26T18:37:00.962 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-26T18:37:00.962 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-26T18:37:00.962 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-26T18:37:00.963 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 219.309857647, 2024-04-26T18:37:00.963 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 27, 2024-04-26T18:37:00.963 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 92, 2024-04-26T18:37:00.963 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 91, 2024-04-26T18:37:00.963 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 262.35906326999998 2024-04-26T18:37:00.963 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:37:00.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.957+0000 7f49199d7700 1 -- 172.21.15.80:0/1471348771 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f49000a3ed0 msgr2=0x7f49000a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:00.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.957+0000 7f49199d7700 1 --2- 172.21.15.80:0/1471348771 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f49000a3ed0 0x7f49000a6390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4904005950 tx=0x7f490400b410 comp rx=0 tx=0).stop 2024-04-26T18:37:00.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.957+0000 7f49199d7700 1 -- 172.21.15.80:0/1471348771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4914103e40 msgr2=0x7f4914075c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:00.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.957+0000 7f49199d7700 1 --2- 172.21.15.80:0/1471348771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4914103e40 0x7f4914075c60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0057c0 tx=0x7f48fc0057f0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.957+0000 7f49199d7700 1 -- 172.21.15.80:0/1471348771 shutdown_connections 2024-04-26T18:37:00.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.957+0000 7f49199d7700 1 --2- 172.21.15.80:0/1471348771 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f49000a3ed0 0x7f49000a6390 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.957+0000 7f49199d7700 1 --2- 172.21.15.80:0/1471348771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49141094e0 0x7f49140761a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.957+0000 7f49199d7700 1 --2- 172.21.15.80:0/1471348771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49141034a0 0x7f4914075720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.957+0000 7f49199d7700 1 --2- 172.21.15.80:0/1471348771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4914103e40 0x7f4914075c60 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:00.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.957+0000 7f49199d7700 1 -- 172.21.15.80:0/1471348771 >> 172.21.15.80:0/1471348771 conn(0x7f491407a5d0 msgr2=0x7f4914101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:00.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.957+0000 7f49199d7700 1 -- 172.21.15.80:0/1471348771 shutdown_connections 2024-04-26T18:37:00.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:00.957+0000 7f49199d7700 1 -- 172.21.15.80:0/1471348771 wait complete. 2024-04-26T18:37:01.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:00 smithi082 ceph-mon[32808]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.1 KiB/s wr, 15 op/s 2024-04-26T18:37:01.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:00 smithi080 ceph-mon[29135]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.1 KiB/s wr, 15 op/s 2024-04-26T18:37:01.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:00 smithi192 ceph-mon[32842]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.1 KiB/s wr, 15 op/s 2024-04-26T18:37:01.750 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell mds.i status 2024-04-26T18:37:01.991 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:37:03.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:02 smithi082 ceph-mon[32808]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-04-26T18:37:03.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:02 smithi082 ceph-mon[32808]: mgrmap e25: x(active, since 34s), standbys: z, y 2024-04-26T18:37:03.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:02 smithi080 ceph-mon[29135]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-04-26T18:37:03.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:02 smithi080 ceph-mon[29135]: mgrmap e25: x(active, since 34s), standbys: z, y 2024-04-26T18:37:03.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:02 smithi192 ceph-mon[32842]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-04-26T18:37:03.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:02 smithi192 ceph-mon[32842]: mgrmap e25: x(active, since 34s), standbys: z, y 2024-04-26T18:37:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.880+0000 7efecf3c1700 1 -- 172.21.15.80:0/2674759673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efec8104270 msgr2=0x7efec8104650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.880+0000 7efecf3c1700 1 --2- 172.21.15.80:0/2674759673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efec8104270 0x7efec8104650 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7efec4009990 tx=0x7efec4009ca0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.880+0000 7efecf3c1700 1 -- 172.21.15.80:0/2674759673 shutdown_connections 2024-04-26T18:37:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.880+0000 7efecf3c1700 1 --2- 172.21.15.80:0/2674759673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efec8102d10 0x7efec810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.880+0000 7efecf3c1700 1 --2- 172.21.15.80:0/2674759673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efec8104270 0x7efec8104650 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.880+0000 7efecf3c1700 1 --2- 172.21.15.80:0/2674759673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec8102350 0x7efec81027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.880+0000 7efecf3c1700 1 -- 172.21.15.80:0/2674759673 >> 172.21.15.80:0/2674759673 conn(0x7efec8078390 msgr2=0x7efec80787a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.880+0000 7efecf3c1700 1 -- 172.21.15.80:0/2674759673 shutdown_connections 2024-04-26T18:37:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.881+0000 7efecf3c1700 1 -- 172.21.15.80:0/2674759673 wait complete. 2024-04-26T18:37:03.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.881+0000 7efecf3c1700 1 Processor -- start 2024-04-26T18:37:03.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.881+0000 7efecf3c1700 1 -- start start 2024-04-26T18:37:03.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.881+0000 7efecf3c1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec8102350 0x7efec819f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:03.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.881+0000 7efecf3c1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efec8102d10 0x7efec819fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:03.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.881+0000 7efecf3c1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efec8104270 0x7efec8199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:03.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.881+0000 7efecf3c1700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efec81125d0 con 0x7efec8102d10 2024-04-26T18:37:03.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.881+0000 7efecf3c1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efec8112450 con 0x7efec8102350 2024-04-26T18:37:03.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.881+0000 7efecf3c1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efec8112750 con 0x7efec8104270 2024-04-26T18:37:03.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.881+0000 7efecc95c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efec8102d10 0x7efec819fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:03.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.882+0000 7efecc95c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efec8102d10 0x7efec819fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35732/0 (socket says 172.21.15.80:35732) 2024-04-26T18:37:03.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.882+0000 7efecc95c700 1 -- 172.21.15.80:0/3941625481 learned_addr learned my addr 172.21.15.80:0/3941625481 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:03.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.882+0000 7efecd95e700 1 --2- 172.21.15.80:0/3941625481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efec8104270 0x7efec8199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:03.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.882+0000 7efecd15d700 1 --2- 172.21.15.80:0/3941625481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec8102350 0x7efec819f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:03.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.882+0000 7efecc95c700 1 -- 172.21.15.80:0/3941625481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efec8104270 msgr2=0x7efec8199cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:03.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.882+0000 7efecc95c700 1 --2- 172.21.15.80:0/3941625481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efec8104270 0x7efec8199cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.882+0000 7efecc95c700 1 -- 172.21.15.80:0/3941625481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec8102350 msgr2=0x7efec819f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:03.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.882+0000 7efecc95c700 1 --2- 172.21.15.80:0/3941625481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec8102350 0x7efec819f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.882+0000 7efecc95c700 1 -- 172.21.15.80:0/3941625481 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec819a410 con 0x7efec8102d10 2024-04-26T18:37:03.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.882+0000 7efecd15d700 1 --2- 172.21.15.80:0/3941625481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec8102350 0x7efec819f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:37:03.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.882+0000 7efecc95c700 1 --2- 172.21.15.80:0/3941625481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efec8102d10 0x7efec819fc90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7efeb800c9b0 tx=0x7efeb800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:03.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.882+0000 7efebe7fc700 1 -- 172.21.15.80:0/3941625481 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb8007b00 con 0x7efec8102d10 2024-04-26T18:37:03.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.882+0000 7efebe7fc700 1 -- 172.21.15.80:0/3941625481 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efeb8007ca0 con 0x7efec8102d10 2024-04-26T18:37:03.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.882+0000 7efebe7fc700 1 -- 172.21.15.80:0/3941625481 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb8018660 con 0x7efec8102d10 2024-04-26T18:37:03.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.882+0000 7efecf3c1700 1 -- 172.21.15.80:0/3941625481 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec819a700 con 0x7efec8102d10 2024-04-26T18:37:03.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.882+0000 7efecf3c1700 1 -- 172.21.15.80:0/3941625481 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec81a6620 con 0x7efec8102d10 2024-04-26T18:37:03.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.884+0000 7efebe7fc700 1 -- 172.21.15.80:0/3941625481 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 138930+0+0 (secure 0 0 0) 0x7efeb800f450 con 0x7efec8102d10 2024-04-26T18:37:03.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.885+0000 7efebe7fc700 1 --2- 172.21.15.80:0/3941625481 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7efeb40a3f60 0x7efeb40a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:03.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.885+0000 7efecd15d700 1 --2- 172.21.15.80:0/3941625481 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7efeb40a3f60 0x7efeb40a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:03.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.885+0000 7efebe7fc700 1 -- 172.21.15.80:0/3941625481 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7efeb80d0ab0 con 0x7efec8102d10 2024-04-26T18:37:03.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.886+0000 7efecd15d700 1 --2- 172.21.15.80:0/3941625481 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7efeb40a3f60 0x7efeb40a6420 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efec4000c00 tx=0x7efec4005fd0 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:03.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.886+0000 7efed9c53b80 1 Processor -- start 2024-04-26T18:37:03.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.886+0000 7efed9c53b80 1 -- start start 2024-04-26T18:37:03.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.886+0000 7efed9c53b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e50fc6ad0 0x562e50fc6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:03.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.886+0000 7efed9c53b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc73f0 0x562e50fc0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:03.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.886+0000 7efed9c53b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e50fc12d0 0x562e50fc1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:03.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.886+0000 7efed9c53b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562e50f136f0 con 0x562e50fc73f0 2024-04-26T18:37:03.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.886+0000 7efed9c53b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562e50eb2590 con 0x562e50fc6ad0 2024-04-26T18:37:03.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.886+0000 7efed9c53b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562e50f0f6b0 con 0x562e50fc12d0 2024-04-26T18:37:03.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.886+0000 7efecc95c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc73f0 0x562e50fc0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:03.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.886+0000 7efecc95c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc73f0 0x562e50fc0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35748/0 (socket says 172.21.15.80:35748) 2024-04-26T18:37:03.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.886+0000 7efecc95c700 1 -- 172.21.15.80:0/3680666787 learned_addr learned my addr 172.21.15.80:0/3680666787 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:03.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.886+0000 7efecd15d700 1 --2- 172.21.15.80:0/3680666787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e50fc6ad0 0x562e50fc6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:03.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.886+0000 7efecd95e700 1 --2- 172.21.15.80:0/3680666787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e50fc12d0 0x562e50fc1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:03.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.887+0000 7efecc95c700 1 -- 172.21.15.80:0/3680666787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e50fc12d0 msgr2=0x562e50fc1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:03.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.887+0000 7efecc95c700 1 --2- 172.21.15.80:0/3680666787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e50fc12d0 0x562e50fc1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.887+0000 7efecc95c700 1 -- 172.21.15.80:0/3680666787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e50fc6ad0 msgr2=0x562e50fc6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:03.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.887+0000 7efecc95c700 1 --2- 172.21.15.80:0/3680666787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e50fc6ad0 0x562e50fc6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.887+0000 7efecc95c700 1 -- 172.21.15.80:0/3680666787 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e50e60880 con 0x562e50fc73f0 2024-04-26T18:37:03.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.887+0000 7efecc95c700 1 --2- 172.21.15.80:0/3680666787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc73f0 0x562e50fc0cb0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7efeb80ce100 tx=0x7efeb809c1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd7ceea2f443ff6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:03.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.887+0000 7efeb37fe700 1 -- 172.21.15.80:0/3680666787 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb80a0c10 con 0x562e50fc73f0 2024-04-26T18:37:03.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.887+0000 7efeb37fe700 1 -- 172.21.15.80:0/3680666787 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efeb80a54d0 con 0x562e50fc73f0 2024-04-26T18:37:03.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.887+0000 7efeb37fe700 1 -- 172.21.15.80:0/3680666787 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb80a5040 con 0x562e50fc73f0 2024-04-26T18:37:03.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.888+0000 7efed9c53b80 1 -- 172.21.15.80:0/3680666787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc73f0 msgr2=0x562e50fc0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:03.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.888+0000 7efed9c53b80 1 --2- 172.21.15.80:0/3680666787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc73f0 0x562e50fc0cb0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7efeb80ce100 tx=0x7efeb809c1c0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.888+0000 7efed9c53b80 1 -- 172.21.15.80:0/3680666787 shutdown_connections 2024-04-26T18:37:03.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.888+0000 7efed9c53b80 1 --2- 172.21.15.80:0/3680666787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e50fc12d0 0x562e50fc1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.888+0000 7efed9c53b80 1 --2- 172.21.15.80:0/3680666787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e50fc6ad0 0x562e50fc6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.888+0000 7efed9c53b80 1 --2- 172.21.15.80:0/3680666787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc73f0 0x562e50fc0cb0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.888+0000 7efed9c53b80 1 -- 172.21.15.80:0/3680666787 >> 172.21.15.80:0/3680666787 conn(0x562e50eedcf0 msgr2=0x562e50fbc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:03.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.888+0000 7efed9c53b80 1 -- 172.21.15.80:0/3680666787 shutdown_connections 2024-04-26T18:37:03.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.888+0000 7efed9c53b80 1 -- 172.21.15.80:0/3680666787 wait complete. 2024-04-26T18:37:03.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.888+0000 7efed9c53b80 1 -- start start 2024-04-26T18:37:03.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.888+0000 7efed9c53b80 1 Processor -- start 2024-04-26T18:37:03.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.889+0000 7efed9c53b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e50fc12d0 0x562e50fcd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:03.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.889+0000 7efed9c53b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e50fc6ad0 0x562e50fca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:03.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.889+0000 7efed9c53b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc73f0 0x562e50fcaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:03.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.889+0000 7efed9c53b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562e50fcdf10 con 0x562e50fc73f0 2024-04-26T18:37:03.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.889+0000 7efed9c53b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562e50e79900 con 0x562e50fc12d0 2024-04-26T18:37:03.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.889+0000 7efed9c53b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562e50fce090 con 0x562e50fc6ad0 2024-04-26T18:37:03.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.889+0000 7efed9c53b80 10 client.0 _ll_register_callbacks cb 0x562e50ea7530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:37:03.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.889+0000 7efecd95e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc73f0 0x562e50fcaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:03.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.889+0000 7efecd95e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc73f0 0x562e50fcaaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35754/0 (socket says 172.21.15.80:35754) 2024-04-26T18:37:03.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.889+0000 7efecd95e700 1 -- 172.21.15.80:0/3138056540 learned_addr learned my addr 172.21.15.80:0/3138056540 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:03.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.889+0000 7efecd15d700 1 --2- 172.21.15.80:0/3138056540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e50fc12d0 0x562e50fcd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:03.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.889+0000 7efecc95c700 1 --2- 172.21.15.80:0/3138056540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e50fc6ad0 0x562e50fca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:03.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.889+0000 7efecc95c700 1 -- 172.21.15.80:0/3138056540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e50fc12d0 msgr2=0x562e50fcd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:03.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.889+0000 7efecc95c700 1 --2- 172.21.15.80:0/3138056540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e50fc12d0 0x562e50fcd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.889+0000 7efecc95c700 1 -- 172.21.15.80:0/3138056540 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc73f0 msgr2=0x562e50fcaaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:03.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.889+0000 7efecc95c700 1 --2- 172.21.15.80:0/3138056540 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc73f0 0x562e50fcaaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.889+0000 7efecc95c700 1 -- 172.21.15.80:0/3138056540 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e50fcb2e0 con 0x562e50fc6ad0 2024-04-26T18:37:03.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.889+0000 7efecd95e700 1 --2- 172.21.15.80:0/3138056540 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc73f0 0x562e50fcaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:37:03.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.889+0000 7efecc95c700 1 --2- 172.21.15.80:0/3138056540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e50fc6ad0 0x562e50fca560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efeb8098cc0 tx=0x7efeb80872c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbbb96d4c26c6cec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:03.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.889+0000 7efeb0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-04-26T18:37:03.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.890+0000 7efeb0ff9700 1 -- 172.21.15.80:0/3138056540 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb80b9030 con 0x562e50fc6ad0 2024-04-26T18:37:03.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.890+0000 7efeb0ff9700 1 -- 172.21.15.80:0/3138056540 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7efeb809ab60 con 0x562e50fc6ad0 2024-04-26T18:37:03.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.890+0000 7efed9c53b80 1 -- 172.21.15.80:0/3138056540 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efeb80a54d0 con 0x562e50fc6ad0 2024-04-26T18:37:03.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.890+0000 7efeb0ff9700 1 -- 172.21.15.80:0/3138056540 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efeb80a0c10 con 0x562e50fc6ad0 2024-04-26T18:37:03.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.890+0000 7efed9c53b80 10 client.24940 fetch_fsmap learned FSMap version 27 2024-04-26T18:37:03.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.890+0000 7efed9c53b80 1 -- 172.21.15.80:0/3138056540 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562e50fcdf10 con 0x562e50fc6ad0 2024-04-26T18:37:03.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.890+0000 7efeb0ff9700 1 -- 172.21.15.80:0/3138056540 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efeb80a54d0 con 0x562e50fc6ad0 2024-04-26T18:37:03.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.890+0000 7efeb0ff9700 1 -- 172.21.15.80:0/3138056540 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7efeb809db90 con 0x562e50fc6ad0 2024-04-26T18:37:03.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.890+0000 7efed9c53b80 10 client.24940 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:37:03.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.890+0000 7efed9c53b80 10 client.24940 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T18:37:03.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.890+0000 7efed9c53b80 20 client.24940 populate_metadata read hostname 'smithi080' 2024-04-26T18:37:03.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.890+0000 7efed9c53b80 1 --2- 172.21.15.80:0/3138056540 >> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] conn(0x562e50fdaa50 0x562e50fdbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.890+0000 7efed9c53b80 4 client.24940 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:37:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.890+0000 7efed9c53b80 1 -- 172.21.15.80:0/3138056540 --> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e50f210d0 con 0x562e50fdaa50 2024-04-26T18:37:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.890+0000 7efecd15d700 1 --2- 172.21.15.80:0/3138056540 >> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] conn(0x562e50fdaa50 0x562e50fdbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.891+0000 7efeb0ff9700 10 client.24940 ms_handle_connect on v2:172.21.15.192:6838/2735406056 2024-04-26T18:37:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.891+0000 7efecd15d700 1 --2- 172.21.15.80:0/3138056540 >> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] conn(0x562e50fdaa50 0x562e50fdbec0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6398fec0149791e8 server_cookie=ce2b20602a0bdfb7 in_seq=0 out_seq=0 2024-04-26T18:37:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.892+0000 7efeb0ff9700 1 -- 172.21.15.80:0/3138056540 <== mds.1 v2:172.21.15.192:6838/2735406056 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562e50f210d0 con 0x562e50fdaa50 2024-04-26T18:37:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.892+0000 7efeb0ff9700 10 client.24940 handle_command_reply: tid=0 2024-04-26T18:37:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.892+0000 7efed9c53b80 1 client.24940 shutdown 2024-04-26T18:37:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.892+0000 7efed9c53b80 1 -- 172.21.15.80:0/3138056540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e50fc6ad0 msgr2=0x562e50fca560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.892+0000 7efed9c53b80 1 --2- 172.21.15.80:0/3138056540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e50fc6ad0 0x562e50fca560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efeb8098cc0 tx=0x7efeb80872c0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.892+0000 7efed9c53b80 1 -- 172.21.15.80:0/3138056540 shutdown_connections 2024-04-26T18:37:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.892+0000 7efed9c53b80 1 --2- 172.21.15.80:0/3138056540 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc73f0 0x562e50fcaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.892+0000 7efed9c53b80 1 --2- 172.21.15.80:0/3138056540 >> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] conn(0x562e50fdaa50 0x562e50fdbec0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.892+0000 7efed9c53b80 1 --2- 172.21.15.80:0/3138056540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e50fc12d0 0x562e50fcd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.892+0000 7efeb0ff9700 0 client.24940 ms_handle_reset on v2:172.21.15.192:6838/2735406056 2024-04-26T18:37:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.892+0000 7efed9c53b80 1 --2- 172.21.15.80:0/3138056540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e50fc6ad0 0x562e50fca560 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.892+0000 7efed9c53b80 1 -- 172.21.15.80:0/3138056540 >> 172.21.15.80:0/3138056540 conn(0x562e50eedcf0 msgr2=0x562e50fbbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.892+0000 7efed9c53b80 1 -- 172.21.15.80:0/3138056540 shutdown_connections 2024-04-26T18:37:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.892+0000 7efed9c53b80 1 -- 172.21.15.80:0/3138056540 wait complete. 2024-04-26T18:37:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.892+0000 7efed9c53b80 20 client.24940 trim_cache size 0 max 16384 2024-04-26T18:37:03.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.913+0000 7efed9c53b80 1 Processor -- start 2024-04-26T18:37:03.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.913+0000 7efed9c53b80 1 -- start start 2024-04-26T18:37:03.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.913+0000 7efed9c53b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc12d0 0x562e50fd7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:03.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.913+0000 7efed9c53b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e50fc6ad0 0x562e50fc7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:03.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.913+0000 7efed9c53b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e50fc73f0 0x562e50fc5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:03.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.913+0000 7efed9c53b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562e50fda200 con 0x562e50fc12d0 2024-04-26T18:37:03.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.913+0000 7efed9c53b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562e50fda8d0 con 0x562e50fc73f0 2024-04-26T18:37:03.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.913+0000 7efed9c53b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562e50fdafa0 con 0x562e50fc6ad0 2024-04-26T18:37:03.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.913+0000 7efecd15d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc12d0 0x562e50fd7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:03.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.913+0000 7efecd15d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc12d0 0x562e50fd7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35770/0 (socket says 172.21.15.80:35770) 2024-04-26T18:37:03.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.913+0000 7efecd15d700 1 -- 172.21.15.80:0/2041204441 learned_addr learned my addr 172.21.15.80:0/2041204441 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.913+0000 7efecd95e700 1 --2- 172.21.15.80:0/2041204441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e50fc73f0 0x562e50fc5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.913+0000 7efecc95c700 1 --2- 172.21.15.80:0/2041204441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e50fc6ad0 0x562e50fc7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.913+0000 7efecd15d700 1 -- 172.21.15.80:0/2041204441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e50fc6ad0 msgr2=0x562e50fc7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.913+0000 7efecd15d700 1 --2- 172.21.15.80:0/2041204441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e50fc6ad0 0x562e50fc7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.913+0000 7efecd15d700 1 -- 172.21.15.80:0/2041204441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e50fc73f0 msgr2=0x562e50fc5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.913+0000 7efecd15d700 1 --2- 172.21.15.80:0/2041204441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e50fc73f0 0x562e50fc5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.913+0000 7efecd15d700 1 -- 172.21.15.80:0/2041204441 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e50fbd360 con 0x562e50fc12d0 2024-04-26T18:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.913+0000 7efecd15d700 1 --2- 172.21.15.80:0/2041204441 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc12d0 0x562e50fd7330 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7efec8104aa0 tx=0x7efec4020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd67613b46bd405 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.914+0000 7efeb2ffd700 1 -- 172.21.15.80:0/2041204441 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec4003dc0 con 0x562e50fc12d0 2024-04-26T18:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.914+0000 7efeb2ffd700 1 -- 172.21.15.80:0/2041204441 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efec403a070 con 0x562e50fc12d0 2024-04-26T18:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.914+0000 7efeb2ffd700 1 -- 172.21.15.80:0/2041204441 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec4035610 con 0x562e50fc12d0 2024-04-26T18:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.914+0000 7efed9c53b80 1 -- 172.21.15.80:0/2041204441 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc12d0 msgr2=0x562e50fd7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.914+0000 7efed9c53b80 1 --2- 172.21.15.80:0/2041204441 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc12d0 0x562e50fd7330 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7efec8104aa0 tx=0x7efec4020000 comp rx=0 tx=0).stop 2024-04-26T18:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.914+0000 7efed9c53b80 1 -- 172.21.15.80:0/2041204441 shutdown_connections 2024-04-26T18:37:03.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.914+0000 7efed9c53b80 1 --2- 172.21.15.80:0/2041204441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e50fc73f0 0x562e50fc5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.914+0000 7efed9c53b80 1 --2- 172.21.15.80:0/2041204441 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc12d0 0x562e50fd7330 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.914+0000 7efed9c53b80 1 --2- 172.21.15.80:0/2041204441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e50fc6ad0 0x562e50fc7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.914+0000 7efed9c53b80 1 -- 172.21.15.80:0/2041204441 >> 172.21.15.80:0/2041204441 conn(0x562e50eedcf0 msgr2=0x562e50fc7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:03.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.914+0000 7efed9c53b80 1 -- 172.21.15.80:0/2041204441 shutdown_connections 2024-04-26T18:37:03.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.914+0000 7efed9c53b80 1 -- 172.21.15.80:0/2041204441 wait complete. 2024-04-26T18:37:03.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.915+0000 7efed9c53b80 1 -- start start 2024-04-26T18:37:03.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.915+0000 7efed9c53b80 1 Processor -- start 2024-04-26T18:37:03.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.915+0000 7efed9c53b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc12d0 0x562e50fbfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:03.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.915+0000 7efed9c53b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e50fc6ad0 0x562e50fc01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:03.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.915+0000 7efed9c53b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e50fc73f0 0x562e50fc0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:03.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.915+0000 7efed9c53b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562e50fdbd40 con 0x562e50fc12d0 2024-04-26T18:37:03.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.915+0000 7efed9c53b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562e50fdb670 con 0x562e50fc73f0 2024-04-26T18:37:03.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.915+0000 7efed9c53b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562e50fdc410 con 0x562e50fc6ad0 2024-04-26T18:37:03.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.915+0000 7efed9c53b80 10 client.0 _ll_register_callbacks cb 0x562e50ea7530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:37:03.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.915+0000 7efecd15d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc12d0 0x562e50fbfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:03.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.915+0000 7efecd15d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc12d0 0x562e50fbfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35780/0 (socket says 172.21.15.80:35780) 2024-04-26T18:37:03.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.915+0000 7efecd15d700 1 -- 172.21.15.80:0/1662379460 learned_addr learned my addr 172.21.15.80:0/1662379460 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:03.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.915+0000 7efecc95c700 1 --2- 172.21.15.80:0/1662379460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e50fc6ad0 0x562e50fc01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:03.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.916+0000 7efecd95e700 1 --2- 172.21.15.80:0/1662379460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e50fc73f0 0x562e50fc0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:03.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.916+0000 7efecd15d700 1 -- 172.21.15.80:0/1662379460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e50fc6ad0 msgr2=0x562e50fc01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:03.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.916+0000 7efecd15d700 1 --2- 172.21.15.80:0/1662379460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e50fc6ad0 0x562e50fc01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.916+0000 7efecd15d700 1 -- 172.21.15.80:0/1662379460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e50fc73f0 msgr2=0x562e50fc0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:03.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.916+0000 7efecd15d700 1 --2- 172.21.15.80:0/1662379460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e50fc73f0 0x562e50fc0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.916+0000 7efecd15d700 1 -- 172.21.15.80:0/1662379460 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e50fe45e0 con 0x562e50fc12d0 2024-04-26T18:37:03.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.916+0000 7efecd95e700 1 --2- 172.21.15.80:0/1662379460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e50fc73f0 0x562e50fc0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:37:03.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.916+0000 7efecd15d700 1 --2- 172.21.15.80:0/1662379460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc12d0 0x562e50fbfca0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7efec4009350 tx=0x7efec4003d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9680c754e73c837e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:03.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.916+0000 7efeb0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:37:03.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.916+0000 7efeb0ff9700 1 -- 172.21.15.80:0/1662379460 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec4043060 con 0x562e50fc12d0 2024-04-26T18:37:03.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.916+0000 7efed9c53b80 1 -- 172.21.15.80:0/1662379460 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efec403a070 con 0x562e50fc12d0 2024-04-26T18:37:03.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.916+0000 7efeb0ff9700 1 -- 172.21.15.80:0/1662379460 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7efec40354f0 con 0x562e50fc12d0 2024-04-26T18:37:03.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.916+0000 7efeb0ff9700 1 -- 172.21.15.80:0/1662379460 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efec40356f0 con 0x562e50fc12d0 2024-04-26T18:37:03.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.916+0000 7efed9c53b80 10 client.15453 fetch_fsmap learned FSMap version 27 2024-04-26T18:37:03.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.916+0000 7efed9c53b80 1 -- 172.21.15.80:0/1662379460 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562e50fe58e0 con 0x562e50fc12d0 2024-04-26T18:37:03.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.916+0000 7efeb0ff9700 1 -- 172.21.15.80:0/1662379460 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efec403a070 con 0x562e50fc12d0 2024-04-26T18:37:03.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.916+0000 7efeb0ff9700 1 -- 172.21.15.80:0/1662379460 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7efec400f830 con 0x562e50fc12d0 2024-04-26T18:37:03.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.916+0000 7efed9c53b80 10 client.15453 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:37:03.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.917+0000 7efed9c53b80 10 client.15453 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T18:37:03.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.917+0000 7efed9c53b80 20 client.15453 populate_metadata read hostname 'smithi080' 2024-04-26T18:37:03.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.917+0000 7efed9c53b80 1 --2- 172.21.15.80:0/1662379460 >> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] conn(0x562e50fdaa50 0x562e51044ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:03.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.917+0000 7efed9c53b80 4 client.15453 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T18:37:03.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.917+0000 7efed9c53b80 1 -- 172.21.15.80:0/1662379460 --> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] -- command(tid 0: {"prefix": "status"}) -- 0x562e50f1b170 con 0x562e50fdaa50 2024-04-26T18:37:03.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.917+0000 7efecc95c700 1 --2- 172.21.15.80:0/1662379460 >> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] conn(0x562e50fdaa50 0x562e51044ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:03.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.917+0000 7efecc95c700 1 --2- 172.21.15.80:0/1662379460 >> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] conn(0x562e50fdaa50 0x562e51044ae0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=96326519b44fed20 server_cookie=a04d81f47fea5fcc in_seq=0 out_seq=0 2024-04-26T18:37:03.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.917+0000 7efeb0ff9700 10 client.15453 ms_handle_connect on v2:172.21.15.192:6838/2735406056 2024-04-26T18:37:03.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.917+0000 7efeb0ff9700 1 -- 172.21.15.80:0/1662379460 <== mds.1 v2:172.21.15.192:6838/2735406056 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x562e50f1b170 con 0x562e50fdaa50 2024-04-26T18:37:03.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.917+0000 7efeb0ff9700 10 client.15453 handle_command_reply: tid=0 2024-04-26T18:37:03.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.917+0000 7efed9c53b80 1 client.15453 shutdown 2024-04-26T18:37:03.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.917+0000 7efed9c53b80 1 -- 172.21.15.80:0/1662379460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc12d0 msgr2=0x562e50fbfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:03.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.917+0000 7efed9c53b80 1 --2- 172.21.15.80:0/1662379460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc12d0 0x562e50fbfca0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7efec4009350 tx=0x7efec4003d70 comp rx=0 tx=0).stop 2024-04-26T18:37:03.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.917+0000 7efed9c53b80 1 -- 172.21.15.80:0/1662379460 shutdown_connections 2024-04-26T18:37:03.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.917+0000 7efed9c53b80 1 --2- 172.21.15.80:0/1662379460 >> [v2:172.21.15.192:6838/2735406056,v1:172.21.15.192:6839/2735406056] conn(0x562e50fdaa50 0x562e51044ae0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.917+0000 7efed9c53b80 1 --2- 172.21.15.80:0/1662379460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e50fc73f0 0x562e50fc0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.917+0000 7efeb0ff9700 0 client.15453 ms_handle_reset on v2:172.21.15.192:6838/2735406056 2024-04-26T18:37:03.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.917+0000 7efed9c53b80 1 --2- 172.21.15.80:0/1662379460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562e50fc12d0 0x562e50fbfca0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.917+0000 7efed9c53b80 1 --2- 172.21.15.80:0/1662379460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e50fc6ad0 0x562e50fc01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.918+0000 7efed9c53b80 1 -- 172.21.15.80:0/1662379460 >> 172.21.15.80:0/1662379460 conn(0x562e50eedcf0 msgr2=0x562e50fc80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:03.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.918+0000 7efed9c53b80 1 -- 172.21.15.80:0/1662379460 shutdown_connections 2024-04-26T18:37:03.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.918+0000 7efed9c53b80 1 -- 172.21.15.80:0/1662379460 wait complete. 2024-04-26T18:37:03.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.918+0000 7efed9c53b80 20 client.15453 trim_cache size 0 max 16384 2024-04-26T18:37:03.925 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:37:03.925 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "2187ca98-03fa-11ef-bc93-c7b262605968", 2024-04-26T18:37:03.925 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 1, 2024-04-26T18:37:03.925 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24421, 2024-04-26T18:37:03.925 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-26T18:37:03.925 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-26T18:37:03.925 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-26T18:37:03.925 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 223.276009601, 2024-04-26T18:37:03.925 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 27, 2024-04-26T18:37:03.925 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 92, 2024-04-26T18:37:03.925 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 91, 2024-04-26T18:37:03.925 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 262.355895465 2024-04-26T18:37:03.925 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:37:03.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.918+0000 7efecf3c1700 1 -- 172.21.15.80:0/3941625481 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7efeb40a3f60 msgr2=0x7efeb40a6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:03.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.918+0000 7efecf3c1700 1 --2- 172.21.15.80:0/3941625481 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7efeb40a3f60 0x7efeb40a6420 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efec4000c00 tx=0x7efec4005fd0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.918+0000 7efecf3c1700 1 -- 172.21.15.80:0/3941625481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efec8102d10 msgr2=0x7efec819fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:03.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.918+0000 7efecf3c1700 1 --2- 172.21.15.80:0/3941625481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efec8102d10 0x7efec819fc90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7efeb800c9b0 tx=0x7efeb800ccc0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.918+0000 7efecf3c1700 1 -- 172.21.15.80:0/3941625481 shutdown_connections 2024-04-26T18:37:03.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.918+0000 7efecf3c1700 1 --2- 172.21.15.80:0/3941625481 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7efeb40a3f60 0x7efeb40a6420 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.918+0000 7efecf3c1700 1 --2- 172.21.15.80:0/3941625481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efec8104270 0x7efec8199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.918+0000 7efecf3c1700 1 --2- 172.21.15.80:0/3941625481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec8102350 0x7efec819f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.918+0000 7efecf3c1700 1 --2- 172.21.15.80:0/3941625481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efec8102d10 0x7efec819fc90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:03.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.918+0000 7efecf3c1700 1 -- 172.21.15.80:0/3941625481 >> 172.21.15.80:0/3941625481 conn(0x7efec8078390 msgr2=0x7efec80ff470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:03.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.918+0000 7efecf3c1700 1 -- 172.21.15.80:0/3941625481 shutdown_connections 2024-04-26T18:37:03.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:03.918+0000 7efecf3c1700 1 -- 172.21.15.80:0/3941625481 wait complete. 2024-04-26T18:37:04.724 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph tell mds.b status 2024-04-26T18:37:04.964 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:37:05.219 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:04 smithi080 ceph-mon[29135]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 25 op/s 2024-04-26T18:37:05.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:04 smithi082 ceph-mon[32808]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 25 op/s 2024-04-26T18:37:05.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:04 smithi192 ceph-mon[32842]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 25 op/s 2024-04-26T18:37:06.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.736+0000 7fb9907d3700 1 -- 172.21.15.80:0/1845331355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9881083a0 msgr2=0x7fb988108780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:06.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.736+0000 7fb9907d3700 1 --2- 172.21.15.80:0/1845331355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9881083a0 0x7fb988108780 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb97800b0a0 tx=0x7fb97800b3b0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.736+0000 7fb9907d3700 1 -- 172.21.15.80:0/1845331355 shutdown_connections 2024-04-26T18:37:06.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.736+0000 7fb9907d3700 1 --2- 172.21.15.80:0/1845331355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb988102d00 0x7fb98810f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.736+0000 7fb9907d3700 1 --2- 172.21.15.80:0/1845331355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9881083a0 0x7fb988108780 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.736+0000 7fb9907d3700 1 --2- 172.21.15.80:0/1845331355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb988102360 0x7fb9881027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.736+0000 7fb9907d3700 1 -- 172.21.15.80:0/1845331355 >> 172.21.15.80:0/1845331355 conn(0x7fb988079250 msgr2=0x7fb988079660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:06.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.736+0000 7fb9907d3700 1 -- 172.21.15.80:0/1845331355 shutdown_connections 2024-04-26T18:37:06.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.736+0000 7fb9907d3700 1 -- 172.21.15.80:0/1845331355 wait complete. 2024-04-26T18:37:06.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.736+0000 7fb9907d3700 1 Processor -- start 2024-04-26T18:37:06.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.737+0000 7fb9907d3700 1 -- start start 2024-04-26T18:37:06.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.737+0000 7fb9907d3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb988102360 0x7fb98819f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:06.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.737+0000 7fb9907d3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb988102d00 0x7fb98819fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:06.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.737+0000 7fb9907d3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9881083a0 0x7fb988199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:06.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.737+0000 7fb9907d3700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb9881124b0 con 0x7fb988102d00 2024-04-26T18:37:06.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.737+0000 7fb9907d3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb988112330 con 0x7fb988102360 2024-04-26T18:37:06.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.737+0000 7fb9907d3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb988112630 con 0x7fb9881083a0 2024-04-26T18:37:06.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.737+0000 7fb98dd6e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb988102d00 0x7fb98819fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:06.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.737+0000 7fb98dd6e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb988102d00 0x7fb98819fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35798/0 (socket says 172.21.15.80:35798) 2024-04-26T18:37:06.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.737+0000 7fb98dd6e700 1 -- 172.21.15.80:0/1063689505 learned_addr learned my addr 172.21.15.80:0/1063689505 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:06.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.737+0000 7fb98e56f700 1 --2- 172.21.15.80:0/1063689505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb988102360 0x7fb98819f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:06.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.737+0000 7fb98ed70700 1 --2- 172.21.15.80:0/1063689505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9881083a0 0x7fb988199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:06.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.737+0000 7fb98dd6e700 1 -- 172.21.15.80:0/1063689505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9881083a0 msgr2=0x7fb988199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:06.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.737+0000 7fb98dd6e700 1 --2- 172.21.15.80:0/1063689505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9881083a0 0x7fb988199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.737+0000 7fb98dd6e700 1 -- 172.21.15.80:0/1063689505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb988102360 msgr2=0x7fb98819f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:06.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.737+0000 7fb98dd6e700 1 --2- 172.21.15.80:0/1063689505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb988102360 0x7fb98819f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.737+0000 7fb98dd6e700 1 -- 172.21.15.80:0/1063689505 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb98819a060 con 0x7fb988102d00 2024-04-26T18:37:06.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.737+0000 7fb98dd6e700 1 --2- 172.21.15.80:0/1063689505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb988102d00 0x7fb98819fc80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb97c00d950 tx=0x7fb97c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:06.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.737+0000 7fb9877fe700 1 -- 172.21.15.80:0/1063689505 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c016070 con 0x7fb988102d00 2024-04-26T18:37:06.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.738+0000 7fb9877fe700 1 -- 172.21.15.80:0/1063689505 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb97c00fd40 con 0x7fb988102d00 2024-04-26T18:37:06.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.738+0000 7fb9877fe700 1 -- 172.21.15.80:0/1063689505 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c00e3b0 con 0x7fb988102d00 2024-04-26T18:37:06.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.738+0000 7fb9907d3700 1 -- 172.21.15.80:0/1063689505 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb98819a350 con 0x7fb988102d00 2024-04-26T18:37:06.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.738+0000 7fb9907d3700 1 -- 172.21.15.80:0/1063689505 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9881a6610 con 0x7fb988102d00 2024-04-26T18:37:06.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.740+0000 7fb9877fe700 1 -- 172.21.15.80:0/1063689505 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 138930+0+0 (secure 0 0 0) 0x7fb97c019070 con 0x7fb988102d00 2024-04-26T18:37:06.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.740+0000 7fb9877fe700 1 --2- 172.21.15.80:0/1063689505 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fb9700a3f60 0x7fb9700a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:06.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.740+0000 7fb98e56f700 1 --2- 172.21.15.80:0/1063689505 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fb9700a3f60 0x7fb9700a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:06.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.740+0000 7fb9877fe700 1 -- 172.21.15.80:0/1063689505 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fb97c0d0540 con 0x7fb988102d00 2024-04-26T18:37:06.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.741+0000 7fb98e56f700 1 --2- 172.21.15.80:0/1063689505 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fb9700a3f60 0x7fb9700a6420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb978009e60 tx=0x7fb97800b7b0 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:06.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.741+0000 7fb99b065b80 1 Processor -- start 2024-04-26T18:37:06.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.741+0000 7fb99b065b80 1 -- start start 2024-04-26T18:37:06.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.741+0000 7fb99b065b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c65f57a20 0x556c65f57e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:06.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.741+0000 7fb99b065b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c65f51d50 0x556c65f521b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:06.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.741+0000 7fb99b065b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f526f0 0x556c65f5e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:06.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.741+0000 7fb99b065b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x556c65ea47e0 con 0x556c65f526f0 2024-04-26T18:37:06.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.741+0000 7fb99b065b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556c65e0a8e0 con 0x556c65f57a20 2024-04-26T18:37:06.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.741+0000 7fb99b065b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x556c65ea07a0 con 0x556c65f51d50 2024-04-26T18:37:06.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.742+0000 7fb98ed70700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f526f0 0x556c65f5e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:06.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.742+0000 7fb98ed70700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f526f0 0x556c65f5e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35810/0 (socket says 172.21.15.80:35810) 2024-04-26T18:37:06.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.742+0000 7fb98ed70700 1 -- 172.21.15.80:0/2127649590 learned_addr learned my addr 172.21.15.80:0/2127649590 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:06.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.742+0000 7fb98e56f700 1 --2- 172.21.15.80:0/2127649590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c65f57a20 0x556c65f57e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:06.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.742+0000 7fb98dd6e700 1 --2- 172.21.15.80:0/2127649590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c65f51d50 0x556c65f521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:06.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.742+0000 7fb98ed70700 1 -- 172.21.15.80:0/2127649590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c65f51d50 msgr2=0x556c65f521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:06.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.742+0000 7fb98ed70700 1 --2- 172.21.15.80:0/2127649590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c65f51d50 0x556c65f521b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.742+0000 7fb98ed70700 1 -- 172.21.15.80:0/2127649590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c65f57a20 msgr2=0x556c65f57e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:06.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.742+0000 7fb98ed70700 1 --2- 172.21.15.80:0/2127649590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c65f57a20 0x556c65f57e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.742+0000 7fb98ed70700 1 -- 172.21.15.80:0/2127649590 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c65df1880 con 0x556c65f526f0 2024-04-26T18:37:06.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.742+0000 7fb98e56f700 1 --2- 172.21.15.80:0/2127649590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c65f57a20 0x556c65f57e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:37:06.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.742+0000 7fb98ed70700 1 --2- 172.21.15.80:0/2127649590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f526f0 0x556c65f5e770 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb9800046a0 tx=0x7fb98000b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25399b8f3d41cdd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:06.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.742+0000 7fb984ff9700 1 -- 172.21.15.80:0/2127649590 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb980004a30 con 0x556c65f526f0 2024-04-26T18:37:06.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.742+0000 7fb984ff9700 1 -- 172.21.15.80:0/2127649590 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb980015070 con 0x556c65f526f0 2024-04-26T18:37:06.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.742+0000 7fb984ff9700 1 -- 172.21.15.80:0/2127649590 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb980003ac0 con 0x556c65f526f0 2024-04-26T18:37:06.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.743+0000 7fb99b065b80 1 -- 172.21.15.80:0/2127649590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f526f0 msgr2=0x556c65f5e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:06.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.743+0000 7fb99b065b80 1 --2- 172.21.15.80:0/2127649590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f526f0 0x556c65f5e770 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb9800046a0 tx=0x7fb98000b970 comp rx=0 tx=0).stop 2024-04-26T18:37:06.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.743+0000 7fb99b065b80 1 -- 172.21.15.80:0/2127649590 shutdown_connections 2024-04-26T18:37:06.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.743+0000 7fb99b065b80 1 --2- 172.21.15.80:0/2127649590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f526f0 0x556c65f5e770 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.743+0000 7fb99b065b80 1 --2- 172.21.15.80:0/2127649590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c65f57a20 0x556c65f57e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.743+0000 7fb99b065b80 1 --2- 172.21.15.80:0/2127649590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c65f51d50 0x556c65f521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.743+0000 7fb99b065b80 1 -- 172.21.15.80:0/2127649590 >> 172.21.15.80:0/2127649590 conn(0x556c65e80570 msgr2=0x556c65f4c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:06.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.743+0000 7fb99b065b80 1 -- 172.21.15.80:0/2127649590 shutdown_connections 2024-04-26T18:37:06.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.743+0000 7fb99b065b80 1 -- 172.21.15.80:0/2127649590 wait complete. 2024-04-26T18:37:06.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.744+0000 7fb99b065b80 1 -- start start 2024-04-26T18:37:06.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.744+0000 7fb99b065b80 1 Processor -- start 2024-04-26T18:37:06.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.744+0000 7fb99b065b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c65f51d50 0x556c65f5e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:06.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.744+0000 7fb99b065b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c65f526f0 0x556c65f5b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:06.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.744+0000 7fb99b065b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f57a20 0x556c65f5bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:06.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.744+0000 7fb99b065b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x556c65f5ecb0 con 0x556c65f57a20 2024-04-26T18:37:06.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.744+0000 7fb99b065b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556c65e5ea30 con 0x556c65f51d50 2024-04-26T18:37:06.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.744+0000 7fb99b065b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x556c65f5ee30 con 0x556c65f526f0 2024-04-26T18:37:06.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.744+0000 7fb99b065b80 10 client.0 _ll_register_callbacks cb 0x556c65e3c900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:37:06.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.744+0000 7fb98ed70700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f57a20 0x556c65f5bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:06.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.744+0000 7fb98ed70700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f57a20 0x556c65f5bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35818/0 (socket says 172.21.15.80:35818) 2024-04-26T18:37:06.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.744+0000 7fb98ed70700 1 -- 172.21.15.80:0/3513284356 learned_addr learned my addr 172.21.15.80:0/3513284356 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:06.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.744+0000 7fb98dd6e700 1 --2- 172.21.15.80:0/3513284356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c65f526f0 0x556c65f5b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:06.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.744+0000 7fb98e56f700 1 --2- 172.21.15.80:0/3513284356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c65f51d50 0x556c65f5e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:06.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.744+0000 7fb98ed70700 1 -- 172.21.15.80:0/3513284356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c65f526f0 msgr2=0x556c65f5b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:06.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.744+0000 7fb98ed70700 1 --2- 172.21.15.80:0/3513284356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c65f526f0 0x556c65f5b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.744+0000 7fb98ed70700 1 -- 172.21.15.80:0/3513284356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c65f51d50 msgr2=0x556c65f5e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:06.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.744+0000 7fb98ed70700 1 --2- 172.21.15.80:0/3513284356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c65f51d50 0x556c65f5e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.744+0000 7fb98ed70700 1 -- 172.21.15.80:0/3513284356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c65e62430 con 0x556c65f57a20 2024-04-26T18:37:06.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.745+0000 7fb98ed70700 1 --2- 172.21.15.80:0/3513284356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f57a20 0x556c65f5bc60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb980004270 tx=0x7fb980004b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d100c0d44ce7e1cd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:06.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.745+0000 7fb96dffb700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:37:06.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.745+0000 7fb96dffb700 1 -- 172.21.15.80:0/3513284356 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb980028060 con 0x556c65f57a20 2024-04-26T18:37:06.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.745+0000 7fb96dffb700 1 -- 172.21.15.80:0/3513284356 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fb980005410 con 0x556c65f57a20 2024-04-26T18:37:06.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.745+0000 7fb99b065b80 1 -- 172.21.15.80:0/3513284356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb980015070 con 0x556c65f57a20 2024-04-26T18:37:06.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.745+0000 7fb96dffb700 1 -- 172.21.15.80:0/3513284356 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb980005610 con 0x556c65f57a20 2024-04-26T18:37:06.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.745+0000 7fb99b065b80 10 client.15465 fetch_fsmap learned FSMap version 27 2024-04-26T18:37:06.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.745+0000 7fb99b065b80 1 -- 172.21.15.80:0/3513284356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556c65f694b0 con 0x556c65f57a20 2024-04-26T18:37:06.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.745+0000 7fb96dffb700 1 -- 172.21.15.80:0/3513284356 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb980015070 con 0x556c65f57a20 2024-04-26T18:37:06.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.745+0000 7fb96dffb700 1 -- 172.21.15.80:0/3513284356 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb980011880 con 0x556c65f57a20 2024-04-26T18:37:06.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.745+0000 7fb99b065b80 10 client.15465 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:37:06.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.745+0000 7fb99b065b80 10 client.15465 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T18:37:06.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.745+0000 7fb99b065b80 20 client.15465 populate_metadata read hostname 'smithi080' 2024-04-26T18:37:06.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.745+0000 7fb99b065b80 1 --2- 172.21.15.80:0/3513284356 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x556c65f6b670 0x556c65f6cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:06.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.745+0000 7fb99b065b80 4 client.15465 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:37:06.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.745+0000 7fb99b065b80 1 -- 172.21.15.80:0/3513284356 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c65eb21c0 con 0x556c65f6b670 2024-04-26T18:37:06.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.746+0000 7fb98e56f700 1 --2- 172.21.15.80:0/3513284356 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x556c65f6b670 0x556c65f6cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:06.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.746+0000 7fb98e56f700 1 --2- 172.21.15.80:0/3513284356 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x556c65f6b670 0x556c65f6cae0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72886c6deaed5f86 server_cookie=813d8422d6682995 in_seq=0 out_seq=0 2024-04-26T18:37:06.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.746+0000 7fb96dffb700 10 client.15465 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:37:06.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.747+0000 7fb96dffb700 1 -- 172.21.15.80:0/3513284356 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556c65eb21c0 con 0x556c65f6b670 2024-04-26T18:37:06.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.747+0000 7fb96dffb700 10 client.15465 handle_command_reply: tid=0 2024-04-26T18:37:06.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.747+0000 7fb99b065b80 1 client.15465 shutdown 2024-04-26T18:37:06.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.747+0000 7fb99b065b80 1 -- 172.21.15.80:0/3513284356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f57a20 msgr2=0x556c65f5bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:06.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.747+0000 7fb99b065b80 1 --2- 172.21.15.80:0/3513284356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f57a20 0x556c65f5bc60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb980004270 tx=0x7fb980004b70 comp rx=0 tx=0).stop 2024-04-26T18:37:06.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.747+0000 7fb99b065b80 1 -- 172.21.15.80:0/3513284356 shutdown_connections 2024-04-26T18:37:06.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.747+0000 7fb99b065b80 1 --2- 172.21.15.80:0/3513284356 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x556c65f6b670 0x556c65f6cae0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.747+0000 7fb99b065b80 1 --2- 172.21.15.80:0/3513284356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f57a20 0x556c65f5bc60 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.747+0000 7fb99b065b80 1 --2- 172.21.15.80:0/3513284356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c65f51d50 0x556c65f5e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.747+0000 7fb96dffb700 0 client.15465 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:37:06.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.747+0000 7fb99b065b80 1 --2- 172.21.15.80:0/3513284356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c65f526f0 0x556c65f5b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.747+0000 7fb99b065b80 1 -- 172.21.15.80:0/3513284356 >> 172.21.15.80:0/3513284356 conn(0x556c65e80570 msgr2=0x556c65f50d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:06.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.747+0000 7fb99b065b80 1 -- 172.21.15.80:0/3513284356 shutdown_connections 2024-04-26T18:37:06.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.747+0000 7fb99b065b80 1 -- 172.21.15.80:0/3513284356 wait complete. 2024-04-26T18:37:06.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.748+0000 7fb99b065b80 20 client.15465 trim_cache size 0 max 16384 2024-04-26T18:37:06.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.768+0000 7fb99b065b80 1 Processor -- start 2024-04-26T18:37:06.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.768+0000 7fb99b065b80 1 -- start start 2024-04-26T18:37:06.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.768+0000 7fb99b065b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c65f51d50 0x556c65f5dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:06.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.768+0000 7fb99b065b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f526f0 0x556c65f46170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:06.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.768+0000 7fb99b065b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c65f57a20 0x556c65f5afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:06.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.768+0000 7fb99b065b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x556c65f6ae20 con 0x556c65f526f0 2024-04-26T18:37:06.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.768+0000 7fb99b065b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556c65f6b4f0 con 0x556c65f57a20 2024-04-26T18:37:06.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.768+0000 7fb99b065b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x556c65f6bbc0 con 0x556c65f51d50 2024-04-26T18:37:06.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.768+0000 7fb98dd6e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f526f0 0x556c65f46170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:06.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.768+0000 7fb98dd6e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f526f0 0x556c65f46170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35820/0 (socket says 172.21.15.80:35820) 2024-04-26T18:37:06.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.768+0000 7fb98dd6e700 1 -- 172.21.15.80:0/1574765322 learned_addr learned my addr 172.21.15.80:0/1574765322 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:06.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.768+0000 7fb98ed70700 1 --2- 172.21.15.80:0/1574765322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c65f57a20 0x556c65f5afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:06.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.768+0000 7fb98dd6e700 1 -- 172.21.15.80:0/1574765322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c65f51d50 msgr2=0x556c65f5dbc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T18:37:06.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.769+0000 7fb98dd6e700 1 --2- 172.21.15.80:0/1574765322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c65f51d50 0x556c65f5dbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.769+0000 7fb98dd6e700 1 -- 172.21.15.80:0/1574765322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c65f57a20 msgr2=0x556c65f5afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:06.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.769+0000 7fb98dd6e700 1 --2- 172.21.15.80:0/1574765322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c65f57a20 0x556c65f5afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.769+0000 7fb98dd6e700 1 -- 172.21.15.80:0/1574765322 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c65f6b310 con 0x556c65f526f0 2024-04-26T18:37:06.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.769+0000 7fb98ed70700 1 --2- 172.21.15.80:0/1574765322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c65f57a20 0x556c65f5afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:37:06.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.769+0000 7fb98dd6e700 1 --2- 172.21.15.80:0/1574765322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f526f0 0x556c65f46170 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb97c098cc0 tx=0x7fb97c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc80de09af1aa6f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:06.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.769+0000 7fb96ffff700 1 -- 172.21.15.80:0/1574765322 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c0b5070 con 0x556c65f526f0 2024-04-26T18:37:06.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.769+0000 7fb96ffff700 1 -- 172.21.15.80:0/1574765322 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb97c09a5f0 con 0x556c65f526f0 2024-04-26T18:37:06.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.769+0000 7fb96ffff700 1 -- 172.21.15.80:0/1574765322 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c014070 con 0x556c65f526f0 2024-04-26T18:37:06.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.770+0000 7fb99b065b80 1 -- 172.21.15.80:0/1574765322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f526f0 msgr2=0x556c65f46170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:06.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.770+0000 7fb99b065b80 1 --2- 172.21.15.80:0/1574765322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f526f0 0x556c65f46170 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb97c098cc0 tx=0x7fb97c010000 comp rx=0 tx=0).stop 2024-04-26T18:37:06.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.770+0000 7fb99b065b80 1 -- 172.21.15.80:0/1574765322 shutdown_connections 2024-04-26T18:37:06.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.770+0000 7fb99b065b80 1 --2- 172.21.15.80:0/1574765322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c65f57a20 0x556c65f5afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.770+0000 7fb99b065b80 1 --2- 172.21.15.80:0/1574765322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c65f51d50 0x556c65f5dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.770+0000 7fb99b065b80 1 --2- 172.21.15.80:0/1574765322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f526f0 0x556c65f46170 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.770+0000 7fb99b065b80 1 -- 172.21.15.80:0/1574765322 >> 172.21.15.80:0/1574765322 conn(0x556c65e80570 msgr2=0x556c65f4c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:06.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.770+0000 7fb99b065b80 1 -- 172.21.15.80:0/1574765322 shutdown_connections 2024-04-26T18:37:06.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.770+0000 7fb99b065b80 1 -- 172.21.15.80:0/1574765322 wait complete. 2024-04-26T18:37:06.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.770+0000 7fb99b065b80 1 -- start start 2024-04-26T18:37:06.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.770+0000 7fb99b065b80 1 Processor -- start 2024-04-26T18:37:06.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.770+0000 7fb99b065b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c65f51d50 0x556c65f74f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:06.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.770+0000 7fb99b065b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f526f0 0x556c65f75490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:06.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.770+0000 7fb99b065b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c65f57a20 0x556c65f75bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:06.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.771+0000 7fb99b065b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x556c65f6c960 con 0x556c65f526f0 2024-04-26T18:37:06.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.771+0000 7fb99b065b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556c65f6c290 con 0x556c65f57a20 2024-04-26T18:37:06.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.771+0000 7fb99b065b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x556c65f6d030 con 0x556c65f51d50 2024-04-26T18:37:06.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.771+0000 7fb99b065b80 10 client.0 _ll_register_callbacks cb 0x556c65e3c900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:37:06.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.771+0000 7fb98dd6e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f526f0 0x556c65f75490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:06.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.771+0000 7fb98dd6e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f526f0 0x556c65f75490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35836/0 (socket says 172.21.15.80:35836) 2024-04-26T18:37:06.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.771+0000 7fb98dd6e700 1 -- 172.21.15.80:0/380739007 learned_addr learned my addr 172.21.15.80:0/380739007 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:06.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.771+0000 7fb98ed70700 1 --2- 172.21.15.80:0/380739007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c65f57a20 0x556c65f75bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:06.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.771+0000 7fb98e56f700 1 --2- 172.21.15.80:0/380739007 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c65f51d50 0x556c65f74f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:06.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.771+0000 7fb98dd6e700 1 -- 172.21.15.80:0/380739007 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c65f51d50 msgr2=0x556c65f74f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:06.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.771+0000 7fb98dd6e700 1 --2- 172.21.15.80:0/380739007 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c65f51d50 0x556c65f74f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.771+0000 7fb98dd6e700 1 -- 172.21.15.80:0/380739007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c65f57a20 msgr2=0x556c65f75bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:06.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.771+0000 7fb98dd6e700 1 --2- 172.21.15.80:0/380739007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c65f57a20 0x556c65f75bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.771+0000 7fb98dd6e700 1 -- 172.21.15.80:0/380739007 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c65f763e0 con 0x556c65f526f0 2024-04-26T18:37:06.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.771+0000 7fb98ed70700 1 --2- 172.21.15.80:0/380739007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c65f57a20 0x556c65f75bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:37:06.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.771+0000 7fb98dd6e700 1 --2- 172.21.15.80:0/380739007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f526f0 0x556c65f75490 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0d07e0 tx=0x7fb97c0a4e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f953686dc0929a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:06.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.771+0000 7fb96dffb700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:37:06.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.771+0000 7fb96dffb700 1 -- 172.21.15.80:0/380739007 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c0b9070 con 0x556c65f526f0 2024-04-26T18:37:06.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.771+0000 7fb96dffb700 1 -- 172.21.15.80:0/380739007 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fb97c0d00b0 con 0x556c65f526f0 2024-04-26T18:37:06.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.771+0000 7fb99b065b80 1 -- 172.21.15.80:0/380739007 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb97c09a5f0 con 0x556c65f526f0 2024-04-26T18:37:06.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.771+0000 7fb96dffb700 1 -- 172.21.15.80:0/380739007 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb97c014040 con 0x556c65f526f0 2024-04-26T18:37:06.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.772+0000 7fb99b065b80 10 client.15471 fetch_fsmap learned FSMap version 27 2024-04-26T18:37:06.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.772+0000 7fb99b065b80 1 -- 172.21.15.80:0/380739007 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556c65f53ec0 con 0x556c65f526f0 2024-04-26T18:37:06.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.772+0000 7fb96dffb700 1 -- 172.21.15.80:0/380739007 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb97c09a5f0 con 0x556c65f526f0 2024-04-26T18:37:06.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.772+0000 7fb96dffb700 1 -- 172.21.15.80:0/380739007 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb97c0a0160 con 0x556c65f526f0 2024-04-26T18:37:06.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.772+0000 7fb99b065b80 10 client.15471 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:37:06.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.772+0000 7fb99b065b80 10 client.15471 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T18:37:06.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.772+0000 7fb99b065b80 20 client.15471 populate_metadata read hostname 'smithi080' 2024-04-26T18:37:06.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.772+0000 7fb99b065b80 1 --2- 172.21.15.80:0/380739007 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x556c65fd7970 0x556c65fd6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:06.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.772+0000 7fb99b065b80 4 client.15471 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T18:37:06.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.772+0000 7fb99b065b80 1 -- 172.21.15.80:0/380739007 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "status"}) -- 0x556c65eac260 con 0x556c65fd7970 2024-04-26T18:37:06.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.772+0000 7fb98e56f700 1 --2- 172.21.15.80:0/380739007 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x556c65fd7970 0x556c65fd6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:06.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.773+0000 7fb98e56f700 1 --2- 172.21.15.80:0/380739007 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x556c65fd7970 0x556c65fd6680 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f58f2a973e332e4 server_cookie=3ac023ca4ddbb799 in_seq=0 out_seq=0 2024-04-26T18:37:06.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.773+0000 7fb96dffb700 10 client.15471 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:37:06.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.773+0000 7fb96dffb700 1 -- 172.21.15.80:0/380739007 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x556c65eac260 con 0x556c65fd7970 2024-04-26T18:37:06.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.773+0000 7fb96dffb700 10 client.15471 handle_command_reply: tid=0 2024-04-26T18:37:06.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.773+0000 7fb99b065b80 1 client.15471 shutdown 2024-04-26T18:37:06.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.773+0000 7fb99b065b80 1 -- 172.21.15.80:0/380739007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f526f0 msgr2=0x556c65f75490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:06.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.773+0000 7fb99b065b80 1 --2- 172.21.15.80:0/380739007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f526f0 0x556c65f75490 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0d07e0 tx=0x7fb97c0a4e30 comp rx=0 tx=0).stop 2024-04-26T18:37:06.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.773+0000 7fb99b065b80 1 -- 172.21.15.80:0/380739007 shutdown_connections 2024-04-26T18:37:06.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.773+0000 7fb99b065b80 1 --2- 172.21.15.80:0/380739007 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x556c65fd7970 0x556c65fd6680 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.773+0000 7fb99b065b80 1 --2- 172.21.15.80:0/380739007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c65f57a20 0x556c65f75bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.773+0000 7fb99b065b80 1 --2- 172.21.15.80:0/380739007 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c65f51d50 0x556c65f74f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.773+0000 7fb99b065b80 1 --2- 172.21.15.80:0/380739007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556c65f526f0 0x556c65f75490 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.773+0000 7fb99b065b80 1 -- 172.21.15.80:0/380739007 >> 172.21.15.80:0/380739007 conn(0x556c65e80570 msgr2=0x556c65f5aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:06.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.773+0000 7fb96dffb700 0 client.15471 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:37:06.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.773+0000 7fb99b065b80 1 -- 172.21.15.80:0/380739007 shutdown_connections 2024-04-26T18:37:06.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.773+0000 7fb99b065b80 1 -- 172.21.15.80:0/380739007 wait complete. 2024-04-26T18:37:06.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.773+0000 7fb99b065b80 20 client.15471 trim_cache size 0 max 16384 2024-04-26T18:37:06.780 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:37:06.780 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "2187ca98-03fa-11ef-bc93-c7b262605968", 2024-04-26T18:37:06.780 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2024-04-26T18:37:06.780 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 24434, 2024-04-26T18:37:06.780 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-26T18:37:06.780 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-26T18:37:06.780 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-26T18:37:06.780 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 238.22056101000001, 2024-04-26T18:37:06.780 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 27, 2024-04-26T18:37:06.780 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 92, 2024-04-26T18:37:06.780 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 91, 2024-04-26T18:37:06.780 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 254.92141667300001 2024-04-26T18:37:06.781 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:37:06.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.774+0000 7fb9907d3700 1 -- 172.21.15.80:0/1063689505 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fb9700a3f60 msgr2=0x7fb9700a6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:06.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.774+0000 7fb9907d3700 1 --2- 172.21.15.80:0/1063689505 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fb9700a3f60 0x7fb9700a6420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb978009e60 tx=0x7fb97800b7b0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.774+0000 7fb9907d3700 1 -- 172.21.15.80:0/1063689505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb988102d00 msgr2=0x7fb98819fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:06.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.774+0000 7fb9907d3700 1 --2- 172.21.15.80:0/1063689505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb988102d00 0x7fb98819fc80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb97c00d950 tx=0x7fb97c00dc60 comp rx=0 tx=0).stop 2024-04-26T18:37:06.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.774+0000 7fb9907d3700 1 -- 172.21.15.80:0/1063689505 shutdown_connections 2024-04-26T18:37:06.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.774+0000 7fb9907d3700 1 --2- 172.21.15.80:0/1063689505 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fb9700a3f60 0x7fb9700a6420 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.774+0000 7fb9907d3700 1 --2- 172.21.15.80:0/1063689505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9881083a0 0x7fb988199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.774+0000 7fb9907d3700 1 --2- 172.21.15.80:0/1063689505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb988102360 0x7fb98819f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.774+0000 7fb9907d3700 1 --2- 172.21.15.80:0/1063689505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb988102d00 0x7fb98819fc80 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:06.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.774+0000 7fb9907d3700 1 -- 172.21.15.80:0/1063689505 >> 172.21.15.80:0/1063689505 conn(0x7fb988079250 msgr2=0x7fb98806bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:06.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.774+0000 7fb9907d3700 1 -- 172.21.15.80:0/1063689505 shutdown_connections 2024-04-26T18:37:06.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:06.774+0000 7fb9907d3700 1 -- 172.21.15.80:0/1063689505 wait complete. 2024-04-26T18:37:07.146 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:06 smithi080 ceph-mon[29135]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 29 op/s 2024-04-26T18:37:07.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:06 smithi082 ceph-mon[32808]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 29 op/s 2024-04-26T18:37:07.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:06 smithi192 ceph-mon[32842]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 29 op/s 2024-04-26T18:37:07.585 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-04-26T18:37:09.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:08 smithi080 ceph-mon[29135]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 26 op/s 2024-04-26T18:37:09.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:08 smithi192 ceph-mon[32842]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 26 op/s 2024-04-26T18:37:09.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:08 smithi082 ceph-mon[32808]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 26 op/s 2024-04-26T18:37:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.774+0000 7fcda7789640 1 -- 172.21.15.80:0/443761377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcda006b160 msgr2=0x7fcda006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.774+0000 7fcda7789640 1 --2- 172.21.15.80:0/443761377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcda006b160 0x7fcda006b5c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fcd90009900 tx=0x7fcd9002a410 comp rx=0 tx=0).stop 2024-04-26T18:37:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.774+0000 7fcda7789640 1 -- 172.21.15.80:0/443761377 shutdown_connections 2024-04-26T18:37:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.774+0000 7fcda7789640 1 --2- 172.21.15.80:0/443761377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcda006b160 0x7fcda006b5c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.774+0000 7fcda7789640 1 --2- 172.21.15.80:0/443761377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcda006bb00 0x7fcda010f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.774+0000 7fcda7789640 1 --2- 172.21.15.80:0/443761377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcda0108920 0x7fcda0108d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.774+0000 7fcda7789640 1 -- 172.21.15.80:0/443761377 >> 172.21.15.80:0/443761377 conn(0x7fcda0077630 msgr2=0x7fcda0077a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.774+0000 7fcda7789640 1 -- 172.21.15.80:0/443761377 shutdown_connections 2024-04-26T18:37:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.774+0000 7fcda7789640 1 -- 172.21.15.80:0/443761377 wait complete. 2024-04-26T18:37:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.774+0000 7fcda7789640 1 Processor -- start 2024-04-26T18:37:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.775+0000 7fcda7789640 1 -- start start 2024-04-26T18:37:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.775+0000 7fcda7789640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcda006b160 0x7fcda01990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.775+0000 7fcda7789640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcda006bb00 0x7fcda0199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.775+0000 7fcda7789640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcda0108920 0x7fcda019d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.775+0000 7fcda7789640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcda0112be0 con 0x7fcda006bb00 2024-04-26T18:37:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.775+0000 7fcda7789640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcda0112a60 con 0x7fcda006b160 2024-04-26T18:37:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.775+0000 7fcda7789640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcda0112d60 con 0x7fcda0108920 2024-04-26T18:37:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.775+0000 7fcda4d24640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcda006bb00 0x7fcda0199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.775+0000 7fcda4d24640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcda006bb00 0x7fcda0199620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35860/0 (socket says 172.21.15.80:35860) 2024-04-26T18:37:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.775+0000 7fcda4d24640 1 -- 172.21.15.80:0/3055713374 learned_addr learned my addr 172.21.15.80:0/3055713374 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.775+0000 7fcda5525640 1 --2- 172.21.15.80:0/3055713374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcda006b160 0x7fcda01990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.775+0000 7fcda5d26640 1 --2- 172.21.15.80:0/3055713374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcda0108920 0x7fcda019d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.775+0000 7fcda4d24640 1 -- 172.21.15.80:0/3055713374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcda0108920 msgr2=0x7fcda019d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.775+0000 7fcda4d24640 1 --2- 172.21.15.80:0/3055713374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcda0108920 0x7fcda019d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.775+0000 7fcda4d24640 1 -- 172.21.15.80:0/3055713374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcda006b160 msgr2=0x7fcda01990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.775+0000 7fcda4d24640 1 --2- 172.21.15.80:0/3055713374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcda006b160 0x7fcda01990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.775+0000 7fcda4d24640 1 -- 172.21.15.80:0/3055713374 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda019e0d0 con 0x7fcda006bb00 2024-04-26T18:37:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.775+0000 7fcda4d24640 1 --2- 172.21.15.80:0/3055713374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcda006bb00 0x7fcda0199620 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fcd90005940 tx=0x7fcd900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.775+0000 7fcd967fc640 1 -- 172.21.15.80:0/3055713374 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9003f030 con 0x7fcda006bb00 2024-04-26T18:37:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.775+0000 7fcd967fc640 1 -- 172.21.15.80:0/3055713374 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd90003cb0 con 0x7fcda006bb00 2024-04-26T18:37:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.775+0000 7fcda7789640 1 -- 172.21.15.80:0/3055713374 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcda019e360 con 0x7fcda006bb00 2024-04-26T18:37:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.776+0000 7fcd967fc640 1 -- 172.21.15.80:0/3055713374 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd90035070 con 0x7fcda006bb00 2024-04-26T18:37:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.776+0000 7fcda7789640 1 -- 172.21.15.80:0/3055713374 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcda01a5c50 con 0x7fcda006bb00 2024-04-26T18:37:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.778+0000 7fcd967fc640 1 -- 172.21.15.80:0/3055713374 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 138930+0+0 (secure 0 0 0) 0x7fcd90042030 con 0x7fcda006bb00 2024-04-26T18:37:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.778+0000 7fcdaa57d740 1 Processor -- start 2024-04-26T18:37:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.778+0000 7fcdaa57d740 1 -- start start 2024-04-26T18:37:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.778+0000 7fcdaa57d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac3249e00 0x55dac324a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.778+0000 7fcd967fc640 1 --2- 172.21.15.80:0/3055713374 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fcd8c0a3f70 0x7fcd8c0a6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.778+0000 7fcdaa57d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dac324a720 0x55dac3258fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.778+0000 7fcdaa57d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dac32594f0 0x55dac325b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.778+0000 7fcdaa57d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55dac31b0460 con 0x55dac3249e00 2024-04-26T18:37:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.778+0000 7fcdaa57d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55dac316a590 con 0x55dac32594f0 2024-04-26T18:37:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.778+0000 7fcdaa57d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55dac31ac420 con 0x55dac324a720 2024-04-26T18:37:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.779+0000 7fcda5d26640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac3249e00 0x55dac324a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.779+0000 7fcda5d26640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac3249e00 0x55dac324a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35862/0 (socket says 172.21.15.80:35862) 2024-04-26T18:37:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.779+0000 7fcda5525640 1 --2- 172.21.15.80:0/3055713374 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fcd8c0a3f70 0x7fcd8c0a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.779+0000 7fcda5d26640 1 -- 172.21.15.80:0/1920980317 learned_addr learned my addr 172.21.15.80:0/1920980317 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.779+0000 7fcd967fc640 1 -- 172.21.15.80:0/3055713374 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fcd900f1330 con 0x7fcda006bb00 2024-04-26T18:37:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.779+0000 7fcda4d24640 1 --2- 172.21.15.80:0/1920980317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dac324a720 0x55dac3258fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.779+0000 7fcda5d26640 1 --2- 172.21.15.80:0/1920980317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dac32594f0 0x55dac325b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.779+0000 7fcda5d26640 1 -- 172.21.15.80:0/1920980317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dac324a720 msgr2=0x55dac3258fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.779+0000 7fcda5d26640 1 --2- 172.21.15.80:0/1920980317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dac324a720 0x55dac3258fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.779+0000 7fcda5d26640 1 -- 172.21.15.80:0/1920980317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dac32594f0 msgr2=0x55dac325b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.779+0000 7fcda5d26640 1 --2- 172.21.15.80:0/1920980317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dac32594f0 0x55dac325b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.779+0000 7fcda5d26640 1 -- 172.21.15.80:0/1920980317 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dac31770d0 con 0x55dac3249e00 2024-04-26T18:37:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.779+0000 7fcda5525640 1 --2- 172.21.15.80:0/3055713374 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fcd8c0a3f70 0x7fcd8c0a6430 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c00a400 tx=0x7fcd9c00d040 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.779+0000 7fcda5d26640 1 --2- 172.21.15.80:0/1920980317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac3249e00 0x55dac324a1e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcd980154f0 tx=0x7fcd98009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f994dc4151c10194 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.779+0000 7fcd8b7fe640 1 -- 172.21.15.80:0/1920980317 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9801b070 con 0x55dac3249e00 2024-04-26T18:37:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.779+0000 7fcd8b7fe640 1 -- 172.21.15.80:0/1920980317 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd98013970 con 0x55dac3249e00 2024-04-26T18:37:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.779+0000 7fcd8b7fe640 1 -- 172.21.15.80:0/1920980317 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd980107e0 con 0x55dac3249e00 2024-04-26T18:37:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.780+0000 7fcdaa57d740 1 -- 172.21.15.80:0/1920980317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac3249e00 msgr2=0x55dac324a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.780+0000 7fcdaa57d740 1 --2- 172.21.15.80:0/1920980317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac3249e00 0x55dac324a1e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcd980154f0 tx=0x7fcd98009530 comp rx=0 tx=0).stop 2024-04-26T18:37:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.780+0000 7fcdaa57d740 1 -- 172.21.15.80:0/1920980317 shutdown_connections 2024-04-26T18:37:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.780+0000 7fcdaa57d740 1 --2- 172.21.15.80:0/1920980317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dac32594f0 0x55dac325b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.780+0000 7fcdaa57d740 1 --2- 172.21.15.80:0/1920980317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dac324a720 0x55dac3258fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.780+0000 7fcdaa57d740 1 --2- 172.21.15.80:0/1920980317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac3249e00 0x55dac324a1e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.780+0000 7fcdaa57d740 1 -- 172.21.15.80:0/1920980317 >> 172.21.15.80:0/1920980317 conn(0x55dac3246410 msgr2=0x55dac32467f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.780+0000 7fcdaa57d740 1 -- 172.21.15.80:0/1920980317 shutdown_connections 2024-04-26T18:37:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.780+0000 7fcdaa57d740 1 -- 172.21.15.80:0/1920980317 wait complete. 2024-04-26T18:37:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.780+0000 7fcdaa57d740 1 -- start start 2024-04-26T18:37:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.780+0000 7fcdaa57d740 1 Processor -- start 2024-04-26T18:37:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.781+0000 7fcdaa57d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dac3249e00 0x55dac3256440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.781+0000 7fcdaa57d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dac324a720 0x55dac3256980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.781+0000 7fcdaa57d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac32594f0 0x55dac3256ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.781+0000 7fcdaa57d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55dac325c120 con 0x55dac32594f0 2024-04-26T18:37:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.781+0000 7fcdaa57d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55dac3137b60 con 0x55dac324a720 2024-04-26T18:37:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.781+0000 7fcdaa57d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55dac325c2a0 con 0x55dac3249e00 2024-04-26T18:37:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.781+0000 7fcdaa57d740 10 client.0 _ll_register_callbacks cb 0x55dac315c2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:37:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.781+0000 7fcda5d26640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac32594f0 0x55dac3256ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.781+0000 7fcda5d26640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac32594f0 0x55dac3256ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35868/0 (socket says 172.21.15.80:35868) 2024-04-26T18:37:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.781+0000 7fcda5d26640 1 -- 172.21.15.80:0/1672089953 learned_addr learned my addr 172.21.15.80:0/1672089953 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.781+0000 7fcda4d24640 1 --2- 172.21.15.80:0/1672089953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dac324a720 0x55dac3256980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.781+0000 7fcda5525640 1 --2- 172.21.15.80:0/1672089953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dac3249e00 0x55dac3256440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.781+0000 7fcda5d26640 1 -- 172.21.15.80:0/1672089953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dac3249e00 msgr2=0x55dac3256440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.781+0000 7fcda5d26640 1 --2- 172.21.15.80:0/1672089953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dac3249e00 0x55dac3256440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.781+0000 7fcda5d26640 1 -- 172.21.15.80:0/1672089953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dac324a720 msgr2=0x55dac3256980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.781+0000 7fcda5d26640 1 --2- 172.21.15.80:0/1672089953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dac324a720 0x55dac3256980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.781+0000 7fcda5d26640 1 -- 172.21.15.80:0/1672089953 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dac2ec2210 con 0x55dac32594f0 2024-04-26T18:37:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.781+0000 7fcda4d24640 1 --2- 172.21.15.80:0/1672089953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dac324a720 0x55dac3256980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:37:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.781+0000 7fcda5d26640 1 --2- 172.21.15.80:0/1672089953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac32594f0 0x55dac3256ec0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcd98009810 tx=0x7fcd980058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4307b32c512304c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.781+0000 7fcd88ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:37:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.782+0000 7fcd88ff9640 1 -- 172.21.15.80:0/1672089953 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9801b040 con 0x55dac32594f0 2024-04-26T18:37:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.782+0000 7fcd88ff9640 1 -- 172.21.15.80:0/1672089953 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fcd98013b20 con 0x55dac32594f0 2024-04-26T18:37:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.782+0000 7fcdaa57d740 1 -- 172.21.15.80:0/1672089953 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd98013970 con 0x55dac32594f0 2024-04-26T18:37:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.782+0000 7fcd88ff9640 1 -- 172.21.15.80:0/1672089953 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcd98013780 con 0x55dac32594f0 2024-04-26T18:37:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.782+0000 7fcdaa57d740 10 client.15483 fetch_fsmap learned FSMap version 27 2024-04-26T18:37:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.782+0000 7fcdaa57d740 1 -- 172.21.15.80:0/1672089953 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55dac2f8e620 con 0x55dac32594f0 2024-04-26T18:37:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.782+0000 7fcd88ff9640 1 -- 172.21.15.80:0/1672089953 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd98013970 con 0x55dac32594f0 2024-04-26T18:37:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.782+0000 7fcd88ff9640 1 -- 172.21.15.80:0/1672089953 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fcd9800c030 con 0x55dac32594f0 2024-04-26T18:37:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.782+0000 7fcdaa57d740 10 client.15483 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:37:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.782+0000 7fcdaa57d740 10 client.15483 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:37:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.782+0000 7fcdaa57d740 20 client.15483 populate_metadata read hostname 'smithi080' 2024-04-26T18:37:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.782+0000 7fcdaa57d740 1 --2- 172.21.15.80:0/1672089953 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55dac3269590 0x55dac326b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.782+0000 7fcdaa57d740 4 client.15483 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:37:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.782+0000 7fcdaa57d740 1 -- 172.21.15.80:0/1672089953 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dac31be070 con 0x55dac3269590 2024-04-26T18:37:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.782+0000 7fcda5525640 1 --2- 172.21.15.80:0/1672089953 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55dac3269590 0x55dac326b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.783+0000 7fcd88ff9640 10 client.15483 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:37:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.783+0000 7fcda5525640 1 --2- 172.21.15.80:0/1672089953 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55dac3269590 0x55dac326b980 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a2a7d13ae4a74cf server_cookie=37c7fa5ff4ee3c44 in_seq=0 out_seq=0 2024-04-26T18:37:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.784+0000 7fcd88ff9640 1 -- 172.21.15.80:0/1672089953 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55dac31be070 con 0x55dac3269590 2024-04-26T18:37:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.784+0000 7fcd88ff9640 10 client.15483 handle_command_reply: tid=0 2024-04-26T18:37:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.784+0000 7fcdaa57d740 1 client.15483 shutdown 2024-04-26T18:37:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.784+0000 7fcdaa57d740 1 -- 172.21.15.80:0/1672089953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac32594f0 msgr2=0x55dac3256ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.784+0000 7fcdaa57d740 1 --2- 172.21.15.80:0/1672089953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac32594f0 0x55dac3256ec0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcd98009810 tx=0x7fcd980058e0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.784+0000 7fcdaa57d740 1 -- 172.21.15.80:0/1672089953 shutdown_connections 2024-04-26T18:37:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.784+0000 7fcdaa57d740 1 --2- 172.21.15.80:0/1672089953 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55dac3269590 0x55dac326b980 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.784+0000 7fcdaa57d740 1 --2- 172.21.15.80:0/1672089953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac32594f0 0x55dac3256ec0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.784+0000 7fcdaa57d740 1 --2- 172.21.15.80:0/1672089953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dac324a720 0x55dac3256980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.784+0000 7fcd88ff9640 0 client.15483 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:37:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.784+0000 7fcdaa57d740 1 --2- 172.21.15.80:0/1672089953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dac3249e00 0x55dac3256440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.784+0000 7fcdaa57d740 1 -- 172.21.15.80:0/1672089953 >> 172.21.15.80:0/1672089953 conn(0x55dac3246410 msgr2=0x55dac324c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.784+0000 7fcdaa57d740 1 -- 172.21.15.80:0/1672089953 shutdown_connections 2024-04-26T18:37:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.784+0000 7fcdaa57d740 1 -- 172.21.15.80:0/1672089953 wait complete. 2024-04-26T18:37:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.784+0000 7fcdaa57d740 20 client.15483 trim_cache size 0 max 16384 2024-04-26T18:37:09.804 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.798+0000 7fcdaa57d740 1 Processor -- start 2024-04-26T18:37:09.804 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.799+0000 7fcdaa57d740 1 -- start start 2024-04-26T18:37:09.804 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.799+0000 7fcdaa57d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac3249e00 0x55dac3265020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:09.804 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.799+0000 7fcdaa57d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dac324a720 0x55dac3270f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:09.804 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.799+0000 7fcdaa57d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dac32594f0 0x55dac3271490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.799+0000 7fcdaa57d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcda01ac190 con 0x55dac3249e00 2024-04-26T18:37:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.799+0000 7fcdaa57d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcda01adcd0 con 0x55dac324a720 2024-04-26T18:37:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.799+0000 7fcdaa57d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcda01ac860 con 0x55dac32594f0 2024-04-26T18:37:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.799+0000 7fcda5525640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac3249e00 0x55dac3265020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.799+0000 7fcda5525640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac3249e00 0x55dac3265020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35876/0 (socket says 172.21.15.80:35876) 2024-04-26T18:37:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.799+0000 7fcda5525640 1 -- 172.21.15.80:0/2356151318 learned_addr learned my addr 172.21.15.80:0/2356151318 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.799+0000 7fcda4d24640 1 --2- 172.21.15.80:0/2356151318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dac324a720 0x55dac3270f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.799+0000 7fcda5525640 1 -- 172.21.15.80:0/2356151318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dac32594f0 msgr2=0x55dac3271490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.799+0000 7fcda5525640 1 --2- 172.21.15.80:0/2356151318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dac32594f0 0x55dac3271490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.799+0000 7fcda5525640 1 -- 172.21.15.80:0/2356151318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dac324a720 msgr2=0x55dac3270f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.799+0000 7fcda5525640 1 --2- 172.21.15.80:0/2356151318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dac324a720 0x55dac3270f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.799+0000 7fcda5525640 1 -- 172.21.15.80:0/2356151318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dac3246240 con 0x55dac3249e00 2024-04-26T18:37:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.799+0000 7fcda4d24640 1 --2- 172.21.15.80:0/2356151318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dac324a720 0x55dac3270f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:37:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.799+0000 7fcda5525640 1 --2- 172.21.15.80:0/2356151318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac3249e00 0x55dac3265020 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x55dac326bec0 tx=0x7fcd9c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78744be754772b38 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.799+0000 7fcd8affd640 1 -- 172.21.15.80:0/2356151318 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c02a070 con 0x55dac3249e00 2024-04-26T18:37:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.799+0000 7fcd8affd640 1 -- 172.21.15.80:0/2356151318 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd9c021e80 con 0x55dac3249e00 2024-04-26T18:37:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.799+0000 7fcd8affd640 1 -- 172.21.15.80:0/2356151318 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c022650 con 0x55dac3249e00 2024-04-26T18:37:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.800+0000 7fcdaa57d740 1 -- 172.21.15.80:0/2356151318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac3249e00 msgr2=0x55dac3265020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.800+0000 7fcdaa57d740 1 --2- 172.21.15.80:0/2356151318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac3249e00 0x55dac3265020 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x55dac326bec0 tx=0x7fcd9c011000 comp rx=0 tx=0).stop 2024-04-26T18:37:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.800+0000 7fcdaa57d740 1 -- 172.21.15.80:0/2356151318 shutdown_connections 2024-04-26T18:37:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.800+0000 7fcdaa57d740 1 --2- 172.21.15.80:0/2356151318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dac32594f0 0x55dac3271490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.800+0000 7fcdaa57d740 1 --2- 172.21.15.80:0/2356151318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dac324a720 0x55dac3270f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.800+0000 7fcdaa57d740 1 --2- 172.21.15.80:0/2356151318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac3249e00 0x55dac3265020 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.800+0000 7fcdaa57d740 1 -- 172.21.15.80:0/2356151318 >> 172.21.15.80:0/2356151318 conn(0x55dac3246410 msgr2=0x55dac32455b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.800+0000 7fcdaa57d740 1 -- 172.21.15.80:0/2356151318 shutdown_connections 2024-04-26T18:37:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.800+0000 7fcdaa57d740 1 -- 172.21.15.80:0/2356151318 wait complete. 2024-04-26T18:37:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.800+0000 7fcdaa57d740 1 -- start start 2024-04-26T18:37:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.800+0000 7fcdaa57d740 1 Processor -- start 2024-04-26T18:37:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.801+0000 7fcdaa57d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dac3249e00 0x55dac32533f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.801+0000 7fcdaa57d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dac324a720 0x55dac3253930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.801+0000 7fcdaa57d740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac32594f0 0x55dac3253eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.801+0000 7fcdaa57d740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcda01ad600 con 0x55dac32594f0 2024-04-26T18:37:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.801+0000 7fcdaa57d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcda01acf30 con 0x55dac324a720 2024-04-26T18:37:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.801+0000 7fcdaa57d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcda01aa170 con 0x55dac3249e00 2024-04-26T18:37:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.801+0000 7fcdaa57d740 10 client.0 _ll_register_callbacks cb 0x7fcd98019070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:37:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.801+0000 7fcda5d26640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac32594f0 0x55dac3253eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.801+0000 7fcda5d26640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac32594f0 0x55dac3253eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35880/0 (socket says 172.21.15.80:35880) 2024-04-26T18:37:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.801+0000 7fcda5d26640 1 -- 172.21.15.80:0/1096990967 learned_addr learned my addr 172.21.15.80:0/1096990967 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.801+0000 7fcda4d24640 1 --2- 172.21.15.80:0/1096990967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dac324a720 0x55dac3253930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.801+0000 7fcda5525640 1 --2- 172.21.15.80:0/1096990967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dac3249e00 0x55dac32533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.801+0000 7fcda5d26640 1 -- 172.21.15.80:0/1096990967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dac3249e00 msgr2=0x55dac32533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.801+0000 7fcda5d26640 1 --2- 172.21.15.80:0/1096990967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dac3249e00 0x55dac32533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.801+0000 7fcda5d26640 1 -- 172.21.15.80:0/1096990967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dac324a720 msgr2=0x55dac3253930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.801+0000 7fcda5d26640 1 --2- 172.21.15.80:0/1096990967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dac324a720 0x55dac3253930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.801+0000 7fcda5d26640 1 -- 172.21.15.80:0/1096990967 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dac324ac60 con 0x55dac32594f0 2024-04-26T18:37:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.801+0000 7fcda4d24640 1 --2- 172.21.15.80:0/1096990967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dac324a720 0x55dac3253930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:37:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.801+0000 7fcda5525640 1 --2- 172.21.15.80:0/1096990967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dac3249e00 0x55dac32533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:37:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.801+0000 7fcda5d26640 1 --2- 172.21.15.80:0/1096990967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac32594f0 0x55dac3253eb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fcd98001eb0 tx=0x7fcd98003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0701ce0ff32d1ec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.801+0000 7fcd88ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:37:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.802+0000 7fcd88ff9640 1 -- 172.21.15.80:0/1096990967 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9801b030 con 0x55dac32594f0 2024-04-26T18:37:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.802+0000 7fcd88ff9640 1 -- 172.21.15.80:0/1096990967 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fcd98009490 con 0x55dac32594f0 2024-04-26T18:37:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.802+0000 7fcdaa57d740 1 -- 172.21.15.80:0/1096990967 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dac31b7ee0 con 0x55dac32594f0 2024-04-26T18:37:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.802+0000 7fcd88ff9640 1 -- 172.21.15.80:0/1096990967 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcd980092a0 con 0x55dac32594f0 2024-04-26T18:37:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.802+0000 7fcdaa57d740 10 client.15489 fetch_fsmap learned FSMap version 27 2024-04-26T18:37:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.802+0000 7fcdaa57d740 1 -- 172.21.15.80:0/1096990967 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55dac32cfbf0 con 0x55dac32594f0 2024-04-26T18:37:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.802+0000 7fcd88ff9640 1 -- 172.21.15.80:0/1096990967 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55dac31b7ee0 con 0x55dac32594f0 2024-04-26T18:37:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.802+0000 7fcd88ff9640 1 -- 172.21.15.80:0/1096990967 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fcd9800c040 con 0x55dac32594f0 2024-04-26T18:37:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.802+0000 7fcdaa57d740 10 client.15489 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:37:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.802+0000 7fcdaa57d740 10 client.15489 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:37:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.802+0000 7fcdaa57d740 20 client.15489 populate_metadata read hostname 'smithi080' 2024-04-26T18:37:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.802+0000 7fcdaa57d740 1 --2- 172.21.15.80:0/1096990967 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55dac32d0320 0x55dac32d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.802+0000 7fcdaa57d740 4 client.15489 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:37:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.802+0000 7fcdaa57d740 1 -- 172.21.15.80:0/1096990967 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dac31335f0 con 0x55dac32d0320 2024-04-26T18:37:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.803+0000 7fcda5525640 1 --2- 172.21.15.80:0/1096990967 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55dac32d0320 0x55dac32d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.803+0000 7fcd88ff9640 10 client.15489 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:37:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.803+0000 7fcda5525640 1 --2- 172.21.15.80:0/1096990967 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55dac32d0320 0x55dac32d2740 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cdfa332492a708e server_cookie=95d163c774985363 in_seq=0 out_seq=0 2024-04-26T18:37:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.811+0000 7fcd88ff9640 1 -- 172.21.15.80:0/1096990967 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dac31335f0 con 0x55dac32d0320 2024-04-26T18:37:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.811+0000 7fcd88ff9640 10 client.15489 handle_command_reply: tid=0 2024-04-26T18:37:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.811+0000 7fcdaa57d740 1 client.15489 shutdown 2024-04-26T18:37:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.811+0000 7fcdaa57d740 1 -- 172.21.15.80:0/1096990967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac32594f0 msgr2=0x55dac3253eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.811+0000 7fcdaa57d740 1 --2- 172.21.15.80:0/1096990967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac32594f0 0x55dac3253eb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fcd98001eb0 tx=0x7fcd98003820 comp rx=0 tx=0).stop 2024-04-26T18:37:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.811+0000 7fcdaa57d740 1 -- 172.21.15.80:0/1096990967 shutdown_connections 2024-04-26T18:37:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.811+0000 7fcdaa57d740 1 --2- 172.21.15.80:0/1096990967 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55dac32d0320 0x55dac32d2740 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.811+0000 7fcdaa57d740 1 --2- 172.21.15.80:0/1096990967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dac32594f0 0x55dac3253eb0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.811+0000 7fcd88ff9640 0 client.15489 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:37:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.811+0000 7fcdaa57d740 1 --2- 172.21.15.80:0/1096990967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dac324a720 0x55dac3253930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.811+0000 7fcdaa57d740 1 --2- 172.21.15.80:0/1096990967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dac3249e00 0x55dac32533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.811+0000 7fcdaa57d740 1 -- 172.21.15.80:0/1096990967 >> 172.21.15.80:0/1096990967 conn(0x55dac3246410 msgr2=0x55dac32563e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.811+0000 7fcdaa57d740 1 -- 172.21.15.80:0/1096990967 shutdown_connections 2024-04-26T18:37:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.811+0000 7fcdaa57d740 1 -- 172.21.15.80:0/1096990967 wait complete. 2024-04-26T18:37:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.811+0000 7fcdaa57d740 20 client.15489 trim_cache size 0 max 16384 2024-04-26T18:37:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:{ 2024-04-26T18:37:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "message": "", 2024-04-26T18:37:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "return_code": 0 2024-04-26T18:37:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:} 2024-04-26T18:37:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.812+0000 7fcda7789640 1 -- 172.21.15.80:0/3055713374 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fcd8c0a3f70 msgr2=0x7fcd8c0a6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.812+0000 7fcda7789640 1 --2- 172.21.15.80:0/3055713374 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fcd8c0a3f70 0x7fcd8c0a6430 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c00a400 tx=0x7fcd9c00d040 comp rx=0 tx=0).stop 2024-04-26T18:37:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.812+0000 7fcda7789640 1 -- 172.21.15.80:0/3055713374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcda006bb00 msgr2=0x7fcda0199620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.812+0000 7fcda7789640 1 --2- 172.21.15.80:0/3055713374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcda006bb00 0x7fcda0199620 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fcd90005940 tx=0x7fcd900042f0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.812+0000 7fcda7789640 1 -- 172.21.15.80:0/3055713374 shutdown_connections 2024-04-26T18:37:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.812+0000 7fcda7789640 1 --2- 172.21.15.80:0/3055713374 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fcd8c0a3f70 0x7fcd8c0a6430 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.812+0000 7fcda7789640 1 --2- 172.21.15.80:0/3055713374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcda006bb00 0x7fcda0199620 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.812+0000 7fcda7789640 1 --2- 172.21.15.80:0/3055713374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcda0108920 0x7fcda019d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.812+0000 7fcda7789640 1 --2- 172.21.15.80:0/3055713374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcda006b160 0x7fcda01990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.812+0000 7fcda7789640 1 -- 172.21.15.80:0/3055713374 >> 172.21.15.80:0/3055713374 conn(0x7fcda0077630 msgr2=0x7fcda0100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.812+0000 7fcda7789640 1 -- 172.21.15.80:0/3055713374 shutdown_connections 2024-04-26T18:37:09.816 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:09.812+0000 7fcda7789640 1 -- 172.21.15.80:0/3055713374 wait complete. 2024-04-26T18:37:11.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:10 smithi080 ceph-mon[29135]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 KiB/s wr, 30 op/s 2024-04-26T18:37:11.271 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:10 smithi082 ceph-mon[32808]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 KiB/s wr, 30 op/s 2024-04-26T18:37:11.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:10 smithi192 ceph-mon[32842]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 KiB/s wr, 30 op/s 2024-04-26T18:37:13.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:12 smithi080 ceph-mon[29135]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-04-26T18:37:13.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:12 smithi192 ceph-mon[32842]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-04-26T18:37:13.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:12 smithi082 ceph-mon[32808]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-04-26T18:37:15.245 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:14 smithi080 ceph-mon[29135]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 26 op/s 2024-04-26T18:37:15.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:14 smithi192 ceph-mon[32842]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 26 op/s 2024-04-26T18:37:15.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:14 smithi082 ceph-mon[32808]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 26 op/s 2024-04-26T18:37:17.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:16 smithi080 ceph-mon[29135]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-04-26T18:37:17.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:16 smithi192 ceph-mon[32842]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-04-26T18:37:17.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:16 smithi082 ceph-mon[32808]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-04-26T18:37:19.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:18 smithi080 ceph-mon[29135]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-26T18:37:19.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:18 smithi192 ceph-mon[32842]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-26T18:37:19.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:18 smithi082 ceph-mon[32808]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-26T18:37:21.244 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:20 smithi080 ceph-mon[29135]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-04-26T18:37:21.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:20 smithi192 ceph-mon[32842]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-04-26T18:37:21.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:20 smithi082 ceph-mon[32808]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-04-26T18:37:22.586 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-26T18:37:22.587 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-04-26T18:37:22.587 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:37:22.844 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:37:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.903+0000 7fded2cbd640 1 -- 172.21.15.80:0/2053416397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdecc107820 msgr2=0x7fdecc107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.903+0000 7fded2cbd640 1 --2- 172.21.15.80:0/2053416397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdecc107820 0x7fdecc107c00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fdec0009930 tx=0x7fdec002a420 comp rx=0 tx=0).stop 2024-04-26T18:37:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.903+0000 7fded2cbd640 1 -- 172.21.15.80:0/2053416397 shutdown_connections 2024-04-26T18:37:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.903+0000 7fded2cbd640 1 --2- 172.21.15.80:0/2053416397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdecc102220 0x7fdecc10e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.904+0000 7fded2cbd640 1 --2- 172.21.15.80:0/2053416397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdecc101860 0x7fdecc101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.904+0000 7fded2cbd640 1 --2- 172.21.15.80:0/2053416397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdecc107820 0x7fdecc107c00 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.904+0000 7fded2cbd640 1 -- 172.21.15.80:0/2053416397 >> 172.21.15.80:0/2053416397 conn(0x7fdecc0789b0 msgr2=0x7fdecc078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.904+0000 7fded2cbd640 1 -- 172.21.15.80:0/2053416397 shutdown_connections 2024-04-26T18:37:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.904+0000 7fded2cbd640 1 -- 172.21.15.80:0/2053416397 wait complete. 2024-04-26T18:37:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.904+0000 7fded2cbd640 1 Processor -- start 2024-04-26T18:37:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.904+0000 7fded2cbd640 1 -- start start 2024-04-26T18:37:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.904+0000 7fded2cbd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdecc101860 0x7fdecc1990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.904+0000 7fded2cbd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdecc102220 0x7fdecc1995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.904+0000 7fded2cbd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdecc107820 0x7fdecc19d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.904+0000 7fded2cbd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc111ae0 con 0x7fdecc102220 2024-04-26T18:37:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.904+0000 7fded2cbd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc111960 con 0x7fdecc101860 2024-04-26T18:37:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.904+0000 7fded2cbd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc111c60 con 0x7fdecc107820 2024-04-26T18:37:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.904+0000 7fdecbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdecc102220 0x7fdecc1995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.904+0000 7fdecbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdecc102220 0x7fdecc1995f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33698/0 (socket says 172.21.15.80:33698) 2024-04-26T18:37:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.904+0000 7fdecbfff640 1 -- 172.21.15.80:0/4271201728 learned_addr learned my addr 172.21.15.80:0/4271201728 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.904+0000 7fded0a59640 1 --2- 172.21.15.80:0/4271201728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdecc101860 0x7fdecc1990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.905+0000 7fded125a640 1 --2- 172.21.15.80:0/4271201728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdecc107820 0x7fdecc19d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.905+0000 7fdecbfff640 1 -- 172.21.15.80:0/4271201728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdecc107820 msgr2=0x7fdecc19d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.905+0000 7fdecbfff640 1 --2- 172.21.15.80:0/4271201728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdecc107820 0x7fdecc19d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.905+0000 7fdecbfff640 1 -- 172.21.15.80:0/4271201728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdecc101860 msgr2=0x7fdecc1990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.905+0000 7fdecbfff640 1 --2- 172.21.15.80:0/4271201728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdecc101860 0x7fdecc1990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.905+0000 7fdecbfff640 1 -- 172.21.15.80:0/4271201728 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdecc19e0a0 con 0x7fdecc102220 2024-04-26T18:37:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.905+0000 7fdecbfff640 1 --2- 172.21.15.80:0/4271201728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdecc102220 0x7fdecc1995f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800d770 tx=0x7fdeb800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.905+0000 7fdec9ffb640 1 -- 172.21.15.80:0/4271201728 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8017070 con 0x7fdecc102220 2024-04-26T18:37:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.905+0000 7fdec9ffb640 1 -- 172.21.15.80:0/4271201728 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdeb80054d0 con 0x7fdecc102220 2024-04-26T18:37:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.905+0000 7fded2cbd640 1 -- 172.21.15.80:0/4271201728 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdecc19e390 con 0x7fdecc102220 2024-04-26T18:37:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.905+0000 7fdec9ffb640 1 -- 172.21.15.80:0/4271201728 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8004c30 con 0x7fdecc102220 2024-04-26T18:37:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.905+0000 7fded2cbd640 1 -- 172.21.15.80:0/4271201728 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdecc1a5c20 con 0x7fdecc102220 2024-04-26T18:37:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.907+0000 7fdec9ffb640 1 -- 172.21.15.80:0/4271201728 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 138930+0+0 (secure 0 0 0) 0x7fdeb8004e10 con 0x7fdecc102220 2024-04-26T18:37:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.908+0000 7fdec9ffb640 1 --2- 172.21.15.80:0/4271201728 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fdebc0a3f70 0x7fdebc0a6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.908+0000 7fded59d3740 1 Processor -- start 2024-04-26T18:37:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.908+0000 7fded59d3740 1 -- start start 2024-04-26T18:37:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.908+0000 7fded0a59640 1 --2- 172.21.15.80:0/4271201728 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fdebc0a3f70 0x7fdebc0a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.908+0000 7fdec9ffb640 1 -- 172.21.15.80:0/4271201728 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fdeb80d04b0 con 0x7fdecc102220 2024-04-26T18:37:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.908+0000 7fded59d3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562efca13e00 0x562efca141e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.908+0000 7fded59d3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562efca14720 0x562efca22fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.908+0000 7fded59d3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca234f0 0x562efca258e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.908+0000 7fded59d3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562efc97a460 con 0x562efca234f0 2024-04-26T18:37:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.908+0000 7fded59d3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562efc934590 con 0x562efca14720 2024-04-26T18:37:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.908+0000 7fded59d3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562efc976420 con 0x562efca13e00 2024-04-26T18:37:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.908+0000 7fded125a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca234f0 0x562efca258e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.908+0000 7fded125a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca234f0 0x562efca258e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33708/0 (socket says 172.21.15.80:33708) 2024-04-26T18:37:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.908+0000 7fded125a640 1 -- 172.21.15.80:0/3894914704 learned_addr learned my addr 172.21.15.80:0/3894914704 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.908+0000 7fdecbfff640 1 --2- 172.21.15.80:0/3894914704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562efca14720 0x562efca22fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.908+0000 7fded0a59640 1 --2- 172.21.15.80:0/4271201728 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fdebc0a3f70 0x7fdebc0a6430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdec0009900 tx=0x7fdec0000bc0 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.908+0000 7fded0a59640 1 --2- 172.21.15.80:0/3894914704 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562efca13e00 0x562efca141e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.908+0000 7fded125a640 1 -- 172.21.15.80:0/3894914704 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562efca13e00 msgr2=0x562efca141e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.908+0000 7fded125a640 1 --2- 172.21.15.80:0/3894914704 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562efca13e00 0x562efca141e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.908+0000 7fded125a640 1 -- 172.21.15.80:0/3894914704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562efca14720 msgr2=0x562efca22fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.908+0000 7fded125a640 1 --2- 172.21.15.80:0/3894914704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562efca14720 0x562efca22fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.908+0000 7fded125a640 1 -- 172.21.15.80:0/3894914704 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562efc9410d0 con 0x562efca234f0 2024-04-26T18:37:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.909+0000 7fded125a640 1 --2- 172.21.15.80:0/3894914704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca234f0 0x562efca258e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009f70 tx=0x7fdec4010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c65ee8d5e8982bd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.909+0000 7fdeb6ffd640 1 -- 172.21.15.80:0/3894914704 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec4016070 con 0x562efca234f0 2024-04-26T18:37:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.909+0000 7fdeb6ffd640 1 -- 172.21.15.80:0/3894914704 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdec4004d20 con 0x562efca234f0 2024-04-26T18:37:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.909+0000 7fdeb6ffd640 1 -- 172.21.15.80:0/3894914704 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec4012770 con 0x562efca234f0 2024-04-26T18:37:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.909+0000 7fded59d3740 1 -- 172.21.15.80:0/3894914704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca234f0 msgr2=0x562efca258e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.909+0000 7fded59d3740 1 --2- 172.21.15.80:0/3894914704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca234f0 0x562efca258e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009f70 tx=0x7fdec4010800 comp rx=0 tx=0).stop 2024-04-26T18:37:22.918 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.909+0000 7fded59d3740 1 -- 172.21.15.80:0/3894914704 shutdown_connections 2024-04-26T18:37:22.918 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.909+0000 7fded59d3740 1 --2- 172.21.15.80:0/3894914704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca234f0 0x562efca258e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.918 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.909+0000 7fded59d3740 1 --2- 172.21.15.80:0/3894914704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562efca14720 0x562efca22fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.918 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.909+0000 7fded59d3740 1 --2- 172.21.15.80:0/3894914704 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562efca13e00 0x562efca141e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.918 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.909+0000 7fded59d3740 1 -- 172.21.15.80:0/3894914704 >> 172.21.15.80:0/3894914704 conn(0x562efca10410 msgr2=0x562efca107f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:22.918 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.909+0000 7fded59d3740 1 -- 172.21.15.80:0/3894914704 shutdown_connections 2024-04-26T18:37:22.918 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.909+0000 7fded59d3740 1 -- 172.21.15.80:0/3894914704 wait complete. 2024-04-26T18:37:22.918 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.910+0000 7fded59d3740 1 -- start start 2024-04-26T18:37:22.918 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.910+0000 7fded59d3740 1 Processor -- start 2024-04-26T18:37:22.918 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.910+0000 7fded59d3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca13e00 0x562efca20480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:22.918 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.910+0000 7fded59d3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562efca14720 0x562efca209c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:22.918 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.910+0000 7fded59d3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562efca234f0 0x562efca20f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:22.919 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.910+0000 7fded59d3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x562efca26120 con 0x562efca13e00 2024-04-26T18:37:22.919 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.910+0000 7fded59d3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562efc901b60 con 0x562efca234f0 2024-04-26T18:37:22.919 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.910+0000 7fded59d3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562efca262a0 con 0x562efca14720 2024-04-26T18:37:22.919 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.910+0000 7fded59d3740 10 client.0 _ll_register_callbacks cb 0x562efc9262b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:37:22.919 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.910+0000 7fded0a59640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca13e00 0x562efca20480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:22.919 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.910+0000 7fded0a59640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca13e00 0x562efca20480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33712/0 (socket says 172.21.15.80:33712) 2024-04-26T18:37:22.919 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.910+0000 7fded0a59640 1 -- 172.21.15.80:0/3802825479 learned_addr learned my addr 172.21.15.80:0/3802825479 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:22.919 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.910+0000 7fded125a640 1 --2- 172.21.15.80:0/3802825479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562efca234f0 0x562efca20f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:22.919 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.910+0000 7fdecbfff640 1 --2- 172.21.15.80:0/3802825479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562efca14720 0x562efca209c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:22.919 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.911+0000 7fded0a59640 1 -- 172.21.15.80:0/3802825479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562efca14720 msgr2=0x562efca209c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:22.919 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.911+0000 7fded0a59640 1 --2- 172.21.15.80:0/3802825479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562efca14720 0x562efca209c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.919 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.911+0000 7fded0a59640 1 -- 172.21.15.80:0/3802825479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562efca234f0 msgr2=0x562efca20f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:22.919 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.911+0000 7fded0a59640 1 --2- 172.21.15.80:0/3802825479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562efca234f0 0x562efca20f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.919 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.911+0000 7fded0a59640 1 -- 172.21.15.80:0/3802825479 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562efc68c210 con 0x562efca13e00 2024-04-26T18:37:22.919 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.911+0000 7fded0a59640 1 --2- 172.21.15.80:0/3802825479 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca13e00 0x562efca20480 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdec0033000 tx=0x7fdec0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511c12c44fb95419 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.911+0000 7fdeabfff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:37:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.911+0000 7fdeabfff640 1 -- 172.21.15.80:0/3802825479 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec0035040 con 0x562efca13e00 2024-04-26T18:37:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.911+0000 7fdeabfff640 1 -- 172.21.15.80:0/3802825479 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fdec00037f0 con 0x562efca13e00 2024-04-26T18:37:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.911+0000 7fded59d3740 1 -- 172.21.15.80:0/3802825479 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdec4004d20 con 0x562efca13e00 2024-04-26T18:37:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.911+0000 7fdeabfff640 1 -- 172.21.15.80:0/3802825479 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdec00044d0 con 0x562efca13e00 2024-04-26T18:37:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.911+0000 7fded59d3740 10 client.15501 fetch_fsmap learned FSMap version 27 2024-04-26T18:37:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.911+0000 7fded59d3740 1 -- 172.21.15.80:0/3802825479 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562efc758620 con 0x562efca13e00 2024-04-26T18:37:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.911+0000 7fdeabfff640 1 -- 172.21.15.80:0/3802825479 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdec4004d20 con 0x562efca13e00 2024-04-26T18:37:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.911+0000 7fdeabfff640 1 -- 172.21.15.80:0/3802825479 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fdec003ca80 con 0x562efca13e00 2024-04-26T18:37:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.911+0000 7fded59d3740 10 client.15501 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:37:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.911+0000 7fded59d3740 10 client.15501 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:37:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.911+0000 7fded59d3740 20 client.15501 populate_metadata read hostname 'smithi080' 2024-04-26T18:37:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.911+0000 7fded59d3740 1 --2- 172.21.15.80:0/3802825479 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x562efca336f0 0x562efca35ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.911+0000 7fded59d3740 4 client.15501 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:37:22.921 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.911+0000 7fded59d3740 1 -- 172.21.15.80:0/3802825479 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562efc988070 con 0x562efca336f0 2024-04-26T18:37:22.921 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.912+0000 7fdecbfff640 1 --2- 172.21.15.80:0/3802825479 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x562efca336f0 0x562efca35ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:22.921 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.912+0000 7fdeabfff640 10 client.15501 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:37:22.921 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.912+0000 7fdecbfff640 1 --2- 172.21.15.80:0/3802825479 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x562efca336f0 0x562efca35ae0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=771218ddadf68c8e server_cookie=d4db0191991f5362 in_seq=0 out_seq=0 2024-04-26T18:37:22.921 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.913+0000 7fdeabfff640 1 -- 172.21.15.80:0/3802825479 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562efc988070 con 0x562efca336f0 2024-04-26T18:37:22.921 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.913+0000 7fdeabfff640 10 client.15501 handle_command_reply: tid=0 2024-04-26T18:37:22.921 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.913+0000 7fded59d3740 1 client.15501 shutdown 2024-04-26T18:37:22.921 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.913+0000 7fded59d3740 1 -- 172.21.15.80:0/3802825479 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca13e00 msgr2=0x562efca20480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:22.921 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.913+0000 7fded59d3740 1 --2- 172.21.15.80:0/3802825479 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca13e00 0x562efca20480 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdec0033000 tx=0x7fdec0009260 comp rx=0 tx=0).stop 2024-04-26T18:37:22.921 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.913+0000 7fded59d3740 1 -- 172.21.15.80:0/3802825479 shutdown_connections 2024-04-26T18:37:22.921 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.913+0000 7fded59d3740 1 --2- 172.21.15.80:0/3802825479 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x562efca336f0 0x562efca35ae0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.921 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.913+0000 7fded59d3740 1 --2- 172.21.15.80:0/3802825479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562efca234f0 0x562efca20f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.921 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.913+0000 7fdeabfff640 0 client.15501 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:37:22.921 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.913+0000 7fded59d3740 1 --2- 172.21.15.80:0/3802825479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562efca14720 0x562efca209c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.922 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.913+0000 7fded59d3740 1 --2- 172.21.15.80:0/3802825479 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca13e00 0x562efca20480 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.922 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.913+0000 7fded59d3740 1 -- 172.21.15.80:0/3802825479 >> 172.21.15.80:0/3802825479 conn(0x562efca10410 msgr2=0x562efca16280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:22.922 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.913+0000 7fded59d3740 1 -- 172.21.15.80:0/3802825479 shutdown_connections 2024-04-26T18:37:22.922 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.913+0000 7fded59d3740 1 -- 172.21.15.80:0/3802825479 wait complete. 2024-04-26T18:37:22.922 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.913+0000 7fded59d3740 20 client.15501 trim_cache size 0 max 16384 2024-04-26T18:37:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.928+0000 7fded59d3740 1 Processor -- start 2024-04-26T18:37:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.928+0000 7fded59d3740 1 -- start start 2024-04-26T18:37:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.928+0000 7fded59d3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562efca13e00 0x562efca2efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.928+0000 7fded59d3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca14720 0x562efca16100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.928+0000 7fded59d3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562efca234f0 0x562efca3b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.928+0000 7fded59d3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc1ac1f0 con 0x562efca14720 2024-04-26T18:37:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.928+0000 7fded59d3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc1add30 con 0x562efca13e00 2024-04-26T18:37:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.928+0000 7fded59d3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc1ac8c0 con 0x562efca234f0 2024-04-26T18:37:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.928+0000 7fdecbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca14720 0x562efca16100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.928+0000 7fdecbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca14720 0x562efca16100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33726/0 (socket says 172.21.15.80:33726) 2024-04-26T18:37:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.928+0000 7fdecbfff640 1 -- 172.21.15.80:0/1669979132 learned_addr learned my addr 172.21.15.80:0/1669979132 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.928+0000 7fded0a59640 1 --2- 172.21.15.80:0/1669979132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562efca13e00 0x562efca2efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:22.937 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.928+0000 7fdecbfff640 1 -- 172.21.15.80:0/1669979132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562efca234f0 msgr2=0x562efca3b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:22.937 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.928+0000 7fdecbfff640 1 --2- 172.21.15.80:0/1669979132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562efca234f0 0x562efca3b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.937 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.928+0000 7fdecbfff640 1 -- 172.21.15.80:0/1669979132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562efca13e00 msgr2=0x562efca2efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:22.937 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.928+0000 7fdecbfff640 1 --2- 172.21.15.80:0/1669979132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562efca13e00 0x562efca2efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.937 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.928+0000 7fdecbfff640 1 -- 172.21.15.80:0/1669979132 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562efca1e9d0 con 0x562efca14720 2024-04-26T18:37:22.937 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.928+0000 7fdecbfff640 1 --2- 172.21.15.80:0/1669979132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca14720 0x562efca16100 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fdeb809c2a0 tx=0x7fdeb8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca7f231d97c498f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:22.937 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.928+0000 7fdeb67fc640 1 -- 172.21.15.80:0/1669979132 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb80b5070 con 0x562efca14720 2024-04-26T18:37:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.929+0000 7fdeb67fc640 1 -- 172.21.15.80:0/1669979132 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdeb809a610 con 0x562efca14720 2024-04-26T18:37:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.929+0000 7fdeb67fc640 1 -- 172.21.15.80:0/1669979132 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8020040 con 0x562efca14720 2024-04-26T18:37:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.929+0000 7fded59d3740 1 -- 172.21.15.80:0/1669979132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca14720 msgr2=0x562efca16100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.929+0000 7fded59d3740 1 --2- 172.21.15.80:0/1669979132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca14720 0x562efca16100 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fdeb809c2a0 tx=0x7fdeb8009f90 comp rx=0 tx=0).stop 2024-04-26T18:37:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.929+0000 7fded59d3740 1 -- 172.21.15.80:0/1669979132 shutdown_connections 2024-04-26T18:37:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.929+0000 7fded59d3740 1 --2- 172.21.15.80:0/1669979132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca14720 0x562efca16100 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.929+0000 7fded59d3740 1 --2- 172.21.15.80:0/1669979132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562efca234f0 0x562efca3b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.929+0000 7fded59d3740 1 --2- 172.21.15.80:0/1669979132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562efca13e00 0x562efca2efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.938 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.929+0000 7fded59d3740 1 -- 172.21.15.80:0/1669979132 >> 172.21.15.80:0/1669979132 conn(0x562efca10410 msgr2=0x562efca159f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:22.939 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.929+0000 7fded59d3740 1 -- 172.21.15.80:0/1669979132 shutdown_connections 2024-04-26T18:37:22.939 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.929+0000 7fded59d3740 1 -- 172.21.15.80:0/1669979132 wait complete. 2024-04-26T18:37:22.939 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.929+0000 7fded59d3740 1 -- start start 2024-04-26T18:37:22.939 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.929+0000 7fded59d3740 1 Processor -- start 2024-04-26T18:37:22.939 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.930+0000 7fded59d3740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca13e00 0x562efca2b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:22.939 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.930+0000 7fded59d3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562efca14720 0x562efca26d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.930+0000 7fded59d3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562efca234f0 0x562efca27320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.930+0000 7fded59d3740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc1ad660 con 0x562efca13e00 2024-04-26T18:37:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.930+0000 7fded59d3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc1acf90 con 0x562efca234f0 2024-04-26T18:37:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.930+0000 7fded59d3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc1aa1f0 con 0x562efca14720 2024-04-26T18:37:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.930+0000 7fded59d3740 10 client.0 _ll_register_callbacks cb 0x7fdec0031db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:37:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.930+0000 7fded0a59640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca13e00 0x562efca2b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:22.940 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.930+0000 7fded0a59640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca13e00 0x562efca2b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33734/0 (socket says 172.21.15.80:33734) 2024-04-26T18:37:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.930+0000 7fded0a59640 1 -- 172.21.15.80:0/678208229 learned_addr learned my addr 172.21.15.80:0/678208229 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.930+0000 7fdecbfff640 1 --2- 172.21.15.80:0/678208229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562efca14720 0x562efca26d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.930+0000 7fded125a640 1 --2- 172.21.15.80:0/678208229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562efca234f0 0x562efca27320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.930+0000 7fded0a59640 1 -- 172.21.15.80:0/678208229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562efca14720 msgr2=0x562efca26d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.930+0000 7fded0a59640 1 --2- 172.21.15.80:0/678208229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562efca14720 0x562efca26d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.941 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.930+0000 7fded0a59640 1 -- 172.21.15.80:0/678208229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562efca234f0 msgr2=0x562efca27320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.930+0000 7fded0a59640 1 --2- 172.21.15.80:0/678208229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562efca234f0 0x562efca27320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.930+0000 7fded0a59640 1 -- 172.21.15.80:0/678208229 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562efca27b50 con 0x562efca13e00 2024-04-26T18:37:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.930+0000 7fded0a59640 1 --2- 172.21.15.80:0/678208229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca13e00 0x562efca2b9a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fdec003ce20 tx=0x7fdec003cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28241a9e140f3825 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.930+0000 7fdeabfff640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:37:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.931+0000 7fdeabfff640 1 -- 172.21.15.80:0/678208229 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec006a060 con 0x562efca13e00 2024-04-26T18:37:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.931+0000 7fdeabfff640 1 -- 172.21.15.80:0/678208229 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fdec005c960 con 0x562efca13e00 2024-04-26T18:37:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.931+0000 7fded59d3740 1 -- 172.21.15.80:0/678208229 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdeb809a610 con 0x562efca13e00 2024-04-26T18:37:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.931+0000 7fdeabfff640 1 -- 172.21.15.80:0/678208229 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdec0061070 con 0x562efca13e00 2024-04-26T18:37:22.942 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.931+0000 7fded59d3740 10 client.15507 fetch_fsmap learned FSMap version 27 2024-04-26T18:37:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.931+0000 7fded59d3740 1 -- 172.21.15.80:0/678208229 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562efca99d70 con 0x562efca13e00 2024-04-26T18:37:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.931+0000 7fdeabfff640 1 -- 172.21.15.80:0/678208229 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdeb809a610 con 0x562efca13e00 2024-04-26T18:37:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.931+0000 7fdeabfff640 1 -- 172.21.15.80:0/678208229 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fdec0003aa0 con 0x562efca13e00 2024-04-26T18:37:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.931+0000 7fded59d3740 10 client.15507 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:37:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.931+0000 7fded59d3740 10 client.15507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:37:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.931+0000 7fded59d3740 20 client.15507 populate_metadata read hostname 'smithi080' 2024-04-26T18:37:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.931+0000 7fded59d3740 1 --2- 172.21.15.80:0/678208229 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x562efca9a460 0x562efca9c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.931+0000 7fded59d3740 4 client.15507 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:37:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.931+0000 7fded59d3740 1 -- 172.21.15.80:0/678208229 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562efca1c080 con 0x562efca9a460 2024-04-26T18:37:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.931+0000 7fdecbfff640 1 --2- 172.21.15.80:0/678208229 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x562efca9a460 0x562efca9c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.932+0000 7fdeabfff640 10 client.15507 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:37:22.943 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.932+0000 7fdecbfff640 1 --2- 172.21.15.80:0/678208229 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x562efca9a460 0x562efca9c880 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15499b4a51be5a86 server_cookie=4620a84d7b919d6f in_seq=0 out_seq=0 2024-04-26T18:37:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.935+0000 7fdeabfff640 1 -- 172.21.15.80:0/678208229 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562efca1c080 con 0x562efca9a460 2024-04-26T18:37:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.935+0000 7fdeabfff640 10 client.15507 handle_command_reply: tid=0 2024-04-26T18:37:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.935+0000 7fded59d3740 1 client.15507 shutdown 2024-04-26T18:37:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.935+0000 7fded59d3740 1 -- 172.21.15.80:0/678208229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca13e00 msgr2=0x562efca2b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.935+0000 7fded59d3740 1 --2- 172.21.15.80:0/678208229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca13e00 0x562efca2b9a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fdec003ce20 tx=0x7fdec003cb60 comp rx=0 tx=0).stop 2024-04-26T18:37:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.935+0000 7fded59d3740 1 -- 172.21.15.80:0/678208229 shutdown_connections 2024-04-26T18:37:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.935+0000 7fded59d3740 1 --2- 172.21.15.80:0/678208229 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x562efca9a460 0x562efca9c880 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.935+0000 7fded59d3740 1 --2- 172.21.15.80:0/678208229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562efca234f0 0x562efca27320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.935+0000 7fded59d3740 1 --2- 172.21.15.80:0/678208229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562efca14720 0x562efca26d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.935+0000 7fdeabfff640 0 client.15507 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:37:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.935+0000 7fded59d3740 1 --2- 172.21.15.80:0/678208229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562efca13e00 0x562efca2b9a0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.935+0000 7fded59d3740 1 -- 172.21.15.80:0/678208229 >> 172.21.15.80:0/678208229 conn(0x562efca10410 msgr2=0x562efca20cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.935+0000 7fded59d3740 1 -- 172.21.15.80:0/678208229 shutdown_connections 2024-04-26T18:37:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.935+0000 7fded59d3740 1 -- 172.21.15.80:0/678208229 wait complete. 2024-04-26T18:37:22.946 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.935+0000 7fded59d3740 20 client.15507 trim_cache size 0 max 16384 2024-04-26T18:37:22.946 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:{ 2024-04-26T18:37:22.946 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "message": "", 2024-04-26T18:37:22.946 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "return_code": 0 2024-04-26T18:37:22.946 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:} 2024-04-26T18:37:22.947 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.936+0000 7fded2cbd640 1 -- 172.21.15.80:0/4271201728 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fdebc0a3f70 msgr2=0x7fdebc0a6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:22.947 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.936+0000 7fded2cbd640 1 --2- 172.21.15.80:0/4271201728 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fdebc0a3f70 0x7fdebc0a6430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdec0009900 tx=0x7fdec0000bc0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.947 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.936+0000 7fded2cbd640 1 -- 172.21.15.80:0/4271201728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdecc102220 msgr2=0x7fdecc1995f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:22.947 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.936+0000 7fded2cbd640 1 --2- 172.21.15.80:0/4271201728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdecc102220 0x7fdecc1995f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800d770 tx=0x7fdeb800dc30 comp rx=0 tx=0).stop 2024-04-26T18:37:22.947 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.936+0000 7fded2cbd640 1 -- 172.21.15.80:0/4271201728 shutdown_connections 2024-04-26T18:37:22.947 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.936+0000 7fded2cbd640 1 --2- 172.21.15.80:0/4271201728 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fdebc0a3f70 0x7fdebc0a6430 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.947 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.936+0000 7fded2cbd640 1 --2- 172.21.15.80:0/4271201728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdecc102220 0x7fdecc1995f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.948 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.936+0000 7fded2cbd640 1 --2- 172.21.15.80:0/4271201728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdecc107820 0x7fdecc19d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.948 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.936+0000 7fded2cbd640 1 --2- 172.21.15.80:0/4271201728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdecc101860 0x7fdecc1990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:22.948 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.936+0000 7fded2cbd640 1 -- 172.21.15.80:0/4271201728 >> 172.21.15.80:0/4271201728 conn(0x7fdecc0789b0 msgr2=0x7fdecc06a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:22.948 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.936+0000 7fded2cbd640 1 -- 172.21.15.80:0/4271201728 shutdown_connections 2024-04-26T18:37:22.948 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:22.936+0000 7fded2cbd640 1 -- 172.21.15.80:0/4271201728 wait complete. 2024-04-26T18:37:23.234 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:22 smithi080 ceph-mon[29135]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-26T18:37:23.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:22 smithi192 ceph-mon[32842]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-26T18:37:23.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:22 smithi082 ceph-mon[32808]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-26T18:37:24.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.640+0000 7fa73dcf2700 1 -- 172.21.15.80:0/2385411600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa738103e30 msgr2=0x7fa738110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:24.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.640+0000 7fa73dcf2700 1 --2- 172.21.15.80:0/2385411600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa738103e30 0x7fa738110290 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa73000b0a0 tx=0x7fa73000b3b0 comp rx=0 tx=0).stop 2024-04-26T18:37:24.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.640+0000 7fa73dcf2700 1 -- 172.21.15.80:0/2385411600 shutdown_connections 2024-04-26T18:37:24.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.640+0000 7fa73dcf2700 1 --2- 172.21.15.80:0/2385411600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa738103e30 0x7fa738110290 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:24.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.640+0000 7fa73dcf2700 1 --2- 172.21.15.80:0/2385411600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7381094c0 0x7fa7381098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:24.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.640+0000 7fa73dcf2700 1 --2- 172.21.15.80:0/2385411600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa738103470 0x7fa7381038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:24.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.640+0000 7fa73dcf2700 1 -- 172.21.15.80:0/2385411600 >> 172.21.15.80:0/2385411600 conn(0x7fa73807a580 msgr2=0x7fa73807a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:24.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.640+0000 7fa73dcf2700 1 -- 172.21.15.80:0/2385411600 shutdown_connections 2024-04-26T18:37:24.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.640+0000 7fa73dcf2700 1 -- 172.21.15.80:0/2385411600 wait complete. 2024-04-26T18:37:24.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.641+0000 7fa73dcf2700 1 Processor -- start 2024-04-26T18:37:24.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.641+0000 7fa73dcf2700 1 -- start start 2024-04-26T18:37:24.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.641+0000 7fa73dcf2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa738103470 0x7fa738075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:24.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.641+0000 7fa73dcf2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa738103e30 0x7fa738075c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:24.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.641+0000 7fa73dcf2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7381094c0 0x7fa7380761a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:24.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.641+0000 7fa73dcf2700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa7381136c0 con 0x7fa738103470 2024-04-26T18:37:24.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.641+0000 7fa73dcf2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa738113540 con 0x7fa738103e30 2024-04-26T18:37:24.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.641+0000 7fa73dcf2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa738113840 con 0x7fa7381094c0 2024-04-26T18:37:24.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.641+0000 7fa7377fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa738103470 0x7fa738075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:24.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.642+0000 7fa7377fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa738103470 0x7fa738075720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55836/0 (socket says 172.21.15.80:55836) 2024-04-26T18:37:24.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.642+0000 7fa7377fe700 1 -- 172.21.15.80:0/1065333503 learned_addr learned my addr 172.21.15.80:0/1065333503 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:24.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.642+0000 7fa737fff700 1 --2- 172.21.15.80:0/1065333503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7381094c0 0x7fa7380761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:24.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.642+0000 7fa7377fe700 1 -- 172.21.15.80:0/1065333503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7381094c0 msgr2=0x7fa7380761a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:24.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.642+0000 7fa7377fe700 1 --2- 172.21.15.80:0/1065333503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7381094c0 0x7fa7380761a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:24.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.642+0000 7fa736ffd700 1 --2- 172.21.15.80:0/1065333503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa738103e30 0x7fa738075c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:24.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.642+0000 7fa7377fe700 1 -- 172.21.15.80:0/1065333503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa738103e30 msgr2=0x7fa738075c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:24.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.642+0000 7fa7377fe700 1 --2- 172.21.15.80:0/1065333503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa738103e30 0x7fa738075c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:24.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.642+0000 7fa7377fe700 1 -- 172.21.15.80:0/1065333503 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7381a8180 con 0x7fa738103470 2024-04-26T18:37:24.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.642+0000 7fa7377fe700 1 --2- 172.21.15.80:0/1065333503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa738103470 0x7fa738075720 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa72800b530 tx=0x7fa72800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:24.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.642+0000 7fa734ff9700 1 -- 172.21.15.80:0/1065333503 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa728015020 con 0x7fa738103470 2024-04-26T18:37:24.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.642+0000 7fa734ff9700 1 -- 172.21.15.80:0/1065333503 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa728011ce0 con 0x7fa738103470 2024-04-26T18:37:24.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.642+0000 7fa73dcf2700 1 -- 172.21.15.80:0/1065333503 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7381a8470 con 0x7fa738103470 2024-04-26T18:37:24.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.642+0000 7fa734ff9700 1 -- 172.21.15.80:0/1065333503 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa728010d20 con 0x7fa738103470 2024-04-26T18:37:24.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.642+0000 7fa73dcf2700 1 -- 172.21.15.80:0/1065333503 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7381a89b0 con 0x7fa738103470 2024-04-26T18:37:24.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.643+0000 7fa73dcf2700 1 -- 172.21.15.80:0/1065333503 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa73806a110 con 0x7fa738103470 2024-04-26T18:37:24.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.645+0000 7fa734ff9700 1 -- 172.21.15.80:0/1065333503 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 138930+0+0 (secure 0 0 0) 0x7fa728018020 con 0x7fa738103470 2024-04-26T18:37:24.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.645+0000 7fa734ff9700 1 --2- 172.21.15.80:0/1065333503 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fa7240a3f60 0x7fa7240a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:24.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.645+0000 7fa736ffd700 1 --2- 172.21.15.80:0/1065333503 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fa7240a3f60 0x7fa7240a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:24.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.645+0000 7fa734ff9700 1 -- 172.21.15.80:0/1065333503 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fa7280d0710 con 0x7fa738103470 2024-04-26T18:37:24.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.646+0000 7fa736ffd700 1 --2- 172.21.15.80:0/1065333503 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fa7240a3f60 0x7fa7240a6420 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa720006fd0 tx=0x7fa720008040 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:24.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.649+0000 7fa734ff9700 1 -- 172.21.15.80:0/1065333503 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa72801f020 con 0x7fa738103470 2024-04-26T18:37:24.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.897+0000 7fa73dcf2700 1 -- 172.21.15.80:0/1065333503 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa73802e490 con 0x7fa738103470 2024-04-26T18:37:24.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.898+0000 7fa734ff9700 1 -- 172.21.15.80:0/1065333503 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11918 (secure 0 0 0) 0x7fa72809ccd0 con 0x7fa738103470 2024-04-26T18:37:24.898 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:37:24.899 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1967550873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1967550873},{"type":"v1","addr":"172.21.15.80:6835","nonce":1967550873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/559541830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":559541830},{"type":"v1","addr":"172.21.15.80:6837","nonce":559541830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T18:33:08.347399+0000","modified":"2024-04-26T18:36:26.401600+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24434,"mds_1":24421,"mds_2":24404,"mds_3":24400,"mds_4":24394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14577":{"gid":14577,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6839/2137993298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":2137993298},{"type":"v1","addr":"172.21.15.80:6839","nonce":2137993298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6841/1544670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1544670},{"type":"v1","addr":"172.21.15.80:6841","nonce":1544670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24371":{"gid":24371,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/3564539039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3564539039},{"type":"v1","addr":"172.21.15.82:6833","nonce":3564539039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24379":{"gid":24379,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/572065563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":572065563},{"type":"v1","addr":"172.21.15.82:6835","nonce":572065563}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.192:6835/719058020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":719058020},{"type":"v1","addr":"172.21.15.192:6835","nonce":719058020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.192:6837/2361996920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2361996920},{"type":"v1","addr":"172.21.15.192:6837","nonce":2361996920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.82:6837/2084055551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2084055551},{"type":"v1","addr":"172.21.15.82:6837","nonce":2084055551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6839/2735406056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":2735406056},{"type":"v1","addr":"172.21.15.192:6839","nonce":2735406056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.82:6839/1482576497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1482576497},{"type":"v1","addr":"172.21.15.82:6839","nonce":1482576497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24434,"qdb_cluster":[24421,24400,24394,24404,24434]},"id":1}]} 2024-04-26T18:37:24.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.900+0000 7fa73dcf2700 1 -- 172.21.15.80:0/1065333503 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fa7240a3f60 msgr2=0x7fa7240a6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:24.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.900+0000 7fa73dcf2700 1 --2- 172.21.15.80:0/1065333503 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fa7240a3f60 0x7fa7240a6420 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa720006fd0 tx=0x7fa720008040 comp rx=0 tx=0).stop 2024-04-26T18:37:24.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.900+0000 7fa73dcf2700 1 -- 172.21.15.80:0/1065333503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa738103470 msgr2=0x7fa738075720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:24.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.900+0000 7fa73dcf2700 1 --2- 172.21.15.80:0/1065333503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa738103470 0x7fa738075720 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa72800b530 tx=0x7fa72800b8f0 comp rx=0 tx=0).stop 2024-04-26T18:37:24.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.900+0000 7fa73dcf2700 1 -- 172.21.15.80:0/1065333503 shutdown_connections 2024-04-26T18:37:24.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.900+0000 7fa73dcf2700 1 --2- 172.21.15.80:0/1065333503 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fa7240a3f60 0x7fa7240a6420 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:24.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.900+0000 7fa73dcf2700 1 --2- 172.21.15.80:0/1065333503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7381094c0 0x7fa7380761a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:24.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.900+0000 7fa73dcf2700 1 --2- 172.21.15.80:0/1065333503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa738103470 0x7fa738075720 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:24.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.900+0000 7fa73dcf2700 1 --2- 172.21.15.80:0/1065333503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa738103e30 0x7fa738075c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:24.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.900+0000 7fa73dcf2700 1 -- 172.21.15.80:0/1065333503 >> 172.21.15.80:0/1065333503 conn(0x7fa73807a580 msgr2=0x7fa7381021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:24.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.900+0000 7fa73dcf2700 1 -- 172.21.15.80:0/1065333503 shutdown_connections 2024-04-26T18:37:24.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:24.900+0000 7fa73dcf2700 1 -- 172.21.15.80:0/1065333503 wait complete. 2024-04-26T18:37:24.902 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 27 2024-04-26T18:37:25.217 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:24 smithi080 ceph-mon[29135]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-04-26T18:37:25.217 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:24 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1065333503' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:37:25.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:24 smithi192 ceph-mon[32842]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-04-26T18:37:25.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:24 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1065333503' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:37:25.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:24 smithi082 ceph-mon[32808]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-04-26T18:37:25.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:24 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1065333503' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:37:25.681 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24434 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-04-26T18:37:25.681 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24434 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-04-26T18:37:25.922 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:37:27.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:26 smithi192 ceph-mon[32842]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 938 B/s wr, 12 op/s 2024-04-26T18:37:27.398 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:26 smithi080 ceph-mon[29135]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 938 B/s wr, 12 op/s 2024-04-26T18:37:27.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:26 smithi082 ceph-mon[32808]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 938 B/s wr, 12 op/s 2024-04-26T18:37:27.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.820+0000 7f3e28148700 1 -- 172.21.15.80:0/3458269080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e20102e50 msgr2=0x7f3e2010f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:27.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.820+0000 7f3e28148700 1 --2- 172.21.15.80:0/3458269080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e20102e50 0x7f3e2010f270 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800b0a0 tx=0x7f3e1800b3b0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.820+0000 7f3e28148700 1 -- 172.21.15.80:0/3458269080 shutdown_connections 2024-04-26T18:37:27.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.820+0000 7f3e28148700 1 --2- 172.21.15.80:0/3458269080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e20102e50 0x7f3e2010f270 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.820+0000 7f3e28148700 1 --2- 172.21.15.80:0/3458269080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e20108430 0x7f3e20108810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.820+0000 7f3e28148700 1 --2- 172.21.15.80:0/3458269080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e201024b0 0x7f3e20102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.820+0000 7f3e28148700 1 -- 172.21.15.80:0/3458269080 >> 172.21.15.80:0/3458269080 conn(0x7f3e20078230 msgr2=0x7f3e20078640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:27.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.820+0000 7f3e28148700 1 -- 172.21.15.80:0/3458269080 shutdown_connections 2024-04-26T18:37:27.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.820+0000 7f3e28148700 1 -- 172.21.15.80:0/3458269080 wait complete. 2024-04-26T18:37:27.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.821+0000 7f3e28148700 1 Processor -- start 2024-04-26T18:37:27.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.821+0000 7f3e28148700 1 -- start start 2024-04-26T18:37:27.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.821+0000 7f3e28148700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e201024b0 0x7f3e201a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:27.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.821+0000 7f3e28148700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e20102e50 0x7f3e201a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:27.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.821+0000 7f3e28148700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e20108430 0x7f3e2019bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:27.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.821+0000 7f3e28148700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3e201125a0 con 0x7f3e20102e50 2024-04-26T18:37:27.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.821+0000 7f3e28148700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3e20112420 con 0x7f3e20108430 2024-04-26T18:37:27.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.821+0000 7f3e28148700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3e20112720 con 0x7f3e201024b0 2024-04-26T18:37:27.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.821+0000 7f3e256e3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e20102e50 0x7f3e201a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:27.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.821+0000 7f3e256e3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e20102e50 0x7f3e201a1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55854/0 (socket says 172.21.15.80:55854) 2024-04-26T18:37:27.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.821+0000 7f3e256e3700 1 -- 172.21.15.80:0/2354589786 learned_addr learned my addr 172.21.15.80:0/2354589786 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.821+0000 7f3e25ee4700 1 --2- 172.21.15.80:0/2354589786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e201024b0 0x7f3e201a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.821+0000 7f3e266e5700 1 --2- 172.21.15.80:0/2354589786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e20108430 0x7f3e2019bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.822+0000 7f3e256e3700 1 -- 172.21.15.80:0/2354589786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e201024b0 msgr2=0x7f3e201a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.822+0000 7f3e256e3700 1 --2- 172.21.15.80:0/2354589786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e201024b0 0x7f3e201a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.822+0000 7f3e256e3700 1 -- 172.21.15.80:0/2354589786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e20108430 msgr2=0x7f3e2019bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.822+0000 7f3e256e3700 1 --2- 172.21.15.80:0/2354589786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e20108430 0x7f3e2019bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.822+0000 7f3e256e3700 1 -- 172.21.15.80:0/2354589786 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e2019c220 con 0x7f3e20102e50 2024-04-26T18:37:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.822+0000 7f3e25ee4700 1 --2- 172.21.15.80:0/2354589786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e201024b0 0x7f3e201a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:37:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.822+0000 7f3e256e3700 1 --2- 172.21.15.80:0/2354589786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e20102e50 0x7f3e201a1e40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000c920 tx=0x7f3e1000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.822+0000 7f3e16ffd700 1 -- 172.21.15.80:0/2354589786 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e10007b00 con 0x7f3e20102e50 2024-04-26T18:37:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.822+0000 7f3e16ffd700 1 -- 172.21.15.80:0/2354589786 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e10004ce0 con 0x7f3e20102e50 2024-04-26T18:37:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.822+0000 7f3e28148700 1 -- 172.21.15.80:0/2354589786 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e2019c510 con 0x7f3e20102e50 2024-04-26T18:37:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.822+0000 7f3e16ffd700 1 -- 172.21.15.80:0/2354589786 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e10005650 con 0x7f3e20102e50 2024-04-26T18:37:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.822+0000 7f3e28148700 1 -- 172.21.15.80:0/2354589786 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e201a87d0 con 0x7f3e20102e50 2024-04-26T18:37:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.825+0000 7f3e16ffd700 1 -- 172.21.15.80:0/2354589786 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 138930+0+0 (secure 0 0 0) 0x7f3e10004750 con 0x7f3e20102e50 2024-04-26T18:37:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.825+0000 7f3e16ffd700 1 --2- 172.21.15.80:0/2354589786 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f3e0c0a4080 0x7f3e0c0a6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.825+0000 7f3e25ee4700 1 --2- 172.21.15.80:0/2354589786 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f3e0c0a4080 0x7f3e0c0a6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.826+0000 7f3e16ffd700 1 -- 172.21.15.80:0/2354589786 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f3e100d0680 con 0x7f3e20102e50 2024-04-26T18:37:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.826+0000 7f3e25ee4700 1 --2- 172.21.15.80:0/2354589786 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f3e0c0a4080 0x7f3e0c0a6540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3e2019cc00 tx=0x7f3e1c008040 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.826+0000 7f3e329dab80 1 Processor -- start 2024-04-26T18:37:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.826+0000 7f3e329dab80 1 -- start start 2024-04-26T18:37:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.826+0000 7f3e329dab80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c939230 0x561d3c939610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.826+0000 7f3e329dab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d3c939b50 0x561d3c9444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.826+0000 7f3e329dab80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561d3c944a00 0x561d3c946df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.827+0000 7f3e329dab80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x561d3c88c8d0 con 0x561d3c939230 2024-04-26T18:37:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.827+0000 7f3e329dab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561d3c82b770 con 0x561d3c939b50 2024-04-26T18:37:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.827+0000 7f3e329dab80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561d3c888890 con 0x561d3c944a00 2024-04-26T18:37:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.827+0000 7f3e25ee4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c939230 0x561d3c939610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.827+0000 7f3e25ee4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c939230 0x561d3c939610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55868/0 (socket says 172.21.15.80:55868) 2024-04-26T18:37:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.827+0000 7f3e25ee4700 1 -- 172.21.15.80:0/1229943564 learned_addr learned my addr 172.21.15.80:0/1229943564 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.827+0000 7f3e256e3700 1 --2- 172.21.15.80:0/1229943564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d3c939b50 0x561d3c9444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.827+0000 7f3e266e5700 1 --2- 172.21.15.80:0/1229943564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561d3c944a00 0x561d3c946df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.827+0000 7f3e25ee4700 1 -- 172.21.15.80:0/1229943564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561d3c944a00 msgr2=0x561d3c946df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.827+0000 7f3e25ee4700 1 --2- 172.21.15.80:0/1229943564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561d3c944a00 0x561d3c946df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.827+0000 7f3e25ee4700 1 -- 172.21.15.80:0/1229943564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d3c939b50 msgr2=0x561d3c9444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.827+0000 7f3e25ee4700 1 --2- 172.21.15.80:0/1229943564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d3c939b50 0x561d3c9444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.827+0000 7f3e25ee4700 1 -- 172.21.15.80:0/1229943564 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d3c7d9a60 con 0x561d3c939230 2024-04-26T18:37:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.827+0000 7f3e266e5700 1 --2- 172.21.15.80:0/1229943564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561d3c944a00 0x561d3c946df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:37:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.827+0000 7f3e256e3700 1 --2- 172.21.15.80:0/1229943564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d3c939b50 0x561d3c9444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:37:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.827+0000 7f3e25ee4700 1 --2- 172.21.15.80:0/1229943564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c939230 0x561d3c939610 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00d7a0 tx=0x7f3e1c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b04c6a881451f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.827+0000 7f3e0bfff700 1 -- 172.21.15.80:0/1229943564 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c024070 con 0x561d3c939230 2024-04-26T18:37:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.827+0000 7f3e0bfff700 1 -- 172.21.15.80:0/1229943564 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e1c014af0 con 0x561d3c939230 2024-04-26T18:37:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.827+0000 7f3e0bfff700 1 -- 172.21.15.80:0/1229943564 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c01fbd0 con 0x561d3c939230 2024-04-26T18:37:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.828+0000 7f3e329dab80 1 -- 172.21.15.80:0/1229943564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c939230 msgr2=0x561d3c939610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.828+0000 7f3e329dab80 1 --2- 172.21.15.80:0/1229943564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c939230 0x561d3c939610 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00d7a0 tx=0x7f3e1c010000 comp rx=0 tx=0).stop 2024-04-26T18:37:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.828+0000 7f3e329dab80 1 -- 172.21.15.80:0/1229943564 shutdown_connections 2024-04-26T18:37:27.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.828+0000 7f3e329dab80 1 --2- 172.21.15.80:0/1229943564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561d3c944a00 0x561d3c946df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.828+0000 7f3e329dab80 1 --2- 172.21.15.80:0/1229943564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c939230 0x561d3c939610 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.828+0000 7f3e329dab80 1 --2- 172.21.15.80:0/1229943564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d3c939b50 0x561d3c9444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.828+0000 7f3e329dab80 1 -- 172.21.15.80:0/1229943564 >> 172.21.15.80:0/1229943564 conn(0x561d3c866ed0 msgr2=0x561d3c935720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:27.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.828+0000 7f3e329dab80 1 -- 172.21.15.80:0/1229943564 shutdown_connections 2024-04-26T18:37:27.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.828+0000 7f3e329dab80 1 -- 172.21.15.80:0/1229943564 wait complete. 2024-04-26T18:37:27.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.829+0000 7f3e329dab80 1 -- start start 2024-04-26T18:37:27.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.829+0000 7f3e329dab80 1 Processor -- start 2024-04-26T18:37:27.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.829+0000 7f3e329dab80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c939230 0x561d3c9441c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:27.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.829+0000 7f3e329dab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d3c939b50 0x561d3c9414c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:27.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.829+0000 7f3e329dab80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561d3c944a00 0x561d3c941a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:27.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.829+0000 7f3e329dab80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x561d3c9475d0 con 0x561d3c939230 2024-04-26T18:37:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.829+0000 7f3e329dab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561d3c7f2ae0 con 0x561d3c939b50 2024-04-26T18:37:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.829+0000 7f3e329dab80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561d3c947750 con 0x561d3c944a00 2024-04-26T18:37:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.829+0000 7f3e329dab80 10 client.0 _ll_register_callbacks cb 0x561d3c820710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:37:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.829+0000 7f3e25ee4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c939230 0x561d3c9441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.829+0000 7f3e25ee4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c939230 0x561d3c9441c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55870/0 (socket says 172.21.15.80:55870) 2024-04-26T18:37:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.829+0000 7f3e25ee4700 1 -- 172.21.15.80:0/863018388 learned_addr learned my addr 172.21.15.80:0/863018388 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.829+0000 7f3e256e3700 1 --2- 172.21.15.80:0/863018388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d3c939b50 0x561d3c9414c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.829+0000 7f3e266e5700 1 --2- 172.21.15.80:0/863018388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561d3c944a00 0x561d3c941a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.829+0000 7f3e25ee4700 1 -- 172.21.15.80:0/863018388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561d3c944a00 msgr2=0x561d3c941a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:27.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.829+0000 7f3e25ee4700 1 --2- 172.21.15.80:0/863018388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561d3c944a00 0x561d3c941a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.829+0000 7f3e25ee4700 1 -- 172.21.15.80:0/863018388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d3c939b50 msgr2=0x561d3c9414c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:27.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.829+0000 7f3e25ee4700 1 --2- 172.21.15.80:0/863018388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d3c939b50 0x561d3c9414c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.829+0000 7f3e25ee4700 1 -- 172.21.15.80:0/863018388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d3c942100 con 0x561d3c939230 2024-04-26T18:37:27.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.829+0000 7f3e256e3700 1 --2- 172.21.15.80:0/863018388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d3c939b50 0x561d3c9414c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:37:27.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.830+0000 7f3e25ee4700 1 --2- 172.21.15.80:0/863018388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c939230 0x561d3c9441c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c022040 tx=0x7f3e1c0146f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4dd9a6a2e22382 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:27.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.830+0000 7f3e097fa700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:37:27.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.830+0000 7f3e097fa700 1 -- 172.21.15.80:0/863018388 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c024040 con 0x561d3c939230 2024-04-26T18:37:27.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.830+0000 7f3e097fa700 1 -- 172.21.15.80:0/863018388 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f3e1c01f850 con 0x561d3c939230 2024-04-26T18:37:27.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.830+0000 7f3e329dab80 1 -- 172.21.15.80:0/863018388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e1c014af0 con 0x561d3c939230 2024-04-26T18:37:27.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.830+0000 7f3e097fa700 1 -- 172.21.15.80:0/863018388 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3e1c014910 con 0x561d3c939230 2024-04-26T18:37:27.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.830+0000 7f3e329dab80 10 client.15525 fetch_fsmap learned FSMap version 27 2024-04-26T18:37:27.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.830+0000 7f3e329dab80 1 -- 172.21.15.80:0/863018388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561d3c952010 con 0x561d3c939230 2024-04-26T18:37:27.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.830+0000 7f3e097fa700 1 -- 172.21.15.80:0/863018388 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e1c014af0 con 0x561d3c939230 2024-04-26T18:37:27.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.830+0000 7f3e097fa700 1 -- 172.21.15.80:0/863018388 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3e1c013070 con 0x561d3c939230 2024-04-26T18:37:27.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.830+0000 7f3e329dab80 10 client.15525 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:37:27.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.830+0000 7f3e329dab80 10 client.15525 resolve_mds: validated gid 24434 aka daemon mds.b 2024-04-26T18:37:27.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.830+0000 7f3e329dab80 20 client.15525 populate_metadata read hostname 'smithi080' 2024-04-26T18:37:27.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.830+0000 7f3e329dab80 1 --2- 172.21.15.80:0/863018388 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x561d3c954590 0x561d3c956980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:27.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.830+0000 7f3e329dab80 4 client.15525 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:37:27.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.830+0000 7f3e329dab80 1 -- 172.21.15.80:0/863018388 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d3c89a2b0 con 0x561d3c954590 2024-04-26T18:37:27.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.831+0000 7f3e256e3700 1 --2- 172.21.15.80:0/863018388 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x561d3c954590 0x561d3c956980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:27.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.831+0000 7f3e097fa700 10 client.15525 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:37:27.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.831+0000 7f3e256e3700 1 --2- 172.21.15.80:0/863018388 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x561d3c954590 0x561d3c956980 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd0abea4a4ad6064 server_cookie=b895b4fd76e6d44e in_seq=0 out_seq=0 2024-04-26T18:37:27.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.832+0000 7f3e097fa700 1 -- 172.21.15.80:0/863018388 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561d3c89a2b0 con 0x561d3c954590 2024-04-26T18:37:27.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.832+0000 7f3e097fa700 10 client.15525 handle_command_reply: tid=0 2024-04-26T18:37:27.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.832+0000 7f3e329dab80 1 client.15525 shutdown 2024-04-26T18:37:27.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.832+0000 7f3e329dab80 1 -- 172.21.15.80:0/863018388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c939230 msgr2=0x561d3c9441c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:27.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.832+0000 7f3e329dab80 1 --2- 172.21.15.80:0/863018388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c939230 0x561d3c9441c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c022040 tx=0x7f3e1c0146f0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.832+0000 7f3e329dab80 1 -- 172.21.15.80:0/863018388 shutdown_connections 2024-04-26T18:37:27.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.832+0000 7f3e329dab80 1 --2- 172.21.15.80:0/863018388 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x561d3c954590 0x561d3c956980 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.832+0000 7f3e329dab80 1 --2- 172.21.15.80:0/863018388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561d3c944a00 0x561d3c941a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.832+0000 7f3e329dab80 1 --2- 172.21.15.80:0/863018388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c939230 0x561d3c9441c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.832+0000 7f3e097fa700 0 client.15525 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:37:27.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.832+0000 7f3e329dab80 1 --2- 172.21.15.80:0/863018388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d3c939b50 0x561d3c9414c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.832+0000 7f3e329dab80 1 -- 172.21.15.80:0/863018388 >> 172.21.15.80:0/863018388 conn(0x561d3c866ed0 msgr2=0x561d3c935350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:27.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.832+0000 7f3e329dab80 1 -- 172.21.15.80:0/863018388 shutdown_connections 2024-04-26T18:37:27.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.832+0000 7f3e329dab80 1 -- 172.21.15.80:0/863018388 wait complete. 2024-04-26T18:37:27.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.833+0000 7f3e329dab80 20 client.15525 trim_cache size 0 max 16384 2024-04-26T18:37:27.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.852+0000 7f3e329dab80 1 Processor -- start 2024-04-26T18:37:27.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.852+0000 7f3e329dab80 1 -- start start 2024-04-26T18:37:27.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.852+0000 7f3e329dab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d3c939230 0x561d3c9504d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:27.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.852+0000 7f3e329dab80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561d3c939b50 0x561d3c95c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:27.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.852+0000 7f3e329dab80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c944a00 0x561d3c95c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:27.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.852+0000 7f3e329dab80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3e201afdb0 con 0x561d3c944a00 2024-04-26T18:37:27.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.852+0000 7f3e329dab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3e201b18f0 con 0x561d3c939230 2024-04-26T18:37:27.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.852+0000 7f3e329dab80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3e201b0480 con 0x561d3c939b50 2024-04-26T18:37:27.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.852+0000 7f3e266e5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c944a00 0x561d3c95c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:27.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.852+0000 7f3e266e5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c944a00 0x561d3c95c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55884/0 (socket says 172.21.15.80:55884) 2024-04-26T18:37:27.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.852+0000 7f3e266e5700 1 -- 172.21.15.80:0/1746590661 learned_addr learned my addr 172.21.15.80:0/1746590661 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:27.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.852+0000 7f3e25ee4700 1 --2- 172.21.15.80:0/1746590661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d3c939230 0x561d3c9504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:27.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.852+0000 7f3e256e3700 1 --2- 172.21.15.80:0/1746590661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561d3c939b50 0x561d3c95c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:27.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.852+0000 7f3e266e5700 1 -- 172.21.15.80:0/1746590661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561d3c939b50 msgr2=0x561d3c95c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:27.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.852+0000 7f3e266e5700 1 --2- 172.21.15.80:0/1746590661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561d3c939b50 0x561d3c95c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.852+0000 7f3e266e5700 1 -- 172.21.15.80:0/1746590661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d3c939230 msgr2=0x561d3c9504d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:27.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.852+0000 7f3e266e5700 1 --2- 172.21.15.80:0/1746590661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d3c939230 0x561d3c9504d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.852+0000 7f3e266e5700 1 -- 172.21.15.80:0/1746590661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d3c93fa90 con 0x561d3c944a00 2024-04-26T18:37:27.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.852+0000 7f3e256e3700 1 --2- 172.21.15.80:0/1746590661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561d3c939b50 0x561d3c95c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:37:27.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.853+0000 7f3e266e5700 1 --2- 172.21.15.80:0/1746590661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c944a00 0x561d3c95c580 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800b0a0 tx=0x7f3e18009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28fb22725b6389f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:27.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.853+0000 7f3e0b7fe700 1 -- 172.21.15.80:0/1746590661 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e18009bf0 con 0x561d3c944a00 2024-04-26T18:37:27.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.853+0000 7f3e0b7fe700 1 -- 172.21.15.80:0/1746590661 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e180074e0 con 0x561d3c944a00 2024-04-26T18:37:27.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.853+0000 7f3e0b7fe700 1 -- 172.21.15.80:0/1746590661 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e18005280 con 0x561d3c944a00 2024-04-26T18:37:27.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.853+0000 7f3e329dab80 1 -- 172.21.15.80:0/1746590661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c944a00 msgr2=0x561d3c95c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:27.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.853+0000 7f3e329dab80 1 --2- 172.21.15.80:0/1746590661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c944a00 0x561d3c95c580 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800b0a0 tx=0x7f3e18009260 comp rx=0 tx=0).stop 2024-04-26T18:37:27.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.854+0000 7f3e329dab80 1 -- 172.21.15.80:0/1746590661 shutdown_connections 2024-04-26T18:37:27.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.854+0000 7f3e329dab80 1 --2- 172.21.15.80:0/1746590661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c944a00 0x561d3c95c580 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.854+0000 7f3e329dab80 1 --2- 172.21.15.80:0/1746590661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d3c939230 0x561d3c9504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.854+0000 7f3e329dab80 1 --2- 172.21.15.80:0/1746590661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561d3c939b50 0x561d3c95c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.854+0000 7f3e329dab80 1 -- 172.21.15.80:0/1746590661 >> 172.21.15.80:0/1746590661 conn(0x561d3c866ed0 msgr2=0x561d3c93cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:27.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.854+0000 7f3e329dab80 1 -- 172.21.15.80:0/1746590661 shutdown_connections 2024-04-26T18:37:27.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.854+0000 7f3e329dab80 1 -- 172.21.15.80:0/1746590661 wait complete. 2024-04-26T18:37:27.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.854+0000 7f3e329dab80 1 -- start start 2024-04-26T18:37:27.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.854+0000 7f3e329dab80 1 Processor -- start 2024-04-26T18:37:27.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.854+0000 7f3e329dab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d3c939230 0x561d3c94c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:27.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.854+0000 7f3e329dab80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c939b50 0x561d3c94cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:27.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.854+0000 7f3e329dab80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561d3c944a00 0x561d3c9499b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:27.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.855+0000 7f3e329dab80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3e201b1220 con 0x561d3c939b50 2024-04-26T18:37:27.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.855+0000 7f3e329dab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3e201b0b50 con 0x561d3c939230 2024-04-26T18:37:27.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.855+0000 7f3e329dab80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3e201add50 con 0x561d3c944a00 2024-04-26T18:37:27.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.855+0000 7f3e329dab80 10 client.0 _ll_register_callbacks cb 0x561d3c820710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:37:27.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.855+0000 7f3e256e3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c939b50 0x561d3c94cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:27.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.855+0000 7f3e256e3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c939b50 0x561d3c94cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55900/0 (socket says 172.21.15.80:55900) 2024-04-26T18:37:27.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.855+0000 7f3e256e3700 1 -- 172.21.15.80:0/3466272955 learned_addr learned my addr 172.21.15.80:0/3466272955 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:27.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.855+0000 7f3e25ee4700 1 --2- 172.21.15.80:0/3466272955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d3c939230 0x561d3c94c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:27.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.855+0000 7f3e266e5700 1 --2- 172.21.15.80:0/3466272955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561d3c944a00 0x561d3c9499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:27.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.855+0000 7f3e256e3700 1 -- 172.21.15.80:0/3466272955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561d3c944a00 msgr2=0x561d3c9499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:27.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.855+0000 7f3e256e3700 1 --2- 172.21.15.80:0/3466272955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561d3c944a00 0x561d3c9499b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.855+0000 7f3e256e3700 1 -- 172.21.15.80:0/3466272955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d3c939230 msgr2=0x561d3c94c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:27.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.855+0000 7f3e256e3700 1 --2- 172.21.15.80:0/3466272955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d3c939230 0x561d3c94c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.855+0000 7f3e256e3700 1 -- 172.21.15.80:0/3466272955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d3c94a1d0 con 0x561d3c939b50 2024-04-26T18:37:27.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.855+0000 7f3e266e5700 1 --2- 172.21.15.80:0/3466272955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561d3c944a00 0x561d3c9499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:37:27.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.855+0000 7f3e256e3700 1 --2- 172.21.15.80:0/3466272955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c939b50 0x561d3c94cf20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3e1009c3c0 tx=0x7f3e1009c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a743ecca1bf783c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:27.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.855+0000 7f3e097fa700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:37:27.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.855+0000 7f3e097fa700 1 -- 172.21.15.80:0/3466272955 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1001d040 con 0x561d3c939b50 2024-04-26T18:37:27.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.855+0000 7f3e097fa700 1 -- 172.21.15.80:0/3466272955 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f3e10007d30 con 0x561d3c939b50 2024-04-26T18:37:27.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.855+0000 7f3e329dab80 1 -- 172.21.15.80:0/3466272955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e180074e0 con 0x561d3c939b50 2024-04-26T18:37:27.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.855+0000 7f3e097fa700 1 -- 172.21.15.80:0/3466272955 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3e10004a40 con 0x561d3c939b50 2024-04-26T18:37:27.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.855+0000 7f3e329dab80 10 client.15531 fetch_fsmap learned FSMap version 27 2024-04-26T18:37:27.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.855+0000 7f3e329dab80 1 -- 172.21.15.80:0/3466272955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561d3c9bb390 con 0x561d3c939b50 2024-04-26T18:37:27.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.856+0000 7f3e097fa700 1 -- 172.21.15.80:0/3466272955 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e180074e0 con 0x561d3c939b50 2024-04-26T18:37:27.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.856+0000 7f3e097fa700 1 -- 172.21.15.80:0/3466272955 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3e100bb1b0 con 0x561d3c939b50 2024-04-26T18:37:27.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.856+0000 7f3e329dab80 10 client.15531 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:37:27.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.856+0000 7f3e329dab80 10 client.15531 resolve_mds: validated gid 24434 aka daemon mds.b 2024-04-26T18:37:27.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.856+0000 7f3e329dab80 20 client.15531 populate_metadata read hostname 'smithi080' 2024-04-26T18:37:27.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.856+0000 7f3e329dab80 1 --2- 172.21.15.80:0/3466272955 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x561d3c9bbb40 0x561d3c9bdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:27.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.856+0000 7f3e329dab80 4 client.15531 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-04-26T18:37:27.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.856+0000 7f3e329dab80 1 -- 172.21.15.80:0/3466272955 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x561d3c894350 con 0x561d3c9bbb40 2024-04-26T18:37:27.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.856+0000 7f3e25ee4700 1 --2- 172.21.15.80:0/3466272955 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x561d3c9bbb40 0x561d3c9bdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:27.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.856+0000 7f3e097fa700 10 client.15531 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:37:27.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.856+0000 7f3e25ee4700 1 --2- 172.21.15.80:0/3466272955 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x561d3c9bbb40 0x561d3c9bdf30 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a267124bb03002c server_cookie=cc0f174c354c01c5 in_seq=0 out_seq=0 2024-04-26T18:37:27.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.868+0000 7f3e097fa700 1 -- 172.21.15.80:0/3466272955 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x561d3c894350 con 0x561d3c9bbb40 2024-04-26T18:37:27.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.868+0000 7f3e097fa700 10 client.15531 handle_command_reply: tid=0 2024-04-26T18:37:27.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.869+0000 7f3e329dab80 1 client.15531 shutdown 2024-04-26T18:37:27.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.869+0000 7f3e329dab80 1 -- 172.21.15.80:0/3466272955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c939b50 msgr2=0x561d3c94cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:27.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.869+0000 7f3e329dab80 1 --2- 172.21.15.80:0/3466272955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c939b50 0x561d3c94cf20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3e1009c3c0 tx=0x7f3e1009c430 comp rx=0 tx=0).stop 2024-04-26T18:37:27.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.869+0000 7f3e329dab80 1 -- 172.21.15.80:0/3466272955 shutdown_connections 2024-04-26T18:37:27.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.869+0000 7f3e329dab80 1 --2- 172.21.15.80:0/3466272955 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x561d3c9bbb40 0x561d3c9bdf30 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.869+0000 7f3e329dab80 1 --2- 172.21.15.80:0/3466272955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561d3c944a00 0x561d3c9499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.869+0000 7f3e329dab80 1 --2- 172.21.15.80:0/3466272955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d3c939230 0x561d3c94c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.869+0000 7f3e097fa700 0 client.15531 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:37:27.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.869+0000 7f3e329dab80 1 --2- 172.21.15.80:0/3466272955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561d3c939b50 0x561d3c94cf20 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.869+0000 7f3e329dab80 1 -- 172.21.15.80:0/3466272955 >> 172.21.15.80:0/3466272955 conn(0x561d3c866ed0 msgr2=0x561d3c93c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:27.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.869+0000 7f3e329dab80 1 -- 172.21.15.80:0/3466272955 shutdown_connections 2024-04-26T18:37:27.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.869+0000 7f3e329dab80 1 -- 172.21.15.80:0/3466272955 wait complete. 2024-04-26T18:37:27.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.869+0000 7f3e329dab80 20 client.15531 trim_cache size 0 max 16384 2024-04-26T18:37:27.871 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:37:27.871 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 27, 2024-04-26T18:37:27.871 INFO:teuthology.orchestra.run.smithi080.stdout: "leader": 24434, 2024-04-26T18:37:27.871 INFO:teuthology.orchestra.run.smithi080.stdout: "set_version": 2, 2024-04-26T18:37:27.871 INFO:teuthology.orchestra.run.smithi080.stdout: "sets": { 2024-04-26T18:37:27.871 INFO:teuthology.orchestra.run.smithi080.stdout: "577c7138": { 2024-04-26T18:37:27.871 INFO:teuthology.orchestra.run.smithi080.stdout: "version": 2, 2024-04-26T18:37:27.871 INFO:teuthology.orchestra.run.smithi080.stdout: "age_ref": 0.0, 2024-04-26T18:37:27.871 INFO:teuthology.orchestra.run.smithi080.stdout: "state": { 2024-04-26T18:37:27.871 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "QUIESCED", 2024-04-26T18:37:27.871 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0 2024-04-26T18:37:27.872 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:37:27.872 INFO:teuthology.orchestra.run.smithi080.stdout: "timeout": 60.0, 2024-04-26T18:37:27.872 INFO:teuthology.orchestra.run.smithi080.stdout: "expiration": 90.0, 2024-04-26T18:37:27.872 INFO:teuthology.orchestra.run.smithi080.stdout: "members": { 2024-04-26T18:37:27.872 INFO:teuthology.orchestra.run.smithi080.stdout: "file:/": { 2024-04-26T18:37:27.872 INFO:teuthology.orchestra.run.smithi080.stdout: "excluded": false, 2024-04-26T18:37:27.872 INFO:teuthology.orchestra.run.smithi080.stdout: "state": { 2024-04-26T18:37:27.872 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "QUIESCED", 2024-04-26T18:37:27.872 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0 2024-04-26T18:37:27.872 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:37:27.872 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:37:27.872 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:37:27.872 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:37:27.872 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:37:27.872 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:37:27.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.869+0000 7f3e28148700 1 -- 172.21.15.80:0/2354589786 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f3e0c0a4080 msgr2=0x7f3e0c0a6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:27.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.869+0000 7f3e28148700 1 --2- 172.21.15.80:0/2354589786 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f3e0c0a4080 0x7f3e0c0a6540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3e2019cc00 tx=0x7f3e1c008040 comp rx=0 tx=0).stop 2024-04-26T18:37:27.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.869+0000 7f3e28148700 1 -- 172.21.15.80:0/2354589786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e20102e50 msgr2=0x7f3e201a1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:27.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.869+0000 7f3e28148700 1 --2- 172.21.15.80:0/2354589786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e20102e50 0x7f3e201a1e40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000c920 tx=0x7f3e1000cce0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.870+0000 7f3e28148700 1 -- 172.21.15.80:0/2354589786 shutdown_connections 2024-04-26T18:37:27.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.870+0000 7f3e28148700 1 --2- 172.21.15.80:0/2354589786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e20108430 0x7f3e2019bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.870+0000 7f3e28148700 1 --2- 172.21.15.80:0/2354589786 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f3e0c0a4080 0x7f3e0c0a6540 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.870+0000 7f3e28148700 1 --2- 172.21.15.80:0/2354589786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e201024b0 0x7f3e201a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.870+0000 7f3e28148700 1 --2- 172.21.15.80:0/2354589786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e20102e50 0x7f3e201a1e40 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:27.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.870+0000 7f3e28148700 1 -- 172.21.15.80:0/2354589786 >> 172.21.15.80:0/2354589786 conn(0x7f3e20078230 msgr2=0x7f3e20101480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:27.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.870+0000 7f3e28148700 1 -- 172.21.15.80:0/2354589786 shutdown_connections 2024-04-26T18:37:27.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:37:27.870+0000 7f3e28148700 1 -- 172.21.15.80:0/2354589786 wait complete. 2024-04-26T18:37:28.574 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '577c7138', quiesce took 6.0 seconds. Will release after: 30.0 2024-04-26T18:37:29.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:28 smithi192 ceph-mon[32842]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T18:37:29.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:28 smithi082 ceph-mon[32808]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T18:37:29.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:28 smithi080 ceph-mon[29135]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T18:37:31.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:31 smithi192 ceph-mon[32842]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-04-26T18:37:31.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:31 smithi082 ceph-mon[32808]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-04-26T18:37:31.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:31 smithi080 ceph-mon[29135]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-04-26T18:37:33.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:33 smithi192 ceph-mon[32842]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-26T18:37:33.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:33 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:37:33.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:33 smithi082 ceph-mon[32808]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-26T18:37:33.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:33 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:37:33.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:33 smithi080 ceph-mon[29135]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-26T18:37:33.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:33 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:37:34.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:34 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:37:34.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:34 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:37:34.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:34 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:37:34.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:34 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:37:34.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:34 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:37:34.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:34 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:37:34.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:34 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:37:34.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:34 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:37:34.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:34 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:37:35.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:35 smithi080 ceph-mon[29135]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-04-26T18:37:35.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:35 smithi192 ceph-mon[32842]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-04-26T18:37:35.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:35 smithi082 ceph-mon[32808]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-04-26T18:37:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.022+0000 7f0c57924640 1 -- 172.21.15.80:0/3005794510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c50102940 msgr2=0x7f0c50102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.022+0000 7f0c57924640 1 --2- 172.21.15.80:0/3005794510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c50102940 0x7f0c50102dc0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0c40009930 tx=0x7f0c4002a420 comp rx=0 tx=0).stop 2024-04-26T18:37:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.022+0000 7f0c57924640 1 -- 172.21.15.80:0/3005794510 shutdown_connections 2024-04-26T18:37:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.022+0000 7f0c57924640 1 --2- 172.21.15.80:0/3005794510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c50102940 0x7f0c50102dc0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.022+0000 7f0c57924640 1 --2- 172.21.15.80:0/3005794510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c50103300 0x7f0c5010f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.022+0000 7f0c57924640 1 --2- 172.21.15.80:0/3005794510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c50108950 0x7f0c50108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.022+0000 7f0c57924640 1 -- 172.21.15.80:0/3005794510 >> 172.21.15.80:0/3005794510 conn(0x7f0c50079dc0 msgr2=0x7f0c5007a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.022+0000 7f0c57924640 1 -- 172.21.15.80:0/3005794510 shutdown_connections 2024-04-26T18:37:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.022+0000 7f0c57924640 1 -- 172.21.15.80:0/3005794510 wait complete. 2024-04-26T18:37:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.023+0000 7f0c57924640 1 Processor -- start 2024-04-26T18:37:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.023+0000 7f0c57924640 1 -- start start 2024-04-26T18:37:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.023+0000 7f0c57924640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c50102940 0x7f0c501990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.023+0000 7f0c57924640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c50103300 0x7f0c50199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.023+0000 7f0c57924640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c50108950 0x7f0c5019d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.023+0000 7f0c57924640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0c50112c10 con 0x7f0c50103300 2024-04-26T18:37:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.023+0000 7f0c57924640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0c50112a90 con 0x7f0c50102940 2024-04-26T18:37:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.023+0000 7f0c57924640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0c50112d90 con 0x7f0c50108950 2024-04-26T18:37:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.023+0000 7f0c54ebf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c50103300 0x7f0c50199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.023+0000 7f0c54ebf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c50103300 0x7f0c50199610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49830/0 (socket says 172.21.15.80:49830) 2024-04-26T18:37:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.023+0000 7f0c54ebf640 1 -- 172.21.15.80:0/3965397690 learned_addr learned my addr 172.21.15.80:0/3965397690 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.024+0000 7f0c55ec1640 1 --2- 172.21.15.80:0/3965397690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c50108950 0x7f0c5019d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.024+0000 7f0c556c0640 1 --2- 172.21.15.80:0/3965397690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c50102940 0x7f0c501990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.024+0000 7f0c54ebf640 1 -- 172.21.15.80:0/3965397690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c50108950 msgr2=0x7f0c5019d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.024+0000 7f0c54ebf640 1 --2- 172.21.15.80:0/3965397690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c50108950 0x7f0c5019d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.024+0000 7f0c54ebf640 1 -- 172.21.15.80:0/3965397690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c50102940 msgr2=0x7f0c501990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.024+0000 7f0c54ebf640 1 --2- 172.21.15.80:0/3965397690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c50102940 0x7f0c501990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.024+0000 7f0c54ebf640 1 -- 172.21.15.80:0/3965397690 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c5019e0c0 con 0x7f0c50103300 2024-04-26T18:37:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.024+0000 7f0c556c0640 1 --2- 172.21.15.80:0/3965397690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c50102940 0x7f0c501990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:37:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.024+0000 7f0c55ec1640 1 --2- 172.21.15.80:0/3965397690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c50108950 0x7f0c5019d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:37:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.024+0000 7f0c54ebf640 1 --2- 172.21.15.80:0/3965397690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c50103300 0x7f0c50199610 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0c40004770 tx=0x7f0c400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.024+0000 7f0c467fc640 1 -- 172.21.15.80:0/3965397690 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4003f070 con 0x7f0c50103300 2024-04-26T18:37:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.024+0000 7f0c467fc640 1 -- 172.21.15.80:0/3965397690 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c4003b460 con 0x7f0c50103300 2024-04-26T18:37:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.024+0000 7f0c57924640 1 -- 172.21.15.80:0/3965397690 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c5019e350 con 0x7f0c50103300 2024-04-26T18:37:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.024+0000 7f0c467fc640 1 -- 172.21.15.80:0/3965397690 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c40035070 con 0x7f0c50103300 2024-04-26T18:37:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.024+0000 7f0c57924640 1 -- 172.21.15.80:0/3965397690 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c501a5c40 con 0x7f0c50103300 2024-04-26T18:37:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.026+0000 7f0c467fc640 1 -- 172.21.15.80:0/3965397690 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 138930+0+0 (secure 0 0 0) 0x7f0c4003b8d0 con 0x7f0c50103300 2024-04-26T18:37:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.027+0000 7f0c5a642740 1 Processor -- start 2024-04-26T18:37:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.027+0000 7f0c5a642740 1 -- start start 2024-04-26T18:37:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.027+0000 7f0c467fc640 1 --2- 172.21.15.80:0/3965397690 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f0c3c0a3f70 0x7f0c3c0a6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.027+0000 7f0c5a642740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 0x55b2b943c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.027+0000 7f0c5a642740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2b943c760 0x55b2b944afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.027+0000 7f0c5a642740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b2b944b4f0 0x55b2b944d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.027+0000 7f0c5a642740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55b2b93a2460 con 0x55b2b943be40 2024-04-26T18:37:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.027+0000 7f0c5a642740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b2b935c590 con 0x55b2b943c760 2024-04-26T18:37:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.027+0000 7f0c5a642740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b2b939e420 con 0x55b2b944b4f0 2024-04-26T18:37:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.027+0000 7f0c55ec1640 1 --2- 172.21.15.80:0/3965397690 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f0c3c0a3f70 0x7f0c3c0a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.027+0000 7f0c467fc640 1 -- 172.21.15.80:0/3965397690 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f0c400f0e80 con 0x7f0c50103300 2024-04-26T18:37:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.027+0000 7f0c556c0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 0x55b2b943c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.027+0000 7f0c556c0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 0x55b2b943c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49842/0 (socket says 172.21.15.80:49842) 2024-04-26T18:37:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.027+0000 7f0c556c0640 1 -- 172.21.15.80:0/287539782 learned_addr learned my addr 172.21.15.80:0/287539782 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.027+0000 7f0c54ebf640 1 --2- 172.21.15.80:0/287539782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2b943c760 0x55b2b944afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.027+0000 7f0c556c0640 1 -- 172.21.15.80:0/287539782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b2b944b4f0 msgr2=0x55b2b944d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.027+0000 7f0c55ec1640 1 --2- 172.21.15.80:0/287539782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b2b944b4f0 0x55b2b944d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.027+0000 7f0c556c0640 1 --2- 172.21.15.80:0/287539782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b2b944b4f0 0x55b2b944d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.027+0000 7f0c556c0640 1 -- 172.21.15.80:0/287539782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2b943c760 msgr2=0x55b2b944afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.027+0000 7f0c556c0640 1 --2- 172.21.15.80:0/287539782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2b943c760 0x55b2b944afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.028+0000 7f0c556c0640 1 -- 172.21.15.80:0/287539782 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2b93690d0 con 0x55b2b943be40 2024-04-26T18:37:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.028+0000 7f0c55ec1640 1 --2- 172.21.15.80:0/287539782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b2b944b4f0 0x55b2b944d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:37:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.028+0000 7f0c55ec1640 1 --2- 172.21.15.80:0/3965397690 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f0c3c0a3f70 0x7f0c3c0a6430 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0c48005fd0 tx=0x7f0c480099a0 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.028+0000 7f0c556c0640 1 --2- 172.21.15.80:0/287539782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 0x55b2b943c220 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c009bd0 tx=0x7f0c4c00e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896fd0fc7245f702 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.028+0000 7f0c3b7fe640 1 -- 172.21.15.80:0/287539782 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c016070 con 0x55b2b943be40 2024-04-26T18:37:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.028+0000 7f0c3b7fe640 1 -- 172.21.15.80:0/287539782 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c4c0054d0 con 0x55b2b943be40 2024-04-26T18:37:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.028+0000 7f0c3b7fe640 1 -- 172.21.15.80:0/287539782 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c011470 con 0x55b2b943be40 2024-04-26T18:37:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.029+0000 7f0c5a642740 1 -- 172.21.15.80:0/287539782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 msgr2=0x55b2b943c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.029+0000 7f0c5a642740 1 --2- 172.21.15.80:0/287539782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 0x55b2b943c220 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c009bd0 tx=0x7f0c4c00e6c0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.029+0000 7f0c5a642740 1 -- 172.21.15.80:0/287539782 shutdown_connections 2024-04-26T18:37:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.029+0000 7f0c5a642740 1 --2- 172.21.15.80:0/287539782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b2b944b4f0 0x55b2b944d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.029+0000 7f0c5a642740 1 --2- 172.21.15.80:0/287539782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2b943c760 0x55b2b944afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.029+0000 7f0c5a642740 1 --2- 172.21.15.80:0/287539782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 0x55b2b943c220 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.029+0000 7f0c5a642740 1 -- 172.21.15.80:0/287539782 >> 172.21.15.80:0/287539782 conn(0x55b2b9438410 msgr2=0x55b2b94387f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.029+0000 7f0c5a642740 1 -- 172.21.15.80:0/287539782 shutdown_connections 2024-04-26T18:37:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.029+0000 7f0c5a642740 1 -- 172.21.15.80:0/287539782 wait complete. 2024-04-26T18:37:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.029+0000 7f0c5a642740 1 -- start start 2024-04-26T18:37:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.029+0000 7f0c5a642740 1 Processor -- start 2024-04-26T18:37:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.029+0000 7f0c5a642740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 0x55b2b9448410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.029+0000 7f0c5a642740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b2b943c760 0x55b2b9448950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.029+0000 7f0c5a642740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2b944b4f0 0x55b2b9448e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.029+0000 7f0c5a642740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55b2b944e0c0 con 0x55b2b943be40 2024-04-26T18:37:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.029+0000 7f0c5a642740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b2b9329b60 con 0x55b2b944b4f0 2024-04-26T18:37:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.029+0000 7f0c5a642740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b2b944e240 con 0x55b2b943c760 2024-04-26T18:37:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.029+0000 7f0c5a642740 10 client.0 _ll_register_callbacks cb 0x55b2b934e2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:37:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.029+0000 7f0c556c0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 0x55b2b9448410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.030+0000 7f0c556c0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 0x55b2b9448410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49848/0 (socket says 172.21.15.80:49848) 2024-04-26T18:37:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.030+0000 7f0c556c0640 1 -- 172.21.15.80:0/4008051226 learned_addr learned my addr 172.21.15.80:0/4008051226 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.030+0000 7f0c55ec1640 1 --2- 172.21.15.80:0/4008051226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2b944b4f0 0x55b2b9448e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.030+0000 7f0c54ebf640 1 --2- 172.21.15.80:0/4008051226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b2b943c760 0x55b2b9448950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.030+0000 7f0c556c0640 1 -- 172.21.15.80:0/4008051226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b2b943c760 msgr2=0x55b2b9448950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.030+0000 7f0c556c0640 1 --2- 172.21.15.80:0/4008051226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b2b943c760 0x55b2b9448950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.030+0000 7f0c556c0640 1 -- 172.21.15.80:0/4008051226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2b944b4f0 msgr2=0x55b2b9448e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.030+0000 7f0c556c0640 1 --2- 172.21.15.80:0/4008051226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2b944b4f0 0x55b2b9448e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.030+0000 7f0c556c0640 1 -- 172.21.15.80:0/4008051226 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2b90b4210 con 0x55b2b943be40 2024-04-26T18:37:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.030+0000 7f0c54ebf640 1 --2- 172.21.15.80:0/4008051226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b2b943c760 0x55b2b9448950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:37:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.030+0000 7f0c556c0640 1 --2- 172.21.15.80:0/4008051226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 0x55b2b9448410 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c000c00 tx=0x7f0c4c005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d976b3089a0341e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.030+0000 7f0c38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:37:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.030+0000 7f0c38ff9640 1 -- 172.21.15.80:0/4008051226 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c028060 con 0x55b2b943be40 2024-04-26T18:37:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.030+0000 7f0c38ff9640 1 -- 172.21.15.80:0/4008051226 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f0c4c0048d0 con 0x55b2b943be40 2024-04-26T18:37:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.030+0000 7f0c5a642740 1 -- 172.21.15.80:0/4008051226 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c4c0054d0 con 0x55b2b943be40 2024-04-26T18:37:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.030+0000 7f0c38ff9640 1 -- 172.21.15.80:0/4008051226 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0c4c016040 con 0x55b2b943be40 2024-04-26T18:37:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.030+0000 7f0c5a642740 10 client.15543 fetch_fsmap learned FSMap version 27 2024-04-26T18:37:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.030+0000 7f0c5a642740 1 -- 172.21.15.80:0/4008051226 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b2b9180620 con 0x55b2b943be40 2024-04-26T18:37:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.030+0000 7f0c38ff9640 1 -- 172.21.15.80:0/4008051226 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c4c0054d0 con 0x55b2b943be40 2024-04-26T18:37:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.030+0000 7f0c38ff9640 1 -- 172.21.15.80:0/4008051226 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0c4c00f040 con 0x55b2b943be40 2024-04-26T18:37:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.031+0000 7f0c5a642740 10 client.15543 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:37:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.031+0000 7f0c5a642740 10 client.15543 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:37:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.031+0000 7f0c5a642740 20 client.15543 populate_metadata read hostname 'smithi080' 2024-04-26T18:37:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.031+0000 7f0c5a642740 1 --2- 172.21.15.80:0/4008051226 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55b2b945b510 0x55b2b945d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.031+0000 7f0c5a642740 4 client.15543 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:37:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.031+0000 7f0c5a642740 1 -- 172.21.15.80:0/4008051226 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2b93b0070 con 0x55b2b945b510 2024-04-26T18:37:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.031+0000 7f0c54ebf640 1 --2- 172.21.15.80:0/4008051226 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55b2b945b510 0x55b2b945d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.031+0000 7f0c38ff9640 10 client.15543 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:37:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.031+0000 7f0c54ebf640 1 --2- 172.21.15.80:0/4008051226 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55b2b945b510 0x55b2b945d900 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57162b9f84bc9a88 server_cookie=c18c524240aae419 in_seq=0 out_seq=0 2024-04-26T18:37:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.032+0000 7f0c38ff9640 1 -- 172.21.15.80:0/4008051226 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b2b93b0070 con 0x55b2b945b510 2024-04-26T18:37:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.032+0000 7f0c38ff9640 10 client.15543 handle_command_reply: tid=0 2024-04-26T18:37:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.032+0000 7f0c5a642740 1 client.15543 shutdown 2024-04-26T18:37:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.032+0000 7f0c5a642740 1 -- 172.21.15.80:0/4008051226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 msgr2=0x55b2b9448410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.032+0000 7f0c5a642740 1 --2- 172.21.15.80:0/4008051226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 0x55b2b9448410 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c000c00 tx=0x7f0c4c005d40 comp rx=0 tx=0).stop 2024-04-26T18:37:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.032+0000 7f0c5a642740 1 -- 172.21.15.80:0/4008051226 shutdown_connections 2024-04-26T18:37:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.032+0000 7f0c5a642740 1 --2- 172.21.15.80:0/4008051226 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55b2b945b510 0x55b2b945d900 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.032+0000 7f0c5a642740 1 --2- 172.21.15.80:0/4008051226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2b944b4f0 0x55b2b9448e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.032+0000 7f0c38ff9640 0 client.15543 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:37:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.032+0000 7f0c5a642740 1 --2- 172.21.15.80:0/4008051226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b2b943c760 0x55b2b9448950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.032+0000 7f0c5a642740 1 --2- 172.21.15.80:0/4008051226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 0x55b2b9448410 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.032+0000 7f0c5a642740 1 -- 172.21.15.80:0/4008051226 >> 172.21.15.80:0/4008051226 conn(0x55b2b9438410 msgr2=0x55b2b943e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.032+0000 7f0c5a642740 1 -- 172.21.15.80:0/4008051226 shutdown_connections 2024-04-26T18:37:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.032+0000 7f0c5a642740 1 -- 172.21.15.80:0/4008051226 wait complete. 2024-04-26T18:37:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.032+0000 7f0c5a642740 20 client.15543 trim_cache size 0 max 16384 2024-04-26T18:37:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.048+0000 7f0c5a642740 1 Processor -- start 2024-04-26T18:37:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.048+0000 7f0c5a642740 1 -- start start 2024-04-26T18:37:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.048+0000 7f0c5a642740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 0x55b2b9456ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.048+0000 7f0c5a642740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2b943c760 0x55b2b9462f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.048+0000 7f0c5a642740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b2b944b4f0 0x55b2b9463470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.048+0000 7f0c5a642740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0c501ac250 con 0x55b2b943be40 2024-04-26T18:37:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.048+0000 7f0c5a642740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0c501add90 con 0x55b2b943c760 2024-04-26T18:37:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.048+0000 7f0c5a642740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0c501ac920 con 0x55b2b944b4f0 2024-04-26T18:37:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.048+0000 7f0c556c0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 0x55b2b9456ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.048+0000 7f0c556c0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 0x55b2b9456ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49862/0 (socket says 172.21.15.80:49862) 2024-04-26T18:37:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.048+0000 7f0c556c0640 1 -- 172.21.15.80:0/3188406118 learned_addr learned my addr 172.21.15.80:0/3188406118 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.049+0000 7f0c55ec1640 1 --2- 172.21.15.80:0/3188406118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b2b944b4f0 0x55b2b9463470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.049+0000 7f0c54ebf640 1 --2- 172.21.15.80:0/3188406118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2b943c760 0x55b2b9462f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.049+0000 7f0c556c0640 1 -- 172.21.15.80:0/3188406118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b2b944b4f0 msgr2=0x55b2b9463470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.049+0000 7f0c556c0640 1 --2- 172.21.15.80:0/3188406118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b2b944b4f0 0x55b2b9463470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.049+0000 7f0c556c0640 1 -- 172.21.15.80:0/3188406118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2b943c760 msgr2=0x55b2b9462f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.049+0000 7f0c556c0640 1 --2- 172.21.15.80:0/3188406118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2b943c760 0x55b2b9462f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.049+0000 7f0c556c0640 1 -- 172.21.15.80:0/3188406118 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2b943e810 con 0x55b2b943be40 2024-04-26T18:37:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.049+0000 7f0c55ec1640 1 --2- 172.21.15.80:0/3188406118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b2b944b4f0 0x55b2b9463470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:37:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.049+0000 7f0c556c0640 1 --2- 172.21.15.80:0/3188406118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 0x55b2b9456ff0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c00e700 tx=0x7f0c4c0094e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6d6d4dec96430 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.049+0000 7f0c3affd640 1 -- 172.21.15.80:0/3188406118 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c028070 con 0x55b2b943be40 2024-04-26T18:37:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.049+0000 7f0c3affd640 1 -- 172.21.15.80:0/3188406118 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c4c0043a0 con 0x55b2b943be40 2024-04-26T18:37:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.049+0000 7f0c3affd640 1 -- 172.21.15.80:0/3188406118 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c004fd0 con 0x55b2b943be40 2024-04-26T18:37:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.050+0000 7f0c5a642740 1 -- 172.21.15.80:0/3188406118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 msgr2=0x55b2b9456ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.050+0000 7f0c5a642740 1 --2- 172.21.15.80:0/3188406118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 0x55b2b9456ff0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c00e700 tx=0x7f0c4c0094e0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.050+0000 7f0c5a642740 1 -- 172.21.15.80:0/3188406118 shutdown_connections 2024-04-26T18:37:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.050+0000 7f0c5a642740 1 --2- 172.21.15.80:0/3188406118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b2b944b4f0 0x55b2b9463470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.050+0000 7f0c5a642740 1 --2- 172.21.15.80:0/3188406118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2b943c760 0x55b2b9462f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.050+0000 7f0c5a642740 1 --2- 172.21.15.80:0/3188406118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 0x55b2b9456ff0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.050+0000 7f0c5a642740 1 -- 172.21.15.80:0/3188406118 >> 172.21.15.80:0/3188406118 conn(0x55b2b9438410 msgr2=0x55b2b94387f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.050+0000 7f0c5a642740 1 -- 172.21.15.80:0/3188406118 shutdown_connections 2024-04-26T18:37:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.050+0000 7f0c5a642740 1 -- 172.21.15.80:0/3188406118 wait complete. 2024-04-26T18:37:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.050+0000 7f0c5a642740 1 -- start start 2024-04-26T18:37:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.050+0000 7f0c5a642740 1 Processor -- start 2024-04-26T18:37:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.051+0000 7f0c5a642740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 0x55b2b9453500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.051+0000 7f0c5a642740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2b943c760 0x55b2b9453a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.051+0000 7f0c5a642740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b2b944b4f0 0x55b2b94504d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.051+0000 7f0c5a642740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0c501ad6c0 con 0x55b2b943be40 2024-04-26T18:37:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.051+0000 7f0c5a642740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0c501acff0 con 0x55b2b943c760 2024-04-26T18:37:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.051+0000 7f0c5a642740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0c501aa230 con 0x55b2b944b4f0 2024-04-26T18:37:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.051+0000 7f0c5a642740 10 client.0 _ll_register_callbacks cb 0x7f0c400329f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:37:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.051+0000 7f0c556c0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 0x55b2b9453500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.051+0000 7f0c556c0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 0x55b2b9453500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49876/0 (socket says 172.21.15.80:49876) 2024-04-26T18:37:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.051+0000 7f0c556c0640 1 -- 172.21.15.80:0/1650011732 learned_addr learned my addr 172.21.15.80:0/1650011732 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.051+0000 7f0c54ebf640 1 --2- 172.21.15.80:0/1650011732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2b943c760 0x55b2b9453a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.051+0000 7f0c55ec1640 1 --2- 172.21.15.80:0/1650011732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b2b944b4f0 0x55b2b94504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.051+0000 7f0c556c0640 1 -- 172.21.15.80:0/1650011732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b2b944b4f0 msgr2=0x55b2b94504d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.051+0000 7f0c556c0640 1 --2- 172.21.15.80:0/1650011732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b2b944b4f0 0x55b2b94504d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.051+0000 7f0c556c0640 1 -- 172.21.15.80:0/1650011732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2b943c760 msgr2=0x55b2b9453a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.051+0000 7f0c556c0640 1 --2- 172.21.15.80:0/1650011732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2b943c760 0x55b2b9453a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.051+0000 7f0c556c0640 1 -- 172.21.15.80:0/1650011732 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2b9450a90 con 0x55b2b943be40 2024-04-26T18:37:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.051+0000 7f0c54ebf640 1 --2- 172.21.15.80:0/1650011732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2b943c760 0x55b2b9453a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:37:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.051+0000 7f0c55ec1640 1 --2- 172.21.15.80:0/1650011732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b2b944b4f0 0x55b2b94504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:37:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.051+0000 7f0c556c0640 1 --2- 172.21.15.80:0/1650011732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 0x55b2b9453500 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c009400 tx=0x7f0c4c003e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8a63871af0e4b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.051+0000 7f0c38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:37:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.051+0000 7f0c38ff9640 1 -- 172.21.15.80:0/1650011732 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c03a060 con 0x55b2b943be40 2024-04-26T18:37:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.051+0000 7f0c38ff9640 1 -- 172.21.15.80:0/1650011732 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f0c4c004fd0 con 0x55b2b943be40 2024-04-26T18:37:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.051+0000 7f0c5a642740 1 -- 172.21.15.80:0/1650011732 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c4c0043a0 con 0x55b2b943be40 2024-04-26T18:37:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.052+0000 7f0c38ff9640 1 -- 172.21.15.80:0/1650011732 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0c4c028070 con 0x55b2b943be40 2024-04-26T18:37:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.052+0000 7f0c5a642740 10 client.15549 fetch_fsmap learned FSMap version 27 2024-04-26T18:37:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.052+0000 7f0c5a642740 1 -- 172.21.15.80:0/1650011732 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b2b94c1ff0 con 0x55b2b943be40 2024-04-26T18:37:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.052+0000 7f0c38ff9640 1 -- 172.21.15.80:0/1650011732 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c4c0043a0 con 0x55b2b943be40 2024-04-26T18:37:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.052+0000 7f0c38ff9640 1 -- 172.21.15.80:0/1650011732 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0c4c0118c0 con 0x55b2b943be40 2024-04-26T18:37:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.052+0000 7f0c5a642740 10 client.15549 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:37:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.052+0000 7f0c5a642740 10 client.15549 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:37:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.052+0000 7f0c5a642740 20 client.15549 populate_metadata read hostname 'smithi080' 2024-04-26T18:37:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.052+0000 7f0c5a642740 1 --2- 172.21.15.80:0/1650011732 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55b2b94c26e0 0x55b2b94c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.052+0000 7f0c5a642740 4 client.15549 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:37:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.052+0000 7f0c5a642740 1 -- 172.21.15.80:0/1650011732 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b2b93a9ee0 con 0x55b2b94c26e0 2024-04-26T18:37:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.052+0000 7f0c54ebf640 1 --2- 172.21.15.80:0/1650011732 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55b2b94c26e0 0x55b2b94c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.053+0000 7f0c38ff9640 10 client.15549 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:37:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.053+0000 7f0c54ebf640 1 --2- 172.21.15.80:0/1650011732 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55b2b94c26e0 0x55b2b94c4b00 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b95b95e572309029 server_cookie=5a396bdcf6cca807 in_seq=0 out_seq=0 2024-04-26T18:37:36.060 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.060+0000 7f0c38ff9640 1 -- 172.21.15.80:0/1650011732 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b2b93a9ee0 con 0x55b2b94c26e0 2024-04-26T18:37:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.060+0000 7f0c38ff9640 10 client.15549 handle_command_reply: tid=0 2024-04-26T18:37:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.060+0000 7f0c5a642740 1 client.15549 shutdown 2024-04-26T18:37:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.060+0000 7f0c5a642740 1 -- 172.21.15.80:0/1650011732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 msgr2=0x55b2b9453500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.060+0000 7f0c5a642740 1 --2- 172.21.15.80:0/1650011732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 0x55b2b9453500 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c009400 tx=0x7f0c4c003e70 comp rx=0 tx=0).stop 2024-04-26T18:37:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.060+0000 7f0c5a642740 1 -- 172.21.15.80:0/1650011732 shutdown_connections 2024-04-26T18:37:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.060+0000 7f0c5a642740 1 --2- 172.21.15.80:0/1650011732 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55b2b94c26e0 0x55b2b94c4b00 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.060+0000 7f0c5a642740 1 --2- 172.21.15.80:0/1650011732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b2b944b4f0 0x55b2b94504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.060+0000 7f0c38ff9640 0 client.15549 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:37:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.060+0000 7f0c5a642740 1 --2- 172.21.15.80:0/1650011732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2b943c760 0x55b2b9453a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.060+0000 7f0c5a642740 1 --2- 172.21.15.80:0/1650011732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b2b943be40 0x55b2b9453500 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.060+0000 7f0c5a642740 1 -- 172.21.15.80:0/1650011732 >> 172.21.15.80:0/1650011732 conn(0x55b2b9438410 msgr2=0x55b2b94483b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.060+0000 7f0c5a642740 1 -- 172.21.15.80:0/1650011732 shutdown_connections 2024-04-26T18:37:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.060+0000 7f0c5a642740 1 -- 172.21.15.80:0/1650011732 wait complete. 2024-04-26T18:37:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.060+0000 7f0c5a642740 20 client.15549 trim_cache size 0 max 16384 2024-04-26T18:37:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:{ 2024-04-26T18:37:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "message": "", 2024-04-26T18:37:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "return_code": 0 2024-04-26T18:37:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:} 2024-04-26T18:37:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.061+0000 7f0c57924640 1 -- 172.21.15.80:0/3965397690 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f0c3c0a3f70 msgr2=0x7f0c3c0a6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.061+0000 7f0c57924640 1 --2- 172.21.15.80:0/3965397690 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f0c3c0a3f70 0x7f0c3c0a6430 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0c48005fd0 tx=0x7f0c480099a0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.061+0000 7f0c57924640 1 -- 172.21.15.80:0/3965397690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c50103300 msgr2=0x7f0c50199610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.061+0000 7f0c57924640 1 --2- 172.21.15.80:0/3965397690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c50103300 0x7f0c50199610 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0c40004770 tx=0x7f0c400042f0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.061+0000 7f0c57924640 1 -- 172.21.15.80:0/3965397690 shutdown_connections 2024-04-26T18:37:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.061+0000 7f0c57924640 1 --2- 172.21.15.80:0/3965397690 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f0c3c0a3f70 0x7f0c3c0a6430 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.061+0000 7f0c57924640 1 --2- 172.21.15.80:0/3965397690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c50103300 0x7f0c50199610 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.061+0000 7f0c57924640 1 --2- 172.21.15.80:0/3965397690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c50108950 0x7f0c5019d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.061+0000 7f0c57924640 1 --2- 172.21.15.80:0/3965397690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c50102940 0x7f0c501990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.061+0000 7f0c57924640 1 -- 172.21.15.80:0/3965397690 >> 172.21.15.80:0/3965397690 conn(0x7f0c50079dc0 msgr2=0x7f0c501002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.061+0000 7f0c57924640 1 -- 172.21.15.80:0/3965397690 shutdown_connections 2024-04-26T18:37:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:36.061+0000 7f0c57924640 1 -- 172.21.15.80:0/3965397690 wait complete. 2024-04-26T18:37:37.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:37 smithi080 ceph-mon[29135]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-04-26T18:37:37.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:37 smithi192 ceph-mon[32842]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-04-26T18:37:37.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:37 smithi082 ceph-mon[32808]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-04-26T18:37:39.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:39 smithi080 ceph-mon[29135]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-04-26T18:37:39.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:39 smithi192 ceph-mon[32842]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-04-26T18:37:39.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:39 smithi082 ceph-mon[32808]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-04-26T18:37:41.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:41 smithi080 ceph-mon[29135]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.6 KiB/s wr, 14 op/s 2024-04-26T18:37:41.772 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:41 smithi082 ceph-mon[32808]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.6 KiB/s wr, 14 op/s 2024-04-26T18:37:41.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:41 smithi192 ceph-mon[32842]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.6 KiB/s wr, 14 op/s 2024-04-26T18:37:43.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:43 smithi080 ceph-mon[29135]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-26T18:37:43.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:43 smithi192 ceph-mon[32842]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-26T18:37:43.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:43 smithi082 ceph-mon[32808]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-26T18:37:45.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:45 smithi080 ceph-mon[29135]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-04-26T18:37:45.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:45 smithi192 ceph-mon[32842]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-04-26T18:37:45.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:45 smithi082 ceph-mon[32808]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-04-26T18:37:47.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:47 smithi192 ceph-mon[32842]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-26T18:37:47.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:47 smithi082 ceph-mon[32808]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-26T18:37:47.994 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:47 smithi080 ceph-mon[29135]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-26T18:37:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.194+0000 7f66b775f640 1 -- 172.21.15.80:0/335493209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66b0107820 msgr2=0x7f66b0107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.194+0000 7f66b775f640 1 --2- 172.21.15.80:0/335493209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66b0107820 0x7f66b0107c00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f66ac009930 tx=0x7f66ac02a420 comp rx=0 tx=0).stop 2024-04-26T18:37:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.194+0000 7f66b775f640 1 -- 172.21.15.80:0/335493209 shutdown_connections 2024-04-26T18:37:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.194+0000 7f66b775f640 1 --2- 172.21.15.80:0/335493209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66b0102220 0x7f66b010e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.194+0000 7f66b775f640 1 --2- 172.21.15.80:0/335493209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66b0101860 0x7f66b0101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.194+0000 7f66b775f640 1 --2- 172.21.15.80:0/335493209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66b0107820 0x7f66b0107c00 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.194+0000 7f66b775f640 1 -- 172.21.15.80:0/335493209 >> 172.21.15.80:0/335493209 conn(0x7f66b00789b0 msgr2=0x7f66b0078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.194+0000 7f66b775f640 1 -- 172.21.15.80:0/335493209 shutdown_connections 2024-04-26T18:37:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.194+0000 7f66b775f640 1 -- 172.21.15.80:0/335493209 wait complete. 2024-04-26T18:37:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.195+0000 7f66b775f640 1 Processor -- start 2024-04-26T18:37:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.195+0000 7f66b775f640 1 -- start start 2024-04-26T18:37:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.195+0000 7f66b775f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66b0101860 0x7f66b0197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.195+0000 7f66b775f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66b0102220 0x7f66b0198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.195+0000 7f66b775f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66b0198980 0x7f66b01a7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.195+0000 7f66b775f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f66b0111ae0 con 0x7f66b0102220 2024-04-26T18:37:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.195+0000 7f66b775f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f66b0111960 con 0x7f66b0198980 2024-04-26T18:37:49.198 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.195+0000 7f66b775f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f66b0111c60 con 0x7f66b0101860 2024-04-26T18:37:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.195+0000 7f66b4cfa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66b0102220 0x7f66b0198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.195+0000 7f66b4cfa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66b0102220 0x7f66b0198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37488/0 (socket says 172.21.15.80:37488) 2024-04-26T18:37:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.195+0000 7f66b4cfa640 1 -- 172.21.15.80:0/4228464202 learned_addr learned my addr 172.21.15.80:0/4228464202 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.195+0000 7f66b54fb640 1 --2- 172.21.15.80:0/4228464202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66b0101860 0x7f66b0197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.196+0000 7f66b5cfc640 1 --2- 172.21.15.80:0/4228464202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66b0198980 0x7f66b01a7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.196+0000 7f66b4cfa640 1 -- 172.21.15.80:0/4228464202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66b0101860 msgr2=0x7f66b0197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.196+0000 7f66b4cfa640 1 --2- 172.21.15.80:0/4228464202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66b0101860 0x7f66b0197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.196+0000 7f66b4cfa640 1 -- 172.21.15.80:0/4228464202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66b0198980 msgr2=0x7f66b01a7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.196+0000 7f66b4cfa640 1 --2- 172.21.15.80:0/4228464202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66b0198980 0x7f66b01a7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.196+0000 7f66b4cfa640 1 -- 172.21.15.80:0/4228464202 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b01a7b40 con 0x7f66b0102220 2024-04-26T18:37:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.196+0000 7f66b54fb640 1 --2- 172.21.15.80:0/4228464202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66b0101860 0x7f66b0197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:37:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.196+0000 7f66b5cfc640 1 --2- 172.21.15.80:0/4228464202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66b0198980 0x7f66b01a7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:37:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.196+0000 7f66b4cfa640 1 --2- 172.21.15.80:0/4228464202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66b0102220 0x7f66b0198440 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f66a000ed90 tx=0x7f66a000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.196+0000 7f66a67fc640 1 -- 172.21.15.80:0/4228464202 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a0009e10 con 0x7f66b0102220 2024-04-26T18:37:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.196+0000 7f66b775f640 1 -- 172.21.15.80:0/4228464202 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66b01a7e30 con 0x7f66b0102220 2024-04-26T18:37:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.196+0000 7f66b775f640 1 -- 172.21.15.80:0/4228464202 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66b01a8340 con 0x7f66b0102220 2024-04-26T18:37:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.197+0000 7f66a67fc640 1 -- 172.21.15.80:0/4228464202 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66a00108e0 con 0x7f66b0102220 2024-04-26T18:37:49.201 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.197+0000 7f66a67fc640 1 -- 172.21.15.80:0/4228464202 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a0018840 con 0x7f66b0102220 2024-04-26T18:37:49.201 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.200+0000 7f66a67fc640 1 -- 172.21.15.80:0/4228464202 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 25) ==== 138930+0+0 (secure 0 0 0) 0x7f66a0010430 con 0x7f66b0102220 2024-04-26T18:37:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.200+0000 7f66ba475740 1 Processor -- start 2024-04-26T18:37:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.200+0000 7f66ba475740 1 -- start start 2024-04-26T18:37:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.200+0000 7f66ba475740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5562f48e3f00 0x5562f48e42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.200+0000 7f66ba475740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48e4820 0x5562f48eeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.201+0000 7f66ba475740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562f48ef0e0 0x5562f48f14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.201+0000 7f66ba475740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5562f484a460 con 0x5562f48e4820 2024-04-26T18:37:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.201+0000 7f66ba475740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5562f4804590 con 0x5562f48ef0e0 2024-04-26T18:37:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.201+0000 7f66ba475740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5562f4846420 con 0x5562f48e3f00 2024-04-26T18:37:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.201+0000 7f66b54fb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48e4820 0x5562f48eeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.201+0000 7f66b54fb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48e4820 0x5562f48eeba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37500/0 (socket says 172.21.15.80:37500) 2024-04-26T18:37:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.201+0000 7f66b54fb640 1 -- 172.21.15.80:0/1233737202 learned_addr learned my addr 172.21.15.80:0/1233737202 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.201+0000 7f66b5cfc640 1 --2- 172.21.15.80:0/1233737202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5562f48e3f00 0x5562f48e42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.201+0000 7f66b54fb640 1 -- 172.21.15.80:0/1233737202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5562f48e3f00 msgr2=0x5562f48e42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.201+0000 7f66b54fb640 1 --2- 172.21.15.80:0/1233737202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5562f48e3f00 0x5562f48e42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.201+0000 7f66b4cfa640 1 --2- 172.21.15.80:0/1233737202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562f48ef0e0 0x5562f48f14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.201+0000 7f66b54fb640 1 -- 172.21.15.80:0/1233737202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562f48ef0e0 msgr2=0x5562f48f14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:49.207 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.201+0000 7f66b54fb640 1 --2- 172.21.15.80:0/1233737202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562f48ef0e0 0x5562f48f14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.207 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.201+0000 7f66b54fb640 1 -- 172.21.15.80:0/1233737202 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562f48110d0 con 0x5562f48e4820 2024-04-26T18:37:49.207 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.201+0000 7f66b4cfa640 1 --2- 172.21.15.80:0/1233737202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562f48ef0e0 0x5562f48f14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:37:49.207 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.201+0000 7f66a67fc640 1 --2- 172.21.15.80:0/4228464202 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f669c0a3ff0 0x7f669c0a64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:49.207 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.202+0000 7f66a67fc640 1 -- 172.21.15.80:0/4228464202 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f66a00d0a30 con 0x7f66b0102220 2024-04-26T18:37:49.207 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.202+0000 7f66b54fb640 1 --2- 172.21.15.80:0/1233737202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48e4820 0x5562f48eeba0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f66ac009900 tx=0x7f66ac005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7dd86fa22345d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:49.207 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.202+0000 7f66b5cfc640 1 --2- 172.21.15.80:0/4228464202 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f669c0a3ff0 0x7f669c0a64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.202+0000 7f669b7fe640 1 -- 172.21.15.80:0/1233737202 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ac040070 con 0x5562f48e4820 2024-04-26T18:37:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.202+0000 7f669b7fe640 1 -- 172.21.15.80:0/1233737202 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66ac031720 con 0x5562f48e4820 2024-04-26T18:37:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.202+0000 7f669b7fe640 1 -- 172.21.15.80:0/1233737202 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ac035040 con 0x5562f48e4820 2024-04-26T18:37:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.203+0000 7f66ba475740 1 -- 172.21.15.80:0/1233737202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48e4820 msgr2=0x5562f48eeba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.203+0000 7f66b5cfc640 1 --2- 172.21.15.80:0/4228464202 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f669c0a3ff0 0x7f669c0a64b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f66a8005fd0 tx=0x7f66a8009500 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.203+0000 7f66ba475740 1 --2- 172.21.15.80:0/1233737202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48e4820 0x5562f48eeba0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f66ac009900 tx=0x7f66ac005c00 comp rx=0 tx=0).stop 2024-04-26T18:37:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.203+0000 7f66ba475740 1 -- 172.21.15.80:0/1233737202 shutdown_connections 2024-04-26T18:37:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.203+0000 7f66ba475740 1 --2- 172.21.15.80:0/1233737202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48e4820 0x5562f48eeba0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.203+0000 7f66ba475740 1 --2- 172.21.15.80:0/1233737202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562f48ef0e0 0x5562f48f14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.203+0000 7f66ba475740 1 --2- 172.21.15.80:0/1233737202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5562f48e3f00 0x5562f48e42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.203+0000 7f66ba475740 1 -- 172.21.15.80:0/1233737202 >> 172.21.15.80:0/1233737202 conn(0x5562f48e0410 msgr2=0x5562f48e07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.203+0000 7f66ba475740 1 -- 172.21.15.80:0/1233737202 shutdown_connections 2024-04-26T18:37:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.203+0000 7f66ba475740 1 -- 172.21.15.80:0/1233737202 wait complete. 2024-04-26T18:37:49.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.204+0000 7f66ba475740 1 -- start start 2024-04-26T18:37:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.204+0000 7f66ba475740 1 Processor -- start 2024-04-26T18:37:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.204+0000 7f66ba475740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562f48e3f00 0x5562f48ebfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.204+0000 7f66ba475740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5562f48e4820 0x5562f48ec4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.204+0000 7f66ba475740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48ef0e0 0x5562f48eca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.204+0000 7f66ba475740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5562f48f1cb0 con 0x5562f48ef0e0 2024-04-26T18:37:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.204+0000 7f66b5cfc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48ef0e0 0x5562f48eca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.204+0000 7f66b54fb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562f48e3f00 0x5562f48ebfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.204+0000 7f66b54fb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562f48e3f00 0x5562f48ebfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:41796/0 (socket says 172.21.15.80:41796) 2024-04-26T18:37:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.205+0000 7f66b54fb640 1 -- 172.21.15.80:0/3098248290 learned_addr learned my addr 172.21.15.80:0/3098248290 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.205+0000 7f66ba475740 1 -- 172.21.15.80:0/3098248290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5562f47d1b60 con 0x5562f48e3f00 2024-04-26T18:37:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.205+0000 7f66ba475740 1 -- 172.21.15.80:0/3098248290 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5562f48f1e30 con 0x5562f48e4820 2024-04-26T18:37:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.205+0000 7f66b4cfa640 1 --2- 172.21.15.80:0/3098248290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5562f48e4820 0x5562f48ec4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.205+0000 7f66b54fb640 1 -- 172.21.15.80:0/3098248290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5562f48e4820 msgr2=0x5562f48ec4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.205+0000 7f66b54fb640 1 --2- 172.21.15.80:0/3098248290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5562f48e4820 0x5562f48ec4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.205+0000 7f66b54fb640 1 -- 172.21.15.80:0/3098248290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48ef0e0 msgr2=0x5562f48eca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.205+0000 7f66b54fb640 1 --2- 172.21.15.80:0/3098248290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48ef0e0 0x5562f48eca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.205+0000 7f66b54fb640 1 -- 172.21.15.80:0/3098248290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562f455c210 con 0x5562f48e3f00 2024-04-26T18:37:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.205+0000 7f66b4cfa640 1 --2- 172.21.15.80:0/3098248290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5562f48e4820 0x5562f48ec4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:37:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.205+0000 7f66ba475740 10 client.0 _ll_register_callbacks cb 0x5562f47f62b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:37:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.205+0000 7f66ba475740 1 -- 172.21.15.80:0/3098248290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66ac031720 con 0x5562f48e3f00 2024-04-26T18:37:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.205+0000 7f66b54fb640 1 --2- 172.21.15.80:0/3098248290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562f48e3f00 0x5562f48ebfb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f66ac005940 tx=0x7f66ac005770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b8ea8635768eb5d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.205+0000 7f6698ff9640 10 client.25082 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T18:37:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.205+0000 7f6698ff9640 1 -- 172.21.15.80:0/3098248290 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ac040070 con 0x5562f48e3f00 2024-04-26T18:37:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.206+0000 7f6698ff9640 1 -- 172.21.15.80:0/3098248290 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f66ac004440 con 0x5562f48e3f00 2024-04-26T18:37:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.206+0000 7f6698ff9640 1 -- 172.21.15.80:0/3098248290 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f66ac035040 con 0x5562f48e3f00 2024-04-26T18:37:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.206+0000 7f66ba475740 10 client.25082 fetch_fsmap learned FSMap version 27 2024-04-26T18:37:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.206+0000 7f66ba475740 1 -- 172.21.15.80:0/3098248290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({fsmap=27}) -- 0x5562f4628620 con 0x5562f48e3f00 2024-04-26T18:37:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.206+0000 7f6698ff9640 1 -- 172.21.15.80:0/3098248290 <== mon.2 v2:172.21.15.82:3300/0 4 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f66ac0035f0 con 0x5562f48e3f00 2024-04-26T18:37:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.206+0000 7f66ba475740 10 client.25082 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:37:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.206+0000 7f66ba475740 10 client.25082 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:37:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.206+0000 7f66ba475740 20 client.25082 populate_metadata read hostname 'smithi080' 2024-04-26T18:37:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.206+0000 7f66ba475740 1 --2- 172.21.15.80:0/3098248290 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x5562f48fedf0 0x5562f49011e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.206+0000 7f66ba475740 4 client.25082 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:37:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.206+0000 7f66ba475740 1 -- 172.21.15.80:0/3098248290 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562f4858070 con 0x5562f48fedf0 2024-04-26T18:37:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.207+0000 7f66b4cfa640 1 --2- 172.21.15.80:0/3098248290 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x5562f48fedf0 0x5562f49011e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.207+0000 7f6698ff9640 10 client.25082 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:37:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.207+0000 7f66b4cfa640 1 --2- 172.21.15.80:0/3098248290 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x5562f48fedf0 0x5562f49011e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd6b490ba76710f5 server_cookie=8fbbccd8a61e5f0f in_seq=0 out_seq=0 2024-04-26T18:37:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.208+0000 7f6698ff9640 1 -- 172.21.15.80:0/3098248290 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5562f4858070 con 0x5562f48fedf0 2024-04-26T18:37:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.208+0000 7f6698ff9640 10 client.25082 handle_command_reply: tid=0 2024-04-26T18:37:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.208+0000 7f66ba475740 1 client.25082 shutdown 2024-04-26T18:37:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.208+0000 7f66ba475740 1 -- 172.21.15.80:0/3098248290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562f48e3f00 msgr2=0x5562f48ebfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.208+0000 7f66ba475740 1 --2- 172.21.15.80:0/3098248290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562f48e3f00 0x5562f48ebfb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f66ac005940 tx=0x7f66ac005770 comp rx=0 tx=0).stop 2024-04-26T18:37:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.208+0000 7f66ba475740 1 -- 172.21.15.80:0/3098248290 shutdown_connections 2024-04-26T18:37:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.208+0000 7f66ba475740 1 --2- 172.21.15.80:0/3098248290 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x5562f48fedf0 0x5562f49011e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.208+0000 7f66ba475740 1 --2- 172.21.15.80:0/3098248290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48ef0e0 0x5562f48eca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.208+0000 7f6698ff9640 0 client.25082 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:37:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.208+0000 7f66ba475740 1 --2- 172.21.15.80:0/3098248290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5562f48e4820 0x5562f48ec4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.208+0000 7f66ba475740 1 --2- 172.21.15.80:0/3098248290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562f48e3f00 0x5562f48ebfb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.208+0000 7f66ba475740 1 -- 172.21.15.80:0/3098248290 >> 172.21.15.80:0/3098248290 conn(0x5562f48e0410 msgr2=0x5562f48e6190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.208+0000 7f66ba475740 1 -- 172.21.15.80:0/3098248290 shutdown_connections 2024-04-26T18:37:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.208+0000 7f66ba475740 1 -- 172.21.15.80:0/3098248290 wait complete. 2024-04-26T18:37:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.208+0000 7f66ba475740 20 client.25082 trim_cache size 0 max 16384 2024-04-26T18:37:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.237+0000 7f66ba475740 1 Processor -- start 2024-04-26T18:37:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.237+0000 7f66ba475740 1 -- start start 2024-04-26T18:37:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.237+0000 7f66ba475740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48e3f00 0x5562f48e6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.237+0000 7f66ba475740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5562f48e4820 0x5562f48fa790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.237+0000 7f66ba475740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562f48ef0e0 0x5562f4904200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.238+0000 7f66b54fb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48e3f00 0x5562f48e6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.238+0000 7f66ba475740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f669400e5c0 con 0x5562f48e3f00 2024-04-26T18:37:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.238+0000 7f66ba475740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6694010100 con 0x5562f48ef0e0 2024-04-26T18:37:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.238+0000 7f66ba475740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f669400ec90 con 0x5562f48e4820 2024-04-26T18:37:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.238+0000 7f66b54fb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48e3f00 0x5562f48e6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37518/0 (socket says 172.21.15.80:37518) 2024-04-26T18:37:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.238+0000 7f66b54fb640 1 -- 172.21.15.80:0/3923852569 learned_addr learned my addr 172.21.15.80:0/3923852569 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.238+0000 7f66b5cfc640 1 --2- 172.21.15.80:0/3923852569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562f48ef0e0 0x5562f4904200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.238+0000 7f66b4cfa640 1 --2- 172.21.15.80:0/3923852569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5562f48e4820 0x5562f48fa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.238+0000 7f66b54fb640 1 -- 172.21.15.80:0/3923852569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5562f48e4820 msgr2=0x5562f48fa790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.238+0000 7f66b54fb640 1 --2- 172.21.15.80:0/3923852569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5562f48e4820 0x5562f48fa790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.238+0000 7f66b54fb640 1 -- 172.21.15.80:0/3923852569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562f48ef0e0 msgr2=0x5562f4904200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.238+0000 7f66b54fb640 1 --2- 172.21.15.80:0/3923852569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562f48ef0e0 0x5562f4904200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.238+0000 7f66b54fb640 1 -- 172.21.15.80:0/3923852569 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562f48dbd60 con 0x5562f48e3f00 2024-04-26T18:37:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.238+0000 7f66b4cfa640 1 --2- 172.21.15.80:0/3923852569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5562f48e4820 0x5562f48fa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:37:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.238+0000 7f66b54fb640 1 --2- 172.21.15.80:0/3923852569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48e3f00 0x5562f48e6910 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f66ac003780 tx=0x7f66ac047040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc63ef02186b90c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.238+0000 7f669affd640 1 -- 172.21.15.80:0/3923852569 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ac004440 con 0x5562f48e3f00 2024-04-26T18:37:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.238+0000 7f669affd640 1 -- 172.21.15.80:0/3923852569 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66ac031720 con 0x5562f48e3f00 2024-04-26T18:37:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.238+0000 7f669affd640 1 -- 172.21.15.80:0/3923852569 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ac052c80 con 0x5562f48e3f00 2024-04-26T18:37:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.239+0000 7f66ba475740 1 -- 172.21.15.80:0/3923852569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48e3f00 msgr2=0x5562f48e6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.239+0000 7f66ba475740 1 --2- 172.21.15.80:0/3923852569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48e3f00 0x5562f48e6910 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f66ac003780 tx=0x7f66ac047040 comp rx=0 tx=0).stop 2024-04-26T18:37:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.239+0000 7f66ba475740 1 -- 172.21.15.80:0/3923852569 shutdown_connections 2024-04-26T18:37:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.239+0000 7f66ba475740 1 --2- 172.21.15.80:0/3923852569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562f48ef0e0 0x5562f4904200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.239+0000 7f66ba475740 1 --2- 172.21.15.80:0/3923852569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5562f48e4820 0x5562f48fa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.239+0000 7f66ba475740 1 --2- 172.21.15.80:0/3923852569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48e3f00 0x5562f48e6910 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.239+0000 7f66ba475740 1 -- 172.21.15.80:0/3923852569 >> 172.21.15.80:0/3923852569 conn(0x5562f48e0410 msgr2=0x5562f48fa080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.240+0000 7f66ba475740 1 -- 172.21.15.80:0/3923852569 shutdown_connections 2024-04-26T18:37:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.240+0000 7f66ba475740 1 -- 172.21.15.80:0/3923852569 wait complete. 2024-04-26T18:37:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.240+0000 7f66ba475740 1 -- start start 2024-04-26T18:37:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.240+0000 7f66ba475740 1 Processor -- start 2024-04-26T18:37:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.241+0000 7f66ba475740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5562f48e3f00 0x5562f4901be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.241+0000 7f66ba475740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48e4820 0x5562f4902120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.241+0000 7f66ba475740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562f48ef0e0 0x5562f4902660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:49.247 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.241+0000 7f66ba475740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f669400fa30 con 0x5562f48e4820 2024-04-26T18:37:49.247 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.241+0000 7f66b4cfa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48e4820 0x5562f4902120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:49.247 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.241+0000 7f66ba475740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f669400f360 con 0x5562f48ef0e0 2024-04-26T18:37:49.247 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.241+0000 7f66b4cfa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48e4820 0x5562f4902120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37530/0 (socket says 172.21.15.80:37530) 2024-04-26T18:37:49.247 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.241+0000 7f66b4cfa640 1 -- 172.21.15.80:0/3340128846 learned_addr learned my addr 172.21.15.80:0/3340128846 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:37:49.247 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.241+0000 7f66ba475740 1 -- 172.21.15.80:0/3340128846 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f669400c5a0 con 0x5562f48e3f00 2024-04-26T18:37:49.247 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.241+0000 7f66b5cfc640 1 --2- 172.21.15.80:0/3340128846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562f48ef0e0 0x5562f4902660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:49.247 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.241+0000 7f66b54fb640 1 --2- 172.21.15.80:0/3340128846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5562f48e3f00 0x5562f4901be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:49.247 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.241+0000 7f66ba475740 10 client.0 _ll_register_callbacks cb 0x7f66ac009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:37:49.247 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.241+0000 7f66b5cfc640 1 -- 172.21.15.80:0/3340128846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5562f48e3f00 msgr2=0x5562f4901be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:49.247 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.241+0000 7f66b5cfc640 1 --2- 172.21.15.80:0/3340128846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5562f48e3f00 0x5562f4901be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.247 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.241+0000 7f66b5cfc640 1 -- 172.21.15.80:0/3340128846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48e4820 msgr2=0x5562f4902120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:37:49.247 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.241+0000 7f66b5cfc640 1 --2- 172.21.15.80:0/3340128846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48e4820 0x5562f4902120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.247 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.241+0000 7f66b5cfc640 1 -- 172.21.15.80:0/3340128846 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562f4963fd0 con 0x5562f48ef0e0 2024-04-26T18:37:49.248 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.241+0000 7f66b4cfa640 1 --2- 172.21.15.80:0/3340128846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48e4820 0x5562f4902120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:37:49.248 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.242+0000 7f66b5cfc640 1 --2- 172.21.15.80:0/3340128846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562f48ef0e0 0x5562f4902660 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x5562f48e5490 tx=0x7f66a8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab0316a98380061a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:37:49.248 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.242+0000 7f6698ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T18:37:49.248 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.242+0000 7f6698ff9640 1 -- 172.21.15.80:0/3340128846 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a802f060 con 0x5562f48ef0e0 2024-04-26T18:37:49.248 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.242+0000 7f6698ff9640 1 -- 172.21.15.80:0/3340128846 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f66a8004590 con 0x5562f48ef0e0 2024-04-26T18:37:49.248 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.242+0000 7f66ba475740 1 -- 172.21.15.80:0/3340128846 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66ac031720 con 0x5562f48ef0e0 2024-04-26T18:37:49.248 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.242+0000 7f6698ff9640 1 -- 172.21.15.80:0/3340128846 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f66a8004790 con 0x5562f48ef0e0 2024-04-26T18:37:49.248 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.242+0000 7f66ba475740 10 client.25088 fetch_fsmap learned FSMap version 27 2024-04-26T18:37:49.248 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.242+0000 7f66ba475740 1 -- 172.21.15.80:0/3340128846 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5562f49651f0 con 0x5562f48ef0e0 2024-04-26T18:37:49.248 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.242+0000 7f6698ff9640 1 -- 172.21.15.80:0/3340128846 <== mon.2 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66a8034910 con 0x5562f48ef0e0 2024-04-26T18:37:49.248 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.243+0000 7f6698ff9640 1 -- 172.21.15.80:0/3340128846 <== mon.2 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f66a801f6a0 con 0x5562f48ef0e0 2024-04-26T18:37:49.248 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.243+0000 7f66ba475740 10 client.25088 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:37:49.248 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.244+0000 7f66ba475740 10 client.25088 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:37:49.248 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.244+0000 7f66ba475740 20 client.25088 populate_metadata read hostname 'smithi080' 2024-04-26T18:37:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.244+0000 7f66ba475740 1 --2- 172.21.15.80:0/3340128846 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x5562f48fedf0 0x5562f4967950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:37:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.244+0000 7f66ba475740 4 client.25088 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:37:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.244+0000 7f66ba475740 1 -- 172.21.15.80:0/3340128846 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f66ac031720 con 0x5562f48fedf0 2024-04-26T18:37:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.244+0000 7f66b54fb640 1 --2- 172.21.15.80:0/3340128846 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x5562f48fedf0 0x5562f4967950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:37:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.244+0000 7f6698ff9640 10 client.25088 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:37:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.244+0000 7f66b54fb640 1 --2- 172.21.15.80:0/3340128846 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x5562f48fedf0 0x5562f4967950 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=693e9854f40d3bc5 server_cookie=e1b390b1a0f66175 in_seq=0 out_seq=0 2024-04-26T18:37:49.250 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.248+0000 7f6698ff9640 1 -- 172.21.15.80:0/3340128846 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f66ac031720 con 0x5562f48fedf0 2024-04-26T18:37:49.250 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.248+0000 7f6698ff9640 10 client.25088 handle_command_reply: tid=0 2024-04-26T18:37:49.250 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.248+0000 7f66ba475740 1 client.25088 shutdown 2024-04-26T18:37:49.251 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.249+0000 7f66ba475740 1 -- 172.21.15.80:0/3340128846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562f48ef0e0 msgr2=0x5562f4902660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:49.251 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.249+0000 7f66ba475740 1 --2- 172.21.15.80:0/3340128846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562f48ef0e0 0x5562f4902660 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x5562f48e5490 tx=0x7f66a8004a40 comp rx=0 tx=0).stop 2024-04-26T18:37:49.251 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.249+0000 7f66ba475740 1 -- 172.21.15.80:0/3340128846 shutdown_connections 2024-04-26T18:37:49.251 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.249+0000 7f66ba475740 1 --2- 172.21.15.80:0/3340128846 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x5562f48fedf0 0x5562f4967950 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.251 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.249+0000 7f66ba475740 1 --2- 172.21.15.80:0/3340128846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5562f48e4820 0x5562f4902120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.251 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.249+0000 7f66ba475740 1 --2- 172.21.15.80:0/3340128846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562f48ef0e0 0x5562f4902660 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.251 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.249+0000 7f66ba475740 1 --2- 172.21.15.80:0/3340128846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5562f48e3f00 0x5562f4901be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.251 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.249+0000 7f66ba475740 1 -- 172.21.15.80:0/3340128846 >> 172.21.15.80:0/3340128846 conn(0x5562f48e0410 msgr2=0x5562f48df5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:49.251 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.249+0000 7f6698ff9640 0 client.25088 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:37:49.251 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.249+0000 7f66ba475740 1 -- 172.21.15.80:0/3340128846 shutdown_connections 2024-04-26T18:37:49.252 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.249+0000 7f66ba475740 1 -- 172.21.15.80:0/3340128846 wait complete. 2024-04-26T18:37:49.252 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.249+0000 7f66ba475740 20 client.25088 trim_cache size 0 max 16384 2024-04-26T18:37:49.252 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:{ 2024-04-26T18:37:49.252 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "message": "", 2024-04-26T18:37:49.252 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "return_code": 0 2024-04-26T18:37:49.252 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:} 2024-04-26T18:37:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.250+0000 7f66b775f640 1 -- 172.21.15.80:0/4228464202 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f669c0a3ff0 msgr2=0x7f669c0a64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.250+0000 7f66b775f640 1 --2- 172.21.15.80:0/4228464202 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f669c0a3ff0 0x7f669c0a64b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f66a8005fd0 tx=0x7f66a8009500 comp rx=0 tx=0).stop 2024-04-26T18:37:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.250+0000 7f66b775f640 1 -- 172.21.15.80:0/4228464202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66b0102220 msgr2=0x7f66b0198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:37:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.250+0000 7f66b775f640 1 --2- 172.21.15.80:0/4228464202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66b0102220 0x7f66b0198440 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f66a000ed90 tx=0x7f66a000c6a0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.250+0000 7f66b775f640 1 -- 172.21.15.80:0/4228464202 shutdown_connections 2024-04-26T18:37:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.250+0000 7f66b775f640 1 --2- 172.21.15.80:0/4228464202 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f669c0a3ff0 0x7f669c0a64b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.250+0000 7f66b775f640 1 --2- 172.21.15.80:0/4228464202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66b0102220 0x7f66b0198440 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.250+0000 7f66b775f640 1 --2- 172.21.15.80:0/4228464202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66b0198980 0x7f66b01a7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.250+0000 7f66b775f640 1 --2- 172.21.15.80:0/4228464202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66b0101860 0x7f66b0197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:37:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.250+0000 7f66b775f640 1 -- 172.21.15.80:0/4228464202 >> 172.21.15.80:0/4228464202 conn(0x7f66b00789b0 msgr2=0x7f66b01044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:37:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.250+0000 7f66b775f640 1 -- 172.21.15.80:0/4228464202 shutdown_connections 2024-04-26T18:37:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:37:49.250+0000 7f66b775f640 1 -- 172.21.15.80:0/4228464202 wait complete. 2024-04-26T18:37:49.795 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:49 smithi080 ceph-mon[29135]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-26T18:37:49.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:49 smithi192 ceph-mon[32842]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-26T18:37:49.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:49 smithi082 ceph-mon[32808]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-26T18:37:51.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:51 smithi192 ceph-mon[32842]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-04-26T18:37:51.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:51 smithi082 ceph-mon[32808]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-04-26T18:37:51.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:51 smithi080 ceph-mon[29135]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-04-26T18:37:53.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:53 smithi192 ceph-mon[32842]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:37:53.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:53 smithi082 ceph-mon[32808]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:37:53.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:53 smithi080 ceph-mon[29135]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:37:55.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:55 smithi192 ceph-mon[32842]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-26T18:37:55.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:55 smithi082 ceph-mon[32808]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-26T18:37:55.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:55 smithi080 ceph-mon[29135]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-26T18:37:57.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:57 smithi192 ceph-mon[32842]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-26T18:37:57.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:57 smithi082 ceph-mon[32808]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-26T18:37:57.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:57 smithi080 ceph-mon[29135]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-26T18:37:58.576 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:37:58.838 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:37:59.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:37:59 smithi192 ceph-mon[32842]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T18:37:59.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:37:59 smithi082 ceph-mon[32808]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T18:37:59.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:37:59 smithi080 ceph-mon[29135]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T18:38:00.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.770+0000 7f516a358700 1 -- 172.21.15.80:0/929754087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5164102ce0 msgr2=0x7f516410f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:00.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.770+0000 7f516a358700 1 --2- 172.21.15.80:0/929754087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5164102ce0 0x7f516410f1d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f515c00b0a0 tx=0x7f515c00b3b0 comp rx=0 tx=0).stop 2024-04-26T18:38:00.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.770+0000 7f516a358700 1 -- 172.21.15.80:0/929754087 shutdown_connections 2024-04-26T18:38:00.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.770+0000 7f516a358700 1 --2- 172.21.15.80:0/929754087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5164102ce0 0x7f516410f1d0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:00.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.770+0000 7f516a358700 1 --2- 172.21.15.80:0/929754087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5164108390 0x7f5164108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:00.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.770+0000 7f516a358700 1 --2- 172.21.15.80:0/929754087 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5164102320 0x7f51641027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:00.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.770+0000 7f516a358700 1 -- 172.21.15.80:0/929754087 >> 172.21.15.80:0/929754087 conn(0x7f51640792d0 msgr2=0x7f51640796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:00.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.770+0000 7f516a358700 1 -- 172.21.15.80:0/929754087 shutdown_connections 2024-04-26T18:38:00.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.770+0000 7f516a358700 1 -- 172.21.15.80:0/929754087 wait complete. 2024-04-26T18:38:00.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.771+0000 7f516a358700 1 Processor -- start 2024-04-26T18:38:00.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.771+0000 7f516a358700 1 -- start start 2024-04-26T18:38:00.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.772+0000 7f516a358700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5164102320 0x7f516419f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:00.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.772+0000 7f516a358700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5164102ce0 0x7f516419fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:00.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.772+0000 7f516a358700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5164108390 0x7f5164199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:00.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.772+0000 7f516a358700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f51641135f0 con 0x7f5164102320 2024-04-26T18:38:00.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.772+0000 7f516a358700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5164113470 con 0x7f5164108390 2024-04-26T18:38:00.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.772+0000 7f516a358700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5164113770 con 0x7f5164102ce0 2024-04-26T18:38:00.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.772+0000 7f5163fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5164102320 0x7f516419f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:00.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.772+0000 7f51688f5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5164108390 0x7f5164199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:00.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.772+0000 7f5163fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5164102320 0x7f516419f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47750/0 (socket says 172.21.15.80:47750) 2024-04-26T18:38:00.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.772+0000 7f5163fff700 1 -- 172.21.15.80:0/3536722538 learned_addr learned my addr 172.21.15.80:0/3536722538 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:00.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.772+0000 7f51637fe700 1 --2- 172.21.15.80:0/3536722538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5164102ce0 0x7f516419fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:00.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.773+0000 7f5163fff700 1 -- 172.21.15.80:0/3536722538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5164102ce0 msgr2=0x7f516419fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:00.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.773+0000 7f5163fff700 1 --2- 172.21.15.80:0/3536722538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5164102ce0 0x7f516419fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:00.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.773+0000 7f5163fff700 1 -- 172.21.15.80:0/3536722538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5164108390 msgr2=0x7f5164199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:00.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.773+0000 7f5163fff700 1 --2- 172.21.15.80:0/3536722538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5164108390 0x7f5164199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:00.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.773+0000 7f5163fff700 1 -- 172.21.15.80:0/3536722538 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5164199fd0 con 0x7f5164102320 2024-04-26T18:38:00.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.773+0000 7f5163fff700 1 --2- 172.21.15.80:0/3536722538 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5164102320 0x7f516419f6b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f515400d980 tx=0x7f515400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:00.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.773+0000 7f51617fa700 1 -- 172.21.15.80:0/3536722538 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5154016070 con 0x7f5164102320 2024-04-26T18:38:00.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.773+0000 7f51617fa700 1 -- 172.21.15.80:0/3536722538 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5154004830 con 0x7f5164102320 2024-04-26T18:38:00.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.773+0000 7f516a358700 1 -- 172.21.15.80:0/3536722538 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f516419a2c0 con 0x7f5164102320 2024-04-26T18:38:00.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.773+0000 7f516a358700 1 -- 172.21.15.80:0/3536722538 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51641a6580 con 0x7f5164102320 2024-04-26T18:38:00.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.773+0000 7f51617fa700 1 -- 172.21.15.80:0/3536722538 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5154005600 con 0x7f5164102320 2024-04-26T18:38:00.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.774+0000 7f516a358700 1 -- 172.21.15.80:0/3536722538 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f516406a110 con 0x7f5164102320 2024-04-26T18:38:00.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.776+0000 7f51617fa700 1 -- 172.21.15.80:0/3536722538 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f5154004220 con 0x7f5164102320 2024-04-26T18:38:00.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.777+0000 7f51617fa700 1 --2- 172.21.15.80:0/3536722538 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f514c0a3e30 0x7f514c0a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:00.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.778+0000 7f51637fe700 1 --2- 172.21.15.80:0/3536722538 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f514c0a3e30 0x7f514c0a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:00.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.777+0000 7f51617fa700 1 -- 172.21.15.80:0/3536722538 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f51540d08e0 con 0x7f5164102320 2024-04-26T18:38:00.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.778+0000 7f51637fe700 1 --2- 172.21.15.80:0/3536722538 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f514c0a3e30 0x7f514c0a62f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5164079860 tx=0x7f515800b410 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:00.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:00.781+0000 7f51617fa700 1 -- 172.21.15.80:0/3536722538 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f515401f020 con 0x7f5164102320 2024-04-26T18:38:01.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:01.046+0000 7f516a358700 1 -- 172.21.15.80:0/3536722538 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f516402e490 con 0x7f5164102320 2024-04-26T18:38:01.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:01.047+0000 7f51617fa700 1 -- 172.21.15.80:0/3536722538 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11918 (secure 0 0 0) 0x7f515409cfd0 con 0x7f5164102320 2024-04-26T18:38:01.048 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:38:01.048 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1967550873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1967550873},{"type":"v1","addr":"172.21.15.80:6835","nonce":1967550873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/559541830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":559541830},{"type":"v1","addr":"172.21.15.80:6837","nonce":559541830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T18:33:08.347399+0000","modified":"2024-04-26T18:36:26.401600+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24434,"mds_1":24421,"mds_2":24404,"mds_3":24400,"mds_4":24394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14577":{"gid":14577,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6839/2137993298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":2137993298},{"type":"v1","addr":"172.21.15.80:6839","nonce":2137993298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6841/1544670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1544670},{"type":"v1","addr":"172.21.15.80:6841","nonce":1544670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24371":{"gid":24371,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/3564539039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3564539039},{"type":"v1","addr":"172.21.15.82:6833","nonce":3564539039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24379":{"gid":24379,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/572065563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":572065563},{"type":"v1","addr":"172.21.15.82:6835","nonce":572065563}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.192:6835/719058020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":719058020},{"type":"v1","addr":"172.21.15.192:6835","nonce":719058020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.192:6837/2361996920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2361996920},{"type":"v1","addr":"172.21.15.192:6837","nonce":2361996920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.82:6837/2084055551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2084055551},{"type":"v1","addr":"172.21.15.82:6837","nonce":2084055551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6839/2735406056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":2735406056},{"type":"v1","addr":"172.21.15.192:6839","nonce":2735406056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.82:6839/1482576497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1482576497},{"type":"v1","addr":"172.21.15.82:6839","nonce":1482576497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24434,"qdb_cluster":[24421,24400,24394,24404,24434]},"id":1}]} 2024-04-26T18:38:01.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:01.050+0000 7f516a358700 1 -- 172.21.15.80:0/3536722538 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f514c0a3e30 msgr2=0x7f514c0a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:01.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:01.050+0000 7f516a358700 1 --2- 172.21.15.80:0/3536722538 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f514c0a3e30 0x7f514c0a62f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5164079860 tx=0x7f515800b410 comp rx=0 tx=0).stop 2024-04-26T18:38:01.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:01.050+0000 7f516a358700 1 -- 172.21.15.80:0/3536722538 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5164102320 msgr2=0x7f516419f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:01.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:01.050+0000 7f516a358700 1 --2- 172.21.15.80:0/3536722538 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5164102320 0x7f516419f6b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f515400d980 tx=0x7f515400dc90 comp rx=0 tx=0).stop 2024-04-26T18:38:01.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:01.050+0000 7f516a358700 1 -- 172.21.15.80:0/3536722538 shutdown_connections 2024-04-26T18:38:01.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:01.050+0000 7f516a358700 1 --2- 172.21.15.80:0/3536722538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5164108390 0x7f5164199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:01.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:01.050+0000 7f516a358700 1 --2- 172.21.15.80:0/3536722538 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5164102320 0x7f516419f6b0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:01.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:01.050+0000 7f516a358700 1 --2- 172.21.15.80:0/3536722538 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f514c0a3e30 0x7f514c0a62f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:01.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:01.050+0000 7f516a358700 1 --2- 172.21.15.80:0/3536722538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5164102ce0 0x7f516419fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:01.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:01.050+0000 7f516a358700 1 -- 172.21.15.80:0/3536722538 >> 172.21.15.80:0/3536722538 conn(0x7f51640792d0 msgr2=0x7f5164100e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:01.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:01.051+0000 7f516a358700 1 -- 172.21.15.80:0/3536722538 shutdown_connections 2024-04-26T18:38:01.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:01.051+0000 7f516a358700 1 -- 172.21.15.80:0/3536722538 wait complete. 2024-04-26T18:38:01.052 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 27 2024-04-26T18:38:01.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:01 smithi080 ceph-mon[29135]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 14 op/s 2024-04-26T18:38:01.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:01 smithi080 ceph-mon[29135]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-04-26T18:38:01.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:01 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3536722538' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:38:01.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:01 smithi192 ceph-mon[32842]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 14 op/s 2024-04-26T18:38:01.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:01 smithi192 ceph-mon[32842]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-04-26T18:38:01.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:01 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3536722538' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:38:01.864 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24434 quiesce db --set-id 577c7138 --release --await' 2024-04-26T18:38:01.864 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24434 quiesce db --set-id 577c7138 --release --await 2024-04-26T18:38:01.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:01 smithi082 ceph-mon[32808]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 14 op/s 2024-04-26T18:38:01.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:01 smithi082 ceph-mon[32808]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-04-26T18:38:01.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:01 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3536722538' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:38:02.239 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:38:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.372+0000 7fdad0274640 1 -- 172.21.15.80:0/3485859153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdac810cf40 msgr2=0x7fdac810f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.372+0000 7fdad0274640 1 --2- 172.21.15.80:0/3485859153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdac810cf40 0x7fdac810f390 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdac4009900 tx=0x7fdac402a480 comp rx=0 tx=0).stop 2024-04-26T18:38:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.372+0000 7fdad0274640 1 -- 172.21.15.80:0/3485859153 shutdown_connections 2024-04-26T18:38:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.372+0000 7fdad0274640 1 --2- 172.21.15.80:0/3485859153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdac810cf40 0x7fdac810f390 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.372+0000 7fdad0274640 1 --2- 172.21.15.80:0/3485859153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdac8104520 0x7fdac810ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.372+0000 7fdad0274640 1 --2- 172.21.15.80:0/3485859153 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdac8103c00 0x7fdac8103fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.372+0000 7fdad0274640 1 -- 172.21.15.80:0/3485859153 >> 172.21.15.80:0/3485859153 conn(0x7fdac80789b0 msgr2=0x7fdac8078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.372+0000 7fdad0274640 1 -- 172.21.15.80:0/3485859153 shutdown_connections 2024-04-26T18:38:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.372+0000 7fdad0274640 1 -- 172.21.15.80:0/3485859153 wait complete. 2024-04-26T18:38:02.375 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.373+0000 7fdad0274640 1 Processor -- start 2024-04-26T18:38:02.375 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.373+0000 7fdad0274640 1 -- start start 2024-04-26T18:38:02.375 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.373+0000 7fdad0274640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdac8103c00 0x7fdac8198ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:02.375 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.373+0000 7fdad0274640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdac8104520 0x7fdac8199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:02.375 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.373+0000 7fdad0274640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdac810cf40 0x7fdac819d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:02.375 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.373+0000 7fdad0274640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdac8112bf0 con 0x7fdac8103c00 2024-04-26T18:38:02.375 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.373+0000 7fdad0274640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdac8112a70 con 0x7fdac8104520 2024-04-26T18:38:02.375 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.373+0000 7fdad0274640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdac8112d70 con 0x7fdac810cf40 2024-04-26T18:38:02.375 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.373+0000 7fdace010640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdac8103c00 0x7fdac8198ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:02.375 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.373+0000 7fdace010640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdac8103c00 0x7fdac8198ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47770/0 (socket says 172.21.15.80:47770) 2024-04-26T18:38:02.376 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.373+0000 7fdace010640 1 -- 172.21.15.80:0/3065443397 learned_addr learned my addr 172.21.15.80:0/3065443397 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:02.376 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.374+0000 7fdacd80f640 1 --2- 172.21.15.80:0/3065443397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdac8104520 0x7fdac8199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:02.376 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.374+0000 7fdace811640 1 --2- 172.21.15.80:0/3065443397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdac810cf40 0x7fdac819d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:02.376 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.374+0000 7fdace010640 1 -- 172.21.15.80:0/3065443397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdac810cf40 msgr2=0x7fdac819d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:02.376 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.374+0000 7fdace010640 1 --2- 172.21.15.80:0/3065443397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdac810cf40 0x7fdac819d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.376 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.374+0000 7fdace010640 1 -- 172.21.15.80:0/3065443397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdac8104520 msgr2=0x7fdac8199530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:02.376 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.374+0000 7fdace010640 1 --2- 172.21.15.80:0/3065443397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdac8104520 0x7fdac8199530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.376 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.374+0000 7fdace010640 1 -- 172.21.15.80:0/3065443397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac819dfe0 con 0x7fdac8103c00 2024-04-26T18:38:02.376 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.374+0000 7fdacd80f640 1 --2- 172.21.15.80:0/3065443397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdac8104520 0x7fdac8199530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:38:02.376 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.374+0000 7fdace010640 1 --2- 172.21.15.80:0/3065443397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdac8103c00 0x7fdac8198ff0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fdac000eb90 tx=0x7fdac000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:02.376 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.374+0000 7fdabf7fe640 1 -- 172.21.15.80:0/3065443397 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac0004d20 con 0x7fdac8103c00 2024-04-26T18:38:02.376 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.374+0000 7fdabf7fe640 1 -- 172.21.15.80:0/3065443397 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdac000ee90 con 0x7fdac8103c00 2024-04-26T18:38:02.376 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.374+0000 7fdabf7fe640 1 -- 172.21.15.80:0/3065443397 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac0010670 con 0x7fdac8103c00 2024-04-26T18:38:02.376 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.374+0000 7fdad0274640 1 -- 172.21.15.80:0/3065443397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdac819e2d0 con 0x7fdac8103c00 2024-04-26T18:38:02.377 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.374+0000 7fdad0274640 1 -- 172.21.15.80:0/3065443397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdac8101780 con 0x7fdac8103c00 2024-04-26T18:38:02.377 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.377+0000 7fdad2f8b740 1 Processor -- start 2024-04-26T18:38:02.378 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.377+0000 7fdad2f8b740 1 -- start start 2024-04-26T18:38:02.378 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.377+0000 7fdad2f8b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3458f00 0x557ad34592e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:02.378 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.377+0000 7fdad2f8b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ad3459820 0x557ad3463ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:02.378 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.377+0000 7fdad2f8b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557ad34640e0 0x557ad34664d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:02.378 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.377+0000 7fdad2f8b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x557ad33bf460 con 0x557ad3458f00 2024-04-26T18:38:02.378 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.377+0000 7fdad2f8b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557ad3379590 con 0x557ad3459820 2024-04-26T18:38:02.378 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.377+0000 7fdad2f8b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x557ad33bb420 con 0x557ad34640e0 2024-04-26T18:38:02.378 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.378+0000 7fdace811640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3458f00 0x557ad34592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:02.378 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.378+0000 7fdace811640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3458f00 0x557ad34592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47780/0 (socket says 172.21.15.80:47780) 2024-04-26T18:38:02.378 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.378+0000 7fdace811640 1 -- 172.21.15.80:0/2734119659 learned_addr learned my addr 172.21.15.80:0/2734119659 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:02.378 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.378+0000 7fdabf7fe640 1 -- 172.21.15.80:0/3065443397 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fdac0005020 con 0x7fdac8103c00 2024-04-26T18:38:02.378 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.378+0000 7fdacd80f640 1 --2- 172.21.15.80:0/2734119659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557ad34640e0 0x557ad34664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:02.380 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.378+0000 7fdace010640 1 --2- 172.21.15.80:0/2734119659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ad3459820 0x557ad3463ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:02.380 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.378+0000 7fdace811640 1 -- 172.21.15.80:0/2734119659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557ad34640e0 msgr2=0x557ad34664d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:02.380 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.378+0000 7fdace811640 1 --2- 172.21.15.80:0/2734119659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557ad34640e0 0x557ad34664d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.380 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.378+0000 7fdace811640 1 -- 172.21.15.80:0/2734119659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ad3459820 msgr2=0x557ad3463ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:02.380 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.378+0000 7fdace811640 1 --2- 172.21.15.80:0/2734119659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ad3459820 0x557ad3463ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.380 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.378+0000 7fdace811640 1 -- 172.21.15.80:0/2734119659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ad33860d0 con 0x557ad3458f00 2024-04-26T18:38:02.380 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.378+0000 7fdace010640 1 --2- 172.21.15.80:0/2734119659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ad3459820 0x557ad3463ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:38:02.380 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.378+0000 7fdace811640 1 --2- 172.21.15.80:0/2734119659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3458f00 0x557ad34592e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fdac4009900 tx=0x7fdac4009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae7c2b39fa330f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:02.381 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.379+0000 7fdabcbfe640 1 -- 172.21.15.80:0/2734119659 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac4035030 con 0x557ad3458f00 2024-04-26T18:38:02.381 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.379+0000 7fdabf7fe640 1 --2- 172.21.15.80:0/3065443397 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fdab40a3dc0 0x7fdab40a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:02.381 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.379+0000 7fdabcbfe640 1 -- 172.21.15.80:0/2734119659 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdac4004450 con 0x557ad3458f00 2024-04-26T18:38:02.381 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.379+0000 7fdabcbfe640 1 -- 172.21.15.80:0/2734119659 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac40035f0 con 0x557ad3458f00 2024-04-26T18:38:02.381 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.379+0000 7fdace010640 1 --2- 172.21.15.80:0/3065443397 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fdab40a3dc0 0x7fdab40a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:02.381 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.379+0000 7fdabf7fe640 1 -- 172.21.15.80:0/3065443397 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fdac00d0f20 con 0x7fdac8103c00 2024-04-26T18:38:02.381 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.379+0000 7fdad2f8b740 1 -- 172.21.15.80:0/2734119659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3458f00 msgr2=0x557ad34592e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:02.381 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.379+0000 7fdad2f8b740 1 --2- 172.21.15.80:0/2734119659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3458f00 0x557ad34592e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fdac4009900 tx=0x7fdac4009680 comp rx=0 tx=0).stop 2024-04-26T18:38:02.381 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.379+0000 7fdace010640 1 --2- 172.21.15.80:0/3065443397 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fdab40a3dc0 0x7fdab40a6280 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdac00ce770 tx=0x7fdac000cf90 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:02.381 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.380+0000 7fdad2f8b740 1 -- 172.21.15.80:0/2734119659 shutdown_connections 2024-04-26T18:38:02.381 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.380+0000 7fdad2f8b740 1 --2- 172.21.15.80:0/2734119659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557ad34640e0 0x557ad34664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.381 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.380+0000 7fdad2f8b740 1 --2- 172.21.15.80:0/2734119659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ad3459820 0x557ad3463ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.381 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.380+0000 7fdad2f8b740 1 --2- 172.21.15.80:0/2734119659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3458f00 0x557ad34592e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.382 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.380+0000 7fdad2f8b740 1 -- 172.21.15.80:0/2734119659 >> 172.21.15.80:0/2734119659 conn(0x557ad3455410 msgr2=0x557ad34557f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:02.382 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.380+0000 7fdad2f8b740 1 -- 172.21.15.80:0/2734119659 shutdown_connections 2024-04-26T18:38:02.382 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.380+0000 7fdad2f8b740 1 -- 172.21.15.80:0/2734119659 wait complete. 2024-04-26T18:38:02.382 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.380+0000 7fdad2f8b740 1 -- start start 2024-04-26T18:38:02.382 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.380+0000 7fdad2f8b740 1 Processor -- start 2024-04-26T18:38:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.381+0000 7fdad2f8b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ad3458f00 0x557ad3461130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.381+0000 7fdad2f8b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3459820 0x557ad3461670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.381+0000 7fdad2f8b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557ad34640e0 0x557ad3461bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.381+0000 7fdad2f8b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x557ad3466cb0 con 0x557ad3459820 2024-04-26T18:38:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.381+0000 7fdad2f8b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557ad3346b60 con 0x557ad3458f00 2024-04-26T18:38:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.381+0000 7fdad2f8b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x557ad3466e30 con 0x557ad34640e0 2024-04-26T18:38:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.381+0000 7fdad2f8b740 10 client.0 _ll_register_callbacks cb 0x557ad336b2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:38:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.381+0000 7fdacd80f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3459820 0x557ad3461670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.381+0000 7fdacd80f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3459820 0x557ad3461670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47788/0 (socket says 172.21.15.80:47788) 2024-04-26T18:38:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.381+0000 7fdacd80f640 1 -- 172.21.15.80:0/1795399608 learned_addr learned my addr 172.21.15.80:0/1795399608 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.381+0000 7fdace811640 1 --2- 172.21.15.80:0/1795399608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557ad34640e0 0x557ad3461bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.381+0000 7fdace811640 1 --2- 172.21.15.80:0/1795399608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ad3458f00 0x557ad3461130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.381+0000 7fdacd80f640 1 -- 172.21.15.80:0/1795399608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557ad34640e0 msgr2=0x557ad3461bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.381+0000 7fdacd80f640 1 --2- 172.21.15.80:0/1795399608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557ad34640e0 0x557ad3461bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.381+0000 7fdacd80f640 1 -- 172.21.15.80:0/1795399608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ad3458f00 msgr2=0x557ad3461130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.381+0000 7fdacd80f640 1 --2- 172.21.15.80:0/1795399608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ad3458f00 0x557ad3461130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.381+0000 7fdacd80f640 1 -- 172.21.15.80:0/1795399608 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ad30d1210 con 0x557ad3459820 2024-04-26T18:38:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.381+0000 7fdace811640 1 --2- 172.21.15.80:0/1795399608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557ad34640e0 0x557ad3461bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:38:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.381+0000 7fdacd80f640 1 --2- 172.21.15.80:0/1795399608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3459820 0x557ad3461670 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdab800bf40 tx=0x7fdab80128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f29e5f1eac77e551 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.381+0000 7fdab1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:38:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.382+0000 7fdab1ffb640 1 -- 172.21.15.80:0/1795399608 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab80035f0 con 0x557ad3459820 2024-04-26T18:38:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.382+0000 7fdad2f8b740 1 -- 172.21.15.80:0/1795399608 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdac4004450 con 0x557ad3459820 2024-04-26T18:38:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.382+0000 7fdab1ffb640 1 -- 172.21.15.80:0/1795399608 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fdab8003790 con 0x557ad3459820 2024-04-26T18:38:02.387 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.382+0000 7fdab1ffb640 1 -- 172.21.15.80:0/1795399608 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdab8003990 con 0x557ad3459820 2024-04-26T18:38:02.387 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.382+0000 7fdad2f8b740 10 client.15585 fetch_fsmap learned FSMap version 27 2024-04-26T18:38:02.387 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.382+0000 7fdad2f8b740 1 -- 172.21.15.80:0/1795399608 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557ad319d620 con 0x557ad3459820 2024-04-26T18:38:02.387 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.382+0000 7fdab1ffb640 1 -- 172.21.15.80:0/1795399608 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdac4004450 con 0x557ad3459820 2024-04-26T18:38:02.387 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.382+0000 7fdab1ffb640 1 -- 172.21.15.80:0/1795399608 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fdab8019070 con 0x557ad3459820 2024-04-26T18:38:02.387 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.382+0000 7fdad2f8b740 10 client.15585 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:38:02.387 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.382+0000 7fdad2f8b740 10 client.15585 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:38:02.387 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.382+0000 7fdad2f8b740 20 client.15585 populate_metadata read hostname 'smithi080' 2024-04-26T18:38:02.387 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.382+0000 7fdad2f8b740 1 --2- 172.21.15.80:0/1795399608 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x557ad3474250 0x557ad3476680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:02.387 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.382+0000 7fdad2f8b740 4 client.15585 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:38:02.387 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.382+0000 7fdad2f8b740 1 -- 172.21.15.80:0/1795399608 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ad33cd070 con 0x557ad3474250 2024-04-26T18:38:02.387 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.383+0000 7fdace811640 1 --2- 172.21.15.80:0/1795399608 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x557ad3474250 0x557ad3476680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:02.387 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.383+0000 7fdab1ffb640 10 client.15585 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:02.387 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.383+0000 7fdace811640 1 --2- 172.21.15.80:0/1795399608 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x557ad3474250 0x557ad3476680 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b068df82a8c974d server_cookie=6cff2cd115b39f76 in_seq=0 out_seq=0 2024-04-26T18:38:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.384+0000 7fdab1ffb640 1 -- 172.21.15.80:0/1795399608 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557ad33cd070 con 0x557ad3474250 2024-04-26T18:38:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.384+0000 7fdab1ffb640 10 client.15585 handle_command_reply: tid=0 2024-04-26T18:38:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.384+0000 7fdad2f8b740 1 client.15585 shutdown 2024-04-26T18:38:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.384+0000 7fdad2f8b740 1 -- 172.21.15.80:0/1795399608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3459820 msgr2=0x557ad3461670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.384+0000 7fdad2f8b740 1 --2- 172.21.15.80:0/1795399608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3459820 0x557ad3461670 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdab800bf40 tx=0x7fdab80128e0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.384+0000 7fdad2f8b740 1 -- 172.21.15.80:0/1795399608 shutdown_connections 2024-04-26T18:38:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.384+0000 7fdad2f8b740 1 --2- 172.21.15.80:0/1795399608 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x557ad3474250 0x557ad3476680 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.384+0000 7fdab1ffb640 0 client.15585 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.384+0000 7fdad2f8b740 1 --2- 172.21.15.80:0/1795399608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3459820 0x557ad3461670 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.384+0000 7fdad2f8b740 1 --2- 172.21.15.80:0/1795399608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557ad34640e0 0x557ad3461bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.384+0000 7fdad2f8b740 1 --2- 172.21.15.80:0/1795399608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ad3458f00 0x557ad3461130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.384+0000 7fdad2f8b740 1 -- 172.21.15.80:0/1795399608 >> 172.21.15.80:0/1795399608 conn(0x557ad3455410 msgr2=0x557ad345b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.384+0000 7fdad2f8b740 1 -- 172.21.15.80:0/1795399608 shutdown_connections 2024-04-26T18:38:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.384+0000 7fdad2f8b740 1 -- 172.21.15.80:0/1795399608 wait complete. 2024-04-26T18:38:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.384+0000 7fdad2f8b740 20 client.15585 trim_cache size 0 max 16384 2024-04-26T18:38:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.399+0000 7fdad2f8b740 1 Processor -- start 2024-04-26T18:38:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.399+0000 7fdad2f8b740 1 -- start start 2024-04-26T18:38:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.399+0000 7fdad2f8b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ad3458f00 0x557ad346fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.399+0000 7fdad2f8b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3459820 0x557ad3461980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.399+0000 7fdad2f8b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557ad34640e0 0x557ad345b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.399+0000 7fdad2f8b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdac81b4950 con 0x557ad3459820 2024-04-26T18:38:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.399+0000 7fdad2f8b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdac81b6490 con 0x557ad3458f00 2024-04-26T18:38:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.399+0000 7fdad2f8b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdac81b5020 con 0x557ad34640e0 2024-04-26T18:38:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.399+0000 7fdacd80f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3459820 0x557ad3461980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.399+0000 7fdacd80f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3459820 0x557ad3461980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47794/0 (socket says 172.21.15.80:47794) 2024-04-26T18:38:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.399+0000 7fdacd80f640 1 -- 172.21.15.80:0/4257255565 learned_addr learned my addr 172.21.15.80:0/4257255565 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.399+0000 7fdace811640 1 --2- 172.21.15.80:0/4257255565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ad3458f00 0x557ad346fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.399+0000 7fdace811640 1 --2- 172.21.15.80:0/4257255565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557ad34640e0 0x557ad345b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.400+0000 7fdacd80f640 1 -- 172.21.15.80:0/4257255565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557ad34640e0 msgr2=0x557ad345b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.400+0000 7fdacd80f640 1 --2- 172.21.15.80:0/4257255565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557ad34640e0 0x557ad345b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.400+0000 7fdacd80f640 1 -- 172.21.15.80:0/4257255565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ad3458f00 msgr2=0x557ad346fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.400+0000 7fdacd80f640 1 --2- 172.21.15.80:0/4257255565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ad3458f00 0x557ad346fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.400+0000 7fdacd80f640 1 -- 172.21.15.80:0/4257255565 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ad34600d0 con 0x557ad3459820 2024-04-26T18:38:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.400+0000 7fdace811640 1 --2- 172.21.15.80:0/4257255565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557ad34640e0 0x557ad345b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:38:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.400+0000 7fdacd80f640 1 --2- 172.21.15.80:0/4257255565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3459820 0x557ad3461980 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdab8000c00 tx=0x7fdab8013f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b69f06f82deb65 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.400+0000 7fdab3fff640 1 -- 172.21.15.80:0/4257255565 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab8030070 con 0x557ad3459820 2024-04-26T18:38:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.400+0000 7fdab3fff640 1 -- 172.21.15.80:0/4257255565 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdab8004300 con 0x557ad3459820 2024-04-26T18:38:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.400+0000 7fdab3fff640 1 -- 172.21.15.80:0/4257255565 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab8028070 con 0x557ad3459820 2024-04-26T18:38:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.401+0000 7fdad2f8b740 1 -- 172.21.15.80:0/4257255565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3459820 msgr2=0x557ad3461980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.401+0000 7fdad2f8b740 1 --2- 172.21.15.80:0/4257255565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3459820 0x557ad3461980 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdab8000c00 tx=0x7fdab8013f80 comp rx=0 tx=0).stop 2024-04-26T18:38:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.401+0000 7fdad2f8b740 1 -- 172.21.15.80:0/4257255565 shutdown_connections 2024-04-26T18:38:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.401+0000 7fdad2f8b740 1 --2- 172.21.15.80:0/4257255565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3459820 0x557ad3461980 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.401+0000 7fdad2f8b740 1 --2- 172.21.15.80:0/4257255565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557ad34640e0 0x557ad345b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.401+0000 7fdad2f8b740 1 --2- 172.21.15.80:0/4257255565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ad3458f00 0x557ad346fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.401+0000 7fdad2f8b740 1 -- 172.21.15.80:0/4257255565 >> 172.21.15.80:0/4257255565 conn(0x557ad3455410 msgr2=0x557ad3462960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.401+0000 7fdad2f8b740 1 -- 172.21.15.80:0/4257255565 shutdown_connections 2024-04-26T18:38:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.401+0000 7fdad2f8b740 1 -- 172.21.15.80:0/4257255565 wait complete. 2024-04-26T18:38:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.402+0000 7fdad2f8b740 1 -- start start 2024-04-26T18:38:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.402+0000 7fdad2f8b740 1 Processor -- start 2024-04-26T18:38:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.402+0000 7fdad2f8b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3458f00 0x557ad345e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.402+0000 7fdad2f8b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ad3459820 0x557ad345e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.402+0000 7fdad2f8b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557ad34640e0 0x557ad34d9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.402+0000 7fdace811640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3458f00 0x557ad345e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.402+0000 7fdace811640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3458f00 0x557ad345e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47808/0 (socket says 172.21.15.80:47808) 2024-04-26T18:38:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.402+0000 7fdace811640 1 -- 172.21.15.80:0/3798336090 learned_addr learned my addr 172.21.15.80:0/3798336090 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.402+0000 7fdad2f8b740 1 -- 172.21.15.80:0/3798336090 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdac81b5dc0 con 0x557ad3458f00 2024-04-26T18:38:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.402+0000 7fdad2f8b740 1 -- 172.21.15.80:0/3798336090 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdac81b56f0 con 0x557ad3459820 2024-04-26T18:38:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.402+0000 7fdad2f8b740 1 -- 172.21.15.80:0/3798336090 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdac81b2950 con 0x557ad34640e0 2024-04-26T18:38:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.402+0000 7fdad2f8b740 10 client.0 _ll_register_callbacks cb 0x7fdab800bb80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:38:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.402+0000 7fdacd80f640 1 --2- 172.21.15.80:0/3798336090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ad3459820 0x557ad345e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.402+0000 7fdace811640 1 --2- 172.21.15.80:0/3798336090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557ad34640e0 0x557ad34d9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.403+0000 7fdace811640 1 -- 172.21.15.80:0/3798336090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557ad34640e0 msgr2=0x557ad34d9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.403+0000 7fdace811640 1 --2- 172.21.15.80:0/3798336090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557ad34640e0 0x557ad34d9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.403+0000 7fdace811640 1 -- 172.21.15.80:0/3798336090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ad3459820 msgr2=0x557ad345e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.403+0000 7fdace811640 1 --2- 172.21.15.80:0/3798336090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ad3459820 0x557ad345e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.403+0000 7fdace811640 1 -- 172.21.15.80:0/3798336090 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ad345efe0 con 0x557ad3458f00 2024-04-26T18:38:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.403+0000 7fdace811640 1 --2- 172.21.15.80:0/3798336090 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3458f00 0x557ad345e1d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdac402aa70 tx=0x7fdac4005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f064fd7aaaeabda1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.403+0000 7fdab1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:38:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.403+0000 7fdab1ffb640 1 -- 172.21.15.80:0/3798336090 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac4035040 con 0x557ad3458f00 2024-04-26T18:38:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.403+0000 7fdab1ffb640 1 -- 172.21.15.80:0/3798336090 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fdac4005140 con 0x557ad3458f00 2024-04-26T18:38:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.403+0000 7fdad2f8b740 1 -- 172.21.15.80:0/3798336090 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdab8004300 con 0x557ad3458f00 2024-04-26T18:38:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.404+0000 7fdab1ffb640 1 -- 172.21.15.80:0/3798336090 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdac4005340 con 0x557ad3458f00 2024-04-26T18:38:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.404+0000 7fdad2f8b740 10 client.15591 fetch_fsmap learned FSMap version 27 2024-04-26T18:38:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.404+0000 7fdad2f8b740 1 -- 172.21.15.80:0/3798336090 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557ad34dae50 con 0x557ad3458f00 2024-04-26T18:38:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.404+0000 7fdab1ffb640 1 -- 172.21.15.80:0/3798336090 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdab8004300 con 0x557ad3458f00 2024-04-26T18:38:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.404+0000 7fdab1ffb640 1 -- 172.21.15.80:0/3798336090 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fdac4051040 con 0x557ad3458f00 2024-04-26T18:38:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.404+0000 7fdad2f8b740 10 client.15591 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:38:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.404+0000 7fdad2f8b740 10 client.15591 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:38:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.404+0000 7fdad2f8b740 20 client.15591 populate_metadata read hostname 'smithi080' 2024-04-26T18:38:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.404+0000 7fdad2f8b740 1 --2- 172.21.15.80:0/3798336090 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x557ad34db190 0x557ad34dd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.404+0000 7fdad2f8b740 4 client.15591 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:38:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.404+0000 7fdad2f8b740 1 -- 172.21.15.80:0/3798336090 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557ad33c6ee0 con 0x557ad34db190 2024-04-26T18:38:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.405+0000 7fdacd80f640 1 --2- 172.21.15.80:0/3798336090 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x557ad34db190 0x557ad34dd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.405+0000 7fdacd80f640 1 --2- 172.21.15.80:0/3798336090 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x557ad34db190 0x557ad34dd580 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ee5dc920e532862 server_cookie=c3f762e23d1f94d4 in_seq=0 out_seq=0 2024-04-26T18:38:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.405+0000 7fdab1ffb640 10 client.15591 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.411+0000 7fdab1ffb640 1 -- 172.21.15.80:0/3798336090 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557ad33c6ee0 con 0x557ad34db190 2024-04-26T18:38:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.412+0000 7fdab1ffb640 10 client.15591 handle_command_reply: tid=0 2024-04-26T18:38:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.412+0000 7fdad2f8b740 1 client.15591 shutdown 2024-04-26T18:38:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.412+0000 7fdad2f8b740 1 -- 172.21.15.80:0/3798336090 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3458f00 msgr2=0x557ad345e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.412+0000 7fdad2f8b740 1 --2- 172.21.15.80:0/3798336090 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3458f00 0x557ad345e1d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdac402aa70 tx=0x7fdac4005b50 comp rx=0 tx=0).stop 2024-04-26T18:38:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.412+0000 7fdad2f8b740 1 -- 172.21.15.80:0/3798336090 shutdown_connections 2024-04-26T18:38:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.412+0000 7fdad2f8b740 1 --2- 172.21.15.80:0/3798336090 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x557ad34db190 0x557ad34dd580 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.412+0000 7fdad2f8b740 1 --2- 172.21.15.80:0/3798336090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557ad34640e0 0x557ad34d9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.412+0000 7fdad2f8b740 1 --2- 172.21.15.80:0/3798336090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ad3459820 0x557ad345e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.412+0000 7fdad2f8b740 1 --2- 172.21.15.80:0/3798336090 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x557ad3458f00 0x557ad345e1d0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.412+0000 7fdad2f8b740 1 -- 172.21.15.80:0/3798336090 >> 172.21.15.80:0/3798336090 conn(0x557ad3455410 msgr2=0x557ad3462960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.412+0000 7fdab1ffb640 0 client.15591 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.412+0000 7fdad2f8b740 1 -- 172.21.15.80:0/3798336090 shutdown_connections 2024-04-26T18:38:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.412+0000 7fdad2f8b740 1 -- 172.21.15.80:0/3798336090 wait complete. 2024-04-26T18:38:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.412+0000 7fdad2f8b740 20 client.15591 trim_cache size 0 max 16384 2024-04-26T18:38:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:{ 2024-04-26T18:38:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "message": "", 2024-04-26T18:38:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "return_code": 0 2024-04-26T18:38:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:} 2024-04-26T18:38:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.413+0000 7fdad0274640 1 -- 172.21.15.80:0/3065443397 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fdab40a3dc0 msgr2=0x7fdab40a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.413+0000 7fdad0274640 1 --2- 172.21.15.80:0/3065443397 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fdab40a3dc0 0x7fdab40a6280 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdac00ce770 tx=0x7fdac000cf90 comp rx=0 tx=0).stop 2024-04-26T18:38:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.413+0000 7fdad0274640 1 -- 172.21.15.80:0/3065443397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdac8103c00 msgr2=0x7fdac8198ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.413+0000 7fdad0274640 1 --2- 172.21.15.80:0/3065443397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdac8103c00 0x7fdac8198ff0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fdac000eb90 tx=0x7fdac000c6a0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.413+0000 7fdad0274640 1 -- 172.21.15.80:0/3065443397 shutdown_connections 2024-04-26T18:38:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.413+0000 7fdad0274640 1 --2- 172.21.15.80:0/3065443397 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fdab40a3dc0 0x7fdab40a6280 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.413+0000 7fdad0274640 1 --2- 172.21.15.80:0/3065443397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdac810cf40 0x7fdac819d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.413+0000 7fdad0274640 1 --2- 172.21.15.80:0/3065443397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdac8104520 0x7fdac8199530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.413+0000 7fdad0274640 1 --2- 172.21.15.80:0/3065443397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdac8103c00 0x7fdac8198ff0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.413+0000 7fdad0274640 1 -- 172.21.15.80:0/3065443397 >> 172.21.15.80:0/3065443397 conn(0x7fdac80789b0 msgr2=0x7fdac80fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.413+0000 7fdad0274640 1 -- 172.21.15.80:0/3065443397 shutdown_connections 2024-04-26T18:38:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:02.414+0000 7fdad0274640 1 -- 172.21.15.80:0/3065443397 wait complete. 2024-04-26T18:38:03.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:03 smithi080 ceph-mon[29135]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-04-26T18:38:03.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:03 smithi192 ceph-mon[32842]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-04-26T18:38:03.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:03 smithi082 ceph-mon[32808]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-04-26T18:38:04.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.201+0000 7f6154955700 1 -- 172.21.15.80:0/527979311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6150108390 msgr2=0x7f6150108770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:04.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.201+0000 7f6154955700 1 --2- 172.21.15.80:0/527979311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6150108390 0x7f6150108770 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6140009990 tx=0x7f6140009ca0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.201+0000 7f6154955700 1 -- 172.21.15.80:0/527979311 shutdown_connections 2024-04-26T18:38:04.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.201+0000 7f6154955700 1 --2- 172.21.15.80:0/527979311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6150102ce0 0x7f615010f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.201+0000 7f6154955700 1 --2- 172.21.15.80:0/527979311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6150108390 0x7f6150108770 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.201+0000 7f6154955700 1 --2- 172.21.15.80:0/527979311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6150102320 0x7f61501027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.201+0000 7f6154955700 1 -- 172.21.15.80:0/527979311 >> 172.21.15.80:0/527979311 conn(0x7f61500792d0 msgr2=0x7f61500796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:04.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.201+0000 7f6154955700 1 -- 172.21.15.80:0/527979311 shutdown_connections 2024-04-26T18:38:04.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.201+0000 7f6154955700 1 -- 172.21.15.80:0/527979311 wait complete. 2024-04-26T18:38:04.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.202+0000 7f6154955700 1 Processor -- start 2024-04-26T18:38:04.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.202+0000 7f6154955700 1 -- start start 2024-04-26T18:38:04.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.203+0000 7f6154955700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6150102320 0x7f61501986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:04.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.203+0000 7f6154955700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6150102ce0 0x7f6150198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:04.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.203+0000 7f6154955700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6150108390 0x7f6150199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:04.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.203+0000 7f614dd9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6150102ce0 0x7f6150198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:04.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.203+0000 7f614dd9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6150102ce0 0x7f6150198c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40668/0 (socket says 172.21.15.80:40668) 2024-04-26T18:38:04.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.203+0000 7f614dd9b700 1 -- 172.21.15.80:0/1909662742 learned_addr learned my addr 172.21.15.80:0/1909662742 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:04.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.203+0000 7f6154955700 1 -- 172.21.15.80:0/1909662742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f61501124e0 con 0x7f6150102ce0 2024-04-26T18:38:04.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.203+0000 7f6154955700 1 -- 172.21.15.80:0/1909662742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6150112360 con 0x7f6150108390 2024-04-26T18:38:04.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.203+0000 7f6154955700 1 -- 172.21.15.80:0/1909662742 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6150112660 con 0x7f6150102320 2024-04-26T18:38:04.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.203+0000 7f614ed9d700 1 --2- 172.21.15.80:0/1909662742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6150108390 0x7f6150199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:04.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.203+0000 7f614e59c700 1 --2- 172.21.15.80:0/1909662742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6150102320 0x7f61501986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:04.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.203+0000 7f614dd9b700 1 -- 172.21.15.80:0/1909662742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6150102320 msgr2=0x7f61501986f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:04.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.203+0000 7f614dd9b700 1 --2- 172.21.15.80:0/1909662742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6150102320 0x7f61501986f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.203+0000 7f614dd9b700 1 -- 172.21.15.80:0/1909662742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6150108390 msgr2=0x7f6150199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:04.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.203+0000 7f614dd9b700 1 --2- 172.21.15.80:0/1909662742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6150108390 0x7f6150199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.203+0000 7f614dd9b700 1 -- 172.21.15.80:0/1909662742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61501a7ff0 con 0x7f6150102ce0 2024-04-26T18:38:04.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.204+0000 7f614e59c700 1 --2- 172.21.15.80:0/1909662742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6150102320 0x7f61501986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:38:04.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.204+0000 7f614dd9b700 1 --2- 172.21.15.80:0/1909662742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6150102ce0 0x7f6150198c30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f614400d980 tx=0x7f614400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:04.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.204+0000 7f613f7fe700 1 -- 172.21.15.80:0/1909662742 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6144016070 con 0x7f6150102ce0 2024-04-26T18:38:04.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.204+0000 7f6154955700 1 -- 172.21.15.80:0/1909662742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61501a82e0 con 0x7f6150102ce0 2024-04-26T18:38:04.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.204+0000 7f613f7fe700 1 -- 172.21.15.80:0/1909662742 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6144004830 con 0x7f6150102ce0 2024-04-26T18:38:04.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.204+0000 7f613f7fe700 1 -- 172.21.15.80:0/1909662742 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61440054c0 con 0x7f6150102ce0 2024-04-26T18:38:04.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.204+0000 7f6154955700 1 -- 172.21.15.80:0/1909662742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61501a87b0 con 0x7f6150102ce0 2024-04-26T18:38:04.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.208+0000 7f613f7fe700 1 -- 172.21.15.80:0/1909662742 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f614400b750 con 0x7f6150102ce0 2024-04-26T18:38:04.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.209+0000 7f613f7fe700 1 --2- 172.21.15.80:0/1909662742 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f61380a3e30 0x7f61380a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:04.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.209+0000 7f613f7fe700 1 -- 172.21.15.80:0/1909662742 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f61440d0520 con 0x7f6150102ce0 2024-04-26T18:38:04.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.209+0000 7f615f1e7b80 1 Processor -- start 2024-04-26T18:38:04.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.209+0000 7f614e59c700 1 --2- 172.21.15.80:0/1909662742 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f61380a3e30 0x7f61380a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.209+0000 7f615f1e7b80 1 -- start start 2024-04-26T18:38:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.209+0000 7f615f1e7b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d1f8ae1a0 0x564d1f8ae580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.209+0000 7f615f1e7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8aeac0 0x564d1f8c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.209+0000 7f615f1e7b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d1f8c2180 0x564d1f8c4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.210+0000 7f615f1e7b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x564d1f801840 con 0x564d1f8ae1a0 2024-04-26T18:38:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.210+0000 7f615f1e7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564d1f7a06e0 con 0x564d1f8aeac0 2024-04-26T18:38:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.210+0000 7f615f1e7b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564d1f7fd800 con 0x564d1f8c2180 2024-04-26T18:38:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.210+0000 7f614dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8aeac0 0x564d1f8c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.210+0000 7f614dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8aeac0 0x564d1f8c1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:34420/0 (socket says 172.21.15.80:34420) 2024-04-26T18:38:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.210+0000 7f614dd9b700 1 -- 172.21.15.80:0/2575715670 learned_addr learned my addr 172.21.15.80:0/2575715670 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.210+0000 7f614ed9d700 1 --2- 172.21.15.80:0/2575715670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d1f8c2180 0x564d1f8c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:04.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.210+0000 7f614dd9b700 1 -- 172.21.15.80:0/2575715670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d1f8c2180 msgr2=0x564d1f8c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:04.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.210+0000 7f614dd9b700 1 --2- 172.21.15.80:0/2575715670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d1f8c2180 0x564d1f8c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.210+0000 7f614dd9b700 1 -- 172.21.15.80:0/2575715670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d1f8ae1a0 msgr2=0x564d1f8ae580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T18:38:04.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.210+0000 7f614dd9b700 1 --2- 172.21.15.80:0/2575715670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d1f8ae1a0 0x564d1f8ae580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.210+0000 7f614dd9b700 1 -- 172.21.15.80:0/2575715670 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d1f74e9d0 con 0x564d1f8aeac0 2024-04-26T18:38:04.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.210+0000 7f614dd9b700 1 --2- 172.21.15.80:0/2575715670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8aeac0 0x564d1f8c1c40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6144098e80 tx=0x7f614409cc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57cbc91ea8d7f7c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:04.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.210+0000 7f614e59c700 1 --2- 172.21.15.80:0/1909662742 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f61380a3e30 0x7f61380a62f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f614000b2e0 tx=0x7f6140005e80 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:04.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.210+0000 7f613cff9700 1 -- 172.21.15.80:0/2575715670 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61440a5120 con 0x564d1f8aeac0 2024-04-26T18:38:04.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.211+0000 7f613cff9700 1 -- 172.21.15.80:0/2575715670 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f614409a7b0 con 0x564d1f8aeac0 2024-04-26T18:38:04.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.211+0000 7f613cff9700 1 -- 172.21.15.80:0/2575715670 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61440d0040 con 0x564d1f8aeac0 2024-04-26T18:38:04.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.211+0000 7f615f1e7b80 1 -- 172.21.15.80:0/2575715670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8aeac0 msgr2=0x564d1f8c1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:04.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.211+0000 7f615f1e7b80 1 --2- 172.21.15.80:0/2575715670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8aeac0 0x564d1f8c1c40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6144098e80 tx=0x7f614409cc50 comp rx=0 tx=0).stop 2024-04-26T18:38:04.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.212+0000 7f615f1e7b80 1 -- 172.21.15.80:0/2575715670 shutdown_connections 2024-04-26T18:38:04.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.212+0000 7f615f1e7b80 1 --2- 172.21.15.80:0/2575715670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d1f8c2180 0x564d1f8c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.212+0000 7f615f1e7b80 1 --2- 172.21.15.80:0/2575715670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d1f8ae1a0 0x564d1f8ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.212+0000 7f615f1e7b80 1 --2- 172.21.15.80:0/2575715670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8aeac0 0x564d1f8c1c40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.212+0000 7f615f1e7b80 1 -- 172.21.15.80:0/2575715670 >> 172.21.15.80:0/2575715670 conn(0x564d1f7dbe40 msgr2=0x564d1f8aa690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:04.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.212+0000 7f615f1e7b80 1 -- 172.21.15.80:0/2575715670 shutdown_connections 2024-04-26T18:38:04.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.212+0000 7f615f1e7b80 1 -- 172.21.15.80:0/2575715670 wait complete. 2024-04-26T18:38:04.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.212+0000 7f615f1e7b80 1 -- start start 2024-04-26T18:38:04.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.212+0000 7f615f1e7b80 1 Processor -- start 2024-04-26T18:38:04.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.213+0000 7f615f1e7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8ae1a0 0x564d1f8c1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:04.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.213+0000 7f615f1e7b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d1f8aeac0 0x564d1f8bec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:04.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.213+0000 7f615f1e7b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d1f8c2180 0x564d1f8bf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:04.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.213+0000 7f614ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d1f8c2180 0x564d1f8bf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:04.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.213+0000 7f614e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8ae1a0 0x564d1f8c1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:04.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.213+0000 7f614ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d1f8c2180 0x564d1f8bf160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40684/0 (socket says 172.21.15.80:40684) 2024-04-26T18:38:04.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.213+0000 7f614ed9d700 1 -- 172.21.15.80:0/2436688224 learned_addr learned my addr 172.21.15.80:0/2436688224 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:04.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.213+0000 7f614e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8ae1a0 0x564d1f8c1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:34434/0 (socket says 172.21.15.80:34434) 2024-04-26T18:38:04.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.213+0000 7f615f1e7b80 1 -- 172.21.15.80:0/2436688224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x564d1f8c4d50 con 0x564d1f8c2180 2024-04-26T18:38:04.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.213+0000 7f615f1e7b80 1 -- 172.21.15.80:0/2436688224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564d1f767a50 con 0x564d1f8ae1a0 2024-04-26T18:38:04.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.213+0000 7f615f1e7b80 1 -- 172.21.15.80:0/2436688224 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564d1f8c4ed0 con 0x564d1f8aeac0 2024-04-26T18:38:04.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.213+0000 7f614dd9b700 1 --2- 172.21.15.80:0/2436688224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d1f8aeac0 0x564d1f8bec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:04.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.214+0000 7f615f1e7b80 10 client.0 _ll_register_callbacks cb 0x564d1f795680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:38:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.214+0000 7f614dd9b700 1 -- 172.21.15.80:0/2436688224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8ae1a0 msgr2=0x564d1f8c1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.214+0000 7f614dd9b700 1 --2- 172.21.15.80:0/2436688224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8ae1a0 0x564d1f8c1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.214+0000 7f614dd9b700 1 -- 172.21.15.80:0/2436688224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d1f8c2180 msgr2=0x564d1f8bf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.214+0000 7f614dd9b700 1 --2- 172.21.15.80:0/2436688224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d1f8c2180 0x564d1f8bf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.214+0000 7f614dd9b700 1 -- 172.21.15.80:0/2436688224 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d1f8bf830 con 0x564d1f8aeac0 2024-04-26T18:38:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.214+0000 7f614ed9d700 1 --2- 172.21.15.80:0/2436688224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d1f8c2180 0x564d1f8bf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:38:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.214+0000 7f614dd9b700 1 --2- 172.21.15.80:0/2436688224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d1f8aeac0 0x564d1f8bec20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f614409c1b0 tx=0x7f614409c620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe2a601ca772763b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.214+0000 7f6135ffb700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-04-26T18:38:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.214+0000 7f6135ffb700 1 -- 172.21.15.80:0/2436688224 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6144005720 con 0x564d1f8aeac0 2024-04-26T18:38:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.214+0000 7f6135ffb700 1 -- 172.21.15.80:0/2436688224 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f61440a4ea0 con 0x564d1f8aeac0 2024-04-26T18:38:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.214+0000 7f615f1e7b80 1 -- 172.21.15.80:0/2436688224 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f614409a7b0 con 0x564d1f8aeac0 2024-04-26T18:38:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.215+0000 7f6135ffb700 1 -- 172.21.15.80:0/2436688224 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f614409c710 con 0x564d1f8aeac0 2024-04-26T18:38:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.215+0000 7f615f1e7b80 10 client.25042 fetch_fsmap learned FSMap version 27 2024-04-26T18:38:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.215+0000 7f615f1e7b80 1 -- 172.21.15.80:0/2436688224 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564d1f8c4d50 con 0x564d1f8aeac0 2024-04-26T18:38:04.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.215+0000 7f6135ffb700 1 -- 172.21.15.80:0/2436688224 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f614409a7b0 con 0x564d1f8aeac0 2024-04-26T18:38:04.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.215+0000 7f6135ffb700 1 -- 172.21.15.80:0/2436688224 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f61440d0060 con 0x564d1f8aeac0 2024-04-26T18:38:04.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.215+0000 7f615f1e7b80 10 client.25042 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:38:04.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.215+0000 7f615f1e7b80 10 client.25042 resolve_mds: validated gid 24434 aka daemon mds.b 2024-04-26T18:38:04.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.215+0000 7f615f1e7b80 20 client.25042 populate_metadata read hostname 'smithi080' 2024-04-26T18:38:04.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.215+0000 7f615f1e7b80 1 --2- 172.21.15.80:0/2436688224 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x564d1f8d1b00 0x564d1f8d3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:04.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.215+0000 7f615f1e7b80 4 client.25042 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:38:04.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.215+0000 7f615f1e7b80 1 -- 172.21.15.80:0/2436688224 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d1f80f220 con 0x564d1f8d1b00 2024-04-26T18:38:04.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.216+0000 7f614e59c700 1 --2- 172.21.15.80:0/2436688224 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x564d1f8d1b00 0x564d1f8d3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:04.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.216+0000 7f6135ffb700 10 client.25042 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:04.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.216+0000 7f614e59c700 1 --2- 172.21.15.80:0/2436688224 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x564d1f8d1b00 0x564d1f8d3ef0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efcc8ad57c2f2a53 server_cookie=8df1e47b4fd99b58 in_seq=0 out_seq=0 2024-04-26T18:38:04.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.217+0000 7f6135ffb700 1 -- 172.21.15.80:0/2436688224 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564d1f80f220 con 0x564d1f8d1b00 2024-04-26T18:38:04.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.217+0000 7f6135ffb700 10 client.25042 handle_command_reply: tid=0 2024-04-26T18:38:04.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.217+0000 7f615f1e7b80 1 client.25042 shutdown 2024-04-26T18:38:04.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.217+0000 7f615f1e7b80 1 -- 172.21.15.80:0/2436688224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d1f8aeac0 msgr2=0x564d1f8bec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:04.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.217+0000 7f615f1e7b80 1 --2- 172.21.15.80:0/2436688224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d1f8aeac0 0x564d1f8bec20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f614409c1b0 tx=0x7f614409c620 comp rx=0 tx=0).stop 2024-04-26T18:38:04.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.217+0000 7f615f1e7b80 1 -- 172.21.15.80:0/2436688224 shutdown_connections 2024-04-26T18:38:04.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.217+0000 7f615f1e7b80 1 --2- 172.21.15.80:0/2436688224 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x564d1f8d1b00 0x564d1f8d3ef0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.217+0000 7f6135ffb700 0 client.25042 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:04.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.217+0000 7f615f1e7b80 1 --2- 172.21.15.80:0/2436688224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d1f8c2180 0x564d1f8bf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.217+0000 7f615f1e7b80 1 --2- 172.21.15.80:0/2436688224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8ae1a0 0x564d1f8c1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.217+0000 7f615f1e7b80 1 --2- 172.21.15.80:0/2436688224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d1f8aeac0 0x564d1f8bec20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.217+0000 7f615f1e7b80 1 -- 172.21.15.80:0/2436688224 >> 172.21.15.80:0/2436688224 conn(0x564d1f7dbe40 msgr2=0x564d1f8aa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:04.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.218+0000 7f615f1e7b80 1 -- 172.21.15.80:0/2436688224 shutdown_connections 2024-04-26T18:38:04.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.218+0000 7f615f1e7b80 1 -- 172.21.15.80:0/2436688224 wait complete. 2024-04-26T18:38:04.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.218+0000 7f615f1e7b80 20 client.25042 trim_cache size 0 max 16384 2024-04-26T18:38:04.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.256+0000 7f615f1e7b80 1 Processor -- start 2024-04-26T18:38:04.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.256+0000 7f615f1e7b80 1 -- start start 2024-04-26T18:38:04.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.256+0000 7f615f1e7b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d1f8ae1a0 0x564d1f8bdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:04.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.256+0000 7f615f1e7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8aeac0 0x564d1f8ba470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:04.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.256+0000 7f615f1e7b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d1f8c2180 0x564d1f8c0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:04.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.256+0000 7f615f1e7b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f613000d480 con 0x564d1f8c2180 2024-04-26T18:38:04.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.256+0000 7f615f1e7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f613000efc0 con 0x564d1f8aeac0 2024-04-26T18:38:04.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.256+0000 7f615f1e7b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f613000db50 con 0x564d1f8ae1a0 2024-04-26T18:38:04.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.257+0000 7f614ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d1f8c2180 0x564d1f8c0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:04.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.257+0000 7f614dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8aeac0 0x564d1f8ba470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:04.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.257+0000 7f614dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8aeac0 0x564d1f8ba470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:34450/0 (socket says 172.21.15.80:34450) 2024-04-26T18:38:04.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.257+0000 7f614dd9b700 1 -- 172.21.15.80:0/1167665057 learned_addr learned my addr 172.21.15.80:0/1167665057 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:04.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.257+0000 7f614ed9d700 1 -- 172.21.15.80:0/1167665057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d1f8ae1a0 msgr2=0x564d1f8bdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:04.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.257+0000 7f614ed9d700 1 --2- 172.21.15.80:0/1167665057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d1f8ae1a0 0x564d1f8bdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.257+0000 7f614ed9d700 1 -- 172.21.15.80:0/1167665057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8aeac0 msgr2=0x564d1f8ba470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:04.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.257+0000 7f614ed9d700 1 --2- 172.21.15.80:0/1167665057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8aeac0 0x564d1f8ba470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.257+0000 7f614ed9d700 1 -- 172.21.15.80:0/1167665057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d1f8a1f40 con 0x564d1f8c2180 2024-04-26T18:38:04.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.257+0000 7f614dd9b700 1 --2- 172.21.15.80:0/1167665057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8aeac0 0x564d1f8ba470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:38:04.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.257+0000 7f614ed9d700 1 --2- 172.21.15.80:0/1167665057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d1f8c2180 0x564d1f8c0b60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6148003d50 tx=0x7f6148009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d2c9d68438347 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:04.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.258+0000 7f6137fff700 1 -- 172.21.15.80:0/1167665057 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6148004db0 con 0x564d1f8c2180 2024-04-26T18:38:04.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.258+0000 7f6137fff700 1 -- 172.21.15.80:0/1167665057 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f614801b070 con 0x564d1f8c2180 2024-04-26T18:38:04.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.258+0000 7f6137fff700 1 -- 172.21.15.80:0/1167665057 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6148007e00 con 0x564d1f8c2180 2024-04-26T18:38:04.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.259+0000 7f615f1e7b80 1 -- 172.21.15.80:0/1167665057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d1f8c2180 msgr2=0x564d1f8c0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:04.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.259+0000 7f615f1e7b80 1 --2- 172.21.15.80:0/1167665057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d1f8c2180 0x564d1f8c0b60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6148003d50 tx=0x7f6148009920 comp rx=0 tx=0).stop 2024-04-26T18:38:04.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.259+0000 7f615f1e7b80 1 -- 172.21.15.80:0/1167665057 shutdown_connections 2024-04-26T18:38:04.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.259+0000 7f615f1e7b80 1 --2- 172.21.15.80:0/1167665057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d1f8c2180 0x564d1f8c0b60 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.259+0000 7f615f1e7b80 1 --2- 172.21.15.80:0/1167665057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d1f8ae1a0 0x564d1f8bdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.259+0000 7f615f1e7b80 1 --2- 172.21.15.80:0/1167665057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8aeac0 0x564d1f8ba470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.259+0000 7f615f1e7b80 1 -- 172.21.15.80:0/1167665057 >> 172.21.15.80:0/1167665057 conn(0x564d1f7dbe40 msgr2=0x564d1f8c0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:04.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.259+0000 7f615f1e7b80 1 -- 172.21.15.80:0/1167665057 shutdown_connections 2024-04-26T18:38:04.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.259+0000 7f615f1e7b80 1 -- 172.21.15.80:0/1167665057 wait complete. 2024-04-26T18:38:04.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.260+0000 7f615f1e7b80 1 -- start start 2024-04-26T18:38:04.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.260+0000 7f615f1e7b80 1 Processor -- start 2024-04-26T18:38:04.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.260+0000 7f615f1e7b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d1f8ae1a0 0x564d1f8c7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:04.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.260+0000 7f615f1e7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8aeac0 0x564d1f8c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:04.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.260+0000 7f615f1e7b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d1f8c2180 0x564d1f8c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:04.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.261+0000 7f614e59c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d1f8ae1a0 0x564d1f8c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:04.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.261+0000 7f614e59c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d1f8ae1a0 0x564d1f8c7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.80:51174/0 (socket says 172.21.15.80:51174) 2024-04-26T18:38:04.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.261+0000 7f614ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d1f8c2180 0x564d1f8c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:04.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.261+0000 7f614ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d1f8c2180 0x564d1f8c7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40696/0 (socket says 172.21.15.80:40696) 2024-04-26T18:38:04.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.261+0000 7f614e59c700 1 -- 172.21.15.80:0/212936318 learned_addr learned my addr 172.21.15.80:0/212936318 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:04.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.261+0000 7f615f1e7b80 1 -- 172.21.15.80:0/212936318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f613000e8f0 con 0x564d1f8c2180 2024-04-26T18:38:04.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.261+0000 7f615f1e7b80 1 -- 172.21.15.80:0/212936318 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f613000e220 con 0x564d1f8aeac0 2024-04-26T18:38:04.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.261+0000 7f615f1e7b80 1 -- 172.21.15.80:0/212936318 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f613000b420 con 0x564d1f8ae1a0 2024-04-26T18:38:04.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.261+0000 7f614dd9b700 1 --2- 172.21.15.80:0/212936318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8aeac0 0x564d1f8c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:04.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.261+0000 7f614ed9d700 1 -- 172.21.15.80:0/212936318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d1f8ae1a0 msgr2=0x564d1f8c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:04.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.261+0000 7f614ed9d700 1 --2- 172.21.15.80:0/212936318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d1f8ae1a0 0x564d1f8c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.261+0000 7f614ed9d700 1 -- 172.21.15.80:0/212936318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8aeac0 msgr2=0x564d1f8c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:04.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.261+0000 7f614ed9d700 1 --2- 172.21.15.80:0/212936318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8aeac0 0x564d1f8c76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.261+0000 7f614ed9d700 1 -- 172.21.15.80:0/212936318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d1f8b10b0 con 0x564d1f8c2180 2024-04-26T18:38:04.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.262+0000 7f615f1e7b80 10 client.0 _ll_register_callbacks cb 0x564d1f795680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:38:04.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.262+0000 7f615f1e7b80 1 -- 172.21.15.80:0/212936318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f614801b070 con 0x564d1f8c2180 2024-04-26T18:38:04.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.262+0000 7f614ed9d700 1 --2- 172.21.15.80:0/212936318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d1f8c2180 0x564d1f8c7c10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6148003d20 tx=0x7f6148008cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d98a1e728f9aa06 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:04.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.262+0000 7f6135ffb700 10 client.15606 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:38:04.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.262+0000 7f6135ffb700 1 -- 172.21.15.80:0/212936318 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6148004650 con 0x564d1f8c2180 2024-04-26T18:38:04.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.262+0000 7f6135ffb700 1 -- 172.21.15.80:0/212936318 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f61480047f0 con 0x564d1f8c2180 2024-04-26T18:38:04.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.262+0000 7f6135ffb700 1 -- 172.21.15.80:0/212936318 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6148017410 con 0x564d1f8c2180 2024-04-26T18:38:04.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.262+0000 7f615f1e7b80 10 client.15606 fetch_fsmap learned FSMap version 27 2024-04-26T18:38:04.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.262+0000 7f615f1e7b80 1 -- 172.21.15.80:0/212936318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({fsmap=27}) -- 0x564d1f938dc0 con 0x564d1f8c2180 2024-04-26T18:38:04.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.263+0000 7f6135ffb700 1 -- 172.21.15.80:0/212936318 <== mon.0 v2:172.21.15.80:3300/0 4 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f61480175b0 con 0x564d1f8c2180 2024-04-26T18:38:04.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.263+0000 7f615f1e7b80 10 client.15606 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:38:04.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.263+0000 7f615f1e7b80 10 client.15606 resolve_mds: validated gid 24434 aka daemon mds.b 2024-04-26T18:38:04.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.263+0000 7f615f1e7b80 20 client.15606 populate_metadata read hostname 'smithi080' 2024-04-26T18:38:04.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.263+0000 7f615f1e7b80 1 --2- 172.21.15.80:0/212936318 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x564d1f939300 0x564d1f93b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:04.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.263+0000 7f615f1e7b80 4 client.15606 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "577c7138", "release": true, "await": true}] 2024-04-26T18:38:04.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.263+0000 7f615f1e7b80 1 -- 172.21.15.80:0/212936318 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "quiesce db", "set_id": "577c7138", "release": true, "await": true}) -- 0x564d1f8092c0 con 0x564d1f939300 2024-04-26T18:38:04.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.263+0000 7f614e59c700 1 --2- 172.21.15.80:0/212936318 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x564d1f939300 0x564d1f93b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:04.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.263+0000 7f6135ffb700 10 client.15606 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:04.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.263+0000 7f614e59c700 1 --2- 172.21.15.80:0/212936318 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x564d1f939300 0x564d1f93b7c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c884fc3883853001 server_cookie=3e3b516257cbb11b in_seq=0 out_seq=0 2024-04-26T18:38:04.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.265+0000 7f6135ffb700 1 -- 172.21.15.80:0/212936318 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x564d1f8092c0 con 0x564d1f939300 2024-04-26T18:38:04.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.265+0000 7f6135ffb700 10 client.15606 handle_command_reply: tid=0 2024-04-26T18:38:04.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.265+0000 7f615f1e7b80 1 client.15606 shutdown 2024-04-26T18:38:04.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.266+0000 7f615f1e7b80 1 -- 172.21.15.80:0/212936318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d1f8c2180 msgr2=0x564d1f8c7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:04.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.266+0000 7f615f1e7b80 1 --2- 172.21.15.80:0/212936318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d1f8c2180 0x564d1f8c7c10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6148003d20 tx=0x7f6148008cf0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.266+0000 7f615f1e7b80 1 -- 172.21.15.80:0/212936318 shutdown_connections 2024-04-26T18:38:04.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.266+0000 7f615f1e7b80 1 --2- 172.21.15.80:0/212936318 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x564d1f939300 0x564d1f93b7c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.266+0000 7f615f1e7b80 1 --2- 172.21.15.80:0/212936318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564d1f8c2180 0x564d1f8c7c10 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.266+0000 7f615f1e7b80 1 --2- 172.21.15.80:0/212936318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d1f8ae1a0 0x564d1f8c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.266+0000 7f615f1e7b80 1 --2- 172.21.15.80:0/212936318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564d1f8aeac0 0x564d1f8c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.266+0000 7f615f1e7b80 1 -- 172.21.15.80:0/212936318 >> 172.21.15.80:0/212936318 conn(0x564d1f7dbe40 msgr2=0x564d1f8ba2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:04.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.266+0000 7f6135ffb700 0 client.15606 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:04.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.266+0000 7f615f1e7b80 1 -- 172.21.15.80:0/212936318 shutdown_connections 2024-04-26T18:38:04.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.266+0000 7f615f1e7b80 1 -- 172.21.15.80:0/212936318 wait complete. 2024-04-26T18:38:04.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.266+0000 7f615f1e7b80 20 client.15606 trim_cache size 0 max 16384 2024-04-26T18:38:04.270 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:38:04.270 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 27, 2024-04-26T18:38:04.270 INFO:teuthology.orchestra.run.smithi080.stdout: "leader": 24434, 2024-04-26T18:38:04.271 INFO:teuthology.orchestra.run.smithi080.stdout: "set_version": 4, 2024-04-26T18:38:04.271 INFO:teuthology.orchestra.run.smithi080.stdout: "sets": { 2024-04-26T18:38:04.271 INFO:teuthology.orchestra.run.smithi080.stdout: "577c7138": { 2024-04-26T18:38:04.271 INFO:teuthology.orchestra.run.smithi080.stdout: "version": 4, 2024-04-26T18:38:04.271 INFO:teuthology.orchestra.run.smithi080.stdout: "age_ref": 0.0, 2024-04-26T18:38:04.271 INFO:teuthology.orchestra.run.smithi080.stdout: "state": { 2024-04-26T18:38:04.271 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RELEASED", 2024-04-26T18:38:04.271 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0 2024-04-26T18:38:04.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:38:04.271 INFO:teuthology.orchestra.run.smithi080.stdout: "timeout": 60.0, 2024-04-26T18:38:04.271 INFO:teuthology.orchestra.run.smithi080.stdout: "expiration": 90.0, 2024-04-26T18:38:04.271 INFO:teuthology.orchestra.run.smithi080.stdout: "members": { 2024-04-26T18:38:04.271 INFO:teuthology.orchestra.run.smithi080.stdout: "file:/": { 2024-04-26T18:38:04.271 INFO:teuthology.orchestra.run.smithi080.stdout: "excluded": false, 2024-04-26T18:38:04.271 INFO:teuthology.orchestra.run.smithi080.stdout: "state": { 2024-04-26T18:38:04.272 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RELEASED", 2024-04-26T18:38:04.272 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0 2024-04-26T18:38:04.272 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:38:04.272 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:38:04.272 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:38:04.273 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:38:04.273 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:38:04.273 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:38:04.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.267+0000 7f6154955700 1 -- 172.21.15.80:0/1909662742 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f61380a3e30 msgr2=0x7f61380a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:04.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.267+0000 7f6154955700 1 --2- 172.21.15.80:0/1909662742 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f61380a3e30 0x7f61380a62f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f614000b2e0 tx=0x7f6140005e80 comp rx=0 tx=0).stop 2024-04-26T18:38:04.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.267+0000 7f6154955700 1 -- 172.21.15.80:0/1909662742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6150102ce0 msgr2=0x7f6150198c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:04.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.267+0000 7f6154955700 1 --2- 172.21.15.80:0/1909662742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6150102ce0 0x7f6150198c30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f614400d980 tx=0x7f614400dc90 comp rx=0 tx=0).stop 2024-04-26T18:38:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.267+0000 7f6154955700 1 -- 172.21.15.80:0/1909662742 shutdown_connections 2024-04-26T18:38:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.267+0000 7f6154955700 1 --2- 172.21.15.80:0/1909662742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6150108390 0x7f6150199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.267+0000 7f6154955700 1 --2- 172.21.15.80:0/1909662742 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f61380a3e30 0x7f61380a62f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.267+0000 7f6154955700 1 --2- 172.21.15.80:0/1909662742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6150102320 0x7f61501986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.267+0000 7f6154955700 1 --2- 172.21.15.80:0/1909662742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6150102ce0 0x7f6150198c30 secure :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f614400d980 tx=0x7f614400dc90 comp rx=0 tx=0).stop 2024-04-26T18:38:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.267+0000 7f6154955700 1 -- 172.21.15.80:0/1909662742 >> 172.21.15.80:0/1909662742 conn(0x7f61500792d0 msgr2=0x7f6150101140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.268+0000 7f6154955700 1 -- 172.21.15.80:0/1909662742 shutdown_connections 2024-04-26T18:38:04.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:04.268+0000 7f6154955700 1 -- 172.21.15.80:0/1909662742 wait complete. 2024-04-26T18:38:05.111 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '577c7138', seconds elapsed: 42.5 2024-04-26T18:38:05.111 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-04-26T18:38:05.111 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:38:05.404 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:38:05.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:05 smithi192 ceph-mon[32842]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 30 op/s 2024-04-26T18:38:05.892 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:05 smithi080 ceph-mon[29135]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 30 op/s 2024-04-26T18:38:05.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:05 smithi082 ceph-mon[32808]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 30 op/s 2024-04-26T18:38:07.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.277+0000 7f6192f6a700 1 -- 172.21.15.80:0/1235536022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f618c102cd0 msgr2=0x7f618c10f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:07.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.277+0000 7f6192f6a700 1 --2- 172.21.15.80:0/1235536022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f618c102cd0 0x7f618c10f1c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f618400b0a0 tx=0x7f618400b3b0 comp rx=0 tx=0).stop 2024-04-26T18:38:07.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.277+0000 7f6192f6a700 1 -- 172.21.15.80:0/1235536022 shutdown_connections 2024-04-26T18:38:07.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.277+0000 7f6192f6a700 1 --2- 172.21.15.80:0/1235536022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f618c102cd0 0x7f618c10f1c0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:07.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.277+0000 7f6192f6a700 1 --2- 172.21.15.80:0/1235536022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f618c108380 0x7f618c108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:07.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.277+0000 7f6192f6a700 1 --2- 172.21.15.80:0/1235536022 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f618c102310 0x7f618c102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:07.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.277+0000 7f6192f6a700 1 -- 172.21.15.80:0/1235536022 >> 172.21.15.80:0/1235536022 conn(0x7f618c079290 msgr2=0x7f618c0796a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:07.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.278+0000 7f6192f6a700 1 -- 172.21.15.80:0/1235536022 shutdown_connections 2024-04-26T18:38:07.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.278+0000 7f6192f6a700 1 -- 172.21.15.80:0/1235536022 wait complete. 2024-04-26T18:38:07.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.278+0000 7f6192f6a700 1 Processor -- start 2024-04-26T18:38:07.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.278+0000 7f6192f6a700 1 -- start start 2024-04-26T18:38:07.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.279+0000 7f6192f6a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f618c102310 0x7f618c198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:07.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.279+0000 7f6192f6a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f618c102cd0 0x7f618c198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:07.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.279+0000 7f6192f6a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f618c108380 0x7f618c199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:07.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.279+0000 7f6192f6a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f618c1124a0 con 0x7f618c102cd0 2024-04-26T18:38:07.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.279+0000 7f6192f6a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f618c112320 con 0x7f618c102310 2024-04-26T18:38:07.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.279+0000 7f6192f6a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f618c112620 con 0x7f618c108380 2024-04-26T18:38:07.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.279+0000 7f6190d06700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f618c102310 0x7f618c198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:07.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.279+0000 7f6190d06700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f618c102310 0x7f618c198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:34468/0 (socket says 172.21.15.80:34468) 2024-04-26T18:38:07.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.279+0000 7f6190d06700 1 -- 172.21.15.80:0/1546325019 learned_addr learned my addr 172.21.15.80:0/1546325019 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:07.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.279+0000 7f6191507700 1 --2- 172.21.15.80:0/1546325019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f618c108380 0x7f618c199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:07.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.279+0000 7f6190d06700 1 -- 172.21.15.80:0/1546325019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f618c108380 msgr2=0x7f618c199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:07.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.279+0000 7f618bfff700 1 --2- 172.21.15.80:0/1546325019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f618c102cd0 0x7f618c198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:07.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.279+0000 7f6190d06700 1 --2- 172.21.15.80:0/1546325019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f618c108380 0x7f618c199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:07.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.279+0000 7f6190d06700 1 -- 172.21.15.80:0/1546325019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f618c102cd0 msgr2=0x7f618c198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:07.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.279+0000 7f6190d06700 1 --2- 172.21.15.80:0/1546325019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f618c102cd0 0x7f618c198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:07.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.279+0000 7f6190d06700 1 -- 172.21.15.80:0/1546325019 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618c1a7f80 con 0x7f618c102310 2024-04-26T18:38:07.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.279+0000 7f618bfff700 1 --2- 172.21.15.80:0/1546325019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f618c102cd0 0x7f618c198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:38:07.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.280+0000 7f6190d06700 1 --2- 172.21.15.80:0/1546325019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f618c102310 0x7f618c198710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f618000d950 tx=0x7f618000dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:07.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.280+0000 7f6189ffb700 1 -- 172.21.15.80:0/1546325019 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6180016070 con 0x7f618c102310 2024-04-26T18:38:07.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.280+0000 7f6189ffb700 1 -- 172.21.15.80:0/1546325019 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6180010460 con 0x7f618c102310 2024-04-26T18:38:07.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.280+0000 7f6189ffb700 1 -- 172.21.15.80:0/1546325019 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618000f620 con 0x7f618c102310 2024-04-26T18:38:07.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.280+0000 7f6192f6a700 1 -- 172.21.15.80:0/1546325019 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f618c1a8270 con 0x7f618c102310 2024-04-26T18:38:07.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.280+0000 7f6192f6a700 1 -- 172.21.15.80:0/1546325019 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f618c1a8760 con 0x7f618c102310 2024-04-26T18:38:07.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.282+0000 7f6192f6a700 1 -- 172.21.15.80:0/1546325019 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f618c06a110 con 0x7f618c102310 2024-04-26T18:38:07.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.283+0000 7f6189ffb700 1 -- 172.21.15.80:0/1546325019 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f6180019070 con 0x7f618c102310 2024-04-26T18:38:07.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.283+0000 7f6189ffb700 1 --2- 172.21.15.80:0/1546325019 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f617c0a3e30 0x7f617c0a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:07.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.284+0000 7f618bfff700 1 --2- 172.21.15.80:0/1546325019 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f617c0a3e30 0x7f617c0a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:07.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.284+0000 7f6189ffb700 1 -- 172.21.15.80:0/1546325019 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f61800d0310 con 0x7f618c102310 2024-04-26T18:38:07.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.284+0000 7f618bfff700 1 --2- 172.21.15.80:0/1546325019 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f617c0a3e30 0x7f617c0a62f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6178005fd0 tx=0x7f6178005dc0 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:07.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.287+0000 7f6189ffb700 1 -- 172.21.15.80:0/1546325019 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f618009ca00 con 0x7f618c102310 2024-04-26T18:38:07.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.783+0000 7f6192f6a700 1 -- 172.21.15.80:0/1546325019 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f618c02e490 con 0x7f618c102310 2024-04-26T18:38:07.784 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:07 smithi080 ceph-mon[29135]: pgmap v52: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-04-26T18:38:07.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.784+0000 7f6189ffb700 1 -- 172.21.15.80:0/1546325019 <== mon.2 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11918 (secure 0 0 0) 0x7f618009c300 con 0x7f618c102310 2024-04-26T18:38:07.785 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:38:07.785 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1967550873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1967550873},{"type":"v1","addr":"172.21.15.80:6835","nonce":1967550873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/559541830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":559541830},{"type":"v1","addr":"172.21.15.80:6837","nonce":559541830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T18:33:08.347399+0000","modified":"2024-04-26T18:36:26.401600+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24434,"mds_1":24421,"mds_2":24404,"mds_3":24400,"mds_4":24394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14577":{"gid":14577,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6839/2137993298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":2137993298},{"type":"v1","addr":"172.21.15.80:6839","nonce":2137993298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6841/1544670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1544670},{"type":"v1","addr":"172.21.15.80:6841","nonce":1544670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24371":{"gid":24371,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/3564539039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3564539039},{"type":"v1","addr":"172.21.15.82:6833","nonce":3564539039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24379":{"gid":24379,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/572065563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":572065563},{"type":"v1","addr":"172.21.15.82:6835","nonce":572065563}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.192:6835/719058020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":719058020},{"type":"v1","addr":"172.21.15.192:6835","nonce":719058020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.192:6837/2361996920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2361996920},{"type":"v1","addr":"172.21.15.192:6837","nonce":2361996920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.82:6837/2084055551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2084055551},{"type":"v1","addr":"172.21.15.82:6837","nonce":2084055551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6839/2735406056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":2735406056},{"type":"v1","addr":"172.21.15.192:6839","nonce":2735406056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.82:6839/1482576497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1482576497},{"type":"v1","addr":"172.21.15.82:6839","nonce":1482576497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24434,"qdb_cluster":[24421,24400,24394,24404,24434]},"id":1}]} 2024-04-26T18:38:07.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.787+0000 7f6192f6a700 1 -- 172.21.15.80:0/1546325019 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f617c0a3e30 msgr2=0x7f617c0a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:07.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.787+0000 7f6192f6a700 1 --2- 172.21.15.80:0/1546325019 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f617c0a3e30 0x7f617c0a62f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6178005fd0 tx=0x7f6178005dc0 comp rx=0 tx=0).stop 2024-04-26T18:38:07.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.787+0000 7f6192f6a700 1 -- 172.21.15.80:0/1546325019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f618c102310 msgr2=0x7f618c198710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:07.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.787+0000 7f6192f6a700 1 --2- 172.21.15.80:0/1546325019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f618c102310 0x7f618c198710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f618000d950 tx=0x7f618000dd10 comp rx=0 tx=0).stop 2024-04-26T18:38:07.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.787+0000 7f6192f6a700 1 -- 172.21.15.80:0/1546325019 shutdown_connections 2024-04-26T18:38:07.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.787+0000 7f6192f6a700 1 --2- 172.21.15.80:0/1546325019 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f617c0a3e30 0x7f617c0a62f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:07.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.788+0000 7f6192f6a700 1 --2- 172.21.15.80:0/1546325019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f618c108380 0x7f618c199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:07.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.788+0000 7f6192f6a700 1 --2- 172.21.15.80:0/1546325019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f618c102310 0x7f618c198710 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:07.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.788+0000 7f6192f6a700 1 --2- 172.21.15.80:0/1546325019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f618c102cd0 0x7f618c198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:07.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.788+0000 7f6192f6a700 1 -- 172.21.15.80:0/1546325019 >> 172.21.15.80:0/1546325019 conn(0x7f618c079290 msgr2=0x7f618c100f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:07.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.788+0000 7f6192f6a700 1 -- 172.21.15.80:0/1546325019 shutdown_connections 2024-04-26T18:38:07.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:07.788+0000 7f6192f6a700 1 -- 172.21.15.80:0/1546325019 wait complete. 2024-04-26T18:38:07.789 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 27 2024-04-26T18:38:07.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:07 smithi192 ceph-mon[32842]: pgmap v52: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-04-26T18:38:07.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:07 smithi082 ceph-mon[32808]: pgmap v52: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-04-26T18:38:08.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:08 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1546325019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:38:08.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:08 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1546325019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:38:08.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:08 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1546325019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:38:09.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:09 smithi192 ceph-mon[32842]: pgmap v53: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-04-26T18:38:09.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:09 smithi082 ceph-mon[32808]: pgmap v53: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-04-26T18:38:09.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:09 smithi080 ceph-mon[29135]: pgmap v53: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-04-26T18:38:10.428 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24434 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-04-26T18:38:10.429 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24434 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-04-26T18:38:10.706 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:38:11.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:11 smithi192 ceph-mon[32842]: pgmap v54: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 29 op/s 2024-04-26T18:38:11.866 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:11 smithi080 ceph-mon[29135]: pgmap v54: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 29 op/s 2024-04-26T18:38:11.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:11 smithi082 ceph-mon[32808]: pgmap v54: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 29 op/s 2024-04-26T18:38:12.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.892+0000 7fba5990b700 1 -- 172.21.15.80:0/1248456509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba5406baf0 msgr2=0x7fba5406bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:12.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.892+0000 7fba5990b700 1 --2- 172.21.15.80:0/1248456509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba5406baf0 0x7fba5406bf70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fba48009990 tx=0x7fba48009ca0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.892+0000 7fba5990b700 1 -- 172.21.15.80:0/1248456509 shutdown_connections 2024-04-26T18:38:12.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.892+0000 7fba5990b700 1 --2- 172.21.15.80:0/1248456509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba5406c4b0 0x7fba541102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.892+0000 7fba5990b700 1 --2- 172.21.15.80:0/1248456509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba54109500 0x7fba541098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.892+0000 7fba5990b700 1 --2- 172.21.15.80:0/1248456509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba5406baf0 0x7fba5406bf70 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.892+0000 7fba5990b700 1 -- 172.21.15.80:0/1248456509 >> 172.21.15.80:0/1248456509 conn(0x7fba54079080 msgr2=0x7fba54079490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:12.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.892+0000 7fba5990b700 1 -- 172.21.15.80:0/1248456509 shutdown_connections 2024-04-26T18:38:12.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.892+0000 7fba5990b700 1 -- 172.21.15.80:0/1248456509 wait complete. 2024-04-26T18:38:12.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.893+0000 7fba5990b700 1 Processor -- start 2024-04-26T18:38:12.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.893+0000 7fba5990b700 1 -- start start 2024-04-26T18:38:12.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.893+0000 7fba5990b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba5406baf0 0x7fba54102710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:12.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.894+0000 7fba5990b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba5406c4b0 0x7fba54102c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:12.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.894+0000 7fba5990b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba54109500 0x7fba54103190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:12.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.894+0000 7fba5990b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fba541136e0 con 0x7fba5406c4b0 2024-04-26T18:38:12.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.894+0000 7fba5990b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba54113560 con 0x7fba5406baf0 2024-04-26T18:38:12.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.894+0000 7fba5990b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fba54113860 con 0x7fba54109500 2024-04-26T18:38:12.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.894+0000 7fba527fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba5406c4b0 0x7fba54102c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:12.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.894+0000 7fba527fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba5406c4b0 0x7fba54102c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40726/0 (socket says 172.21.15.80:40726) 2024-04-26T18:38:12.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.894+0000 7fba527fc700 1 -- 172.21.15.80:0/1569529809 learned_addr learned my addr 172.21.15.80:0/1569529809 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:12.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.894+0000 7fba52ffd700 1 --2- 172.21.15.80:0/1569529809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba5406baf0 0x7fba54102710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:12.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.894+0000 7fba537fe700 1 --2- 172.21.15.80:0/1569529809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba54109500 0x7fba54103190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:12.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.894+0000 7fba527fc700 1 -- 172.21.15.80:0/1569529809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba54109500 msgr2=0x7fba54103190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:12.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.894+0000 7fba527fc700 1 --2- 172.21.15.80:0/1569529809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba54109500 0x7fba54103190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.894+0000 7fba527fc700 1 -- 172.21.15.80:0/1569529809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba5406baf0 msgr2=0x7fba54102710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:12.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.894+0000 7fba527fc700 1 --2- 172.21.15.80:0/1569529809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba5406baf0 0x7fba54102710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.894+0000 7fba527fc700 1 -- 172.21.15.80:0/1569529809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba541a8160 con 0x7fba5406c4b0 2024-04-26T18:38:12.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.894+0000 7fba537fe700 1 --2- 172.21.15.80:0/1569529809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba54109500 0x7fba54103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:38:12.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.894+0000 7fba527fc700 1 --2- 172.21.15.80:0/1569529809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba5406c4b0 0x7fba54102c50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fba48000c00 tx=0x7fba480047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:12.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.894+0000 7fba58909700 1 -- 172.21.15.80:0/1569529809 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba48027070 con 0x7fba5406c4b0 2024-04-26T18:38:12.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.894+0000 7fba5990b700 1 -- 172.21.15.80:0/1569529809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba541a83f0 con 0x7fba5406c4b0 2024-04-26T18:38:12.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.894+0000 7fba58909700 1 -- 172.21.15.80:0/1569529809 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba480041d0 con 0x7fba5406c4b0 2024-04-26T18:38:12.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.894+0000 7fba5990b700 1 -- 172.21.15.80:0/1569529809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba541a88a0 con 0x7fba5406c4b0 2024-04-26T18:38:12.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.894+0000 7fba58909700 1 -- 172.21.15.80:0/1569529809 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4800f460 con 0x7fba5406c4b0 2024-04-26T18:38:12.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.897+0000 7fba58909700 1 -- 172.21.15.80:0/1569529809 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fba4802a070 con 0x7fba5406c4b0 2024-04-26T18:38:12.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.898+0000 7fba58909700 1 --2- 172.21.15.80:0/1569529809 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fba3c0a3e50 0x7fba3c0a6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:12.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.898+0000 7fba52ffd700 1 --2- 172.21.15.80:0/1569529809 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fba3c0a3e50 0x7fba3c0a6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:12.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.898+0000 7fba58909700 1 -- 172.21.15.80:0/1569529809 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fba480d1610 con 0x7fba5406c4b0 2024-04-26T18:38:12.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.898+0000 7fba52ffd700 1 --2- 172.21.15.80:0/1569529809 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fba3c0a3e50 0x7fba3c0a6310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fba44006fd0 tx=0x7fba44008040 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:12.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.899+0000 7fba6419db80 1 Processor -- start 2024-04-26T18:38:12.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.899+0000 7fba6419db80 1 -- start start 2024-04-26T18:38:12.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.899+0000 7fba6419db80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470664f30 0x55c470665310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:12.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.900+0000 7fba6419db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c470665850 0x55c47065f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:12.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.900+0000 7fba6419db80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c47065f900 0x55c47065fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:12.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.900+0000 7fba6419db80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55c4705b19c0 con 0x55c470664f30 2024-04-26T18:38:12.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.900+0000 7fba6419db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c470517ac0 con 0x55c470665850 2024-04-26T18:38:12.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.900+0000 7fba6419db80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c4705ad980 con 0x55c47065f900 2024-04-26T18:38:12.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.900+0000 7fba52ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470664f30 0x55c470665310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:12.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.900+0000 7fba52ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470664f30 0x55c470665310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40742/0 (socket says 172.21.15.80:40742) 2024-04-26T18:38:12.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.900+0000 7fba52ffd700 1 -- 172.21.15.80:0/2083845623 learned_addr learned my addr 172.21.15.80:0/2083845623 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:12.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.900+0000 7fba52ffd700 1 -- 172.21.15.80:0/2083845623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c47065f900 msgr2=0x55c47065fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:12.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.900+0000 7fba52ffd700 1 --2- 172.21.15.80:0/2083845623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c47065f900 0x55c47065fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.900+0000 7fba52ffd700 1 -- 172.21.15.80:0/2083845623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c470665850 msgr2=0x55c47065f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:12.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.900+0000 7fba527fc700 1 --2- 172.21.15.80:0/2083845623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c470665850 0x55c47065f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:12.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.900+0000 7fba52ffd700 1 --2- 172.21.15.80:0/2083845623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c470665850 0x55c47065f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.900+0000 7fba52ffd700 1 -- 172.21.15.80:0/2083845623 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4704fea60 con 0x55c470664f30 2024-04-26T18:38:12.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.900+0000 7fba52ffd700 1 --2- 172.21.15.80:0/2083845623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470664f30 0x55c470665310 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fba4400d750 tx=0x7fba44010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5155968d4ec9476e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:12.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.900+0000 7fba39ffb700 1 -- 172.21.15.80:0/2083845623 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44024070 con 0x55c470664f30 2024-04-26T18:38:12.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.900+0000 7fba39ffb700 1 -- 172.21.15.80:0/2083845623 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba44014af0 con 0x55c470664f30 2024-04-26T18:38:12.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.900+0000 7fba39ffb700 1 -- 172.21.15.80:0/2083845623 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4401fbc0 con 0x55c470664f30 2024-04-26T18:38:12.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.901+0000 7fba6419db80 1 -- 172.21.15.80:0/2083845623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470664f30 msgr2=0x55c470665310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:12.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.901+0000 7fba6419db80 1 --2- 172.21.15.80:0/2083845623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470664f30 0x55c470665310 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fba4400d750 tx=0x7fba44010000 comp rx=0 tx=0).stop 2024-04-26T18:38:12.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.901+0000 7fba6419db80 1 -- 172.21.15.80:0/2083845623 shutdown_connections 2024-04-26T18:38:12.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.901+0000 7fba6419db80 1 --2- 172.21.15.80:0/2083845623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c47065f900 0x55c47065fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.901+0000 7fba6419db80 1 --2- 172.21.15.80:0/2083845623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470664f30 0x55c470665310 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.901+0000 7fba6419db80 1 --2- 172.21.15.80:0/2083845623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c470665850 0x55c47065f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.901+0000 7fba6419db80 1 -- 172.21.15.80:0/2083845623 >> 172.21.15.80:0/2083845623 conn(0x55c47058d750 msgr2=0x55c47065a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:12.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.901+0000 7fba6419db80 1 -- 172.21.15.80:0/2083845623 shutdown_connections 2024-04-26T18:38:12.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.901+0000 7fba6419db80 1 -- 172.21.15.80:0/2083845623 wait complete. 2024-04-26T18:38:12.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.902+0000 7fba6419db80 1 -- start start 2024-04-26T18:38:12.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.902+0000 7fba6419db80 1 Processor -- start 2024-04-26T18:38:12.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.902+0000 7fba6419db80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c47065f900 0x55c47066b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:12.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.902+0000 7fba6419db80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470664f30 0x55c470668860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:12.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.902+0000 7fba6419db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c470665850 0x55c470668da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:12.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.902+0000 7fba6419db80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55c47066c2c0 con 0x55c470664f30 2024-04-26T18:38:12.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.902+0000 7fba6419db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c47056bc10 con 0x55c470665850 2024-04-26T18:38:12.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.902+0000 7fba6419db80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c47066c440 con 0x55c47065f900 2024-04-26T18:38:12.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.902+0000 7fba527fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470664f30 0x55c470668860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:12.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.902+0000 7fba6419db80 10 client.0 _ll_register_callbacks cb 0x55c470549ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:38:12.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.902+0000 7fba527fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470664f30 0x55c470668860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40754/0 (socket says 172.21.15.80:40754) 2024-04-26T18:38:12.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.902+0000 7fba527fc700 1 -- 172.21.15.80:0/2324409439 learned_addr learned my addr 172.21.15.80:0/2324409439 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:12.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.902+0000 7fba52ffd700 1 --2- 172.21.15.80:0/2324409439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c47065f900 0x55c47066b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:12.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.902+0000 7fba537fe700 1 --2- 172.21.15.80:0/2324409439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c470665850 0x55c470668da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:12.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.903+0000 7fba527fc700 1 -- 172.21.15.80:0/2324409439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c47065f900 msgr2=0x55c47066b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:12.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.903+0000 7fba527fc700 1 --2- 172.21.15.80:0/2324409439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c47065f900 0x55c47066b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.903+0000 7fba527fc700 1 -- 172.21.15.80:0/2324409439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c470665850 msgr2=0x55c470668da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:12.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.903+0000 7fba527fc700 1 --2- 172.21.15.80:0/2324409439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c470665850 0x55c470668da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.903+0000 7fba527fc700 1 -- 172.21.15.80:0/2324409439 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c47056f610 con 0x55c470664f30 2024-04-26T18:38:12.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.903+0000 7fba527fc700 1 --2- 172.21.15.80:0/2324409439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470664f30 0x55c470668860 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fba48006010 tx=0x7fba4809d1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7381453209c8552d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:12.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.903+0000 7fba32ffd700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:38:12.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.903+0000 7fba32ffd700 1 -- 172.21.15.80:0/2324409439 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4809dd90 con 0x55c470664f30 2024-04-26T18:38:12.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.903+0000 7fba32ffd700 1 -- 172.21.15.80:0/2324409439 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fba48086bd0 con 0x55c470664f30 2024-04-26T18:38:12.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.903+0000 7fba6419db80 1 -- 172.21.15.80:0/2324409439 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba44014af0 con 0x55c470664f30 2024-04-26T18:38:12.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.903+0000 7fba32ffd700 1 -- 172.21.15.80:0/2324409439 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fba4809d690 con 0x55c470664f30 2024-04-26T18:38:12.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.903+0000 7fba6419db80 10 client.15621 fetch_fsmap learned FSMap version 27 2024-04-26T18:38:12.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.903+0000 7fba6419db80 1 -- 172.21.15.80:0/2324409439 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c470676af0 con 0x55c470664f30 2024-04-26T18:38:12.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.903+0000 7fba32ffd700 1 -- 172.21.15.80:0/2324409439 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba480b5030 con 0x55c470664f30 2024-04-26T18:38:12.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.904+0000 7fba32ffd700 1 -- 172.21.15.80:0/2324409439 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fba480a5e70 con 0x55c470664f30 2024-04-26T18:38:12.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.904+0000 7fba6419db80 10 client.15621 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:38:12.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.904+0000 7fba6419db80 10 client.15621 resolve_mds: validated gid 24434 aka daemon mds.b 2024-04-26T18:38:12.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.904+0000 7fba6419db80 20 client.15621 populate_metadata read hostname 'smithi080' 2024-04-26T18:38:12.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.904+0000 7fba6419db80 1 --2- 172.21.15.80:0/2324409439 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55c4706790e0 0x55c47067b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:12.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.904+0000 7fba6419db80 4 client.15621 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:38:12.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.904+0000 7fba6419db80 1 -- 172.21.15.80:0/2324409439 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4705bf3a0 con 0x55c4706790e0 2024-04-26T18:38:12.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.904+0000 7fba52ffd700 1 --2- 172.21.15.80:0/2324409439 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55c4706790e0 0x55c47067b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:12.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.904+0000 7fba32ffd700 10 client.15621 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:12.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.904+0000 7fba52ffd700 1 --2- 172.21.15.80:0/2324409439 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55c4706790e0 0x55c47067b500 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=783fe70ff5b7be37 server_cookie=481d2137c06c511c in_seq=0 out_seq=0 2024-04-26T18:38:12.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.905+0000 7fba32ffd700 1 -- 172.21.15.80:0/2324409439 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c4705bf3a0 con 0x55c4706790e0 2024-04-26T18:38:12.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.905+0000 7fba32ffd700 10 client.15621 handle_command_reply: tid=0 2024-04-26T18:38:12.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.905+0000 7fba6419db80 1 client.15621 shutdown 2024-04-26T18:38:12.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.905+0000 7fba6419db80 1 -- 172.21.15.80:0/2324409439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470664f30 msgr2=0x55c470668860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:12.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.905+0000 7fba6419db80 1 --2- 172.21.15.80:0/2324409439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470664f30 0x55c470668860 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fba48006010 tx=0x7fba4809d1d0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.905+0000 7fba6419db80 1 -- 172.21.15.80:0/2324409439 shutdown_connections 2024-04-26T18:38:12.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.905+0000 7fba6419db80 1 --2- 172.21.15.80:0/2324409439 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55c4706790e0 0x55c47067b500 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.905+0000 7fba32ffd700 0 client.15621 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:12.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.905+0000 7fba6419db80 1 --2- 172.21.15.80:0/2324409439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c470665850 0x55c470668da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.905+0000 7fba6419db80 1 --2- 172.21.15.80:0/2324409439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c47065f900 0x55c47066b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.905+0000 7fba6419db80 1 --2- 172.21.15.80:0/2324409439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470664f30 0x55c470668860 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.905+0000 7fba6419db80 1 -- 172.21.15.80:0/2324409439 >> 172.21.15.80:0/2324409439 conn(0x55c47058d750 msgr2=0x55c47065e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:12.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.905+0000 7fba6419db80 1 -- 172.21.15.80:0/2324409439 shutdown_connections 2024-04-26T18:38:12.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.905+0000 7fba6419db80 1 -- 172.21.15.80:0/2324409439 wait complete. 2024-04-26T18:38:12.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.905+0000 7fba6419db80 20 client.15621 trim_cache size 0 max 16384 2024-04-26T18:38:12.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.941+0000 7fba6419db80 1 Processor -- start 2024-04-26T18:38:12.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.941+0000 7fba6419db80 1 -- start start 2024-04-26T18:38:12.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.941+0000 7fba6419db80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c47065f900 0x55c470668df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:12.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.941+0000 7fba6419db80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470664f30 0x55c47065f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:12.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.941+0000 7fba6419db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c470665850 0x55c470675250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:12.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.941+0000 7fba6419db80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fba4000d3e0 con 0x55c470664f30 2024-04-26T18:38:12.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.941+0000 7fba6419db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba4000ef20 con 0x55c470665850 2024-04-26T18:38:12.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.941+0000 7fba6419db80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fba4000dab0 con 0x55c47065f900 2024-04-26T18:38:12.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.941+0000 7fba527fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470664f30 0x55c47065f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:12.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.941+0000 7fba527fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470664f30 0x55c47065f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40766/0 (socket says 172.21.15.80:40766) 2024-04-26T18:38:12.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.941+0000 7fba527fc700 1 -- 172.21.15.80:0/1101053981 learned_addr learned my addr 172.21.15.80:0/1101053981 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:12.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.941+0000 7fba537fe700 1 --2- 172.21.15.80:0/1101053981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c470665850 0x55c470675250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:12.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.941+0000 7fba52ffd700 1 --2- 172.21.15.80:0/1101053981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c47065f900 0x55c470668df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:12.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.941+0000 7fba527fc700 1 -- 172.21.15.80:0/1101053981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c47065f900 msgr2=0x55c470668df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:12.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.941+0000 7fba527fc700 1 --2- 172.21.15.80:0/1101053981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c47065f900 0x55c470668df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.941+0000 7fba527fc700 1 -- 172.21.15.80:0/1101053981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c470665850 msgr2=0x55c470675250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:12.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.941+0000 7fba527fc700 1 --2- 172.21.15.80:0/1101053981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c470665850 0x55c470675250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.942+0000 7fba527fc700 1 -- 172.21.15.80:0/1101053981 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c47066b100 con 0x55c470664f30 2024-04-26T18:38:12.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.942+0000 7fba527fc700 1 --2- 172.21.15.80:0/1101053981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470664f30 0x55c47065f2e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fba48022af0 tx=0x7fba4809cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f118b5f3564ec19 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:12.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.942+0000 7fba397fa700 1 -- 172.21.15.80:0/1101053981 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4809dd90 con 0x55c470664f30 2024-04-26T18:38:12.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.942+0000 7fba397fa700 1 -- 172.21.15.80:0/1101053981 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba480b5070 con 0x55c470664f30 2024-04-26T18:38:12.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.942+0000 7fba397fa700 1 -- 172.21.15.80:0/1101053981 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba48086bd0 con 0x55c470664f30 2024-04-26T18:38:12.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.943+0000 7fba6419db80 1 -- 172.21.15.80:0/1101053981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470664f30 msgr2=0x55c47065f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:12.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.943+0000 7fba6419db80 1 --2- 172.21.15.80:0/1101053981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470664f30 0x55c47065f2e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fba48022af0 tx=0x7fba4809cf40 comp rx=0 tx=0).stop 2024-04-26T18:38:12.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.943+0000 7fba6419db80 1 -- 172.21.15.80:0/1101053981 shutdown_connections 2024-04-26T18:38:12.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.943+0000 7fba6419db80 1 --2- 172.21.15.80:0/1101053981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c470665850 0x55c470675250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.943+0000 7fba6419db80 1 --2- 172.21.15.80:0/1101053981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c47065f900 0x55c470668df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.943+0000 7fba6419db80 1 --2- 172.21.15.80:0/1101053981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470664f30 0x55c47065f2e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.943+0000 7fba6419db80 1 -- 172.21.15.80:0/1101053981 >> 172.21.15.80:0/1101053981 conn(0x55c47058d750 msgr2=0x55c470666360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:12.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.943+0000 7fba6419db80 1 -- 172.21.15.80:0/1101053981 shutdown_connections 2024-04-26T18:38:12.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.943+0000 7fba6419db80 1 -- 172.21.15.80:0/1101053981 wait complete. 2024-04-26T18:38:12.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.943+0000 7fba6419db80 1 -- start start 2024-04-26T18:38:12.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.944+0000 7fba6419db80 1 Processor -- start 2024-04-26T18:38:12.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.944+0000 7fba6419db80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c47065f900 0x55c47066e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:12.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.944+0000 7fba6419db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c470664f30 0x55c47066ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:12.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.944+0000 7fba6419db80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470665850 0x55c4706df650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:12.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.944+0000 7fba6419db80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fba4000e850 con 0x55c470665850 2024-04-26T18:38:12.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.944+0000 7fba6419db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba4000e180 con 0x55c470664f30 2024-04-26T18:38:12.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.944+0000 7fba6419db80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fba4000b380 con 0x55c47065f900 2024-04-26T18:38:12.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.944+0000 7fba6419db80 10 client.0 _ll_register_callbacks cb 0x55c470549ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:38:12.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.944+0000 7fba537fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470665850 0x55c4706df650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:12.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.944+0000 7fba537fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470665850 0x55c4706df650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40778/0 (socket says 172.21.15.80:40778) 2024-04-26T18:38:12.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.944+0000 7fba537fe700 1 -- 172.21.15.80:0/2721250688 learned_addr learned my addr 172.21.15.80:0/2721250688 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:12.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.944+0000 7fba527fc700 1 --2- 172.21.15.80:0/2721250688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c470664f30 0x55c47066ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:12.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.944+0000 7fba52ffd700 1 --2- 172.21.15.80:0/2721250688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c47065f900 0x55c47066e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:12.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.944+0000 7fba537fe700 1 -- 172.21.15.80:0/2721250688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c47065f900 msgr2=0x55c47066e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:12.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.944+0000 7fba537fe700 1 --2- 172.21.15.80:0/2721250688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c47065f900 0x55c47066e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.944+0000 7fba537fe700 1 -- 172.21.15.80:0/2721250688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c470664f30 msgr2=0x55c47066ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:12.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.944+0000 7fba537fe700 1 --2- 172.21.15.80:0/2721250688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c470664f30 0x55c47066ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.944+0000 7fba537fe700 1 -- 172.21.15.80:0/2721250688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4706dfb90 con 0x55c470665850 2024-04-26T18:38:12.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.944+0000 7fba527fc700 1 --2- 172.21.15.80:0/2721250688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c470664f30 0x55c47066ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:38:12.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.945+0000 7fba537fe700 1 --2- 172.21.15.80:0/2721250688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470665850 0x55c4706df650 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fba4c010ba0 tx=0x7fba4c010bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12dbc858eb0dc9b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:12.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.945+0000 7fba32ffd700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:38:12.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.945+0000 7fba32ffd700 1 -- 172.21.15.80:0/2721250688 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c00f7a0 con 0x55c470665850 2024-04-26T18:38:12.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.945+0000 7fba32ffd700 1 -- 172.21.15.80:0/2721250688 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fba4c00f940 con 0x55c470665850 2024-04-26T18:38:12.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.945+0000 7fba6419db80 1 -- 172.21.15.80:0/2721250688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba480b5070 con 0x55c470665850 2024-04-26T18:38:12.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.945+0000 7fba32ffd700 1 -- 172.21.15.80:0/2721250688 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fba4c00fb40 con 0x55c470665850 2024-04-26T18:38:12.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.945+0000 7fba6419db80 10 client.15627 fetch_fsmap learned FSMap version 27 2024-04-26T18:38:12.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.945+0000 7fba6419db80 1 -- 172.21.15.80:0/2721250688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c4706e0e40 con 0x55c470665850 2024-04-26T18:38:12.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.945+0000 7fba32ffd700 1 -- 172.21.15.80:0/2721250688 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba480b5070 con 0x55c470665850 2024-04-26T18:38:12.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.945+0000 7fba32ffd700 1 -- 172.21.15.80:0/2721250688 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fba4c0193c0 con 0x55c470665850 2024-04-26T18:38:12.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.945+0000 7fba6419db80 10 client.15627 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:38:12.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.945+0000 7fba6419db80 10 client.15627 resolve_mds: validated gid 24434 aka daemon mds.b 2024-04-26T18:38:12.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.945+0000 7fba6419db80 20 client.15627 populate_metadata read hostname 'smithi080' 2024-04-26T18:38:12.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.945+0000 7fba6419db80 1 --2- 172.21.15.80:0/2721250688 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55c4706e1610 0x55c4706e3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:12.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.945+0000 7fba6419db80 4 client.15627 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-04-26T18:38:12.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.945+0000 7fba6419db80 1 -- 172.21.15.80:0/2721250688 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x55c4705b9440 con 0x55c4706e1610 2024-04-26T18:38:12.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.946+0000 7fba52ffd700 1 --2- 172.21.15.80:0/2721250688 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55c4706e1610 0x55c4706e3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:12.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.946+0000 7fba32ffd700 10 client.15627 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:12.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.946+0000 7fba52ffd700 1 --2- 172.21.15.80:0/2721250688 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55c4706e1610 0x55c4706e3a30 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1364c44f2b958161 server_cookie=b99b9faa49b3325d in_seq=0 out_seq=0 2024-04-26T18:38:12.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.954+0000 7fba32ffd700 1 -- 172.21.15.80:0/2721250688 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55c4705b9440 con 0x55c4706e1610 2024-04-26T18:38:12.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.954+0000 7fba32ffd700 10 client.15627 handle_command_reply: tid=0 2024-04-26T18:38:12.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.954+0000 7fba6419db80 1 client.15627 shutdown 2024-04-26T18:38:12.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.954+0000 7fba6419db80 1 -- 172.21.15.80:0/2721250688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470665850 msgr2=0x55c4706df650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:12.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.954+0000 7fba6419db80 1 --2- 172.21.15.80:0/2721250688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470665850 0x55c4706df650 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fba4c010ba0 tx=0x7fba4c010bd0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.954+0000 7fba6419db80 1 -- 172.21.15.80:0/2721250688 shutdown_connections 2024-04-26T18:38:12.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.954+0000 7fba6419db80 1 --2- 172.21.15.80:0/2721250688 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55c4706e1610 0x55c4706e3a30 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.954+0000 7fba6419db80 1 --2- 172.21.15.80:0/2721250688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c470665850 0x55c4706df650 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.954+0000 7fba32ffd700 0 client.15627 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:12.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.954+0000 7fba6419db80 1 --2- 172.21.15.80:0/2721250688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c47065f900 0x55c47066e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.954+0000 7fba6419db80 1 --2- 172.21.15.80:0/2721250688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c470664f30 0x55c47066ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.954+0000 7fba6419db80 1 -- 172.21.15.80:0/2721250688 >> 172.21.15.80:0/2721250688 conn(0x55c47058d750 msgr2=0x55c470666d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:12.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.954+0000 7fba6419db80 1 -- 172.21.15.80:0/2721250688 shutdown_connections 2024-04-26T18:38:12.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.954+0000 7fba6419db80 1 -- 172.21.15.80:0/2721250688 wait complete. 2024-04-26T18:38:12.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.954+0000 7fba6419db80 20 client.15627 trim_cache size 0 max 16384 2024-04-26T18:38:12.958 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:38:12.958 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 27, 2024-04-26T18:38:12.958 INFO:teuthology.orchestra.run.smithi080.stdout: "leader": 24434, 2024-04-26T18:38:12.958 INFO:teuthology.orchestra.run.smithi080.stdout: "set_version": 6, 2024-04-26T18:38:12.958 INFO:teuthology.orchestra.run.smithi080.stdout: "sets": { 2024-04-26T18:38:12.958 INFO:teuthology.orchestra.run.smithi080.stdout: "79a7f30a": { 2024-04-26T18:38:12.958 INFO:teuthology.orchestra.run.smithi080.stdout: "version": 6, 2024-04-26T18:38:12.958 INFO:teuthology.orchestra.run.smithi080.stdout: "age_ref": 0.0, 2024-04-26T18:38:12.958 INFO:teuthology.orchestra.run.smithi080.stdout: "state": { 2024-04-26T18:38:12.959 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "QUIESCED", 2024-04-26T18:38:12.959 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0 2024-04-26T18:38:12.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:38:12.959 INFO:teuthology.orchestra.run.smithi080.stdout: "timeout": 60.0, 2024-04-26T18:38:12.959 INFO:teuthology.orchestra.run.smithi080.stdout: "expiration": 90.0, 2024-04-26T18:38:12.959 INFO:teuthology.orchestra.run.smithi080.stdout: "members": { 2024-04-26T18:38:12.959 INFO:teuthology.orchestra.run.smithi080.stdout: "file:/": { 2024-04-26T18:38:12.959 INFO:teuthology.orchestra.run.smithi080.stdout: "excluded": false, 2024-04-26T18:38:12.959 INFO:teuthology.orchestra.run.smithi080.stdout: "state": { 2024-04-26T18:38:12.959 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "QUIESCED", 2024-04-26T18:38:12.959 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0 2024-04-26T18:38:12.959 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:38:12.959 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:38:12.959 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:38:12.960 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:38:12.960 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:38:12.960 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:38:12.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.955+0000 7fba5990b700 1 -- 172.21.15.80:0/1569529809 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fba3c0a3e50 msgr2=0x7fba3c0a6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:12.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.955+0000 7fba5990b700 1 --2- 172.21.15.80:0/1569529809 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fba3c0a3e50 0x7fba3c0a6310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fba44006fd0 tx=0x7fba44008040 comp rx=0 tx=0).stop 2024-04-26T18:38:12.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.955+0000 7fba5990b700 1 -- 172.21.15.80:0/1569529809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba5406c4b0 msgr2=0x7fba54102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:12.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.955+0000 7fba5990b700 1 --2- 172.21.15.80:0/1569529809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba5406c4b0 0x7fba54102c50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fba48000c00 tx=0x7fba480047b0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.955+0000 7fba5990b700 1 -- 172.21.15.80:0/1569529809 shutdown_connections 2024-04-26T18:38:12.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.955+0000 7fba5990b700 1 --2- 172.21.15.80:0/1569529809 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fba3c0a3e50 0x7fba3c0a6310 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.955+0000 7fba5990b700 1 --2- 172.21.15.80:0/1569529809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba54109500 0x7fba54103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.955+0000 7fba5990b700 1 --2- 172.21.15.80:0/1569529809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba5406baf0 0x7fba54102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.955+0000 7fba5990b700 1 --2- 172.21.15.80:0/1569529809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba5406c4b0 0x7fba54102c50 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:12.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.955+0000 7fba5990b700 1 -- 172.21.15.80:0/1569529809 >> 172.21.15.80:0/1569529809 conn(0x7fba54079080 msgr2=0x7fba541013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:12.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.955+0000 7fba5990b700 1 -- 172.21.15.80:0/1569529809 shutdown_connections 2024-04-26T18:38:12.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:12.955+0000 7fba5990b700 1 -- 172.21.15.80:0/1569529809 wait complete. 2024-04-26T18:38:13.683 INFO:tasks.workunit.client.0.smithi080.stderr:Updating files: 92% (11292/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-26T18:38:13.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:13 smithi080 ceph-mon[29135]: pgmap v55: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-04-26T18:38:13.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:13 smithi192 ceph-mon[32842]: pgmap v55: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-04-26T18:38:13.889 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '79a7f30a', quiesce took 8.8 seconds. Will release after: 30.0 2024-04-26T18:38:13.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:13 smithi082 ceph-mon[32808]: pgmap v55: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-04-26T18:38:14.442 INFO:tasks.workunit.client.0.smithi080.stderr:Note: switching to 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1'. 2024-04-26T18:38:14.442 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-04-26T18:38:14.442 INFO:tasks.workunit.client.0.smithi080.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-26T18:38:14.442 INFO:tasks.workunit.client.0.smithi080.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-26T18:38:14.442 INFO:tasks.workunit.client.0.smithi080.stderr:state without impacting any branches by switching back to a branch. 2024-04-26T18:38:14.442 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-04-26T18:38:14.442 INFO:tasks.workunit.client.0.smithi080.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-26T18:38:14.442 INFO:tasks.workunit.client.0.smithi080.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-26T18:38:14.443 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-04-26T18:38:14.443 INFO:tasks.workunit.client.0.smithi080.stderr: git switch -c 2024-04-26T18:38:14.443 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-04-26T18:38:14.443 INFO:tasks.workunit.client.0.smithi080.stderr:Or undo this operation with: 2024-04-26T18:38:14.443 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-04-26T18:38:14.443 INFO:tasks.workunit.client.0.smithi080.stderr: git switch - 2024-04-26T18:38:14.443 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-04-26T18:38:14.443 INFO:tasks.workunit.client.0.smithi080.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-26T18:38:14.443 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-04-26T18:38:14.443 INFO:tasks.workunit.client.0.smithi080.stderr:HEAD is now at bc94a2a924f Merge commit 'refs/pull/57099/head' of github.com:ceph/ceph into quiescer 2024-04-26T18:38:14.448 DEBUG:teuthology.orchestra.run.smithi080:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-26T18:38:14.470 INFO:tasks.workunit.client.0.smithi080.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-26T18:38:14.472 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T18:38:14.472 INFO:tasks.workunit.client.0.smithi080.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-26T18:38:15.093 INFO:tasks.workunit.client.0.smithi080.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-26T18:38:15.155 INFO:tasks.workunit.client.0.smithi080.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-26T18:38:15.194 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T18:38:15.196 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T18:38:15.196 INFO:tasks.workunit.client.0.smithi080.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-26T18:38:15.234 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T18:38:15.237 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T18:38:15.238 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-26T18:38:15.293 INFO:tasks.workunit:Running workunits matching direct_io on client.0... 2024-04-26T18:38:15.294 INFO:tasks.workunit:Running workunit direct_io/big.sh... 2024-04-26T18:38:15.294 DEBUG:teuthology.orchestra.run.smithi080:workunit test direct_io/big.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/big.sh 2024-04-26T18:38:15.501 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.499+0000 7f874b5da640 1 -- 172.21.15.80:0/2761723503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8744104500 msgr2=0x7f874410c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:15.501 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.499+0000 7f874b5da640 1 --2- 172.21.15.80:0/2761723503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8744104500 0x7f874410c9e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8734009900 tx=0x7f873402a480 comp rx=0 tx=0).stop 2024-04-26T18:38:15.502 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.499+0000 7f874b5da640 1 -- 172.21.15.80:0/2761723503 shutdown_connections 2024-04-26T18:38:15.502 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.499+0000 7f874b5da640 1 --2- 172.21.15.80:0/2761723503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8744104500 0x7f874410c9e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.502 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.499+0000 7f874b5da640 1 --2- 172.21.15.80:0/2761723503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f874410cfb0 0x7f874410f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.502 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.499+0000 7f874b5da640 1 --2- 172.21.15.80:0/2761723503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8744103be0 0x7f8744103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.502 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.499+0000 7f874b5da640 1 -- 172.21.15.80:0/2761723503 >> 172.21.15.80:0/2761723503 conn(0x7f8744077bb0 msgr2=0x7f8744077fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:15.502 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.499+0000 7f874b5da640 1 -- 172.21.15.80:0/2761723503 shutdown_connections 2024-04-26T18:38:15.502 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.499+0000 7f874b5da640 1 -- 172.21.15.80:0/2761723503 wait complete. 2024-04-26T18:38:15.502 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.500+0000 7f874b5da640 1 Processor -- start 2024-04-26T18:38:15.502 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.500+0000 7f874b5da640 1 -- start start 2024-04-26T18:38:15.502 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.500+0000 7f874b5da640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8744103be0 0x7f8744101830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:15.502 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.500+0000 7f874b5da640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8744104500 0x7f8744101d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:15.502 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.500+0000 7f874b5da640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f874410cfb0 0x7f87441022b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:15.502 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.500+0000 7f874b5da640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8744112bf0 con 0x7f8744103be0 2024-04-26T18:38:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.500+0000 7f874b5da640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8744112a70 con 0x7f874410cfb0 2024-04-26T18:38:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.500+0000 7f874b5da640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8744112d70 con 0x7f8744104500 2024-04-26T18:38:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.500+0000 7f8749376640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8744103be0 0x7f8744101830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.500+0000 7f8749376640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8744103be0 0x7f8744101830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49170/0 (socket says 172.21.15.80:49170) 2024-04-26T18:38:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.500+0000 7f8749376640 1 -- 172.21.15.80:0/447161202 learned_addr learned my addr 172.21.15.80:0/447161202 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.500+0000 7f8749b77640 1 --2- 172.21.15.80:0/447161202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f874410cfb0 0x7f87441022b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.500+0000 7f8749376640 1 -- 172.21.15.80:0/447161202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8744104500 msgr2=0x7f8744101d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.500+0000 7f8748b75640 1 --2- 172.21.15.80:0/447161202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8744104500 0x7f8744101d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.500+0000 7f8749376640 1 --2- 172.21.15.80:0/447161202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8744104500 0x7f8744101d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.500+0000 7f8749376640 1 -- 172.21.15.80:0/447161202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f874410cfb0 msgr2=0x7f87441022b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.500+0000 7f8749376640 1 --2- 172.21.15.80:0/447161202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f874410cfb0 0x7f87441022b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.500+0000 7f8749376640 1 -- 172.21.15.80:0/447161202 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87441a7550 con 0x7f8744103be0 2024-04-26T18:38:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.500+0000 7f8749b77640 1 --2- 172.21.15.80:0/447161202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f874410cfb0 0x7f87441022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:38:15.503 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.500+0000 7f8748b75640 1 --2- 172.21.15.80:0/447161202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8744104500 0x7f8744101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:38:15.504 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.500+0000 7f8749376640 1 --2- 172.21.15.80:0/447161202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8744103be0 0x7f8744101830 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f874000d770 tx=0x7f874000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:15.504 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.501+0000 7f873a7fc640 1 -- 172.21.15.80:0/447161202 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8740017070 con 0x7f8744103be0 2024-04-26T18:38:15.504 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.501+0000 7f873a7fc640 1 -- 172.21.15.80:0/447161202 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87400054d0 con 0x7f8744103be0 2024-04-26T18:38:15.504 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.501+0000 7f874b5da640 1 -- 172.21.15.80:0/447161202 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87441a7840 con 0x7f8744103be0 2024-04-26T18:38:15.504 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.501+0000 7f873a7fc640 1 -- 172.21.15.80:0/447161202 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8740004c30 con 0x7f8744103be0 2024-04-26T18:38:15.504 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.501+0000 7f874b5da640 1 -- 172.21.15.80:0/447161202 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87441a7d40 con 0x7f8744103be0 2024-04-26T18:38:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.503+0000 7f873a7fc640 1 -- 172.21.15.80:0/447161202 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f8740004dd0 con 0x7f8744103be0 2024-04-26T18:38:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.503+0000 7f874e3c7740 1 Processor -- start 2024-04-26T18:38:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.503+0000 7f874e3c7740 1 -- start start 2024-04-26T18:38:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.503+0000 7f874e3c7740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55905751bf00 0x55905751c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.503+0000 7f874e3c7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55905751c820 0x559057526ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.503+0000 7f874e3c7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590575270e0 0x5590575294d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.503+0000 7f874e3c7740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x559057482460 con 0x55905751bf00 2024-04-26T18:38:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.503+0000 7f874e3c7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55905743c590 con 0x5590575270e0 2024-04-26T18:38:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.503+0000 7f874e3c7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55905747e420 con 0x55905751c820 2024-04-26T18:38:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.503+0000 7f873a7fc640 1 --2- 172.21.15.80:0/447161202 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f87300a3df0 0x7f87300a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.504+0000 7f8749b77640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55905751bf00 0x55905751c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.504+0000 7f8749b77640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55905751bf00 0x55905751c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49184/0 (socket says 172.21.15.80:49184) 2024-04-26T18:38:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.504+0000 7f8749b77640 1 -- 172.21.15.80:0/200905606 learned_addr learned my addr 172.21.15.80:0/200905606 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.504+0000 7f8749376640 1 --2- 172.21.15.80:0/200905606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55905751c820 0x559057526ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.504+0000 7f8749b77640 1 --2- 172.21.15.80:0/447161202 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f87300a3df0 0x7f87300a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.504+0000 7f873a7fc640 1 -- 172.21.15.80:0/447161202 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f87400d0320 con 0x7f8744103be0 2024-04-26T18:38:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.504+0000 7f8748b75640 1 --2- 172.21.15.80:0/200905606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590575270e0 0x5590575294d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.504+0000 7f8749b77640 1 -- 172.21.15.80:0/200905606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55905751c820 msgr2=0x559057526ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.504+0000 7f8749b77640 1 --2- 172.21.15.80:0/200905606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55905751c820 0x559057526ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.504+0000 7f8749b77640 1 -- 172.21.15.80:0/200905606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590575270e0 msgr2=0x5590575294d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.504+0000 7f8749b77640 1 --2- 172.21.15.80:0/200905606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590575270e0 0x5590575294d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.504+0000 7f8749b77640 1 -- 172.21.15.80:0/200905606 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590574490d0 con 0x55905751bf00 2024-04-26T18:38:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.504+0000 7f8748b75640 1 --2- 172.21.15.80:0/200905606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590575270e0 0x5590575294d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:38:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.504+0000 7f8749b77640 1 --2- 172.21.15.80:0/200905606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55905751bf00 0x55905751c2e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f873c012d50 tx=0x7f873c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78aa63c3924fa507 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.504+0000 7f8749b77640 1 --2- 172.21.15.80:0/447161202 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f87300a3df0 0x7f87300a62b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f873c00fc30 tx=0x7f873c01a000 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.504+0000 7f872f7fe640 1 -- 172.21.15.80:0/200905606 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c020070 con 0x55905751bf00 2024-04-26T18:38:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.504+0000 7f872f7fe640 1 -- 172.21.15.80:0/200905606 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f873c00ab40 con 0x55905751bf00 2024-04-26T18:38:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.504+0000 7f872f7fe640 1 -- 172.21.15.80:0/200905606 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c00d3d0 con 0x55905751bf00 2024-04-26T18:38:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.505+0000 7f874e3c7740 1 -- 172.21.15.80:0/200905606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55905751bf00 msgr2=0x55905751c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.505+0000 7f874e3c7740 1 --2- 172.21.15.80:0/200905606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55905751bf00 0x55905751c2e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f873c012d50 tx=0x7f873c00f730 comp rx=0 tx=0).stop 2024-04-26T18:38:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.505+0000 7f874e3c7740 1 -- 172.21.15.80:0/200905606 shutdown_connections 2024-04-26T18:38:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.505+0000 7f874e3c7740 1 --2- 172.21.15.80:0/200905606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590575270e0 0x5590575294d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.505+0000 7f874e3c7740 1 --2- 172.21.15.80:0/200905606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55905751c820 0x559057526ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.505+0000 7f874e3c7740 1 --2- 172.21.15.80:0/200905606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55905751bf00 0x55905751c2e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.505+0000 7f874e3c7740 1 -- 172.21.15.80:0/200905606 >> 172.21.15.80:0/200905606 conn(0x559057518410 msgr2=0x5590575187f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.505+0000 7f874e3c7740 1 -- 172.21.15.80:0/200905606 shutdown_connections 2024-04-26T18:38:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.505+0000 7f874e3c7740 1 -- 172.21.15.80:0/200905606 wait complete. 2024-04-26T18:38:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.505+0000 7f874e3c7740 1 -- start start 2024-04-26T18:38:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.505+0000 7f874e3c7740 1 Processor -- start 2024-04-26T18:38:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.506+0000 7f874e3c7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55905751bf00 0x559057524170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.506+0000 7f874e3c7740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55905751c820 0x5590575246b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.506+0000 7f874e3c7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5590575270e0 0x559057524bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.506+0000 7f874e3c7740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x559057529cb0 con 0x55905751c820 2024-04-26T18:38:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.506+0000 7f874e3c7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559057409b60 con 0x55905751bf00 2024-04-26T18:38:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.506+0000 7f874e3c7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559057529e30 con 0x5590575270e0 2024-04-26T18:38:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.506+0000 7f874e3c7740 10 client.0 _ll_register_callbacks cb 0x55905742e2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:38:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.506+0000 7f8748b75640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55905751c820 0x5590575246b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.506+0000 7f8748b75640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55905751c820 0x5590575246b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49194/0 (socket says 172.21.15.80:49194) 2024-04-26T18:38:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.506+0000 7f8748b75640 1 -- 172.21.15.80:0/3476317478 learned_addr learned my addr 172.21.15.80:0/3476317478 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.506+0000 7f8749376640 1 --2- 172.21.15.80:0/3476317478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55905751bf00 0x559057524170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.506+0000 7f8749b77640 1 --2- 172.21.15.80:0/3476317478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5590575270e0 0x559057524bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.506+0000 7f8748b75640 1 -- 172.21.15.80:0/3476317478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5590575270e0 msgr2=0x559057524bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.506+0000 7f8748b75640 1 --2- 172.21.15.80:0/3476317478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5590575270e0 0x559057524bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.506+0000 7f8748b75640 1 -- 172.21.15.80:0/3476317478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55905751bf00 msgr2=0x559057524170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.506+0000 7f8748b75640 1 --2- 172.21.15.80:0/3476317478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55905751bf00 0x559057524170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.514 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.506+0000 7f8748b75640 1 -- 172.21.15.80:0/3476317478 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559057194210 con 0x55905751c820 2024-04-26T18:38:15.514 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.506+0000 7f8749b77640 1 --2- 172.21.15.80:0/3476317478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5590575270e0 0x559057524bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:38:15.514 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.506+0000 7f8748b75640 1 --2- 172.21.15.80:0/3476317478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55905751c820 0x5590575246b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8734009230 tx=0x7f8734031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55331f21c9b8d11 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:15.514 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.506+0000 7f872cff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:38:15.514 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.506+0000 7f872cff9640 1 -- 172.21.15.80:0/3476317478 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873403f070 con 0x55905751c820 2024-04-26T18:38:15.514 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.506+0000 7f872cff9640 1 -- 172.21.15.80:0/3476317478 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f8734004450 con 0x55905751c820 2024-04-26T18:38:15.514 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.506+0000 7f874e3c7740 1 -- 172.21.15.80:0/3476317478 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f873c00ab40 con 0x55905751c820 2024-04-26T18:38:15.514 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.507+0000 7f872cff9640 1 -- 172.21.15.80:0/3476317478 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8734035070 con 0x55905751c820 2024-04-26T18:38:15.514 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.507+0000 7f874e3c7740 10 client.15639 fetch_fsmap learned FSMap version 27 2024-04-26T18:38:15.514 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.507+0000 7f874e3c7740 1 -- 172.21.15.80:0/3476317478 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559057260620 con 0x55905751c820 2024-04-26T18:38:15.514 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.507+0000 7f872cff9640 1 -- 172.21.15.80:0/3476317478 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f873c00ab40 con 0x55905751c820 2024-04-26T18:38:15.514 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.507+0000 7f872cff9640 1 -- 172.21.15.80:0/3476317478 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f8734004b40 con 0x55905751c820 2024-04-26T18:38:15.514 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.507+0000 7f874e3c7740 10 client.15639 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:38:15.514 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.507+0000 7f874e3c7740 10 client.15639 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:38:15.515 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.507+0000 7f874e3c7740 20 client.15639 populate_metadata read hostname 'smithi080' 2024-04-26T18:38:15.515 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.507+0000 7f874e3c7740 1 --2- 172.21.15.80:0/3476317478 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x559057537280 0x559057539670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:15.515 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.507+0000 7f874e3c7740 4 client.15639 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:38:15.515 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.507+0000 7f874e3c7740 1 -- 172.21.15.80:0/3476317478 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559057490070 con 0x559057537280 2024-04-26T18:38:15.515 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.507+0000 7f8749376640 1 --2- 172.21.15.80:0/3476317478 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x559057537280 0x559057539670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:15.515 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.508+0000 7f872cff9640 10 client.15639 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:15.515 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.508+0000 7f8749376640 1 --2- 172.21.15.80:0/3476317478 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x559057537280 0x559057539670 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45c7fc4c01eb2025 server_cookie=d76189dd2bc4722 in_seq=0 out_seq=0 2024-04-26T18:38:15.515 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.508+0000 7f872cff9640 1 -- 172.21.15.80:0/3476317478 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559057490070 con 0x559057537280 2024-04-26T18:38:15.515 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.508+0000 7f872cff9640 10 client.15639 handle_command_reply: tid=0 2024-04-26T18:38:15.515 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.508+0000 7f874e3c7740 1 client.15639 shutdown 2024-04-26T18:38:15.515 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.508+0000 7f874e3c7740 1 -- 172.21.15.80:0/3476317478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55905751c820 msgr2=0x5590575246b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:15.515 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.508+0000 7f874e3c7740 1 --2- 172.21.15.80:0/3476317478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55905751c820 0x5590575246b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8734009230 tx=0x7f8734031740 comp rx=0 tx=0).stop 2024-04-26T18:38:15.515 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.508+0000 7f874e3c7740 1 -- 172.21.15.80:0/3476317478 shutdown_connections 2024-04-26T18:38:15.515 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.508+0000 7f874e3c7740 1 --2- 172.21.15.80:0/3476317478 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x559057537280 0x559057539670 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.515 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.508+0000 7f874e3c7740 1 --2- 172.21.15.80:0/3476317478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55905751c820 0x5590575246b0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.516 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.508+0000 7f874e3c7740 1 --2- 172.21.15.80:0/3476317478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5590575270e0 0x559057524bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.516 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.508+0000 7f874e3c7740 1 --2- 172.21.15.80:0/3476317478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55905751bf00 0x559057524170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.516 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.508+0000 7f874e3c7740 1 -- 172.21.15.80:0/3476317478 >> 172.21.15.80:0/3476317478 conn(0x559057518410 msgr2=0x55905751e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:15.516 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.508+0000 7f872cff9640 0 client.15639 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:15.516 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.509+0000 7f874e3c7740 1 -- 172.21.15.80:0/3476317478 shutdown_connections 2024-04-26T18:38:15.516 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.509+0000 7f874e3c7740 1 -- 172.21.15.80:0/3476317478 wait complete. 2024-04-26T18:38:15.516 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.509+0000 7f874e3c7740 20 client.15639 trim_cache size 0 max 16384 2024-04-26T18:38:15.527 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.523+0000 7f874e3c7740 1 Processor -- start 2024-04-26T18:38:15.527 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.523+0000 7f874e3c7740 1 -- start start 2024-04-26T18:38:15.527 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.523+0000 7f874e3c7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55905751bf00 0x559057517d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:15.527 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.523+0000 7f874e3c7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55905751c820 0x559057522a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:15.527 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.523+0000 7f874e3c7740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590575270e0 0x55905753ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:15.527 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.523+0000 7f874e3c7740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f87441b0590 con 0x5590575270e0 2024-04-26T18:38:15.527 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.523+0000 7f874e3c7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f87441b20d0 con 0x55905751bf00 2024-04-26T18:38:15.527 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.523+0000 7f874e3c7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f87441b0c60 con 0x55905751c820 2024-04-26T18:38:15.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.523+0000 7f8749b77640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590575270e0 0x55905753ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:15.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.523+0000 7f8749b77640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590575270e0 0x55905753ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49200/0 (socket says 172.21.15.80:49200) 2024-04-26T18:38:15.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.523+0000 7f8749b77640 1 -- 172.21.15.80:0/561051020 learned_addr learned my addr 172.21.15.80:0/561051020 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:15.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.523+0000 7f8749376640 1 --2- 172.21.15.80:0/561051020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55905751bf00 0x559057517d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:15.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.523+0000 7f8749b77640 1 -- 172.21.15.80:0/561051020 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55905751c820 msgr2=0x559057522a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:15.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.523+0000 7f8749b77640 1 --2- 172.21.15.80:0/561051020 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55905751c820 0x559057522a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.523+0000 7f8749b77640 1 -- 172.21.15.80:0/561051020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55905751bf00 msgr2=0x559057517d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:15.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.523+0000 7f8749b77640 1 --2- 172.21.15.80:0/561051020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55905751bf00 0x559057517d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.523+0000 7f8749b77640 1 -- 172.21.15.80:0/561051020 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559057523120 con 0x5590575270e0 2024-04-26T18:38:15.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.524+0000 7f8749b77640 1 --2- 172.21.15.80:0/561051020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590575270e0 0x55905753ef80 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f873c015090 tx=0x7f873c012f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37244abd82bd4f23 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:15.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.524+0000 7f872effd640 1 -- 172.21.15.80:0/561051020 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c020040 con 0x5590575270e0 2024-04-26T18:38:15.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.524+0000 7f872effd640 1 -- 172.21.15.80:0/561051020 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f873c004a00 con 0x5590575270e0 2024-04-26T18:38:15.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.524+0000 7f872effd640 1 -- 172.21.15.80:0/561051020 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c0053e0 con 0x5590575270e0 2024-04-26T18:38:15.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.524+0000 7f874e3c7740 1 -- 172.21.15.80:0/561051020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590575270e0 msgr2=0x55905753ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:15.528 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.524+0000 7f874e3c7740 1 --2- 172.21.15.80:0/561051020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590575270e0 0x55905753ef80 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f873c015090 tx=0x7f873c012f60 comp rx=0 tx=0).stop 2024-04-26T18:38:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.524+0000 7f874e3c7740 1 -- 172.21.15.80:0/561051020 shutdown_connections 2024-04-26T18:38:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.524+0000 7f874e3c7740 1 --2- 172.21.15.80:0/561051020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590575270e0 0x55905753ef80 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.524+0000 7f874e3c7740 1 --2- 172.21.15.80:0/561051020 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55905751c820 0x559057522a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.524+0000 7f874e3c7740 1 --2- 172.21.15.80:0/561051020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55905751bf00 0x559057517d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.524+0000 7f874e3c7740 1 -- 172.21.15.80:0/561051020 >> 172.21.15.80:0/561051020 conn(0x559057518410 msgr2=0x5590575249c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.524+0000 7f874e3c7740 1 -- 172.21.15.80:0/561051020 shutdown_connections 2024-04-26T18:38:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.524+0000 7f874e3c7740 1 -- 172.21.15.80:0/561051020 wait complete. 2024-04-26T18:38:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.525+0000 7f874e3c7740 1 -- start start 2024-04-26T18:38:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.525+0000 7f874e3c7740 1 Processor -- start 2024-04-26T18:38:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.525+0000 7f874e3c7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55905751bf00 0x5590575211b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.525+0000 7f874e3c7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55905751c820 0x5590575216f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.525+0000 7f874e3c7740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590575270e0 0x55905759c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.525+0000 7f874e3c7740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f87441b1a00 con 0x5590575270e0 2024-04-26T18:38:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.525+0000 7f874e3c7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f87441b1330 con 0x55905751bf00 2024-04-26T18:38:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.525+0000 7f874e3c7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f87441ae570 con 0x55905751c820 2024-04-26T18:38:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.525+0000 7f874e3c7740 10 client.0 _ll_register_callbacks cb 0x7f8734009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:38:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.525+0000 7f8749b77640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590575270e0 0x55905759c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.525+0000 7f8749b77640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590575270e0 0x55905759c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49202/0 (socket says 172.21.15.80:49202) 2024-04-26T18:38:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.525+0000 7f8749b77640 1 -- 172.21.15.80:0/4250614692 learned_addr learned my addr 172.21.15.80:0/4250614692 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.525+0000 7f8749376640 1 --2- 172.21.15.80:0/4250614692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55905751bf00 0x5590575211b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.525+0000 7f8748b75640 1 --2- 172.21.15.80:0/4250614692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55905751c820 0x5590575216f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.525+0000 7f8749b77640 1 -- 172.21.15.80:0/4250614692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55905751c820 msgr2=0x5590575216f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.525+0000 7f8749b77640 1 --2- 172.21.15.80:0/4250614692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55905751c820 0x5590575216f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.525+0000 7f8749b77640 1 -- 172.21.15.80:0/4250614692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55905751bf00 msgr2=0x5590575211b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.525+0000 7f8749b77640 1 --2- 172.21.15.80:0/4250614692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55905751bf00 0x5590575211b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.525+0000 7f8749b77640 1 -- 172.21.15.80:0/4250614692 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559057529840 con 0x5590575270e0 2024-04-26T18:38:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.525+0000 7f8748b75640 1 --2- 172.21.15.80:0/4250614692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55905751c820 0x5590575216f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:38:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.526+0000 7f8749b77640 1 --2- 172.21.15.80:0/4250614692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590575270e0 0x55905759c7f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f873c005080 tx=0x7f873c012bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7a68f36918b9d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.526+0000 7f872cff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:38:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.526+0000 7f872cff9640 1 -- 172.21.15.80:0/4250614692 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c020040 con 0x5590575270e0 2024-04-26T18:38:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.526+0000 7f874e3c7740 1 -- 172.21.15.80:0/4250614692 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f873c004a00 con 0x5590575270e0 2024-04-26T18:38:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.526+0000 7f872cff9640 1 -- 172.21.15.80:0/4250614692 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f873c019cb0 con 0x5590575270e0 2024-04-26T18:38:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.526+0000 7f872cff9640 1 -- 172.21.15.80:0/4250614692 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f873c043050 con 0x5590575270e0 2024-04-26T18:38:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.526+0000 7f874e3c7740 10 client.15645 fetch_fsmap learned FSMap version 27 2024-04-26T18:38:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.526+0000 7f874e3c7740 1 -- 172.21.15.80:0/4250614692 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55905759dc70 con 0x5590575270e0 2024-04-26T18:38:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.526+0000 7f872cff9640 1 -- 172.21.15.80:0/4250614692 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f873c004a00 con 0x5590575270e0 2024-04-26T18:38:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.526+0000 7f872cff9640 1 -- 172.21.15.80:0/4250614692 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f873c01b070 con 0x5590575270e0 2024-04-26T18:38:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.526+0000 7f874e3c7740 10 client.15645 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:38:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.526+0000 7f874e3c7740 10 client.15645 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:38:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.526+0000 7f874e3c7740 20 client.15645 populate_metadata read hostname 'smithi080' 2024-04-26T18:38:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.526+0000 7f874e3c7740 1 --2- 172.21.15.80:0/4250614692 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55905759e210 0x5590575a0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.526+0000 7f874e3c7740 4 client.15645 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:38:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.526+0000 7f874e3c7740 1 -- 172.21.15.80:0/4250614692 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559057489ee0 con 0x55905759e210 2024-04-26T18:38:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.527+0000 7f8749376640 1 --2- 172.21.15.80:0/4250614692 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55905759e210 0x5590575a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:15.532 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.527+0000 7f872cff9640 10 client.15645 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:15.532 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.527+0000 7f8749376640 1 --2- 172.21.15.80:0/4250614692 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55905759e210 0x5590575a0630 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c1a4b589429b7cd server_cookie=d51ebfcf570e0b94 in_seq=0 out_seq=0 2024-04-26T18:38:15.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.533+0000 7f872cff9640 1 -- 172.21.15.80:0/4250614692 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559057489ee0 con 0x55905759e210 2024-04-26T18:38:15.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.533+0000 7f872cff9640 10 client.15645 handle_command_reply: tid=0 2024-04-26T18:38:15.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.533+0000 7f874e3c7740 1 client.15645 shutdown 2024-04-26T18:38:15.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.533+0000 7f874e3c7740 1 -- 172.21.15.80:0/4250614692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590575270e0 msgr2=0x55905759c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:15.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.533+0000 7f874e3c7740 1 --2- 172.21.15.80:0/4250614692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590575270e0 0x55905759c7f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f873c005080 tx=0x7f873c012bd0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.533+0000 7f874e3c7740 1 -- 172.21.15.80:0/4250614692 shutdown_connections 2024-04-26T18:38:15.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.533+0000 7f874e3c7740 1 --2- 172.21.15.80:0/4250614692 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55905759e210 0x5590575a0630 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.533+0000 7f872cff9640 0 client.15645 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:15.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.533+0000 7f874e3c7740 1 --2- 172.21.15.80:0/4250614692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590575270e0 0x55905759c7f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.533+0000 7f874e3c7740 1 --2- 172.21.15.80:0/4250614692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55905751c820 0x5590575216f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.533+0000 7f874e3c7740 1 --2- 172.21.15.80:0/4250614692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55905751bf00 0x5590575211b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.534 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.533+0000 7f874e3c7740 1 -- 172.21.15.80:0/4250614692 >> 172.21.15.80:0/4250614692 conn(0x559057518410 msgr2=0x55905751e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.533+0000 7f874e3c7740 1 -- 172.21.15.80:0/4250614692 shutdown_connections 2024-04-26T18:38:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.533+0000 7f874e3c7740 1 -- 172.21.15.80:0/4250614692 wait complete. 2024-04-26T18:38:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.534+0000 7f874e3c7740 20 client.15645 trim_cache size 0 max 16384 2024-04-26T18:38:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:{ 2024-04-26T18:38:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "message": "", 2024-04-26T18:38:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "return_code": 0 2024-04-26T18:38:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:} 2024-04-26T18:38:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.534+0000 7f874b5da640 1 -- 172.21.15.80:0/447161202 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f87300a3df0 msgr2=0x7f87300a62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.534+0000 7f874b5da640 1 --2- 172.21.15.80:0/447161202 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f87300a3df0 0x7f87300a62b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f873c00fc30 tx=0x7f873c01a000 comp rx=0 tx=0).stop 2024-04-26T18:38:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.534+0000 7f874b5da640 1 -- 172.21.15.80:0/447161202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8744103be0 msgr2=0x7f8744101830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.534+0000 7f874b5da640 1 --2- 172.21.15.80:0/447161202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8744103be0 0x7f8744101830 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f874000d770 tx=0x7f874000dc30 comp rx=0 tx=0).stop 2024-04-26T18:38:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.534+0000 7f874b5da640 1 -- 172.21.15.80:0/447161202 shutdown_connections 2024-04-26T18:38:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.534+0000 7f874b5da640 1 --2- 172.21.15.80:0/447161202 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f87300a3df0 0x7f87300a62b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.534+0000 7f874b5da640 1 --2- 172.21.15.80:0/447161202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f874410cfb0 0x7f87441022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.534+0000 7f874b5da640 1 --2- 172.21.15.80:0/447161202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8744104500 0x7f8744101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.534+0000 7f874b5da640 1 --2- 172.21.15.80:0/447161202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8744103be0 0x7f8744101830 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.534+0000 7f874b5da640 1 -- 172.21.15.80:0/447161202 >> 172.21.15.80:0/447161202 conn(0x7f8744077bb0 msgr2=0x7f87440fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.534+0000 7f874b5da640 1 -- 172.21.15.80:0/447161202 shutdown_connections 2024-04-26T18:38:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:15.534+0000 7f874b5da640 1 -- 172.21.15.80:0/447161202 wait complete. 2024-04-26T18:38:15.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:15 smithi192 ceph-mon[32842]: pgmap v56: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-26T18:38:15.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:15 smithi082 ceph-mon[32808]: pgmap v56: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-26T18:38:15.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:15 smithi080 ceph-mon[29135]: pgmap v56: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-26T18:38:17.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:17 smithi192 ceph-mon[32842]: pgmap v57: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-04-26T18:38:17.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:17 smithi082 ceph-mon[32808]: pgmap v57: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-04-26T18:38:17.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:17 smithi080 ceph-mon[29135]: pgmap v57: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-04-26T18:38:19.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:19 smithi192 ceph-mon[32842]: pgmap v58: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-04-26T18:38:19.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:19 smithi082 ceph-mon[32808]: pgmap v58: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-04-26T18:38:19.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:19 smithi080 ceph-mon[29135]: pgmap v58: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-04-26T18:38:21.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:21 smithi192 ceph-mon[32842]: pgmap v59: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1023 B/s wr, 13 op/s 2024-04-26T18:38:21.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:21 smithi082 ceph-mon[32808]: pgmap v59: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1023 B/s wr, 13 op/s 2024-04-26T18:38:21.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:21 smithi080 ceph-mon[29135]: pgmap v59: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1023 B/s wr, 13 op/s 2024-04-26T18:38:23.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:23 smithi192 ceph-mon[32842]: pgmap v60: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1023 B/s wr, 9 op/s 2024-04-26T18:38:23.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:23 smithi082 ceph-mon[32808]: pgmap v60: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1023 B/s wr, 9 op/s 2024-04-26T18:38:23.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:23 smithi080 ceph-mon[29135]: pgmap v60: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1023 B/s wr, 9 op/s 2024-04-26T18:38:25.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:25 smithi192 ceph-mon[32842]: pgmap v61: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1023 B/s wr, 13 op/s 2024-04-26T18:38:25.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:25 smithi082 ceph-mon[32808]: pgmap v61: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1023 B/s wr, 13 op/s 2024-04-26T18:38:25.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:25 smithi080 ceph-mon[29135]: pgmap v61: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1023 B/s wr, 13 op/s 2024-04-26T18:38:27.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:27 smithi192 ceph-mon[32842]: pgmap v62: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1023 B/s wr, 8 op/s 2024-04-26T18:38:27.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:27 smithi082 ceph-mon[32808]: pgmap v62: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1023 B/s wr, 8 op/s 2024-04-26T18:38:27.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:27 smithi080 ceph-mon[29135]: pgmap v62: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1023 B/s wr, 8 op/s 2024-04-26T18:38:28.634 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.630+0000 7fe5b5023640 1 -- 172.21.15.80:0/4165782058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5b0101830 msgr2=0x7fe5b010f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:28.634 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.630+0000 7fe5b5023640 1 --2- 172.21.15.80:0/4165782058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5b0101830 0x7fe5b010f800 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8009cd0 tx=0x7fe5a802a8e0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.634 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.630+0000 7fe5b5023640 1 -- 172.21.15.80:0/4165782058 shutdown_connections 2024-04-26T18:38:28.634 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.630+0000 7fe5b5023640 1 --2- 172.21.15.80:0/4165782058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5b0101830 0x7fe5b010f800 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.630+0000 7fe5b5023640 1 --2- 172.21.15.80:0/4165782058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5b0100e70 0x7fe5b01012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.630+0000 7fe5b5023640 1 --2- 172.21.15.80:0/4165782058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5b0107950 0x7fe5b0107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.630+0000 7fe5b5023640 1 -- 172.21.15.80:0/4165782058 >> 172.21.15.80:0/4165782058 conn(0x7fe5b0077d90 msgr2=0x7fe5b00ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.631+0000 7fe5b5023640 1 -- 172.21.15.80:0/4165782058 shutdown_connections 2024-04-26T18:38:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.631+0000 7fe5b5023640 1 -- 172.21.15.80:0/4165782058 wait complete. 2024-04-26T18:38:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.631+0000 7fe5b5023640 1 Processor -- start 2024-04-26T18:38:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.631+0000 7fe5b5023640 1 -- start start 2024-04-26T18:38:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.632+0000 7fe5b5023640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5b0100e70 0x7fe5b0199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.632+0000 7fe5b5023640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5b0101830 0x7fe5b0199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.632+0000 7fe5b5023640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5b0107950 0x7fe5b019d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.632+0000 7fe5b5023640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b0112d10 con 0x7fe5b0100e70 2024-04-26T18:38:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.632+0000 7fe5b5023640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b0112b90 con 0x7fe5b0107950 2024-04-26T18:38:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.632+0000 7fe5b5023640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b0112e90 con 0x7fe5b0101830 2024-04-26T18:38:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.632+0000 7fe5aed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5b0100e70 0x7fe5b0199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.632+0000 7fe5aed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5b0100e70 0x7fe5b0199110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37794/0 (socket says 172.21.15.80:37794) 2024-04-26T18:38:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.632+0000 7fe5aed9d640 1 -- 172.21.15.80:0/3509657022 learned_addr learned my addr 172.21.15.80:0/3509657022 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.632+0000 7fe5af59e640 1 --2- 172.21.15.80:0/3509657022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5b0107950 0x7fe5b019d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.632+0000 7fe5a7fff640 1 --2- 172.21.15.80:0/3509657022 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5b0101830 0x7fe5b0199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.632+0000 7fe5aed9d640 1 -- 172.21.15.80:0/3509657022 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5b0101830 msgr2=0x7fe5b0199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.632+0000 7fe5aed9d640 1 --2- 172.21.15.80:0/3509657022 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5b0101830 0x7fe5b0199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.632+0000 7fe5aed9d640 1 -- 172.21.15.80:0/3509657022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5b0107950 msgr2=0x7fe5b019d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.632+0000 7fe5aed9d640 1 --2- 172.21.15.80:0/3509657022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5b0107950 0x7fe5b019d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.632+0000 7fe5aed9d640 1 -- 172.21.15.80:0/3509657022 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b019e100 con 0x7fe5b0100e70 2024-04-26T18:38:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.632+0000 7fe5a7fff640 1 --2- 172.21.15.80:0/3509657022 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5b0101830 0x7fe5b0199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:38:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.632+0000 7fe5aed9d640 1 --2- 172.21.15.80:0/3509657022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5b0100e70 0x7fe5b0199110 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000c970 tx=0x7fe5a000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:28.637 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.632+0000 7fe5acd99640 1 -- 172.21.15.80:0/3509657022 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0007bb0 con 0x7fe5b0100e70 2024-04-26T18:38:28.637 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.632+0000 7fe5acd99640 1 -- 172.21.15.80:0/3509657022 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5a0007d50 con 0x7fe5b0100e70 2024-04-26T18:38:28.637 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.632+0000 7fe5b5023640 1 -- 172.21.15.80:0/3509657022 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5b019e3f0 con 0x7fe5b0100e70 2024-04-26T18:38:28.637 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.632+0000 7fe5acd99640 1 -- 172.21.15.80:0/3509657022 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a000f450 con 0x7fe5b0100e70 2024-04-26T18:38:28.637 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.633+0000 7fe5b5023640 1 -- 172.21.15.80:0/3509657022 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5b01a5c80 con 0x7fe5b0100e70 2024-04-26T18:38:28.643 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.635+0000 7fe5acd99640 1 -- 172.21.15.80:0/3509657022 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fe5a0004f20 con 0x7fe5b0100e70 2024-04-26T18:38:28.644 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.635+0000 7fe5b7e1e740 1 Processor -- start 2024-04-26T18:38:28.644 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.635+0000 7fe5b7e1e740 1 -- start start 2024-04-26T18:38:28.644 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.635+0000 7fe5acd99640 1 --2- 172.21.15.80:0/3509657022 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fe59c0a3dc0 0x7fe59c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:28.644 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.635+0000 7fe5af59e640 1 --2- 172.21.15.80:0/3509657022 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fe59c0a3dc0 0x7fe59c0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:28.644 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.635+0000 7fe5acd99640 1 -- 172.21.15.80:0/3509657022 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fe5a00d0510 con 0x7fe5b0100e70 2024-04-26T18:38:28.644 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.636+0000 7fe5b7e1e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591449b2f00 0x5591449b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:28.644 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.636+0000 7fe5b7e1e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449b3820 0x5591449bdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:28.644 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.636+0000 7fe5b7e1e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591449be0e0 0x5591449c04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:28.644 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.636+0000 7fe5b7e1e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x559144919460 con 0x5591449b3820 2024-04-26T18:38:28.644 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.636+0000 7fe5b7e1e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5591448d3590 con 0x5591449b2f00 2024-04-26T18:38:28.644 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.636+0000 7fe5b7e1e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559144915420 con 0x5591449be0e0 2024-04-26T18:38:28.644 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.636+0000 7fe5a7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449b3820 0x5591449bdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:28.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.636+0000 7fe5a7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449b3820 0x5591449bdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37796/0 (socket says 172.21.15.80:37796) 2024-04-26T18:38:28.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.636+0000 7fe5a7fff640 1 -- 172.21.15.80:0/3980784988 learned_addr learned my addr 172.21.15.80:0/3980784988 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:28.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.636+0000 7fe5af59e640 1 --2- 172.21.15.80:0/3509657022 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fe59c0a3dc0 0x7fe59c0a6280 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8005e10 tx=0x7fe5a8005da0 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:28.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.636+0000 7fe5aed9d640 1 --2- 172.21.15.80:0/3980784988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591449b2f00 0x5591449b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:28.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.636+0000 7fe5a7fff640 1 -- 172.21.15.80:0/3980784988 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591449be0e0 msgr2=0x5591449c04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:28.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.636+0000 7fe5a7fff640 1 --2- 172.21.15.80:0/3980784988 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591449be0e0 0x5591449c04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.636+0000 7fe5a7fff640 1 -- 172.21.15.80:0/3980784988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591449b2f00 msgr2=0x5591449b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:28.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.636+0000 7fe5a7fff640 1 --2- 172.21.15.80:0/3980784988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591449b2f00 0x5591449b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.636+0000 7fe5a7fff640 1 -- 172.21.15.80:0/3980784988 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591448e00d0 con 0x5591449b3820 2024-04-26T18:38:28.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.636+0000 7fe5a7fff640 1 --2- 172.21.15.80:0/3980784988 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449b3820 0x5591449bdba0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe59800bd30 tx=0x7fe59800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40670423d4e6a56b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:28.645 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.636+0000 7fe5a57fa640 1 -- 172.21.15.80:0/3980784988 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe598015070 con 0x5591449b3820 2024-04-26T18:38:28.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.636+0000 7fe5a57fa640 1 -- 172.21.15.80:0/3980784988 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe59800be20 con 0x5591449b3820 2024-04-26T18:38:28.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.637+0000 7fe5a57fa640 1 -- 172.21.15.80:0/3980784988 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe598011970 con 0x5591449b3820 2024-04-26T18:38:28.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.637+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/3980784988 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449b3820 msgr2=0x5591449bdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:28.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.637+0000 7fe5b7e1e740 1 --2- 172.21.15.80:0/3980784988 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449b3820 0x5591449bdba0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe59800bd30 tx=0x7fe59800f730 comp rx=0 tx=0).stop 2024-04-26T18:38:28.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.637+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/3980784988 shutdown_connections 2024-04-26T18:38:28.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.637+0000 7fe5b7e1e740 1 --2- 172.21.15.80:0/3980784988 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449b3820 0x5591449bdba0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.637+0000 7fe5b7e1e740 1 --2- 172.21.15.80:0/3980784988 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591449be0e0 0x5591449c04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.637+0000 7fe5b7e1e740 1 --2- 172.21.15.80:0/3980784988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591449b2f00 0x5591449b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.637+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/3980784988 >> 172.21.15.80:0/3980784988 conn(0x5591449af410 msgr2=0x5591449af7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:28.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.637+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/3980784988 shutdown_connections 2024-04-26T18:38:28.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.637+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/3980784988 wait complete. 2024-04-26T18:38:28.646 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.638+0000 7fe5b7e1e740 1 -- start start 2024-04-26T18:38:28.647 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.638+0000 7fe5b7e1e740 1 Processor -- start 2024-04-26T18:38:28.647 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.638+0000 7fe5b7e1e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449b2f00 0x5591449bb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:28.647 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.638+0000 7fe5b7e1e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591449b3820 0x5591449bb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:28.647 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.638+0000 7fe5b7e1e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591449be0e0 0x5591449bbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:28.647 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.638+0000 7fe5b7e1e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5591449c0d10 con 0x5591449b2f00 2024-04-26T18:38:28.647 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.638+0000 7fe5b7e1e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5591448a0b60 con 0x5591449b3820 2024-04-26T18:38:28.647 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.638+0000 7fe5b7e1e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5591449c0e90 con 0x5591449be0e0 2024-04-26T18:38:28.647 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.638+0000 7fe5b7e1e740 10 client.0 _ll_register_callbacks cb 0x5591448c52b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:38:28.648 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.638+0000 7fe5aed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449b2f00 0x5591449bb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:28.648 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.638+0000 7fe5aed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449b2f00 0x5591449bb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37802/0 (socket says 172.21.15.80:37802) 2024-04-26T18:38:28.648 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.638+0000 7fe5aed9d640 1 -- 172.21.15.80:0/338559869 learned_addr learned my addr 172.21.15.80:0/338559869 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:28.648 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.638+0000 7fe5af59e640 1 --2- 172.21.15.80:0/338559869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591449be0e0 0x5591449bbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:28.648 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.638+0000 7fe5aed9d640 1 -- 172.21.15.80:0/338559869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591449be0e0 msgr2=0x5591449bbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:28.648 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.638+0000 7fe5aed9d640 1 --2- 172.21.15.80:0/338559869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591449be0e0 0x5591449bbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.648 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.638+0000 7fe5a7fff640 1 --2- 172.21.15.80:0/338559869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591449b3820 0x5591449bb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:28.648 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.638+0000 7fe5aed9d640 1 -- 172.21.15.80:0/338559869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591449b3820 msgr2=0x5591449bb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:28.648 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.638+0000 7fe5aed9d640 1 --2- 172.21.15.80:0/338559869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591449b3820 0x5591449bb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.648 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.638+0000 7fe5aed9d640 1 -- 172.21.15.80:0/338559869 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55914462b210 con 0x5591449b2f00 2024-04-26T18:38:28.648 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.639+0000 7fe5aed9d640 1 --2- 172.21.15.80:0/338559869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449b2f00 0x5591449bb170 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00058c0 tx=0x7fe5a0005730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f728d4a1574073 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:28.648 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.639+0000 7fe5967fc640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:38:28.649 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.639+0000 7fe5967fc640 1 -- 172.21.15.80:0/338559869 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a00b5060 con 0x5591449b2f00 2024-04-26T18:38:28.649 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.639+0000 7fe5967fc640 1 -- 172.21.15.80:0/338559869 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fe5a0005210 con 0x5591449b2f00 2024-04-26T18:38:28.649 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.639+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/338559869 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe59800be20 con 0x5591449b2f00 2024-04-26T18:38:28.649 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.639+0000 7fe5967fc640 1 -- 172.21.15.80:0/338559869 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe5a001d040 con 0x5591449b2f00 2024-04-26T18:38:28.649 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.639+0000 7fe5b7e1e740 10 client.15657 fetch_fsmap learned FSMap version 27 2024-04-26T18:38:28.649 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.639+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/338559869 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5591446f7620 con 0x5591449b2f00 2024-04-26T18:38:28.649 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.639+0000 7fe5967fc640 1 -- 172.21.15.80:0/338559869 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe59800be20 con 0x5591449b2f00 2024-04-26T18:38:28.649 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.639+0000 7fe5967fc640 1 -- 172.21.15.80:0/338559869 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe5a009b950 con 0x5591449b2f00 2024-04-26T18:38:28.649 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.639+0000 7fe5b7e1e740 10 client.15657 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:38:28.649 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.639+0000 7fe5b7e1e740 10 client.15657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:38:28.649 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.639+0000 7fe5b7e1e740 20 client.15657 populate_metadata read hostname 'smithi080' 2024-04-26T18:38:28.649 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.639+0000 7fe5b7e1e740 1 --2- 172.21.15.80:0/338559869 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x5591449ce2e0 0x5591449d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:28.649 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.639+0000 7fe5b7e1e740 4 client.15657 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:38:28.650 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.639+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/338559869 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559144927070 con 0x5591449ce2e0 2024-04-26T18:38:28.650 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.640+0000 7fe5a7fff640 1 --2- 172.21.15.80:0/338559869 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x5591449ce2e0 0x5591449d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:28.650 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.640+0000 7fe5967fc640 10 client.15657 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:28.650 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.640+0000 7fe5a7fff640 1 --2- 172.21.15.80:0/338559869 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x5591449ce2e0 0x5591449d06d0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4593e32349fbdf15 server_cookie=41e3c2bf987f940a in_seq=0 out_seq=0 2024-04-26T18:38:28.650 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.641+0000 7fe5967fc640 1 -- 172.21.15.80:0/338559869 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559144927070 con 0x5591449ce2e0 2024-04-26T18:38:28.650 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.641+0000 7fe5967fc640 10 client.15657 handle_command_reply: tid=0 2024-04-26T18:38:28.650 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.641+0000 7fe5b7e1e740 1 client.15657 shutdown 2024-04-26T18:38:28.650 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.641+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/338559869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449b2f00 msgr2=0x5591449bb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:28.650 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.641+0000 7fe5b7e1e740 1 --2- 172.21.15.80:0/338559869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449b2f00 0x5591449bb170 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00058c0 tx=0x7fe5a0005730 comp rx=0 tx=0).stop 2024-04-26T18:38:28.650 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.641+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/338559869 shutdown_connections 2024-04-26T18:38:28.650 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.641+0000 7fe5b7e1e740 1 --2- 172.21.15.80:0/338559869 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x5591449ce2e0 0x5591449d06d0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.650 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.641+0000 7fe5b7e1e740 1 --2- 172.21.15.80:0/338559869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591449be0e0 0x5591449bbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.651 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.641+0000 7fe5967fc640 0 client.15657 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:28.651 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.641+0000 7fe5b7e1e740 1 --2- 172.21.15.80:0/338559869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591449b3820 0x5591449bb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.651 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.641+0000 7fe5b7e1e740 1 --2- 172.21.15.80:0/338559869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449b2f00 0x5591449bb170 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.651 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.641+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/338559869 >> 172.21.15.80:0/338559869 conn(0x5591449af410 msgr2=0x5591449b5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:28.651 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.641+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/338559869 shutdown_connections 2024-04-26T18:38:28.651 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.641+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/338559869 wait complete. 2024-04-26T18:38:28.651 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.641+0000 7fe5b7e1e740 20 client.15657 trim_cache size 0 max 16384 2024-04-26T18:38:28.655 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.656+0000 7fe5b7e1e740 1 Processor -- start 2024-04-26T18:38:28.656 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.656+0000 7fe5b7e1e740 1 -- start start 2024-04-26T18:38:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.656+0000 7fe5b7e1e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591449b2f00 0x5591449bd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.656+0000 7fe5b7e1e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449b3820 0x5591449b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.656+0000 7fe5b7e1e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591449be0e0 0x5591449d5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.656+0000 7fe5b7e1e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b01ae400 con 0x5591449b3820 2024-04-26T18:38:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.656+0000 7fe5b7e1e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b01aff40 con 0x5591449b2f00 2024-04-26T18:38:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.656+0000 7fe5b7e1e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b01aead0 con 0x5591449be0e0 2024-04-26T18:38:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.656+0000 7fe5a7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449b3820 0x5591449b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:28.663 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.656+0000 7fe5a7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449b3820 0x5591449b4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37806/0 (socket says 172.21.15.80:37806) 2024-04-26T18:38:28.663 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.656+0000 7fe5a7fff640 1 -- 172.21.15.80:0/2978221806 learned_addr learned my addr 172.21.15.80:0/2978221806 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:28.663 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.656+0000 7fe5af59e640 1 --2- 172.21.15.80:0/2978221806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591449be0e0 0x5591449d5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:28.663 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.656+0000 7fe5aed9d640 1 --2- 172.21.15.80:0/2978221806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591449b2f00 0x5591449bd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:28.663 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.656+0000 7fe5a7fff640 1 -- 172.21.15.80:0/2978221806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591449be0e0 msgr2=0x5591449d5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:28.663 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.656+0000 7fe5a7fff640 1 --2- 172.21.15.80:0/2978221806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591449be0e0 0x5591449d5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.663 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.656+0000 7fe5a7fff640 1 -- 172.21.15.80:0/2978221806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591449b2f00 msgr2=0x5591449bd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:28.663 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.656+0000 7fe5a7fff640 1 --2- 172.21.15.80:0/2978221806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591449b2f00 0x5591449bd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.664 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.656+0000 7fe5a7fff640 1 -- 172.21.15.80:0/2978221806 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591449c04d0 con 0x5591449b3820 2024-04-26T18:38:28.664 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.656+0000 7fe5aed9d640 1 --2- 172.21.15.80:0/2978221806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591449b2f00 0x5591449bd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:38:28.664 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.657+0000 7fe5a7fff640 1 --2- 172.21.15.80:0/2978221806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449b3820 0x5591449b4fc0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe59800bac0 tx=0x7fe59800b3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7766e074289a41e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:28.664 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.657+0000 7fe5a4ff9640 1 -- 172.21.15.80:0/2978221806 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59802b070 con 0x5591449b3820 2024-04-26T18:38:28.664 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.657+0000 7fe5a4ff9640 1 -- 172.21.15.80:0/2978221806 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5980055f0 con 0x5591449b3820 2024-04-26T18:38:28.664 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.657+0000 7fe5a4ff9640 1 -- 172.21.15.80:0/2978221806 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe598021070 con 0x5591449b3820 2024-04-26T18:38:28.664 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.657+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/2978221806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449b3820 msgr2=0x5591449b4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:28.664 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.657+0000 7fe5b7e1e740 1 --2- 172.21.15.80:0/2978221806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449b3820 0x5591449b4fc0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe59800bac0 tx=0x7fe59800b3a0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.664 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.657+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/2978221806 shutdown_connections 2024-04-26T18:38:28.664 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.657+0000 7fe5b7e1e740 1 --2- 172.21.15.80:0/2978221806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449b3820 0x5591449b4fc0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.664 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.657+0000 7fe5b7e1e740 1 --2- 172.21.15.80:0/2978221806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591449be0e0 0x5591449d5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.664 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.657+0000 7fe5b7e1e740 1 --2- 172.21.15.80:0/2978221806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591449b2f00 0x5591449bd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.665 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.657+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/2978221806 >> 172.21.15.80:0/2978221806 conn(0x5591449af410 msgr2=0x5591449b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:28.665 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.658+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/2978221806 shutdown_connections 2024-04-26T18:38:28.665 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.658+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/2978221806 wait complete. 2024-04-26T18:38:28.665 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.658+0000 7fe5b7e1e740 1 -- start start 2024-04-26T18:38:28.665 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.658+0000 7fe5b7e1e740 1 Processor -- start 2024-04-26T18:38:28.665 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.658+0000 7fe5b7e1e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591449b2f00 0x5591449c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:28.665 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.658+0000 7fe5b7e1e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591449b3820 0x5591449c2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:28.665 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.658+0000 7fe5b7e1e740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449be0e0 0x5591449c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:28.666 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.658+0000 7fe5b7e1e740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b01af870 con 0x5591449be0e0 2024-04-26T18:38:28.666 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.658+0000 7fe5b7e1e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b01af1a0 con 0x5591449b2f00 2024-04-26T18:38:28.666 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.658+0000 7fe5b7e1e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b01ac3e0 con 0x5591449b3820 2024-04-26T18:38:28.666 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.658+0000 7fe5b7e1e740 10 client.0 _ll_register_callbacks cb 0x7fe5a00980e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:38:28.666 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.658+0000 7fe5af59e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449be0e0 0x5591449c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:28.666 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.658+0000 7fe5af59e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449be0e0 0x5591449c2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37814/0 (socket says 172.21.15.80:37814) 2024-04-26T18:38:28.666 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.658+0000 7fe5af59e640 1 -- 172.21.15.80:0/2151062407 learned_addr learned my addr 172.21.15.80:0/2151062407 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:28.666 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.658+0000 7fe5a7fff640 1 --2- 172.21.15.80:0/2151062407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591449b3820 0x5591449c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:28.666 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.658+0000 7fe5aed9d640 1 --2- 172.21.15.80:0/2151062407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591449b2f00 0x5591449c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.659+0000 7fe5af59e640 1 -- 172.21.15.80:0/2151062407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591449b3820 msgr2=0x5591449c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.659+0000 7fe5af59e640 1 --2- 172.21.15.80:0/2151062407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591449b3820 0x5591449c2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.659+0000 7fe5af59e640 1 -- 172.21.15.80:0/2151062407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591449b2f00 msgr2=0x5591449c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.659+0000 7fe5af59e640 1 --2- 172.21.15.80:0/2151062407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591449b2f00 0x5591449c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.659+0000 7fe5af59e640 1 -- 172.21.15.80:0/2151062407 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591449c2ff0 con 0x5591449be0e0 2024-04-26T18:38:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.659+0000 7fe5af59e640 1 --2- 172.21.15.80:0/2151062407 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449be0e0 0x5591449c2ab0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8035000 tx=0x7fe5a80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9dec40c18ba917f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.659+0000 7fe5967fc640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:38:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.659+0000 7fe5967fc640 1 -- 172.21.15.80:0/2151062407 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a80305a0 con 0x5591449be0e0 2024-04-26T18:38:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.659+0000 7fe5967fc640 1 -- 172.21.15.80:0/2151062407 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fe5a8030740 con 0x5591449be0e0 2024-04-26T18:38:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.659+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/2151062407 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5980055f0 con 0x5591449be0e0 2024-04-26T18:38:28.668 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.659+0000 7fe5967fc640 1 -- 172.21.15.80:0/2151062407 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe5a8030940 con 0x5591449be0e0 2024-04-26T18:38:28.668 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.659+0000 7fe5b7e1e740 10 client.15663 fetch_fsmap learned FSMap version 27 2024-04-26T18:38:28.668 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.659+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/2151062407 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559144a35460 con 0x5591449be0e0 2024-04-26T18:38:28.668 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.659+0000 7fe5967fc640 1 -- 172.21.15.80:0/2151062407 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5980055f0 con 0x5591449be0e0 2024-04-26T18:38:28.668 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.659+0000 7fe5967fc640 1 -- 172.21.15.80:0/2151062407 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe5a8051070 con 0x5591449be0e0 2024-04-26T18:38:28.668 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.659+0000 7fe5b7e1e740 10 client.15663 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:38:28.668 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.659+0000 7fe5b7e1e740 10 client.15663 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:38:28.668 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.659+0000 7fe5b7e1e740 20 client.15663 populate_metadata read hostname 'smithi080' 2024-04-26T18:38:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.659+0000 7fe5b7e1e740 1 --2- 172.21.15.80:0/2151062407 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x559144a35c10 0x559144a38030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.659+0000 7fe5b7e1e740 4 client.15663 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:38:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.659+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/2151062407 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559144920ee0 con 0x559144a35c10 2024-04-26T18:38:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.660+0000 7fe5aed9d640 1 --2- 172.21.15.80:0/2151062407 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x559144a35c10 0x559144a38030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.660+0000 7fe5967fc640 10 client.15663 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.660+0000 7fe5aed9d640 1 --2- 172.21.15.80:0/2151062407 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x559144a35c10 0x559144a38030 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d39765fba2f696ba server_cookie=5b05f6ae5cf5fde8 in_seq=0 out_seq=0 2024-04-26T18:38:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.664+0000 7fe5967fc640 1 -- 172.21.15.80:0/2151062407 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559144920ee0 con 0x559144a35c10 2024-04-26T18:38:28.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.664+0000 7fe5967fc640 10 client.15663 handle_command_reply: tid=0 2024-04-26T18:38:28.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.664+0000 7fe5b7e1e740 1 client.15663 shutdown 2024-04-26T18:38:28.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.664+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/2151062407 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449be0e0 msgr2=0x5591449c2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:28.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.664+0000 7fe5b7e1e740 1 --2- 172.21.15.80:0/2151062407 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449be0e0 0x5591449c2ab0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8035000 tx=0x7fe5a80095c0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.664+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/2151062407 shutdown_connections 2024-04-26T18:38:28.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.664+0000 7fe5b7e1e740 1 --2- 172.21.15.80:0/2151062407 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x559144a35c10 0x559144a38030 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.664+0000 7fe5b7e1e740 1 --2- 172.21.15.80:0/2151062407 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591449be0e0 0x5591449c2ab0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.664+0000 7fe5b7e1e740 1 --2- 172.21.15.80:0/2151062407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591449b3820 0x5591449c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.664+0000 7fe5967fc640 0 client.15663 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:28.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.664+0000 7fe5b7e1e740 1 --2- 172.21.15.80:0/2151062407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591449b2f00 0x5591449c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.671 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.664+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/2151062407 >> 172.21.15.80:0/2151062407 conn(0x5591449af410 msgr2=0x5591449ae5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:28.672 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.664+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/2151062407 shutdown_connections 2024-04-26T18:38:28.672 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.664+0000 7fe5b7e1e740 1 -- 172.21.15.80:0/2151062407 wait complete. 2024-04-26T18:38:28.672 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.664+0000 7fe5b7e1e740 20 client.15663 trim_cache size 0 max 16384 2024-04-26T18:38:28.672 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:{ 2024-04-26T18:38:28.672 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "message": "", 2024-04-26T18:38:28.672 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "return_code": 0 2024-04-26T18:38:28.672 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:} 2024-04-26T18:38:28.673 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.664+0000 7fe5b5023640 1 -- 172.21.15.80:0/3509657022 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fe59c0a3dc0 msgr2=0x7fe59c0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:28.673 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.664+0000 7fe5b5023640 1 --2- 172.21.15.80:0/3509657022 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fe59c0a3dc0 0x7fe59c0a6280 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8005e10 tx=0x7fe5a8005da0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.673 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.664+0000 7fe5b5023640 1 -- 172.21.15.80:0/3509657022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5b0100e70 msgr2=0x7fe5b0199110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:28.673 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.664+0000 7fe5b5023640 1 --2- 172.21.15.80:0/3509657022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5b0100e70 0x7fe5b0199110 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000c970 tx=0x7fe5a000ce30 comp rx=0 tx=0).stop 2024-04-26T18:38:28.673 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.664+0000 7fe5b5023640 1 -- 172.21.15.80:0/3509657022 shutdown_connections 2024-04-26T18:38:28.673 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.664+0000 7fe5b5023640 1 --2- 172.21.15.80:0/3509657022 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fe59c0a3dc0 0x7fe59c0a6280 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.673 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.665+0000 7fe5b5023640 1 --2- 172.21.15.80:0/3509657022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5b0107950 0x7fe5b019d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.674 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.665+0000 7fe5b5023640 1 --2- 172.21.15.80:0/3509657022 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5b0101830 0x7fe5b0199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.674 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.665+0000 7fe5b5023640 1 --2- 172.21.15.80:0/3509657022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5b0100e70 0x7fe5b0199110 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:28.674 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.665+0000 7fe5b5023640 1 -- 172.21.15.80:0/3509657022 >> 172.21.15.80:0/3509657022 conn(0x7fe5b0077d90 msgr2=0x7fe5b0105990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:28.674 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.665+0000 7fe5b5023640 1 -- 172.21.15.80:0/3509657022 shutdown_connections 2024-04-26T18:38:28.674 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:28.665+0000 7fe5b5023640 1 -- 172.21.15.80:0/3509657022 wait complete. 2024-04-26T18:38:29.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:29 smithi192 ceph-mon[32842]: pgmap v63: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1023 B/s wr, 8 op/s 2024-04-26T18:38:29.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:29 smithi082 ceph-mon[32808]: pgmap v63: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1023 B/s wr, 8 op/s 2024-04-26T18:38:29.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:29 smithi080 ceph-mon[29135]: pgmap v63: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1023 B/s wr, 8 op/s 2024-04-26T18:38:31.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:31 smithi192 ceph-mon[32842]: pgmap v64: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-04-26T18:38:31.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:31 smithi082 ceph-mon[32808]: pgmap v64: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-04-26T18:38:31.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:31 smithi080 ceph-mon[29135]: pgmap v64: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-04-26T18:38:33.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:33 smithi192 ceph-mon[32842]: pgmap v65: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T18:38:33.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:33 smithi082 ceph-mon[32808]: pgmap v65: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T18:38:33.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:33 smithi080 ceph-mon[29135]: pgmap v65: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T18:38:34.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:34 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:38:34.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:34 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:38:34.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:34 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:38:34.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:34 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:38:34.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:34 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:38:34.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:34 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:38:34.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:34 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:38:34.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:34 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:38:34.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:34 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:38:34.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:34 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:38:34.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:34 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:38:34.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:34 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:38:35.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:35 smithi192 ceph-mon[32842]: pgmap v66: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-26T18:38:35.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:35 smithi082 ceph-mon[32808]: pgmap v66: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-26T18:38:35.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:35 smithi080 ceph-mon[29135]: pgmap v66: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-26T18:38:37.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:37 smithi192 ceph-mon[32842]: pgmap v67: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T18:38:37.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:37 smithi082 ceph-mon[32808]: pgmap v67: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T18:38:37.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:37 smithi080 ceph-mon[29135]: pgmap v67: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T18:38:39.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:39 smithi192 ceph-mon[32842]: pgmap v68: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T18:38:39.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:39 smithi082 ceph-mon[32808]: pgmap v68: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T18:38:39.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:39 smithi080 ceph-mon[29135]: pgmap v68: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T18:38:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.758+0000 7f4450d71640 1 -- 172.21.15.80:0/3776708316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f444c107860 msgr2=0x7f444c107c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.758+0000 7f4450d71640 1 --2- 172.21.15.80:0/3776708316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f444c107860 0x7f444c107c40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f443c009930 tx=0x7f443c02a420 comp rx=0 tx=0).stop 2024-04-26T18:38:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.758+0000 7f4450d71640 1 -- 172.21.15.80:0/3776708316 shutdown_connections 2024-04-26T18:38:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.758+0000 7f4450d71640 1 --2- 172.21.15.80:0/3776708316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f444c102210 0x7f444c10e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.758+0000 7f4450d71640 1 --2- 172.21.15.80:0/3776708316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f444c101850 0x7f444c101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.758+0000 7f4450d71640 1 --2- 172.21.15.80:0/3776708316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f444c107860 0x7f444c107c40 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.758+0000 7f4450d71640 1 -- 172.21.15.80:0/3776708316 >> 172.21.15.80:0/3776708316 conn(0x7f444c077bb0 msgr2=0x7f444c077fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.758+0000 7f4450d71640 1 -- 172.21.15.80:0/3776708316 shutdown_connections 2024-04-26T18:38:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.758+0000 7f4450d71640 1 -- 172.21.15.80:0/3776708316 wait complete. 2024-04-26T18:38:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.759+0000 7f4450d71640 1 Processor -- start 2024-04-26T18:38:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.759+0000 7f4450d71640 1 -- start start 2024-04-26T18:38:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.759+0000 7f4450d71640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f444c101850 0x7f444c10f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.759+0000 7f4450d71640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f444c102210 0x7f444c10f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.759+0000 7f4450d71640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f444c107860 0x7f444c10fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.759+0000 7f4450d71640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f444c112c20 con 0x7f444c101850 2024-04-26T18:38:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.759+0000 7f4450d71640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f444c112aa0 con 0x7f444c102210 2024-04-26T18:38:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.759+0000 7f4450d71640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f444c112da0 con 0x7f444c107860 2024-04-26T18:38:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.759+0000 7f444a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f444c101850 0x7f444c10f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.759+0000 7f444a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f444c101850 0x7f444c10f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48060/0 (socket says 172.21.15.80:48060) 2024-04-26T18:38:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.759+0000 7f444a59c640 1 -- 172.21.15.80:0/4189667327 learned_addr learned my addr 172.21.15.80:0/4189667327 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.759+0000 7f444ad9d640 1 --2- 172.21.15.80:0/4189667327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f444c107860 0x7f444c10fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.759+0000 7f444a59c640 1 -- 172.21.15.80:0/4189667327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f444c107860 msgr2=0x7f444c10fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.759+0000 7f444a59c640 1 --2- 172.21.15.80:0/4189667327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f444c107860 0x7f444c10fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.759+0000 7f444a59c640 1 -- 172.21.15.80:0/4189667327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f444c102210 msgr2=0x7f444c10f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.759+0000 7f444a59c640 1 --2- 172.21.15.80:0/4189667327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f444c102210 0x7f444c10f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.760+0000 7f444a59c640 1 -- 172.21.15.80:0/4189667327 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f444c1a7560 con 0x7f444c101850 2024-04-26T18:38:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.760+0000 7f444a59c640 1 --2- 172.21.15.80:0/4189667327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f444c101850 0x7f444c10f1b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f443c004770 tx=0x7f443c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:41.763 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.760+0000 7f443b7fe640 1 -- 172.21.15.80:0/4189667327 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c03f070 con 0x7f444c101850 2024-04-26T18:38:41.763 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.760+0000 7f443b7fe640 1 -- 172.21.15.80:0/4189667327 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f443c03b460 con 0x7f444c101850 2024-04-26T18:38:41.763 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.760+0000 7f4450d71640 1 -- 172.21.15.80:0/4189667327 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f444c1a77f0 con 0x7f444c101850 2024-04-26T18:38:41.763 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.760+0000 7f443b7fe640 1 -- 172.21.15.80:0/4189667327 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c035070 con 0x7f444c101850 2024-04-26T18:38:41.763 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.760+0000 7f4450d71640 1 -- 172.21.15.80:0/4189667327 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f444c1a7d30 con 0x7f444c101850 2024-04-26T18:38:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.762+0000 7f443b7fe640 1 -- 172.21.15.80:0/4189667327 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f443c03b8d0 con 0x7f444c101850 2024-04-26T18:38:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.762+0000 7f4453b65740 1 Processor -- start 2024-04-26T18:38:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.763+0000 7f4453b65740 1 -- start start 2024-04-26T18:38:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.763+0000 7f4453b65740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56471a5acf00 0x56471a5ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.763+0000 7f4453b65740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5ad820 0x56471a5b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.763+0000 7f4453b65740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56471a5b80e0 0x56471a5ba4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.763+0000 7f4453b65740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56471a513460 con 0x56471a5ad820 2024-04-26T18:38:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.763+0000 7f4453b65740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56471a4cd590 con 0x56471a5b80e0 2024-04-26T18:38:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.763+0000 7f4453b65740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56471a50f420 con 0x56471a5acf00 2024-04-26T18:38:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.763+0000 7f444a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5ad820 0x56471a5b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.763+0000 7f443b7fe640 1 --2- 172.21.15.80:0/4189667327 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f44340a3e40 0x7f44340a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.763+0000 7f444a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5ad820 0x56471a5b7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48068/0 (socket says 172.21.15.80:48068) 2024-04-26T18:38:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.763+0000 7f444a59c640 1 -- 172.21.15.80:0/1944986363 learned_addr learned my addr 172.21.15.80:0/1944986363 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.763+0000 7f4449d9b640 1 --2- 172.21.15.80:0/1944986363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56471a5b80e0 0x56471a5ba4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.763+0000 7f444ad9d640 1 --2- 172.21.15.80:0/1944986363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56471a5acf00 0x56471a5ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.763+0000 7f444ad9d640 1 --2- 172.21.15.80:0/4189667327 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f44340a3e40 0x7f44340a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.763+0000 7f443b7fe640 1 -- 172.21.15.80:0/4189667327 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f443c0f0b60 con 0x7f444c101850 2024-04-26T18:38:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.763+0000 7f444a59c640 1 -- 172.21.15.80:0/1944986363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56471a5acf00 msgr2=0x56471a5ad2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.763+0000 7f444a59c640 1 --2- 172.21.15.80:0/1944986363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56471a5acf00 0x56471a5ad2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.763+0000 7f444a59c640 1 -- 172.21.15.80:0/1944986363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56471a5b80e0 msgr2=0x56471a5ba4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.763+0000 7f444a59c640 1 --2- 172.21.15.80:0/1944986363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56471a5b80e0 0x56471a5ba4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.763+0000 7f444a59c640 1 -- 172.21.15.80:0/1944986363 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56471a4da0d0 con 0x56471a5ad820 2024-04-26T18:38:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.764+0000 7f444a59c640 1 --2- 172.21.15.80:0/1944986363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5ad820 0x56471a5b7ba0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f443c0bc850 tx=0x7f443c049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f337f881f3039c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.764+0000 7f444ad9d640 1 --2- 172.21.15.80:0/4189667327 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f44340a3e40 0x7f44340a6300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4444009fd0 tx=0x7f4444004a40 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.764+0000 7f4438ff9640 1 -- 172.21.15.80:0/1944986363 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c048070 con 0x56471a5ad820 2024-04-26T18:38:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.764+0000 7f4438ff9640 1 -- 172.21.15.80:0/1944986363 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f443c0bcb50 con 0x56471a5ad820 2024-04-26T18:38:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.764+0000 7f4438ff9640 1 -- 172.21.15.80:0/1944986363 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c0ee580 con 0x56471a5ad820 2024-04-26T18:38:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.764+0000 7f4453b65740 1 -- 172.21.15.80:0/1944986363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5ad820 msgr2=0x56471a5b7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.764+0000 7f4453b65740 1 --2- 172.21.15.80:0/1944986363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5ad820 0x56471a5b7ba0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f443c0bc850 tx=0x7f443c049000 comp rx=0 tx=0).stop 2024-04-26T18:38:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.765+0000 7f4453b65740 1 -- 172.21.15.80:0/1944986363 shutdown_connections 2024-04-26T18:38:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.765+0000 7f4453b65740 1 --2- 172.21.15.80:0/1944986363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5ad820 0x56471a5b7ba0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.765+0000 7f4453b65740 1 --2- 172.21.15.80:0/1944986363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56471a5b80e0 0x56471a5ba4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.765+0000 7f4453b65740 1 --2- 172.21.15.80:0/1944986363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56471a5acf00 0x56471a5ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.765+0000 7f4453b65740 1 -- 172.21.15.80:0/1944986363 >> 172.21.15.80:0/1944986363 conn(0x56471a5a9410 msgr2=0x56471a5a97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.765+0000 7f4453b65740 1 -- 172.21.15.80:0/1944986363 shutdown_connections 2024-04-26T18:38:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.765+0000 7f4453b65740 1 -- 172.21.15.80:0/1944986363 wait complete. 2024-04-26T18:38:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.765+0000 7f4453b65740 1 -- start start 2024-04-26T18:38:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.765+0000 7f4453b65740 1 Processor -- start 2024-04-26T18:38:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.765+0000 7f4453b65740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5acf00 0x56471a5b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.765+0000 7f4453b65740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56471a5ad820 0x56471a5b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.765+0000 7f4453b65740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56471a5b80e0 0x56471a5b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.765+0000 7f4453b65740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x56471a5baad0 con 0x56471a5acf00 2024-04-26T18:38:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.765+0000 7f4453b65740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56471a49ab60 con 0x56471a5b80e0 2024-04-26T18:38:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.765+0000 7f4453b65740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56471a5bac50 con 0x56471a5ad820 2024-04-26T18:38:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.765+0000 7f4453b65740 10 client.0 _ll_register_callbacks cb 0x56471a4bf2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:38:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.765+0000 7f444a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5acf00 0x56471a5b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.765+0000 7f444a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5acf00 0x56471a5b5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48080/0 (socket says 172.21.15.80:48080) 2024-04-26T18:38:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.765+0000 7f444a59c640 1 -- 172.21.15.80:0/2508051121 learned_addr learned my addr 172.21.15.80:0/2508051121 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.766+0000 7f4449d9b640 1 --2- 172.21.15.80:0/2508051121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56471a5ad820 0x56471a5b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.766+0000 7f444ad9d640 1 --2- 172.21.15.80:0/2508051121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56471a5b80e0 0x56471a5b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.766+0000 7f444a59c640 1 -- 172.21.15.80:0/2508051121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56471a5ad820 msgr2=0x56471a5b55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.766+0000 7f444a59c640 1 --2- 172.21.15.80:0/2508051121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56471a5ad820 0x56471a5b55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.766+0000 7f444a59c640 1 -- 172.21.15.80:0/2508051121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56471a5b80e0 msgr2=0x56471a5b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.766+0000 7f444a59c640 1 --2- 172.21.15.80:0/2508051121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56471a5b80e0 0x56471a5b5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.766+0000 7f444a59c640 1 -- 172.21.15.80:0/2508051121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56471a225210 con 0x56471a5acf00 2024-04-26T18:38:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.766+0000 7f4449d9b640 1 --2- 172.21.15.80:0/2508051121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56471a5ad820 0x56471a5b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:38:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.766+0000 7f444a59c640 1 --2- 172.21.15.80:0/2508051121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5acf00 0x56471a5b5060 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f443c0b9520 tx=0x7f443c0dd2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e97b4e6196db62b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.766+0000 7f4431ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:38:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.766+0000 7f4431ffb640 1 -- 172.21.15.80:0/2508051121 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c048040 con 0x56471a5acf00 2024-04-26T18:38:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.766+0000 7f4431ffb640 1 -- 172.21.15.80:0/2508051121 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f443c0bae50 con 0x56471a5acf00 2024-04-26T18:38:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.766+0000 7f4453b65740 1 -- 172.21.15.80:0/2508051121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f443c0bcb50 con 0x56471a5acf00 2024-04-26T18:38:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.766+0000 7f4431ffb640 1 -- 172.21.15.80:0/2508051121 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f443c0c57c0 con 0x56471a5acf00 2024-04-26T18:38:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.766+0000 7f4453b65740 10 client.15675 fetch_fsmap learned FSMap version 27 2024-04-26T18:38:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.766+0000 7f4453b65740 1 -- 172.21.15.80:0/2508051121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56471a2f1620 con 0x56471a5acf00 2024-04-26T18:38:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.766+0000 7f4431ffb640 1 -- 172.21.15.80:0/2508051121 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f443c0bcb50 con 0x56471a5acf00 2024-04-26T18:38:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.766+0000 7f4431ffb640 1 -- 172.21.15.80:0/2508051121 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f443c04b060 con 0x56471a5acf00 2024-04-26T18:38:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.767+0000 7f4453b65740 10 client.15675 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:38:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.767+0000 7f4453b65740 10 client.15675 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:38:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.767+0000 7f4453b65740 20 client.15675 populate_metadata read hostname 'smithi080' 2024-04-26T18:38:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.767+0000 7f4453b65740 1 --2- 172.21.15.80:0/2508051121 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x56471a5c7e00 0x56471a5ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.767+0000 7f4453b65740 4 client.15675 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:38:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.767+0000 7f4453b65740 1 -- 172.21.15.80:0/2508051121 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56471a521070 con 0x56471a5c7e00 2024-04-26T18:38:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.767+0000 7f4449d9b640 1 --2- 172.21.15.80:0/2508051121 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x56471a5c7e00 0x56471a5ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.767+0000 7f4431ffb640 10 client.15675 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.767+0000 7f4449d9b640 1 --2- 172.21.15.80:0/2508051121 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x56471a5c7e00 0x56471a5ca1f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1afa63b06d647fd8 server_cookie=76bf480eb52c4363 in_seq=0 out_seq=0 2024-04-26T18:38:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.768+0000 7f4431ffb640 1 -- 172.21.15.80:0/2508051121 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56471a521070 con 0x56471a5c7e00 2024-04-26T18:38:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.768+0000 7f4431ffb640 10 client.15675 handle_command_reply: tid=0 2024-04-26T18:38:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.768+0000 7f4453b65740 1 client.15675 shutdown 2024-04-26T18:38:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.768+0000 7f4453b65740 1 -- 172.21.15.80:0/2508051121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5acf00 msgr2=0x56471a5b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.768+0000 7f4453b65740 1 --2- 172.21.15.80:0/2508051121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5acf00 0x56471a5b5060 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f443c0b9520 tx=0x7f443c0dd2e0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.768+0000 7f4453b65740 1 -- 172.21.15.80:0/2508051121 shutdown_connections 2024-04-26T18:38:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.768+0000 7f4453b65740 1 --2- 172.21.15.80:0/2508051121 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x56471a5c7e00 0x56471a5ca1f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.768+0000 7f4453b65740 1 --2- 172.21.15.80:0/2508051121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56471a5b80e0 0x56471a5b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.768+0000 7f4453b65740 1 --2- 172.21.15.80:0/2508051121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56471a5ad820 0x56471a5b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.768+0000 7f4431ffb640 0 client.15675 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.768+0000 7f4453b65740 1 --2- 172.21.15.80:0/2508051121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5acf00 0x56471a5b5060 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.768+0000 7f4453b65740 1 -- 172.21.15.80:0/2508051121 >> 172.21.15.80:0/2508051121 conn(0x56471a5a9410 msgr2=0x56471a5af140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.768+0000 7f4453b65740 1 -- 172.21.15.80:0/2508051121 shutdown_connections 2024-04-26T18:38:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.768+0000 7f4453b65740 1 -- 172.21.15.80:0/2508051121 wait complete. 2024-04-26T18:38:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.768+0000 7f4453b65740 20 client.15675 trim_cache size 0 max 16384 2024-04-26T18:38:41.787 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.783+0000 7f4453b65740 1 Processor -- start 2024-04-26T18:38:41.788 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.783+0000 7f4453b65740 1 -- start start 2024-04-26T18:38:41.788 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.783+0000 7f4453b65740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5acf00 0x56471a5c3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:41.788 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.783+0000 7f4453b65740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56471a5ad820 0x56471a5a8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:41.788 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.783+0000 7f4453b65740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56471a5b80e0 0x56471a5cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:41.788 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.783+0000 7f4453b65740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f444c1b0630 con 0x56471a5acf00 2024-04-26T18:38:41.788 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.783+0000 7f4453b65740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f444c1b2170 con 0x56471a5ad820 2024-04-26T18:38:41.788 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.783+0000 7f4453b65740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f444c1b0d00 con 0x56471a5b80e0 2024-04-26T18:38:41.788 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.783+0000 7f444a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5acf00 0x56471a5c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:41.788 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.783+0000 7f444a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5acf00 0x56471a5c3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48092/0 (socket says 172.21.15.80:48092) 2024-04-26T18:38:41.788 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.783+0000 7f444a59c640 1 -- 172.21.15.80:0/350522042 learned_addr learned my addr 172.21.15.80:0/350522042 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:41.788 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.783+0000 7f4449d9b640 1 --2- 172.21.15.80:0/350522042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56471a5ad820 0x56471a5a8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:41.788 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.783+0000 7f444ad9d640 1 --2- 172.21.15.80:0/350522042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56471a5b80e0 0x56471a5cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:41.789 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.783+0000 7f444a59c640 1 -- 172.21.15.80:0/350522042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56471a5b80e0 msgr2=0x56471a5cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:41.789 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.783+0000 7f444a59c640 1 --2- 172.21.15.80:0/350522042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56471a5b80e0 0x56471a5cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.789 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.783+0000 7f444a59c640 1 -- 172.21.15.80:0/350522042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56471a5ad820 msgr2=0x56471a5a8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:41.789 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.783+0000 7f444a59c640 1 --2- 172.21.15.80:0/350522042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56471a5ad820 0x56471a5a8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.789 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.783+0000 7f444a59c640 1 -- 172.21.15.80:0/350522042 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56471a5a4d60 con 0x56471a5acf00 2024-04-26T18:38:41.789 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.784+0000 7f444a59c640 1 --2- 172.21.15.80:0/350522042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5acf00 0x56471a5c3900 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f443c0bc850 tx=0x7f443c0c56e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c245cc305faceda3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:41.789 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.784+0000 7f4433fff640 1 -- 172.21.15.80:0/350522042 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c048070 con 0x56471a5acf00 2024-04-26T18:38:41.789 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.784+0000 7f4433fff640 1 -- 172.21.15.80:0/350522042 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f443c0bcb50 con 0x56471a5acf00 2024-04-26T18:38:41.789 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.784+0000 7f4433fff640 1 -- 172.21.15.80:0/350522042 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c0bc920 con 0x56471a5acf00 2024-04-26T18:38:41.789 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.784+0000 7f4453b65740 1 -- 172.21.15.80:0/350522042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5acf00 msgr2=0x56471a5c3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:41.789 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.784+0000 7f4453b65740 1 --2- 172.21.15.80:0/350522042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5acf00 0x56471a5c3900 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f443c0bc850 tx=0x7f443c0c56e0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.789 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.784+0000 7f4453b65740 1 -- 172.21.15.80:0/350522042 shutdown_connections 2024-04-26T18:38:41.789 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.784+0000 7f4453b65740 1 --2- 172.21.15.80:0/350522042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56471a5b80e0 0x56471a5cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.789 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.784+0000 7f4453b65740 1 --2- 172.21.15.80:0/350522042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56471a5ad820 0x56471a5a8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.784+0000 7f4453b65740 1 --2- 172.21.15.80:0/350522042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5acf00 0x56471a5c3900 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.784+0000 7f4453b65740 1 -- 172.21.15.80:0/350522042 >> 172.21.15.80:0/350522042 conn(0x56471a5a9410 msgr2=0x56471a5a7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:41.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.784+0000 7f4453b65740 1 -- 172.21.15.80:0/350522042 shutdown_connections 2024-04-26T18:38:41.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.784+0000 7f4453b65740 1 -- 172.21.15.80:0/350522042 wait complete. 2024-04-26T18:38:41.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.785+0000 7f4453b65740 1 -- start start 2024-04-26T18:38:41.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.785+0000 7f4453b65740 1 Processor -- start 2024-04-26T18:38:41.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.785+0000 7f4453b65740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5acf00 0x56471a5bfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:41.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.785+0000 7f4453b65740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56471a5ad820 0x56471a5c0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:41.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.785+0000 7f4453b65740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56471a5b80e0 0x56471a5bcde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:41.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.785+0000 7f4453b65740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f444c1b1aa0 con 0x56471a5acf00 2024-04-26T18:38:41.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.785+0000 7f4453b65740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f444c1b13d0 con 0x56471a5ad820 2024-04-26T18:38:41.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.785+0000 7f4453b65740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f444c1ae610 con 0x56471a5b80e0 2024-04-26T18:38:41.790 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.785+0000 7f4453b65740 10 client.0 _ll_register_callbacks cb 0x7f444000b260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:38:41.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.785+0000 7f444a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5acf00 0x56471a5bfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:41.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.785+0000 7f444a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5acf00 0x56471a5bfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48098/0 (socket says 172.21.15.80:48098) 2024-04-26T18:38:41.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.785+0000 7f444a59c640 1 -- 172.21.15.80:0/3258176028 learned_addr learned my addr 172.21.15.80:0/3258176028 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:41.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.785+0000 7f4449d9b640 1 --2- 172.21.15.80:0/3258176028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56471a5ad820 0x56471a5c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:41.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.785+0000 7f444ad9d640 1 --2- 172.21.15.80:0/3258176028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56471a5b80e0 0x56471a5bcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:41.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.785+0000 7f444a59c640 1 -- 172.21.15.80:0/3258176028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56471a5b80e0 msgr2=0x56471a5bcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:41.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.785+0000 7f444a59c640 1 --2- 172.21.15.80:0/3258176028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56471a5b80e0 0x56471a5bcde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.785+0000 7f444a59c640 1 -- 172.21.15.80:0/3258176028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56471a5ad820 msgr2=0x56471a5c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:41.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.785+0000 7f444a59c640 1 --2- 172.21.15.80:0/3258176028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56471a5ad820 0x56471a5c0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.785+0000 7f444a59c640 1 -- 172.21.15.80:0/3258176028 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56471a5bd4d0 con 0x56471a5acf00 2024-04-26T18:38:41.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.785+0000 7f444ad9d640 1 --2- 172.21.15.80:0/3258176028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56471a5b80e0 0x56471a5bcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:38:41.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.785+0000 7f444a59c640 1 --2- 172.21.15.80:0/3258176028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5acf00 0x56471a5bfe10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f443c0b8fb0 tx=0x7f443c009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b634576273db720f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:41.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.785+0000 7f4431ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:38:41.791 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.785+0000 7f4431ffb640 1 -- 172.21.15.80:0/3258176028 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c048070 con 0x56471a5acf00 2024-04-26T18:38:41.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.786+0000 7f4431ffb640 1 -- 172.21.15.80:0/3258176028 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f443c0bbfa0 con 0x56471a5acf00 2024-04-26T18:38:41.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.786+0000 7f4453b65740 1 -- 172.21.15.80:0/3258176028 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f443c0bcb50 con 0x56471a5acf00 2024-04-26T18:38:41.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.786+0000 7f4431ffb640 1 -- 172.21.15.80:0/3258176028 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f443c0bc920 con 0x56471a5acf00 2024-04-26T18:38:41.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.786+0000 7f4453b65740 10 client.15681 fetch_fsmap learned FSMap version 27 2024-04-26T18:38:41.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.786+0000 7f4453b65740 1 -- 172.21.15.80:0/3258176028 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56471a5bd4d0 con 0x56471a5acf00 2024-04-26T18:38:41.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.786+0000 7f4431ffb640 1 -- 172.21.15.80:0/3258176028 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f443c0bcb50 con 0x56471a5acf00 2024-04-26T18:38:41.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.786+0000 7f4431ffb640 1 -- 172.21.15.80:0/3258176028 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f443c0bba10 con 0x56471a5acf00 2024-04-26T18:38:41.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.786+0000 7f4453b65740 10 client.15681 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:38:41.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.786+0000 7f4453b65740 10 client.15681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:38:41.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.786+0000 7f4453b65740 20 client.15681 populate_metadata read hostname 'smithi080' 2024-04-26T18:38:41.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.786+0000 7f4453b65740 1 --2- 172.21.15.80:0/3258176028 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x56471a62ee80 0x56471a631270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:41.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.786+0000 7f4453b65740 4 client.15681 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:38:41.792 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.786+0000 7f4453b65740 1 -- 172.21.15.80:0/3258176028 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56471a51aee0 con 0x56471a62ee80 2024-04-26T18:38:41.793 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.786+0000 7f4449d9b640 1 --2- 172.21.15.80:0/3258176028 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x56471a62ee80 0x56471a631270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:41.793 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.787+0000 7f4431ffb640 10 client.15681 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:41.793 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.787+0000 7f4449d9b640 1 --2- 172.21.15.80:0/3258176028 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x56471a62ee80 0x56471a631270 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=312c129bc443ead5 server_cookie=1acc34b5be00bbc0 in_seq=0 out_seq=0 2024-04-26T18:38:41.794 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.790+0000 7f4431ffb640 1 -- 172.21.15.80:0/3258176028 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56471a51aee0 con 0x56471a62ee80 2024-04-26T18:38:41.794 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.790+0000 7f4431ffb640 10 client.15681 handle_command_reply: tid=0 2024-04-26T18:38:41.794 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.790+0000 7f4453b65740 1 client.15681 shutdown 2024-04-26T18:38:41.794 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.790+0000 7f4453b65740 1 -- 172.21.15.80:0/3258176028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5acf00 msgr2=0x56471a5bfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:41.794 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.790+0000 7f4453b65740 1 --2- 172.21.15.80:0/3258176028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5acf00 0x56471a5bfe10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f443c0b8fb0 tx=0x7f443c009300 comp rx=0 tx=0).stop 2024-04-26T18:38:41.794 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.790+0000 7f4453b65740 1 -- 172.21.15.80:0/3258176028 shutdown_connections 2024-04-26T18:38:41.794 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.790+0000 7f4453b65740 1 --2- 172.21.15.80:0/3258176028 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x56471a62ee80 0x56471a631270 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.794 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.790+0000 7f4453b65740 1 --2- 172.21.15.80:0/3258176028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56471a5b80e0 0x56471a5bcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.794 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.790+0000 7f4453b65740 1 --2- 172.21.15.80:0/3258176028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56471a5ad820 0x56471a5c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.790+0000 7f4431ffb640 0 client.15681 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.790+0000 7f4453b65740 1 --2- 172.21.15.80:0/3258176028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56471a5acf00 0x56471a5bfe10 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.791+0000 7f4453b65740 1 -- 172.21.15.80:0/3258176028 >> 172.21.15.80:0/3258176028 conn(0x56471a5a9410 msgr2=0x56471a5a85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.791+0000 7f4453b65740 1 -- 172.21.15.80:0/3258176028 shutdown_connections 2024-04-26T18:38:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.791+0000 7f4453b65740 1 -- 172.21.15.80:0/3258176028 wait complete. 2024-04-26T18:38:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.791+0000 7f4453b65740 20 client.15681 trim_cache size 0 max 16384 2024-04-26T18:38:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:{ 2024-04-26T18:38:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "message": "", 2024-04-26T18:38:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "return_code": 0 2024-04-26T18:38:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:} 2024-04-26T18:38:41.796 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.791+0000 7f4450d71640 1 -- 172.21.15.80:0/4189667327 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f44340a3e40 msgr2=0x7f44340a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:41.796 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.791+0000 7f4450d71640 1 --2- 172.21.15.80:0/4189667327 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f44340a3e40 0x7f44340a6300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4444009fd0 tx=0x7f4444004a40 comp rx=0 tx=0).stop 2024-04-26T18:38:41.796 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.791+0000 7f4450d71640 1 -- 172.21.15.80:0/4189667327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f444c101850 msgr2=0x7f444c10f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:41.797 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.791+0000 7f4450d71640 1 --2- 172.21.15.80:0/4189667327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f444c101850 0x7f444c10f1b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f443c004770 tx=0x7f443c0042f0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.797 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.791+0000 7f4450d71640 1 -- 172.21.15.80:0/4189667327 shutdown_connections 2024-04-26T18:38:41.797 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.791+0000 7f4450d71640 1 --2- 172.21.15.80:0/4189667327 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f44340a3e40 0x7f44340a6300 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.797 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.791+0000 7f4450d71640 1 --2- 172.21.15.80:0/4189667327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f444c107860 0x7f444c10fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.797 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.791+0000 7f4450d71640 1 --2- 172.21.15.80:0/4189667327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f444c102210 0x7f444c10f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.797 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.791+0000 7f4450d71640 1 --2- 172.21.15.80:0/4189667327 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f444c101850 0x7f444c10f1b0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:41.797 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.791+0000 7f4450d71640 1 -- 172.21.15.80:0/4189667327 >> 172.21.15.80:0/4189667327 conn(0x7f444c077bb0 msgr2=0x7f444c0ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:41.797 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.791+0000 7f4450d71640 1 -- 172.21.15.80:0/4189667327 shutdown_connections 2024-04-26T18:38:41.797 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:41.791+0000 7f4450d71640 1 -- 172.21.15.80:0/4189667327 wait complete. 2024-04-26T18:38:41.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:41 smithi192 ceph-mon[32842]: pgmap v69: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-26T18:38:41.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:41 smithi082 ceph-mon[32808]: pgmap v69: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-26T18:38:41.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:41 smithi080 ceph-mon[29135]: pgmap v69: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-26T18:38:43.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:43 smithi192 ceph-mon[32842]: pgmap v70: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:38:43.890 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:38:43.917 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:43 smithi080 ceph-mon[29135]: pgmap v70: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:38:43.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:43 smithi082 ceph-mon[32808]: pgmap v70: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:38:44.141 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:38:45.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:45 smithi192 ceph-mon[32842]: pgmap v71: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-26T18:38:45.890 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:45 smithi080 ceph-mon[29135]: pgmap v71: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-26T18:38:45.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:45 smithi082 ceph-mon[32808]: pgmap v71: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-26T18:38:45.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.990+0000 7fbb57d28700 1 -- 172.21.15.80:0/1499462597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb50102320 msgr2=0x7fbb501027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:45.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.990+0000 7fbb57d28700 1 --2- 172.21.15.80:0/1499462597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb50102320 0x7fbb501027a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c009990 tx=0x7fbb4c009ca0 comp rx=0 tx=0).stop 2024-04-26T18:38:45.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.990+0000 7fbb57d28700 1 -- 172.21.15.80:0/1499462597 shutdown_connections 2024-04-26T18:38:45.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.990+0000 7fbb57d28700 1 --2- 172.21.15.80:0/1499462597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb50102ce0 0x7fbb5010f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:45.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.990+0000 7fbb57d28700 1 --2- 172.21.15.80:0/1499462597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb50108390 0x7fbb50108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:45.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.990+0000 7fbb57d28700 1 --2- 172.21.15.80:0/1499462597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb50102320 0x7fbb501027a0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:45.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.990+0000 7fbb57d28700 1 -- 172.21.15.80:0/1499462597 >> 172.21.15.80:0/1499462597 conn(0x7fbb500792d0 msgr2=0x7fbb500796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:45.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.990+0000 7fbb57d28700 1 -- 172.21.15.80:0/1499462597 shutdown_connections 2024-04-26T18:38:45.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.990+0000 7fbb57d28700 1 -- 172.21.15.80:0/1499462597 wait complete. 2024-04-26T18:38:45.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.991+0000 7fbb57d28700 1 Processor -- start 2024-04-26T18:38:45.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.991+0000 7fbb57d28700 1 -- start start 2024-04-26T18:38:45.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.991+0000 7fbb57d28700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb50102320 0x7fbb50109270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:45.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.991+0000 7fbb57d28700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb50102ce0 0x7fbb501097b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:45.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.991+0000 7fbb57d28700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb50108390 0x7fbb50109cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:45.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.991+0000 7fbb57d28700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fbb501125b0 con 0x7fbb50102ce0 2024-04-26T18:38:45.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.991+0000 7fbb57d28700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbb50112430 con 0x7fbb50102320 2024-04-26T18:38:45.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.991+0000 7fbb57d28700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbb50112730 con 0x7fbb50108390 2024-04-26T18:38:45.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.991+0000 7fbb552c3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb50102ce0 0x7fbb501097b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:45.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.991+0000 7fbb552c3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb50102ce0 0x7fbb501097b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38070/0 (socket says 172.21.15.80:38070) 2024-04-26T18:38:45.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.991+0000 7fbb552c3700 1 -- 172.21.15.80:0/315920088 learned_addr learned my addr 172.21.15.80:0/315920088 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:45.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.992+0000 7fbb552c3700 1 -- 172.21.15.80:0/315920088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb50108390 msgr2=0x7fbb50109cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:45.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.992+0000 7fbb552c3700 1 --2- 172.21.15.80:0/315920088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb50108390 0x7fbb50109cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:45.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.992+0000 7fbb55ac4700 1 --2- 172.21.15.80:0/315920088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb50102320 0x7fbb50109270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:45.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.992+0000 7fbb552c3700 1 -- 172.21.15.80:0/315920088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb50102320 msgr2=0x7fbb50109270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:45.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.992+0000 7fbb552c3700 1 --2- 172.21.15.80:0/315920088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb50102320 0x7fbb50109270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:46.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.992+0000 7fbb552c3700 1 -- 172.21.15.80:0/315920088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb501a82a0 con 0x7fbb50102ce0 2024-04-26T18:38:46.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.992+0000 7fbb55ac4700 1 --2- 172.21.15.80:0/315920088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb50102320 0x7fbb50109270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:38:46.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.992+0000 7fbb552c3700 1 --2- 172.21.15.80:0/315920088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb50102ce0 0x7fbb501097b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c000c00 tx=0x7fbb4c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:46.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.992+0000 7fbb46ffd700 1 -- 172.21.15.80:0/315920088 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c027070 con 0x7fbb50102ce0 2024-04-26T18:38:46.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.992+0000 7fbb46ffd700 1 -- 172.21.15.80:0/315920088 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb4c0041d0 con 0x7fbb50102ce0 2024-04-26T18:38:46.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.992+0000 7fbb57d28700 1 -- 172.21.15.80:0/315920088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb501a8530 con 0x7fbb50102ce0 2024-04-26T18:38:46.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.992+0000 7fbb46ffd700 1 -- 172.21.15.80:0/315920088 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c00f460 con 0x7fbb50102ce0 2024-04-26T18:38:46.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.992+0000 7fbb57d28700 1 -- 172.21.15.80:0/315920088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb501a8980 con 0x7fbb50102ce0 2024-04-26T18:38:46.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.993+0000 7fbb57d28700 1 -- 172.21.15.80:0/315920088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb5006a110 con 0x7fbb50102ce0 2024-04-26T18:38:46.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.994+0000 7fbb46ffd700 1 -- 172.21.15.80:0/315920088 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fbb4c02a070 con 0x7fbb50102ce0 2024-04-26T18:38:46.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.994+0000 7fbb46ffd700 1 --2- 172.21.15.80:0/315920088 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fbb3c0a3db0 0x7fbb3c0a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:46.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.995+0000 7fbb55ac4700 1 --2- 172.21.15.80:0/315920088 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fbb3c0a3db0 0x7fbb3c0a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:46.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.995+0000 7fbb46ffd700 1 -- 172.21.15.80:0/315920088 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7fbb4c0d17a0 con 0x7fbb50102ce0 2024-04-26T18:38:46.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.995+0000 7fbb55ac4700 1 --2- 172.21.15.80:0/315920088 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fbb3c0a3db0 0x7fbb3c0a6270 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbb40007900 tx=0x7fbb40008040 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:46.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:45.999+0000 7fbb46ffd700 1 -- 172.21.15.80:0/315920088 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbb4c05eff0 con 0x7fbb50102ce0 2024-04-26T18:38:46.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:46.253+0000 7fbb57d28700 1 -- 172.21.15.80:0/315920088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb501a8cb0 con 0x7fbb50102ce0 2024-04-26T18:38:46.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:46.254+0000 7fbb46ffd700 1 -- 172.21.15.80:0/315920088 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11918 (secure 0 0 0) 0x7fbb4c013070 con 0x7fbb50102ce0 2024-04-26T18:38:46.254 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:38:46.254 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1967550873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1967550873},{"type":"v1","addr":"172.21.15.80:6835","nonce":1967550873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/559541830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":559541830},{"type":"v1","addr":"172.21.15.80:6837","nonce":559541830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T18:33:08.347399+0000","modified":"2024-04-26T18:36:26.401600+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24434,"mds_1":24421,"mds_2":24404,"mds_3":24400,"mds_4":24394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14577":{"gid":14577,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6839/2137993298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":2137993298},{"type":"v1","addr":"172.21.15.80:6839","nonce":2137993298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6841/1544670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1544670},{"type":"v1","addr":"172.21.15.80:6841","nonce":1544670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24371":{"gid":24371,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/3564539039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3564539039},{"type":"v1","addr":"172.21.15.82:6833","nonce":3564539039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24379":{"gid":24379,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/572065563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":572065563},{"type":"v1","addr":"172.21.15.82:6835","nonce":572065563}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.192:6835/719058020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":719058020},{"type":"v1","addr":"172.21.15.192:6835","nonce":719058020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.192:6837/2361996920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2361996920},{"type":"v1","addr":"172.21.15.192:6837","nonce":2361996920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.82:6837/2084055551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2084055551},{"type":"v1","addr":"172.21.15.82:6837","nonce":2084055551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6839/2735406056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":2735406056},{"type":"v1","addr":"172.21.15.192:6839","nonce":2735406056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.82:6839/1482576497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1482576497},{"type":"v1","addr":"172.21.15.82:6839","nonce":1482576497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24434,"qdb_cluster":[24421,24400,24394,24404,24434]},"id":1}]} 2024-04-26T18:38:46.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:46.256+0000 7fbb57d28700 1 -- 172.21.15.80:0/315920088 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fbb3c0a3db0 msgr2=0x7fbb3c0a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:46.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:46.256+0000 7fbb57d28700 1 --2- 172.21.15.80:0/315920088 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fbb3c0a3db0 0x7fbb3c0a6270 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbb40007900 tx=0x7fbb40008040 comp rx=0 tx=0).stop 2024-04-26T18:38:46.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:46.256+0000 7fbb57d28700 1 -- 172.21.15.80:0/315920088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb50102ce0 msgr2=0x7fbb501097b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:46.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:46.256+0000 7fbb57d28700 1 --2- 172.21.15.80:0/315920088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb50102ce0 0x7fbb501097b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c000c00 tx=0x7fbb4c0047b0 comp rx=0 tx=0).stop 2024-04-26T18:38:46.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:46.256+0000 7fbb57d28700 1 -- 172.21.15.80:0/315920088 shutdown_connections 2024-04-26T18:38:46.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:46.256+0000 7fbb57d28700 1 --2- 172.21.15.80:0/315920088 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fbb3c0a3db0 0x7fbb3c0a6270 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:46.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:46.256+0000 7fbb57d28700 1 --2- 172.21.15.80:0/315920088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb50108390 0x7fbb50109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:46.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:46.256+0000 7fbb57d28700 1 --2- 172.21.15.80:0/315920088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb50102320 0x7fbb50109270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:46.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:46.256+0000 7fbb57d28700 1 --2- 172.21.15.80:0/315920088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb50102ce0 0x7fbb501097b0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:46.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:46.256+0000 7fbb57d28700 1 -- 172.21.15.80:0/315920088 >> 172.21.15.80:0/315920088 conn(0x7fbb500792d0 msgr2=0x7fbb501000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:46.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:46.256+0000 7fbb57d28700 1 -- 172.21.15.80:0/315920088 shutdown_connections 2024-04-26T18:38:46.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:46.256+0000 7fbb57d28700 1 -- 172.21.15.80:0/315920088 wait complete. 2024-04-26T18:38:46.258 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 27 2024-04-26T18:38:46.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:46 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/315920088' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:38:46.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:46 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/315920088' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:38:46.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:46 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/315920088' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:38:47.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:47 smithi080 ceph-mon[29135]: pgmap v72: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T18:38:47.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:47 smithi192 ceph-mon[32842]: pgmap v72: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T18:38:47.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:47 smithi082 ceph-mon[32808]: pgmap v72: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T18:38:48.748 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24434 quiesce db --set-id 79a7f30a --release --await' 2024-04-26T18:38:48.748 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24434 quiesce db --set-id 79a7f30a --release --await 2024-04-26T18:38:49.034 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:38:49.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:49 smithi080 ceph-mon[29135]: pgmap v73: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T18:38:49.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:49 smithi192 ceph-mon[32842]: pgmap v73: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T18:38:49.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:49 smithi082 ceph-mon[32808]: pgmap v73: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T18:38:50.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.920+0000 7f5d32c8c700 1 -- 172.21.15.80:0/421020387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d2c102310 msgr2=0x7f5d2c102790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:50.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.920+0000 7f5d32c8c700 1 --2- 172.21.15.80:0/421020387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d2c102310 0x7f5d2c102790 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5d18009990 tx=0x7f5d18009ca0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.920+0000 7f5d32c8c700 1 -- 172.21.15.80:0/421020387 shutdown_connections 2024-04-26T18:38:50.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.920+0000 7f5d32c8c700 1 --2- 172.21.15.80:0/421020387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d2c102cd0 0x7f5d2c10f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.920+0000 7f5d32c8c700 1 --2- 172.21.15.80:0/421020387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d2c108380 0x7f5d2c108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.920+0000 7f5d32c8c700 1 --2- 172.21.15.80:0/421020387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d2c102310 0x7f5d2c102790 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.920+0000 7f5d32c8c700 1 -- 172.21.15.80:0/421020387 >> 172.21.15.80:0/421020387 conn(0x7f5d2c079290 msgr2=0x7f5d2c0796a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:50.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.920+0000 7f5d32c8c700 1 -- 172.21.15.80:0/421020387 shutdown_connections 2024-04-26T18:38:50.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.920+0000 7f5d32c8c700 1 -- 172.21.15.80:0/421020387 wait complete. 2024-04-26T18:38:50.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.921+0000 7f5d32c8c700 1 Processor -- start 2024-04-26T18:38:50.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.921+0000 7f5d32c8c700 1 -- start start 2024-04-26T18:38:50.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.921+0000 7f5d32c8c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d2c102310 0x7f5d2c19e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:50.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.921+0000 7f5d32c8c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d2c102cd0 0x7f5d2c19ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:50.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.921+0000 7f5d32c8c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d2c108380 0x7f5d2c198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:50.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.921+0000 7f5d32c8c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c1124a0 con 0x7f5d2c102310 2024-04-26T18:38:50.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.921+0000 7f5d32c8c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c112320 con 0x7f5d2c108380 2024-04-26T18:38:50.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.921+0000 7f5d32c8c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c112620 con 0x7f5d2c102cd0 2024-04-26T18:38:50.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.921+0000 7f5d30a28700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d2c102310 0x7f5d2c19e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:50.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.921+0000 7f5d30a28700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d2c102310 0x7f5d2c19e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38096/0 (socket says 172.21.15.80:38096) 2024-04-26T18:38:50.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.921+0000 7f5d30a28700 1 -- 172.21.15.80:0/3561820541 learned_addr learned my addr 172.21.15.80:0/3561820541 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:50.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.921+0000 7f5d2bfff700 1 --2- 172.21.15.80:0/3561820541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d2c102cd0 0x7f5d2c19ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:50.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.922+0000 7f5d31229700 1 --2- 172.21.15.80:0/3561820541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d2c108380 0x7f5d2c198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:50.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.922+0000 7f5d30a28700 1 -- 172.21.15.80:0/3561820541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d2c102cd0 msgr2=0x7f5d2c19ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:50.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.922+0000 7f5d30a28700 1 --2- 172.21.15.80:0/3561820541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d2c102cd0 0x7f5d2c19ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.922+0000 7f5d30a28700 1 -- 172.21.15.80:0/3561820541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d2c108380 msgr2=0x7f5d2c198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:50.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.922+0000 7f5d30a28700 1 --2- 172.21.15.80:0/3561820541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d2c108380 0x7f5d2c198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.922+0000 7f5d30a28700 1 -- 172.21.15.80:0/3561820541 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d2c198fc0 con 0x7f5d2c102310 2024-04-26T18:38:50.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.922+0000 7f5d30a28700 1 --2- 172.21.15.80:0/3561820541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d2c102310 0x7f5d2c19e6a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5d2000c920 tx=0x7f5d2000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:50.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.922+0000 7f5d29ffb700 1 -- 172.21.15.80:0/3561820541 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d20004a30 con 0x7f5d2c102310 2024-04-26T18:38:50.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.922+0000 7f5d32c8c700 1 -- 172.21.15.80:0/3561820541 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d2c1992b0 con 0x7f5d2c102310 2024-04-26T18:38:50.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.922+0000 7f5d29ffb700 1 -- 172.21.15.80:0/3561820541 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d200054d0 con 0x7f5d2c102310 2024-04-26T18:38:50.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.923+0000 7f5d29ffb700 1 -- 172.21.15.80:0/3561820541 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d20007bd0 con 0x7f5d2c102310 2024-04-26T18:38:50.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.923+0000 7f5d32c8c700 1 -- 172.21.15.80:0/3561820541 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d2c1a5570 con 0x7f5d2c102310 2024-04-26T18:38:50.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.924+0000 7f5d29ffb700 1 -- 172.21.15.80:0/3561820541 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f5d20004bd0 con 0x7f5d2c102310 2024-04-26T18:38:50.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.925+0000 7f5d29ffb700 1 --2- 172.21.15.80:0/3561820541 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f5d1c0a3c90 0x7f5d1c0a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:50.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.925+0000 7f5d2bfff700 1 --2- 172.21.15.80:0/3561820541 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f5d1c0a3c90 0x7f5d1c0a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:50.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.925+0000 7f5d29ffb700 1 -- 172.21.15.80:0/3561820541 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f5d200cff40 con 0x7f5d2c102310 2024-04-26T18:38:50.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.926+0000 7f5d2bfff700 1 --2- 172.21.15.80:0/3561820541 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f5d1c0a3c90 0x7f5d1c0a6150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5d1800b5c0 tx=0x7f5d18005960 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:50.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.927+0000 7f5d3d51eb80 1 Processor -- start 2024-04-26T18:38:50.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.927+0000 7f5d3d51eb80 1 -- start start 2024-04-26T18:38:50.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.927+0000 7f5d3d51eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55555e7d61a0 0x55555e7d6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:50.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.927+0000 7f5d3d51eb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7d6ac0 0x55555e7e1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:50.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.927+0000 7f5d3d51eb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55555e7e1970 0x55555e7e3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:50.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.927+0000 7f5d3d51eb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55555e729840 con 0x55555e7d6ac0 2024-04-26T18:38:50.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.927+0000 7f5d3d51eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55555e6c86e0 con 0x55555e7d61a0 2024-04-26T18:38:50.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.927+0000 7f5d3d51eb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55555e725800 con 0x55555e7e1970 2024-04-26T18:38:50.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.927+0000 7f5d2bfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7d6ac0 0x55555e7e1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:50.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.927+0000 7f5d2bfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7d6ac0 0x55555e7e1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38100/0 (socket says 172.21.15.80:38100) 2024-04-26T18:38:50.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.927+0000 7f5d2bfff700 1 -- 172.21.15.80:0/1902715365 learned_addr learned my addr 172.21.15.80:0/1902715365 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:50.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.927+0000 7f5d30a28700 1 --2- 172.21.15.80:0/1902715365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55555e7d61a0 0x55555e7d6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:50.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.927+0000 7f5d2bfff700 1 -- 172.21.15.80:0/1902715365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55555e7e1970 msgr2=0x55555e7e3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:50.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.927+0000 7f5d2bfff700 1 --2- 172.21.15.80:0/1902715365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55555e7e1970 0x55555e7e3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.927+0000 7f5d2bfff700 1 -- 172.21.15.80:0/1902715365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55555e7d61a0 msgr2=0x55555e7d6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:50.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.927+0000 7f5d2bfff700 1 --2- 172.21.15.80:0/1902715365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55555e7d61a0 0x55555e7d6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.927+0000 7f5d2bfff700 1 -- 172.21.15.80:0/1902715365 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55555e6769d0 con 0x55555e7d6ac0 2024-04-26T18:38:50.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.927+0000 7f5d30a28700 1 --2- 172.21.15.80:0/1902715365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55555e7d61a0 0x55555e7d6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:38:50.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.927+0000 7f5d2bfff700 1 --2- 172.21.15.80:0/1902715365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7d6ac0 0x55555e7e1430 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5d18015000 tx=0x7f5d1801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f8d47e1aad5057 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:50.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.928+0000 7f5d16ffd700 1 -- 172.21.15.80:0/1902715365 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d18034070 con 0x55555e7d6ac0 2024-04-26T18:38:50.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.928+0000 7f5d16ffd700 1 -- 172.21.15.80:0/1902715365 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d18024930 con 0x55555e7d6ac0 2024-04-26T18:38:50.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.928+0000 7f5d16ffd700 1 -- 172.21.15.80:0/1902715365 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1802fa80 con 0x55555e7d6ac0 2024-04-26T18:38:50.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.928+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/1902715365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7d6ac0 msgr2=0x55555e7e1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:50.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.928+0000 7f5d3d51eb80 1 --2- 172.21.15.80:0/1902715365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7d6ac0 0x55555e7e1430 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5d18015000 tx=0x7f5d1801f000 comp rx=0 tx=0).stop 2024-04-26T18:38:50.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.928+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/1902715365 shutdown_connections 2024-04-26T18:38:50.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.928+0000 7f5d3d51eb80 1 --2- 172.21.15.80:0/1902715365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55555e7e1970 0x55555e7e3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.928+0000 7f5d3d51eb80 1 --2- 172.21.15.80:0/1902715365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55555e7d61a0 0x55555e7d6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.928+0000 7f5d3d51eb80 1 --2- 172.21.15.80:0/1902715365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7d6ac0 0x55555e7e1430 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.928+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/1902715365 >> 172.21.15.80:0/1902715365 conn(0x55555e703e40 msgr2=0x55555e7d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:50.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.928+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/1902715365 shutdown_connections 2024-04-26T18:38:50.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.928+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/1902715365 wait complete. 2024-04-26T18:38:50.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.929+0000 7f5d3d51eb80 1 -- start start 2024-04-26T18:38:50.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.929+0000 7f5d3d51eb80 1 Processor -- start 2024-04-26T18:38:50.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.929+0000 7f5d3d51eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55555e7d61a0 0x55555e7dc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:50.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.929+0000 7f5d3d51eb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55555e7d6ac0 0x55555e7dce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:50.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.929+0000 7f5d3d51eb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7e1970 0x55555e7dd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:50.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.929+0000 7f5d3d51eb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55555e7e44e0 con 0x55555e7e1970 2024-04-26T18:38:50.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.929+0000 7f5d3d51eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55555e68fa50 con 0x55555e7d61a0 2024-04-26T18:38:50.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.929+0000 7f5d3d51eb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55555e7e4660 con 0x55555e7d6ac0 2024-04-26T18:38:50.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.929+0000 7f5d3d51eb80 10 client.0 _ll_register_callbacks cb 0x55555e6bd680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:38:50.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.929+0000 7f5d31229700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7e1970 0x55555e7dd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:50.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.930+0000 7f5d31229700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7e1970 0x55555e7dd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38112/0 (socket says 172.21.15.80:38112) 2024-04-26T18:38:50.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.930+0000 7f5d31229700 1 -- 172.21.15.80:0/272790547 learned_addr learned my addr 172.21.15.80:0/272790547 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:50.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.930+0000 7f5d2bfff700 1 --2- 172.21.15.80:0/272790547 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55555e7d6ac0 0x55555e7dce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:50.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.930+0000 7f5d30a28700 1 --2- 172.21.15.80:0/272790547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55555e7d61a0 0x55555e7dc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:50.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.930+0000 7f5d31229700 1 -- 172.21.15.80:0/272790547 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55555e7d6ac0 msgr2=0x55555e7dce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:50.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.930+0000 7f5d31229700 1 --2- 172.21.15.80:0/272790547 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55555e7d6ac0 0x55555e7dce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.930+0000 7f5d31229700 1 -- 172.21.15.80:0/272790547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55555e7d61a0 msgr2=0x55555e7dc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:50.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.930+0000 7f5d31229700 1 --2- 172.21.15.80:0/272790547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55555e7d61a0 0x55555e7dc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.930+0000 7f5d31229700 1 -- 172.21.15.80:0/272790547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55555e7f1a70 con 0x55555e7e1970 2024-04-26T18:38:50.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.930+0000 7f5d2bfff700 1 --2- 172.21.15.80:0/272790547 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55555e7d6ac0 0x55555e7dce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:38:50.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.930+0000 7f5d30a28700 1 --2- 172.21.15.80:0/272790547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55555e7d61a0 0x55555e7dc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:38:50.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.930+0000 7f5d31229700 1 --2- 172.21.15.80:0/272790547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7e1970 0x55555e7dd3d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009f10 tx=0x7f5d24004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f4c45d233d158d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:50.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.930+0000 7f5d0bfff700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:38:50.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.930+0000 7f5d0bfff700 1 -- 172.21.15.80:0/272790547 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24007910 con 0x55555e7e1970 2024-04-26T18:38:50.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.930+0000 7f5d0bfff700 1 -- 172.21.15.80:0/272790547 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f5d24007ab0 con 0x55555e7e1970 2024-04-26T18:38:50.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.930+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/272790547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d18024930 con 0x55555e7e1970 2024-04-26T18:38:50.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.930+0000 7f5d0bfff700 1 -- 172.21.15.80:0/272790547 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5d24023050 con 0x55555e7e1970 2024-04-26T18:38:50.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.930+0000 7f5d3d51eb80 10 client.15699 fetch_fsmap learned FSMap version 27 2024-04-26T18:38:50.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.930+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/272790547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55555e7f3480 con 0x55555e7e1970 2024-04-26T18:38:50.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.930+0000 7f5d0bfff700 1 -- 172.21.15.80:0/272790547 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d18024930 con 0x55555e7e1970 2024-04-26T18:38:50.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.931+0000 7f5d0bfff700 1 -- 172.21.15.80:0/272790547 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f5d240143e0 con 0x55555e7e1970 2024-04-26T18:38:50.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.931+0000 7f5d3d51eb80 10 client.15699 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:38:50.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.931+0000 7f5d3d51eb80 10 client.15699 resolve_mds: validated gid 24434 aka daemon mds.b 2024-04-26T18:38:50.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.931+0000 7f5d3d51eb80 20 client.15699 populate_metadata read hostname 'smithi080' 2024-04-26T18:38:50.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.931+0000 7f5d3d51eb80 1 --2- 172.21.15.80:0/272790547 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55555e7f5ac0 0x55555e7f7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:50.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.931+0000 7f5d3d51eb80 4 client.15699 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:38:50.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.931+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/272790547 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55555e737220 con 0x55555e7f5ac0 2024-04-26T18:38:50.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.931+0000 7f5d30a28700 1 --2- 172.21.15.80:0/272790547 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55555e7f5ac0 0x55555e7f7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:50.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.931+0000 7f5d30a28700 1 --2- 172.21.15.80:0/272790547 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55555e7f5ac0 0x55555e7f7ef0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3e674dfce6edc6a server_cookie=b4969ebfc6c8e9ee in_seq=0 out_seq=0 2024-04-26T18:38:50.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.931+0000 7f5d0bfff700 10 client.15699 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:50.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.932+0000 7f5d0bfff700 1 -- 172.21.15.80:0/272790547 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55555e737220 con 0x55555e7f5ac0 2024-04-26T18:38:50.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.932+0000 7f5d0bfff700 10 client.15699 handle_command_reply: tid=0 2024-04-26T18:38:50.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.932+0000 7f5d3d51eb80 1 client.15699 shutdown 2024-04-26T18:38:50.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.932+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/272790547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7e1970 msgr2=0x55555e7dd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:50.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.932+0000 7f5d3d51eb80 1 --2- 172.21.15.80:0/272790547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7e1970 0x55555e7dd3d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009f10 tx=0x7f5d24004320 comp rx=0 tx=0).stop 2024-04-26T18:38:50.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.932+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/272790547 shutdown_connections 2024-04-26T18:38:50.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.932+0000 7f5d3d51eb80 1 --2- 172.21.15.80:0/272790547 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55555e7f5ac0 0x55555e7f7ef0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.932+0000 7f5d3d51eb80 1 --2- 172.21.15.80:0/272790547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7e1970 0x55555e7dd3d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.932+0000 7f5d3d51eb80 1 --2- 172.21.15.80:0/272790547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55555e7d61a0 0x55555e7dc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.932+0000 7f5d3d51eb80 1 --2- 172.21.15.80:0/272790547 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55555e7d6ac0 0x55555e7dce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.932+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/272790547 >> 172.21.15.80:0/272790547 conn(0x55555e703e40 msgr2=0x55555e7d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:50.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.932+0000 7f5d0bfff700 0 client.15699 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:50.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.932+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/272790547 shutdown_connections 2024-04-26T18:38:50.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.932+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/272790547 wait complete. 2024-04-26T18:38:50.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.933+0000 7f5d3d51eb80 20 client.15699 trim_cache size 0 max 16384 2024-04-26T18:38:50.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.951+0000 7f5d3d51eb80 1 Processor -- start 2024-04-26T18:38:50.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.951+0000 7f5d3d51eb80 1 -- start start 2024-04-26T18:38:50.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.952+0000 7f5d3d51eb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55555e7d61a0 0x55555e7e58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:50.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.952+0000 7f5d3d51eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55555e7d6ac0 0x55555e7dd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:50.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.952+0000 7f5d3d51eb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7e1970 0x55555e7fd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:50.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.952+0000 7f5d3d51eb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c1ab5f0 con 0x55555e7e1970 2024-04-26T18:38:50.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.952+0000 7f5d3d51eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c1ad130 con 0x55555e7d6ac0 2024-04-26T18:38:50.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.952+0000 7f5d3d51eb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c1abcc0 con 0x55555e7d61a0 2024-04-26T18:38:50.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.952+0000 7f5d31229700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7e1970 0x55555e7fd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:50.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.952+0000 7f5d31229700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7e1970 0x55555e7fd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38124/0 (socket says 172.21.15.80:38124) 2024-04-26T18:38:50.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.952+0000 7f5d31229700 1 -- 172.21.15.80:0/1292014495 learned_addr learned my addr 172.21.15.80:0/1292014495 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:50.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.952+0000 7f5d31229700 1 -- 172.21.15.80:0/1292014495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55555e7d61a0 msgr2=0x55555e7e58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:50.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.952+0000 7f5d30a28700 1 --2- 172.21.15.80:0/1292014495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55555e7d61a0 0x55555e7e58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:50.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.952+0000 7f5d2bfff700 1 --2- 172.21.15.80:0/1292014495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55555e7d6ac0 0x55555e7dd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:50.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.952+0000 7f5d31229700 1 --2- 172.21.15.80:0/1292014495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55555e7d61a0 0x55555e7e58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.952+0000 7f5d31229700 1 -- 172.21.15.80:0/1292014495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55555e7d6ac0 msgr2=0x55555e7dd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:50.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.952+0000 7f5d31229700 1 --2- 172.21.15.80:0/1292014495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55555e7d6ac0 0x55555e7dd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.952+0000 7f5d31229700 1 -- 172.21.15.80:0/1292014495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55555e7e62e0 con 0x55555e7e1970 2024-04-26T18:38:50.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.952+0000 7f5d31229700 1 --2- 172.21.15.80:0/1292014495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7e1970 0x55555e7fd7c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5d240061e0 tx=0x7f5d240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc468243a10d9409 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:50.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.952+0000 7f5d167fc700 1 -- 172.21.15.80:0/1292014495 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24014c70 con 0x55555e7e1970 2024-04-26T18:38:50.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.952+0000 7f5d167fc700 1 -- 172.21.15.80:0/1292014495 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d2401a070 con 0x55555e7e1970 2024-04-26T18:38:50.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.952+0000 7f5d167fc700 1 -- 172.21.15.80:0/1292014495 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24007e60 con 0x55555e7e1970 2024-04-26T18:38:50.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.953+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/1292014495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7e1970 msgr2=0x55555e7fd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:50.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.953+0000 7f5d3d51eb80 1 --2- 172.21.15.80:0/1292014495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7e1970 0x55555e7fd7c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5d240061e0 tx=0x7f5d240091d0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.953+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/1292014495 shutdown_connections 2024-04-26T18:38:50.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.953+0000 7f5d3d51eb80 1 --2- 172.21.15.80:0/1292014495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7e1970 0x55555e7fd7c0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.953+0000 7f5d3d51eb80 1 --2- 172.21.15.80:0/1292014495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55555e7d61a0 0x55555e7e58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.953+0000 7f5d3d51eb80 1 --2- 172.21.15.80:0/1292014495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55555e7d6ac0 0x55555e7dd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.953+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/1292014495 >> 172.21.15.80:0/1292014495 conn(0x55555e703e40 msgr2=0x55555e7dc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:50.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.953+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/1292014495 shutdown_connections 2024-04-26T18:38:50.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.953+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/1292014495 wait complete. 2024-04-26T18:38:50.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.953+0000 7f5d3d51eb80 1 -- start start 2024-04-26T18:38:50.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.953+0000 7f5d3d51eb80 1 Processor -- start 2024-04-26T18:38:50.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.954+0000 7f5d3d51eb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7d61a0 0x55555e7f14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:50.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.954+0000 7f5d3d51eb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55555e7d6ac0 0x55555e7ed860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:50.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.954+0000 7f5d3d51eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55555e7e1970 0x55555e7edfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:50.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.954+0000 7f5d3d51eb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c1aca60 con 0x55555e7d61a0 2024-04-26T18:38:50.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.954+0000 7f5d3d51eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c1ac390 con 0x55555e7e1970 2024-04-26T18:38:50.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.954+0000 7f5d3d51eb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c1a9590 con 0x55555e7d6ac0 2024-04-26T18:38:50.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.954+0000 7f5d3d51eb80 10 client.0 _ll_register_callbacks cb 0x55555e6bd680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:38:50.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.954+0000 7f5d30a28700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7d61a0 0x55555e7f14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:50.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.954+0000 7f5d30a28700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7d61a0 0x55555e7f14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38132/0 (socket says 172.21.15.80:38132) 2024-04-26T18:38:50.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.954+0000 7f5d30a28700 1 -- 172.21.15.80:0/41924951 learned_addr learned my addr 172.21.15.80:0/41924951 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:50.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.954+0000 7f5d30a28700 1 -- 172.21.15.80:0/41924951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55555e7d6ac0 msgr2=0x55555e7ed860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:50.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.954+0000 7f5d2bfff700 1 --2- 172.21.15.80:0/41924951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55555e7d6ac0 0x55555e7ed860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:50.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.954+0000 7f5d31229700 1 --2- 172.21.15.80:0/41924951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55555e7e1970 0x55555e7edfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:50.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.954+0000 7f5d30a28700 1 --2- 172.21.15.80:0/41924951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55555e7d6ac0 0x55555e7ed860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.954+0000 7f5d30a28700 1 -- 172.21.15.80:0/41924951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55555e7e1970 msgr2=0x55555e7edfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:50.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.954+0000 7f5d30a28700 1 --2- 172.21.15.80:0/41924951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55555e7e1970 0x55555e7edfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.954+0000 7f5d30a28700 1 -- 172.21.15.80:0/41924951 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55555e85c040 con 0x55555e7d61a0 2024-04-26T18:38:50.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.954+0000 7f5d30a28700 1 --2- 172.21.15.80:0/41924951 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7d61a0 0x55555e7f14d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5d2009bc30 tx=0x7f5d2009c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ecd3d3b4dab83b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:50.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.954+0000 7f5d0bfff700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:38:50.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.955+0000 7f5d0bfff700 1 -- 172.21.15.80:0/41924951 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d200a4ba0 con 0x55555e7d61a0 2024-04-26T18:38:50.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.955+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/41924951 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d2401a070 con 0x55555e7d61a0 2024-04-26T18:38:50.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.955+0000 7f5d0bfff700 1 -- 172.21.15.80:0/41924951 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f5d200985a0 con 0x55555e7d61a0 2024-04-26T18:38:50.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.955+0000 7f5d0bfff700 1 -- 172.21.15.80:0/41924951 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5d200b52a0 con 0x55555e7d61a0 2024-04-26T18:38:50.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.955+0000 7f5d3d51eb80 10 client.15705 fetch_fsmap learned FSMap version 27 2024-04-26T18:38:50.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.955+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/41924951 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55555e85d290 con 0x55555e7d61a0 2024-04-26T18:38:50.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.955+0000 7f5d0bfff700 1 -- 172.21.15.80:0/41924951 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d2401a070 con 0x55555e7d61a0 2024-04-26T18:38:50.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.955+0000 7f5d0bfff700 1 -- 172.21.15.80:0/41924951 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f5d20020060 con 0x55555e7d61a0 2024-04-26T18:38:50.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.955+0000 7f5d3d51eb80 10 client.15705 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:38:50.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.955+0000 7f5d3d51eb80 10 client.15705 resolve_mds: validated gid 24434 aka daemon mds.b 2024-04-26T18:38:50.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.955+0000 7f5d3d51eb80 20 client.15705 populate_metadata read hostname 'smithi080' 2024-04-26T18:38:50.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.955+0000 7f5d3d51eb80 1 --2- 172.21.15.80:0/41924951 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55555e85d9f0 0x55555e85fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:50.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.955+0000 7f5d3d51eb80 4 client.15705 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "79a7f30a", "release": true, "await": true}] 2024-04-26T18:38:50.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.955+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/41924951 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "quiesce db", "set_id": "79a7f30a", "release": true, "await": true}) -- 0x55555e7312c0 con 0x55555e85d9f0 2024-04-26T18:38:50.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.955+0000 7f5d2bfff700 1 --2- 172.21.15.80:0/41924951 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55555e85d9f0 0x55555e85fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:50.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.956+0000 7f5d2bfff700 1 --2- 172.21.15.80:0/41924951 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55555e85d9f0 0x55555e85fe10 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8683f26767315df1 server_cookie=cce85e65237c5ade in_seq=0 out_seq=0 2024-04-26T18:38:50.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.956+0000 7f5d0bfff700 10 client.15705 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:50.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.959+0000 7f5d0bfff700 1 -- 172.21.15.80:0/41924951 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55555e7312c0 con 0x55555e85d9f0 2024-04-26T18:38:50.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.959+0000 7f5d0bfff700 10 client.15705 handle_command_reply: tid=0 2024-04-26T18:38:50.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.959+0000 7f5d3d51eb80 1 client.15705 shutdown 2024-04-26T18:38:50.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.959+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/41924951 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7d61a0 msgr2=0x55555e7f14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:50.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.959+0000 7f5d3d51eb80 1 --2- 172.21.15.80:0/41924951 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7d61a0 0x55555e7f14d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5d2009bc30 tx=0x7f5d2009c6e0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.959+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/41924951 shutdown_connections 2024-04-26T18:38:50.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.959+0000 7f5d3d51eb80 1 --2- 172.21.15.80:0/41924951 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55555e85d9f0 0x55555e85fe10 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.959+0000 7f5d3d51eb80 1 --2- 172.21.15.80:0/41924951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55555e7e1970 0x55555e7edfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.959+0000 7f5d3d51eb80 1 --2- 172.21.15.80:0/41924951 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55555e7d61a0 0x55555e7f14d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.959+0000 7f5d3d51eb80 1 --2- 172.21.15.80:0/41924951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55555e7d6ac0 0x55555e7ed860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.959+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/41924951 >> 172.21.15.80:0/41924951 conn(0x55555e703e40 msgr2=0x55555e7dd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:50.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.959+0000 7f5d0bfff700 0 client.15705 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:50.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.960+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/41924951 shutdown_connections 2024-04-26T18:38:50.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.960+0000 7f5d3d51eb80 1 -- 172.21.15.80:0/41924951 wait complete. 2024-04-26T18:38:50.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.960+0000 7f5d3d51eb80 20 client.15705 trim_cache size 0 max 16384 2024-04-26T18:38:50.964 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:38:50.964 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 27, 2024-04-26T18:38:50.964 INFO:teuthology.orchestra.run.smithi080.stdout: "leader": 24434, 2024-04-26T18:38:50.964 INFO:teuthology.orchestra.run.smithi080.stdout: "set_version": 8, 2024-04-26T18:38:50.964 INFO:teuthology.orchestra.run.smithi080.stdout: "sets": { 2024-04-26T18:38:50.964 INFO:teuthology.orchestra.run.smithi080.stdout: "79a7f30a": { 2024-04-26T18:38:50.964 INFO:teuthology.orchestra.run.smithi080.stdout: "version": 8, 2024-04-26T18:38:50.964 INFO:teuthology.orchestra.run.smithi080.stdout: "age_ref": 0.0, 2024-04-26T18:38:50.964 INFO:teuthology.orchestra.run.smithi080.stdout: "state": { 2024-04-26T18:38:50.964 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RELEASED", 2024-04-26T18:38:50.964 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0 2024-04-26T18:38:50.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:38:50.964 INFO:teuthology.orchestra.run.smithi080.stdout: "timeout": 60.0, 2024-04-26T18:38:50.965 INFO:teuthology.orchestra.run.smithi080.stdout: "expiration": 90.0, 2024-04-26T18:38:50.965 INFO:teuthology.orchestra.run.smithi080.stdout: "members": { 2024-04-26T18:38:50.965 INFO:teuthology.orchestra.run.smithi080.stdout: "file:/": { 2024-04-26T18:38:50.965 INFO:teuthology.orchestra.run.smithi080.stdout: "excluded": false, 2024-04-26T18:38:50.965 INFO:teuthology.orchestra.run.smithi080.stdout: "state": { 2024-04-26T18:38:50.965 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RELEASED", 2024-04-26T18:38:50.965 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.0 2024-04-26T18:38:50.965 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:38:50.965 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:38:50.965 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:38:50.965 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:38:50.965 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:38:50.965 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:38:50.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.960+0000 7f5d32c8c700 1 -- 172.21.15.80:0/3561820541 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f5d1c0a3c90 msgr2=0x7f5d1c0a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:50.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.960+0000 7f5d32c8c700 1 --2- 172.21.15.80:0/3561820541 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f5d1c0a3c90 0x7f5d1c0a6150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5d1800b5c0 tx=0x7f5d18005960 comp rx=0 tx=0).stop 2024-04-26T18:38:50.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.960+0000 7f5d32c8c700 1 -- 172.21.15.80:0/3561820541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d2c102310 msgr2=0x7f5d2c19e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:50.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.960+0000 7f5d32c8c700 1 --2- 172.21.15.80:0/3561820541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d2c102310 0x7f5d2c19e6a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5d2000c920 tx=0x7f5d2000cc30 comp rx=0 tx=0).stop 2024-04-26T18:38:50.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.960+0000 7f5d32c8c700 1 -- 172.21.15.80:0/3561820541 shutdown_connections 2024-04-26T18:38:50.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.960+0000 7f5d32c8c700 1 --2- 172.21.15.80:0/3561820541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d2c108380 0x7f5d2c198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.960+0000 7f5d32c8c700 1 --2- 172.21.15.80:0/3561820541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d2c102310 0x7f5d2c19e6a0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.960+0000 7f5d32c8c700 1 --2- 172.21.15.80:0/3561820541 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f5d1c0a3c90 0x7f5d1c0a6150 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.960+0000 7f5d32c8c700 1 --2- 172.21.15.80:0/3561820541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d2c102cd0 0x7f5d2c19ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:50.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.960+0000 7f5d32c8c700 1 -- 172.21.15.80:0/3561820541 >> 172.21.15.80:0/3561820541 conn(0x7f5d2c079290 msgr2=0x7f5d2c100fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:50.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.960+0000 7f5d32c8c700 1 -- 172.21.15.80:0/3561820541 shutdown_connections 2024-04-26T18:38:50.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:38:50.960+0000 7f5d32c8c700 1 -- 172.21.15.80:0/3561820541 wait complete. 2024-04-26T18:38:50.967 INFO:tasks.workunit.client.0.smithi080.stdout:test large (16MB) dio write 2024-04-26T18:38:50.968 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test large (16MB) dio write' 2024-04-26T18:38:50.968 INFO:tasks.workunit.client.0.smithi080.stderr:+ dd if=/dev/zero of=foo.big bs=16M count=1 oflag=direct 2024-04-26T18:38:51.044 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-04-26T18:38:51.045 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-04-26T18:38:51.045 INFO:tasks.workunit.client.0.smithi080.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.0789021 s, 213 MB/s 2024-04-26T18:38:51.045 INFO:tasks.workunit.client.0.smithi080.stdout:OK 2024-04-26T18:38:51.046 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo OK 2024-04-26T18:38:51.046 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T18:38:51.046 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T18:38:51.080 INFO:tasks.workunit:Running workunit direct_io/direct_io_test... 2024-04-26T18:38:51.080 DEBUG:teuthology.orchestra.run.smithi080:workunit test direct_io/direct_io_test> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/direct_io_test 2024-04-26T18:38:51.798 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '79a7f30a', seconds elapsed: 46.7 2024-04-26T18:38:51.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:51 smithi192 ceph-mon[32842]: pgmap v74: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-26T18:38:51.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:51 smithi082 ceph-mon[32808]: pgmap v74: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-26T18:38:51.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:51 smithi080 ceph-mon[29135]: pgmap v74: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-26T18:38:53.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:53 smithi192 ceph-mon[32842]: pgmap v75: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T18:38:53.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:53 smithi082 ceph-mon[32808]: pgmap v75: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T18:38:53.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:53 smithi080 ceph-mon[29135]: pgmap v75: 97 pgs: 97 active+clean; 1.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T18:38:54.882 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.879+0000 7ff8e89e2640 1 -- 172.21.15.80:0/2692878272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8e4107820 msgr2=0x7ff8e4107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:54.882 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.879+0000 7ff8e89e2640 1 --2- 172.21.15.80:0/2692878272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8e4107820 0x7ff8e4107c00 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009cd0 tx=0x7ff8d402a8e0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.882 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.879+0000 7ff8e89e2640 1 -- 172.21.15.80:0/2692878272 shutdown_connections 2024-04-26T18:38:54.882 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.879+0000 7ff8e89e2640 1 --2- 172.21.15.80:0/2692878272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e4102220 0x7ff8e410e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.882 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.879+0000 7ff8e89e2640 1 --2- 172.21.15.80:0/2692878272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8e4101860 0x7ff8e4101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.882 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.879+0000 7ff8e89e2640 1 --2- 172.21.15.80:0/2692878272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8e4107820 0x7ff8e4107c00 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.882 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.879+0000 7ff8e89e2640 1 -- 172.21.15.80:0/2692878272 >> 172.21.15.80:0/2692878272 conn(0x7ff8e40789b0 msgr2=0x7ff8e4078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:54.882 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.879+0000 7ff8e89e2640 1 -- 172.21.15.80:0/2692878272 shutdown_connections 2024-04-26T18:38:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.880+0000 7ff8e89e2640 1 -- 172.21.15.80:0/2692878272 wait complete. 2024-04-26T18:38:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.880+0000 7ff8e89e2640 1 Processor -- start 2024-04-26T18:38:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.880+0000 7ff8e89e2640 1 -- start start 2024-04-26T18:38:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.880+0000 7ff8e89e2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8e4101860 0x7ff8e41980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.880+0000 7ff8e89e2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8e4102220 0x7ff8e41985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.880+0000 7ff8e89e2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e4107820 0x7ff8e419c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.880+0000 7ff8e89e2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e4111b00 con 0x7ff8e4102220 2024-04-26T18:38:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.880+0000 7ff8e89e2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e4111980 con 0x7ff8e4107820 2024-04-26T18:38:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.880+0000 7ff8e89e2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e4111c80 con 0x7ff8e4101860 2024-04-26T18:38:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.881+0000 7ff8e1d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8e4102220 0x7ff8e41985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.881+0000 7ff8e1d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8e4102220 0x7ff8e41985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37028/0 (socket says 172.21.15.80:37028) 2024-04-26T18:38:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.881+0000 7ff8e1d9b640 1 -- 172.21.15.80:0/2270592595 learned_addr learned my addr 172.21.15.80:0/2270592595 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.881+0000 7ff8e259c640 1 --2- 172.21.15.80:0/2270592595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8e4101860 0x7ff8e41980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.881+0000 7ff8e2d9d640 1 --2- 172.21.15.80:0/2270592595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e4107820 0x7ff8e419c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.881+0000 7ff8e1d9b640 1 -- 172.21.15.80:0/2270592595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8e4101860 msgr2=0x7ff8e41980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.881+0000 7ff8e1d9b640 1 --2- 172.21.15.80:0/2270592595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8e4101860 0x7ff8e41980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.881+0000 7ff8e1d9b640 1 -- 172.21.15.80:0/2270592595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e4107820 msgr2=0x7ff8e419c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.881+0000 7ff8e1d9b640 1 --2- 172.21.15.80:0/2270592595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e4107820 0x7ff8e419c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.881+0000 7ff8e1d9b640 1 -- 172.21.15.80:0/2270592595 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e419d090 con 0x7ff8e4102220 2024-04-26T18:38:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.881+0000 7ff8e2d9d640 1 --2- 172.21.15.80:0/2270592595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e4107820 0x7ff8e419c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:38:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.881+0000 7ff8e1d9b640 1 --2- 172.21.15.80:0/2270592595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8e4102220 0x7ff8e41985e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800eb00 tx=0x7ff8d800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.881+0000 7ff8d37fe640 1 -- 172.21.15.80:0/2270592595 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d800bc30 con 0x7ff8e4102220 2024-04-26T18:38:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.881+0000 7ff8d37fe640 1 -- 172.21.15.80:0/2270592595 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8d800bdd0 con 0x7ff8e4102220 2024-04-26T18:38:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.881+0000 7ff8e89e2640 1 -- 172.21.15.80:0/2270592595 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e419d380 con 0x7ff8e4102220 2024-04-26T18:38:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.881+0000 7ff8d37fe640 1 -- 172.21.15.80:0/2270592595 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8017410 con 0x7ff8e4102220 2024-04-26T18:38:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.881+0000 7ff8e89e2640 1 -- 172.21.15.80:0/2270592595 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e4069fe0 con 0x7ff8e4102220 2024-04-26T18:38:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.883+0000 7ff8d37fe640 1 -- 172.21.15.80:0/2270592595 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7ff8d8004f70 con 0x7ff8e4102220 2024-04-26T18:38:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.884+0000 7ff8eb7cf740 1 Processor -- start 2024-04-26T18:38:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.884+0000 7ff8eb7cf740 1 -- start start 2024-04-26T18:38:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.884+0000 7ff8d37fe640 1 --2- 172.21.15.80:0/2270592595 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7ff8cc0a3dc0 0x7ff8cc0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.884+0000 7ff8eb7cf740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558645589310 0x5586455896f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.884+0000 7ff8eb7cf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558645589c30 0x558645593fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.884+0000 7ff8eb7cf740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5586455944f0 0x5586455968e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.884+0000 7ff8eb7cf740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5586454eb460 con 0x5586455944f0 2024-04-26T18:38:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.884+0000 7ff8eb7cf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5586454a5590 con 0x558645589c30 2024-04-26T18:38:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.884+0000 7ff8eb7cf740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5586454e7420 con 0x558645589310 2024-04-26T18:38:54.892 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.884+0000 7ff8e2d9d640 1 --2- 172.21.15.80:0/2270592595 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7ff8cc0a3dc0 0x7ff8cc0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:54.892 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.884+0000 7ff8d37fe640 1 -- 172.21.15.80:0/2270592595 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7ff8d80d2070 con 0x7ff8e4102220 2024-04-26T18:38:54.892 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.884+0000 7ff8e259c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558645589310 0x5586455896f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:54.892 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.884+0000 7ff8e2d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5586455944f0 0x5586455968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:54.892 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.884+0000 7ff8e259c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558645589310 0x5586455896f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.80:48380/0 (socket says 172.21.15.80:48380) 2024-04-26T18:38:54.892 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.884+0000 7ff8e259c640 1 -- 172.21.15.80:0/633479665 learned_addr learned my addr 172.21.15.80:0/633479665 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:54.892 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.885+0000 7ff8e1d9b640 1 --2- 172.21.15.80:0/633479665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558645589c30 0x558645593fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:54.892 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.885+0000 7ff8e259c640 1 -- 172.21.15.80:0/633479665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558645589c30 msgr2=0x558645593fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:54.892 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.885+0000 7ff8e259c640 1 --2- 172.21.15.80:0/633479665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558645589c30 0x558645593fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.892 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.885+0000 7ff8e259c640 1 -- 172.21.15.80:0/633479665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5586455944f0 msgr2=0x5586455968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:54.892 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.885+0000 7ff8e259c640 1 --2- 172.21.15.80:0/633479665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5586455944f0 0x5586455968e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.892 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.885+0000 7ff8e259c640 1 -- 172.21.15.80:0/633479665 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586454b20d0 con 0x558645589310 2024-04-26T18:38:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.885+0000 7ff8e2d9d640 1 --2- 172.21.15.80:0/2270592595 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7ff8cc0a3dc0 0x7ff8cc0a6280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc006e10 tx=0x7ff8dc00a8d0 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.885+0000 7ff8e259c640 1 --2- 172.21.15.80:0/633479665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558645589310 0x5586455896f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009cd0 tx=0x7ff8d4005fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8548bb20bf04850 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.885+0000 7ff8d0ff9640 1 -- 172.21.15.80:0/633479665 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4049070 con 0x558645589310 2024-04-26T18:38:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.885+0000 7ff8d0ff9640 1 -- 172.21.15.80:0/633479665 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8d4036040 con 0x558645589310 2024-04-26T18:38:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.885+0000 7ff8d0ff9640 1 -- 172.21.15.80:0/633479665 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4004280 con 0x558645589310 2024-04-26T18:38:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.886+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/633479665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558645589310 msgr2=0x5586455896f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.886+0000 7ff8eb7cf740 1 --2- 172.21.15.80:0/633479665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558645589310 0x5586455896f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009cd0 tx=0x7ff8d4005fa0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.886+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/633479665 shutdown_connections 2024-04-26T18:38:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.886+0000 7ff8eb7cf740 1 --2- 172.21.15.80:0/633479665 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5586455944f0 0x5586455968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.886+0000 7ff8eb7cf740 1 --2- 172.21.15.80:0/633479665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558645589c30 0x558645593fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.886+0000 7ff8eb7cf740 1 --2- 172.21.15.80:0/633479665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558645589310 0x5586455896f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.886+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/633479665 >> 172.21.15.80:0/633479665 conn(0x558645585820 msgr2=0x558645585c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.886+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/633479665 shutdown_connections 2024-04-26T18:38:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.886+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/633479665 wait complete. 2024-04-26T18:38:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.886+0000 7ff8eb7cf740 1 -- start start 2024-04-26T18:38:54.894 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.886+0000 7ff8eb7cf740 1 Processor -- start 2024-04-26T18:38:54.894 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.887+0000 7ff8eb7cf740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558645589310 0x558645591430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:54.894 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.887+0000 7ff8eb7cf740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558645589c30 0x558645591970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:54.894 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.887+0000 7ff8eb7cf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586455944f0 0x558645591eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:54.894 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.887+0000 7ff8eb7cf740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5586455970c0 con 0x558645589310 2024-04-26T18:38:54.894 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.887+0000 7ff8eb7cf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558645472b60 con 0x5586455944f0 2024-04-26T18:38:54.894 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.887+0000 7ff8eb7cf740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558645597240 con 0x558645589c30 2024-04-26T18:38:54.894 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.887+0000 7ff8eb7cf740 10 client.0 _ll_register_callbacks cb 0x5586454972b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:38:54.894 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.887+0000 7ff8e259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558645589310 0x558645591430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:54.894 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.887+0000 7ff8e1d9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558645589c30 0x558645591970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:54.894 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.887+0000 7ff8e259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558645589310 0x558645591430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37046/0 (socket says 172.21.15.80:37046) 2024-04-26T18:38:54.894 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.887+0000 7ff8e259c640 1 -- 172.21.15.80:0/1809673262 learned_addr learned my addr 172.21.15.80:0/1809673262 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:54.894 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.887+0000 7ff8e2d9d640 1 --2- 172.21.15.80:0/1809673262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586455944f0 0x558645591eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:54.895 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.887+0000 7ff8e259c640 1 -- 172.21.15.80:0/1809673262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558645589c30 msgr2=0x558645591970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:54.895 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.887+0000 7ff8e259c640 1 --2- 172.21.15.80:0/1809673262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558645589c30 0x558645591970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.895 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.887+0000 7ff8e259c640 1 -- 172.21.15.80:0/1809673262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586455944f0 msgr2=0x558645591eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:54.895 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.887+0000 7ff8e259c640 1 --2- 172.21.15.80:0/1809673262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586455944f0 0x558645591eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.895 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.887+0000 7ff8e259c640 1 -- 172.21.15.80:0/1809673262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586451fd210 con 0x558645589310 2024-04-26T18:38:54.895 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.887+0000 7ff8e259c640 1 --2- 172.21.15.80:0/1809673262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558645589310 0x558645591430 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009ca0 tx=0x7ff8d4009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4355641630044 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:54.895 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.887+0000 7ff8c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:38:54.895 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.887+0000 7ff8c9ffb640 1 -- 172.21.15.80:0/1809673262 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4049070 con 0x558645589310 2024-04-26T18:38:54.895 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.887+0000 7ff8c9ffb640 1 -- 172.21.15.80:0/1809673262 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7ff8d4041040 con 0x558645589310 2024-04-26T18:38:54.895 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.887+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/1809673262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8d4036040 con 0x558645589310 2024-04-26T18:38:54.895 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.887+0000 7ff8c9ffb640 1 -- 172.21.15.80:0/1809673262 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff8d40305a0 con 0x558645589310 2024-04-26T18:38:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.888+0000 7ff8eb7cf740 10 client.15717 fetch_fsmap learned FSMap version 27 2024-04-26T18:38:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.888+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/1809673262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5586452c9620 con 0x558645589310 2024-04-26T18:38:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.888+0000 7ff8c9ffb640 1 -- 172.21.15.80:0/1809673262 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8d4036040 con 0x558645589310 2024-04-26T18:38:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.888+0000 7ff8c9ffb640 1 -- 172.21.15.80:0/1809673262 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff8d4030070 con 0x558645589310 2024-04-26T18:38:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.888+0000 7ff8eb7cf740 10 client.15717 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:38:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.888+0000 7ff8eb7cf740 10 client.15717 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:38:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.888+0000 7ff8eb7cf740 20 client.15717 populate_metadata read hostname 'smithi080' 2024-04-26T18:38:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.888+0000 7ff8eb7cf740 1 --2- 172.21.15.80:0/1809673262 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x5586455a4450 0x5586455a6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.888+0000 7ff8eb7cf740 4 client.15717 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:38:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.888+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/1809673262 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586454f9070 con 0x5586455a4450 2024-04-26T18:38:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.888+0000 7ff8e1d9b640 1 --2- 172.21.15.80:0/1809673262 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x5586455a4450 0x5586455a6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.889+0000 7ff8c9ffb640 10 client.15717 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.889+0000 7ff8e1d9b640 1 --2- 172.21.15.80:0/1809673262 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x5586455a4450 0x5586455a6840 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccbbbc433f9e16dc server_cookie=90f2c0b11ec8a663 in_seq=0 out_seq=0 2024-04-26T18:38:54.896 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.889+0000 7ff8c9ffb640 1 -- 172.21.15.80:0/1809673262 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5586454f9070 con 0x5586455a4450 2024-04-26T18:38:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.889+0000 7ff8c9ffb640 10 client.15717 handle_command_reply: tid=0 2024-04-26T18:38:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.889+0000 7ff8eb7cf740 1 client.15717 shutdown 2024-04-26T18:38:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.889+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/1809673262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558645589310 msgr2=0x558645591430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.889+0000 7ff8eb7cf740 1 --2- 172.21.15.80:0/1809673262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558645589310 0x558645591430 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009ca0 tx=0x7ff8d4009580 comp rx=0 tx=0).stop 2024-04-26T18:38:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.889+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/1809673262 shutdown_connections 2024-04-26T18:38:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.889+0000 7ff8eb7cf740 1 --2- 172.21.15.80:0/1809673262 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x5586455a4450 0x5586455a6840 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.889+0000 7ff8eb7cf740 1 --2- 172.21.15.80:0/1809673262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586455944f0 0x558645591eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.889+0000 7ff8eb7cf740 1 --2- 172.21.15.80:0/1809673262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558645589c30 0x558645591970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.889+0000 7ff8c9ffb640 0 client.15717 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.889+0000 7ff8eb7cf740 1 --2- 172.21.15.80:0/1809673262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558645589310 0x558645591430 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.889+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/1809673262 >> 172.21.15.80:0/1809673262 conn(0x558645585820 msgr2=0x5586455805b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.889+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/1809673262 shutdown_connections 2024-04-26T18:38:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.890+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/1809673262 wait complete. 2024-04-26T18:38:54.897 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.890+0000 7ff8eb7cf740 20 client.15717 trim_cache size 0 max 16384 2024-04-26T18:38:54.909 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.904+0000 7ff8eb7cf740 1 Processor -- start 2024-04-26T18:38:54.909 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.904+0000 7ff8eb7cf740 1 -- start start 2024-04-26T18:38:54.909 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.904+0000 7ff8eb7cf740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558645589310 0x55864559ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:54.909 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.904+0000 7ff8eb7cf740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558645589c30 0x5586455abea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:54.909 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.904+0000 7ff8eb7cf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586455944f0 0x5586455ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:54.909 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.904+0000 7ff8eb7cf740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e41ac190 con 0x558645589310 2024-04-26T18:38:54.909 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.904+0000 7ff8eb7cf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e41adcd0 con 0x5586455944f0 2024-04-26T18:38:54.909 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.904+0000 7ff8eb7cf740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e41ac860 con 0x558645589c30 2024-04-26T18:38:54.909 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.904+0000 7ff8e259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558645589310 0x55864559ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:54.909 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.904+0000 7ff8e259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558645589310 0x55864559ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37060/0 (socket says 172.21.15.80:37060) 2024-04-26T18:38:54.909 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.904+0000 7ff8e259c640 1 -- 172.21.15.80:0/3629324980 learned_addr learned my addr 172.21.15.80:0/3629324980 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:54.909 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.904+0000 7ff8e1d9b640 1 --2- 172.21.15.80:0/3629324980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558645589c30 0x5586455abea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.905+0000 7ff8e2d9d640 1 --2- 172.21.15.80:0/3629324980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586455944f0 0x5586455ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.905+0000 7ff8e259c640 1 -- 172.21.15.80:0/3629324980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558645589c30 msgr2=0x5586455abea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.905+0000 7ff8e259c640 1 --2- 172.21.15.80:0/3629324980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558645589c30 0x5586455abea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.905+0000 7ff8e259c640 1 -- 172.21.15.80:0/3629324980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586455944f0 msgr2=0x5586455ac3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.905+0000 7ff8e259c640 1 --2- 172.21.15.80:0/3629324980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586455944f0 0x5586455ac3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.905+0000 7ff8e259c640 1 -- 172.21.15.80:0/3629324980 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55864557b9c0 con 0x558645589310 2024-04-26T18:38:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.905+0000 7ff8e2d9d640 1 --2- 172.21.15.80:0/3629324980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586455944f0 0x5586455ac3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:38:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.905+0000 7ff8e259c640 1 --2- 172.21.15.80:0/3629324980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558645589310 0x55864559ff80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4000f80 tx=0x7ff8d4009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b004e88f66b547 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.905+0000 7ff8cbfff640 1 -- 172.21.15.80:0/3629324980 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4049070 con 0x558645589310 2024-04-26T18:38:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.905+0000 7ff8cbfff640 1 -- 172.21.15.80:0/3629324980 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8d4036040 con 0x558645589310 2024-04-26T18:38:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.905+0000 7ff8cbfff640 1 -- 172.21.15.80:0/3629324980 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4030c40 con 0x558645589310 2024-04-26T18:38:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.905+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/3629324980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558645589310 msgr2=0x55864559ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.906+0000 7ff8eb7cf740 1 --2- 172.21.15.80:0/3629324980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558645589310 0x55864559ff80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4000f80 tx=0x7ff8d4009a20 comp rx=0 tx=0).stop 2024-04-26T18:38:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.906+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/3629324980 shutdown_connections 2024-04-26T18:38:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.906+0000 7ff8eb7cf740 1 --2- 172.21.15.80:0/3629324980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586455944f0 0x5586455ac3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.906+0000 7ff8eb7cf740 1 --2- 172.21.15.80:0/3629324980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558645589c30 0x5586455abea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.906+0000 7ff8eb7cf740 1 --2- 172.21.15.80:0/3629324980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558645589310 0x55864559ff80 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.906+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/3629324980 >> 172.21.15.80:0/3629324980 conn(0x558645585820 msgr2=0x5586455805b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.906+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/3629324980 shutdown_connections 2024-04-26T18:38:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.906+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/3629324980 wait complete. 2024-04-26T18:38:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.906+0000 7ff8eb7cf740 1 -- start start 2024-04-26T18:38:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.906+0000 7ff8eb7cf740 1 Processor -- start 2024-04-26T18:38:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.906+0000 7ff8eb7cf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558645589c30 0x55864558e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.906+0000 7ff8eb7cf740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586455944f0 0x55864558ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.906+0000 7ff8eb7cf740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558645607700 0x558645609af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.906+0000 7ff8eb7cf740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e41ad600 con 0x558645607700 2024-04-26T18:38:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.906+0000 7ff8eb7cf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e41acf30 con 0x558645589c30 2024-04-26T18:38:54.912 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.906+0000 7ff8eb7cf740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e41aa170 con 0x5586455944f0 2024-04-26T18:38:54.912 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.906+0000 7ff8eb7cf740 10 client.0 _ll_register_callbacks cb 0x7ff8d4047070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:38:54.912 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.906+0000 7ff8e2d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558645607700 0x558645609af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:54.912 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.906+0000 7ff8e2d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558645607700 0x558645609af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37072/0 (socket says 172.21.15.80:37072) 2024-04-26T18:38:54.912 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.906+0000 7ff8e2d9d640 1 -- 172.21.15.80:0/1136668879 learned_addr learned my addr 172.21.15.80:0/1136668879 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:38:54.912 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.906+0000 7ff8e1d9b640 1 --2- 172.21.15.80:0/1136668879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586455944f0 0x55864558ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:54.912 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.907+0000 7ff8e2d9d640 1 -- 172.21.15.80:0/1136668879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586455944f0 msgr2=0x55864558ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:54.912 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.907+0000 7ff8e2d9d640 1 --2- 172.21.15.80:0/1136668879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586455944f0 0x55864558ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.912 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.907+0000 7ff8e2d9d640 1 -- 172.21.15.80:0/1136668879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558645589c30 msgr2=0x55864558e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:38:54.912 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.907+0000 7ff8e2d9d640 1 --2- 172.21.15.80:0/1136668879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558645589c30 0x55864558e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.912 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.907+0000 7ff8e2d9d640 1 -- 172.21.15.80:0/1136668879 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55864560a060 con 0x558645607700 2024-04-26T18:38:54.912 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.907+0000 7ff8e2d9d640 1 --2- 172.21.15.80:0/1136668879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558645607700 0x558645609af0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc00a790 tx=0x7ff8dc006da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceda5a6d876790d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:38:54.912 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.907+0000 7ff8c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:38:54.912 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.907+0000 7ff8c9ffb640 1 -- 172.21.15.80:0/1136668879 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc027020 con 0x558645607700 2024-04-26T18:38:54.912 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.907+0000 7ff8c9ffb640 1 -- 172.21.15.80:0/1136668879 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7ff8dc018db0 con 0x558645607700 2024-04-26T18:38:54.913 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.907+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/1136668879 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8d4036040 con 0x558645607700 2024-04-26T18:38:54.913 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.907+0000 7ff8c9ffb640 1 -- 172.21.15.80:0/1136668879 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff8dc032050 con 0x558645607700 2024-04-26T18:38:54.913 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.907+0000 7ff8eb7cf740 10 client.15723 fetch_fsmap learned FSMap version 27 2024-04-26T18:38:54.913 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.907+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/1136668879 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55864560b2e0 con 0x558645607700 2024-04-26T18:38:54.913 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.907+0000 7ff8c9ffb640 1 -- 172.21.15.80:0/1136668879 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8d4036040 con 0x558645607700 2024-04-26T18:38:54.913 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.907+0000 7ff8c9ffb640 1 -- 172.21.15.80:0/1136668879 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff8dc015040 con 0x558645607700 2024-04-26T18:38:54.913 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.907+0000 7ff8eb7cf740 10 client.15723 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:38:54.913 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.907+0000 7ff8eb7cf740 10 client.15723 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:38:54.913 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.907+0000 7ff8eb7cf740 20 client.15723 populate_metadata read hostname 'smithi080' 2024-04-26T18:38:54.913 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.907+0000 7ff8eb7cf740 1 --2- 172.21.15.80:0/1136668879 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55864560bb60 0x55864560dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:38:54.913 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.907+0000 7ff8eb7cf740 4 client.15723 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:38:54.913 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.907+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/1136668879 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5586454f2ee0 con 0x55864560bb60 2024-04-26T18:38:54.913 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.908+0000 7ff8e259c640 1 --2- 172.21.15.80:0/1136668879 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55864560bb60 0x55864560dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:38:54.913 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.908+0000 7ff8e259c640 1 --2- 172.21.15.80:0/1136668879 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55864560bb60 0x55864560dfa0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9834d8808a12be50 server_cookie=95cc2e4f48ba76ae in_seq=0 out_seq=0 2024-04-26T18:38:54.913 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.908+0000 7ff8c9ffb640 10 client.15723 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.919+0000 7ff8c9ffb640 1 -- 172.21.15.80:0/1136668879 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5586454f2ee0 con 0x55864560bb60 2024-04-26T18:38:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.919+0000 7ff8c9ffb640 10 client.15723 handle_command_reply: tid=0 2024-04-26T18:38:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.919+0000 7ff8eb7cf740 1 client.15723 shutdown 2024-04-26T18:38:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.919+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/1136668879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558645607700 msgr2=0x558645609af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.919+0000 7ff8eb7cf740 1 --2- 172.21.15.80:0/1136668879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558645607700 0x558645609af0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc00a790 tx=0x7ff8dc006da0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.919+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/1136668879 shutdown_connections 2024-04-26T18:38:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.919+0000 7ff8eb7cf740 1 --2- 172.21.15.80:0/1136668879 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55864560bb60 0x55864560dfa0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.919+0000 7ff8eb7cf740 1 --2- 172.21.15.80:0/1136668879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558645607700 0x558645609af0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.919+0000 7ff8c9ffb640 0 client.15723 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:38:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.919+0000 7ff8eb7cf740 1 --2- 172.21.15.80:0/1136668879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586455944f0 0x55864558ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.919+0000 7ff8eb7cf740 1 --2- 172.21.15.80:0/1136668879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558645589c30 0x55864558e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.919+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/1136668879 >> 172.21.15.80:0/1136668879 conn(0x558645585820 msgr2=0x55864558acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.920+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/1136668879 shutdown_connections 2024-04-26T18:38:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.920+0000 7ff8eb7cf740 1 -- 172.21.15.80:0/1136668879 wait complete. 2024-04-26T18:38:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.920+0000 7ff8eb7cf740 20 client.15723 trim_cache size 0 max 16384 2024-04-26T18:38:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:{ 2024-04-26T18:38:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "message": "", 2024-04-26T18:38:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "return_code": 0 2024-04-26T18:38:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:} 2024-04-26T18:38:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.920+0000 7ff8e89e2640 1 -- 172.21.15.80:0/2270592595 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7ff8cc0a3dc0 msgr2=0x7ff8cc0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.920+0000 7ff8e89e2640 1 --2- 172.21.15.80:0/2270592595 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7ff8cc0a3dc0 0x7ff8cc0a6280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc006e10 tx=0x7ff8dc00a8d0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.920+0000 7ff8e89e2640 1 -- 172.21.15.80:0/2270592595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8e4102220 msgr2=0x7ff8e41985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:38:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.920+0000 7ff8e89e2640 1 --2- 172.21.15.80:0/2270592595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8e4102220 0x7ff8e41985e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800eb00 tx=0x7ff8d800ef00 comp rx=0 tx=0).stop 2024-04-26T18:38:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.920+0000 7ff8e89e2640 1 -- 172.21.15.80:0/2270592595 shutdown_connections 2024-04-26T18:38:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.920+0000 7ff8e89e2640 1 --2- 172.21.15.80:0/2270592595 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7ff8cc0a3dc0 0x7ff8cc0a6280 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.920+0000 7ff8e89e2640 1 --2- 172.21.15.80:0/2270592595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8e4102220 0x7ff8e41985e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.920+0000 7ff8e89e2640 1 --2- 172.21.15.80:0/2270592595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e4107820 0x7ff8e419c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.920+0000 7ff8e89e2640 1 --2- 172.21.15.80:0/2270592595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8e4101860 0x7ff8e41980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:38:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.920+0000 7ff8e89e2640 1 -- 172.21.15.80:0/2270592595 >> 172.21.15.80:0/2270592595 conn(0x7ff8e40789b0 msgr2=0x7ff8e4104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:38:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.920+0000 7ff8e89e2640 1 -- 172.21.15.80:0/2270592595 shutdown_connections 2024-04-26T18:38:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:38:54.920+0000 7ff8e89e2640 1 -- 172.21.15.80:0/2270592595 wait complete. 2024-04-26T18:38:55.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:55 smithi192 ceph-mon[32842]: pgmap v76: 97 pgs: 97 active+clean; 18 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.4 MiB/s wr, 739 op/s 2024-04-26T18:38:55.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:55 smithi082 ceph-mon[32808]: pgmap v76: 97 pgs: 97 active+clean; 18 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.4 MiB/s wr, 739 op/s 2024-04-26T18:38:55.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:55 smithi080 ceph-mon[29135]: pgmap v76: 97 pgs: 97 active+clean; 18 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.4 MiB/s wr, 739 op/s 2024-04-26T18:38:57.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:57 smithi192 ceph-mon[32842]: pgmap v77: 97 pgs: 97 active+clean; 18 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.4 MiB/s wr, 735 op/s 2024-04-26T18:38:57.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:57 smithi082 ceph-mon[32808]: pgmap v77: 97 pgs: 97 active+clean; 18 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.4 MiB/s wr, 735 op/s 2024-04-26T18:38:57.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:57 smithi080 ceph-mon[29135]: pgmap v77: 97 pgs: 97 active+clean; 18 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.4 MiB/s wr, 735 op/s 2024-04-26T18:38:59.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:38:59 smithi080 ceph-mon[29135]: pgmap v78: 97 pgs: 97 active+clean; 18 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.4 MiB/s wr, 735 op/s 2024-04-26T18:38:59.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:38:59 smithi192 ceph-mon[32842]: pgmap v78: 97 pgs: 97 active+clean; 18 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.4 MiB/s wr, 735 op/s 2024-04-26T18:38:59.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:38:59 smithi082 ceph-mon[32808]: pgmap v78: 97 pgs: 97 active+clean; 18 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.4 MiB/s wr, 735 op/s 2024-04-26T18:39:01.000 INFO:tasks.workunit.client.0.smithi080.stdout:.......... 2024-04-26T18:39:01.000 INFO:tasks.workunit.client.0.smithi080.stdout:do_o_direct_reads: SUCCESS 2024-04-26T18:39:01.002 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T18:39:01.002 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T18:39:01.030 INFO:tasks.workunit:Running workunit direct_io/misc.sh... 2024-04-26T18:39:01.030 DEBUG:teuthology.orchestra.run.smithi080:workunit test direct_io/misc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/misc.sh 2024-04-26T18:39:01.090 INFO:tasks.workunit.client.0.smithi080.stdout:test read from hole 2024-04-26T18:39:01.090 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test read from hole' 2024-04-26T18:39:01.090 INFO:tasks.workunit.client.0.smithi080.stderr:+ dd if=/dev/zero of=dd3 bs=1 seek=1048576 count=0 2024-04-26T18:39:01.092 INFO:tasks.workunit.client.0.smithi080.stderr:0+0 records in 2024-04-26T18:39:01.092 INFO:tasks.workunit.client.0.smithi080.stderr:0+0 records out 2024-04-26T18:39:01.092 INFO:tasks.workunit.client.0.smithi080.stderr:0 bytes copied, 3.2524e-05 s, 0.0 kB/s 2024-04-26T18:39:01.092 INFO:tasks.workunit.client.0.smithi080.stderr:+ dd if=dd3 of=/tmp/ddout1 skip=8 bs=512 count=2 iflag=direct 2024-04-26T18:39:01.094 INFO:tasks.workunit.client.0.smithi080.stderr:2+0 records in 2024-04-26T18:39:01.094 INFO:tasks.workunit.client.0.smithi080.stderr:2+0 records out 2024-04-26T18:39:01.094 INFO:tasks.workunit.client.0.smithi080.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00126248 s, 811 kB/s 2024-04-26T18:39:01.094 INFO:tasks.workunit.client.0.smithi080.stderr:+ dd if=/dev/zero of=/tmp/dd3 bs=512 count=2 2024-04-26T18:39:01.094 INFO:tasks.workunit.client.0.smithi080.stderr:2+0 records in 2024-04-26T18:39:01.094 INFO:tasks.workunit.client.0.smithi080.stderr:2+0 records out 2024-04-26T18:39:01.095 INFO:tasks.workunit.client.0.smithi080.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 4.0368e-05 s, 25.4 MB/s 2024-04-26T18:39:01.095 INFO:tasks.workunit.client.0.smithi080.stderr:+ cmp /tmp/dd3 /tmp/ddout1 2024-04-26T18:39:01.095 INFO:tasks.workunit.client.0.smithi080.stdout:other thing 2024-04-26T18:39:01.095 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'other thing' 2024-04-26T18:39:01.095 INFO:tasks.workunit.client.0.smithi080.stderr:+ dd if=/dev/urandom of=/tmp/dd10 bs=500 count=1 2024-04-26T18:39:01.096 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-04-26T18:39:01.096 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-04-26T18:39:01.096 INFO:tasks.workunit.client.0.smithi080.stderr:500 bytes copied, 3.7576e-05 s, 13.3 MB/s 2024-04-26T18:39:01.096 INFO:tasks.workunit.client.0.smithi080.stderr:+ dd if=/tmp/dd10 of=dd10 bs=512 seek=8388 count=1 2024-04-26T18:39:01.103 INFO:tasks.workunit.client.0.smithi080.stderr:0+1 records in 2024-04-26T18:39:01.105 INFO:tasks.workunit.client.0.smithi080.stderr:0+1 records out 2024-04-26T18:39:01.105 INFO:tasks.workunit.client.0.smithi080.stderr:500 bytes copied, 0.00593276 s, 84.3 kB/s 2024-04-26T18:39:01.105 INFO:tasks.workunit.client.0.smithi080.stderr:+ dd if=dd10 of=/tmp/dd10out bs=512 skip=8388 count=1 iflag=direct 2024-04-26T18:39:01.107 INFO:tasks.workunit.client.0.smithi080.stderr:0+1 records in 2024-04-26T18:39:01.107 INFO:tasks.workunit.client.0.smithi080.stderr:0+1 records out 2024-04-26T18:39:01.107 INFO:tasks.workunit.client.0.smithi080.stderr:500 bytes copied, 0.00225165 s, 222 kB/s 2024-04-26T18:39:01.107 INFO:tasks.workunit.client.0.smithi080.stderr:+ cmp /tmp/dd10 /tmp/dd10out 2024-04-26T18:39:01.107 INFO:tasks.workunit.client.0.smithi080.stdout:OK 2024-04-26T18:39:01.108 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo OK 2024-04-26T18:39:01.108 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T18:39:01.108 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T18:39:01.182 INFO:tasks.workunit:Running workunit direct_io/test_short_dio_read... 2024-04-26T18:39:01.183 DEBUG:teuthology.orchestra.run.smithi080:workunit test direct_io/test_short_dio_read> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/test_short_dio_read 2024-04-26T18:39:01.253 INFO:tasks.workunit.client.0.smithi080.stdout:writing first 3 bytes of 10k file 2024-04-26T18:39:01.253 INFO:tasks.workunit.client.0.smithi080.stdout:reading O_DIRECT 2024-04-26T18:39:01.253 INFO:tasks.workunit.client.0.smithi080.stdout:got 10000 2024-04-26T18:39:01.254 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T18:39:01.254 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T18:39:01.324 INFO:tasks.workunit:Running workunit direct_io/test_sync_io... 2024-04-26T18:39:01.325 DEBUG:teuthology.orchestra.run.smithi080:workunit test direct_io/test_sync_io> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/test_sync_io 2024-04-26T18:39:01.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:01 smithi082 ceph-mon[32808]: pgmap v79: 97 pgs: 97 active+clean; 1.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.4 MiB/s wr, 2.14k op/s 2024-04-26T18:39:01.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:01 smithi080 ceph-mon[29135]: pgmap v79: 97 pgs: 97 active+clean; 1.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.4 MiB/s wr, 2.14k op/s 2024-04-26T18:39:02.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:01 smithi192 ceph-mon[32842]: pgmap v79: 97 pgs: 97 active+clean; 1.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.4 MiB/s wr, 2.14k op/s 2024-04-26T18:39:02.588 INFO:tasks.workunit.client.0.smithi080.stdout:writing pattern 2024-04-26T18:39:02.588 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4190208 len 1024 2024-04-26T18:39:02.588 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190208 len 1024 2024-04-26T18:39:02.588 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4190208 len 1024 2024-04-26T18:39:02.588 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190208 len 1024 2024-04-26T18:39:02.588 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4190208 len 2048 2024-04-26T18:39:02.589 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190208 len 2048 2024-04-26T18:39:02.589 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4190208 len 2048 2024-04-26T18:39:02.589 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190208 len 2048 2024-04-26T18:39:02.589 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4190208 len 4096 2024-04-26T18:39:02.589 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190208 len 4096 2024-04-26T18:39:02.589 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4190208 len 4096 2024-04-26T18:39:02.589 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190208 len 4096 2024-04-26T18:39:02.589 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4190208 len 8192 2024-04-26T18:39:02.589 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190208 len 8192 2024-04-26T18:39:02.589 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4190208 len 8192 2024-04-26T18:39:02.589 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190208 len 8192 2024-04-26T18:39:02.589 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4190208 len 16384 2024-04-26T18:39:02.590 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190208 len 16384 2024-04-26T18:39:02.590 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4190208 len 16384 2024-04-26T18:39:02.590 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190208 len 16384 2024-04-26T18:39:02.590 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4190720 len 1024 2024-04-26T18:39:02.590 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190720 len 1024 2024-04-26T18:39:02.590 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4190720 len 1024 2024-04-26T18:39:02.590 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190720 len 1024 2024-04-26T18:39:02.590 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4190720 len 2048 2024-04-26T18:39:02.590 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190720 len 2048 2024-04-26T18:39:02.590 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4190720 len 2048 2024-04-26T18:39:02.590 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190720 len 2048 2024-04-26T18:39:02.590 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4190720 len 4096 2024-04-26T18:39:02.590 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190720 len 4096 2024-04-26T18:39:02.590 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4190720 len 4096 2024-04-26T18:39:02.591 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190720 len 4096 2024-04-26T18:39:02.591 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4190720 len 8192 2024-04-26T18:39:02.591 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190720 len 8192 2024-04-26T18:39:02.591 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4190720 len 8192 2024-04-26T18:39:02.591 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190720 len 8192 2024-04-26T18:39:02.591 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4190720 len 16384 2024-04-26T18:39:02.591 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190720 len 16384 2024-04-26T18:39:02.591 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4190720 len 16384 2024-04-26T18:39:02.591 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4190720 len 16384 2024-04-26T18:39:02.591 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4191232 len 1024 2024-04-26T18:39:02.591 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191232 len 1024 2024-04-26T18:39:02.591 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4191232 len 1024 2024-04-26T18:39:02.591 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191232 len 1024 2024-04-26T18:39:02.591 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4191232 len 2048 2024-04-26T18:39:02.591 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191232 len 2048 2024-04-26T18:39:02.591 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4191232 len 2048 2024-04-26T18:39:02.592 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191232 len 2048 2024-04-26T18:39:02.592 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4191232 len 4096 2024-04-26T18:39:02.592 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191232 len 4096 2024-04-26T18:39:02.592 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4191232 len 4096 2024-04-26T18:39:02.592 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191232 len 4096 2024-04-26T18:39:02.592 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4191232 len 8192 2024-04-26T18:39:02.592 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191232 len 8192 2024-04-26T18:39:02.592 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4191232 len 8192 2024-04-26T18:39:02.592 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191232 len 8192 2024-04-26T18:39:02.592 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4191232 len 16384 2024-04-26T18:39:02.592 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191232 len 16384 2024-04-26T18:39:02.592 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4191232 len 16384 2024-04-26T18:39:02.592 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191232 len 16384 2024-04-26T18:39:02.593 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4191744 len 1024 2024-04-26T18:39:02.593 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191744 len 1024 2024-04-26T18:39:02.593 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4191744 len 1024 2024-04-26T18:39:02.593 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191744 len 1024 2024-04-26T18:39:02.593 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4191744 len 2048 2024-04-26T18:39:02.593 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191744 len 2048 2024-04-26T18:39:02.593 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4191744 len 2048 2024-04-26T18:39:02.593 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191744 len 2048 2024-04-26T18:39:02.593 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4191744 len 4096 2024-04-26T18:39:02.593 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191744 len 4096 2024-04-26T18:39:02.593 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4191744 len 4096 2024-04-26T18:39:02.593 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191744 len 4096 2024-04-26T18:39:02.593 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4191744 len 8192 2024-04-26T18:39:02.593 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191744 len 8192 2024-04-26T18:39:02.593 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4191744 len 8192 2024-04-26T18:39:02.594 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191744 len 8192 2024-04-26T18:39:02.594 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4191744 len 16384 2024-04-26T18:39:02.594 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191744 len 16384 2024-04-26T18:39:02.594 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4191744 len 16384 2024-04-26T18:39:02.594 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4191744 len 16384 2024-04-26T18:39:02.594 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4192256 len 1024 2024-04-26T18:39:02.594 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192256 len 1024 2024-04-26T18:39:02.594 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4192256 len 1024 2024-04-26T18:39:02.594 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192256 len 1024 2024-04-26T18:39:02.594 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4192256 len 2048 2024-04-26T18:39:02.594 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192256 len 2048 2024-04-26T18:39:02.594 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4192256 len 2048 2024-04-26T18:39:02.608 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192256 len 2048 2024-04-26T18:39:02.609 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4192256 len 4096 2024-04-26T18:39:02.609 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192256 len 4096 2024-04-26T18:39:02.609 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4192256 len 4096 2024-04-26T18:39:02.609 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192256 len 4096 2024-04-26T18:39:02.609 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4192256 len 8192 2024-04-26T18:39:02.609 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192256 len 8192 2024-04-26T18:39:02.609 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4192256 len 8192 2024-04-26T18:39:02.609 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192256 len 8192 2024-04-26T18:39:02.609 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4192256 len 16384 2024-04-26T18:39:02.609 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192256 len 16384 2024-04-26T18:39:02.609 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4192256 len 16384 2024-04-26T18:39:02.609 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192256 len 16384 2024-04-26T18:39:02.609 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4192768 len 1024 2024-04-26T18:39:02.609 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192768 len 1024 2024-04-26T18:39:02.609 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4192768 len 1024 2024-04-26T18:39:02.610 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192768 len 1024 2024-04-26T18:39:02.610 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4192768 len 2048 2024-04-26T18:39:02.610 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192768 len 2048 2024-04-26T18:39:02.610 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4192768 len 2048 2024-04-26T18:39:02.610 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192768 len 2048 2024-04-26T18:39:02.610 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4192768 len 4096 2024-04-26T18:39:02.610 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192768 len 4096 2024-04-26T18:39:02.610 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4192768 len 4096 2024-04-26T18:39:02.610 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192768 len 4096 2024-04-26T18:39:02.610 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4192768 len 8192 2024-04-26T18:39:02.610 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192768 len 8192 2024-04-26T18:39:02.610 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4192768 len 8192 2024-04-26T18:39:02.610 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192768 len 8192 2024-04-26T18:39:02.610 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4192768 len 16384 2024-04-26T18:39:02.611 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192768 len 16384 2024-04-26T18:39:02.611 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4192768 len 16384 2024-04-26T18:39:02.611 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4192768 len 16384 2024-04-26T18:39:02.611 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4193280 len 1024 2024-04-26T18:39:02.611 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193280 len 1024 2024-04-26T18:39:02.611 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4193280 len 1024 2024-04-26T18:39:02.611 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193280 len 1024 2024-04-26T18:39:02.611 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4193280 len 2048 2024-04-26T18:39:02.611 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193280 len 2048 2024-04-26T18:39:02.611 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4193280 len 2048 2024-04-26T18:39:02.611 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193280 len 2048 2024-04-26T18:39:02.611 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4193280 len 4096 2024-04-26T18:39:02.611 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193280 len 4096 2024-04-26T18:39:02.611 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4193280 len 4096 2024-04-26T18:39:02.612 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193280 len 4096 2024-04-26T18:39:02.612 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4193280 len 8192 2024-04-26T18:39:02.612 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193280 len 8192 2024-04-26T18:39:02.612 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4193280 len 8192 2024-04-26T18:39:02.612 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193280 len 8192 2024-04-26T18:39:02.612 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4193280 len 16384 2024-04-26T18:39:02.612 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193280 len 16384 2024-04-26T18:39:02.612 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4193280 len 16384 2024-04-26T18:39:02.612 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193280 len 16384 2024-04-26T18:39:02.612 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4193792 len 1024 2024-04-26T18:39:02.612 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193792 len 1024 2024-04-26T18:39:02.612 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4193792 len 1024 2024-04-26T18:39:02.612 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193792 len 1024 2024-04-26T18:39:02.612 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4193792 len 2048 2024-04-26T18:39:02.612 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193792 len 2048 2024-04-26T18:39:02.613 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4193792 len 2048 2024-04-26T18:39:02.613 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193792 len 2048 2024-04-26T18:39:02.613 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4193792 len 4096 2024-04-26T18:39:02.613 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193792 len 4096 2024-04-26T18:39:02.613 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4193792 len 4096 2024-04-26T18:39:02.613 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193792 len 4096 2024-04-26T18:39:02.613 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4193792 len 8192 2024-04-26T18:39:02.613 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193792 len 8192 2024-04-26T18:39:02.613 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4193792 len 8192 2024-04-26T18:39:02.613 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193792 len 8192 2024-04-26T18:39:02.613 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4193792 len 16384 2024-04-26T18:39:02.613 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193792 len 16384 2024-04-26T18:39:02.613 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4193792 len 16384 2024-04-26T18:39:02.613 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4193792 len 16384 2024-04-26T18:39:02.613 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4194304 len 1024 2024-04-26T18:39:02.614 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194304 len 1024 2024-04-26T18:39:02.614 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4194304 len 1024 2024-04-26T18:39:02.614 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194304 len 1024 2024-04-26T18:39:02.614 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4194304 len 2048 2024-04-26T18:39:02.614 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194304 len 2048 2024-04-26T18:39:02.614 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4194304 len 2048 2024-04-26T18:39:02.614 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194304 len 2048 2024-04-26T18:39:02.614 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4194304 len 4096 2024-04-26T18:39:02.614 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194304 len 4096 2024-04-26T18:39:02.614 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4194304 len 4096 2024-04-26T18:39:02.614 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194304 len 4096 2024-04-26T18:39:02.614 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4194304 len 8192 2024-04-26T18:39:02.614 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194304 len 8192 2024-04-26T18:39:02.614 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4194304 len 8192 2024-04-26T18:39:02.619 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194304 len 8192 2024-04-26T18:39:02.619 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4194304 len 16384 2024-04-26T18:39:02.619 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194304 len 16384 2024-04-26T18:39:02.619 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4194304 len 16384 2024-04-26T18:39:02.619 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194304 len 16384 2024-04-26T18:39:02.619 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4194816 len 1024 2024-04-26T18:39:02.619 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194816 len 1024 2024-04-26T18:39:02.619 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4194816 len 1024 2024-04-26T18:39:02.619 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194816 len 1024 2024-04-26T18:39:02.619 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4194816 len 2048 2024-04-26T18:39:02.620 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194816 len 2048 2024-04-26T18:39:02.620 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4194816 len 2048 2024-04-26T18:39:02.620 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194816 len 2048 2024-04-26T18:39:02.620 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4194816 len 4096 2024-04-26T18:39:02.620 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194816 len 4096 2024-04-26T18:39:02.620 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4194816 len 4096 2024-04-26T18:39:02.620 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194816 len 4096 2024-04-26T18:39:02.620 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4194816 len 8192 2024-04-26T18:39:02.620 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194816 len 8192 2024-04-26T18:39:02.620 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4194816 len 8192 2024-04-26T18:39:02.620 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194816 len 8192 2024-04-26T18:39:02.620 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4194816 len 16384 2024-04-26T18:39:02.620 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194816 len 16384 2024-04-26T18:39:02.620 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4194816 len 16384 2024-04-26T18:39:02.620 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4194816 len 16384 2024-04-26T18:39:02.621 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4195328 len 1024 2024-04-26T18:39:02.621 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195328 len 1024 2024-04-26T18:39:02.621 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4195328 len 1024 2024-04-26T18:39:02.621 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195328 len 1024 2024-04-26T18:39:02.621 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4195328 len 2048 2024-04-26T18:39:02.621 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195328 len 2048 2024-04-26T18:39:02.621 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4195328 len 2048 2024-04-26T18:39:02.621 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195328 len 2048 2024-04-26T18:39:02.621 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4195328 len 4096 2024-04-26T18:39:02.621 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195328 len 4096 2024-04-26T18:39:02.621 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4195328 len 4096 2024-04-26T18:39:02.621 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195328 len 4096 2024-04-26T18:39:02.621 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4195328 len 8192 2024-04-26T18:39:02.621 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195328 len 8192 2024-04-26T18:39:02.621 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4195328 len 8192 2024-04-26T18:39:02.621 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195328 len 8192 2024-04-26T18:39:02.622 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4195328 len 16384 2024-04-26T18:39:02.622 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195328 len 16384 2024-04-26T18:39:02.622 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4195328 len 16384 2024-04-26T18:39:02.622 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195328 len 16384 2024-04-26T18:39:02.622 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4195840 len 1024 2024-04-26T18:39:02.622 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195840 len 1024 2024-04-26T18:39:02.622 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4195840 len 1024 2024-04-26T18:39:02.622 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195840 len 1024 2024-04-26T18:39:02.622 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4195840 len 2048 2024-04-26T18:39:02.622 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195840 len 2048 2024-04-26T18:39:02.622 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4195840 len 2048 2024-04-26T18:39:02.622 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195840 len 2048 2024-04-26T18:39:02.622 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4195840 len 4096 2024-04-26T18:39:02.622 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195840 len 4096 2024-04-26T18:39:02.623 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4195840 len 4096 2024-04-26T18:39:02.623 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195840 len 4096 2024-04-26T18:39:02.623 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4195840 len 8192 2024-04-26T18:39:02.623 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195840 len 8192 2024-04-26T18:39:02.623 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4195840 len 8192 2024-04-26T18:39:02.623 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195840 len 8192 2024-04-26T18:39:02.623 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4195840 len 16384 2024-04-26T18:39:02.623 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195840 len 16384 2024-04-26T18:39:02.623 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4195840 len 16384 2024-04-26T18:39:02.623 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4195840 len 16384 2024-04-26T18:39:02.623 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4196352 len 1024 2024-04-26T18:39:02.623 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196352 len 1024 2024-04-26T18:39:02.623 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4196352 len 1024 2024-04-26T18:39:02.623 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196352 len 1024 2024-04-26T18:39:02.623 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4196352 len 2048 2024-04-26T18:39:02.623 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196352 len 2048 2024-04-26T18:39:02.623 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4196352 len 2048 2024-04-26T18:39:02.624 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196352 len 2048 2024-04-26T18:39:02.624 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4196352 len 4096 2024-04-26T18:39:02.624 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196352 len 4096 2024-04-26T18:39:02.624 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4196352 len 4096 2024-04-26T18:39:02.624 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196352 len 4096 2024-04-26T18:39:02.624 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4196352 len 8192 2024-04-26T18:39:02.624 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196352 len 8192 2024-04-26T18:39:02.624 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4196352 len 8192 2024-04-26T18:39:02.624 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196352 len 8192 2024-04-26T18:39:02.624 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4196352 len 16384 2024-04-26T18:39:02.624 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196352 len 16384 2024-04-26T18:39:02.624 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4196352 len 16384 2024-04-26T18:39:02.624 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196352 len 16384 2024-04-26T18:39:02.624 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4196864 len 1024 2024-04-26T18:39:02.625 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196864 len 1024 2024-04-26T18:39:02.631 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4196864 len 1024 2024-04-26T18:39:02.631 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196864 len 1024 2024-04-26T18:39:02.631 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4196864 len 2048 2024-04-26T18:39:02.631 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196864 len 2048 2024-04-26T18:39:02.631 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4196864 len 2048 2024-04-26T18:39:02.631 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196864 len 2048 2024-04-26T18:39:02.631 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4196864 len 4096 2024-04-26T18:39:02.631 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196864 len 4096 2024-04-26T18:39:02.631 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4196864 len 4096 2024-04-26T18:39:02.631 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196864 len 4096 2024-04-26T18:39:02.632 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4196864 len 8192 2024-04-26T18:39:02.632 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196864 len 8192 2024-04-26T18:39:02.632 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4196864 len 8192 2024-04-26T18:39:02.632 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196864 len 8192 2024-04-26T18:39:02.632 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4196864 len 16384 2024-04-26T18:39:02.632 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196864 len 16384 2024-04-26T18:39:02.632 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4196864 len 16384 2024-04-26T18:39:02.632 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4196864 len 16384 2024-04-26T18:39:02.632 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4197376 len 1024 2024-04-26T18:39:02.632 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197376 len 1024 2024-04-26T18:39:02.632 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4197376 len 1024 2024-04-26T18:39:02.632 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197376 len 1024 2024-04-26T18:39:02.632 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4197376 len 2048 2024-04-26T18:39:02.633 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197376 len 2048 2024-04-26T18:39:02.633 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4197376 len 2048 2024-04-26T18:39:02.633 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197376 len 2048 2024-04-26T18:39:02.633 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4197376 len 4096 2024-04-26T18:39:02.633 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197376 len 4096 2024-04-26T18:39:02.633 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4197376 len 4096 2024-04-26T18:39:02.633 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197376 len 4096 2024-04-26T18:39:02.633 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4197376 len 8192 2024-04-26T18:39:02.633 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197376 len 8192 2024-04-26T18:39:02.633 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4197376 len 8192 2024-04-26T18:39:02.633 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197376 len 8192 2024-04-26T18:39:02.633 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4197376 len 16384 2024-04-26T18:39:02.633 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197376 len 16384 2024-04-26T18:39:02.633 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4197376 len 16384 2024-04-26T18:39:02.633 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197376 len 16384 2024-04-26T18:39:02.634 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4197888 len 1024 2024-04-26T18:39:02.634 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197888 len 1024 2024-04-26T18:39:02.634 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4197888 len 1024 2024-04-26T18:39:02.634 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197888 len 1024 2024-04-26T18:39:02.634 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4197888 len 2048 2024-04-26T18:39:02.634 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197888 len 2048 2024-04-26T18:39:02.634 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4197888 len 2048 2024-04-26T18:39:02.634 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197888 len 2048 2024-04-26T18:39:02.634 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4197888 len 4096 2024-04-26T18:39:02.634 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197888 len 4096 2024-04-26T18:39:02.634 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4197888 len 4096 2024-04-26T18:39:02.634 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197888 len 4096 2024-04-26T18:39:02.634 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4197888 len 8192 2024-04-26T18:39:02.634 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197888 len 8192 2024-04-26T18:39:02.635 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4197888 len 8192 2024-04-26T18:39:02.635 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197888 len 8192 2024-04-26T18:39:02.635 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 0 offset 4197888 len 16384 2024-04-26T18:39:02.635 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197888 len 16384 2024-04-26T18:39:02.635 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 0 offset 4197888 len 16384 2024-04-26T18:39:02.635 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 0 offset 4197888 len 16384 2024-04-26T18:39:02.635 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4190208 len 1024 2024-04-26T18:39:02.635 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190208 len 1024 2024-04-26T18:39:02.635 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4190208 len 1024 2024-04-26T18:39:02.635 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190208 len 1024 2024-04-26T18:39:02.635 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4190208 len 2048 2024-04-26T18:39:02.635 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190208 len 2048 2024-04-26T18:39:02.635 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4190208 len 2048 2024-04-26T18:39:02.635 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190208 len 2048 2024-04-26T18:39:02.635 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4190208 len 4096 2024-04-26T18:39:02.636 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190208 len 4096 2024-04-26T18:39:02.636 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4190208 len 4096 2024-04-26T18:39:02.636 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190208 len 4096 2024-04-26T18:39:02.636 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4190208 len 8192 2024-04-26T18:39:02.636 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190208 len 8192 2024-04-26T18:39:02.636 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4190208 len 8192 2024-04-26T18:39:02.636 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190208 len 8192 2024-04-26T18:39:02.636 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4190208 len 16384 2024-04-26T18:39:02.636 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190208 len 16384 2024-04-26T18:39:02.636 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4190208 len 16384 2024-04-26T18:39:02.636 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190208 len 16384 2024-04-26T18:39:02.636 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4190720 len 1024 2024-04-26T18:39:02.636 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190720 len 1024 2024-04-26T18:39:02.636 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4190720 len 1024 2024-04-26T18:39:02.637 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190720 len 1024 2024-04-26T18:39:02.637 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4190720 len 2048 2024-04-26T18:39:02.637 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190720 len 2048 2024-04-26T18:39:02.637 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4190720 len 2048 2024-04-26T18:39:02.637 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190720 len 2048 2024-04-26T18:39:02.637 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4190720 len 4096 2024-04-26T18:39:02.657 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190720 len 4096 2024-04-26T18:39:02.657 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4190720 len 4096 2024-04-26T18:39:02.657 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190720 len 4096 2024-04-26T18:39:02.657 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4190720 len 8192 2024-04-26T18:39:02.658 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190720 len 8192 2024-04-26T18:39:02.658 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4190720 len 8192 2024-04-26T18:39:02.658 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190720 len 8192 2024-04-26T18:39:02.658 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4190720 len 16384 2024-04-26T18:39:02.658 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190720 len 16384 2024-04-26T18:39:02.658 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4190720 len 16384 2024-04-26T18:39:02.658 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4190720 len 16384 2024-04-26T18:39:02.658 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4191232 len 1024 2024-04-26T18:39:02.658 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191232 len 1024 2024-04-26T18:39:02.658 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4191232 len 1024 2024-04-26T18:39:02.658 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191232 len 1024 2024-04-26T18:39:02.658 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4191232 len 2048 2024-04-26T18:39:02.658 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191232 len 2048 2024-04-26T18:39:02.658 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4191232 len 2048 2024-04-26T18:39:02.659 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191232 len 2048 2024-04-26T18:39:02.659 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4191232 len 4096 2024-04-26T18:39:02.659 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191232 len 4096 2024-04-26T18:39:02.659 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4191232 len 4096 2024-04-26T18:39:02.659 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191232 len 4096 2024-04-26T18:39:02.659 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4191232 len 8192 2024-04-26T18:39:02.659 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191232 len 8192 2024-04-26T18:39:02.659 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4191232 len 8192 2024-04-26T18:39:02.659 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191232 len 8192 2024-04-26T18:39:02.659 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4191232 len 16384 2024-04-26T18:39:02.659 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191232 len 16384 2024-04-26T18:39:02.659 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4191232 len 16384 2024-04-26T18:39:02.659 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191232 len 16384 2024-04-26T18:39:02.659 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4191744 len 1024 2024-04-26T18:39:02.659 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191744 len 1024 2024-04-26T18:39:02.660 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4191744 len 1024 2024-04-26T18:39:02.660 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191744 len 1024 2024-04-26T18:39:02.660 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4191744 len 2048 2024-04-26T18:39:02.660 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191744 len 2048 2024-04-26T18:39:02.660 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4191744 len 2048 2024-04-26T18:39:02.660 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191744 len 2048 2024-04-26T18:39:02.660 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4191744 len 4096 2024-04-26T18:39:02.660 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191744 len 4096 2024-04-26T18:39:02.660 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4191744 len 4096 2024-04-26T18:39:02.660 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191744 len 4096 2024-04-26T18:39:02.660 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4191744 len 8192 2024-04-26T18:39:02.660 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191744 len 8192 2024-04-26T18:39:02.660 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4191744 len 8192 2024-04-26T18:39:02.660 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191744 len 8192 2024-04-26T18:39:02.660 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4191744 len 16384 2024-04-26T18:39:02.661 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191744 len 16384 2024-04-26T18:39:02.661 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4191744 len 16384 2024-04-26T18:39:02.661 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4191744 len 16384 2024-04-26T18:39:02.661 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4192256 len 1024 2024-04-26T18:39:02.661 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192256 len 1024 2024-04-26T18:39:02.661 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4192256 len 1024 2024-04-26T18:39:02.661 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192256 len 1024 2024-04-26T18:39:02.661 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4192256 len 2048 2024-04-26T18:39:02.661 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192256 len 2048 2024-04-26T18:39:02.661 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4192256 len 2048 2024-04-26T18:39:02.661 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192256 len 2048 2024-04-26T18:39:02.661 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4192256 len 4096 2024-04-26T18:39:02.661 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192256 len 4096 2024-04-26T18:39:02.661 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4192256 len 4096 2024-04-26T18:39:02.662 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192256 len 4096 2024-04-26T18:39:02.662 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4192256 len 8192 2024-04-26T18:39:02.662 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192256 len 8192 2024-04-26T18:39:02.662 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4192256 len 8192 2024-04-26T18:39:02.662 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192256 len 8192 2024-04-26T18:39:02.662 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4192256 len 16384 2024-04-26T18:39:02.662 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192256 len 16384 2024-04-26T18:39:02.662 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4192256 len 16384 2024-04-26T18:39:02.662 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192256 len 16384 2024-04-26T18:39:02.662 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4192768 len 1024 2024-04-26T18:39:02.662 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192768 len 1024 2024-04-26T18:39:02.662 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4192768 len 1024 2024-04-26T18:39:02.662 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192768 len 1024 2024-04-26T18:39:02.662 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4192768 len 2048 2024-04-26T18:39:02.662 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192768 len 2048 2024-04-26T18:39:02.663 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4192768 len 2048 2024-04-26T18:39:02.663 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192768 len 2048 2024-04-26T18:39:02.663 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4192768 len 4096 2024-04-26T18:39:02.663 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192768 len 4096 2024-04-26T18:39:02.663 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4192768 len 4096 2024-04-26T18:39:02.663 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192768 len 4096 2024-04-26T18:39:02.663 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4192768 len 8192 2024-04-26T18:39:02.676 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192768 len 8192 2024-04-26T18:39:02.676 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4192768 len 8192 2024-04-26T18:39:02.676 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192768 len 8192 2024-04-26T18:39:02.676 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4192768 len 16384 2024-04-26T18:39:02.676 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192768 len 16384 2024-04-26T18:39:02.676 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4192768 len 16384 2024-04-26T18:39:02.676 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4192768 len 16384 2024-04-26T18:39:02.677 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4193280 len 1024 2024-04-26T18:39:02.677 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193280 len 1024 2024-04-26T18:39:02.677 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4193280 len 1024 2024-04-26T18:39:02.677 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193280 len 1024 2024-04-26T18:39:02.677 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4193280 len 2048 2024-04-26T18:39:02.677 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193280 len 2048 2024-04-26T18:39:02.677 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4193280 len 2048 2024-04-26T18:39:02.677 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193280 len 2048 2024-04-26T18:39:02.677 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4193280 len 4096 2024-04-26T18:39:02.677 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193280 len 4096 2024-04-26T18:39:02.677 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4193280 len 4096 2024-04-26T18:39:02.678 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193280 len 4096 2024-04-26T18:39:02.678 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4193280 len 8192 2024-04-26T18:39:02.678 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193280 len 8192 2024-04-26T18:39:02.678 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4193280 len 8192 2024-04-26T18:39:02.678 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193280 len 8192 2024-04-26T18:39:02.678 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4193280 len 16384 2024-04-26T18:39:02.678 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193280 len 16384 2024-04-26T18:39:02.678 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4193280 len 16384 2024-04-26T18:39:02.678 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193280 len 16384 2024-04-26T18:39:02.678 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4193792 len 1024 2024-04-26T18:39:02.678 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193792 len 1024 2024-04-26T18:39:02.678 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4193792 len 1024 2024-04-26T18:39:02.678 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193792 len 1024 2024-04-26T18:39:02.678 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4193792 len 2048 2024-04-26T18:39:02.679 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193792 len 2048 2024-04-26T18:39:02.679 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4193792 len 2048 2024-04-26T18:39:02.679 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193792 len 2048 2024-04-26T18:39:02.679 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4193792 len 4096 2024-04-26T18:39:02.679 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193792 len 4096 2024-04-26T18:39:02.679 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4193792 len 4096 2024-04-26T18:39:02.679 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193792 len 4096 2024-04-26T18:39:02.679 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4193792 len 8192 2024-04-26T18:39:02.679 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193792 len 8192 2024-04-26T18:39:02.679 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4193792 len 8192 2024-04-26T18:39:02.679 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193792 len 8192 2024-04-26T18:39:02.679 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4193792 len 16384 2024-04-26T18:39:02.679 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193792 len 16384 2024-04-26T18:39:02.679 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4193792 len 16384 2024-04-26T18:39:02.680 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4193792 len 16384 2024-04-26T18:39:02.680 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4194304 len 1024 2024-04-26T18:39:02.680 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194304 len 1024 2024-04-26T18:39:02.680 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4194304 len 1024 2024-04-26T18:39:02.680 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194304 len 1024 2024-04-26T18:39:02.680 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4194304 len 2048 2024-04-26T18:39:02.680 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194304 len 2048 2024-04-26T18:39:02.680 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4194304 len 2048 2024-04-26T18:39:02.680 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194304 len 2048 2024-04-26T18:39:02.680 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4194304 len 4096 2024-04-26T18:39:02.680 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194304 len 4096 2024-04-26T18:39:02.680 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4194304 len 4096 2024-04-26T18:39:02.680 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194304 len 4096 2024-04-26T18:39:02.680 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4194304 len 8192 2024-04-26T18:39:02.680 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194304 len 8192 2024-04-26T18:39:02.681 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4194304 len 8192 2024-04-26T18:39:02.681 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194304 len 8192 2024-04-26T18:39:02.681 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4194304 len 16384 2024-04-26T18:39:02.681 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194304 len 16384 2024-04-26T18:39:02.681 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4194304 len 16384 2024-04-26T18:39:02.681 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194304 len 16384 2024-04-26T18:39:02.681 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4194816 len 1024 2024-04-26T18:39:02.681 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194816 len 1024 2024-04-26T18:39:02.681 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4194816 len 1024 2024-04-26T18:39:02.681 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194816 len 1024 2024-04-26T18:39:02.681 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4194816 len 2048 2024-04-26T18:39:02.681 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194816 len 2048 2024-04-26T18:39:02.681 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4194816 len 2048 2024-04-26T18:39:02.681 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194816 len 2048 2024-04-26T18:39:02.681 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4194816 len 4096 2024-04-26T18:39:02.682 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194816 len 4096 2024-04-26T18:39:02.682 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4194816 len 4096 2024-04-26T18:39:02.682 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194816 len 4096 2024-04-26T18:39:02.682 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4194816 len 8192 2024-04-26T18:39:02.682 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194816 len 8192 2024-04-26T18:39:02.682 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4194816 len 8192 2024-04-26T18:39:02.682 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194816 len 8192 2024-04-26T18:39:02.682 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4194816 len 16384 2024-04-26T18:39:02.685 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194816 len 16384 2024-04-26T18:39:02.685 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4194816 len 16384 2024-04-26T18:39:02.685 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4194816 len 16384 2024-04-26T18:39:02.685 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4195328 len 1024 2024-04-26T18:39:02.685 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195328 len 1024 2024-04-26T18:39:02.686 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4195328 len 1024 2024-04-26T18:39:02.686 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195328 len 1024 2024-04-26T18:39:02.686 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4195328 len 2048 2024-04-26T18:39:02.686 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195328 len 2048 2024-04-26T18:39:02.686 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4195328 len 2048 2024-04-26T18:39:02.686 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195328 len 2048 2024-04-26T18:39:02.686 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4195328 len 4096 2024-04-26T18:39:02.686 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195328 len 4096 2024-04-26T18:39:02.686 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4195328 len 4096 2024-04-26T18:39:02.686 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195328 len 4096 2024-04-26T18:39:02.686 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4195328 len 8192 2024-04-26T18:39:02.686 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195328 len 8192 2024-04-26T18:39:02.686 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4195328 len 8192 2024-04-26T18:39:02.686 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195328 len 8192 2024-04-26T18:39:02.687 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4195328 len 16384 2024-04-26T18:39:02.687 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195328 len 16384 2024-04-26T18:39:02.687 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4195328 len 16384 2024-04-26T18:39:02.687 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195328 len 16384 2024-04-26T18:39:02.687 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4195840 len 1024 2024-04-26T18:39:02.687 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195840 len 1024 2024-04-26T18:39:02.687 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4195840 len 1024 2024-04-26T18:39:02.687 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195840 len 1024 2024-04-26T18:39:02.687 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4195840 len 2048 2024-04-26T18:39:02.687 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195840 len 2048 2024-04-26T18:39:02.687 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4195840 len 2048 2024-04-26T18:39:02.687 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195840 len 2048 2024-04-26T18:39:02.687 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4195840 len 4096 2024-04-26T18:39:02.687 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195840 len 4096 2024-04-26T18:39:02.688 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4195840 len 4096 2024-04-26T18:39:02.688 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195840 len 4096 2024-04-26T18:39:02.688 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4195840 len 8192 2024-04-26T18:39:02.688 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195840 len 8192 2024-04-26T18:39:02.688 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4195840 len 8192 2024-04-26T18:39:02.688 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195840 len 8192 2024-04-26T18:39:02.688 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4195840 len 16384 2024-04-26T18:39:02.688 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195840 len 16384 2024-04-26T18:39:02.688 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4195840 len 16384 2024-04-26T18:39:02.688 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4195840 len 16384 2024-04-26T18:39:02.688 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4196352 len 1024 2024-04-26T18:39:02.688 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196352 len 1024 2024-04-26T18:39:02.688 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4196352 len 1024 2024-04-26T18:39:02.688 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196352 len 1024 2024-04-26T18:39:02.688 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4196352 len 2048 2024-04-26T18:39:02.689 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196352 len 2048 2024-04-26T18:39:02.689 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4196352 len 2048 2024-04-26T18:39:02.689 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196352 len 2048 2024-04-26T18:39:02.689 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4196352 len 4096 2024-04-26T18:39:02.689 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196352 len 4096 2024-04-26T18:39:02.689 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4196352 len 4096 2024-04-26T18:39:02.689 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196352 len 4096 2024-04-26T18:39:02.689 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4196352 len 8192 2024-04-26T18:39:02.689 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196352 len 8192 2024-04-26T18:39:02.689 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4196352 len 8192 2024-04-26T18:39:02.689 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196352 len 8192 2024-04-26T18:39:02.689 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4196352 len 16384 2024-04-26T18:39:02.689 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196352 len 16384 2024-04-26T18:39:02.689 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4196352 len 16384 2024-04-26T18:39:02.689 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196352 len 16384 2024-04-26T18:39:02.690 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4196864 len 1024 2024-04-26T18:39:02.690 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196864 len 1024 2024-04-26T18:39:02.690 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4196864 len 1024 2024-04-26T18:39:02.690 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196864 len 1024 2024-04-26T18:39:02.690 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4196864 len 2048 2024-04-26T18:39:02.690 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196864 len 2048 2024-04-26T18:39:02.690 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4196864 len 2048 2024-04-26T18:39:02.690 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196864 len 2048 2024-04-26T18:39:02.690 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4196864 len 4096 2024-04-26T18:39:02.690 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196864 len 4096 2024-04-26T18:39:02.690 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4196864 len 4096 2024-04-26T18:39:02.690 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196864 len 4096 2024-04-26T18:39:02.690 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4196864 len 8192 2024-04-26T18:39:02.690 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196864 len 8192 2024-04-26T18:39:02.691 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4196864 len 8192 2024-04-26T18:39:02.691 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196864 len 8192 2024-04-26T18:39:02.691 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4196864 len 16384 2024-04-26T18:39:02.691 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196864 len 16384 2024-04-26T18:39:02.691 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4196864 len 16384 2024-04-26T18:39:02.691 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4196864 len 16384 2024-04-26T18:39:02.691 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4197376 len 1024 2024-04-26T18:39:02.700 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197376 len 1024 2024-04-26T18:39:02.700 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4197376 len 1024 2024-04-26T18:39:02.700 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197376 len 1024 2024-04-26T18:39:02.700 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4197376 len 2048 2024-04-26T18:39:02.701 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197376 len 2048 2024-04-26T18:39:02.701 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4197376 len 2048 2024-04-26T18:39:02.701 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197376 len 2048 2024-04-26T18:39:02.701 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4197376 len 4096 2024-04-26T18:39:02.701 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197376 len 4096 2024-04-26T18:39:02.701 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4197376 len 4096 2024-04-26T18:39:02.701 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197376 len 4096 2024-04-26T18:39:02.701 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4197376 len 8192 2024-04-26T18:39:02.701 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197376 len 8192 2024-04-26T18:39:02.701 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4197376 len 8192 2024-04-26T18:39:02.701 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197376 len 8192 2024-04-26T18:39:02.701 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4197376 len 16384 2024-04-26T18:39:02.701 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197376 len 16384 2024-04-26T18:39:02.701 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4197376 len 16384 2024-04-26T18:39:02.701 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197376 len 16384 2024-04-26T18:39:02.702 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4197888 len 1024 2024-04-26T18:39:02.702 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197888 len 1024 2024-04-26T18:39:02.702 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4197888 len 1024 2024-04-26T18:39:02.702 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197888 len 1024 2024-04-26T18:39:02.702 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4197888 len 2048 2024-04-26T18:39:02.702 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197888 len 2048 2024-04-26T18:39:02.702 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4197888 len 2048 2024-04-26T18:39:02.702 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197888 len 2048 2024-04-26T18:39:02.702 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4197888 len 4096 2024-04-26T18:39:02.702 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197888 len 4096 2024-04-26T18:39:02.702 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4197888 len 4096 2024-04-26T18:39:02.702 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197888 len 4096 2024-04-26T18:39:02.702 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4197888 len 8192 2024-04-26T18:39:02.702 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197888 len 8192 2024-04-26T18:39:02.703 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4197888 len 8192 2024-04-26T18:39:02.703 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197888 len 8192 2024-04-26T18:39:02.703 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 512 offset 4197888 len 16384 2024-04-26T18:39:02.703 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197888 len 16384 2024-04-26T18:39:02.703 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 512 offset 4197888 len 16384 2024-04-26T18:39:02.703 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 512 offset 4197888 len 16384 2024-04-26T18:39:02.703 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4190208 len 1024 2024-04-26T18:39:02.703 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190208 len 1024 2024-04-26T18:39:02.703 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4190208 len 1024 2024-04-26T18:39:02.703 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190208 len 1024 2024-04-26T18:39:02.703 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4190208 len 2048 2024-04-26T18:39:02.703 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190208 len 2048 2024-04-26T18:39:02.703 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4190208 len 2048 2024-04-26T18:39:02.703 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190208 len 2048 2024-04-26T18:39:02.704 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4190208 len 4096 2024-04-26T18:39:02.704 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190208 len 4096 2024-04-26T18:39:02.704 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4190208 len 4096 2024-04-26T18:39:02.704 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190208 len 4096 2024-04-26T18:39:02.704 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4190208 len 8192 2024-04-26T18:39:02.704 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190208 len 8192 2024-04-26T18:39:02.704 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4190208 len 8192 2024-04-26T18:39:02.704 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190208 len 8192 2024-04-26T18:39:02.704 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4190208 len 16384 2024-04-26T18:39:02.704 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190208 len 16384 2024-04-26T18:39:02.704 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4190208 len 16384 2024-04-26T18:39:02.704 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190208 len 16384 2024-04-26T18:39:02.704 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4190720 len 1024 2024-04-26T18:39:02.704 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190720 len 1024 2024-04-26T18:39:02.704 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4190720 len 1024 2024-04-26T18:39:02.705 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190720 len 1024 2024-04-26T18:39:02.705 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4190720 len 2048 2024-04-26T18:39:02.705 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190720 len 2048 2024-04-26T18:39:02.705 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4190720 len 2048 2024-04-26T18:39:02.705 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190720 len 2048 2024-04-26T18:39:02.705 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4190720 len 4096 2024-04-26T18:39:02.705 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190720 len 4096 2024-04-26T18:39:02.705 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4190720 len 4096 2024-04-26T18:39:02.705 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190720 len 4096 2024-04-26T18:39:02.705 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4190720 len 8192 2024-04-26T18:39:02.705 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190720 len 8192 2024-04-26T18:39:02.705 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4190720 len 8192 2024-04-26T18:39:02.705 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190720 len 8192 2024-04-26T18:39:02.705 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4190720 len 16384 2024-04-26T18:39:02.705 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190720 len 16384 2024-04-26T18:39:02.706 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4190720 len 16384 2024-04-26T18:39:02.706 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4190720 len 16384 2024-04-26T18:39:02.706 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4191232 len 1024 2024-04-26T18:39:02.706 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191232 len 1024 2024-04-26T18:39:02.706 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4191232 len 1024 2024-04-26T18:39:02.706 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191232 len 1024 2024-04-26T18:39:02.718 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4191232 len 2048 2024-04-26T18:39:02.718 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191232 len 2048 2024-04-26T18:39:02.718 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4191232 len 2048 2024-04-26T18:39:02.718 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191232 len 2048 2024-04-26T18:39:02.718 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4191232 len 4096 2024-04-26T18:39:02.718 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191232 len 4096 2024-04-26T18:39:02.718 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4191232 len 4096 2024-04-26T18:39:02.718 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191232 len 4096 2024-04-26T18:39:02.718 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4191232 len 8192 2024-04-26T18:39:02.718 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191232 len 8192 2024-04-26T18:39:02.718 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4191232 len 8192 2024-04-26T18:39:02.718 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191232 len 8192 2024-04-26T18:39:02.718 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4191232 len 16384 2024-04-26T18:39:02.719 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191232 len 16384 2024-04-26T18:39:02.719 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4191232 len 16384 2024-04-26T18:39:02.719 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191232 len 16384 2024-04-26T18:39:02.719 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4191744 len 1024 2024-04-26T18:39:02.719 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191744 len 1024 2024-04-26T18:39:02.719 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4191744 len 1024 2024-04-26T18:39:02.719 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191744 len 1024 2024-04-26T18:39:02.719 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4191744 len 2048 2024-04-26T18:39:02.719 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191744 len 2048 2024-04-26T18:39:02.719 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4191744 len 2048 2024-04-26T18:39:02.719 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191744 len 2048 2024-04-26T18:39:02.719 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4191744 len 4096 2024-04-26T18:39:02.719 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191744 len 4096 2024-04-26T18:39:02.719 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4191744 len 4096 2024-04-26T18:39:02.720 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191744 len 4096 2024-04-26T18:39:02.720 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4191744 len 8192 2024-04-26T18:39:02.720 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191744 len 8192 2024-04-26T18:39:02.720 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4191744 len 8192 2024-04-26T18:39:02.720 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191744 len 8192 2024-04-26T18:39:02.720 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4191744 len 16384 2024-04-26T18:39:02.720 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191744 len 16384 2024-04-26T18:39:02.720 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4191744 len 16384 2024-04-26T18:39:02.720 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4191744 len 16384 2024-04-26T18:39:02.720 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4192256 len 1024 2024-04-26T18:39:02.720 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192256 len 1024 2024-04-26T18:39:02.720 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4192256 len 1024 2024-04-26T18:39:02.720 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192256 len 1024 2024-04-26T18:39:02.720 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4192256 len 2048 2024-04-26T18:39:02.720 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192256 len 2048 2024-04-26T18:39:02.721 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4192256 len 2048 2024-04-26T18:39:02.721 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192256 len 2048 2024-04-26T18:39:02.721 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4192256 len 4096 2024-04-26T18:39:02.721 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192256 len 4096 2024-04-26T18:39:02.721 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4192256 len 4096 2024-04-26T18:39:02.721 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192256 len 4096 2024-04-26T18:39:02.721 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4192256 len 8192 2024-04-26T18:39:02.721 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192256 len 8192 2024-04-26T18:39:02.721 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4192256 len 8192 2024-04-26T18:39:02.721 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192256 len 8192 2024-04-26T18:39:02.721 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4192256 len 16384 2024-04-26T18:39:02.721 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192256 len 16384 2024-04-26T18:39:02.721 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4192256 len 16384 2024-04-26T18:39:02.721 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192256 len 16384 2024-04-26T18:39:02.721 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4192768 len 1024 2024-04-26T18:39:02.722 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192768 len 1024 2024-04-26T18:39:02.722 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4192768 len 1024 2024-04-26T18:39:02.722 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192768 len 1024 2024-04-26T18:39:02.722 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4192768 len 2048 2024-04-26T18:39:02.722 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192768 len 2048 2024-04-26T18:39:02.722 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4192768 len 2048 2024-04-26T18:39:02.722 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192768 len 2048 2024-04-26T18:39:02.722 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4192768 len 4096 2024-04-26T18:39:02.722 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192768 len 4096 2024-04-26T18:39:02.722 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4192768 len 4096 2024-04-26T18:39:02.722 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192768 len 4096 2024-04-26T18:39:02.722 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4192768 len 8192 2024-04-26T18:39:02.722 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192768 len 8192 2024-04-26T18:39:02.722 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4192768 len 8192 2024-04-26T18:39:02.722 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192768 len 8192 2024-04-26T18:39:02.723 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4192768 len 16384 2024-04-26T18:39:02.723 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192768 len 16384 2024-04-26T18:39:02.723 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4192768 len 16384 2024-04-26T18:39:02.723 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4192768 len 16384 2024-04-26T18:39:02.723 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4193280 len 1024 2024-04-26T18:39:02.723 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193280 len 1024 2024-04-26T18:39:02.723 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4193280 len 1024 2024-04-26T18:39:02.723 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193280 len 1024 2024-04-26T18:39:02.723 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4193280 len 2048 2024-04-26T18:39:02.723 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193280 len 2048 2024-04-26T18:39:02.723 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4193280 len 2048 2024-04-26T18:39:02.733 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193280 len 2048 2024-04-26T18:39:02.733 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4193280 len 4096 2024-04-26T18:39:02.733 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193280 len 4096 2024-04-26T18:39:02.733 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4193280 len 4096 2024-04-26T18:39:02.733 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193280 len 4096 2024-04-26T18:39:02.733 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4193280 len 8192 2024-04-26T18:39:02.733 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193280 len 8192 2024-04-26T18:39:02.734 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4193280 len 8192 2024-04-26T18:39:02.734 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193280 len 8192 2024-04-26T18:39:02.734 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4193280 len 16384 2024-04-26T18:39:02.734 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193280 len 16384 2024-04-26T18:39:02.734 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4193280 len 16384 2024-04-26T18:39:02.734 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193280 len 16384 2024-04-26T18:39:02.734 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4193792 len 1024 2024-04-26T18:39:02.734 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193792 len 1024 2024-04-26T18:39:02.734 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4193792 len 1024 2024-04-26T18:39:02.734 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193792 len 1024 2024-04-26T18:39:02.734 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4193792 len 2048 2024-04-26T18:39:02.734 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193792 len 2048 2024-04-26T18:39:02.734 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4193792 len 2048 2024-04-26T18:39:02.734 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193792 len 2048 2024-04-26T18:39:02.735 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4193792 len 4096 2024-04-26T18:39:02.735 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193792 len 4096 2024-04-26T18:39:02.735 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4193792 len 4096 2024-04-26T18:39:02.735 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193792 len 4096 2024-04-26T18:39:02.735 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4193792 len 8192 2024-04-26T18:39:02.735 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193792 len 8192 2024-04-26T18:39:02.735 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4193792 len 8192 2024-04-26T18:39:02.735 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193792 len 8192 2024-04-26T18:39:02.735 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4193792 len 16384 2024-04-26T18:39:02.735 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193792 len 16384 2024-04-26T18:39:02.735 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4193792 len 16384 2024-04-26T18:39:02.735 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4193792 len 16384 2024-04-26T18:39:02.735 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4194304 len 1024 2024-04-26T18:39:02.735 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194304 len 1024 2024-04-26T18:39:02.735 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4194304 len 1024 2024-04-26T18:39:02.736 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194304 len 1024 2024-04-26T18:39:02.736 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4194304 len 2048 2024-04-26T18:39:02.736 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194304 len 2048 2024-04-26T18:39:02.736 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4194304 len 2048 2024-04-26T18:39:02.736 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194304 len 2048 2024-04-26T18:39:02.736 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4194304 len 4096 2024-04-26T18:39:02.736 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194304 len 4096 2024-04-26T18:39:02.736 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4194304 len 4096 2024-04-26T18:39:02.736 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194304 len 4096 2024-04-26T18:39:02.736 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4194304 len 8192 2024-04-26T18:39:02.736 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194304 len 8192 2024-04-26T18:39:02.736 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4194304 len 8192 2024-04-26T18:39:02.736 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194304 len 8192 2024-04-26T18:39:02.736 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4194304 len 16384 2024-04-26T18:39:02.737 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194304 len 16384 2024-04-26T18:39:02.737 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4194304 len 16384 2024-04-26T18:39:02.737 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194304 len 16384 2024-04-26T18:39:02.737 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4194816 len 1024 2024-04-26T18:39:02.737 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194816 len 1024 2024-04-26T18:39:02.737 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4194816 len 1024 2024-04-26T18:39:02.737 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194816 len 1024 2024-04-26T18:39:02.737 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4194816 len 2048 2024-04-26T18:39:02.737 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194816 len 2048 2024-04-26T18:39:02.737 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4194816 len 2048 2024-04-26T18:39:02.737 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194816 len 2048 2024-04-26T18:39:02.737 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4194816 len 4096 2024-04-26T18:39:02.737 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194816 len 4096 2024-04-26T18:39:02.737 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4194816 len 4096 2024-04-26T18:39:02.737 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194816 len 4096 2024-04-26T18:39:02.737 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4194816 len 8192 2024-04-26T18:39:02.738 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194816 len 8192 2024-04-26T18:39:02.738 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4194816 len 8192 2024-04-26T18:39:02.738 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194816 len 8192 2024-04-26T18:39:02.738 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4194816 len 16384 2024-04-26T18:39:02.738 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194816 len 16384 2024-04-26T18:39:02.738 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4194816 len 16384 2024-04-26T18:39:02.738 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4194816 len 16384 2024-04-26T18:39:02.738 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4195328 len 1024 2024-04-26T18:39:02.738 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195328 len 1024 2024-04-26T18:39:02.738 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4195328 len 1024 2024-04-26T18:39:02.738 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195328 len 1024 2024-04-26T18:39:02.738 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4195328 len 2048 2024-04-26T18:39:02.738 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195328 len 2048 2024-04-26T18:39:02.738 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4195328 len 2048 2024-04-26T18:39:02.739 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195328 len 2048 2024-04-26T18:39:02.739 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4195328 len 4096 2024-04-26T18:39:02.743 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195328 len 4096 2024-04-26T18:39:02.743 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4195328 len 4096 2024-04-26T18:39:02.743 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195328 len 4096 2024-04-26T18:39:02.743 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4195328 len 8192 2024-04-26T18:39:02.744 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195328 len 8192 2024-04-26T18:39:02.744 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4195328 len 8192 2024-04-26T18:39:02.744 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195328 len 8192 2024-04-26T18:39:02.744 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4195328 len 16384 2024-04-26T18:39:02.744 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195328 len 16384 2024-04-26T18:39:02.744 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4195328 len 16384 2024-04-26T18:39:02.744 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195328 len 16384 2024-04-26T18:39:02.744 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4195840 len 1024 2024-04-26T18:39:02.744 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195840 len 1024 2024-04-26T18:39:02.744 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4195840 len 1024 2024-04-26T18:39:02.744 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195840 len 1024 2024-04-26T18:39:02.744 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4195840 len 2048 2024-04-26T18:39:02.744 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195840 len 2048 2024-04-26T18:39:02.744 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4195840 len 2048 2024-04-26T18:39:02.744 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195840 len 2048 2024-04-26T18:39:02.745 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4195840 len 4096 2024-04-26T18:39:02.745 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195840 len 4096 2024-04-26T18:39:02.745 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4195840 len 4096 2024-04-26T18:39:02.745 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195840 len 4096 2024-04-26T18:39:02.745 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4195840 len 8192 2024-04-26T18:39:02.745 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195840 len 8192 2024-04-26T18:39:02.745 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4195840 len 8192 2024-04-26T18:39:02.745 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195840 len 8192 2024-04-26T18:39:02.745 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4195840 len 16384 2024-04-26T18:39:02.745 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195840 len 16384 2024-04-26T18:39:02.745 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4195840 len 16384 2024-04-26T18:39:02.745 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4195840 len 16384 2024-04-26T18:39:02.745 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4196352 len 1024 2024-04-26T18:39:02.745 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196352 len 1024 2024-04-26T18:39:02.745 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4196352 len 1024 2024-04-26T18:39:02.746 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196352 len 1024 2024-04-26T18:39:02.746 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4196352 len 2048 2024-04-26T18:39:02.746 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196352 len 2048 2024-04-26T18:39:02.746 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4196352 len 2048 2024-04-26T18:39:02.746 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196352 len 2048 2024-04-26T18:39:02.746 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4196352 len 4096 2024-04-26T18:39:02.746 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196352 len 4096 2024-04-26T18:39:02.746 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4196352 len 4096 2024-04-26T18:39:02.746 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196352 len 4096 2024-04-26T18:39:02.746 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4196352 len 8192 2024-04-26T18:39:02.746 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196352 len 8192 2024-04-26T18:39:02.746 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4196352 len 8192 2024-04-26T18:39:02.746 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196352 len 8192 2024-04-26T18:39:02.746 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4196352 len 16384 2024-04-26T18:39:02.747 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196352 len 16384 2024-04-26T18:39:02.747 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4196352 len 16384 2024-04-26T18:39:02.747 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196352 len 16384 2024-04-26T18:39:02.747 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4196864 len 1024 2024-04-26T18:39:02.747 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196864 len 1024 2024-04-26T18:39:02.747 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4196864 len 1024 2024-04-26T18:39:02.747 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196864 len 1024 2024-04-26T18:39:02.747 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4196864 len 2048 2024-04-26T18:39:02.747 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196864 len 2048 2024-04-26T18:39:02.747 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4196864 len 2048 2024-04-26T18:39:02.747 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196864 len 2048 2024-04-26T18:39:02.747 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4196864 len 4096 2024-04-26T18:39:02.747 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196864 len 4096 2024-04-26T18:39:02.747 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4196864 len 4096 2024-04-26T18:39:02.747 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196864 len 4096 2024-04-26T18:39:02.748 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4196864 len 8192 2024-04-26T18:39:02.748 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196864 len 8192 2024-04-26T18:39:02.748 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4196864 len 8192 2024-04-26T18:39:02.748 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196864 len 8192 2024-04-26T18:39:02.748 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4196864 len 16384 2024-04-26T18:39:02.748 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196864 len 16384 2024-04-26T18:39:02.748 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4196864 len 16384 2024-04-26T18:39:02.748 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4196864 len 16384 2024-04-26T18:39:02.748 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4197376 len 1024 2024-04-26T18:39:02.748 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197376 len 1024 2024-04-26T18:39:02.748 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4197376 len 1024 2024-04-26T18:39:02.748 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197376 len 1024 2024-04-26T18:39:02.748 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4197376 len 2048 2024-04-26T18:39:02.748 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197376 len 2048 2024-04-26T18:39:02.748 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4197376 len 2048 2024-04-26T18:39:02.749 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197376 len 2048 2024-04-26T18:39:02.749 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4197376 len 4096 2024-04-26T18:39:02.749 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197376 len 4096 2024-04-26T18:39:02.749 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4197376 len 4096 2024-04-26T18:39:02.749 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197376 len 4096 2024-04-26T18:39:02.758 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4197376 len 8192 2024-04-26T18:39:02.758 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197376 len 8192 2024-04-26T18:39:02.758 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4197376 len 8192 2024-04-26T18:39:02.758 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197376 len 8192 2024-04-26T18:39:02.758 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4197376 len 16384 2024-04-26T18:39:02.758 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197376 len 16384 2024-04-26T18:39:02.759 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4197376 len 16384 2024-04-26T18:39:02.759 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197376 len 16384 2024-04-26T18:39:02.759 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4197888 len 1024 2024-04-26T18:39:02.759 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197888 len 1024 2024-04-26T18:39:02.759 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4197888 len 1024 2024-04-26T18:39:02.759 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197888 len 1024 2024-04-26T18:39:02.759 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4197888 len 2048 2024-04-26T18:39:02.759 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197888 len 2048 2024-04-26T18:39:02.759 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4197888 len 2048 2024-04-26T18:39:02.759 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197888 len 2048 2024-04-26T18:39:02.759 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4197888 len 4096 2024-04-26T18:39:02.759 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197888 len 4096 2024-04-26T18:39:02.759 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4197888 len 4096 2024-04-26T18:39:02.759 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197888 len 4096 2024-04-26T18:39:02.759 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4197888 len 8192 2024-04-26T18:39:02.759 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197888 len 8192 2024-04-26T18:39:02.760 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4197888 len 8192 2024-04-26T18:39:02.760 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197888 len 8192 2024-04-26T18:39:02.760 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1024 offset 4197888 len 16384 2024-04-26T18:39:02.760 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197888 len 16384 2024-04-26T18:39:02.760 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1024 offset 4197888 len 16384 2024-04-26T18:39:02.760 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1024 offset 4197888 len 16384 2024-04-26T18:39:02.760 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4190208 len 1024 2024-04-26T18:39:02.760 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190208 len 1024 2024-04-26T18:39:02.760 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4190208 len 1024 2024-04-26T18:39:02.760 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190208 len 1024 2024-04-26T18:39:02.760 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4190208 len 2048 2024-04-26T18:39:02.760 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190208 len 2048 2024-04-26T18:39:02.760 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4190208 len 2048 2024-04-26T18:39:02.760 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190208 len 2048 2024-04-26T18:39:02.760 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4190208 len 4096 2024-04-26T18:39:02.761 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190208 len 4096 2024-04-26T18:39:02.761 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4190208 len 4096 2024-04-26T18:39:02.761 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190208 len 4096 2024-04-26T18:39:02.761 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4190208 len 8192 2024-04-26T18:39:02.761 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190208 len 8192 2024-04-26T18:39:02.761 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4190208 len 8192 2024-04-26T18:39:02.761 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190208 len 8192 2024-04-26T18:39:02.761 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4190208 len 16384 2024-04-26T18:39:02.761 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190208 len 16384 2024-04-26T18:39:02.761 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4190208 len 16384 2024-04-26T18:39:02.761 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190208 len 16384 2024-04-26T18:39:02.761 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4190720 len 1024 2024-04-26T18:39:02.761 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190720 len 1024 2024-04-26T18:39:02.761 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4190720 len 1024 2024-04-26T18:39:02.762 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190720 len 1024 2024-04-26T18:39:02.762 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4190720 len 2048 2024-04-26T18:39:02.762 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190720 len 2048 2024-04-26T18:39:02.762 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4190720 len 2048 2024-04-26T18:39:02.762 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190720 len 2048 2024-04-26T18:39:02.762 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4190720 len 4096 2024-04-26T18:39:02.762 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190720 len 4096 2024-04-26T18:39:02.762 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4190720 len 4096 2024-04-26T18:39:02.762 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190720 len 4096 2024-04-26T18:39:02.762 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4190720 len 8192 2024-04-26T18:39:02.762 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190720 len 8192 2024-04-26T18:39:02.762 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4190720 len 8192 2024-04-26T18:39:02.762 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190720 len 8192 2024-04-26T18:39:02.762 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4190720 len 16384 2024-04-26T18:39:02.762 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190720 len 16384 2024-04-26T18:39:02.763 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4190720 len 16384 2024-04-26T18:39:02.763 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4190720 len 16384 2024-04-26T18:39:02.763 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4191232 len 1024 2024-04-26T18:39:02.763 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191232 len 1024 2024-04-26T18:39:02.763 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4191232 len 1024 2024-04-26T18:39:02.763 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191232 len 1024 2024-04-26T18:39:02.763 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4191232 len 2048 2024-04-26T18:39:02.763 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191232 len 2048 2024-04-26T18:39:02.763 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4191232 len 2048 2024-04-26T18:39:02.763 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191232 len 2048 2024-04-26T18:39:02.763 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4191232 len 4096 2024-04-26T18:39:02.763 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191232 len 4096 2024-04-26T18:39:02.763 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4191232 len 4096 2024-04-26T18:39:02.763 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191232 len 4096 2024-04-26T18:39:02.763 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4191232 len 8192 2024-04-26T18:39:02.764 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191232 len 8192 2024-04-26T18:39:02.777 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4191232 len 8192 2024-04-26T18:39:02.777 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191232 len 8192 2024-04-26T18:39:02.777 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4191232 len 16384 2024-04-26T18:39:02.777 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191232 len 16384 2024-04-26T18:39:02.777 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4191232 len 16384 2024-04-26T18:39:02.777 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191232 len 16384 2024-04-26T18:39:02.777 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4191744 len 1024 2024-04-26T18:39:02.777 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191744 len 1024 2024-04-26T18:39:02.777 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4191744 len 1024 2024-04-26T18:39:02.777 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191744 len 1024 2024-04-26T18:39:02.778 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4191744 len 2048 2024-04-26T18:39:02.778 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191744 len 2048 2024-04-26T18:39:02.778 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4191744 len 2048 2024-04-26T18:39:02.778 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191744 len 2048 2024-04-26T18:39:02.778 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4191744 len 4096 2024-04-26T18:39:02.778 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191744 len 4096 2024-04-26T18:39:02.778 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4191744 len 4096 2024-04-26T18:39:02.778 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191744 len 4096 2024-04-26T18:39:02.778 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4191744 len 8192 2024-04-26T18:39:02.778 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191744 len 8192 2024-04-26T18:39:02.778 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4191744 len 8192 2024-04-26T18:39:02.778 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191744 len 8192 2024-04-26T18:39:02.778 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4191744 len 16384 2024-04-26T18:39:02.778 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191744 len 16384 2024-04-26T18:39:02.779 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4191744 len 16384 2024-04-26T18:39:02.779 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4191744 len 16384 2024-04-26T18:39:02.779 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4192256 len 1024 2024-04-26T18:39:02.779 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192256 len 1024 2024-04-26T18:39:02.779 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4192256 len 1024 2024-04-26T18:39:02.779 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192256 len 1024 2024-04-26T18:39:02.779 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4192256 len 2048 2024-04-26T18:39:02.779 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192256 len 2048 2024-04-26T18:39:02.779 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4192256 len 2048 2024-04-26T18:39:02.779 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192256 len 2048 2024-04-26T18:39:02.779 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4192256 len 4096 2024-04-26T18:39:02.779 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192256 len 4096 2024-04-26T18:39:02.779 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4192256 len 4096 2024-04-26T18:39:02.779 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192256 len 4096 2024-04-26T18:39:02.780 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4192256 len 8192 2024-04-26T18:39:02.780 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192256 len 8192 2024-04-26T18:39:02.780 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4192256 len 8192 2024-04-26T18:39:02.780 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192256 len 8192 2024-04-26T18:39:02.780 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4192256 len 16384 2024-04-26T18:39:02.780 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192256 len 16384 2024-04-26T18:39:02.780 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4192256 len 16384 2024-04-26T18:39:02.780 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192256 len 16384 2024-04-26T18:39:02.780 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4192768 len 1024 2024-04-26T18:39:02.780 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192768 len 1024 2024-04-26T18:39:02.780 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4192768 len 1024 2024-04-26T18:39:02.780 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192768 len 1024 2024-04-26T18:39:02.780 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4192768 len 2048 2024-04-26T18:39:02.780 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192768 len 2048 2024-04-26T18:39:02.780 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4192768 len 2048 2024-04-26T18:39:02.781 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192768 len 2048 2024-04-26T18:39:02.781 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4192768 len 4096 2024-04-26T18:39:02.781 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192768 len 4096 2024-04-26T18:39:02.781 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4192768 len 4096 2024-04-26T18:39:02.781 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192768 len 4096 2024-04-26T18:39:02.781 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4192768 len 8192 2024-04-26T18:39:02.781 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192768 len 8192 2024-04-26T18:39:02.781 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4192768 len 8192 2024-04-26T18:39:02.781 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192768 len 8192 2024-04-26T18:39:02.781 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4192768 len 16384 2024-04-26T18:39:02.781 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192768 len 16384 2024-04-26T18:39:02.781 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4192768 len 16384 2024-04-26T18:39:02.781 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4192768 len 16384 2024-04-26T18:39:02.781 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4193280 len 1024 2024-04-26T18:39:02.781 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193280 len 1024 2024-04-26T18:39:02.782 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4193280 len 1024 2024-04-26T18:39:02.782 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193280 len 1024 2024-04-26T18:39:02.782 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4193280 len 2048 2024-04-26T18:39:02.782 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193280 len 2048 2024-04-26T18:39:02.782 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4193280 len 2048 2024-04-26T18:39:02.782 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193280 len 2048 2024-04-26T18:39:02.782 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4193280 len 4096 2024-04-26T18:39:02.782 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193280 len 4096 2024-04-26T18:39:02.782 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4193280 len 4096 2024-04-26T18:39:02.782 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193280 len 4096 2024-04-26T18:39:02.782 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4193280 len 8192 2024-04-26T18:39:02.782 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193280 len 8192 2024-04-26T18:39:02.782 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4193280 len 8192 2024-04-26T18:39:02.782 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193280 len 8192 2024-04-26T18:39:02.789 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4193280 len 16384 2024-04-26T18:39:02.789 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193280 len 16384 2024-04-26T18:39:02.789 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4193280 len 16384 2024-04-26T18:39:02.789 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193280 len 16384 2024-04-26T18:39:02.789 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4193792 len 1024 2024-04-26T18:39:02.789 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193792 len 1024 2024-04-26T18:39:02.789 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4193792 len 1024 2024-04-26T18:39:02.789 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193792 len 1024 2024-04-26T18:39:02.790 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4193792 len 2048 2024-04-26T18:39:02.790 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193792 len 2048 2024-04-26T18:39:02.790 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4193792 len 2048 2024-04-26T18:39:02.790 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193792 len 2048 2024-04-26T18:39:02.790 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4193792 len 4096 2024-04-26T18:39:02.790 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193792 len 4096 2024-04-26T18:39:02.790 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4193792 len 4096 2024-04-26T18:39:02.790 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193792 len 4096 2024-04-26T18:39:02.790 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4193792 len 8192 2024-04-26T18:39:02.790 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193792 len 8192 2024-04-26T18:39:02.790 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4193792 len 8192 2024-04-26T18:39:02.790 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193792 len 8192 2024-04-26T18:39:02.790 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4193792 len 16384 2024-04-26T18:39:02.790 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193792 len 16384 2024-04-26T18:39:02.791 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4193792 len 16384 2024-04-26T18:39:02.791 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4193792 len 16384 2024-04-26T18:39:02.791 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4194304 len 1024 2024-04-26T18:39:02.791 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194304 len 1024 2024-04-26T18:39:02.791 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4194304 len 1024 2024-04-26T18:39:02.791 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194304 len 1024 2024-04-26T18:39:02.791 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4194304 len 2048 2024-04-26T18:39:02.791 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194304 len 2048 2024-04-26T18:39:02.791 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4194304 len 2048 2024-04-26T18:39:02.791 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194304 len 2048 2024-04-26T18:39:02.791 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4194304 len 4096 2024-04-26T18:39:02.791 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194304 len 4096 2024-04-26T18:39:02.791 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4194304 len 4096 2024-04-26T18:39:02.791 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194304 len 4096 2024-04-26T18:39:02.791 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4194304 len 8192 2024-04-26T18:39:02.792 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194304 len 8192 2024-04-26T18:39:02.792 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4194304 len 8192 2024-04-26T18:39:02.792 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194304 len 8192 2024-04-26T18:39:02.792 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4194304 len 16384 2024-04-26T18:39:02.792 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194304 len 16384 2024-04-26T18:39:02.792 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4194304 len 16384 2024-04-26T18:39:02.792 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194304 len 16384 2024-04-26T18:39:02.792 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4194816 len 1024 2024-04-26T18:39:02.792 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194816 len 1024 2024-04-26T18:39:02.792 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4194816 len 1024 2024-04-26T18:39:02.792 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194816 len 1024 2024-04-26T18:39:02.792 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4194816 len 2048 2024-04-26T18:39:02.792 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194816 len 2048 2024-04-26T18:39:02.792 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4194816 len 2048 2024-04-26T18:39:02.793 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194816 len 2048 2024-04-26T18:39:02.793 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4194816 len 4096 2024-04-26T18:39:02.793 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194816 len 4096 2024-04-26T18:39:02.793 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4194816 len 4096 2024-04-26T18:39:02.793 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194816 len 4096 2024-04-26T18:39:02.793 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4194816 len 8192 2024-04-26T18:39:02.793 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194816 len 8192 2024-04-26T18:39:02.793 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4194816 len 8192 2024-04-26T18:39:02.793 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194816 len 8192 2024-04-26T18:39:02.793 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4194816 len 16384 2024-04-26T18:39:02.793 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194816 len 16384 2024-04-26T18:39:02.793 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4194816 len 16384 2024-04-26T18:39:02.793 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4194816 len 16384 2024-04-26T18:39:02.793 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4195328 len 1024 2024-04-26T18:39:02.793 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195328 len 1024 2024-04-26T18:39:02.794 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4195328 len 1024 2024-04-26T18:39:02.794 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195328 len 1024 2024-04-26T18:39:02.794 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4195328 len 2048 2024-04-26T18:39:02.794 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195328 len 2048 2024-04-26T18:39:02.794 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4195328 len 2048 2024-04-26T18:39:02.794 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195328 len 2048 2024-04-26T18:39:02.794 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4195328 len 4096 2024-04-26T18:39:02.794 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195328 len 4096 2024-04-26T18:39:02.794 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4195328 len 4096 2024-04-26T18:39:02.794 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195328 len 4096 2024-04-26T18:39:02.794 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4195328 len 8192 2024-04-26T18:39:02.794 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195328 len 8192 2024-04-26T18:39:02.794 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4195328 len 8192 2024-04-26T18:39:02.794 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195328 len 8192 2024-04-26T18:39:02.794 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4195328 len 16384 2024-04-26T18:39:02.795 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195328 len 16384 2024-04-26T18:39:02.795 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4195328 len 16384 2024-04-26T18:39:02.797 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195328 len 16384 2024-04-26T18:39:02.798 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4195840 len 1024 2024-04-26T18:39:02.798 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195840 len 1024 2024-04-26T18:39:02.798 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4195840 len 1024 2024-04-26T18:39:02.798 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195840 len 1024 2024-04-26T18:39:02.798 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4195840 len 2048 2024-04-26T18:39:02.798 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195840 len 2048 2024-04-26T18:39:02.798 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4195840 len 2048 2024-04-26T18:39:02.798 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195840 len 2048 2024-04-26T18:39:02.798 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4195840 len 4096 2024-04-26T18:39:02.798 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195840 len 4096 2024-04-26T18:39:02.798 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4195840 len 4096 2024-04-26T18:39:02.798 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195840 len 4096 2024-04-26T18:39:02.798 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4195840 len 8192 2024-04-26T18:39:02.799 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195840 len 8192 2024-04-26T18:39:02.799 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4195840 len 8192 2024-04-26T18:39:02.799 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195840 len 8192 2024-04-26T18:39:02.799 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4195840 len 16384 2024-04-26T18:39:02.799 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195840 len 16384 2024-04-26T18:39:02.799 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4195840 len 16384 2024-04-26T18:39:02.799 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4195840 len 16384 2024-04-26T18:39:02.799 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4196352 len 1024 2024-04-26T18:39:02.799 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196352 len 1024 2024-04-26T18:39:02.799 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4196352 len 1024 2024-04-26T18:39:02.799 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196352 len 1024 2024-04-26T18:39:02.799 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4196352 len 2048 2024-04-26T18:39:02.799 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196352 len 2048 2024-04-26T18:39:02.799 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4196352 len 2048 2024-04-26T18:39:02.799 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196352 len 2048 2024-04-26T18:39:02.800 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4196352 len 4096 2024-04-26T18:39:02.800 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196352 len 4096 2024-04-26T18:39:02.800 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4196352 len 4096 2024-04-26T18:39:02.800 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196352 len 4096 2024-04-26T18:39:02.800 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4196352 len 8192 2024-04-26T18:39:02.800 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196352 len 8192 2024-04-26T18:39:02.800 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4196352 len 8192 2024-04-26T18:39:02.800 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196352 len 8192 2024-04-26T18:39:02.800 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4196352 len 16384 2024-04-26T18:39:02.800 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196352 len 16384 2024-04-26T18:39:02.800 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4196352 len 16384 2024-04-26T18:39:02.800 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196352 len 16384 2024-04-26T18:39:02.800 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4196864 len 1024 2024-04-26T18:39:02.800 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196864 len 1024 2024-04-26T18:39:02.800 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4196864 len 1024 2024-04-26T18:39:02.801 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196864 len 1024 2024-04-26T18:39:02.801 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4196864 len 2048 2024-04-26T18:39:02.801 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196864 len 2048 2024-04-26T18:39:02.801 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4196864 len 2048 2024-04-26T18:39:02.801 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196864 len 2048 2024-04-26T18:39:02.801 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4196864 len 4096 2024-04-26T18:39:02.801 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196864 len 4096 2024-04-26T18:39:02.801 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4196864 len 4096 2024-04-26T18:39:02.801 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196864 len 4096 2024-04-26T18:39:02.801 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4196864 len 8192 2024-04-26T18:39:02.801 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196864 len 8192 2024-04-26T18:39:02.801 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4196864 len 8192 2024-04-26T18:39:02.801 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196864 len 8192 2024-04-26T18:39:02.801 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4196864 len 16384 2024-04-26T18:39:02.802 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196864 len 16384 2024-04-26T18:39:02.802 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4196864 len 16384 2024-04-26T18:39:02.802 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4196864 len 16384 2024-04-26T18:39:02.802 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4197376 len 1024 2024-04-26T18:39:02.802 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197376 len 1024 2024-04-26T18:39:02.802 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4197376 len 1024 2024-04-26T18:39:02.802 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197376 len 1024 2024-04-26T18:39:02.802 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4197376 len 2048 2024-04-26T18:39:02.802 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197376 len 2048 2024-04-26T18:39:02.802 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4197376 len 2048 2024-04-26T18:39:02.802 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197376 len 2048 2024-04-26T18:39:02.802 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4197376 len 4096 2024-04-26T18:39:02.802 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197376 len 4096 2024-04-26T18:39:02.802 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4197376 len 4096 2024-04-26T18:39:02.802 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197376 len 4096 2024-04-26T18:39:02.803 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4197376 len 8192 2024-04-26T18:39:02.803 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197376 len 8192 2024-04-26T18:39:02.803 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4197376 len 8192 2024-04-26T18:39:02.803 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197376 len 8192 2024-04-26T18:39:02.803 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4197376 len 16384 2024-04-26T18:39:02.803 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197376 len 16384 2024-04-26T18:39:02.803 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4197376 len 16384 2024-04-26T18:39:02.803 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197376 len 16384 2024-04-26T18:39:02.803 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4197888 len 1024 2024-04-26T18:39:02.812 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197888 len 1024 2024-04-26T18:39:02.812 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4197888 len 1024 2024-04-26T18:39:02.812 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197888 len 1024 2024-04-26T18:39:02.813 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4197888 len 2048 2024-04-26T18:39:02.813 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197888 len 2048 2024-04-26T18:39:02.813 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4197888 len 2048 2024-04-26T18:39:02.813 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197888 len 2048 2024-04-26T18:39:02.813 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4197888 len 4096 2024-04-26T18:39:02.813 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197888 len 4096 2024-04-26T18:39:02.813 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4197888 len 4096 2024-04-26T18:39:02.813 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197888 len 4096 2024-04-26T18:39:02.813 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4197888 len 8192 2024-04-26T18:39:02.813 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197888 len 8192 2024-04-26T18:39:02.813 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4197888 len 8192 2024-04-26T18:39:02.813 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197888 len 8192 2024-04-26T18:39:02.813 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 1536 offset 4197888 len 16384 2024-04-26T18:39:02.813 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197888 len 16384 2024-04-26T18:39:02.813 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 1536 offset 4197888 len 16384 2024-04-26T18:39:02.814 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 1536 offset 4197888 len 16384 2024-04-26T18:39:02.814 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4190208 len 1024 2024-04-26T18:39:02.814 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190208 len 1024 2024-04-26T18:39:02.814 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4190208 len 1024 2024-04-26T18:39:02.814 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190208 len 1024 2024-04-26T18:39:02.814 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4190208 len 2048 2024-04-26T18:39:02.814 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190208 len 2048 2024-04-26T18:39:02.814 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4190208 len 2048 2024-04-26T18:39:02.814 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190208 len 2048 2024-04-26T18:39:02.814 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4190208 len 4096 2024-04-26T18:39:02.814 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190208 len 4096 2024-04-26T18:39:02.814 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4190208 len 4096 2024-04-26T18:39:02.814 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190208 len 4096 2024-04-26T18:39:02.814 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4190208 len 8192 2024-04-26T18:39:02.815 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190208 len 8192 2024-04-26T18:39:02.815 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4190208 len 8192 2024-04-26T18:39:02.815 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190208 len 8192 2024-04-26T18:39:02.815 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4190208 len 16384 2024-04-26T18:39:02.815 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190208 len 16384 2024-04-26T18:39:02.815 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4190208 len 16384 2024-04-26T18:39:02.815 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190208 len 16384 2024-04-26T18:39:02.815 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4190720 len 1024 2024-04-26T18:39:02.815 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190720 len 1024 2024-04-26T18:39:02.815 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4190720 len 1024 2024-04-26T18:39:02.815 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190720 len 1024 2024-04-26T18:39:02.815 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4190720 len 2048 2024-04-26T18:39:02.815 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190720 len 2048 2024-04-26T18:39:02.815 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4190720 len 2048 2024-04-26T18:39:02.815 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190720 len 2048 2024-04-26T18:39:02.815 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4190720 len 4096 2024-04-26T18:39:02.816 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190720 len 4096 2024-04-26T18:39:02.816 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4190720 len 4096 2024-04-26T18:39:02.816 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190720 len 4096 2024-04-26T18:39:02.816 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4190720 len 8192 2024-04-26T18:39:02.816 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190720 len 8192 2024-04-26T18:39:02.816 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4190720 len 8192 2024-04-26T18:39:02.816 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190720 len 8192 2024-04-26T18:39:02.816 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4190720 len 16384 2024-04-26T18:39:02.816 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190720 len 16384 2024-04-26T18:39:02.816 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4190720 len 16384 2024-04-26T18:39:02.816 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4190720 len 16384 2024-04-26T18:39:02.816 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4191232 len 1024 2024-04-26T18:39:02.816 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191232 len 1024 2024-04-26T18:39:02.816 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4191232 len 1024 2024-04-26T18:39:02.817 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191232 len 1024 2024-04-26T18:39:02.817 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4191232 len 2048 2024-04-26T18:39:02.817 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191232 len 2048 2024-04-26T18:39:02.817 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4191232 len 2048 2024-04-26T18:39:02.817 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191232 len 2048 2024-04-26T18:39:02.817 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4191232 len 4096 2024-04-26T18:39:02.817 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191232 len 4096 2024-04-26T18:39:02.817 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4191232 len 4096 2024-04-26T18:39:02.817 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191232 len 4096 2024-04-26T18:39:02.817 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4191232 len 8192 2024-04-26T18:39:02.817 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191232 len 8192 2024-04-26T18:39:02.817 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4191232 len 8192 2024-04-26T18:39:02.817 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191232 len 8192 2024-04-26T18:39:02.817 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4191232 len 16384 2024-04-26T18:39:02.818 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191232 len 16384 2024-04-26T18:39:02.818 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4191232 len 16384 2024-04-26T18:39:02.818 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191232 len 16384 2024-04-26T18:39:02.818 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4191744 len 1024 2024-04-26T18:39:02.818 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191744 len 1024 2024-04-26T18:39:02.818 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4191744 len 1024 2024-04-26T18:39:02.818 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191744 len 1024 2024-04-26T18:39:02.832 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4191744 len 2048 2024-04-26T18:39:02.832 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191744 len 2048 2024-04-26T18:39:02.832 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4191744 len 2048 2024-04-26T18:39:02.833 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191744 len 2048 2024-04-26T18:39:02.833 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4191744 len 4096 2024-04-26T18:39:02.833 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191744 len 4096 2024-04-26T18:39:02.833 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4191744 len 4096 2024-04-26T18:39:02.833 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191744 len 4096 2024-04-26T18:39:02.833 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4191744 len 8192 2024-04-26T18:39:02.833 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191744 len 8192 2024-04-26T18:39:02.833 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4191744 len 8192 2024-04-26T18:39:02.833 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191744 len 8192 2024-04-26T18:39:02.833 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4191744 len 16384 2024-04-26T18:39:02.833 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191744 len 16384 2024-04-26T18:39:02.833 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4191744 len 16384 2024-04-26T18:39:02.833 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4191744 len 16384 2024-04-26T18:39:02.833 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4192256 len 1024 2024-04-26T18:39:02.834 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192256 len 1024 2024-04-26T18:39:02.834 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4192256 len 1024 2024-04-26T18:39:02.834 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192256 len 1024 2024-04-26T18:39:02.834 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4192256 len 2048 2024-04-26T18:39:02.834 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192256 len 2048 2024-04-26T18:39:02.834 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4192256 len 2048 2024-04-26T18:39:02.834 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192256 len 2048 2024-04-26T18:39:02.834 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4192256 len 4096 2024-04-26T18:39:02.834 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192256 len 4096 2024-04-26T18:39:02.834 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4192256 len 4096 2024-04-26T18:39:02.834 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192256 len 4096 2024-04-26T18:39:02.834 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4192256 len 8192 2024-04-26T18:39:02.834 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192256 len 8192 2024-04-26T18:39:02.834 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4192256 len 8192 2024-04-26T18:39:02.835 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192256 len 8192 2024-04-26T18:39:02.835 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4192256 len 16384 2024-04-26T18:39:02.835 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192256 len 16384 2024-04-26T18:39:02.835 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4192256 len 16384 2024-04-26T18:39:02.835 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192256 len 16384 2024-04-26T18:39:02.835 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4192768 len 1024 2024-04-26T18:39:02.835 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192768 len 1024 2024-04-26T18:39:02.835 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4192768 len 1024 2024-04-26T18:39:02.835 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192768 len 1024 2024-04-26T18:39:02.835 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4192768 len 2048 2024-04-26T18:39:02.835 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192768 len 2048 2024-04-26T18:39:02.835 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4192768 len 2048 2024-04-26T18:39:02.835 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192768 len 2048 2024-04-26T18:39:02.835 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4192768 len 4096 2024-04-26T18:39:02.835 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192768 len 4096 2024-04-26T18:39:02.836 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4192768 len 4096 2024-04-26T18:39:02.836 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192768 len 4096 2024-04-26T18:39:02.836 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4192768 len 8192 2024-04-26T18:39:02.836 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192768 len 8192 2024-04-26T18:39:02.836 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4192768 len 8192 2024-04-26T18:39:02.836 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192768 len 8192 2024-04-26T18:39:02.836 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4192768 len 16384 2024-04-26T18:39:02.836 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192768 len 16384 2024-04-26T18:39:02.836 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4192768 len 16384 2024-04-26T18:39:02.836 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4192768 len 16384 2024-04-26T18:39:02.836 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4193280 len 1024 2024-04-26T18:39:02.836 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193280 len 1024 2024-04-26T18:39:02.836 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4193280 len 1024 2024-04-26T18:39:02.836 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193280 len 1024 2024-04-26T18:39:02.837 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4193280 len 2048 2024-04-26T18:39:02.837 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193280 len 2048 2024-04-26T18:39:02.837 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4193280 len 2048 2024-04-26T18:39:02.837 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193280 len 2048 2024-04-26T18:39:02.837 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4193280 len 4096 2024-04-26T18:39:02.837 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193280 len 4096 2024-04-26T18:39:02.837 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4193280 len 4096 2024-04-26T18:39:02.837 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193280 len 4096 2024-04-26T18:39:02.837 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4193280 len 8192 2024-04-26T18:39:02.837 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193280 len 8192 2024-04-26T18:39:02.837 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4193280 len 8192 2024-04-26T18:39:02.837 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193280 len 8192 2024-04-26T18:39:02.837 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4193280 len 16384 2024-04-26T18:39:02.837 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193280 len 16384 2024-04-26T18:39:02.837 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4193280 len 16384 2024-04-26T18:39:02.838 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193280 len 16384 2024-04-26T18:39:02.838 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4193792 len 1024 2024-04-26T18:39:02.838 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193792 len 1024 2024-04-26T18:39:02.838 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4193792 len 1024 2024-04-26T18:39:02.838 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193792 len 1024 2024-04-26T18:39:02.838 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4193792 len 2048 2024-04-26T18:39:02.838 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193792 len 2048 2024-04-26T18:39:02.843 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4193792 len 2048 2024-04-26T18:39:02.843 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193792 len 2048 2024-04-26T18:39:02.843 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4193792 len 4096 2024-04-26T18:39:02.843 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193792 len 4096 2024-04-26T18:39:02.843 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4193792 len 4096 2024-04-26T18:39:02.843 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193792 len 4096 2024-04-26T18:39:02.843 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4193792 len 8192 2024-04-26T18:39:02.843 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193792 len 8192 2024-04-26T18:39:02.843 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4193792 len 8192 2024-04-26T18:39:02.844 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193792 len 8192 2024-04-26T18:39:02.844 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4193792 len 16384 2024-04-26T18:39:02.844 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193792 len 16384 2024-04-26T18:39:02.844 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4193792 len 16384 2024-04-26T18:39:02.844 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4193792 len 16384 2024-04-26T18:39:02.844 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4194304 len 1024 2024-04-26T18:39:02.844 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194304 len 1024 2024-04-26T18:39:02.844 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4194304 len 1024 2024-04-26T18:39:02.844 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194304 len 1024 2024-04-26T18:39:02.844 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4194304 len 2048 2024-04-26T18:39:02.844 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194304 len 2048 2024-04-26T18:39:02.844 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4194304 len 2048 2024-04-26T18:39:02.844 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194304 len 2048 2024-04-26T18:39:02.844 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4194304 len 4096 2024-04-26T18:39:02.845 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194304 len 4096 2024-04-26T18:39:02.845 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4194304 len 4096 2024-04-26T18:39:02.845 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194304 len 4096 2024-04-26T18:39:02.845 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4194304 len 8192 2024-04-26T18:39:02.845 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194304 len 8192 2024-04-26T18:39:02.845 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4194304 len 8192 2024-04-26T18:39:02.845 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194304 len 8192 2024-04-26T18:39:02.845 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4194304 len 16384 2024-04-26T18:39:02.845 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194304 len 16384 2024-04-26T18:39:02.845 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4194304 len 16384 2024-04-26T18:39:02.845 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194304 len 16384 2024-04-26T18:39:02.845 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4194816 len 1024 2024-04-26T18:39:02.845 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194816 len 1024 2024-04-26T18:39:02.845 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4194816 len 1024 2024-04-26T18:39:02.846 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194816 len 1024 2024-04-26T18:39:02.846 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4194816 len 2048 2024-04-26T18:39:02.846 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194816 len 2048 2024-04-26T18:39:02.846 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4194816 len 2048 2024-04-26T18:39:02.846 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194816 len 2048 2024-04-26T18:39:02.846 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4194816 len 4096 2024-04-26T18:39:02.846 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194816 len 4096 2024-04-26T18:39:02.846 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4194816 len 4096 2024-04-26T18:39:02.846 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194816 len 4096 2024-04-26T18:39:02.846 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4194816 len 8192 2024-04-26T18:39:02.846 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194816 len 8192 2024-04-26T18:39:02.846 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4194816 len 8192 2024-04-26T18:39:02.846 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194816 len 8192 2024-04-26T18:39:02.846 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4194816 len 16384 2024-04-26T18:39:02.846 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194816 len 16384 2024-04-26T18:39:02.847 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4194816 len 16384 2024-04-26T18:39:02.847 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4194816 len 16384 2024-04-26T18:39:02.847 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4195328 len 1024 2024-04-26T18:39:02.847 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195328 len 1024 2024-04-26T18:39:02.847 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4195328 len 1024 2024-04-26T18:39:02.847 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195328 len 1024 2024-04-26T18:39:02.847 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4195328 len 2048 2024-04-26T18:39:02.847 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195328 len 2048 2024-04-26T18:39:02.847 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4195328 len 2048 2024-04-26T18:39:02.847 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195328 len 2048 2024-04-26T18:39:02.847 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4195328 len 4096 2024-04-26T18:39:02.847 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195328 len 4096 2024-04-26T18:39:02.847 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4195328 len 4096 2024-04-26T18:39:02.847 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195328 len 4096 2024-04-26T18:39:02.847 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4195328 len 8192 2024-04-26T18:39:02.848 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195328 len 8192 2024-04-26T18:39:02.848 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4195328 len 8192 2024-04-26T18:39:02.848 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195328 len 8192 2024-04-26T18:39:02.848 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4195328 len 16384 2024-04-26T18:39:02.848 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195328 len 16384 2024-04-26T18:39:02.848 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4195328 len 16384 2024-04-26T18:39:02.848 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195328 len 16384 2024-04-26T18:39:02.848 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4195840 len 1024 2024-04-26T18:39:02.848 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195840 len 1024 2024-04-26T18:39:02.848 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4195840 len 1024 2024-04-26T18:39:02.848 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195840 len 1024 2024-04-26T18:39:02.848 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4195840 len 2048 2024-04-26T18:39:02.848 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195840 len 2048 2024-04-26T18:39:02.848 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4195840 len 2048 2024-04-26T18:39:02.848 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195840 len 2048 2024-04-26T18:39:02.851 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4195840 len 4096 2024-04-26T18:39:02.851 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195840 len 4096 2024-04-26T18:39:02.851 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4195840 len 4096 2024-04-26T18:39:02.852 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195840 len 4096 2024-04-26T18:39:02.852 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4195840 len 8192 2024-04-26T18:39:02.852 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195840 len 8192 2024-04-26T18:39:02.852 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4195840 len 8192 2024-04-26T18:39:02.852 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195840 len 8192 2024-04-26T18:39:02.852 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4195840 len 16384 2024-04-26T18:39:02.852 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195840 len 16384 2024-04-26T18:39:02.852 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4195840 len 16384 2024-04-26T18:39:02.852 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4195840 len 16384 2024-04-26T18:39:02.852 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4196352 len 1024 2024-04-26T18:39:02.852 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196352 len 1024 2024-04-26T18:39:02.852 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4196352 len 1024 2024-04-26T18:39:02.852 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196352 len 1024 2024-04-26T18:39:02.852 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4196352 len 2048 2024-04-26T18:39:02.853 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196352 len 2048 2024-04-26T18:39:02.853 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4196352 len 2048 2024-04-26T18:39:02.853 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196352 len 2048 2024-04-26T18:39:02.853 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4196352 len 4096 2024-04-26T18:39:02.853 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196352 len 4096 2024-04-26T18:39:02.853 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4196352 len 4096 2024-04-26T18:39:02.853 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196352 len 4096 2024-04-26T18:39:02.853 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4196352 len 8192 2024-04-26T18:39:02.853 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196352 len 8192 2024-04-26T18:39:02.853 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4196352 len 8192 2024-04-26T18:39:02.853 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196352 len 8192 2024-04-26T18:39:02.853 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4196352 len 16384 2024-04-26T18:39:02.853 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196352 len 16384 2024-04-26T18:39:02.853 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4196352 len 16384 2024-04-26T18:39:02.853 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196352 len 16384 2024-04-26T18:39:02.853 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4196864 len 1024 2024-04-26T18:39:02.854 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196864 len 1024 2024-04-26T18:39:02.854 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4196864 len 1024 2024-04-26T18:39:02.854 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196864 len 1024 2024-04-26T18:39:02.854 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4196864 len 2048 2024-04-26T18:39:02.854 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196864 len 2048 2024-04-26T18:39:02.854 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4196864 len 2048 2024-04-26T18:39:02.854 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196864 len 2048 2024-04-26T18:39:02.854 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4196864 len 4096 2024-04-26T18:39:02.854 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196864 len 4096 2024-04-26T18:39:02.854 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4196864 len 4096 2024-04-26T18:39:02.854 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196864 len 4096 2024-04-26T18:39:02.854 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4196864 len 8192 2024-04-26T18:39:02.854 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196864 len 8192 2024-04-26T18:39:02.854 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4196864 len 8192 2024-04-26T18:39:02.855 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196864 len 8192 2024-04-26T18:39:02.855 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4196864 len 16384 2024-04-26T18:39:02.855 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196864 len 16384 2024-04-26T18:39:02.855 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4196864 len 16384 2024-04-26T18:39:02.855 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4196864 len 16384 2024-04-26T18:39:02.855 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4197376 len 1024 2024-04-26T18:39:02.855 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197376 len 1024 2024-04-26T18:39:02.855 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4197376 len 1024 2024-04-26T18:39:02.855 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197376 len 1024 2024-04-26T18:39:02.855 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4197376 len 2048 2024-04-26T18:39:02.855 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197376 len 2048 2024-04-26T18:39:02.855 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4197376 len 2048 2024-04-26T18:39:02.855 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197376 len 2048 2024-04-26T18:39:02.855 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4197376 len 4096 2024-04-26T18:39:02.855 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197376 len 4096 2024-04-26T18:39:02.856 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4197376 len 4096 2024-04-26T18:39:02.856 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197376 len 4096 2024-04-26T18:39:02.856 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4197376 len 8192 2024-04-26T18:39:02.856 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197376 len 8192 2024-04-26T18:39:02.856 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4197376 len 8192 2024-04-26T18:39:02.856 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197376 len 8192 2024-04-26T18:39:02.856 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4197376 len 16384 2024-04-26T18:39:02.856 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197376 len 16384 2024-04-26T18:39:02.856 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4197376 len 16384 2024-04-26T18:39:02.856 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197376 len 16384 2024-04-26T18:39:02.856 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4197888 len 1024 2024-04-26T18:39:02.856 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197888 len 1024 2024-04-26T18:39:02.856 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4197888 len 1024 2024-04-26T18:39:02.856 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197888 len 1024 2024-04-26T18:39:02.857 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4197888 len 2048 2024-04-26T18:39:02.857 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197888 len 2048 2024-04-26T18:39:02.857 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4197888 len 2048 2024-04-26T18:39:02.857 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197888 len 2048 2024-04-26T18:39:02.857 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4197888 len 4096 2024-04-26T18:39:02.857 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197888 len 4096 2024-04-26T18:39:02.857 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4197888 len 4096 2024-04-26T18:39:02.867 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197888 len 4096 2024-04-26T18:39:02.867 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4197888 len 8192 2024-04-26T18:39:02.867 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197888 len 8192 2024-04-26T18:39:02.867 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4197888 len 8192 2024-04-26T18:39:02.868 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197888 len 8192 2024-04-26T18:39:02.868 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2048 offset 4197888 len 16384 2024-04-26T18:39:02.868 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197888 len 16384 2024-04-26T18:39:02.868 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2048 offset 4197888 len 16384 2024-04-26T18:39:02.868 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2048 offset 4197888 len 16384 2024-04-26T18:39:02.868 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4190208 len 1024 2024-04-26T18:39:02.868 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190208 len 1024 2024-04-26T18:39:02.868 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4190208 len 1024 2024-04-26T18:39:02.868 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190208 len 1024 2024-04-26T18:39:02.868 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4190208 len 2048 2024-04-26T18:39:02.868 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190208 len 2048 2024-04-26T18:39:02.868 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4190208 len 2048 2024-04-26T18:39:02.868 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190208 len 2048 2024-04-26T18:39:02.868 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4190208 len 4096 2024-04-26T18:39:02.869 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190208 len 4096 2024-04-26T18:39:02.869 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4190208 len 4096 2024-04-26T18:39:02.869 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190208 len 4096 2024-04-26T18:39:02.869 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4190208 len 8192 2024-04-26T18:39:02.869 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190208 len 8192 2024-04-26T18:39:02.869 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4190208 len 8192 2024-04-26T18:39:02.869 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190208 len 8192 2024-04-26T18:39:02.869 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4190208 len 16384 2024-04-26T18:39:02.869 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190208 len 16384 2024-04-26T18:39:02.869 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4190208 len 16384 2024-04-26T18:39:02.869 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190208 len 16384 2024-04-26T18:39:02.869 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4190720 len 1024 2024-04-26T18:39:02.869 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190720 len 1024 2024-04-26T18:39:02.869 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4190720 len 1024 2024-04-26T18:39:02.869 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190720 len 1024 2024-04-26T18:39:02.869 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4190720 len 2048 2024-04-26T18:39:02.870 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190720 len 2048 2024-04-26T18:39:02.870 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4190720 len 2048 2024-04-26T18:39:02.870 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190720 len 2048 2024-04-26T18:39:02.870 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4190720 len 4096 2024-04-26T18:39:02.870 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190720 len 4096 2024-04-26T18:39:02.870 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4190720 len 4096 2024-04-26T18:39:02.870 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190720 len 4096 2024-04-26T18:39:02.870 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4190720 len 8192 2024-04-26T18:39:02.870 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190720 len 8192 2024-04-26T18:39:02.870 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4190720 len 8192 2024-04-26T18:39:02.870 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190720 len 8192 2024-04-26T18:39:02.870 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4190720 len 16384 2024-04-26T18:39:02.870 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190720 len 16384 2024-04-26T18:39:02.870 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4190720 len 16384 2024-04-26T18:39:02.871 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4190720 len 16384 2024-04-26T18:39:02.871 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4191232 len 1024 2024-04-26T18:39:02.871 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191232 len 1024 2024-04-26T18:39:02.871 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4191232 len 1024 2024-04-26T18:39:02.871 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191232 len 1024 2024-04-26T18:39:02.871 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4191232 len 2048 2024-04-26T18:39:02.871 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191232 len 2048 2024-04-26T18:39:02.871 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4191232 len 2048 2024-04-26T18:39:02.871 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191232 len 2048 2024-04-26T18:39:02.871 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4191232 len 4096 2024-04-26T18:39:02.871 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191232 len 4096 2024-04-26T18:39:02.871 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4191232 len 4096 2024-04-26T18:39:02.871 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191232 len 4096 2024-04-26T18:39:02.871 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4191232 len 8192 2024-04-26T18:39:02.871 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191232 len 8192 2024-04-26T18:39:02.871 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4191232 len 8192 2024-04-26T18:39:02.872 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191232 len 8192 2024-04-26T18:39:02.872 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4191232 len 16384 2024-04-26T18:39:02.872 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191232 len 16384 2024-04-26T18:39:02.872 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4191232 len 16384 2024-04-26T18:39:02.872 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191232 len 16384 2024-04-26T18:39:02.872 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4191744 len 1024 2024-04-26T18:39:02.872 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191744 len 1024 2024-04-26T18:39:02.872 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4191744 len 1024 2024-04-26T18:39:02.872 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191744 len 1024 2024-04-26T18:39:02.872 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4191744 len 2048 2024-04-26T18:39:02.872 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191744 len 2048 2024-04-26T18:39:02.872 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4191744 len 2048 2024-04-26T18:39:02.872 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191744 len 2048 2024-04-26T18:39:02.872 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4191744 len 4096 2024-04-26T18:39:02.872 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191744 len 4096 2024-04-26T18:39:02.873 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4191744 len 4096 2024-04-26T18:39:02.873 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191744 len 4096 2024-04-26T18:39:02.873 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4191744 len 8192 2024-04-26T18:39:02.888 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191744 len 8192 2024-04-26T18:39:02.888 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4191744 len 8192 2024-04-26T18:39:02.888 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191744 len 8192 2024-04-26T18:39:02.888 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4191744 len 16384 2024-04-26T18:39:02.888 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191744 len 16384 2024-04-26T18:39:02.888 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4191744 len 16384 2024-04-26T18:39:02.888 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4191744 len 16384 2024-04-26T18:39:02.888 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4192256 len 1024 2024-04-26T18:39:02.888 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192256 len 1024 2024-04-26T18:39:02.888 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4192256 len 1024 2024-04-26T18:39:02.888 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192256 len 1024 2024-04-26T18:39:02.888 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4192256 len 2048 2024-04-26T18:39:02.888 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192256 len 2048 2024-04-26T18:39:02.888 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4192256 len 2048 2024-04-26T18:39:02.889 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192256 len 2048 2024-04-26T18:39:02.889 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4192256 len 4096 2024-04-26T18:39:02.889 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192256 len 4096 2024-04-26T18:39:02.889 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4192256 len 4096 2024-04-26T18:39:02.889 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192256 len 4096 2024-04-26T18:39:02.889 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4192256 len 8192 2024-04-26T18:39:02.889 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192256 len 8192 2024-04-26T18:39:02.889 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4192256 len 8192 2024-04-26T18:39:02.889 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192256 len 8192 2024-04-26T18:39:02.889 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4192256 len 16384 2024-04-26T18:39:02.889 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192256 len 16384 2024-04-26T18:39:02.889 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4192256 len 16384 2024-04-26T18:39:02.889 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192256 len 16384 2024-04-26T18:39:02.889 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4192768 len 1024 2024-04-26T18:39:02.890 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192768 len 1024 2024-04-26T18:39:02.890 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4192768 len 1024 2024-04-26T18:39:02.890 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192768 len 1024 2024-04-26T18:39:02.890 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4192768 len 2048 2024-04-26T18:39:02.890 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192768 len 2048 2024-04-26T18:39:02.890 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4192768 len 2048 2024-04-26T18:39:02.890 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192768 len 2048 2024-04-26T18:39:02.890 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4192768 len 4096 2024-04-26T18:39:02.890 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192768 len 4096 2024-04-26T18:39:02.890 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4192768 len 4096 2024-04-26T18:39:02.890 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192768 len 4096 2024-04-26T18:39:02.890 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4192768 len 8192 2024-04-26T18:39:02.890 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192768 len 8192 2024-04-26T18:39:02.890 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4192768 len 8192 2024-04-26T18:39:02.891 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192768 len 8192 2024-04-26T18:39:02.891 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4192768 len 16384 2024-04-26T18:39:02.891 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192768 len 16384 2024-04-26T18:39:02.891 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4192768 len 16384 2024-04-26T18:39:02.891 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4192768 len 16384 2024-04-26T18:39:02.891 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4193280 len 1024 2024-04-26T18:39:02.891 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193280 len 1024 2024-04-26T18:39:02.891 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4193280 len 1024 2024-04-26T18:39:02.891 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193280 len 1024 2024-04-26T18:39:02.891 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4193280 len 2048 2024-04-26T18:39:02.891 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193280 len 2048 2024-04-26T18:39:02.891 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4193280 len 2048 2024-04-26T18:39:02.891 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193280 len 2048 2024-04-26T18:39:02.891 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4193280 len 4096 2024-04-26T18:39:02.891 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193280 len 4096 2024-04-26T18:39:02.892 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4193280 len 4096 2024-04-26T18:39:02.892 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193280 len 4096 2024-04-26T18:39:02.892 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4193280 len 8192 2024-04-26T18:39:02.892 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193280 len 8192 2024-04-26T18:39:02.892 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4193280 len 8192 2024-04-26T18:39:02.892 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193280 len 8192 2024-04-26T18:39:02.892 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4193280 len 16384 2024-04-26T18:39:02.892 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193280 len 16384 2024-04-26T18:39:02.892 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4193280 len 16384 2024-04-26T18:39:02.892 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193280 len 16384 2024-04-26T18:39:02.892 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4193792 len 1024 2024-04-26T18:39:02.892 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193792 len 1024 2024-04-26T18:39:02.892 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4193792 len 1024 2024-04-26T18:39:02.892 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193792 len 1024 2024-04-26T18:39:02.892 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4193792 len 2048 2024-04-26T18:39:02.893 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193792 len 2048 2024-04-26T18:39:02.893 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4193792 len 2048 2024-04-26T18:39:02.893 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193792 len 2048 2024-04-26T18:39:02.893 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4193792 len 4096 2024-04-26T18:39:02.893 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193792 len 4096 2024-04-26T18:39:02.893 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4193792 len 4096 2024-04-26T18:39:02.893 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193792 len 4096 2024-04-26T18:39:02.893 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4193792 len 8192 2024-04-26T18:39:02.893 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193792 len 8192 2024-04-26T18:39:02.893 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4193792 len 8192 2024-04-26T18:39:02.893 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193792 len 8192 2024-04-26T18:39:02.899 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4193792 len 16384 2024-04-26T18:39:02.899 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193792 len 16384 2024-04-26T18:39:02.899 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4193792 len 16384 2024-04-26T18:39:02.899 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4193792 len 16384 2024-04-26T18:39:02.899 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4194304 len 1024 2024-04-26T18:39:02.899 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194304 len 1024 2024-04-26T18:39:02.899 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4194304 len 1024 2024-04-26T18:39:02.899 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194304 len 1024 2024-04-26T18:39:02.899 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4194304 len 2048 2024-04-26T18:39:02.899 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194304 len 2048 2024-04-26T18:39:02.899 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4194304 len 2048 2024-04-26T18:39:02.899 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194304 len 2048 2024-04-26T18:39:02.899 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4194304 len 4096 2024-04-26T18:39:02.900 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194304 len 4096 2024-04-26T18:39:02.900 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4194304 len 4096 2024-04-26T18:39:02.900 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194304 len 4096 2024-04-26T18:39:02.900 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4194304 len 8192 2024-04-26T18:39:02.900 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194304 len 8192 2024-04-26T18:39:02.900 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4194304 len 8192 2024-04-26T18:39:02.900 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194304 len 8192 2024-04-26T18:39:02.900 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4194304 len 16384 2024-04-26T18:39:02.900 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194304 len 16384 2024-04-26T18:39:02.900 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4194304 len 16384 2024-04-26T18:39:02.900 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194304 len 16384 2024-04-26T18:39:02.900 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4194816 len 1024 2024-04-26T18:39:02.900 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194816 len 1024 2024-04-26T18:39:02.900 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4194816 len 1024 2024-04-26T18:39:02.901 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194816 len 1024 2024-04-26T18:39:02.901 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4194816 len 2048 2024-04-26T18:39:02.901 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194816 len 2048 2024-04-26T18:39:02.901 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4194816 len 2048 2024-04-26T18:39:02.901 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194816 len 2048 2024-04-26T18:39:02.901 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4194816 len 4096 2024-04-26T18:39:02.901 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194816 len 4096 2024-04-26T18:39:02.901 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4194816 len 4096 2024-04-26T18:39:02.901 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194816 len 4096 2024-04-26T18:39:02.901 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4194816 len 8192 2024-04-26T18:39:02.901 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194816 len 8192 2024-04-26T18:39:02.901 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4194816 len 8192 2024-04-26T18:39:02.901 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194816 len 8192 2024-04-26T18:39:02.901 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4194816 len 16384 2024-04-26T18:39:02.901 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194816 len 16384 2024-04-26T18:39:02.902 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4194816 len 16384 2024-04-26T18:39:02.902 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4194816 len 16384 2024-04-26T18:39:02.902 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4195328 len 1024 2024-04-26T18:39:02.902 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195328 len 1024 2024-04-26T18:39:02.902 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4195328 len 1024 2024-04-26T18:39:02.902 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195328 len 1024 2024-04-26T18:39:02.902 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4195328 len 2048 2024-04-26T18:39:02.902 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195328 len 2048 2024-04-26T18:39:02.902 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4195328 len 2048 2024-04-26T18:39:02.902 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195328 len 2048 2024-04-26T18:39:02.902 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4195328 len 4096 2024-04-26T18:39:02.902 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195328 len 4096 2024-04-26T18:39:02.902 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4195328 len 4096 2024-04-26T18:39:02.902 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195328 len 4096 2024-04-26T18:39:02.903 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4195328 len 8192 2024-04-26T18:39:02.903 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195328 len 8192 2024-04-26T18:39:02.903 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4195328 len 8192 2024-04-26T18:39:02.903 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195328 len 8192 2024-04-26T18:39:02.903 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4195328 len 16384 2024-04-26T18:39:02.903 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195328 len 16384 2024-04-26T18:39:02.903 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4195328 len 16384 2024-04-26T18:39:02.903 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195328 len 16384 2024-04-26T18:39:02.903 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4195840 len 1024 2024-04-26T18:39:02.903 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195840 len 1024 2024-04-26T18:39:02.903 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4195840 len 1024 2024-04-26T18:39:02.903 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195840 len 1024 2024-04-26T18:39:02.903 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4195840 len 2048 2024-04-26T18:39:02.903 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195840 len 2048 2024-04-26T18:39:02.903 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4195840 len 2048 2024-04-26T18:39:02.904 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195840 len 2048 2024-04-26T18:39:02.904 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4195840 len 4096 2024-04-26T18:39:02.904 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195840 len 4096 2024-04-26T18:39:02.904 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4195840 len 4096 2024-04-26T18:39:02.904 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195840 len 4096 2024-04-26T18:39:02.904 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4195840 len 8192 2024-04-26T18:39:02.904 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195840 len 8192 2024-04-26T18:39:02.904 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4195840 len 8192 2024-04-26T18:39:02.904 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195840 len 8192 2024-04-26T18:39:02.904 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4195840 len 16384 2024-04-26T18:39:02.904 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195840 len 16384 2024-04-26T18:39:02.909 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4195840 len 16384 2024-04-26T18:39:02.909 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4195840 len 16384 2024-04-26T18:39:02.909 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4196352 len 1024 2024-04-26T18:39:02.909 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196352 len 1024 2024-04-26T18:39:02.909 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4196352 len 1024 2024-04-26T18:39:02.909 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196352 len 1024 2024-04-26T18:39:02.910 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4196352 len 2048 2024-04-26T18:39:02.910 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196352 len 2048 2024-04-26T18:39:02.910 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4196352 len 2048 2024-04-26T18:39:02.910 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196352 len 2048 2024-04-26T18:39:02.910 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4196352 len 4096 2024-04-26T18:39:02.910 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196352 len 4096 2024-04-26T18:39:02.910 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4196352 len 4096 2024-04-26T18:39:02.910 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196352 len 4096 2024-04-26T18:39:02.910 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4196352 len 8192 2024-04-26T18:39:02.910 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196352 len 8192 2024-04-26T18:39:02.910 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4196352 len 8192 2024-04-26T18:39:02.910 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196352 len 8192 2024-04-26T18:39:02.910 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4196352 len 16384 2024-04-26T18:39:02.910 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196352 len 16384 2024-04-26T18:39:02.911 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4196352 len 16384 2024-04-26T18:39:02.911 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196352 len 16384 2024-04-26T18:39:02.911 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4196864 len 1024 2024-04-26T18:39:02.911 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196864 len 1024 2024-04-26T18:39:02.911 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4196864 len 1024 2024-04-26T18:39:02.911 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196864 len 1024 2024-04-26T18:39:02.911 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4196864 len 2048 2024-04-26T18:39:02.911 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196864 len 2048 2024-04-26T18:39:02.911 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4196864 len 2048 2024-04-26T18:39:02.911 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196864 len 2048 2024-04-26T18:39:02.911 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4196864 len 4096 2024-04-26T18:39:02.911 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196864 len 4096 2024-04-26T18:39:02.911 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4196864 len 4096 2024-04-26T18:39:02.911 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196864 len 4096 2024-04-26T18:39:02.912 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4196864 len 8192 2024-04-26T18:39:02.912 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196864 len 8192 2024-04-26T18:39:02.912 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4196864 len 8192 2024-04-26T18:39:02.912 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196864 len 8192 2024-04-26T18:39:02.912 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4196864 len 16384 2024-04-26T18:39:02.912 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196864 len 16384 2024-04-26T18:39:02.912 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4196864 len 16384 2024-04-26T18:39:02.912 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4196864 len 16384 2024-04-26T18:39:02.912 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4197376 len 1024 2024-04-26T18:39:02.912 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197376 len 1024 2024-04-26T18:39:02.912 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4197376 len 1024 2024-04-26T18:39:02.912 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197376 len 1024 2024-04-26T18:39:02.912 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4197376 len 2048 2024-04-26T18:39:02.912 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197376 len 2048 2024-04-26T18:39:02.912 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4197376 len 2048 2024-04-26T18:39:02.913 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197376 len 2048 2024-04-26T18:39:02.913 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4197376 len 4096 2024-04-26T18:39:02.913 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197376 len 4096 2024-04-26T18:39:02.913 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4197376 len 4096 2024-04-26T18:39:02.913 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197376 len 4096 2024-04-26T18:39:02.913 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4197376 len 8192 2024-04-26T18:39:02.913 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197376 len 8192 2024-04-26T18:39:02.913 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4197376 len 8192 2024-04-26T18:39:02.913 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197376 len 8192 2024-04-26T18:39:02.913 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4197376 len 16384 2024-04-26T18:39:02.913 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197376 len 16384 2024-04-26T18:39:02.913 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4197376 len 16384 2024-04-26T18:39:02.913 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197376 len 16384 2024-04-26T18:39:02.913 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4197888 len 1024 2024-04-26T18:39:02.913 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197888 len 1024 2024-04-26T18:39:02.914 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4197888 len 1024 2024-04-26T18:39:02.914 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197888 len 1024 2024-04-26T18:39:02.914 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4197888 len 2048 2024-04-26T18:39:02.914 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197888 len 2048 2024-04-26T18:39:02.914 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4197888 len 2048 2024-04-26T18:39:02.914 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197888 len 2048 2024-04-26T18:39:02.914 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4197888 len 4096 2024-04-26T18:39:02.914 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197888 len 4096 2024-04-26T18:39:02.914 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4197888 len 4096 2024-04-26T18:39:02.914 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197888 len 4096 2024-04-26T18:39:02.914 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4197888 len 8192 2024-04-26T18:39:02.914 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197888 len 8192 2024-04-26T18:39:02.914 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4197888 len 8192 2024-04-26T18:39:02.914 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197888 len 8192 2024-04-26T18:39:02.914 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 2560 offset 4197888 len 16384 2024-04-26T18:39:02.915 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197888 len 16384 2024-04-26T18:39:02.915 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 2560 offset 4197888 len 16384 2024-04-26T18:39:02.915 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 2560 offset 4197888 len 16384 2024-04-26T18:39:02.926 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4190208 len 1024 2024-04-26T18:39:02.926 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190208 len 1024 2024-04-26T18:39:02.926 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4190208 len 1024 2024-04-26T18:39:02.927 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190208 len 1024 2024-04-26T18:39:02.927 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4190208 len 2048 2024-04-26T18:39:02.927 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190208 len 2048 2024-04-26T18:39:02.927 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4190208 len 2048 2024-04-26T18:39:02.927 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190208 len 2048 2024-04-26T18:39:02.927 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4190208 len 4096 2024-04-26T18:39:02.927 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190208 len 4096 2024-04-26T18:39:02.927 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4190208 len 4096 2024-04-26T18:39:02.927 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190208 len 4096 2024-04-26T18:39:02.927 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4190208 len 8192 2024-04-26T18:39:02.927 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190208 len 8192 2024-04-26T18:39:02.927 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4190208 len 8192 2024-04-26T18:39:02.927 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190208 len 8192 2024-04-26T18:39:02.927 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4190208 len 16384 2024-04-26T18:39:02.928 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190208 len 16384 2024-04-26T18:39:02.928 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4190208 len 16384 2024-04-26T18:39:02.928 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190208 len 16384 2024-04-26T18:39:02.928 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4190720 len 1024 2024-04-26T18:39:02.928 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190720 len 1024 2024-04-26T18:39:02.928 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4190720 len 1024 2024-04-26T18:39:02.928 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190720 len 1024 2024-04-26T18:39:02.928 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4190720 len 2048 2024-04-26T18:39:02.928 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190720 len 2048 2024-04-26T18:39:02.928 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4190720 len 2048 2024-04-26T18:39:02.928 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190720 len 2048 2024-04-26T18:39:02.928 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4190720 len 4096 2024-04-26T18:39:02.928 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190720 len 4096 2024-04-26T18:39:02.928 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4190720 len 4096 2024-04-26T18:39:02.928 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190720 len 4096 2024-04-26T18:39:02.928 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4190720 len 8192 2024-04-26T18:39:02.929 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190720 len 8192 2024-04-26T18:39:02.929 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4190720 len 8192 2024-04-26T18:39:02.929 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190720 len 8192 2024-04-26T18:39:02.929 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4190720 len 16384 2024-04-26T18:39:02.929 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190720 len 16384 2024-04-26T18:39:02.929 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4190720 len 16384 2024-04-26T18:39:02.929 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4190720 len 16384 2024-04-26T18:39:02.929 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4191232 len 1024 2024-04-26T18:39:02.929 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191232 len 1024 2024-04-26T18:39:02.929 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4191232 len 1024 2024-04-26T18:39:02.929 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191232 len 1024 2024-04-26T18:39:02.929 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4191232 len 2048 2024-04-26T18:39:02.929 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191232 len 2048 2024-04-26T18:39:02.929 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4191232 len 2048 2024-04-26T18:39:02.929 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191232 len 2048 2024-04-26T18:39:02.930 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4191232 len 4096 2024-04-26T18:39:02.930 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191232 len 4096 2024-04-26T18:39:02.930 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4191232 len 4096 2024-04-26T18:39:02.930 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191232 len 4096 2024-04-26T18:39:02.930 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4191232 len 8192 2024-04-26T18:39:02.930 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191232 len 8192 2024-04-26T18:39:02.930 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4191232 len 8192 2024-04-26T18:39:02.930 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191232 len 8192 2024-04-26T18:39:02.930 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4191232 len 16384 2024-04-26T18:39:02.930 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191232 len 16384 2024-04-26T18:39:02.930 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4191232 len 16384 2024-04-26T18:39:02.930 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191232 len 16384 2024-04-26T18:39:02.930 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4191744 len 1024 2024-04-26T18:39:02.930 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191744 len 1024 2024-04-26T18:39:02.930 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4191744 len 1024 2024-04-26T18:39:02.931 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191744 len 1024 2024-04-26T18:39:02.931 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4191744 len 2048 2024-04-26T18:39:02.931 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191744 len 2048 2024-04-26T18:39:02.931 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4191744 len 2048 2024-04-26T18:39:02.931 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191744 len 2048 2024-04-26T18:39:02.931 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4191744 len 4096 2024-04-26T18:39:02.931 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191744 len 4096 2024-04-26T18:39:02.931 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4191744 len 4096 2024-04-26T18:39:02.931 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191744 len 4096 2024-04-26T18:39:02.931 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4191744 len 8192 2024-04-26T18:39:02.931 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191744 len 8192 2024-04-26T18:39:02.931 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4191744 len 8192 2024-04-26T18:39:02.931 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191744 len 8192 2024-04-26T18:39:02.931 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4191744 len 16384 2024-04-26T18:39:02.931 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191744 len 16384 2024-04-26T18:39:02.932 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4191744 len 16384 2024-04-26T18:39:02.932 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4191744 len 16384 2024-04-26T18:39:02.932 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4192256 len 1024 2024-04-26T18:39:02.932 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192256 len 1024 2024-04-26T18:39:02.932 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4192256 len 1024 2024-04-26T18:39:02.949 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192256 len 1024 2024-04-26T18:39:02.949 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4192256 len 2048 2024-04-26T18:39:02.949 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192256 len 2048 2024-04-26T18:39:02.950 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4192256 len 2048 2024-04-26T18:39:02.950 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192256 len 2048 2024-04-26T18:39:02.950 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4192256 len 4096 2024-04-26T18:39:02.950 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192256 len 4096 2024-04-26T18:39:02.950 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4192256 len 4096 2024-04-26T18:39:02.950 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192256 len 4096 2024-04-26T18:39:02.950 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4192256 len 8192 2024-04-26T18:39:02.950 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192256 len 8192 2024-04-26T18:39:02.950 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4192256 len 8192 2024-04-26T18:39:02.950 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192256 len 8192 2024-04-26T18:39:02.950 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4192256 len 16384 2024-04-26T18:39:02.950 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192256 len 16384 2024-04-26T18:39:02.950 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4192256 len 16384 2024-04-26T18:39:02.950 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192256 len 16384 2024-04-26T18:39:02.950 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4192768 len 1024 2024-04-26T18:39:02.951 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192768 len 1024 2024-04-26T18:39:02.951 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4192768 len 1024 2024-04-26T18:39:02.951 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192768 len 1024 2024-04-26T18:39:02.951 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4192768 len 2048 2024-04-26T18:39:02.951 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192768 len 2048 2024-04-26T18:39:02.951 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4192768 len 2048 2024-04-26T18:39:02.951 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192768 len 2048 2024-04-26T18:39:02.951 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4192768 len 4096 2024-04-26T18:39:02.951 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192768 len 4096 2024-04-26T18:39:02.951 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4192768 len 4096 2024-04-26T18:39:02.951 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192768 len 4096 2024-04-26T18:39:02.951 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4192768 len 8192 2024-04-26T18:39:02.951 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192768 len 8192 2024-04-26T18:39:02.951 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4192768 len 8192 2024-04-26T18:39:02.951 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192768 len 8192 2024-04-26T18:39:02.952 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4192768 len 16384 2024-04-26T18:39:02.952 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192768 len 16384 2024-04-26T18:39:02.952 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4192768 len 16384 2024-04-26T18:39:02.952 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4192768 len 16384 2024-04-26T18:39:02.952 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4193280 len 1024 2024-04-26T18:39:02.952 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193280 len 1024 2024-04-26T18:39:02.952 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4193280 len 1024 2024-04-26T18:39:02.952 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193280 len 1024 2024-04-26T18:39:02.952 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4193280 len 2048 2024-04-26T18:39:02.952 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193280 len 2048 2024-04-26T18:39:02.952 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4193280 len 2048 2024-04-26T18:39:02.952 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193280 len 2048 2024-04-26T18:39:02.952 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4193280 len 4096 2024-04-26T18:39:02.952 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193280 len 4096 2024-04-26T18:39:02.953 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4193280 len 4096 2024-04-26T18:39:02.953 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193280 len 4096 2024-04-26T18:39:02.953 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4193280 len 8192 2024-04-26T18:39:02.953 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193280 len 8192 2024-04-26T18:39:02.953 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4193280 len 8192 2024-04-26T18:39:02.953 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193280 len 8192 2024-04-26T18:39:02.953 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4193280 len 16384 2024-04-26T18:39:02.953 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193280 len 16384 2024-04-26T18:39:02.953 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4193280 len 16384 2024-04-26T18:39:02.953 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193280 len 16384 2024-04-26T18:39:02.953 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4193792 len 1024 2024-04-26T18:39:02.953 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193792 len 1024 2024-04-26T18:39:02.953 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4193792 len 1024 2024-04-26T18:39:02.953 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193792 len 1024 2024-04-26T18:39:02.953 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4193792 len 2048 2024-04-26T18:39:02.953 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193792 len 2048 2024-04-26T18:39:02.954 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4193792 len 2048 2024-04-26T18:39:02.954 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193792 len 2048 2024-04-26T18:39:02.954 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4193792 len 4096 2024-04-26T18:39:02.954 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193792 len 4096 2024-04-26T18:39:02.954 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4193792 len 4096 2024-04-26T18:39:02.954 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193792 len 4096 2024-04-26T18:39:02.954 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4193792 len 8192 2024-04-26T18:39:02.954 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193792 len 8192 2024-04-26T18:39:02.954 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4193792 len 8192 2024-04-26T18:39:02.954 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193792 len 8192 2024-04-26T18:39:02.954 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4193792 len 16384 2024-04-26T18:39:02.954 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193792 len 16384 2024-04-26T18:39:02.954 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4193792 len 16384 2024-04-26T18:39:02.954 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4193792 len 16384 2024-04-26T18:39:02.955 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4194304 len 1024 2024-04-26T18:39:02.955 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194304 len 1024 2024-04-26T18:39:02.955 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4194304 len 1024 2024-04-26T18:39:02.955 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194304 len 1024 2024-04-26T18:39:02.955 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4194304 len 2048 2024-04-26T18:39:02.959 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194304 len 2048 2024-04-26T18:39:02.959 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4194304 len 2048 2024-04-26T18:39:02.959 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194304 len 2048 2024-04-26T18:39:02.959 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4194304 len 4096 2024-04-26T18:39:02.959 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194304 len 4096 2024-04-26T18:39:02.959 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4194304 len 4096 2024-04-26T18:39:02.959 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194304 len 4096 2024-04-26T18:39:02.959 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4194304 len 8192 2024-04-26T18:39:02.959 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194304 len 8192 2024-04-26T18:39:02.960 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4194304 len 8192 2024-04-26T18:39:02.960 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194304 len 8192 2024-04-26T18:39:02.960 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4194304 len 16384 2024-04-26T18:39:02.960 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194304 len 16384 2024-04-26T18:39:02.960 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4194304 len 16384 2024-04-26T18:39:02.960 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194304 len 16384 2024-04-26T18:39:02.960 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4194816 len 1024 2024-04-26T18:39:02.960 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194816 len 1024 2024-04-26T18:39:02.960 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4194816 len 1024 2024-04-26T18:39:02.960 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194816 len 1024 2024-04-26T18:39:02.960 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4194816 len 2048 2024-04-26T18:39:02.960 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194816 len 2048 2024-04-26T18:39:02.960 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4194816 len 2048 2024-04-26T18:39:02.960 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194816 len 2048 2024-04-26T18:39:02.960 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4194816 len 4096 2024-04-26T18:39:02.960 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194816 len 4096 2024-04-26T18:39:02.961 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4194816 len 4096 2024-04-26T18:39:02.961 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194816 len 4096 2024-04-26T18:39:02.961 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4194816 len 8192 2024-04-26T18:39:02.961 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194816 len 8192 2024-04-26T18:39:02.961 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4194816 len 8192 2024-04-26T18:39:02.961 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194816 len 8192 2024-04-26T18:39:02.961 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4194816 len 16384 2024-04-26T18:39:02.961 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194816 len 16384 2024-04-26T18:39:02.961 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4194816 len 16384 2024-04-26T18:39:02.961 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4194816 len 16384 2024-04-26T18:39:02.961 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4195328 len 1024 2024-04-26T18:39:02.961 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195328 len 1024 2024-04-26T18:39:02.961 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4195328 len 1024 2024-04-26T18:39:02.961 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195328 len 1024 2024-04-26T18:39:02.962 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4195328 len 2048 2024-04-26T18:39:02.962 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195328 len 2048 2024-04-26T18:39:02.962 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4195328 len 2048 2024-04-26T18:39:02.962 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195328 len 2048 2024-04-26T18:39:02.962 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4195328 len 4096 2024-04-26T18:39:02.962 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195328 len 4096 2024-04-26T18:39:02.962 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4195328 len 4096 2024-04-26T18:39:02.962 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195328 len 4096 2024-04-26T18:39:02.962 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4195328 len 8192 2024-04-26T18:39:02.962 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195328 len 8192 2024-04-26T18:39:02.962 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4195328 len 8192 2024-04-26T18:39:02.962 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195328 len 8192 2024-04-26T18:39:02.962 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4195328 len 16384 2024-04-26T18:39:02.962 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195328 len 16384 2024-04-26T18:39:02.963 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4195328 len 16384 2024-04-26T18:39:02.963 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195328 len 16384 2024-04-26T18:39:02.963 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4195840 len 1024 2024-04-26T18:39:02.963 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195840 len 1024 2024-04-26T18:39:02.963 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4195840 len 1024 2024-04-26T18:39:02.963 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195840 len 1024 2024-04-26T18:39:02.963 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4195840 len 2048 2024-04-26T18:39:02.963 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195840 len 2048 2024-04-26T18:39:02.963 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4195840 len 2048 2024-04-26T18:39:02.963 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195840 len 2048 2024-04-26T18:39:02.963 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4195840 len 4096 2024-04-26T18:39:02.963 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195840 len 4096 2024-04-26T18:39:02.963 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4195840 len 4096 2024-04-26T18:39:02.963 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195840 len 4096 2024-04-26T18:39:02.963 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4195840 len 8192 2024-04-26T18:39:02.964 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195840 len 8192 2024-04-26T18:39:02.964 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4195840 len 8192 2024-04-26T18:39:02.964 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195840 len 8192 2024-04-26T18:39:02.964 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4195840 len 16384 2024-04-26T18:39:02.964 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195840 len 16384 2024-04-26T18:39:02.964 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4195840 len 16384 2024-04-26T18:39:02.964 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4195840 len 16384 2024-04-26T18:39:02.964 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4196352 len 1024 2024-04-26T18:39:02.964 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196352 len 1024 2024-04-26T18:39:02.964 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4196352 len 1024 2024-04-26T18:39:02.964 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196352 len 1024 2024-04-26T18:39:02.964 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4196352 len 2048 2024-04-26T18:39:02.964 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196352 len 2048 2024-04-26T18:39:02.964 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4196352 len 2048 2024-04-26T18:39:02.964 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196352 len 2048 2024-04-26T18:39:02.968 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4196352 len 4096 2024-04-26T18:39:02.968 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196352 len 4096 2024-04-26T18:39:02.968 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4196352 len 4096 2024-04-26T18:39:02.968 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196352 len 4096 2024-04-26T18:39:02.968 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4196352 len 8192 2024-04-26T18:39:02.968 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196352 len 8192 2024-04-26T18:39:02.969 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4196352 len 8192 2024-04-26T18:39:02.969 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196352 len 8192 2024-04-26T18:39:02.969 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4196352 len 16384 2024-04-26T18:39:02.969 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196352 len 16384 2024-04-26T18:39:02.969 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4196352 len 16384 2024-04-26T18:39:02.969 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196352 len 16384 2024-04-26T18:39:02.969 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4196864 len 1024 2024-04-26T18:39:02.969 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196864 len 1024 2024-04-26T18:39:02.969 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4196864 len 1024 2024-04-26T18:39:02.969 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196864 len 1024 2024-04-26T18:39:02.969 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4196864 len 2048 2024-04-26T18:39:02.969 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196864 len 2048 2024-04-26T18:39:02.969 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4196864 len 2048 2024-04-26T18:39:02.969 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196864 len 2048 2024-04-26T18:39:02.969 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4196864 len 4096 2024-04-26T18:39:02.970 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196864 len 4096 2024-04-26T18:39:02.970 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4196864 len 4096 2024-04-26T18:39:02.970 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196864 len 4096 2024-04-26T18:39:02.970 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4196864 len 8192 2024-04-26T18:39:02.970 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196864 len 8192 2024-04-26T18:39:02.970 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4196864 len 8192 2024-04-26T18:39:02.970 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196864 len 8192 2024-04-26T18:39:02.970 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4196864 len 16384 2024-04-26T18:39:02.970 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196864 len 16384 2024-04-26T18:39:02.970 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4196864 len 16384 2024-04-26T18:39:02.970 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4196864 len 16384 2024-04-26T18:39:02.970 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4197376 len 1024 2024-04-26T18:39:02.970 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197376 len 1024 2024-04-26T18:39:02.971 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4197376 len 1024 2024-04-26T18:39:02.971 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197376 len 1024 2024-04-26T18:39:02.971 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4197376 len 2048 2024-04-26T18:39:02.971 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197376 len 2048 2024-04-26T18:39:02.971 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4197376 len 2048 2024-04-26T18:39:02.971 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197376 len 2048 2024-04-26T18:39:02.971 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4197376 len 4096 2024-04-26T18:39:02.971 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197376 len 4096 2024-04-26T18:39:02.971 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4197376 len 4096 2024-04-26T18:39:02.971 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197376 len 4096 2024-04-26T18:39:02.971 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4197376 len 8192 2024-04-26T18:39:02.971 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197376 len 8192 2024-04-26T18:39:02.971 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4197376 len 8192 2024-04-26T18:39:02.971 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197376 len 8192 2024-04-26T18:39:02.971 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4197376 len 16384 2024-04-26T18:39:02.972 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197376 len 16384 2024-04-26T18:39:02.972 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4197376 len 16384 2024-04-26T18:39:02.972 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197376 len 16384 2024-04-26T18:39:02.972 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4197888 len 1024 2024-04-26T18:39:02.972 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197888 len 1024 2024-04-26T18:39:02.972 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4197888 len 1024 2024-04-26T18:39:02.972 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197888 len 1024 2024-04-26T18:39:02.972 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4197888 len 2048 2024-04-26T18:39:02.972 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197888 len 2048 2024-04-26T18:39:02.972 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4197888 len 2048 2024-04-26T18:39:02.972 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197888 len 2048 2024-04-26T18:39:02.972 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4197888 len 4096 2024-04-26T18:39:02.972 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197888 len 4096 2024-04-26T18:39:02.972 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4197888 len 4096 2024-04-26T18:39:02.972 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197888 len 4096 2024-04-26T18:39:02.972 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4197888 len 8192 2024-04-26T18:39:02.973 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197888 len 8192 2024-04-26T18:39:02.973 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4197888 len 8192 2024-04-26T18:39:02.973 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197888 len 8192 2024-04-26T18:39:02.973 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3072 offset 4197888 len 16384 2024-04-26T18:39:02.973 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197888 len 16384 2024-04-26T18:39:02.973 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3072 offset 4197888 len 16384 2024-04-26T18:39:02.973 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3072 offset 4197888 len 16384 2024-04-26T18:39:02.973 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4190208 len 1024 2024-04-26T18:39:02.973 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190208 len 1024 2024-04-26T18:39:02.973 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4190208 len 1024 2024-04-26T18:39:02.973 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190208 len 1024 2024-04-26T18:39:02.973 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4190208 len 2048 2024-04-26T18:39:02.973 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190208 len 2048 2024-04-26T18:39:02.974 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4190208 len 2048 2024-04-26T18:39:02.974 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190208 len 2048 2024-04-26T18:39:02.974 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4190208 len 4096 2024-04-26T18:39:02.974 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190208 len 4096 2024-04-26T18:39:02.991 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4190208 len 4096 2024-04-26T18:39:02.991 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190208 len 4096 2024-04-26T18:39:02.991 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4190208 len 8192 2024-04-26T18:39:02.991 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190208 len 8192 2024-04-26T18:39:02.991 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4190208 len 8192 2024-04-26T18:39:02.992 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190208 len 8192 2024-04-26T18:39:02.992 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4190208 len 16384 2024-04-26T18:39:02.992 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190208 len 16384 2024-04-26T18:39:02.992 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4190208 len 16384 2024-04-26T18:39:02.992 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190208 len 16384 2024-04-26T18:39:02.992 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4190720 len 1024 2024-04-26T18:39:02.992 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190720 len 1024 2024-04-26T18:39:02.992 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4190720 len 1024 2024-04-26T18:39:02.992 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190720 len 1024 2024-04-26T18:39:02.992 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4190720 len 2048 2024-04-26T18:39:02.992 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190720 len 2048 2024-04-26T18:39:02.992 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4190720 len 2048 2024-04-26T18:39:02.992 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190720 len 2048 2024-04-26T18:39:02.992 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4190720 len 4096 2024-04-26T18:39:02.992 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190720 len 4096 2024-04-26T18:39:02.993 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4190720 len 4096 2024-04-26T18:39:02.993 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190720 len 4096 2024-04-26T18:39:02.993 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4190720 len 8192 2024-04-26T18:39:02.993 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190720 len 8192 2024-04-26T18:39:02.993 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4190720 len 8192 2024-04-26T18:39:02.993 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190720 len 8192 2024-04-26T18:39:02.993 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4190720 len 16384 2024-04-26T18:39:02.993 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190720 len 16384 2024-04-26T18:39:02.993 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4190720 len 16384 2024-04-26T18:39:02.993 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4190720 len 16384 2024-04-26T18:39:02.993 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4191232 len 1024 2024-04-26T18:39:02.993 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191232 len 1024 2024-04-26T18:39:02.993 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4191232 len 1024 2024-04-26T18:39:02.993 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191232 len 1024 2024-04-26T18:39:02.993 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4191232 len 2048 2024-04-26T18:39:02.994 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191232 len 2048 2024-04-26T18:39:02.994 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4191232 len 2048 2024-04-26T18:39:02.994 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191232 len 2048 2024-04-26T18:39:02.994 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4191232 len 4096 2024-04-26T18:39:02.994 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191232 len 4096 2024-04-26T18:39:02.994 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4191232 len 4096 2024-04-26T18:39:02.994 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191232 len 4096 2024-04-26T18:39:02.994 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4191232 len 8192 2024-04-26T18:39:02.994 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191232 len 8192 2024-04-26T18:39:02.994 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4191232 len 8192 2024-04-26T18:39:02.994 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191232 len 8192 2024-04-26T18:39:02.994 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4191232 len 16384 2024-04-26T18:39:02.994 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191232 len 16384 2024-04-26T18:39:02.994 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4191232 len 16384 2024-04-26T18:39:02.995 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191232 len 16384 2024-04-26T18:39:02.995 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4191744 len 1024 2024-04-26T18:39:02.995 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191744 len 1024 2024-04-26T18:39:02.995 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4191744 len 1024 2024-04-26T18:39:02.995 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191744 len 1024 2024-04-26T18:39:02.995 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4191744 len 2048 2024-04-26T18:39:02.995 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191744 len 2048 2024-04-26T18:39:02.995 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4191744 len 2048 2024-04-26T18:39:02.995 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191744 len 2048 2024-04-26T18:39:02.995 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4191744 len 4096 2024-04-26T18:39:02.995 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191744 len 4096 2024-04-26T18:39:02.995 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4191744 len 4096 2024-04-26T18:39:02.995 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191744 len 4096 2024-04-26T18:39:02.995 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4191744 len 8192 2024-04-26T18:39:02.996 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191744 len 8192 2024-04-26T18:39:02.996 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4191744 len 8192 2024-04-26T18:39:02.996 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191744 len 8192 2024-04-26T18:39:02.996 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4191744 len 16384 2024-04-26T18:39:02.996 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191744 len 16384 2024-04-26T18:39:02.996 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4191744 len 16384 2024-04-26T18:39:02.996 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4191744 len 16384 2024-04-26T18:39:02.996 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4192256 len 1024 2024-04-26T18:39:02.996 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192256 len 1024 2024-04-26T18:39:02.996 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4192256 len 1024 2024-04-26T18:39:02.996 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192256 len 1024 2024-04-26T18:39:02.996 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4192256 len 2048 2024-04-26T18:39:02.996 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192256 len 2048 2024-04-26T18:39:02.996 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4192256 len 2048 2024-04-26T18:39:02.996 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192256 len 2048 2024-04-26T18:39:02.996 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4192256 len 4096 2024-04-26T18:39:02.997 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192256 len 4096 2024-04-26T18:39:02.997 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4192256 len 4096 2024-04-26T18:39:02.997 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192256 len 4096 2024-04-26T18:39:02.997 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4192256 len 8192 2024-04-26T18:39:03.016 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192256 len 8192 2024-04-26T18:39:03.016 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4192256 len 8192 2024-04-26T18:39:03.016 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192256 len 8192 2024-04-26T18:39:03.016 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4192256 len 16384 2024-04-26T18:39:03.016 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192256 len 16384 2024-04-26T18:39:03.016 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4192256 len 16384 2024-04-26T18:39:03.016 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192256 len 16384 2024-04-26T18:39:03.016 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4192768 len 1024 2024-04-26T18:39:03.016 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192768 len 1024 2024-04-26T18:39:03.016 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4192768 len 1024 2024-04-26T18:39:03.017 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192768 len 1024 2024-04-26T18:39:03.017 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4192768 len 2048 2024-04-26T18:39:03.017 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192768 len 2048 2024-04-26T18:39:03.017 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4192768 len 2048 2024-04-26T18:39:03.017 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192768 len 2048 2024-04-26T18:39:03.017 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4192768 len 4096 2024-04-26T18:39:03.017 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192768 len 4096 2024-04-26T18:39:03.017 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4192768 len 4096 2024-04-26T18:39:03.017 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192768 len 4096 2024-04-26T18:39:03.017 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4192768 len 8192 2024-04-26T18:39:03.017 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192768 len 8192 2024-04-26T18:39:03.017 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4192768 len 8192 2024-04-26T18:39:03.017 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192768 len 8192 2024-04-26T18:39:03.017 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4192768 len 16384 2024-04-26T18:39:03.017 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192768 len 16384 2024-04-26T18:39:03.018 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4192768 len 16384 2024-04-26T18:39:03.018 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4192768 len 16384 2024-04-26T18:39:03.018 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4193280 len 1024 2024-04-26T18:39:03.018 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193280 len 1024 2024-04-26T18:39:03.018 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4193280 len 1024 2024-04-26T18:39:03.018 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193280 len 1024 2024-04-26T18:39:03.018 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4193280 len 2048 2024-04-26T18:39:03.018 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193280 len 2048 2024-04-26T18:39:03.018 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4193280 len 2048 2024-04-26T18:39:03.018 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193280 len 2048 2024-04-26T18:39:03.018 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4193280 len 4096 2024-04-26T18:39:03.018 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193280 len 4096 2024-04-26T18:39:03.018 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4193280 len 4096 2024-04-26T18:39:03.019 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193280 len 4096 2024-04-26T18:39:03.019 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4193280 len 8192 2024-04-26T18:39:03.019 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193280 len 8192 2024-04-26T18:39:03.019 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4193280 len 8192 2024-04-26T18:39:03.019 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193280 len 8192 2024-04-26T18:39:03.019 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4193280 len 16384 2024-04-26T18:39:03.019 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193280 len 16384 2024-04-26T18:39:03.019 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4193280 len 16384 2024-04-26T18:39:03.019 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193280 len 16384 2024-04-26T18:39:03.019 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4193792 len 1024 2024-04-26T18:39:03.019 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193792 len 1024 2024-04-26T18:39:03.019 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4193792 len 1024 2024-04-26T18:39:03.019 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193792 len 1024 2024-04-26T18:39:03.019 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4193792 len 2048 2024-04-26T18:39:03.019 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193792 len 2048 2024-04-26T18:39:03.019 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4193792 len 2048 2024-04-26T18:39:03.020 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193792 len 2048 2024-04-26T18:39:03.020 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4193792 len 4096 2024-04-26T18:39:03.020 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193792 len 4096 2024-04-26T18:39:03.020 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4193792 len 4096 2024-04-26T18:39:03.020 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193792 len 4096 2024-04-26T18:39:03.020 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4193792 len 8192 2024-04-26T18:39:03.020 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193792 len 8192 2024-04-26T18:39:03.020 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4193792 len 8192 2024-04-26T18:39:03.020 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193792 len 8192 2024-04-26T18:39:03.020 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4193792 len 16384 2024-04-26T18:39:03.020 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193792 len 16384 2024-04-26T18:39:03.020 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4193792 len 16384 2024-04-26T18:39:03.020 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4193792 len 16384 2024-04-26T18:39:03.020 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4194304 len 1024 2024-04-26T18:39:03.020 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194304 len 1024 2024-04-26T18:39:03.021 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4194304 len 1024 2024-04-26T18:39:03.021 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194304 len 1024 2024-04-26T18:39:03.021 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4194304 len 2048 2024-04-26T18:39:03.021 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194304 len 2048 2024-04-26T18:39:03.021 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4194304 len 2048 2024-04-26T18:39:03.021 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194304 len 2048 2024-04-26T18:39:03.021 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4194304 len 4096 2024-04-26T18:39:03.021 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194304 len 4096 2024-04-26T18:39:03.021 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4194304 len 4096 2024-04-26T18:39:03.021 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194304 len 4096 2024-04-26T18:39:03.021 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4194304 len 8192 2024-04-26T18:39:03.021 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194304 len 8192 2024-04-26T18:39:03.021 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4194304 len 8192 2024-04-26T18:39:03.024 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194304 len 8192 2024-04-26T18:39:03.024 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4194304 len 16384 2024-04-26T18:39:03.024 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194304 len 16384 2024-04-26T18:39:03.025 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4194304 len 16384 2024-04-26T18:39:03.025 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194304 len 16384 2024-04-26T18:39:03.025 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4194816 len 1024 2024-04-26T18:39:03.025 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194816 len 1024 2024-04-26T18:39:03.025 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4194816 len 1024 2024-04-26T18:39:03.025 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194816 len 1024 2024-04-26T18:39:03.025 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4194816 len 2048 2024-04-26T18:39:03.025 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194816 len 2048 2024-04-26T18:39:03.025 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4194816 len 2048 2024-04-26T18:39:03.025 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194816 len 2048 2024-04-26T18:39:03.025 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4194816 len 4096 2024-04-26T18:39:03.025 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194816 len 4096 2024-04-26T18:39:03.025 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4194816 len 4096 2024-04-26T18:39:03.025 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194816 len 4096 2024-04-26T18:39:03.026 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4194816 len 8192 2024-04-26T18:39:03.026 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194816 len 8192 2024-04-26T18:39:03.026 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4194816 len 8192 2024-04-26T18:39:03.026 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194816 len 8192 2024-04-26T18:39:03.026 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4194816 len 16384 2024-04-26T18:39:03.026 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194816 len 16384 2024-04-26T18:39:03.026 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4194816 len 16384 2024-04-26T18:39:03.026 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4194816 len 16384 2024-04-26T18:39:03.026 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4195328 len 1024 2024-04-26T18:39:03.026 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195328 len 1024 2024-04-26T18:39:03.026 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4195328 len 1024 2024-04-26T18:39:03.026 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195328 len 1024 2024-04-26T18:39:03.026 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4195328 len 2048 2024-04-26T18:39:03.026 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195328 len 2048 2024-04-26T18:39:03.026 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4195328 len 2048 2024-04-26T18:39:03.027 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195328 len 2048 2024-04-26T18:39:03.027 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4195328 len 4096 2024-04-26T18:39:03.027 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195328 len 4096 2024-04-26T18:39:03.027 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4195328 len 4096 2024-04-26T18:39:03.027 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195328 len 4096 2024-04-26T18:39:03.027 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4195328 len 8192 2024-04-26T18:39:03.027 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195328 len 8192 2024-04-26T18:39:03.027 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4195328 len 8192 2024-04-26T18:39:03.027 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195328 len 8192 2024-04-26T18:39:03.027 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4195328 len 16384 2024-04-26T18:39:03.027 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195328 len 16384 2024-04-26T18:39:03.027 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4195328 len 16384 2024-04-26T18:39:03.027 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195328 len 16384 2024-04-26T18:39:03.028 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4195840 len 1024 2024-04-26T18:39:03.028 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195840 len 1024 2024-04-26T18:39:03.028 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4195840 len 1024 2024-04-26T18:39:03.028 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195840 len 1024 2024-04-26T18:39:03.028 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4195840 len 2048 2024-04-26T18:39:03.028 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195840 len 2048 2024-04-26T18:39:03.028 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4195840 len 2048 2024-04-26T18:39:03.028 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195840 len 2048 2024-04-26T18:39:03.028 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4195840 len 4096 2024-04-26T18:39:03.028 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195840 len 4096 2024-04-26T18:39:03.028 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4195840 len 4096 2024-04-26T18:39:03.028 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195840 len 4096 2024-04-26T18:39:03.028 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4195840 len 8192 2024-04-26T18:39:03.028 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195840 len 8192 2024-04-26T18:39:03.028 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4195840 len 8192 2024-04-26T18:39:03.029 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195840 len 8192 2024-04-26T18:39:03.029 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4195840 len 16384 2024-04-26T18:39:03.029 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195840 len 16384 2024-04-26T18:39:03.029 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4195840 len 16384 2024-04-26T18:39:03.029 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4195840 len 16384 2024-04-26T18:39:03.029 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4196352 len 1024 2024-04-26T18:39:03.029 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196352 len 1024 2024-04-26T18:39:03.029 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4196352 len 1024 2024-04-26T18:39:03.029 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196352 len 1024 2024-04-26T18:39:03.029 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4196352 len 2048 2024-04-26T18:39:03.029 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196352 len 2048 2024-04-26T18:39:03.029 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4196352 len 2048 2024-04-26T18:39:03.029 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196352 len 2048 2024-04-26T18:39:03.029 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4196352 len 4096 2024-04-26T18:39:03.029 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196352 len 4096 2024-04-26T18:39:03.030 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4196352 len 4096 2024-04-26T18:39:03.030 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196352 len 4096 2024-04-26T18:39:03.030 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4196352 len 8192 2024-04-26T18:39:03.030 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196352 len 8192 2024-04-26T18:39:03.030 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4196352 len 8192 2024-04-26T18:39:03.030 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196352 len 8192 2024-04-26T18:39:03.030 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4196352 len 16384 2024-04-26T18:39:03.219 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196352 len 16384 2024-04-26T18:39:03.219 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4196352 len 16384 2024-04-26T18:39:03.219 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196352 len 16384 2024-04-26T18:39:03.219 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4196864 len 1024 2024-04-26T18:39:03.219 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196864 len 1024 2024-04-26T18:39:03.219 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4196864 len 1024 2024-04-26T18:39:03.219 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196864 len 1024 2024-04-26T18:39:03.219 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4196864 len 2048 2024-04-26T18:39:03.219 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196864 len 2048 2024-04-26T18:39:03.219 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4196864 len 2048 2024-04-26T18:39:03.219 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196864 len 2048 2024-04-26T18:39:03.220 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4196864 len 4096 2024-04-26T18:39:03.220 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196864 len 4096 2024-04-26T18:39:03.220 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4196864 len 4096 2024-04-26T18:39:03.220 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196864 len 4096 2024-04-26T18:39:03.220 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4196864 len 8192 2024-04-26T18:39:03.220 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196864 len 8192 2024-04-26T18:39:03.220 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4196864 len 8192 2024-04-26T18:39:03.220 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196864 len 8192 2024-04-26T18:39:03.220 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4196864 len 16384 2024-04-26T18:39:03.220 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196864 len 16384 2024-04-26T18:39:03.220 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4196864 len 16384 2024-04-26T18:39:03.220 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4196864 len 16384 2024-04-26T18:39:03.220 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4197376 len 1024 2024-04-26T18:39:03.220 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197376 len 1024 2024-04-26T18:39:03.221 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4197376 len 1024 2024-04-26T18:39:03.221 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197376 len 1024 2024-04-26T18:39:03.221 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4197376 len 2048 2024-04-26T18:39:03.221 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197376 len 2048 2024-04-26T18:39:03.221 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4197376 len 2048 2024-04-26T18:39:03.221 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197376 len 2048 2024-04-26T18:39:03.221 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4197376 len 4096 2024-04-26T18:39:03.221 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197376 len 4096 2024-04-26T18:39:03.221 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4197376 len 4096 2024-04-26T18:39:03.221 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197376 len 4096 2024-04-26T18:39:03.221 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4197376 len 8192 2024-04-26T18:39:03.221 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197376 len 8192 2024-04-26T18:39:03.221 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4197376 len 8192 2024-04-26T18:39:03.221 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197376 len 8192 2024-04-26T18:39:03.221 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4197376 len 16384 2024-04-26T18:39:03.222 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197376 len 16384 2024-04-26T18:39:03.222 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4197376 len 16384 2024-04-26T18:39:03.222 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197376 len 16384 2024-04-26T18:39:03.222 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4197888 len 1024 2024-04-26T18:39:03.222 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197888 len 1024 2024-04-26T18:39:03.222 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4197888 len 1024 2024-04-26T18:39:03.222 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197888 len 1024 2024-04-26T18:39:03.222 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4197888 len 2048 2024-04-26T18:39:03.222 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197888 len 2048 2024-04-26T18:39:03.222 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4197888 len 2048 2024-04-26T18:39:03.222 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197888 len 2048 2024-04-26T18:39:03.222 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4197888 len 4096 2024-04-26T18:39:03.222 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197888 len 4096 2024-04-26T18:39:03.223 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4197888 len 4096 2024-04-26T18:39:03.223 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197888 len 4096 2024-04-26T18:39:03.223 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4197888 len 8192 2024-04-26T18:39:03.223 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197888 len 8192 2024-04-26T18:39:03.223 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4197888 len 8192 2024-04-26T18:39:03.223 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197888 len 8192 2024-04-26T18:39:03.223 INFO:tasks.workunit.client.0.smithi080.stdout:read_direct buf_align 3584 offset 4197888 len 16384 2024-04-26T18:39:03.223 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197888 len 16384 2024-04-26T18:39:03.223 INFO:tasks.workunit.client.0.smithi080.stdout:read_sync buf_align 3584 offset 4197888 len 16384 2024-04-26T18:39:03.223 INFO:tasks.workunit.client.0.smithi080.stdout:read_file buf_align 3584 offset 4197888 len 16384 2024-04-26T18:39:03.223 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4190720 len 1024 2024-04-26T18:39:03.223 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4190720 len 1024 2024-04-26T18:39:03.223 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4190720 len 1024 2024-04-26T18:39:03.223 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4190720 len 1024 2024-04-26T18:39:03.224 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4190720 len 2048 2024-04-26T18:39:03.224 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4190720 len 2048 2024-04-26T18:39:03.224 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4190720 len 2048 2024-04-26T18:39:03.224 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4190720 len 2048 2024-04-26T18:39:03.224 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4190720 len 4096 2024-04-26T18:39:03.224 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4190720 len 4096 2024-04-26T18:39:03.224 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4190720 len 4096 2024-04-26T18:39:03.224 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4190720 len 4096 2024-04-26T18:39:03.224 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4190720 len 8192 2024-04-26T18:39:03.224 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4190720 len 8192 2024-04-26T18:39:03.224 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4190720 len 8192 2024-04-26T18:39:03.224 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4190720 len 8192 2024-04-26T18:39:03.224 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4190720 len 16384 2024-04-26T18:39:03.224 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4190720 len 16384 2024-04-26T18:39:03.224 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4190720 len 16384 2024-04-26T18:39:03.225 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4190720 len 16384 2024-04-26T18:39:03.225 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4191232 len 1024 2024-04-26T18:39:03.896 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191232 len 1024 2024-04-26T18:39:03.896 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4191232 len 1024 2024-04-26T18:39:03.896 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191232 len 1024 2024-04-26T18:39:03.896 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4191232 len 2048 2024-04-26T18:39:03.897 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191232 len 2048 2024-04-26T18:39:03.897 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4191232 len 2048 2024-04-26T18:39:03.897 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191232 len 2048 2024-04-26T18:39:03.897 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4191232 len 4096 2024-04-26T18:39:03.897 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191232 len 4096 2024-04-26T18:39:03.897 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4191232 len 4096 2024-04-26T18:39:03.897 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191232 len 4096 2024-04-26T18:39:03.897 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4191232 len 8192 2024-04-26T18:39:03.897 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191232 len 8192 2024-04-26T18:39:03.897 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4191232 len 8192 2024-04-26T18:39:03.897 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191232 len 8192 2024-04-26T18:39:03.897 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4191232 len 16384 2024-04-26T18:39:03.897 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191232 len 16384 2024-04-26T18:39:03.897 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4191232 len 16384 2024-04-26T18:39:03.898 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191232 len 16384 2024-04-26T18:39:03.898 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4191744 len 1024 2024-04-26T18:39:03.898 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191744 len 1024 2024-04-26T18:39:03.898 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4191744 len 1024 2024-04-26T18:39:03.898 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191744 len 1024 2024-04-26T18:39:03.898 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4191744 len 2048 2024-04-26T18:39:03.898 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191744 len 2048 2024-04-26T18:39:03.898 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4191744 len 2048 2024-04-26T18:39:03.898 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191744 len 2048 2024-04-26T18:39:03.898 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4191744 len 4096 2024-04-26T18:39:03.898 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191744 len 4096 2024-04-26T18:39:03.898 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4191744 len 4096 2024-04-26T18:39:03.898 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191744 len 4096 2024-04-26T18:39:03.898 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4191744 len 8192 2024-04-26T18:39:03.899 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191744 len 8192 2024-04-26T18:39:03.899 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4191744 len 8192 2024-04-26T18:39:03.899 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191744 len 8192 2024-04-26T18:39:03.899 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4191744 len 16384 2024-04-26T18:39:03.899 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191744 len 16384 2024-04-26T18:39:03.899 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4191744 len 16384 2024-04-26T18:39:03.899 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4191744 len 16384 2024-04-26T18:39:03.899 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4192256 len 1024 2024-04-26T18:39:03.899 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192256 len 1024 2024-04-26T18:39:03.899 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4192256 len 1024 2024-04-26T18:39:03.899 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192256 len 1024 2024-04-26T18:39:03.899 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4192256 len 2048 2024-04-26T18:39:03.899 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192256 len 2048 2024-04-26T18:39:03.899 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4192256 len 2048 2024-04-26T18:39:03.899 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192256 len 2048 2024-04-26T18:39:03.900 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4192256 len 4096 2024-04-26T18:39:03.900 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192256 len 4096 2024-04-26T18:39:03.900 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4192256 len 4096 2024-04-26T18:39:03.900 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192256 len 4096 2024-04-26T18:39:03.900 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4192256 len 8192 2024-04-26T18:39:03.900 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192256 len 8192 2024-04-26T18:39:03.900 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4192256 len 8192 2024-04-26T18:39:03.900 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192256 len 8192 2024-04-26T18:39:03.900 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4192256 len 16384 2024-04-26T18:39:03.900 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192256 len 16384 2024-04-26T18:39:03.900 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4192256 len 16384 2024-04-26T18:39:03.900 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192256 len 16384 2024-04-26T18:39:03.900 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4192768 len 1024 2024-04-26T18:39:03.900 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192768 len 1024 2024-04-26T18:39:03.901 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4192768 len 1024 2024-04-26T18:39:03.901 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192768 len 1024 2024-04-26T18:39:03.901 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4192768 len 2048 2024-04-26T18:39:03.901 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192768 len 2048 2024-04-26T18:39:03.901 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4192768 len 2048 2024-04-26T18:39:03.901 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192768 len 2048 2024-04-26T18:39:03.901 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4192768 len 4096 2024-04-26T18:39:03.901 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192768 len 4096 2024-04-26T18:39:03.901 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4192768 len 4096 2024-04-26T18:39:03.901 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192768 len 4096 2024-04-26T18:39:03.901 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4192768 len 8192 2024-04-26T18:39:03.901 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192768 len 8192 2024-04-26T18:39:03.901 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4192768 len 8192 2024-04-26T18:39:03.901 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192768 len 8192 2024-04-26T18:39:03.901 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4192768 len 16384 2024-04-26T18:39:03.902 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192768 len 16384 2024-04-26T18:39:03.902 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4192768 len 16384 2024-04-26T18:39:03.902 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4192768 len 16384 2024-04-26T18:39:03.902 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4193280 len 1024 2024-04-26T18:39:03.902 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193280 len 1024 2024-04-26T18:39:03.902 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4193280 len 1024 2024-04-26T18:39:03.902 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193280 len 1024 2024-04-26T18:39:03.902 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4193280 len 2048 2024-04-26T18:39:03.902 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193280 len 2048 2024-04-26T18:39:03.902 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4193280 len 2048 2024-04-26T18:39:03.913 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:03 smithi192 ceph-mon[32842]: pgmap v80: 97 pgs: 97 active+clean; 1.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.4 MiB/s wr, 2.14k op/s 2024-04-26T18:39:03.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:03 smithi082 ceph-mon[32808]: pgmap v80: 97 pgs: 97 active+clean; 1.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.4 MiB/s wr, 2.14k op/s 2024-04-26T18:39:03.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:03 smithi080 ceph-mon[29135]: pgmap v80: 97 pgs: 97 active+clean; 1.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.4 MiB/s wr, 2.14k op/s 2024-04-26T18:39:04.397 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193280 len 2048 2024-04-26T18:39:04.397 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4193280 len 4096 2024-04-26T18:39:04.397 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193280 len 4096 2024-04-26T18:39:04.397 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4193280 len 4096 2024-04-26T18:39:04.397 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193280 len 4096 2024-04-26T18:39:04.397 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4193280 len 8192 2024-04-26T18:39:04.397 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193280 len 8192 2024-04-26T18:39:04.397 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4193280 len 8192 2024-04-26T18:39:04.397 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193280 len 8192 2024-04-26T18:39:04.397 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4193280 len 16384 2024-04-26T18:39:04.398 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193280 len 16384 2024-04-26T18:39:04.398 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4193280 len 16384 2024-04-26T18:39:04.398 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193280 len 16384 2024-04-26T18:39:04.398 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4193792 len 1024 2024-04-26T18:39:04.398 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193792 len 1024 2024-04-26T18:39:04.398 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4193792 len 1024 2024-04-26T18:39:04.398 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193792 len 1024 2024-04-26T18:39:04.398 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4193792 len 2048 2024-04-26T18:39:04.398 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193792 len 2048 2024-04-26T18:39:04.398 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4193792 len 2048 2024-04-26T18:39:04.398 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193792 len 2048 2024-04-26T18:39:04.398 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4193792 len 4096 2024-04-26T18:39:04.399 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193792 len 4096 2024-04-26T18:39:04.399 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4193792 len 4096 2024-04-26T18:39:04.399 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193792 len 4096 2024-04-26T18:39:04.399 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4193792 len 8192 2024-04-26T18:39:04.399 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193792 len 8192 2024-04-26T18:39:04.399 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4193792 len 8192 2024-04-26T18:39:04.399 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193792 len 8192 2024-04-26T18:39:04.399 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4193792 len 16384 2024-04-26T18:39:04.399 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193792 len 16384 2024-04-26T18:39:04.399 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4193792 len 16384 2024-04-26T18:39:04.399 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4193792 len 16384 2024-04-26T18:39:04.399 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4194304 len 1024 2024-04-26T18:39:04.399 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194304 len 1024 2024-04-26T18:39:04.399 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4194304 len 1024 2024-04-26T18:39:04.399 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194304 len 1024 2024-04-26T18:39:04.400 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4194304 len 2048 2024-04-26T18:39:04.400 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194304 len 2048 2024-04-26T18:39:04.400 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4194304 len 2048 2024-04-26T18:39:04.400 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194304 len 2048 2024-04-26T18:39:04.400 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4194304 len 4096 2024-04-26T18:39:04.400 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194304 len 4096 2024-04-26T18:39:04.400 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4194304 len 4096 2024-04-26T18:39:04.400 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194304 len 4096 2024-04-26T18:39:04.400 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4194304 len 8192 2024-04-26T18:39:04.400 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194304 len 8192 2024-04-26T18:39:04.400 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4194304 len 8192 2024-04-26T18:39:04.400 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194304 len 8192 2024-04-26T18:39:04.400 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4194304 len 16384 2024-04-26T18:39:04.400 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194304 len 16384 2024-04-26T18:39:04.400 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4194304 len 16384 2024-04-26T18:39:04.401 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194304 len 16384 2024-04-26T18:39:04.401 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4194816 len 1024 2024-04-26T18:39:04.401 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194816 len 1024 2024-04-26T18:39:04.401 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4194816 len 1024 2024-04-26T18:39:04.401 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194816 len 1024 2024-04-26T18:39:04.401 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4194816 len 2048 2024-04-26T18:39:04.401 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194816 len 2048 2024-04-26T18:39:04.401 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4194816 len 2048 2024-04-26T18:39:04.401 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194816 len 2048 2024-04-26T18:39:04.401 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4194816 len 4096 2024-04-26T18:39:04.401 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194816 len 4096 2024-04-26T18:39:04.401 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4194816 len 4096 2024-04-26T18:39:04.401 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194816 len 4096 2024-04-26T18:39:04.401 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4194816 len 8192 2024-04-26T18:39:04.401 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194816 len 8192 2024-04-26T18:39:04.401 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4194816 len 8192 2024-04-26T18:39:04.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194816 len 8192 2024-04-26T18:39:04.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4194816 len 16384 2024-04-26T18:39:04.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194816 len 16384 2024-04-26T18:39:04.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4194816 len 16384 2024-04-26T18:39:04.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4194816 len 16384 2024-04-26T18:39:04.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4195328 len 1024 2024-04-26T18:39:04.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195328 len 1024 2024-04-26T18:39:04.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4195328 len 1024 2024-04-26T18:39:04.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195328 len 1024 2024-04-26T18:39:04.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4195328 len 2048 2024-04-26T18:39:04.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195328 len 2048 2024-04-26T18:39:04.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4195328 len 2048 2024-04-26T18:39:04.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195328 len 2048 2024-04-26T18:39:04.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4195328 len 4096 2024-04-26T18:39:04.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195328 len 4096 2024-04-26T18:39:04.403 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4195328 len 4096 2024-04-26T18:39:04.403 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195328 len 4096 2024-04-26T18:39:04.778 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4195328 len 8192 2024-04-26T18:39:04.778 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195328 len 8192 2024-04-26T18:39:04.778 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4195328 len 8192 2024-04-26T18:39:04.778 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195328 len 8192 2024-04-26T18:39:04.778 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4195328 len 16384 2024-04-26T18:39:04.778 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195328 len 16384 2024-04-26T18:39:04.778 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4195328 len 16384 2024-04-26T18:39:04.778 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195328 len 16384 2024-04-26T18:39:04.779 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4195840 len 1024 2024-04-26T18:39:04.779 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195840 len 1024 2024-04-26T18:39:04.779 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4195840 len 1024 2024-04-26T18:39:04.779 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195840 len 1024 2024-04-26T18:39:04.779 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4195840 len 2048 2024-04-26T18:39:04.779 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195840 len 2048 2024-04-26T18:39:04.779 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4195840 len 2048 2024-04-26T18:39:04.779 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195840 len 2048 2024-04-26T18:39:04.779 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4195840 len 4096 2024-04-26T18:39:04.779 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195840 len 4096 2024-04-26T18:39:04.779 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4195840 len 4096 2024-04-26T18:39:04.779 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195840 len 4096 2024-04-26T18:39:04.779 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4195840 len 8192 2024-04-26T18:39:04.779 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195840 len 8192 2024-04-26T18:39:04.781 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4195840 len 8192 2024-04-26T18:39:04.781 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195840 len 8192 2024-04-26T18:39:04.781 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4195840 len 16384 2024-04-26T18:39:04.781 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195840 len 16384 2024-04-26T18:39:04.781 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4195840 len 16384 2024-04-26T18:39:04.781 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4195840 len 16384 2024-04-26T18:39:04.781 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4196352 len 1024 2024-04-26T18:39:04.781 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196352 len 1024 2024-04-26T18:39:04.781 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4196352 len 1024 2024-04-26T18:39:04.782 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196352 len 1024 2024-04-26T18:39:04.782 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4196352 len 2048 2024-04-26T18:39:04.782 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196352 len 2048 2024-04-26T18:39:04.782 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4196352 len 2048 2024-04-26T18:39:04.782 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196352 len 2048 2024-04-26T18:39:04.782 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4196352 len 4096 2024-04-26T18:39:04.782 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196352 len 4096 2024-04-26T18:39:04.782 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4196352 len 4096 2024-04-26T18:39:04.782 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196352 len 4096 2024-04-26T18:39:04.782 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4196352 len 8192 2024-04-26T18:39:04.782 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196352 len 8192 2024-04-26T18:39:04.782 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4196352 len 8192 2024-04-26T18:39:04.783 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196352 len 8192 2024-04-26T18:39:04.783 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4196352 len 16384 2024-04-26T18:39:04.783 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196352 len 16384 2024-04-26T18:39:04.783 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4196352 len 16384 2024-04-26T18:39:04.783 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196352 len 16384 2024-04-26T18:39:04.783 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4196864 len 1024 2024-04-26T18:39:04.783 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196864 len 1024 2024-04-26T18:39:04.783 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4196864 len 1024 2024-04-26T18:39:04.783 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196864 len 1024 2024-04-26T18:39:04.783 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4196864 len 2048 2024-04-26T18:39:04.783 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196864 len 2048 2024-04-26T18:39:04.783 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4196864 len 2048 2024-04-26T18:39:04.783 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196864 len 2048 2024-04-26T18:39:04.783 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4196864 len 4096 2024-04-26T18:39:04.783 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196864 len 4096 2024-04-26T18:39:04.784 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4196864 len 4096 2024-04-26T18:39:04.784 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196864 len 4096 2024-04-26T18:39:04.784 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4196864 len 8192 2024-04-26T18:39:04.784 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196864 len 8192 2024-04-26T18:39:04.784 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4196864 len 8192 2024-04-26T18:39:04.784 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196864 len 8192 2024-04-26T18:39:04.784 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4196864 len 16384 2024-04-26T18:39:04.784 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196864 len 16384 2024-04-26T18:39:04.784 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4196864 len 16384 2024-04-26T18:39:04.784 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4196864 len 16384 2024-04-26T18:39:04.784 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4197376 len 1024 2024-04-26T18:39:04.784 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197376 len 1024 2024-04-26T18:39:04.784 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4197376 len 1024 2024-04-26T18:39:04.784 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197376 len 1024 2024-04-26T18:39:04.785 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4197376 len 2048 2024-04-26T18:39:04.785 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197376 len 2048 2024-04-26T18:39:04.785 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4197376 len 2048 2024-04-26T18:39:04.785 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197376 len 2048 2024-04-26T18:39:04.785 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4197376 len 4096 2024-04-26T18:39:04.785 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197376 len 4096 2024-04-26T18:39:04.785 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4197376 len 4096 2024-04-26T18:39:04.785 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197376 len 4096 2024-04-26T18:39:04.785 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4197376 len 8192 2024-04-26T18:39:04.785 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197376 len 8192 2024-04-26T18:39:04.785 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4197376 len 8192 2024-04-26T18:39:04.785 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197376 len 8192 2024-04-26T18:39:04.785 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4197376 len 16384 2024-04-26T18:39:04.785 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197376 len 16384 2024-04-26T18:39:05.354 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4197376 len 16384 2024-04-26T18:39:05.355 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197376 len 16384 2024-04-26T18:39:05.355 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4197888 len 1024 2024-04-26T18:39:05.355 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197888 len 1024 2024-04-26T18:39:05.355 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4197888 len 1024 2024-04-26T18:39:05.355 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197888 len 1024 2024-04-26T18:39:05.355 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4197888 len 2048 2024-04-26T18:39:05.355 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197888 len 2048 2024-04-26T18:39:05.355 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4197888 len 2048 2024-04-26T18:39:05.355 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197888 len 2048 2024-04-26T18:39:05.355 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4197888 len 4096 2024-04-26T18:39:05.355 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197888 len 4096 2024-04-26T18:39:05.355 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4197888 len 4096 2024-04-26T18:39:05.356 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197888 len 4096 2024-04-26T18:39:05.356 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4197888 len 8192 2024-04-26T18:39:05.356 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197888 len 8192 2024-04-26T18:39:05.356 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4197888 len 8192 2024-04-26T18:39:05.356 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197888 len 8192 2024-04-26T18:39:05.356 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 0 offset 4197888 len 16384 2024-04-26T18:39:05.356 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197888 len 16384 2024-04-26T18:39:05.356 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 0 offset 4197888 len 16384 2024-04-26T18:39:05.356 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 0 offset 4197888 len 16384 2024-04-26T18:39:05.356 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4190720 len 1024 2024-04-26T18:39:05.356 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4190720 len 1024 2024-04-26T18:39:05.356 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4190720 len 1024 2024-04-26T18:39:05.356 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4190720 len 1024 2024-04-26T18:39:05.356 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4190720 len 2048 2024-04-26T18:39:05.357 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4190720 len 2048 2024-04-26T18:39:05.357 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4190720 len 2048 2024-04-26T18:39:05.357 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4190720 len 2048 2024-04-26T18:39:05.357 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4190720 len 4096 2024-04-26T18:39:05.357 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4190720 len 4096 2024-04-26T18:39:05.357 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4190720 len 4096 2024-04-26T18:39:05.357 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4190720 len 4096 2024-04-26T18:39:05.357 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4190720 len 8192 2024-04-26T18:39:05.357 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4190720 len 8192 2024-04-26T18:39:05.357 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4190720 len 8192 2024-04-26T18:39:05.357 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4190720 len 8192 2024-04-26T18:39:05.357 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4190720 len 16384 2024-04-26T18:39:05.357 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4190720 len 16384 2024-04-26T18:39:05.357 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4190720 len 16384 2024-04-26T18:39:05.357 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4190720 len 16384 2024-04-26T18:39:05.358 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4191232 len 1024 2024-04-26T18:39:05.358 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191232 len 1024 2024-04-26T18:39:05.358 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4191232 len 1024 2024-04-26T18:39:05.358 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191232 len 1024 2024-04-26T18:39:05.358 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4191232 len 2048 2024-04-26T18:39:05.358 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191232 len 2048 2024-04-26T18:39:05.358 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4191232 len 2048 2024-04-26T18:39:05.358 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191232 len 2048 2024-04-26T18:39:05.358 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4191232 len 4096 2024-04-26T18:39:05.358 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191232 len 4096 2024-04-26T18:39:05.358 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4191232 len 4096 2024-04-26T18:39:05.358 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191232 len 4096 2024-04-26T18:39:05.358 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4191232 len 8192 2024-04-26T18:39:05.359 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191232 len 8192 2024-04-26T18:39:05.359 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4191232 len 8192 2024-04-26T18:39:05.359 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191232 len 8192 2024-04-26T18:39:05.359 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4191232 len 16384 2024-04-26T18:39:05.359 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191232 len 16384 2024-04-26T18:39:05.359 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4191232 len 16384 2024-04-26T18:39:05.359 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191232 len 16384 2024-04-26T18:39:05.359 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4191744 len 1024 2024-04-26T18:39:05.359 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191744 len 1024 2024-04-26T18:39:05.359 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4191744 len 1024 2024-04-26T18:39:05.359 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191744 len 1024 2024-04-26T18:39:05.359 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4191744 len 2048 2024-04-26T18:39:05.359 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191744 len 2048 2024-04-26T18:39:05.359 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4191744 len 2048 2024-04-26T18:39:05.359 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191744 len 2048 2024-04-26T18:39:05.360 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4191744 len 4096 2024-04-26T18:39:05.360 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191744 len 4096 2024-04-26T18:39:05.360 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4191744 len 4096 2024-04-26T18:39:05.360 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191744 len 4096 2024-04-26T18:39:05.360 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4191744 len 8192 2024-04-26T18:39:05.360 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191744 len 8192 2024-04-26T18:39:05.360 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4191744 len 8192 2024-04-26T18:39:05.360 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191744 len 8192 2024-04-26T18:39:05.360 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4191744 len 16384 2024-04-26T18:39:05.360 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191744 len 16384 2024-04-26T18:39:05.360 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4191744 len 16384 2024-04-26T18:39:05.360 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4191744 len 16384 2024-04-26T18:39:05.360 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4192256 len 1024 2024-04-26T18:39:05.360 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192256 len 1024 2024-04-26T18:39:05.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:05 smithi082 ceph-mon[32808]: pgmap v81: 97 pgs: 97 active+clean; 183 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 2.1 MiB/s wr, 2.90k op/s 2024-04-26T18:39:05.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:05 smithi080 ceph-mon[29135]: pgmap v81: 97 pgs: 97 active+clean; 183 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 2.1 MiB/s wr, 2.90k op/s 2024-04-26T18:39:06.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4192256 len 1024 2024-04-26T18:39:06.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192256 len 1024 2024-04-26T18:39:06.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4192256 len 2048 2024-04-26T18:39:06.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192256 len 2048 2024-04-26T18:39:06.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4192256 len 2048 2024-04-26T18:39:06.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192256 len 2048 2024-04-26T18:39:06.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4192256 len 4096 2024-04-26T18:39:06.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192256 len 4096 2024-04-26T18:39:06.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4192256 len 4096 2024-04-26T18:39:06.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192256 len 4096 2024-04-26T18:39:06.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4192256 len 8192 2024-04-26T18:39:06.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192256 len 8192 2024-04-26T18:39:06.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4192256 len 8192 2024-04-26T18:39:06.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192256 len 8192 2024-04-26T18:39:06.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4192256 len 16384 2024-04-26T18:39:06.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192256 len 16384 2024-04-26T18:39:06.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4192256 len 16384 2024-04-26T18:39:06.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192256 len 16384 2024-04-26T18:39:06.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4192768 len 1024 2024-04-26T18:39:06.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192768 len 1024 2024-04-26T18:39:06.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4192768 len 1024 2024-04-26T18:39:06.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192768 len 1024 2024-04-26T18:39:06.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4192768 len 2048 2024-04-26T18:39:06.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192768 len 2048 2024-04-26T18:39:06.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4192768 len 2048 2024-04-26T18:39:06.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192768 len 2048 2024-04-26T18:39:06.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4192768 len 4096 2024-04-26T18:39:06.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192768 len 4096 2024-04-26T18:39:06.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4192768 len 4096 2024-04-26T18:39:06.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192768 len 4096 2024-04-26T18:39:06.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4192768 len 8192 2024-04-26T18:39:06.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192768 len 8192 2024-04-26T18:39:06.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4192768 len 8192 2024-04-26T18:39:06.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192768 len 8192 2024-04-26T18:39:06.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4192768 len 16384 2024-04-26T18:39:06.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192768 len 16384 2024-04-26T18:39:06.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4192768 len 16384 2024-04-26T18:39:06.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4192768 len 16384 2024-04-26T18:39:06.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4193280 len 1024 2024-04-26T18:39:06.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193280 len 1024 2024-04-26T18:39:06.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4193280 len 1024 2024-04-26T18:39:06.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193280 len 1024 2024-04-26T18:39:06.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4193280 len 2048 2024-04-26T18:39:06.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193280 len 2048 2024-04-26T18:39:06.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4193280 len 2048 2024-04-26T18:39:06.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193280 len 2048 2024-04-26T18:39:06.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4193280 len 4096 2024-04-26T18:39:06.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193280 len 4096 2024-04-26T18:39:06.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4193280 len 4096 2024-04-26T18:39:06.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193280 len 4096 2024-04-26T18:39:06.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4193280 len 8192 2024-04-26T18:39:06.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193280 len 8192 2024-04-26T18:39:06.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4193280 len 8192 2024-04-26T18:39:06.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193280 len 8192 2024-04-26T18:39:06.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4193280 len 16384 2024-04-26T18:39:06.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193280 len 16384 2024-04-26T18:39:06.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4193280 len 16384 2024-04-26T18:39:06.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193280 len 16384 2024-04-26T18:39:06.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4193792 len 1024 2024-04-26T18:39:06.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193792 len 1024 2024-04-26T18:39:06.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4193792 len 1024 2024-04-26T18:39:06.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193792 len 1024 2024-04-26T18:39:06.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4193792 len 2048 2024-04-26T18:39:06.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193792 len 2048 2024-04-26T18:39:06.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4193792 len 2048 2024-04-26T18:39:06.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193792 len 2048 2024-04-26T18:39:06.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4193792 len 4096 2024-04-26T18:39:06.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193792 len 4096 2024-04-26T18:39:06.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4193792 len 4096 2024-04-26T18:39:06.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193792 len 4096 2024-04-26T18:39:06.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4193792 len 8192 2024-04-26T18:39:06.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193792 len 8192 2024-04-26T18:39:06.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4193792 len 8192 2024-04-26T18:39:06.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193792 len 8192 2024-04-26T18:39:06.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4193792 len 16384 2024-04-26T18:39:06.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193792 len 16384 2024-04-26T18:39:06.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4193792 len 16384 2024-04-26T18:39:06.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4193792 len 16384 2024-04-26T18:39:06.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4194304 len 1024 2024-04-26T18:39:06.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194304 len 1024 2024-04-26T18:39:06.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4194304 len 1024 2024-04-26T18:39:06.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194304 len 1024 2024-04-26T18:39:06.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:05 smithi192 ceph-mon[32842]: pgmap v81: 97 pgs: 97 active+clean; 183 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 2.1 MiB/s wr, 2.90k op/s 2024-04-26T18:39:06.443 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4194304 len 2048 2024-04-26T18:39:06.443 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194304 len 2048 2024-04-26T18:39:06.443 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4194304 len 2048 2024-04-26T18:39:06.443 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194304 len 2048 2024-04-26T18:39:06.443 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4194304 len 4096 2024-04-26T18:39:06.443 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194304 len 4096 2024-04-26T18:39:06.443 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4194304 len 4096 2024-04-26T18:39:06.443 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194304 len 4096 2024-04-26T18:39:06.443 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4194304 len 8192 2024-04-26T18:39:06.443 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194304 len 8192 2024-04-26T18:39:06.443 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4194304 len 8192 2024-04-26T18:39:06.444 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194304 len 8192 2024-04-26T18:39:06.444 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4194304 len 16384 2024-04-26T18:39:06.444 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194304 len 16384 2024-04-26T18:39:06.444 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4194304 len 16384 2024-04-26T18:39:06.444 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194304 len 16384 2024-04-26T18:39:06.444 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4194816 len 1024 2024-04-26T18:39:06.444 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194816 len 1024 2024-04-26T18:39:06.444 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4194816 len 1024 2024-04-26T18:39:06.444 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194816 len 1024 2024-04-26T18:39:06.444 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4194816 len 2048 2024-04-26T18:39:06.444 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194816 len 2048 2024-04-26T18:39:06.444 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4194816 len 2048 2024-04-26T18:39:06.444 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194816 len 2048 2024-04-26T18:39:06.444 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4194816 len 4096 2024-04-26T18:39:06.445 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194816 len 4096 2024-04-26T18:39:06.445 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4194816 len 4096 2024-04-26T18:39:06.445 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194816 len 4096 2024-04-26T18:39:06.445 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4194816 len 8192 2024-04-26T18:39:06.445 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194816 len 8192 2024-04-26T18:39:06.445 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4194816 len 8192 2024-04-26T18:39:06.445 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194816 len 8192 2024-04-26T18:39:06.445 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4194816 len 16384 2024-04-26T18:39:06.445 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194816 len 16384 2024-04-26T18:39:06.445 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4194816 len 16384 2024-04-26T18:39:06.445 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4194816 len 16384 2024-04-26T18:39:06.445 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4195328 len 1024 2024-04-26T18:39:06.445 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195328 len 1024 2024-04-26T18:39:06.445 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4195328 len 1024 2024-04-26T18:39:06.445 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195328 len 1024 2024-04-26T18:39:06.445 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4195328 len 2048 2024-04-26T18:39:06.446 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195328 len 2048 2024-04-26T18:39:06.446 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4195328 len 2048 2024-04-26T18:39:06.446 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195328 len 2048 2024-04-26T18:39:06.446 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4195328 len 4096 2024-04-26T18:39:06.446 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195328 len 4096 2024-04-26T18:39:06.446 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4195328 len 4096 2024-04-26T18:39:06.446 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195328 len 4096 2024-04-26T18:39:06.446 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4195328 len 8192 2024-04-26T18:39:06.446 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195328 len 8192 2024-04-26T18:39:06.446 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4195328 len 8192 2024-04-26T18:39:06.446 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195328 len 8192 2024-04-26T18:39:06.446 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4195328 len 16384 2024-04-26T18:39:06.446 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195328 len 16384 2024-04-26T18:39:06.446 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4195328 len 16384 2024-04-26T18:39:06.447 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195328 len 16384 2024-04-26T18:39:06.447 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4195840 len 1024 2024-04-26T18:39:06.447 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195840 len 1024 2024-04-26T18:39:06.447 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4195840 len 1024 2024-04-26T18:39:06.447 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195840 len 1024 2024-04-26T18:39:06.447 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4195840 len 2048 2024-04-26T18:39:06.447 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195840 len 2048 2024-04-26T18:39:06.447 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4195840 len 2048 2024-04-26T18:39:06.447 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195840 len 2048 2024-04-26T18:39:06.447 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4195840 len 4096 2024-04-26T18:39:06.447 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195840 len 4096 2024-04-26T18:39:06.447 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4195840 len 4096 2024-04-26T18:39:06.447 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195840 len 4096 2024-04-26T18:39:06.447 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4195840 len 8192 2024-04-26T18:39:06.447 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195840 len 8192 2024-04-26T18:39:06.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4195840 len 8192 2024-04-26T18:39:06.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195840 len 8192 2024-04-26T18:39:06.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4195840 len 16384 2024-04-26T18:39:06.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195840 len 16384 2024-04-26T18:39:06.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4195840 len 16384 2024-04-26T18:39:06.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4195840 len 16384 2024-04-26T18:39:06.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4196352 len 1024 2024-04-26T18:39:06.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196352 len 1024 2024-04-26T18:39:06.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4196352 len 1024 2024-04-26T18:39:06.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196352 len 1024 2024-04-26T18:39:06.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4196352 len 2048 2024-04-26T18:39:06.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196352 len 2048 2024-04-26T18:39:06.861 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4196352 len 2048 2024-04-26T18:39:06.861 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196352 len 2048 2024-04-26T18:39:06.861 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4196352 len 4096 2024-04-26T18:39:06.861 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196352 len 4096 2024-04-26T18:39:06.861 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4196352 len 4096 2024-04-26T18:39:06.861 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196352 len 4096 2024-04-26T18:39:06.861 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4196352 len 8192 2024-04-26T18:39:06.861 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196352 len 8192 2024-04-26T18:39:06.861 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4196352 len 8192 2024-04-26T18:39:06.861 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196352 len 8192 2024-04-26T18:39:06.862 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4196352 len 16384 2024-04-26T18:39:06.862 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196352 len 16384 2024-04-26T18:39:06.862 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4196352 len 16384 2024-04-26T18:39:06.862 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196352 len 16384 2024-04-26T18:39:06.862 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4196864 len 1024 2024-04-26T18:39:06.862 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196864 len 1024 2024-04-26T18:39:06.862 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4196864 len 1024 2024-04-26T18:39:06.862 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196864 len 1024 2024-04-26T18:39:06.862 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4196864 len 2048 2024-04-26T18:39:06.862 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196864 len 2048 2024-04-26T18:39:06.862 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4196864 len 2048 2024-04-26T18:39:06.862 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196864 len 2048 2024-04-26T18:39:06.862 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4196864 len 4096 2024-04-26T18:39:06.863 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196864 len 4096 2024-04-26T18:39:06.863 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4196864 len 4096 2024-04-26T18:39:06.863 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196864 len 4096 2024-04-26T18:39:06.863 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4196864 len 8192 2024-04-26T18:39:06.863 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196864 len 8192 2024-04-26T18:39:06.863 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4196864 len 8192 2024-04-26T18:39:06.863 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196864 len 8192 2024-04-26T18:39:06.863 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4196864 len 16384 2024-04-26T18:39:06.863 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196864 len 16384 2024-04-26T18:39:06.863 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4196864 len 16384 2024-04-26T18:39:06.863 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4196864 len 16384 2024-04-26T18:39:06.863 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4197376 len 1024 2024-04-26T18:39:06.863 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197376 len 1024 2024-04-26T18:39:06.863 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4197376 len 1024 2024-04-26T18:39:06.864 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197376 len 1024 2024-04-26T18:39:06.864 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4197376 len 2048 2024-04-26T18:39:06.864 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197376 len 2048 2024-04-26T18:39:06.864 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4197376 len 2048 2024-04-26T18:39:06.864 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197376 len 2048 2024-04-26T18:39:06.864 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4197376 len 4096 2024-04-26T18:39:06.864 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197376 len 4096 2024-04-26T18:39:06.864 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4197376 len 4096 2024-04-26T18:39:06.864 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197376 len 4096 2024-04-26T18:39:06.864 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4197376 len 8192 2024-04-26T18:39:06.864 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197376 len 8192 2024-04-26T18:39:06.864 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4197376 len 8192 2024-04-26T18:39:06.864 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197376 len 8192 2024-04-26T18:39:06.864 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4197376 len 16384 2024-04-26T18:39:06.865 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197376 len 16384 2024-04-26T18:39:06.865 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4197376 len 16384 2024-04-26T18:39:06.865 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197376 len 16384 2024-04-26T18:39:06.865 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4197888 len 1024 2024-04-26T18:39:06.865 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197888 len 1024 2024-04-26T18:39:06.865 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4197888 len 1024 2024-04-26T18:39:06.865 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197888 len 1024 2024-04-26T18:39:06.865 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4197888 len 2048 2024-04-26T18:39:06.865 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197888 len 2048 2024-04-26T18:39:06.865 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4197888 len 2048 2024-04-26T18:39:06.865 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197888 len 2048 2024-04-26T18:39:06.865 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4197888 len 4096 2024-04-26T18:39:06.865 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197888 len 4096 2024-04-26T18:39:06.865 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4197888 len 4096 2024-04-26T18:39:06.866 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197888 len 4096 2024-04-26T18:39:06.866 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4197888 len 8192 2024-04-26T18:39:06.866 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197888 len 8192 2024-04-26T18:39:06.866 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4197888 len 8192 2024-04-26T18:39:06.866 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197888 len 8192 2024-04-26T18:39:06.866 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 512 offset 4197888 len 16384 2024-04-26T18:39:06.866 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197888 len 16384 2024-04-26T18:39:06.866 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 512 offset 4197888 len 16384 2024-04-26T18:39:06.866 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 512 offset 4197888 len 16384 2024-04-26T18:39:06.866 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4190720 len 1024 2024-04-26T18:39:06.866 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4190720 len 1024 2024-04-26T18:39:06.866 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4190720 len 1024 2024-04-26T18:39:06.866 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4190720 len 1024 2024-04-26T18:39:06.866 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4190720 len 2048 2024-04-26T18:39:06.867 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4190720 len 2048 2024-04-26T18:39:06.867 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4190720 len 2048 2024-04-26T18:39:06.867 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4190720 len 2048 2024-04-26T18:39:06.867 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4190720 len 4096 2024-04-26T18:39:07.486 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4190720 len 4096 2024-04-26T18:39:07.486 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4190720 len 4096 2024-04-26T18:39:07.486 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4190720 len 4096 2024-04-26T18:39:07.486 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4190720 len 8192 2024-04-26T18:39:07.486 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4190720 len 8192 2024-04-26T18:39:07.487 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4190720 len 8192 2024-04-26T18:39:07.487 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4190720 len 8192 2024-04-26T18:39:07.487 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4190720 len 16384 2024-04-26T18:39:07.487 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4190720 len 16384 2024-04-26T18:39:07.487 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4190720 len 16384 2024-04-26T18:39:07.487 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4190720 len 16384 2024-04-26T18:39:07.487 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4191232 len 1024 2024-04-26T18:39:07.487 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191232 len 1024 2024-04-26T18:39:07.487 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4191232 len 1024 2024-04-26T18:39:07.487 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191232 len 1024 2024-04-26T18:39:07.487 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4191232 len 2048 2024-04-26T18:39:07.487 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191232 len 2048 2024-04-26T18:39:07.487 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4191232 len 2048 2024-04-26T18:39:07.487 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191232 len 2048 2024-04-26T18:39:07.488 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4191232 len 4096 2024-04-26T18:39:07.488 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191232 len 4096 2024-04-26T18:39:07.488 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4191232 len 4096 2024-04-26T18:39:07.488 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191232 len 4096 2024-04-26T18:39:07.488 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4191232 len 8192 2024-04-26T18:39:07.488 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191232 len 8192 2024-04-26T18:39:07.488 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4191232 len 8192 2024-04-26T18:39:07.488 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191232 len 8192 2024-04-26T18:39:07.488 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4191232 len 16384 2024-04-26T18:39:07.488 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191232 len 16384 2024-04-26T18:39:07.488 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4191232 len 16384 2024-04-26T18:39:07.488 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191232 len 16384 2024-04-26T18:39:07.488 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4191744 len 1024 2024-04-26T18:39:07.488 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191744 len 1024 2024-04-26T18:39:07.488 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4191744 len 1024 2024-04-26T18:39:07.489 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191744 len 1024 2024-04-26T18:39:07.489 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4191744 len 2048 2024-04-26T18:39:07.489 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191744 len 2048 2024-04-26T18:39:07.489 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4191744 len 2048 2024-04-26T18:39:07.489 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191744 len 2048 2024-04-26T18:39:07.489 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4191744 len 4096 2024-04-26T18:39:07.489 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191744 len 4096 2024-04-26T18:39:07.489 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4191744 len 4096 2024-04-26T18:39:07.489 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191744 len 4096 2024-04-26T18:39:07.489 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4191744 len 8192 2024-04-26T18:39:07.489 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191744 len 8192 2024-04-26T18:39:07.489 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4191744 len 8192 2024-04-26T18:39:07.489 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191744 len 8192 2024-04-26T18:39:07.489 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4191744 len 16384 2024-04-26T18:39:07.489 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191744 len 16384 2024-04-26T18:39:07.490 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4191744 len 16384 2024-04-26T18:39:07.490 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4191744 len 16384 2024-04-26T18:39:07.490 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4192256 len 1024 2024-04-26T18:39:07.490 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192256 len 1024 2024-04-26T18:39:07.490 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4192256 len 1024 2024-04-26T18:39:07.490 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192256 len 1024 2024-04-26T18:39:07.490 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4192256 len 2048 2024-04-26T18:39:07.490 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192256 len 2048 2024-04-26T18:39:07.490 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4192256 len 2048 2024-04-26T18:39:07.490 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192256 len 2048 2024-04-26T18:39:07.490 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4192256 len 4096 2024-04-26T18:39:07.490 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192256 len 4096 2024-04-26T18:39:07.490 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4192256 len 4096 2024-04-26T18:39:07.490 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192256 len 4096 2024-04-26T18:39:07.490 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4192256 len 8192 2024-04-26T18:39:07.491 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192256 len 8192 2024-04-26T18:39:07.491 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4192256 len 8192 2024-04-26T18:39:07.491 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192256 len 8192 2024-04-26T18:39:07.491 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4192256 len 16384 2024-04-26T18:39:07.491 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192256 len 16384 2024-04-26T18:39:07.491 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4192256 len 16384 2024-04-26T18:39:07.491 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192256 len 16384 2024-04-26T18:39:07.491 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4192768 len 1024 2024-04-26T18:39:07.491 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192768 len 1024 2024-04-26T18:39:07.491 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4192768 len 1024 2024-04-26T18:39:07.491 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192768 len 1024 2024-04-26T18:39:07.491 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4192768 len 2048 2024-04-26T18:39:07.491 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192768 len 2048 2024-04-26T18:39:07.491 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4192768 len 2048 2024-04-26T18:39:07.492 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192768 len 2048 2024-04-26T18:39:07.492 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4192768 len 4096 2024-04-26T18:39:07.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:07 smithi082 ceph-mon[32808]: pgmap v82: 97 pgs: 97 active+clean; 183 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 787 KiB/s wr, 2.17k op/s 2024-04-26T18:39:07.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:07 smithi080 ceph-mon[29135]: pgmap v82: 97 pgs: 97 active+clean; 183 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 787 KiB/s wr, 2.17k op/s 2024-04-26T18:39:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.008+0000 7f64525e4640 1 -- 172.21.15.80:0/1084392195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f644c10cfb0 msgr2=0x7f644c10f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.008+0000 7f64525e4640 1 --2- 172.21.15.80:0/1084392195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f644c10cfb0 0x7f644c10f3e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6444009ca0 tx=0x7f644402a950 comp rx=0 tx=0).stop 2024-04-26T18:39:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.008+0000 7f64525e4640 1 -- 172.21.15.80:0/1084392195 shutdown_connections 2024-04-26T18:39:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.008+0000 7f64525e4640 1 --2- 172.21.15.80:0/1084392195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f644c10cfb0 0x7f644c10f3e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.008+0000 7f64525e4640 1 --2- 172.21.15.80:0/1084392195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f644c104500 0x7f644c10c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.008+0000 7f64525e4640 1 --2- 172.21.15.80:0/1084392195 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f644c103be0 0x7f644c103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.008+0000 7f64525e4640 1 -- 172.21.15.80:0/1084392195 >> 172.21.15.80:0/1084392195 conn(0x7f644c077bb0 msgr2=0x7f644c077fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:39:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.008+0000 7f64525e4640 1 -- 172.21.15.80:0/1084392195 shutdown_connections 2024-04-26T18:39:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.008+0000 7f64525e4640 1 -- 172.21.15.80:0/1084392195 wait complete. 2024-04-26T18:39:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.009+0000 7f64525e4640 1 Processor -- start 2024-04-26T18:39:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.009+0000 7f64525e4640 1 -- start start 2024-04-26T18:39:08.011 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.009+0000 7f64525e4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f644c103be0 0x7f644c198ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:08.011 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.009+0000 7f64525e4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f644c104500 0x7f644c199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:08.011 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.009+0000 7f64525e4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f644c10cfb0 0x7f644c19d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:08.011 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.009+0000 7f64525e4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f644c112bf0 con 0x7f644c103be0 2024-04-26T18:39:08.012 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.009+0000 7f64525e4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f644c112a70 con 0x7f644c10cfb0 2024-04-26T18:39:08.012 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.009+0000 7f64525e4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f644c112d70 con 0x7f644c104500 2024-04-26T18:39:08.012 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.009+0000 7f644bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f644c103be0 0x7f644c198ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:08.012 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.009+0000 7f644bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f644c103be0 0x7f644c198ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46912/0 (socket says 172.21.15.80:46912) 2024-04-26T18:39:08.012 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.009+0000 7f644bfff640 1 -- 172.21.15.80:0/237785909 learned_addr learned my addr 172.21.15.80:0/237785909 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:39:08.012 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.009+0000 7f6450b81640 1 --2- 172.21.15.80:0/237785909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f644c10cfb0 0x7f644c19d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:08.012 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.009+0000 7f644b7fe640 1 --2- 172.21.15.80:0/237785909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f644c104500 0x7f644c199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:08.012 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.010+0000 7f644bfff640 1 -- 172.21.15.80:0/237785909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f644c104500 msgr2=0x7f644c199530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:08.012 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.010+0000 7f644bfff640 1 --2- 172.21.15.80:0/237785909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f644c104500 0x7f644c199530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.012 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.010+0000 7f644bfff640 1 -- 172.21.15.80:0/237785909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f644c10cfb0 msgr2=0x7f644c19d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:08.012 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.010+0000 7f644bfff640 1 --2- 172.21.15.80:0/237785909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f644c10cfb0 0x7f644c19d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.012 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.010+0000 7f644bfff640 1 -- 172.21.15.80:0/237785909 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c19dfe0 con 0x7f644c103be0 2024-04-26T18:39:08.012 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.010+0000 7f644bfff640 1 --2- 172.21.15.80:0/237785909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f644c103be0 0x7f644c198ff0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f643c00e9f0 tx=0x7f643c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:39:08.013 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.010+0000 7f64497fa640 1 -- 172.21.15.80:0/237785909 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c00cd80 con 0x7f644c103be0 2024-04-26T18:39:08.013 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.010+0000 7f64525e4640 1 -- 172.21.15.80:0/237785909 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f644c19e2d0 con 0x7f644c103be0 2024-04-26T18:39:08.013 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.010+0000 7f64497fa640 1 -- 172.21.15.80:0/237785909 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f643c0108e0 con 0x7f644c103be0 2024-04-26T18:39:08.013 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.010+0000 7f64497fa640 1 -- 172.21.15.80:0/237785909 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c018980 con 0x7f644c103be0 2024-04-26T18:39:08.013 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.010+0000 7f64525e4640 1 -- 172.21.15.80:0/237785909 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f644c1a5b60 con 0x7f644c103be0 2024-04-26T18:39:08.019 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.012+0000 7f64497fa640 1 -- 172.21.15.80:0/237785909 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f643c010430 con 0x7f644c103be0 2024-04-26T18:39:08.019 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.013+0000 7f64553d4740 1 Processor -- start 2024-04-26T18:39:08.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.013+0000 7f64553d4740 1 -- start start 2024-04-26T18:39:08.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.013+0000 7f64497fa640 1 --2- 172.21.15.80:0/237785909 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f64340a3dc0 0x7f64340a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:08.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.013+0000 7f64553d4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9d1301f00 0x55d9d13022e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:08.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.013+0000 7f64553d4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1302820 0x55d9d130cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:08.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.013+0000 7f64553d4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d130d0e0 0x55d9d130f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:08.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.013+0000 7f64553d4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55d9d1268460 con 0x55d9d130d0e0 2024-04-26T18:39:08.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.013+0000 7f64553d4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d9d1222590 con 0x55d9d1302820 2024-04-26T18:39:08.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.013+0000 7f64553d4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d9d1264420 con 0x55d9d1301f00 2024-04-26T18:39:08.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.013+0000 7f6450b81640 1 --2- 172.21.15.80:0/237785909 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f64340a3dc0 0x7f64340a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:08.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.013+0000 7f644b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1302820 0x55d9d130cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:08.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.013+0000 7f644bfff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9d1301f00 0x55d9d13022e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:08.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.013+0000 7f64497fa640 1 -- 172.21.15.80:0/237785909 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f643c0d0ad0 con 0x7f644c103be0 2024-04-26T18:39:08.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.013+0000 7f644b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1302820 0x55d9d130cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:33058/0 (socket says 172.21.15.80:33058) 2024-04-26T18:39:08.020 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.013+0000 7f6450b81640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d130d0e0 0x55d9d130f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:08.021 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.013+0000 7f644b7fe640 1 -- 172.21.15.80:0/2714270197 learned_addr learned my addr 172.21.15.80:0/2714270197 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:39:08.021 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.013+0000 7f644b7fe640 1 -- 172.21.15.80:0/2714270197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9d1301f00 msgr2=0x55d9d13022e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:39:08.021 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.013+0000 7f644b7fe640 1 --2- 172.21.15.80:0/2714270197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9d1301f00 0x55d9d13022e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.021 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.013+0000 7f644b7fe640 1 -- 172.21.15.80:0/2714270197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d130d0e0 msgr2=0x55d9d130f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:39:08.021 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.013+0000 7f644b7fe640 1 --2- 172.21.15.80:0/2714270197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d130d0e0 0x55d9d130f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.021 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.014+0000 7f644b7fe640 1 -- 172.21.15.80:0/2714270197 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9d122f0d0 con 0x55d9d1302820 2024-04-26T18:39:08.021 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.014+0000 7f6450b81640 1 --2- 172.21.15.80:0/237785909 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f64340a3dc0 0x7f64340a6280 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6444005e30 tx=0x7f64440099c0 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:39:08.021 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.014+0000 7f644b7fe640 1 --2- 172.21.15.80:0/2714270197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1302820 0x55d9d130cba0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6440009c10 tx=0x7f6440011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f2b5c4592c29afd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:39:08.021 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.014+0000 7f64327fc640 1 -- 172.21.15.80:0/2714270197 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6440004230 con 0x55d9d1302820 2024-04-26T18:39:08.021 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.014+0000 7f64327fc640 1 -- 172.21.15.80:0/2714270197 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64400043d0 con 0x55d9d1302820 2024-04-26T18:39:08.021 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.014+0000 7f64327fc640 1 -- 172.21.15.80:0/2714270197 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6440004cc0 con 0x55d9d1302820 2024-04-26T18:39:08.021 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.015+0000 7f64553d4740 1 -- 172.21.15.80:0/2714270197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1302820 msgr2=0x55d9d130cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:08.021 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.015+0000 7f64553d4740 1 --2- 172.21.15.80:0/2714270197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1302820 0x55d9d130cba0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6440009c10 tx=0x7f6440011810 comp rx=0 tx=0).stop 2024-04-26T18:39:08.021 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.015+0000 7f64553d4740 1 -- 172.21.15.80:0/2714270197 shutdown_connections 2024-04-26T18:39:08.022 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.015+0000 7f64553d4740 1 --2- 172.21.15.80:0/2714270197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d130d0e0 0x55d9d130f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.022 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.015+0000 7f64553d4740 1 --2- 172.21.15.80:0/2714270197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1302820 0x55d9d130cba0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.022 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.015+0000 7f64553d4740 1 --2- 172.21.15.80:0/2714270197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9d1301f00 0x55d9d13022e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.022 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.015+0000 7f64553d4740 1 -- 172.21.15.80:0/2714270197 >> 172.21.15.80:0/2714270197 conn(0x55d9d12fe410 msgr2=0x55d9d12fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:39:08.022 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.015+0000 7f64553d4740 1 -- 172.21.15.80:0/2714270197 shutdown_connections 2024-04-26T18:39:08.022 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.015+0000 7f64553d4740 1 -- 172.21.15.80:0/2714270197 wait complete. 2024-04-26T18:39:08.022 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.015+0000 7f64553d4740 1 -- start start 2024-04-26T18:39:08.022 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.015+0000 7f64553d4740 1 Processor -- start 2024-04-26T18:39:08.022 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.015+0000 7f64553d4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9d1301f00 0x55d9d130a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:08.022 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.015+0000 7f64553d4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1302820 0x55d9d130a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:08.022 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.015+0000 7f64553d4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d130d0e0 0x55d9d130ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:08.022 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.015+0000 7f64553d4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55d9d130fd10 con 0x55d9d130d0e0 2024-04-26T18:39:08.022 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.015+0000 7f64553d4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d9d11efb60 con 0x55d9d1302820 2024-04-26T18:39:08.022 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.015+0000 7f64553d4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d9d130fe90 con 0x55d9d1301f00 2024-04-26T18:39:08.023 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.016+0000 7f64553d4740 10 client.0 _ll_register_callbacks cb 0x55d9d12142b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:39:08.023 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.016+0000 7f644b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1302820 0x55d9d130a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:08.023 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.016+0000 7f6450b81640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d130d0e0 0x55d9d130ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:08.023 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.016+0000 7f644b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1302820 0x55d9d130a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.80:33070/0 (socket says 172.21.15.80:33070) 2024-04-26T18:39:08.023 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.016+0000 7f644b7fe640 1 -- 172.21.15.80:0/418607651 learned_addr learned my addr 172.21.15.80:0/418607651 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:39:08.023 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.016+0000 7f6450b81640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d130d0e0 0x55d9d130ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46932/0 (socket says 172.21.15.80:46932) 2024-04-26T18:39:08.023 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.016+0000 7f644bfff640 1 --2- 172.21.15.80:0/418607651 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9d1301f00 0x55d9d130a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:08.023 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.016+0000 7f6450b81640 1 -- 172.21.15.80:0/418607651 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9d1301f00 msgr2=0x55d9d130a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:39:08.023 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.016+0000 7f6450b81640 1 --2- 172.21.15.80:0/418607651 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9d1301f00 0x55d9d130a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.023 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.016+0000 7f6450b81640 1 -- 172.21.15.80:0/418607651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1302820 msgr2=0x55d9d130a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:39:08.023 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.016+0000 7f6450b81640 1 --2- 172.21.15.80:0/418607651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1302820 0x55d9d130a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.023 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.016+0000 7f6450b81640 1 -- 172.21.15.80:0/418607651 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9d0f7a210 con 0x55d9d130d0e0 2024-04-26T18:39:08.023 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.016+0000 7f644bfff640 1 --2- 172.21.15.80:0/418607651 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9d1301f00 0x55d9d130a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:39:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.016+0000 7f644b7fe640 1 --2- 172.21.15.80:0/418607651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1302820 0x55d9d130a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:39:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.016+0000 7f6450b81640 1 --2- 172.21.15.80:0/418607651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d130d0e0 0x55d9d130ab00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6444006010 tx=0x7f6444005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aceaec4632e65a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:39:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.016+0000 7f642b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:39:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.016+0000 7f642b7fe640 1 -- 172.21.15.80:0/418607651 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444050070 con 0x55d9d130d0e0 2024-04-26T18:39:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.016+0000 7f642b7fe640 1 -- 172.21.15.80:0/418607651 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f644404a680 con 0x55d9d130d0e0 2024-04-26T18:39:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.016+0000 7f64553d4740 1 -- 172.21.15.80:0/418607651 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64400043d0 con 0x55d9d130d0e0 2024-04-26T18:39:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.016+0000 7f642b7fe640 1 -- 172.21.15.80:0/418607651 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f644405c050 con 0x55d9d130d0e0 2024-04-26T18:39:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.016+0000 7f64553d4740 10 client.15735 fetch_fsmap learned FSMap version 27 2024-04-26T18:39:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.016+0000 7f64553d4740 1 -- 172.21.15.80:0/418607651 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d9d1046620 con 0x55d9d130d0e0 2024-04-26T18:39:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.017+0000 7f642b7fe640 1 -- 172.21.15.80:0/418607651 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64400043d0 con 0x55d9d130d0e0 2024-04-26T18:39:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.017+0000 7f642b7fe640 1 -- 172.21.15.80:0/418607651 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f64440055e0 con 0x55d9d130d0e0 2024-04-26T18:39:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.017+0000 7f64553d4740 10 client.15735 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:39:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.017+0000 7f64553d4740 10 client.15735 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:39:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.017+0000 7f64553d4740 20 client.15735 populate_metadata read hostname 'smithi080' 2024-04-26T18:39:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.017+0000 7f64553d4740 1 --2- 172.21.15.80:0/418607651 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55d9d131d300 0x55d9d131f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.017+0000 7f64553d4740 4 client.15735 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:39:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.017+0000 7f64553d4740 1 -- 172.21.15.80:0/418607651 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9d1276070 con 0x55d9d131d300 2024-04-26T18:39:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.017+0000 7f644bfff640 1 --2- 172.21.15.80:0/418607651 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55d9d131d300 0x55d9d131f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.017+0000 7f642b7fe640 10 client.15735 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:39:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.017+0000 7f644bfff640 1 --2- 172.21.15.80:0/418607651 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55d9d131d300 0x55d9d131f710 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd9f748408ba9d90 server_cookie=17b81f4c133d49f3 in_seq=0 out_seq=0 2024-04-26T18:39:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.019+0000 7f642b7fe640 1 -- 172.21.15.80:0/418607651 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d9d1276070 con 0x55d9d131d300 2024-04-26T18:39:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.019+0000 7f642b7fe640 10 client.15735 handle_command_reply: tid=0 2024-04-26T18:39:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.019+0000 7f64553d4740 1 client.15735 shutdown 2024-04-26T18:39:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.019+0000 7f64553d4740 1 -- 172.21.15.80:0/418607651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d130d0e0 msgr2=0x55d9d130ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.019+0000 7f64553d4740 1 --2- 172.21.15.80:0/418607651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d130d0e0 0x55d9d130ab00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6444006010 tx=0x7f6444005c50 comp rx=0 tx=0).stop 2024-04-26T18:39:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.019+0000 7f64553d4740 1 -- 172.21.15.80:0/418607651 shutdown_connections 2024-04-26T18:39:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.019+0000 7f64553d4740 1 --2- 172.21.15.80:0/418607651 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55d9d131d300 0x55d9d131f710 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.019+0000 7f64553d4740 1 --2- 172.21.15.80:0/418607651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d130d0e0 0x55d9d130ab00 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.026 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.019+0000 7f64553d4740 1 --2- 172.21.15.80:0/418607651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1302820 0x55d9d130a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.026 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.019+0000 7f642b7fe640 0 client.15735 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:39:08.026 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.019+0000 7f64553d4740 1 --2- 172.21.15.80:0/418607651 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9d1301f00 0x55d9d130a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.026 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.019+0000 7f64553d4740 1 -- 172.21.15.80:0/418607651 >> 172.21.15.80:0/418607651 conn(0x55d9d12fe410 msgr2=0x55d9d1304140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:39:08.026 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.019+0000 7f64553d4740 1 -- 172.21.15.80:0/418607651 shutdown_connections 2024-04-26T18:39:08.026 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.019+0000 7f64553d4740 1 -- 172.21.15.80:0/418607651 wait complete. 2024-04-26T18:39:08.026 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.019+0000 7f64553d4740 20 client.15735 trim_cache size 0 max 16384 2024-04-26T18:39:08.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192768 len 4096 2024-04-26T18:39:08.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4192768 len 4096 2024-04-26T18:39:08.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192768 len 4096 2024-04-26T18:39:08.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4192768 len 8192 2024-04-26T18:39:08.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192768 len 8192 2024-04-26T18:39:08.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4192768 len 8192 2024-04-26T18:39:08.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192768 len 8192 2024-04-26T18:39:08.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4192768 len 16384 2024-04-26T18:39:08.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192768 len 16384 2024-04-26T18:39:08.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4192768 len 16384 2024-04-26T18:39:08.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4192768 len 16384 2024-04-26T18:39:08.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4193280 len 1024 2024-04-26T18:39:08.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193280 len 1024 2024-04-26T18:39:08.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4193280 len 1024 2024-04-26T18:39:08.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193280 len 1024 2024-04-26T18:39:08.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4193280 len 2048 2024-04-26T18:39:08.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193280 len 2048 2024-04-26T18:39:08.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4193280 len 2048 2024-04-26T18:39:08.033 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193280 len 2048 2024-04-26T18:39:08.033 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4193280 len 4096 2024-04-26T18:39:08.033 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193280 len 4096 2024-04-26T18:39:08.033 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4193280 len 4096 2024-04-26T18:39:08.033 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193280 len 4096 2024-04-26T18:39:08.033 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4193280 len 8192 2024-04-26T18:39:08.033 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193280 len 8192 2024-04-26T18:39:08.033 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4193280 len 8192 2024-04-26T18:39:08.033 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193280 len 8192 2024-04-26T18:39:08.033 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4193280 len 16384 2024-04-26T18:39:08.033 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193280 len 16384 2024-04-26T18:39:08.033 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4193280 len 16384 2024-04-26T18:39:08.033 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193280 len 16384 2024-04-26T18:39:08.033 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4193792 len 1024 2024-04-26T18:39:08.033 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193792 len 1024 2024-04-26T18:39:08.034 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4193792 len 1024 2024-04-26T18:39:08.034 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193792 len 1024 2024-04-26T18:39:08.034 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4193792 len 2048 2024-04-26T18:39:08.034 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193792 len 2048 2024-04-26T18:39:08.034 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4193792 len 2048 2024-04-26T18:39:08.034 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193792 len 2048 2024-04-26T18:39:08.034 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4193792 len 4096 2024-04-26T18:39:08.034 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193792 len 4096 2024-04-26T18:39:08.034 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4193792 len 4096 2024-04-26T18:39:08.034 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193792 len 4096 2024-04-26T18:39:08.034 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4193792 len 8192 2024-04-26T18:39:08.034 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193792 len 8192 2024-04-26T18:39:08.034 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4193792 len 8192 2024-04-26T18:39:08.034 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193792 len 8192 2024-04-26T18:39:08.035 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4193792 len 16384 2024-04-26T18:39:08.035 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193792 len 16384 2024-04-26T18:39:08.035 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4193792 len 16384 2024-04-26T18:39:08.035 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4193792 len 16384 2024-04-26T18:39:08.035 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4194304 len 1024 2024-04-26T18:39:08.035 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194304 len 1024 2024-04-26T18:39:08.035 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4194304 len 1024 2024-04-26T18:39:08.035 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194304 len 1024 2024-04-26T18:39:08.035 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4194304 len 2048 2024-04-26T18:39:08.035 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194304 len 2048 2024-04-26T18:39:08.035 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4194304 len 2048 2024-04-26T18:39:08.035 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194304 len 2048 2024-04-26T18:39:08.035 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4194304 len 4096 2024-04-26T18:39:08.035 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194304 len 4096 2024-04-26T18:39:08.035 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4194304 len 4096 2024-04-26T18:39:08.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194304 len 4096 2024-04-26T18:39:08.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4194304 len 8192 2024-04-26T18:39:08.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194304 len 8192 2024-04-26T18:39:08.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4194304 len 8192 2024-04-26T18:39:08.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194304 len 8192 2024-04-26T18:39:08.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4194304 len 16384 2024-04-26T18:39:08.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194304 len 16384 2024-04-26T18:39:08.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4194304 len 16384 2024-04-26T18:39:08.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194304 len 16384 2024-04-26T18:39:08.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4194816 len 1024 2024-04-26T18:39:08.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194816 len 1024 2024-04-26T18:39:08.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4194816 len 1024 2024-04-26T18:39:08.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194816 len 1024 2024-04-26T18:39:08.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4194816 len 2048 2024-04-26T18:39:08.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194816 len 2048 2024-04-26T18:39:08.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4194816 len 2048 2024-04-26T18:39:08.037 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194816 len 2048 2024-04-26T18:39:08.037 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4194816 len 4096 2024-04-26T18:39:08.037 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194816 len 4096 2024-04-26T18:39:08.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.034+0000 7f64553d4740 1 Processor -- start 2024-04-26T18:39:08.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.034+0000 7f64553d4740 1 -- start start 2024-04-26T18:39:08.041 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.035+0000 7f64553d4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1301f00 0x55d9d1318bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:08.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.035+0000 7f64553d4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d1302820 0x55d9d130c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:08.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.035+0000 7f64553d4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9d130d0e0 0x55d9d13048c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:08.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.035+0000 7f64553d4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f644c1ae3c0 con 0x55d9d1302820 2024-04-26T18:39:08.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.035+0000 7f64553d4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f644c1aff00 con 0x55d9d1301f00 2024-04-26T18:39:08.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.035+0000 7f64553d4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f644c1aea90 con 0x55d9d130d0e0 2024-04-26T18:39:08.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.035+0000 7f644b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d1302820 0x55d9d130c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:08.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.035+0000 7f644b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d1302820 0x55d9d130c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46946/0 (socket says 172.21.15.80:46946) 2024-04-26T18:39:08.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.035+0000 7f644b7fe640 1 -- 172.21.15.80:0/3212528985 learned_addr learned my addr 172.21.15.80:0/3212528985 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:39:08.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.035+0000 7f644bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1301f00 0x55d9d1318bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:08.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.035+0000 7f6450b81640 1 --2- 172.21.15.80:0/3212528985 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9d130d0e0 0x55d9d13048c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:08.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.035+0000 7f644b7fe640 1 -- 172.21.15.80:0/3212528985 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9d130d0e0 msgr2=0x55d9d13048c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:39:08.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.035+0000 7f644b7fe640 1 --2- 172.21.15.80:0/3212528985 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9d130d0e0 0x55d9d13048c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.042 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.035+0000 7f644b7fe640 1 -- 172.21.15.80:0/3212528985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1301f00 msgr2=0x55d9d1318bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:39:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.035+0000 7f644b7fe640 1 --2- 172.21.15.80:0/3212528985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1301f00 0x55d9d1318bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.035+0000 7f644b7fe640 1 -- 172.21.15.80:0/3212528985 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9d1309070 con 0x55d9d1302820 2024-04-26T18:39:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.035+0000 7f644b7fe640 1 --2- 172.21.15.80:0/3212528985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d1302820 0x55d9d130c140 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6440009b60 tx=0x7f6440004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed6b14966c88f17 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:39:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.035+0000 7f6431ffb640 1 -- 172.21.15.80:0/3212528985 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644001e040 con 0x55d9d1302820 2024-04-26T18:39:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.035+0000 7f6431ffb640 1 -- 172.21.15.80:0/3212528985 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f644001f040 con 0x55d9d1302820 2024-04-26T18:39:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.035+0000 7f6431ffb640 1 -- 172.21.15.80:0/3212528985 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6440003d80 con 0x55d9d1302820 2024-04-26T18:39:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.036+0000 7f64553d4740 1 -- 172.21.15.80:0/3212528985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d1302820 msgr2=0x55d9d130c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.036+0000 7f64553d4740 1 --2- 172.21.15.80:0/3212528985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d1302820 0x55d9d130c140 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6440009b60 tx=0x7f6440004840 comp rx=0 tx=0).stop 2024-04-26T18:39:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.036+0000 7f64553d4740 1 -- 172.21.15.80:0/3212528985 shutdown_connections 2024-04-26T18:39:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.036+0000 7f64553d4740 1 --2- 172.21.15.80:0/3212528985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d1302820 0x55d9d130c140 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.036+0000 7f64553d4740 1 --2- 172.21.15.80:0/3212528985 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9d130d0e0 0x55d9d13048c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.036+0000 7f64553d4740 1 --2- 172.21.15.80:0/3212528985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1301f00 0x55d9d1318bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.036+0000 7f64553d4740 1 -- 172.21.15.80:0/3212528985 >> 172.21.15.80:0/3212528985 conn(0x55d9d12fe410 msgr2=0x55d9d12fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:39:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.036+0000 7f64553d4740 1 -- 172.21.15.80:0/3212528985 shutdown_connections 2024-04-26T18:39:08.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.036+0000 7f64553d4740 1 -- 172.21.15.80:0/3212528985 wait complete. 2024-04-26T18:39:08.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.036+0000 7f64553d4740 1 -- start start 2024-04-26T18:39:08.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.037+0000 7f64553d4740 1 Processor -- start 2024-04-26T18:39:08.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.037+0000 7f64553d4740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d1301f00 0x55d9d1306ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:08.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.037+0000 7f64553d4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1302820 0x55d9d1307430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:08.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.037+0000 7f64553d4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9d130d0e0 0x55d9d1307970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:08.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.037+0000 7f64553d4740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f644c1af830 con 0x55d9d1301f00 2024-04-26T18:39:08.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.037+0000 7f64553d4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f644c1af160 con 0x55d9d1302820 2024-04-26T18:39:08.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.037+0000 7f64553d4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f644c1ac3a0 con 0x55d9d130d0e0 2024-04-26T18:39:08.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.037+0000 7f64553d4740 10 client.0 _ll_register_callbacks cb 0x7f6444009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:39:08.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.037+0000 7f644bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d1301f00 0x55d9d1306ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:08.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.037+0000 7f6450b81640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9d130d0e0 0x55d9d1307970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:08.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.037+0000 7f644bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d1301f00 0x55d9d1306ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46958/0 (socket says 172.21.15.80:46958) 2024-04-26T18:39:08.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.037+0000 7f644bfff640 1 -- 172.21.15.80:0/2399378410 learned_addr learned my addr 172.21.15.80:0/2399378410 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:39:08.044 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.037+0000 7f644b7fe640 1 --2- 172.21.15.80:0/2399378410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1302820 0x55d9d1307430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:08.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.037+0000 7f644bfff640 1 -- 172.21.15.80:0/2399378410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9d130d0e0 msgr2=0x55d9d1307970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:39:08.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.037+0000 7f644bfff640 1 --2- 172.21.15.80:0/2399378410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9d130d0e0 0x55d9d1307970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.037+0000 7f644bfff640 1 -- 172.21.15.80:0/2399378410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1302820 msgr2=0x55d9d1307430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:39:08.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.037+0000 7f644bfff640 1 --2- 172.21.15.80:0/2399378410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1302820 0x55d9d1307430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.037+0000 7f644bfff640 1 -- 172.21.15.80:0/2399378410 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9d13829f0 con 0x55d9d1301f00 2024-04-26T18:39:08.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.037+0000 7f6450b81640 1 --2- 172.21.15.80:0/2399378410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9d130d0e0 0x55d9d1307970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:39:08.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.037+0000 7f644b7fe640 1 --2- 172.21.15.80:0/2399378410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1302820 0x55d9d1307430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:39:08.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.037+0000 7f644bfff640 1 --2- 172.21.15.80:0/2399378410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d1301f00 0x55d9d1306ef0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f643c098f20 tx=0x7f643c018420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d971c540160e67 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:39:08.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.037+0000 7f642b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:39:08.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.038+0000 7f642b7fe640 1 -- 172.21.15.80:0/2399378410 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c0a0e10 con 0x55d9d1301f00 2024-04-26T18:39:08.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.038+0000 7f642b7fe640 1 -- 172.21.15.80:0/2399378410 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8440+0+0 (secure 0 0 0) 0x7f643c010a90 con 0x55d9d1301f00 2024-04-26T18:39:08.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.038+0000 7f64553d4740 1 -- 172.21.15.80:0/2399378410 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f644001f040 con 0x55d9d1301f00 2024-04-26T18:39:08.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.038+0000 7f642b7fe640 1 -- 172.21.15.80:0/2399378410 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f643c0a56d0 con 0x55d9d1301f00 2024-04-26T18:39:08.045 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.038+0000 7f64553d4740 10 client.15741 fetch_fsmap learned FSMap version 27 2024-04-26T18:39:08.046 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.038+0000 7f64553d4740 1 -- 172.21.15.80:0/2399378410 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d9d1383d40 con 0x55d9d1301f00 2024-04-26T18:39:08.046 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.038+0000 7f642b7fe640 1 -- 172.21.15.80:0/2399378410 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f644001f040 con 0x55d9d1301f00 2024-04-26T18:39:08.046 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.038+0000 7f642b7fe640 1 -- 172.21.15.80:0/2399378410 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f643c0a5240 con 0x55d9d1301f00 2024-04-26T18:39:08.046 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.038+0000 7f64553d4740 10 client.15741 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T18:39:08.046 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.038+0000 7f64553d4740 10 client.15741 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:39:08.046 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.038+0000 7f64553d4740 20 client.15741 populate_metadata read hostname 'smithi080' 2024-04-26T18:39:08.046 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.038+0000 7f64553d4740 1 --2- 172.21.15.80:0/2399378410 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55d9d1384490 0x55d9d13868b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:08.046 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.038+0000 7f64553d4740 4 client.15741 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:39:08.046 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.038+0000 7f64553d4740 1 -- 172.21.15.80:0/2399378410 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d9d126fee0 con 0x55d9d1384490 2024-04-26T18:39:08.046 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.038+0000 7f644b7fe640 1 --2- 172.21.15.80:0/2399378410 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55d9d1384490 0x55d9d13868b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:08.046 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.039+0000 7f644b7fe640 1 --2- 172.21.15.80:0/2399378410 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55d9d1384490 0x55d9d13868b0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42b46c191b79553f server_cookie=31b58e94c6722c5c in_seq=0 out_seq=0 2024-04-26T18:39:08.046 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.039+0000 7f642b7fe640 10 client.15741 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:39:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.098+0000 7f642b7fe640 1 -- 172.21.15.80:0/2399378410 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d9d126fee0 con 0x55d9d1384490 2024-04-26T18:39:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.098+0000 7f642b7fe640 10 client.15741 handle_command_reply: tid=0 2024-04-26T18:39:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.098+0000 7f64553d4740 1 client.15741 shutdown 2024-04-26T18:39:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.098+0000 7f64553d4740 1 -- 172.21.15.80:0/2399378410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d1301f00 msgr2=0x55d9d1306ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.098+0000 7f64553d4740 1 --2- 172.21.15.80:0/2399378410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d1301f00 0x55d9d1306ef0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f643c098f20 tx=0x7f643c018420 comp rx=0 tx=0).stop 2024-04-26T18:39:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.098+0000 7f64553d4740 1 -- 172.21.15.80:0/2399378410 shutdown_connections 2024-04-26T18:39:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.098+0000 7f64553d4740 1 --2- 172.21.15.80:0/2399378410 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x55d9d1384490 0x55d9d13868b0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.098+0000 7f64553d4740 1 --2- 172.21.15.80:0/2399378410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9d130d0e0 0x55d9d1307970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.098+0000 7f642b7fe640 0 client.15741 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:39:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.098+0000 7f64553d4740 1 --2- 172.21.15.80:0/2399378410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d9d1302820 0x55d9d1307430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.098+0000 7f64553d4740 1 --2- 172.21.15.80:0/2399378410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d9d1301f00 0x55d9d1306ef0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.100 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.098+0000 7f64553d4740 1 -- 172.21.15.80:0/2399378410 >> 172.21.15.80:0/2399378410 conn(0x55d9d12fe410 msgr2=0x55d9d12fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:39:08.100 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.098+0000 7f64553d4740 1 -- 172.21.15.80:0/2399378410 shutdown_connections 2024-04-26T18:39:08.100 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.098+0000 7f64553d4740 1 -- 172.21.15.80:0/2399378410 wait complete. 2024-04-26T18:39:08.100 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.098+0000 7f64553d4740 20 client.15741 trim_cache size 0 max 16384 2024-04-26T18:39:08.100 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:{ 2024-04-26T18:39:08.100 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "message": "", 2024-04-26T18:39:08.100 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "return_code": 0 2024-04-26T18:39:08.100 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:} 2024-04-26T18:39:08.101 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.099+0000 7f64525e4640 1 -- 172.21.15.80:0/237785909 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f64340a3dc0 msgr2=0x7f64340a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:08.101 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.099+0000 7f64525e4640 1 --2- 172.21.15.80:0/237785909 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f64340a3dc0 0x7f64340a6280 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6444005e30 tx=0x7f64440099c0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.101 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.099+0000 7f64525e4640 1 -- 172.21.15.80:0/237785909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f644c103be0 msgr2=0x7f644c198ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:08.101 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.099+0000 7f64525e4640 1 --2- 172.21.15.80:0/237785909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f644c103be0 0x7f644c198ff0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f643c00e9f0 tx=0x7f643c00eeb0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.101 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.099+0000 7f64525e4640 1 -- 172.21.15.80:0/237785909 shutdown_connections 2024-04-26T18:39:08.102 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.099+0000 7f64525e4640 1 --2- 172.21.15.80:0/237785909 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f64340a3dc0 0x7f64340a6280 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.102 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.099+0000 7f64525e4640 1 --2- 172.21.15.80:0/237785909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f644c10cfb0 0x7f644c19d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.102 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.099+0000 7f64525e4640 1 --2- 172.21.15.80:0/237785909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f644c104500 0x7f644c199530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.102 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.099+0000 7f64525e4640 1 --2- 172.21.15.80:0/237785909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f644c103be0 0x7f644c198ff0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:08.102 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.099+0000 7f64525e4640 1 -- 172.21.15.80:0/237785909 >> 172.21.15.80:0/237785909 conn(0x7f644c077bb0 msgr2=0x7f644c0fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:39:08.102 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.099+0000 7f64525e4640 1 -- 172.21.15.80:0/237785909 shutdown_connections 2024-04-26T18:39:08.102 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:08.099+0000 7f64525e4640 1 -- 172.21.15.80:0/237785909 wait complete. 2024-04-26T18:39:08.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:07 smithi192 ceph-mon[32842]: pgmap v82: 97 pgs: 97 active+clean; 183 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 787 KiB/s wr, 2.17k op/s 2024-04-26T18:39:08.447 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4194816 len 4096 2024-04-26T18:39:08.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194816 len 4096 2024-04-26T18:39:08.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4194816 len 8192 2024-04-26T18:39:08.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194816 len 8192 2024-04-26T18:39:08.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4194816 len 8192 2024-04-26T18:39:08.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194816 len 8192 2024-04-26T18:39:08.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4194816 len 16384 2024-04-26T18:39:08.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194816 len 16384 2024-04-26T18:39:08.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4194816 len 16384 2024-04-26T18:39:08.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4194816 len 16384 2024-04-26T18:39:08.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4195328 len 1024 2024-04-26T18:39:08.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195328 len 1024 2024-04-26T18:39:08.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4195328 len 1024 2024-04-26T18:39:08.448 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195328 len 1024 2024-04-26T18:39:08.449 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4195328 len 2048 2024-04-26T18:39:08.449 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195328 len 2048 2024-04-26T18:39:08.449 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4195328 len 2048 2024-04-26T18:39:08.449 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195328 len 2048 2024-04-26T18:39:08.449 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4195328 len 4096 2024-04-26T18:39:08.449 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195328 len 4096 2024-04-26T18:39:08.449 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4195328 len 4096 2024-04-26T18:39:08.449 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195328 len 4096 2024-04-26T18:39:08.449 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4195328 len 8192 2024-04-26T18:39:08.449 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195328 len 8192 2024-04-26T18:39:08.449 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4195328 len 8192 2024-04-26T18:39:08.449 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195328 len 8192 2024-04-26T18:39:08.449 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4195328 len 16384 2024-04-26T18:39:08.449 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195328 len 16384 2024-04-26T18:39:08.449 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4195328 len 16384 2024-04-26T18:39:08.449 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195328 len 16384 2024-04-26T18:39:08.450 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4195840 len 1024 2024-04-26T18:39:08.450 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195840 len 1024 2024-04-26T18:39:08.450 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4195840 len 1024 2024-04-26T18:39:08.450 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195840 len 1024 2024-04-26T18:39:08.450 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4195840 len 2048 2024-04-26T18:39:08.450 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195840 len 2048 2024-04-26T18:39:08.450 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4195840 len 2048 2024-04-26T18:39:08.450 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195840 len 2048 2024-04-26T18:39:08.450 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4195840 len 4096 2024-04-26T18:39:08.450 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195840 len 4096 2024-04-26T18:39:08.450 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4195840 len 4096 2024-04-26T18:39:08.450 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195840 len 4096 2024-04-26T18:39:08.450 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4195840 len 8192 2024-04-26T18:39:08.450 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195840 len 8192 2024-04-26T18:39:08.450 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4195840 len 8192 2024-04-26T18:39:08.451 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195840 len 8192 2024-04-26T18:39:08.451 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4195840 len 16384 2024-04-26T18:39:08.451 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195840 len 16384 2024-04-26T18:39:08.451 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4195840 len 16384 2024-04-26T18:39:08.451 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4195840 len 16384 2024-04-26T18:39:08.451 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4196352 len 1024 2024-04-26T18:39:08.451 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196352 len 1024 2024-04-26T18:39:08.451 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4196352 len 1024 2024-04-26T18:39:08.451 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196352 len 1024 2024-04-26T18:39:08.451 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4196352 len 2048 2024-04-26T18:39:08.451 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196352 len 2048 2024-04-26T18:39:08.451 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4196352 len 2048 2024-04-26T18:39:08.451 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196352 len 2048 2024-04-26T18:39:08.451 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4196352 len 4096 2024-04-26T18:39:08.451 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196352 len 4096 2024-04-26T18:39:08.451 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4196352 len 4096 2024-04-26T18:39:08.452 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196352 len 4096 2024-04-26T18:39:08.452 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4196352 len 8192 2024-04-26T18:39:08.452 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196352 len 8192 2024-04-26T18:39:08.452 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4196352 len 8192 2024-04-26T18:39:08.452 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196352 len 8192 2024-04-26T18:39:08.452 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4196352 len 16384 2024-04-26T18:39:08.452 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196352 len 16384 2024-04-26T18:39:08.452 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4196352 len 16384 2024-04-26T18:39:08.452 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196352 len 16384 2024-04-26T18:39:08.452 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4196864 len 1024 2024-04-26T18:39:08.452 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196864 len 1024 2024-04-26T18:39:08.452 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4196864 len 1024 2024-04-26T18:39:08.452 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196864 len 1024 2024-04-26T18:39:08.452 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4196864 len 2048 2024-04-26T18:39:08.453 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196864 len 2048 2024-04-26T18:39:08.453 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4196864 len 2048 2024-04-26T18:39:08.453 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196864 len 2048 2024-04-26T18:39:08.453 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4196864 len 4096 2024-04-26T18:39:08.453 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196864 len 4096 2024-04-26T18:39:08.453 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4196864 len 4096 2024-04-26T18:39:08.962 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196864 len 4096 2024-04-26T18:39:08.962 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4196864 len 8192 2024-04-26T18:39:08.962 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196864 len 8192 2024-04-26T18:39:08.962 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4196864 len 8192 2024-04-26T18:39:08.962 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196864 len 8192 2024-04-26T18:39:08.963 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4196864 len 16384 2024-04-26T18:39:08.963 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196864 len 16384 2024-04-26T18:39:08.963 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4196864 len 16384 2024-04-26T18:39:08.963 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4196864 len 16384 2024-04-26T18:39:08.963 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4197376 len 1024 2024-04-26T18:39:08.963 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197376 len 1024 2024-04-26T18:39:08.963 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4197376 len 1024 2024-04-26T18:39:08.963 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197376 len 1024 2024-04-26T18:39:08.963 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4197376 len 2048 2024-04-26T18:39:08.963 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197376 len 2048 2024-04-26T18:39:08.963 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4197376 len 2048 2024-04-26T18:39:08.963 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197376 len 2048 2024-04-26T18:39:08.963 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4197376 len 4096 2024-04-26T18:39:08.963 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197376 len 4096 2024-04-26T18:39:08.963 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4197376 len 4096 2024-04-26T18:39:08.964 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197376 len 4096 2024-04-26T18:39:08.964 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4197376 len 8192 2024-04-26T18:39:08.964 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197376 len 8192 2024-04-26T18:39:08.964 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4197376 len 8192 2024-04-26T18:39:08.964 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197376 len 8192 2024-04-26T18:39:08.964 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4197376 len 16384 2024-04-26T18:39:08.964 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197376 len 16384 2024-04-26T18:39:08.964 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4197376 len 16384 2024-04-26T18:39:08.964 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197376 len 16384 2024-04-26T18:39:08.964 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4197888 len 1024 2024-04-26T18:39:08.964 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197888 len 1024 2024-04-26T18:39:08.964 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4197888 len 1024 2024-04-26T18:39:08.964 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197888 len 1024 2024-04-26T18:39:08.964 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4197888 len 2048 2024-04-26T18:39:08.964 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197888 len 2048 2024-04-26T18:39:08.965 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4197888 len 2048 2024-04-26T18:39:08.965 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197888 len 2048 2024-04-26T18:39:08.965 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4197888 len 4096 2024-04-26T18:39:08.965 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197888 len 4096 2024-04-26T18:39:08.965 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4197888 len 4096 2024-04-26T18:39:08.965 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197888 len 4096 2024-04-26T18:39:08.965 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4197888 len 8192 2024-04-26T18:39:08.965 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197888 len 8192 2024-04-26T18:39:08.965 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4197888 len 8192 2024-04-26T18:39:08.965 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197888 len 8192 2024-04-26T18:39:08.965 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1024 offset 4197888 len 16384 2024-04-26T18:39:08.965 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197888 len 16384 2024-04-26T18:39:08.965 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1024 offset 4197888 len 16384 2024-04-26T18:39:08.965 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1024 offset 4197888 len 16384 2024-04-26T18:39:08.966 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4190720 len 1024 2024-04-26T18:39:08.966 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4190720 len 1024 2024-04-26T18:39:08.966 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4190720 len 1024 2024-04-26T18:39:08.966 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4190720 len 1024 2024-04-26T18:39:08.966 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4190720 len 2048 2024-04-26T18:39:08.966 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4190720 len 2048 2024-04-26T18:39:08.966 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4190720 len 2048 2024-04-26T18:39:08.966 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4190720 len 2048 2024-04-26T18:39:08.966 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4190720 len 4096 2024-04-26T18:39:08.966 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4190720 len 4096 2024-04-26T18:39:08.966 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4190720 len 4096 2024-04-26T18:39:08.966 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4190720 len 4096 2024-04-26T18:39:08.966 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4190720 len 8192 2024-04-26T18:39:08.966 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4190720 len 8192 2024-04-26T18:39:08.966 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4190720 len 8192 2024-04-26T18:39:08.967 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4190720 len 8192 2024-04-26T18:39:08.967 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4190720 len 16384 2024-04-26T18:39:08.967 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4190720 len 16384 2024-04-26T18:39:08.967 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4190720 len 16384 2024-04-26T18:39:08.967 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4190720 len 16384 2024-04-26T18:39:08.967 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4191232 len 1024 2024-04-26T18:39:08.967 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191232 len 1024 2024-04-26T18:39:08.967 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4191232 len 1024 2024-04-26T18:39:08.967 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191232 len 1024 2024-04-26T18:39:08.967 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4191232 len 2048 2024-04-26T18:39:08.967 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191232 len 2048 2024-04-26T18:39:08.967 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4191232 len 2048 2024-04-26T18:39:08.967 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191232 len 2048 2024-04-26T18:39:08.967 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4191232 len 4096 2024-04-26T18:39:08.967 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191232 len 4096 2024-04-26T18:39:08.968 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4191232 len 4096 2024-04-26T18:39:08.968 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191232 len 4096 2024-04-26T18:39:08.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:08 smithi082 ceph-mon[32808]: daemon mds.e restarted 2024-04-26T18:39:08.969 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 26 18:39:08 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-e[62895]: ignoring --setuser ceph since I am not root 2024-04-26T18:39:08.969 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 26 18:39:08 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-e[62895]: ignoring --setgroup ceph since I am not root 2024-04-26T18:39:08.970 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 26 18:39:08 smithi082 ceph-mds[62899]: -- 172.21.15.82:0/1449750215 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555cdaf85a40 con 0x555cdaf58c00 2024-04-26T18:39:08.970 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 26 18:39:08 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-e[62895]: starting mds.e at 2024-04-26T18:39:08.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:08 smithi080 ceph-mon[29135]: daemon mds.e restarted 2024-04-26T18:39:09.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:08 smithi192 ceph-mon[32842]: daemon mds.e restarted 2024-04-26T18:39:09.583 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4191232 len 8192 2024-04-26T18:39:09.583 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191232 len 8192 2024-04-26T18:39:09.583 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4191232 len 8192 2024-04-26T18:39:09.583 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191232 len 8192 2024-04-26T18:39:09.583 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4191232 len 16384 2024-04-26T18:39:09.583 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191232 len 16384 2024-04-26T18:39:09.583 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4191232 len 16384 2024-04-26T18:39:09.583 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191232 len 16384 2024-04-26T18:39:09.583 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4191744 len 1024 2024-04-26T18:39:09.583 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191744 len 1024 2024-04-26T18:39:09.583 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4191744 len 1024 2024-04-26T18:39:09.583 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191744 len 1024 2024-04-26T18:39:09.584 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4191744 len 2048 2024-04-26T18:39:09.584 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191744 len 2048 2024-04-26T18:39:09.584 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4191744 len 2048 2024-04-26T18:39:09.584 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191744 len 2048 2024-04-26T18:39:09.584 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4191744 len 4096 2024-04-26T18:39:09.584 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191744 len 4096 2024-04-26T18:39:09.584 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4191744 len 4096 2024-04-26T18:39:09.584 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191744 len 4096 2024-04-26T18:39:09.584 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4191744 len 8192 2024-04-26T18:39:09.584 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191744 len 8192 2024-04-26T18:39:09.584 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4191744 len 8192 2024-04-26T18:39:09.584 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191744 len 8192 2024-04-26T18:39:09.584 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4191744 len 16384 2024-04-26T18:39:09.584 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191744 len 16384 2024-04-26T18:39:09.584 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4191744 len 16384 2024-04-26T18:39:09.585 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4191744 len 16384 2024-04-26T18:39:09.585 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4192256 len 1024 2024-04-26T18:39:09.585 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192256 len 1024 2024-04-26T18:39:09.585 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4192256 len 1024 2024-04-26T18:39:09.585 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192256 len 1024 2024-04-26T18:39:09.585 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4192256 len 2048 2024-04-26T18:39:09.585 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192256 len 2048 2024-04-26T18:39:09.585 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4192256 len 2048 2024-04-26T18:39:09.585 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192256 len 2048 2024-04-26T18:39:09.585 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4192256 len 4096 2024-04-26T18:39:09.585 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192256 len 4096 2024-04-26T18:39:09.585 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4192256 len 4096 2024-04-26T18:39:09.585 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192256 len 4096 2024-04-26T18:39:09.586 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4192256 len 8192 2024-04-26T18:39:09.586 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192256 len 8192 2024-04-26T18:39:09.586 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4192256 len 8192 2024-04-26T18:39:09.586 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192256 len 8192 2024-04-26T18:39:09.586 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4192256 len 16384 2024-04-26T18:39:09.586 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192256 len 16384 2024-04-26T18:39:09.586 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4192256 len 16384 2024-04-26T18:39:09.586 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192256 len 16384 2024-04-26T18:39:09.586 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4192768 len 1024 2024-04-26T18:39:09.586 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192768 len 1024 2024-04-26T18:39:09.586 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4192768 len 1024 2024-04-26T18:39:09.586 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192768 len 1024 2024-04-26T18:39:09.586 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4192768 len 2048 2024-04-26T18:39:09.587 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192768 len 2048 2024-04-26T18:39:09.587 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4192768 len 2048 2024-04-26T18:39:09.587 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192768 len 2048 2024-04-26T18:39:09.587 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4192768 len 4096 2024-04-26T18:39:09.587 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192768 len 4096 2024-04-26T18:39:09.587 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4192768 len 4096 2024-04-26T18:39:09.587 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192768 len 4096 2024-04-26T18:39:09.587 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4192768 len 8192 2024-04-26T18:39:09.587 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192768 len 8192 2024-04-26T18:39:09.587 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4192768 len 8192 2024-04-26T18:39:09.587 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192768 len 8192 2024-04-26T18:39:09.587 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4192768 len 16384 2024-04-26T18:39:09.587 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192768 len 16384 2024-04-26T18:39:09.587 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4192768 len 16384 2024-04-26T18:39:09.588 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4192768 len 16384 2024-04-26T18:39:09.588 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4193280 len 1024 2024-04-26T18:39:09.588 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193280 len 1024 2024-04-26T18:39:09.588 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4193280 len 1024 2024-04-26T18:39:09.588 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193280 len 1024 2024-04-26T18:39:09.588 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4193280 len 2048 2024-04-26T18:39:09.588 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193280 len 2048 2024-04-26T18:39:09.588 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4193280 len 2048 2024-04-26T18:39:09.588 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193280 len 2048 2024-04-26T18:39:09.588 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4193280 len 4096 2024-04-26T18:39:09.588 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193280 len 4096 2024-04-26T18:39:09.588 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4193280 len 4096 2024-04-26T18:39:09.588 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193280 len 4096 2024-04-26T18:39:09.588 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4193280 len 8192 2024-04-26T18:39:09.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:09 smithi082 ceph-mon[32808]: pgmap v83: 97 pgs: 97 active+clean; 183 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 787 KiB/s wr, 2.17k op/s 2024-04-26T18:39:09.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:09 smithi082 ceph-mon[32808]: osdmap e93: 12 total, 12 up, 12 in 2024-04-26T18:39:09.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:09 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.82:6834/1661640740,v1:172.21.15.82:6835/1661640740] up:boot 2024-04-26T18:39:09.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:09 smithi082 ceph-mon[32808]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-04-26T18:39:09.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:09 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T18:39:09.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:09 smithi082 ceph-mon[32808]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T18:39:09.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:09 smithi080 ceph-mon[29135]: pgmap v83: 97 pgs: 97 active+clean; 183 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 787 KiB/s wr, 2.17k op/s 2024-04-26T18:39:09.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:09 smithi080 ceph-mon[29135]: osdmap e93: 12 total, 12 up, 12 in 2024-04-26T18:39:09.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:09 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.82:6834/1661640740,v1:172.21.15.82:6835/1661640740] up:boot 2024-04-26T18:39:09.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:09 smithi080 ceph-mon[29135]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-04-26T18:39:09.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:09 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T18:39:09.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:09 smithi080 ceph-mon[29135]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T18:39:10.071 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193280 len 8192 2024-04-26T18:39:10.071 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4193280 len 8192 2024-04-26T18:39:10.071 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193280 len 8192 2024-04-26T18:39:10.071 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4193280 len 16384 2024-04-26T18:39:10.071 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193280 len 16384 2024-04-26T18:39:10.071 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4193280 len 16384 2024-04-26T18:39:10.071 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193280 len 16384 2024-04-26T18:39:10.071 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4193792 len 1024 2024-04-26T18:39:10.071 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193792 len 1024 2024-04-26T18:39:10.071 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4193792 len 1024 2024-04-26T18:39:10.071 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193792 len 1024 2024-04-26T18:39:10.071 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4193792 len 2048 2024-04-26T18:39:10.072 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193792 len 2048 2024-04-26T18:39:10.072 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4193792 len 2048 2024-04-26T18:39:10.072 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193792 len 2048 2024-04-26T18:39:10.072 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4193792 len 4096 2024-04-26T18:39:10.072 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193792 len 4096 2024-04-26T18:39:10.072 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4193792 len 4096 2024-04-26T18:39:10.072 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193792 len 4096 2024-04-26T18:39:10.072 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4193792 len 8192 2024-04-26T18:39:10.072 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193792 len 8192 2024-04-26T18:39:10.072 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4193792 len 8192 2024-04-26T18:39:10.072 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193792 len 8192 2024-04-26T18:39:10.072 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4193792 len 16384 2024-04-26T18:39:10.072 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193792 len 16384 2024-04-26T18:39:10.072 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4193792 len 16384 2024-04-26T18:39:10.072 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4193792 len 16384 2024-04-26T18:39:10.072 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4194304 len 1024 2024-04-26T18:39:10.073 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194304 len 1024 2024-04-26T18:39:10.073 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4194304 len 1024 2024-04-26T18:39:10.073 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194304 len 1024 2024-04-26T18:39:10.073 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4194304 len 2048 2024-04-26T18:39:10.073 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194304 len 2048 2024-04-26T18:39:10.073 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4194304 len 2048 2024-04-26T18:39:10.073 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194304 len 2048 2024-04-26T18:39:10.073 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4194304 len 4096 2024-04-26T18:39:10.073 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194304 len 4096 2024-04-26T18:39:10.073 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4194304 len 4096 2024-04-26T18:39:10.073 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194304 len 4096 2024-04-26T18:39:10.073 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4194304 len 8192 2024-04-26T18:39:10.073 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194304 len 8192 2024-04-26T18:39:10.073 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4194304 len 8192 2024-04-26T18:39:10.073 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194304 len 8192 2024-04-26T18:39:10.073 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4194304 len 16384 2024-04-26T18:39:10.073 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194304 len 16384 2024-04-26T18:39:10.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4194304 len 16384 2024-04-26T18:39:10.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194304 len 16384 2024-04-26T18:39:10.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4194816 len 1024 2024-04-26T18:39:10.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194816 len 1024 2024-04-26T18:39:10.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4194816 len 1024 2024-04-26T18:39:10.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194816 len 1024 2024-04-26T18:39:10.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4194816 len 2048 2024-04-26T18:39:10.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194816 len 2048 2024-04-26T18:39:10.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4194816 len 2048 2024-04-26T18:39:10.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194816 len 2048 2024-04-26T18:39:10.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4194816 len 4096 2024-04-26T18:39:10.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194816 len 4096 2024-04-26T18:39:10.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4194816 len 4096 2024-04-26T18:39:10.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194816 len 4096 2024-04-26T18:39:10.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4194816 len 8192 2024-04-26T18:39:10.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194816 len 8192 2024-04-26T18:39:10.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4194816 len 8192 2024-04-26T18:39:10.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194816 len 8192 2024-04-26T18:39:10.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4194816 len 16384 2024-04-26T18:39:10.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194816 len 16384 2024-04-26T18:39:10.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4194816 len 16384 2024-04-26T18:39:10.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4194816 len 16384 2024-04-26T18:39:10.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4195328 len 1024 2024-04-26T18:39:10.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195328 len 1024 2024-04-26T18:39:10.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4195328 len 1024 2024-04-26T18:39:10.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195328 len 1024 2024-04-26T18:39:10.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4195328 len 2048 2024-04-26T18:39:10.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195328 len 2048 2024-04-26T18:39:10.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4195328 len 2048 2024-04-26T18:39:10.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195328 len 2048 2024-04-26T18:39:10.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4195328 len 4096 2024-04-26T18:39:10.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195328 len 4096 2024-04-26T18:39:10.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4195328 len 4096 2024-04-26T18:39:10.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195328 len 4096 2024-04-26T18:39:10.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4195328 len 8192 2024-04-26T18:39:10.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:09 smithi192 ceph-mon[32842]: pgmap v83: 97 pgs: 97 active+clean; 183 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 787 KiB/s wr, 2.17k op/s 2024-04-26T18:39:10.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:09 smithi192 ceph-mon[32842]: osdmap e93: 12 total, 12 up, 12 in 2024-04-26T18:39:10.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:09 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.82:6834/1661640740,v1:172.21.15.82:6835/1661640740] up:boot 2024-04-26T18:39:10.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:09 smithi192 ceph-mon[32842]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-04-26T18:39:10.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:09 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T18:39:10.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:09 smithi192 ceph-mon[32842]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T18:39:10.434 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195328 len 8192 2024-04-26T18:39:10.434 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4195328 len 8192 2024-04-26T18:39:10.434 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195328 len 8192 2024-04-26T18:39:10.434 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4195328 len 16384 2024-04-26T18:39:10.435 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195328 len 16384 2024-04-26T18:39:10.435 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4195328 len 16384 2024-04-26T18:39:10.435 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195328 len 16384 2024-04-26T18:39:10.435 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4195840 len 1024 2024-04-26T18:39:10.435 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195840 len 1024 2024-04-26T18:39:10.435 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4195840 len 1024 2024-04-26T18:39:10.435 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195840 len 1024 2024-04-26T18:39:10.435 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4195840 len 2048 2024-04-26T18:39:10.435 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195840 len 2048 2024-04-26T18:39:10.435 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4195840 len 2048 2024-04-26T18:39:10.435 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195840 len 2048 2024-04-26T18:39:10.435 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4195840 len 4096 2024-04-26T18:39:10.435 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195840 len 4096 2024-04-26T18:39:10.435 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4195840 len 4096 2024-04-26T18:39:10.436 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195840 len 4096 2024-04-26T18:39:10.436 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4195840 len 8192 2024-04-26T18:39:10.436 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195840 len 8192 2024-04-26T18:39:10.436 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4195840 len 8192 2024-04-26T18:39:10.436 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195840 len 8192 2024-04-26T18:39:10.436 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4195840 len 16384 2024-04-26T18:39:10.436 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195840 len 16384 2024-04-26T18:39:10.436 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4195840 len 16384 2024-04-26T18:39:10.436 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4195840 len 16384 2024-04-26T18:39:10.436 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4196352 len 1024 2024-04-26T18:39:10.436 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196352 len 1024 2024-04-26T18:39:10.436 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4196352 len 1024 2024-04-26T18:39:10.436 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196352 len 1024 2024-04-26T18:39:10.436 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4196352 len 2048 2024-04-26T18:39:10.436 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196352 len 2048 2024-04-26T18:39:10.437 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4196352 len 2048 2024-04-26T18:39:10.437 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196352 len 2048 2024-04-26T18:39:10.437 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4196352 len 4096 2024-04-26T18:39:10.437 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196352 len 4096 2024-04-26T18:39:10.437 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4196352 len 4096 2024-04-26T18:39:10.437 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196352 len 4096 2024-04-26T18:39:10.437 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4196352 len 8192 2024-04-26T18:39:10.437 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196352 len 8192 2024-04-26T18:39:10.437 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4196352 len 8192 2024-04-26T18:39:10.437 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196352 len 8192 2024-04-26T18:39:10.437 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4196352 len 16384 2024-04-26T18:39:10.437 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196352 len 16384 2024-04-26T18:39:10.437 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4196352 len 16384 2024-04-26T18:39:10.437 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196352 len 16384 2024-04-26T18:39:10.437 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4196864 len 1024 2024-04-26T18:39:10.438 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196864 len 1024 2024-04-26T18:39:10.438 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4196864 len 1024 2024-04-26T18:39:10.438 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196864 len 1024 2024-04-26T18:39:10.438 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4196864 len 2048 2024-04-26T18:39:10.438 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196864 len 2048 2024-04-26T18:39:10.438 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4196864 len 2048 2024-04-26T18:39:10.438 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196864 len 2048 2024-04-26T18:39:10.438 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4196864 len 4096 2024-04-26T18:39:10.438 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196864 len 4096 2024-04-26T18:39:10.438 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4196864 len 4096 2024-04-26T18:39:10.438 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196864 len 4096 2024-04-26T18:39:10.438 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4196864 len 8192 2024-04-26T18:39:10.438 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196864 len 8192 2024-04-26T18:39:10.438 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4196864 len 8192 2024-04-26T18:39:10.438 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196864 len 8192 2024-04-26T18:39:10.439 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4196864 len 16384 2024-04-26T18:39:10.439 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196864 len 16384 2024-04-26T18:39:10.439 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4196864 len 16384 2024-04-26T18:39:10.439 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4196864 len 16384 2024-04-26T18:39:10.439 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4197376 len 1024 2024-04-26T18:39:10.439 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197376 len 1024 2024-04-26T18:39:10.439 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4197376 len 1024 2024-04-26T18:39:10.439 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197376 len 1024 2024-04-26T18:39:10.439 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4197376 len 2048 2024-04-26T18:39:10.439 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197376 len 2048 2024-04-26T18:39:10.439 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4197376 len 2048 2024-04-26T18:39:10.439 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197376 len 2048 2024-04-26T18:39:10.439 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4197376 len 4096 2024-04-26T18:39:10.439 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197376 len 4096 2024-04-26T18:39:10.439 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4197376 len 4096 2024-04-26T18:39:10.440 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197376 len 4096 2024-04-26T18:39:10.440 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4197376 len 8192 2024-04-26T18:39:10.440 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197376 len 8192 2024-04-26T18:39:11.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4197376 len 8192 2024-04-26T18:39:11.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197376 len 8192 2024-04-26T18:39:11.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4197376 len 16384 2024-04-26T18:39:11.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197376 len 16384 2024-04-26T18:39:11.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4197376 len 16384 2024-04-26T18:39:11.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197376 len 16384 2024-04-26T18:39:11.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4197888 len 1024 2024-04-26T18:39:11.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197888 len 1024 2024-04-26T18:39:11.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4197888 len 1024 2024-04-26T18:39:11.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197888 len 1024 2024-04-26T18:39:11.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4197888 len 2048 2024-04-26T18:39:11.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197888 len 2048 2024-04-26T18:39:11.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4197888 len 2048 2024-04-26T18:39:11.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197888 len 2048 2024-04-26T18:39:11.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4197888 len 4096 2024-04-26T18:39:11.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197888 len 4096 2024-04-26T18:39:11.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4197888 len 4096 2024-04-26T18:39:11.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197888 len 4096 2024-04-26T18:39:11.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4197888 len 8192 2024-04-26T18:39:11.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197888 len 8192 2024-04-26T18:39:11.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4197888 len 8192 2024-04-26T18:39:11.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197888 len 8192 2024-04-26T18:39:11.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 1536 offset 4197888 len 16384 2024-04-26T18:39:11.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197888 len 16384 2024-04-26T18:39:11.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 1536 offset 4197888 len 16384 2024-04-26T18:39:11.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 1536 offset 4197888 len 16384 2024-04-26T18:39:11.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4190720 len 1024 2024-04-26T18:39:11.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4190720 len 1024 2024-04-26T18:39:11.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4190720 len 1024 2024-04-26T18:39:11.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4190720 len 1024 2024-04-26T18:39:11.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4190720 len 2048 2024-04-26T18:39:11.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4190720 len 2048 2024-04-26T18:39:11.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4190720 len 2048 2024-04-26T18:39:11.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4190720 len 2048 2024-04-26T18:39:11.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4190720 len 4096 2024-04-26T18:39:11.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4190720 len 4096 2024-04-26T18:39:11.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4190720 len 4096 2024-04-26T18:39:11.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4190720 len 4096 2024-04-26T18:39:11.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4190720 len 8192 2024-04-26T18:39:11.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4190720 len 8192 2024-04-26T18:39:11.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4190720 len 8192 2024-04-26T18:39:11.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4190720 len 8192 2024-04-26T18:39:11.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4190720 len 16384 2024-04-26T18:39:11.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4190720 len 16384 2024-04-26T18:39:11.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4190720 len 16384 2024-04-26T18:39:11.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4190720 len 16384 2024-04-26T18:39:11.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4191232 len 1024 2024-04-26T18:39:11.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191232 len 1024 2024-04-26T18:39:11.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4191232 len 1024 2024-04-26T18:39:11.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191232 len 1024 2024-04-26T18:39:11.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4191232 len 2048 2024-04-26T18:39:11.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191232 len 2048 2024-04-26T18:39:11.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4191232 len 2048 2024-04-26T18:39:11.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191232 len 2048 2024-04-26T18:39:11.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4191232 len 4096 2024-04-26T18:39:11.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191232 len 4096 2024-04-26T18:39:11.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4191232 len 4096 2024-04-26T18:39:11.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191232 len 4096 2024-04-26T18:39:11.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4191232 len 8192 2024-04-26T18:39:11.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191232 len 8192 2024-04-26T18:39:11.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4191232 len 8192 2024-04-26T18:39:11.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191232 len 8192 2024-04-26T18:39:11.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4191232 len 16384 2024-04-26T18:39:11.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191232 len 16384 2024-04-26T18:39:11.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4191232 len 16384 2024-04-26T18:39:11.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191232 len 16384 2024-04-26T18:39:11.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4191744 len 1024 2024-04-26T18:39:11.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191744 len 1024 2024-04-26T18:39:11.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4191744 len 1024 2024-04-26T18:39:11.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191744 len 1024 2024-04-26T18:39:11.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4191744 len 2048 2024-04-26T18:39:11.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191744 len 2048 2024-04-26T18:39:11.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4191744 len 2048 2024-04-26T18:39:11.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191744 len 2048 2024-04-26T18:39:11.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4191744 len 4096 2024-04-26T18:39:11.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191744 len 4096 2024-04-26T18:39:11.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4191744 len 4096 2024-04-26T18:39:11.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191744 len 4096 2024-04-26T18:39:11.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4191744 len 8192 2024-04-26T18:39:11.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191744 len 8192 2024-04-26T18:39:11.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4191744 len 8192 2024-04-26T18:39:11.671 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191744 len 8192 2024-04-26T18:39:11.671 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4191744 len 16384 2024-04-26T18:39:11.671 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191744 len 16384 2024-04-26T18:39:11.671 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4191744 len 16384 2024-04-26T18:39:11.671 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4191744 len 16384 2024-04-26T18:39:11.671 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4192256 len 1024 2024-04-26T18:39:11.671 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192256 len 1024 2024-04-26T18:39:11.671 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4192256 len 1024 2024-04-26T18:39:11.671 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192256 len 1024 2024-04-26T18:39:11.671 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4192256 len 2048 2024-04-26T18:39:11.671 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192256 len 2048 2024-04-26T18:39:11.672 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4192256 len 2048 2024-04-26T18:39:11.672 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192256 len 2048 2024-04-26T18:39:11.672 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4192256 len 4096 2024-04-26T18:39:11.672 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192256 len 4096 2024-04-26T18:39:11.672 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4192256 len 4096 2024-04-26T18:39:11.672 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192256 len 4096 2024-04-26T18:39:11.672 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4192256 len 8192 2024-04-26T18:39:11.672 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192256 len 8192 2024-04-26T18:39:11.672 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4192256 len 8192 2024-04-26T18:39:11.672 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192256 len 8192 2024-04-26T18:39:11.672 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4192256 len 16384 2024-04-26T18:39:11.672 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192256 len 16384 2024-04-26T18:39:11.672 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4192256 len 16384 2024-04-26T18:39:11.672 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192256 len 16384 2024-04-26T18:39:11.672 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4192768 len 1024 2024-04-26T18:39:11.672 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192768 len 1024 2024-04-26T18:39:11.673 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4192768 len 1024 2024-04-26T18:39:11.673 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192768 len 1024 2024-04-26T18:39:11.673 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4192768 len 2048 2024-04-26T18:39:11.673 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192768 len 2048 2024-04-26T18:39:11.673 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4192768 len 2048 2024-04-26T18:39:11.673 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192768 len 2048 2024-04-26T18:39:11.673 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4192768 len 4096 2024-04-26T18:39:11.673 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192768 len 4096 2024-04-26T18:39:11.673 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4192768 len 4096 2024-04-26T18:39:11.673 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192768 len 4096 2024-04-26T18:39:11.673 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4192768 len 8192 2024-04-26T18:39:11.673 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192768 len 8192 2024-04-26T18:39:11.673 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4192768 len 8192 2024-04-26T18:39:11.673 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192768 len 8192 2024-04-26T18:39:11.674 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4192768 len 16384 2024-04-26T18:39:11.674 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192768 len 16384 2024-04-26T18:39:11.674 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4192768 len 16384 2024-04-26T18:39:11.674 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4192768 len 16384 2024-04-26T18:39:11.674 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4193280 len 1024 2024-04-26T18:39:11.674 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193280 len 1024 2024-04-26T18:39:11.674 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4193280 len 1024 2024-04-26T18:39:11.674 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193280 len 1024 2024-04-26T18:39:11.674 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4193280 len 2048 2024-04-26T18:39:11.674 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193280 len 2048 2024-04-26T18:39:11.674 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4193280 len 2048 2024-04-26T18:39:11.674 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193280 len 2048 2024-04-26T18:39:11.674 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4193280 len 4096 2024-04-26T18:39:11.674 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193280 len 4096 2024-04-26T18:39:11.675 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4193280 len 4096 2024-04-26T18:39:11.675 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193280 len 4096 2024-04-26T18:39:11.675 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4193280 len 8192 2024-04-26T18:39:11.675 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193280 len 8192 2024-04-26T18:39:11.675 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4193280 len 8192 2024-04-26T18:39:11.675 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193280 len 8192 2024-04-26T18:39:11.675 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4193280 len 16384 2024-04-26T18:39:11.675 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193280 len 16384 2024-04-26T18:39:11.675 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4193280 len 16384 2024-04-26T18:39:11.675 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193280 len 16384 2024-04-26T18:39:11.675 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4193792 len 1024 2024-04-26T18:39:11.675 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193792 len 1024 2024-04-26T18:39:11.675 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4193792 len 1024 2024-04-26T18:39:11.676 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193792 len 1024 2024-04-26T18:39:11.676 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4193792 len 2048 2024-04-26T18:39:11.676 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193792 len 2048 2024-04-26T18:39:11.676 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4193792 len 2048 2024-04-26T18:39:11.676 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193792 len 2048 2024-04-26T18:39:11.676 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4193792 len 4096 2024-04-26T18:39:11.676 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193792 len 4096 2024-04-26T18:39:11.676 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4193792 len 4096 2024-04-26T18:39:11.676 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193792 len 4096 2024-04-26T18:39:11.676 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4193792 len 8192 2024-04-26T18:39:11.676 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193792 len 8192 2024-04-26T18:39:11.676 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4193792 len 8192 2024-04-26T18:39:11.676 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193792 len 8192 2024-04-26T18:39:11.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:11 smithi082 ceph-mon[32808]: pgmap v85: 97 pgs: 97 active+clean; 360 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 90 MiB/s rd, 1.7 MiB/s wr, 1.19k op/s 2024-04-26T18:39:11.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:11 smithi080 ceph-mon[29135]: pgmap v85: 97 pgs: 97 active+clean; 360 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 90 MiB/s rd, 1.7 MiB/s wr, 1.19k op/s 2024-04-26T18:39:12.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4193792 len 16384 2024-04-26T18:39:12.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193792 len 16384 2024-04-26T18:39:12.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4193792 len 16384 2024-04-26T18:39:12.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4193792 len 16384 2024-04-26T18:39:12.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4194304 len 1024 2024-04-26T18:39:12.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194304 len 1024 2024-04-26T18:39:12.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4194304 len 1024 2024-04-26T18:39:12.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194304 len 1024 2024-04-26T18:39:12.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4194304 len 2048 2024-04-26T18:39:12.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194304 len 2048 2024-04-26T18:39:12.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4194304 len 2048 2024-04-26T18:39:12.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194304 len 2048 2024-04-26T18:39:12.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4194304 len 4096 2024-04-26T18:39:12.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194304 len 4096 2024-04-26T18:39:12.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4194304 len 4096 2024-04-26T18:39:12.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194304 len 4096 2024-04-26T18:39:12.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4194304 len 8192 2024-04-26T18:39:12.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194304 len 8192 2024-04-26T18:39:12.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4194304 len 8192 2024-04-26T18:39:12.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194304 len 8192 2024-04-26T18:39:12.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4194304 len 16384 2024-04-26T18:39:12.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194304 len 16384 2024-04-26T18:39:12.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4194304 len 16384 2024-04-26T18:39:12.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194304 len 16384 2024-04-26T18:39:12.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4194816 len 1024 2024-04-26T18:39:12.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194816 len 1024 2024-04-26T18:39:12.028 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4194816 len 1024 2024-04-26T18:39:12.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194816 len 1024 2024-04-26T18:39:12.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4194816 len 2048 2024-04-26T18:39:12.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194816 len 2048 2024-04-26T18:39:12.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4194816 len 2048 2024-04-26T18:39:12.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194816 len 2048 2024-04-26T18:39:12.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4194816 len 4096 2024-04-26T18:39:12.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194816 len 4096 2024-04-26T18:39:12.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4194816 len 4096 2024-04-26T18:39:12.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194816 len 4096 2024-04-26T18:39:12.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4194816 len 8192 2024-04-26T18:39:12.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194816 len 8192 2024-04-26T18:39:12.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4194816 len 8192 2024-04-26T18:39:12.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194816 len 8192 2024-04-26T18:39:12.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4194816 len 16384 2024-04-26T18:39:12.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194816 len 16384 2024-04-26T18:39:12.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4194816 len 16384 2024-04-26T18:39:12.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4194816 len 16384 2024-04-26T18:39:12.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4195328 len 1024 2024-04-26T18:39:12.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195328 len 1024 2024-04-26T18:39:12.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4195328 len 1024 2024-04-26T18:39:12.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195328 len 1024 2024-04-26T18:39:12.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4195328 len 2048 2024-04-26T18:39:12.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195328 len 2048 2024-04-26T18:39:12.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4195328 len 2048 2024-04-26T18:39:12.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195328 len 2048 2024-04-26T18:39:12.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4195328 len 4096 2024-04-26T18:39:12.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195328 len 4096 2024-04-26T18:39:12.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4195328 len 4096 2024-04-26T18:39:12.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195328 len 4096 2024-04-26T18:39:12.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4195328 len 8192 2024-04-26T18:39:12.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195328 len 8192 2024-04-26T18:39:12.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4195328 len 8192 2024-04-26T18:39:12.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195328 len 8192 2024-04-26T18:39:12.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4195328 len 16384 2024-04-26T18:39:12.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195328 len 16384 2024-04-26T18:39:12.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4195328 len 16384 2024-04-26T18:39:12.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195328 len 16384 2024-04-26T18:39:12.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4195840 len 1024 2024-04-26T18:39:12.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195840 len 1024 2024-04-26T18:39:12.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4195840 len 1024 2024-04-26T18:39:12.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195840 len 1024 2024-04-26T18:39:12.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4195840 len 2048 2024-04-26T18:39:12.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195840 len 2048 2024-04-26T18:39:12.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4195840 len 2048 2024-04-26T18:39:12.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195840 len 2048 2024-04-26T18:39:12.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4195840 len 4096 2024-04-26T18:39:12.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195840 len 4096 2024-04-26T18:39:12.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4195840 len 4096 2024-04-26T18:39:12.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195840 len 4096 2024-04-26T18:39:12.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4195840 len 8192 2024-04-26T18:39:12.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195840 len 8192 2024-04-26T18:39:12.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4195840 len 8192 2024-04-26T18:39:12.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195840 len 8192 2024-04-26T18:39:12.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:11 smithi192 ceph-mon[32842]: pgmap v85: 97 pgs: 97 active+clean; 360 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 90 MiB/s rd, 1.7 MiB/s wr, 1.19k op/s 2024-04-26T18:39:12.401 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4195840 len 16384 2024-04-26T18:39:12.401 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195840 len 16384 2024-04-26T18:39:12.401 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4195840 len 16384 2024-04-26T18:39:12.401 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4195840 len 16384 2024-04-26T18:39:12.401 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4196352 len 1024 2024-04-26T18:39:12.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196352 len 1024 2024-04-26T18:39:12.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4196352 len 1024 2024-04-26T18:39:12.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196352 len 1024 2024-04-26T18:39:12.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4196352 len 2048 2024-04-26T18:39:12.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196352 len 2048 2024-04-26T18:39:12.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4196352 len 2048 2024-04-26T18:39:12.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196352 len 2048 2024-04-26T18:39:12.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4196352 len 4096 2024-04-26T18:39:12.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196352 len 4096 2024-04-26T18:39:12.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4196352 len 4096 2024-04-26T18:39:12.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196352 len 4096 2024-04-26T18:39:12.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4196352 len 8192 2024-04-26T18:39:12.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196352 len 8192 2024-04-26T18:39:12.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4196352 len 8192 2024-04-26T18:39:12.402 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196352 len 8192 2024-04-26T18:39:12.403 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4196352 len 16384 2024-04-26T18:39:12.403 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196352 len 16384 2024-04-26T18:39:12.403 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4196352 len 16384 2024-04-26T18:39:12.403 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196352 len 16384 2024-04-26T18:39:12.403 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4196864 len 1024 2024-04-26T18:39:12.403 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196864 len 1024 2024-04-26T18:39:12.403 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4196864 len 1024 2024-04-26T18:39:12.403 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196864 len 1024 2024-04-26T18:39:12.403 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4196864 len 2048 2024-04-26T18:39:12.403 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196864 len 2048 2024-04-26T18:39:12.403 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4196864 len 2048 2024-04-26T18:39:12.403 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196864 len 2048 2024-04-26T18:39:12.403 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4196864 len 4096 2024-04-26T18:39:12.403 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196864 len 4096 2024-04-26T18:39:12.403 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4196864 len 4096 2024-04-26T18:39:12.404 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196864 len 4096 2024-04-26T18:39:12.404 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4196864 len 8192 2024-04-26T18:39:12.404 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196864 len 8192 2024-04-26T18:39:12.404 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4196864 len 8192 2024-04-26T18:39:12.404 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196864 len 8192 2024-04-26T18:39:12.404 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4196864 len 16384 2024-04-26T18:39:12.404 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196864 len 16384 2024-04-26T18:39:12.404 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4196864 len 16384 2024-04-26T18:39:12.404 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4196864 len 16384 2024-04-26T18:39:12.404 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4197376 len 1024 2024-04-26T18:39:12.404 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197376 len 1024 2024-04-26T18:39:12.404 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4197376 len 1024 2024-04-26T18:39:12.404 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197376 len 1024 2024-04-26T18:39:12.404 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4197376 len 2048 2024-04-26T18:39:12.404 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197376 len 2048 2024-04-26T18:39:12.404 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4197376 len 2048 2024-04-26T18:39:12.405 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197376 len 2048 2024-04-26T18:39:12.405 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4197376 len 4096 2024-04-26T18:39:12.405 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197376 len 4096 2024-04-26T18:39:12.405 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4197376 len 4096 2024-04-26T18:39:12.405 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197376 len 4096 2024-04-26T18:39:12.405 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4197376 len 8192 2024-04-26T18:39:12.405 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197376 len 8192 2024-04-26T18:39:12.405 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4197376 len 8192 2024-04-26T18:39:12.405 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197376 len 8192 2024-04-26T18:39:12.405 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4197376 len 16384 2024-04-26T18:39:12.405 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197376 len 16384 2024-04-26T18:39:12.405 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4197376 len 16384 2024-04-26T18:39:12.405 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197376 len 16384 2024-04-26T18:39:12.405 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4197888 len 1024 2024-04-26T18:39:12.405 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197888 len 1024 2024-04-26T18:39:12.405 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4197888 len 1024 2024-04-26T18:39:12.406 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197888 len 1024 2024-04-26T18:39:12.406 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4197888 len 2048 2024-04-26T18:39:12.406 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197888 len 2048 2024-04-26T18:39:12.406 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4197888 len 2048 2024-04-26T18:39:12.406 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197888 len 2048 2024-04-26T18:39:12.406 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4197888 len 4096 2024-04-26T18:39:12.406 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197888 len 4096 2024-04-26T18:39:12.406 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4197888 len 4096 2024-04-26T18:39:12.406 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197888 len 4096 2024-04-26T18:39:12.406 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4197888 len 8192 2024-04-26T18:39:12.406 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197888 len 8192 2024-04-26T18:39:12.406 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4197888 len 8192 2024-04-26T18:39:12.407 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197888 len 8192 2024-04-26T18:39:12.407 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2048 offset 4197888 len 16384 2024-04-26T18:39:13.014 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197888 len 16384 2024-04-26T18:39:13.015 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2048 offset 4197888 len 16384 2024-04-26T18:39:13.015 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2048 offset 4197888 len 16384 2024-04-26T18:39:13.015 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4190720 len 1024 2024-04-26T18:39:13.015 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4190720 len 1024 2024-04-26T18:39:13.015 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4190720 len 1024 2024-04-26T18:39:13.015 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4190720 len 1024 2024-04-26T18:39:13.015 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4190720 len 2048 2024-04-26T18:39:13.015 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4190720 len 2048 2024-04-26T18:39:13.015 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4190720 len 2048 2024-04-26T18:39:13.015 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4190720 len 2048 2024-04-26T18:39:13.015 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4190720 len 4096 2024-04-26T18:39:13.015 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4190720 len 4096 2024-04-26T18:39:13.015 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4190720 len 4096 2024-04-26T18:39:13.015 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4190720 len 4096 2024-04-26T18:39:13.016 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4190720 len 8192 2024-04-26T18:39:13.016 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4190720 len 8192 2024-04-26T18:39:13.016 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4190720 len 8192 2024-04-26T18:39:13.016 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4190720 len 8192 2024-04-26T18:39:13.016 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4190720 len 16384 2024-04-26T18:39:13.016 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4190720 len 16384 2024-04-26T18:39:13.016 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4190720 len 16384 2024-04-26T18:39:13.016 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4190720 len 16384 2024-04-26T18:39:13.016 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4191232 len 1024 2024-04-26T18:39:13.016 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191232 len 1024 2024-04-26T18:39:13.016 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4191232 len 1024 2024-04-26T18:39:13.016 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191232 len 1024 2024-04-26T18:39:13.016 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4191232 len 2048 2024-04-26T18:39:13.016 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191232 len 2048 2024-04-26T18:39:13.016 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4191232 len 2048 2024-04-26T18:39:13.017 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191232 len 2048 2024-04-26T18:39:13.017 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4191232 len 4096 2024-04-26T18:39:13.017 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191232 len 4096 2024-04-26T18:39:13.017 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4191232 len 4096 2024-04-26T18:39:13.017 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191232 len 4096 2024-04-26T18:39:13.017 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4191232 len 8192 2024-04-26T18:39:13.017 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191232 len 8192 2024-04-26T18:39:13.017 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4191232 len 8192 2024-04-26T18:39:13.017 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191232 len 8192 2024-04-26T18:39:13.017 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4191232 len 16384 2024-04-26T18:39:13.017 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191232 len 16384 2024-04-26T18:39:13.017 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4191232 len 16384 2024-04-26T18:39:13.017 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191232 len 16384 2024-04-26T18:39:13.017 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4191744 len 1024 2024-04-26T18:39:13.017 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191744 len 1024 2024-04-26T18:39:13.018 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4191744 len 1024 2024-04-26T18:39:13.018 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191744 len 1024 2024-04-26T18:39:13.018 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4191744 len 2048 2024-04-26T18:39:13.018 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191744 len 2048 2024-04-26T18:39:13.018 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4191744 len 2048 2024-04-26T18:39:13.018 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191744 len 2048 2024-04-26T18:39:13.018 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4191744 len 4096 2024-04-26T18:39:13.018 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191744 len 4096 2024-04-26T18:39:13.018 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4191744 len 4096 2024-04-26T18:39:13.018 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191744 len 4096 2024-04-26T18:39:13.018 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4191744 len 8192 2024-04-26T18:39:13.018 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191744 len 8192 2024-04-26T18:39:13.018 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4191744 len 8192 2024-04-26T18:39:13.018 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191744 len 8192 2024-04-26T18:39:13.019 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4191744 len 16384 2024-04-26T18:39:13.019 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191744 len 16384 2024-04-26T18:39:13.019 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4191744 len 16384 2024-04-26T18:39:13.019 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4191744 len 16384 2024-04-26T18:39:13.019 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4192256 len 1024 2024-04-26T18:39:13.019 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192256 len 1024 2024-04-26T18:39:13.019 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4192256 len 1024 2024-04-26T18:39:13.019 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192256 len 1024 2024-04-26T18:39:13.019 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4192256 len 2048 2024-04-26T18:39:13.019 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192256 len 2048 2024-04-26T18:39:13.019 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4192256 len 2048 2024-04-26T18:39:13.019 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192256 len 2048 2024-04-26T18:39:13.019 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4192256 len 4096 2024-04-26T18:39:13.019 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192256 len 4096 2024-04-26T18:39:13.020 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4192256 len 4096 2024-04-26T18:39:13.020 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192256 len 4096 2024-04-26T18:39:13.020 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4192256 len 8192 2024-04-26T18:39:13.020 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192256 len 8192 2024-04-26T18:39:13.020 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4192256 len 8192 2024-04-26T18:39:13.020 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192256 len 8192 2024-04-26T18:39:13.020 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4192256 len 16384 2024-04-26T18:39:13.020 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192256 len 16384 2024-04-26T18:39:13.620 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4192256 len 16384 2024-04-26T18:39:13.620 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192256 len 16384 2024-04-26T18:39:13.620 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4192768 len 1024 2024-04-26T18:39:13.620 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192768 len 1024 2024-04-26T18:39:13.620 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4192768 len 1024 2024-04-26T18:39:13.620 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192768 len 1024 2024-04-26T18:39:13.620 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4192768 len 2048 2024-04-26T18:39:13.620 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192768 len 2048 2024-04-26T18:39:13.621 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4192768 len 2048 2024-04-26T18:39:13.621 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192768 len 2048 2024-04-26T18:39:13.621 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4192768 len 4096 2024-04-26T18:39:13.621 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192768 len 4096 2024-04-26T18:39:13.621 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4192768 len 4096 2024-04-26T18:39:13.621 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192768 len 4096 2024-04-26T18:39:13.621 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4192768 len 8192 2024-04-26T18:39:13.621 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192768 len 8192 2024-04-26T18:39:13.621 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4192768 len 8192 2024-04-26T18:39:13.621 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192768 len 8192 2024-04-26T18:39:13.621 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4192768 len 16384 2024-04-26T18:39:13.621 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192768 len 16384 2024-04-26T18:39:13.621 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4192768 len 16384 2024-04-26T18:39:13.621 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4192768 len 16384 2024-04-26T18:39:13.621 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4193280 len 1024 2024-04-26T18:39:13.622 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193280 len 1024 2024-04-26T18:39:13.622 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4193280 len 1024 2024-04-26T18:39:13.622 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193280 len 1024 2024-04-26T18:39:13.622 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4193280 len 2048 2024-04-26T18:39:13.622 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193280 len 2048 2024-04-26T18:39:13.622 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4193280 len 2048 2024-04-26T18:39:13.622 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193280 len 2048 2024-04-26T18:39:13.622 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4193280 len 4096 2024-04-26T18:39:13.622 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193280 len 4096 2024-04-26T18:39:13.622 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4193280 len 4096 2024-04-26T18:39:13.622 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193280 len 4096 2024-04-26T18:39:13.622 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4193280 len 8192 2024-04-26T18:39:13.622 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193280 len 8192 2024-04-26T18:39:13.622 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4193280 len 8192 2024-04-26T18:39:13.622 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193280 len 8192 2024-04-26T18:39:13.623 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4193280 len 16384 2024-04-26T18:39:13.623 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193280 len 16384 2024-04-26T18:39:13.623 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4193280 len 16384 2024-04-26T18:39:13.623 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193280 len 16384 2024-04-26T18:39:13.623 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4193792 len 1024 2024-04-26T18:39:13.623 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193792 len 1024 2024-04-26T18:39:13.623 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4193792 len 1024 2024-04-26T18:39:13.623 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193792 len 1024 2024-04-26T18:39:13.623 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4193792 len 2048 2024-04-26T18:39:13.623 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193792 len 2048 2024-04-26T18:39:13.623 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4193792 len 2048 2024-04-26T18:39:13.623 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193792 len 2048 2024-04-26T18:39:13.623 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4193792 len 4096 2024-04-26T18:39:13.623 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193792 len 4096 2024-04-26T18:39:13.624 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4193792 len 4096 2024-04-26T18:39:13.624 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193792 len 4096 2024-04-26T18:39:13.624 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4193792 len 8192 2024-04-26T18:39:13.624 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193792 len 8192 2024-04-26T18:39:13.624 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4193792 len 8192 2024-04-26T18:39:13.624 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193792 len 8192 2024-04-26T18:39:13.624 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4193792 len 16384 2024-04-26T18:39:13.624 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193792 len 16384 2024-04-26T18:39:13.624 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4193792 len 16384 2024-04-26T18:39:13.624 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4193792 len 16384 2024-04-26T18:39:13.624 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4194304 len 1024 2024-04-26T18:39:13.624 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194304 len 1024 2024-04-26T18:39:13.624 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4194304 len 1024 2024-04-26T18:39:13.624 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194304 len 1024 2024-04-26T18:39:13.624 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4194304 len 2048 2024-04-26T18:39:13.624 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194304 len 2048 2024-04-26T18:39:13.625 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4194304 len 2048 2024-04-26T18:39:13.625 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194304 len 2048 2024-04-26T18:39:13.625 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4194304 len 4096 2024-04-26T18:39:13.625 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194304 len 4096 2024-04-26T18:39:13.625 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4194304 len 4096 2024-04-26T18:39:13.625 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194304 len 4096 2024-04-26T18:39:13.625 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4194304 len 8192 2024-04-26T18:39:13.625 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194304 len 8192 2024-04-26T18:39:13.625 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4194304 len 8192 2024-04-26T18:39:13.625 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194304 len 8192 2024-04-26T18:39:13.625 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4194304 len 16384 2024-04-26T18:39:13.625 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194304 len 16384 2024-04-26T18:39:13.625 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4194304 len 16384 2024-04-26T18:39:13.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:13 smithi082 ceph-mon[32808]: pgmap v86: 97 pgs: 97 active+clean; 360 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 90 MiB/s rd, 1.7 MiB/s wr, 1.19k op/s 2024-04-26T18:39:13.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:13 smithi080 ceph-mon[29135]: pgmap v86: 97 pgs: 97 active+clean; 360 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 90 MiB/s rd, 1.7 MiB/s wr, 1.19k op/s 2024-04-26T18:39:14.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194304 len 16384 2024-04-26T18:39:14.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4194816 len 1024 2024-04-26T18:39:14.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194816 len 1024 2024-04-26T18:39:14.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4194816 len 1024 2024-04-26T18:39:14.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194816 len 1024 2024-04-26T18:39:14.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4194816 len 2048 2024-04-26T18:39:14.036 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194816 len 2048 2024-04-26T18:39:14.037 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4194816 len 2048 2024-04-26T18:39:14.037 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194816 len 2048 2024-04-26T18:39:14.037 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4194816 len 4096 2024-04-26T18:39:14.037 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194816 len 4096 2024-04-26T18:39:14.037 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4194816 len 4096 2024-04-26T18:39:14.037 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194816 len 4096 2024-04-26T18:39:14.037 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4194816 len 8192 2024-04-26T18:39:14.037 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194816 len 8192 2024-04-26T18:39:14.037 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4194816 len 8192 2024-04-26T18:39:14.037 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194816 len 8192 2024-04-26T18:39:14.037 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4194816 len 16384 2024-04-26T18:39:14.037 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194816 len 16384 2024-04-26T18:39:14.037 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4194816 len 16384 2024-04-26T18:39:14.038 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4194816 len 16384 2024-04-26T18:39:14.038 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4195328 len 1024 2024-04-26T18:39:14.038 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195328 len 1024 2024-04-26T18:39:14.038 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4195328 len 1024 2024-04-26T18:39:14.038 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195328 len 1024 2024-04-26T18:39:14.038 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4195328 len 2048 2024-04-26T18:39:14.038 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195328 len 2048 2024-04-26T18:39:14.038 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4195328 len 2048 2024-04-26T18:39:14.038 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195328 len 2048 2024-04-26T18:39:14.038 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4195328 len 4096 2024-04-26T18:39:14.038 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195328 len 4096 2024-04-26T18:39:14.038 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4195328 len 4096 2024-04-26T18:39:14.038 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195328 len 4096 2024-04-26T18:39:14.038 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4195328 len 8192 2024-04-26T18:39:14.039 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195328 len 8192 2024-04-26T18:39:14.039 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4195328 len 8192 2024-04-26T18:39:14.039 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195328 len 8192 2024-04-26T18:39:14.039 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4195328 len 16384 2024-04-26T18:39:14.039 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195328 len 16384 2024-04-26T18:39:14.039 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4195328 len 16384 2024-04-26T18:39:14.039 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195328 len 16384 2024-04-26T18:39:14.039 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4195840 len 1024 2024-04-26T18:39:14.039 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195840 len 1024 2024-04-26T18:39:14.039 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4195840 len 1024 2024-04-26T18:39:14.039 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195840 len 1024 2024-04-26T18:39:14.039 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4195840 len 2048 2024-04-26T18:39:14.039 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195840 len 2048 2024-04-26T18:39:14.039 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4195840 len 2048 2024-04-26T18:39:14.040 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195840 len 2048 2024-04-26T18:39:14.040 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4195840 len 4096 2024-04-26T18:39:14.040 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195840 len 4096 2024-04-26T18:39:14.040 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4195840 len 4096 2024-04-26T18:39:14.040 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195840 len 4096 2024-04-26T18:39:14.040 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4195840 len 8192 2024-04-26T18:39:14.040 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195840 len 8192 2024-04-26T18:39:14.040 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4195840 len 8192 2024-04-26T18:39:14.040 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195840 len 8192 2024-04-26T18:39:14.040 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4195840 len 16384 2024-04-26T18:39:14.040 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195840 len 16384 2024-04-26T18:39:14.040 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4195840 len 16384 2024-04-26T18:39:14.040 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4195840 len 16384 2024-04-26T18:39:14.040 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4196352 len 1024 2024-04-26T18:39:14.041 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196352 len 1024 2024-04-26T18:39:14.041 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4196352 len 1024 2024-04-26T18:39:14.041 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196352 len 1024 2024-04-26T18:39:14.041 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4196352 len 2048 2024-04-26T18:39:14.041 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196352 len 2048 2024-04-26T18:39:14.041 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4196352 len 2048 2024-04-26T18:39:14.041 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196352 len 2048 2024-04-26T18:39:14.041 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4196352 len 4096 2024-04-26T18:39:14.041 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196352 len 4096 2024-04-26T18:39:14.041 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4196352 len 4096 2024-04-26T18:39:14.041 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196352 len 4096 2024-04-26T18:39:14.041 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4196352 len 8192 2024-04-26T18:39:14.041 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196352 len 8192 2024-04-26T18:39:14.041 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4196352 len 8192 2024-04-26T18:39:14.042 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196352 len 8192 2024-04-26T18:39:14.042 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4196352 len 16384 2024-04-26T18:39:14.042 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196352 len 16384 2024-04-26T18:39:14.042 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4196352 len 16384 2024-04-26T18:39:14.042 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196352 len 16384 2024-04-26T18:39:14.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:13 smithi192 ceph-mon[32842]: pgmap v86: 97 pgs: 97 active+clean; 360 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 90 MiB/s rd, 1.7 MiB/s wr, 1.19k op/s 2024-04-26T18:39:14.461 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4196864 len 1024 2024-04-26T18:39:14.461 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196864 len 1024 2024-04-26T18:39:14.462 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4196864 len 1024 2024-04-26T18:39:14.462 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196864 len 1024 2024-04-26T18:39:14.462 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4196864 len 2048 2024-04-26T18:39:14.462 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196864 len 2048 2024-04-26T18:39:14.462 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4196864 len 2048 2024-04-26T18:39:14.462 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196864 len 2048 2024-04-26T18:39:14.462 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4196864 len 4096 2024-04-26T18:39:14.462 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196864 len 4096 2024-04-26T18:39:14.462 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4196864 len 4096 2024-04-26T18:39:14.462 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196864 len 4096 2024-04-26T18:39:14.462 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4196864 len 8192 2024-04-26T18:39:14.462 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196864 len 8192 2024-04-26T18:39:14.462 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4196864 len 8192 2024-04-26T18:39:14.463 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196864 len 8192 2024-04-26T18:39:14.463 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4196864 len 16384 2024-04-26T18:39:14.463 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196864 len 16384 2024-04-26T18:39:14.463 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4196864 len 16384 2024-04-26T18:39:14.463 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4196864 len 16384 2024-04-26T18:39:14.463 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4197376 len 1024 2024-04-26T18:39:14.463 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197376 len 1024 2024-04-26T18:39:14.463 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4197376 len 1024 2024-04-26T18:39:14.463 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197376 len 1024 2024-04-26T18:39:14.463 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4197376 len 2048 2024-04-26T18:39:14.463 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197376 len 2048 2024-04-26T18:39:14.463 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4197376 len 2048 2024-04-26T18:39:14.463 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197376 len 2048 2024-04-26T18:39:14.463 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4197376 len 4096 2024-04-26T18:39:14.464 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197376 len 4096 2024-04-26T18:39:14.464 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4197376 len 4096 2024-04-26T18:39:14.464 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197376 len 4096 2024-04-26T18:39:14.464 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4197376 len 8192 2024-04-26T18:39:14.464 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197376 len 8192 2024-04-26T18:39:14.464 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4197376 len 8192 2024-04-26T18:39:14.464 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197376 len 8192 2024-04-26T18:39:14.464 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4197376 len 16384 2024-04-26T18:39:14.464 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197376 len 16384 2024-04-26T18:39:14.464 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4197376 len 16384 2024-04-26T18:39:14.464 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197376 len 16384 2024-04-26T18:39:14.464 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4197888 len 1024 2024-04-26T18:39:14.464 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197888 len 1024 2024-04-26T18:39:14.464 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4197888 len 1024 2024-04-26T18:39:14.464 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197888 len 1024 2024-04-26T18:39:14.465 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4197888 len 2048 2024-04-26T18:39:14.465 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197888 len 2048 2024-04-26T18:39:14.465 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4197888 len 2048 2024-04-26T18:39:14.465 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197888 len 2048 2024-04-26T18:39:14.465 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4197888 len 4096 2024-04-26T18:39:14.465 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197888 len 4096 2024-04-26T18:39:14.465 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4197888 len 4096 2024-04-26T18:39:14.465 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197888 len 4096 2024-04-26T18:39:14.465 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4197888 len 8192 2024-04-26T18:39:14.465 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197888 len 8192 2024-04-26T18:39:14.465 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4197888 len 8192 2024-04-26T18:39:14.465 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197888 len 8192 2024-04-26T18:39:14.465 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 2560 offset 4197888 len 16384 2024-04-26T18:39:14.465 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197888 len 16384 2024-04-26T18:39:14.465 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 2560 offset 4197888 len 16384 2024-04-26T18:39:14.466 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 2560 offset 4197888 len 16384 2024-04-26T18:39:14.466 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4190720 len 1024 2024-04-26T18:39:14.466 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4190720 len 1024 2024-04-26T18:39:14.466 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4190720 len 1024 2024-04-26T18:39:14.466 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4190720 len 1024 2024-04-26T18:39:14.466 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4190720 len 2048 2024-04-26T18:39:14.466 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4190720 len 2048 2024-04-26T18:39:14.466 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4190720 len 2048 2024-04-26T18:39:14.467 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4190720 len 2048 2024-04-26T18:39:14.467 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4190720 len 4096 2024-04-26T18:39:14.467 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4190720 len 4096 2024-04-26T18:39:14.467 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4190720 len 4096 2024-04-26T18:39:14.467 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4190720 len 4096 2024-04-26T18:39:14.467 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4190720 len 8192 2024-04-26T18:39:14.467 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4190720 len 8192 2024-04-26T18:39:14.468 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4190720 len 8192 2024-04-26T18:39:14.468 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4190720 len 8192 2024-04-26T18:39:14.468 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4190720 len 16384 2024-04-26T18:39:14.468 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4190720 len 16384 2024-04-26T18:39:14.468 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4190720 len 16384 2024-04-26T18:39:14.468 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4190720 len 16384 2024-04-26T18:39:15.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4191232 len 1024 2024-04-26T18:39:15.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191232 len 1024 2024-04-26T18:39:15.074 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4191232 len 1024 2024-04-26T18:39:15.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191232 len 1024 2024-04-26T18:39:15.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4191232 len 2048 2024-04-26T18:39:15.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191232 len 2048 2024-04-26T18:39:15.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4191232 len 2048 2024-04-26T18:39:15.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191232 len 2048 2024-04-26T18:39:15.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4191232 len 4096 2024-04-26T18:39:15.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191232 len 4096 2024-04-26T18:39:15.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4191232 len 4096 2024-04-26T18:39:15.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191232 len 4096 2024-04-26T18:39:15.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4191232 len 8192 2024-04-26T18:39:15.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191232 len 8192 2024-04-26T18:39:15.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4191232 len 8192 2024-04-26T18:39:15.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191232 len 8192 2024-04-26T18:39:15.075 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4191232 len 16384 2024-04-26T18:39:15.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191232 len 16384 2024-04-26T18:39:15.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4191232 len 16384 2024-04-26T18:39:15.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191232 len 16384 2024-04-26T18:39:15.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4191744 len 1024 2024-04-26T18:39:15.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191744 len 1024 2024-04-26T18:39:15.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4191744 len 1024 2024-04-26T18:39:15.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191744 len 1024 2024-04-26T18:39:15.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4191744 len 2048 2024-04-26T18:39:15.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191744 len 2048 2024-04-26T18:39:15.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4191744 len 2048 2024-04-26T18:39:15.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191744 len 2048 2024-04-26T18:39:15.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4191744 len 4096 2024-04-26T18:39:15.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191744 len 4096 2024-04-26T18:39:15.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4191744 len 4096 2024-04-26T18:39:15.076 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191744 len 4096 2024-04-26T18:39:15.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4191744 len 8192 2024-04-26T18:39:15.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191744 len 8192 2024-04-26T18:39:15.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4191744 len 8192 2024-04-26T18:39:15.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191744 len 8192 2024-04-26T18:39:15.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4191744 len 16384 2024-04-26T18:39:15.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191744 len 16384 2024-04-26T18:39:15.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4191744 len 16384 2024-04-26T18:39:15.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4191744 len 16384 2024-04-26T18:39:15.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4192256 len 1024 2024-04-26T18:39:15.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192256 len 1024 2024-04-26T18:39:15.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4192256 len 1024 2024-04-26T18:39:15.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192256 len 1024 2024-04-26T18:39:15.077 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4192256 len 2048 2024-04-26T18:39:15.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192256 len 2048 2024-04-26T18:39:15.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4192256 len 2048 2024-04-26T18:39:15.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192256 len 2048 2024-04-26T18:39:15.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4192256 len 4096 2024-04-26T18:39:15.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192256 len 4096 2024-04-26T18:39:15.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4192256 len 4096 2024-04-26T18:39:15.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192256 len 4096 2024-04-26T18:39:15.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4192256 len 8192 2024-04-26T18:39:15.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192256 len 8192 2024-04-26T18:39:15.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4192256 len 8192 2024-04-26T18:39:15.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192256 len 8192 2024-04-26T18:39:15.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4192256 len 16384 2024-04-26T18:39:15.078 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192256 len 16384 2024-04-26T18:39:15.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4192256 len 16384 2024-04-26T18:39:15.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192256 len 16384 2024-04-26T18:39:15.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4192768 len 1024 2024-04-26T18:39:15.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192768 len 1024 2024-04-26T18:39:15.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4192768 len 1024 2024-04-26T18:39:15.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192768 len 1024 2024-04-26T18:39:15.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4192768 len 2048 2024-04-26T18:39:15.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192768 len 2048 2024-04-26T18:39:15.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4192768 len 2048 2024-04-26T18:39:15.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192768 len 2048 2024-04-26T18:39:15.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4192768 len 4096 2024-04-26T18:39:15.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192768 len 4096 2024-04-26T18:39:15.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4192768 len 4096 2024-04-26T18:39:15.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192768 len 4096 2024-04-26T18:39:15.079 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4192768 len 8192 2024-04-26T18:39:15.080 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192768 len 8192 2024-04-26T18:39:15.080 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4192768 len 8192 2024-04-26T18:39:15.080 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192768 len 8192 2024-04-26T18:39:15.080 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4192768 len 16384 2024-04-26T18:39:15.080 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192768 len 16384 2024-04-26T18:39:15.080 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4192768 len 16384 2024-04-26T18:39:15.080 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4192768 len 16384 2024-04-26T18:39:15.080 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4193280 len 1024 2024-04-26T18:39:15.589 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193280 len 1024 2024-04-26T18:39:15.589 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4193280 len 1024 2024-04-26T18:39:15.589 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193280 len 1024 2024-04-26T18:39:15.589 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4193280 len 2048 2024-04-26T18:39:15.589 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193280 len 2048 2024-04-26T18:39:15.589 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4193280 len 2048 2024-04-26T18:39:15.589 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193280 len 2048 2024-04-26T18:39:15.589 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4193280 len 4096 2024-04-26T18:39:15.589 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193280 len 4096 2024-04-26T18:39:15.589 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4193280 len 4096 2024-04-26T18:39:15.590 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193280 len 4096 2024-04-26T18:39:15.590 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4193280 len 8192 2024-04-26T18:39:15.590 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193280 len 8192 2024-04-26T18:39:15.590 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4193280 len 8192 2024-04-26T18:39:15.590 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193280 len 8192 2024-04-26T18:39:15.590 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4193280 len 16384 2024-04-26T18:39:15.590 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193280 len 16384 2024-04-26T18:39:15.590 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4193280 len 16384 2024-04-26T18:39:15.590 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193280 len 16384 2024-04-26T18:39:15.590 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4193792 len 1024 2024-04-26T18:39:15.590 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193792 len 1024 2024-04-26T18:39:15.590 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4193792 len 1024 2024-04-26T18:39:15.590 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193792 len 1024 2024-04-26T18:39:15.590 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4193792 len 2048 2024-04-26T18:39:15.591 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193792 len 2048 2024-04-26T18:39:15.591 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4193792 len 2048 2024-04-26T18:39:15.591 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193792 len 2048 2024-04-26T18:39:15.591 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4193792 len 4096 2024-04-26T18:39:15.591 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193792 len 4096 2024-04-26T18:39:15.591 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4193792 len 4096 2024-04-26T18:39:15.591 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193792 len 4096 2024-04-26T18:39:15.591 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4193792 len 8192 2024-04-26T18:39:15.591 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193792 len 8192 2024-04-26T18:39:15.591 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4193792 len 8192 2024-04-26T18:39:15.591 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193792 len 8192 2024-04-26T18:39:15.591 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4193792 len 16384 2024-04-26T18:39:15.591 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193792 len 16384 2024-04-26T18:39:15.591 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4193792 len 16384 2024-04-26T18:39:15.591 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4193792 len 16384 2024-04-26T18:39:15.592 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4194304 len 1024 2024-04-26T18:39:15.592 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194304 len 1024 2024-04-26T18:39:15.592 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4194304 len 1024 2024-04-26T18:39:15.592 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194304 len 1024 2024-04-26T18:39:15.592 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4194304 len 2048 2024-04-26T18:39:15.592 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194304 len 2048 2024-04-26T18:39:15.592 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4194304 len 2048 2024-04-26T18:39:15.592 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194304 len 2048 2024-04-26T18:39:15.592 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4194304 len 4096 2024-04-26T18:39:15.592 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194304 len 4096 2024-04-26T18:39:15.592 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4194304 len 4096 2024-04-26T18:39:15.592 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194304 len 4096 2024-04-26T18:39:15.592 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4194304 len 8192 2024-04-26T18:39:15.592 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194304 len 8192 2024-04-26T18:39:15.593 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4194304 len 8192 2024-04-26T18:39:15.593 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194304 len 8192 2024-04-26T18:39:15.593 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4194304 len 16384 2024-04-26T18:39:15.593 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194304 len 16384 2024-04-26T18:39:15.593 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4194304 len 16384 2024-04-26T18:39:15.593 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194304 len 16384 2024-04-26T18:39:15.593 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4194816 len 1024 2024-04-26T18:39:15.593 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194816 len 1024 2024-04-26T18:39:15.593 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4194816 len 1024 2024-04-26T18:39:15.593 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194816 len 1024 2024-04-26T18:39:15.593 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4194816 len 2048 2024-04-26T18:39:15.593 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194816 len 2048 2024-04-26T18:39:15.593 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4194816 len 2048 2024-04-26T18:39:15.593 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194816 len 2048 2024-04-26T18:39:15.593 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4194816 len 4096 2024-04-26T18:39:15.594 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194816 len 4096 2024-04-26T18:39:15.594 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4194816 len 4096 2024-04-26T18:39:15.594 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194816 len 4096 2024-04-26T18:39:15.594 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4194816 len 8192 2024-04-26T18:39:15.594 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194816 len 8192 2024-04-26T18:39:15.594 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4194816 len 8192 2024-04-26T18:39:15.594 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194816 len 8192 2024-04-26T18:39:15.594 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4194816 len 16384 2024-04-26T18:39:15.594 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194816 len 16384 2024-04-26T18:39:15.594 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4194816 len 16384 2024-04-26T18:39:15.594 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4194816 len 16384 2024-04-26T18:39:15.594 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4195328 len 1024 2024-04-26T18:39:15.594 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195328 len 1024 2024-04-26T18:39:15.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:15 smithi082 ceph-mon[32808]: pgmap v87: 97 pgs: 97 active+clean; 544 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 151 MiB/s rd, 1.5 MiB/s wr, 526 op/s 2024-04-26T18:39:15.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:15 smithi080 ceph-mon[29135]: pgmap v87: 97 pgs: 97 active+clean; 544 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 151 MiB/s rd, 1.5 MiB/s wr, 526 op/s 2024-04-26T18:39:16.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4195328 len 1024 2024-04-26T18:39:16.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195328 len 1024 2024-04-26T18:39:16.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4195328 len 2048 2024-04-26T18:39:16.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195328 len 2048 2024-04-26T18:39:16.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4195328 len 2048 2024-04-26T18:39:16.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195328 len 2048 2024-04-26T18:39:16.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4195328 len 4096 2024-04-26T18:39:16.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195328 len 4096 2024-04-26T18:39:16.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4195328 len 4096 2024-04-26T18:39:16.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195328 len 4096 2024-04-26T18:39:16.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4195328 len 8192 2024-04-26T18:39:16.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195328 len 8192 2024-04-26T18:39:16.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4195328 len 8192 2024-04-26T18:39:16.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195328 len 8192 2024-04-26T18:39:16.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4195328 len 16384 2024-04-26T18:39:16.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195328 len 16384 2024-04-26T18:39:16.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4195328 len 16384 2024-04-26T18:39:16.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195328 len 16384 2024-04-26T18:39:16.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4195840 len 1024 2024-04-26T18:39:16.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195840 len 1024 2024-04-26T18:39:16.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4195840 len 1024 2024-04-26T18:39:16.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195840 len 1024 2024-04-26T18:39:16.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4195840 len 2048 2024-04-26T18:39:16.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195840 len 2048 2024-04-26T18:39:16.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4195840 len 2048 2024-04-26T18:39:16.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195840 len 2048 2024-04-26T18:39:16.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4195840 len 4096 2024-04-26T18:39:16.027 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195840 len 4096 2024-04-26T18:39:16.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4195840 len 4096 2024-04-26T18:39:16.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195840 len 4096 2024-04-26T18:39:16.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4195840 len 8192 2024-04-26T18:39:16.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195840 len 8192 2024-04-26T18:39:16.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4195840 len 8192 2024-04-26T18:39:16.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195840 len 8192 2024-04-26T18:39:16.029 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4195840 len 16384 2024-04-26T18:39:16.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195840 len 16384 2024-04-26T18:39:16.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4195840 len 16384 2024-04-26T18:39:16.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4195840 len 16384 2024-04-26T18:39:16.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4196352 len 1024 2024-04-26T18:39:16.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196352 len 1024 2024-04-26T18:39:16.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4196352 len 1024 2024-04-26T18:39:16.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196352 len 1024 2024-04-26T18:39:16.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4196352 len 2048 2024-04-26T18:39:16.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196352 len 2048 2024-04-26T18:39:16.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4196352 len 2048 2024-04-26T18:39:16.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196352 len 2048 2024-04-26T18:39:16.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4196352 len 4096 2024-04-26T18:39:16.030 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196352 len 4096 2024-04-26T18:39:16.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4196352 len 4096 2024-04-26T18:39:16.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196352 len 4096 2024-04-26T18:39:16.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4196352 len 8192 2024-04-26T18:39:16.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196352 len 8192 2024-04-26T18:39:16.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4196352 len 8192 2024-04-26T18:39:16.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196352 len 8192 2024-04-26T18:39:16.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4196352 len 16384 2024-04-26T18:39:16.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196352 len 16384 2024-04-26T18:39:16.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4196352 len 16384 2024-04-26T18:39:16.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196352 len 16384 2024-04-26T18:39:16.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4196864 len 1024 2024-04-26T18:39:16.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196864 len 1024 2024-04-26T18:39:16.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4196864 len 1024 2024-04-26T18:39:16.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196864 len 1024 2024-04-26T18:39:16.031 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4196864 len 2048 2024-04-26T18:39:16.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196864 len 2048 2024-04-26T18:39:16.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4196864 len 2048 2024-04-26T18:39:16.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196864 len 2048 2024-04-26T18:39:16.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4196864 len 4096 2024-04-26T18:39:16.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196864 len 4096 2024-04-26T18:39:16.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4196864 len 4096 2024-04-26T18:39:16.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196864 len 4096 2024-04-26T18:39:16.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4196864 len 8192 2024-04-26T18:39:16.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196864 len 8192 2024-04-26T18:39:16.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4196864 len 8192 2024-04-26T18:39:16.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196864 len 8192 2024-04-26T18:39:16.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4196864 len 16384 2024-04-26T18:39:16.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196864 len 16384 2024-04-26T18:39:16.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4196864 len 16384 2024-04-26T18:39:16.032 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4196864 len 16384 2024-04-26T18:39:16.033 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4197376 len 1024 2024-04-26T18:39:16.033 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197376 len 1024 2024-04-26T18:39:16.033 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4197376 len 1024 2024-04-26T18:39:16.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:15 smithi192 ceph-mon[32842]: pgmap v87: 97 pgs: 97 active+clean; 544 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 151 MiB/s rd, 1.5 MiB/s wr, 526 op/s 2024-04-26T18:39:16.553 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197376 len 1024 2024-04-26T18:39:16.554 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4197376 len 2048 2024-04-26T18:39:16.554 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197376 len 2048 2024-04-26T18:39:16.554 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4197376 len 2048 2024-04-26T18:39:16.554 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197376 len 2048 2024-04-26T18:39:16.554 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4197376 len 4096 2024-04-26T18:39:16.554 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197376 len 4096 2024-04-26T18:39:16.554 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4197376 len 4096 2024-04-26T18:39:16.554 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197376 len 4096 2024-04-26T18:39:16.554 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4197376 len 8192 2024-04-26T18:39:16.554 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197376 len 8192 2024-04-26T18:39:16.554 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4197376 len 8192 2024-04-26T18:39:16.554 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197376 len 8192 2024-04-26T18:39:16.554 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4197376 len 16384 2024-04-26T18:39:16.554 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197376 len 16384 2024-04-26T18:39:16.555 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4197376 len 16384 2024-04-26T18:39:16.555 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197376 len 16384 2024-04-26T18:39:16.555 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4197888 len 1024 2024-04-26T18:39:16.555 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197888 len 1024 2024-04-26T18:39:16.555 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4197888 len 1024 2024-04-26T18:39:16.555 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197888 len 1024 2024-04-26T18:39:16.555 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4197888 len 2048 2024-04-26T18:39:16.555 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197888 len 2048 2024-04-26T18:39:16.555 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4197888 len 2048 2024-04-26T18:39:16.555 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197888 len 2048 2024-04-26T18:39:16.555 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4197888 len 4096 2024-04-26T18:39:16.555 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197888 len 4096 2024-04-26T18:39:16.555 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4197888 len 4096 2024-04-26T18:39:16.555 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197888 len 4096 2024-04-26T18:39:16.556 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4197888 len 8192 2024-04-26T18:39:16.556 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197888 len 8192 2024-04-26T18:39:16.556 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4197888 len 8192 2024-04-26T18:39:16.556 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197888 len 8192 2024-04-26T18:39:16.556 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3072 offset 4197888 len 16384 2024-04-26T18:39:16.556 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197888 len 16384 2024-04-26T18:39:16.556 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3072 offset 4197888 len 16384 2024-04-26T18:39:16.556 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3072 offset 4197888 len 16384 2024-04-26T18:39:16.556 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4190720 len 1024 2024-04-26T18:39:16.556 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4190720 len 1024 2024-04-26T18:39:16.556 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4190720 len 1024 2024-04-26T18:39:16.556 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4190720 len 1024 2024-04-26T18:39:16.556 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4190720 len 2048 2024-04-26T18:39:16.556 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4190720 len 2048 2024-04-26T18:39:16.557 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4190720 len 2048 2024-04-26T18:39:16.557 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4190720 len 2048 2024-04-26T18:39:16.557 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4190720 len 4096 2024-04-26T18:39:16.557 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4190720 len 4096 2024-04-26T18:39:16.557 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4190720 len 4096 2024-04-26T18:39:16.557 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4190720 len 4096 2024-04-26T18:39:16.557 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4190720 len 8192 2024-04-26T18:39:16.557 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4190720 len 8192 2024-04-26T18:39:16.557 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4190720 len 8192 2024-04-26T18:39:16.557 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4190720 len 8192 2024-04-26T18:39:16.557 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4190720 len 16384 2024-04-26T18:39:16.557 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4190720 len 16384 2024-04-26T18:39:16.557 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4190720 len 16384 2024-04-26T18:39:16.557 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4190720 len 16384 2024-04-26T18:39:16.558 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4191232 len 1024 2024-04-26T18:39:16.558 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191232 len 1024 2024-04-26T18:39:16.558 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4191232 len 1024 2024-04-26T18:39:16.558 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191232 len 1024 2024-04-26T18:39:16.558 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4191232 len 2048 2024-04-26T18:39:16.558 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191232 len 2048 2024-04-26T18:39:16.558 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4191232 len 2048 2024-04-26T18:39:16.558 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191232 len 2048 2024-04-26T18:39:16.558 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4191232 len 4096 2024-04-26T18:39:16.558 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191232 len 4096 2024-04-26T18:39:16.558 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4191232 len 4096 2024-04-26T18:39:16.558 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191232 len 4096 2024-04-26T18:39:16.558 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4191232 len 8192 2024-04-26T18:39:16.558 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191232 len 8192 2024-04-26T18:39:16.558 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4191232 len 8192 2024-04-26T18:39:16.559 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191232 len 8192 2024-04-26T18:39:16.559 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4191232 len 16384 2024-04-26T18:39:16.559 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191232 len 16384 2024-04-26T18:39:16.559 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4191232 len 16384 2024-04-26T18:39:16.559 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191232 len 16384 2024-04-26T18:39:16.559 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4191744 len 1024 2024-04-26T18:39:16.559 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191744 len 1024 2024-04-26T18:39:16.559 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4191744 len 1024 2024-04-26T18:39:16.559 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191744 len 1024 2024-04-26T18:39:17.234 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4191744 len 2048 2024-04-26T18:39:17.234 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191744 len 2048 2024-04-26T18:39:17.234 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4191744 len 2048 2024-04-26T18:39:17.234 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191744 len 2048 2024-04-26T18:39:17.234 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4191744 len 4096 2024-04-26T18:39:17.234 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191744 len 4096 2024-04-26T18:39:17.234 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4191744 len 4096 2024-04-26T18:39:17.235 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191744 len 4096 2024-04-26T18:39:17.235 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4191744 len 8192 2024-04-26T18:39:17.235 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191744 len 8192 2024-04-26T18:39:17.235 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4191744 len 8192 2024-04-26T18:39:17.235 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191744 len 8192 2024-04-26T18:39:17.235 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4191744 len 16384 2024-04-26T18:39:17.235 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191744 len 16384 2024-04-26T18:39:17.235 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4191744 len 16384 2024-04-26T18:39:17.235 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4191744 len 16384 2024-04-26T18:39:17.235 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4192256 len 1024 2024-04-26T18:39:17.235 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192256 len 1024 2024-04-26T18:39:17.235 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4192256 len 1024 2024-04-26T18:39:17.235 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192256 len 1024 2024-04-26T18:39:17.235 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4192256 len 2048 2024-04-26T18:39:17.235 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192256 len 2048 2024-04-26T18:39:17.236 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4192256 len 2048 2024-04-26T18:39:17.236 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192256 len 2048 2024-04-26T18:39:17.236 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4192256 len 4096 2024-04-26T18:39:17.236 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192256 len 4096 2024-04-26T18:39:17.236 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4192256 len 4096 2024-04-26T18:39:17.236 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192256 len 4096 2024-04-26T18:39:17.236 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4192256 len 8192 2024-04-26T18:39:17.236 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192256 len 8192 2024-04-26T18:39:17.236 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4192256 len 8192 2024-04-26T18:39:17.236 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192256 len 8192 2024-04-26T18:39:17.236 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4192256 len 16384 2024-04-26T18:39:17.236 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192256 len 16384 2024-04-26T18:39:17.236 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4192256 len 16384 2024-04-26T18:39:17.236 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192256 len 16384 2024-04-26T18:39:17.237 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4192768 len 1024 2024-04-26T18:39:17.237 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192768 len 1024 2024-04-26T18:39:17.237 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4192768 len 1024 2024-04-26T18:39:17.237 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192768 len 1024 2024-04-26T18:39:17.237 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4192768 len 2048 2024-04-26T18:39:17.237 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192768 len 2048 2024-04-26T18:39:17.237 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4192768 len 2048 2024-04-26T18:39:17.237 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192768 len 2048 2024-04-26T18:39:17.237 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4192768 len 4096 2024-04-26T18:39:17.237 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192768 len 4096 2024-04-26T18:39:17.237 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4192768 len 4096 2024-04-26T18:39:17.237 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192768 len 4096 2024-04-26T18:39:17.237 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4192768 len 8192 2024-04-26T18:39:17.237 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192768 len 8192 2024-04-26T18:39:17.237 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4192768 len 8192 2024-04-26T18:39:17.238 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192768 len 8192 2024-04-26T18:39:17.238 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4192768 len 16384 2024-04-26T18:39:17.238 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192768 len 16384 2024-04-26T18:39:17.238 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4192768 len 16384 2024-04-26T18:39:17.238 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4192768 len 16384 2024-04-26T18:39:17.238 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4193280 len 1024 2024-04-26T18:39:17.238 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193280 len 1024 2024-04-26T18:39:17.238 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4193280 len 1024 2024-04-26T18:39:17.238 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193280 len 1024 2024-04-26T18:39:17.238 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4193280 len 2048 2024-04-26T18:39:17.238 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193280 len 2048 2024-04-26T18:39:17.238 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4193280 len 2048 2024-04-26T18:39:17.238 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193280 len 2048 2024-04-26T18:39:17.238 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4193280 len 4096 2024-04-26T18:39:17.239 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193280 len 4096 2024-04-26T18:39:17.239 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4193280 len 4096 2024-04-26T18:39:17.239 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193280 len 4096 2024-04-26T18:39:17.239 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4193280 len 8192 2024-04-26T18:39:17.239 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193280 len 8192 2024-04-26T18:39:17.239 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4193280 len 8192 2024-04-26T18:39:17.239 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193280 len 8192 2024-04-26T18:39:17.239 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4193280 len 16384 2024-04-26T18:39:17.239 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193280 len 16384 2024-04-26T18:39:17.239 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4193280 len 16384 2024-04-26T18:39:17.239 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193280 len 16384 2024-04-26T18:39:17.239 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4193792 len 1024 2024-04-26T18:39:17.239 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193792 len 1024 2024-04-26T18:39:17.239 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4193792 len 1024 2024-04-26T18:39:17.239 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193792 len 1024 2024-04-26T18:39:17.651 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4193792 len 2048 2024-04-26T18:39:17.651 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193792 len 2048 2024-04-26T18:39:17.651 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4193792 len 2048 2024-04-26T18:39:17.651 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193792 len 2048 2024-04-26T18:39:17.651 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4193792 len 4096 2024-04-26T18:39:17.651 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193792 len 4096 2024-04-26T18:39:17.651 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4193792 len 4096 2024-04-26T18:39:17.651 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193792 len 4096 2024-04-26T18:39:17.651 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4193792 len 8192 2024-04-26T18:39:17.652 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193792 len 8192 2024-04-26T18:39:17.652 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4193792 len 8192 2024-04-26T18:39:17.652 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193792 len 8192 2024-04-26T18:39:17.652 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4193792 len 16384 2024-04-26T18:39:17.652 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193792 len 16384 2024-04-26T18:39:17.652 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4193792 len 16384 2024-04-26T18:39:17.652 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4193792 len 16384 2024-04-26T18:39:17.652 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4194304 len 1024 2024-04-26T18:39:17.652 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194304 len 1024 2024-04-26T18:39:17.652 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4194304 len 1024 2024-04-26T18:39:17.652 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194304 len 1024 2024-04-26T18:39:17.653 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4194304 len 2048 2024-04-26T18:39:17.653 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194304 len 2048 2024-04-26T18:39:17.653 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4194304 len 2048 2024-04-26T18:39:17.653 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194304 len 2048 2024-04-26T18:39:17.653 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4194304 len 4096 2024-04-26T18:39:17.653 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194304 len 4096 2024-04-26T18:39:17.653 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4194304 len 4096 2024-04-26T18:39:17.653 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194304 len 4096 2024-04-26T18:39:17.653 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4194304 len 8192 2024-04-26T18:39:17.653 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194304 len 8192 2024-04-26T18:39:17.653 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4194304 len 8192 2024-04-26T18:39:17.654 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194304 len 8192 2024-04-26T18:39:17.654 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4194304 len 16384 2024-04-26T18:39:17.654 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194304 len 16384 2024-04-26T18:39:17.654 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4194304 len 16384 2024-04-26T18:39:17.654 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194304 len 16384 2024-04-26T18:39:17.654 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4194816 len 1024 2024-04-26T18:39:17.654 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194816 len 1024 2024-04-26T18:39:17.654 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4194816 len 1024 2024-04-26T18:39:17.654 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194816 len 1024 2024-04-26T18:39:17.655 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4194816 len 2048 2024-04-26T18:39:17.655 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194816 len 2048 2024-04-26T18:39:17.655 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4194816 len 2048 2024-04-26T18:39:17.655 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194816 len 2048 2024-04-26T18:39:17.655 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4194816 len 4096 2024-04-26T18:39:17.655 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194816 len 4096 2024-04-26T18:39:17.655 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4194816 len 4096 2024-04-26T18:39:17.655 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194816 len 4096 2024-04-26T18:39:17.655 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4194816 len 8192 2024-04-26T18:39:17.655 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194816 len 8192 2024-04-26T18:39:17.655 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4194816 len 8192 2024-04-26T18:39:17.655 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194816 len 8192 2024-04-26T18:39:17.655 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4194816 len 16384 2024-04-26T18:39:17.655 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194816 len 16384 2024-04-26T18:39:17.655 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4194816 len 16384 2024-04-26T18:39:17.656 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4194816 len 16384 2024-04-26T18:39:17.656 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4195328 len 1024 2024-04-26T18:39:17.656 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195328 len 1024 2024-04-26T18:39:17.656 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4195328 len 1024 2024-04-26T18:39:17.656 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195328 len 1024 2024-04-26T18:39:17.656 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4195328 len 2048 2024-04-26T18:39:17.656 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195328 len 2048 2024-04-26T18:39:17.656 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4195328 len 2048 2024-04-26T18:39:17.656 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195328 len 2048 2024-04-26T18:39:17.656 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4195328 len 4096 2024-04-26T18:39:17.656 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195328 len 4096 2024-04-26T18:39:17.657 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4195328 len 4096 2024-04-26T18:39:17.657 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195328 len 4096 2024-04-26T18:39:17.657 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4195328 len 8192 2024-04-26T18:39:17.657 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195328 len 8192 2024-04-26T18:39:17.657 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4195328 len 8192 2024-04-26T18:39:17.657 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195328 len 8192 2024-04-26T18:39:17.657 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4195328 len 16384 2024-04-26T18:39:17.658 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195328 len 16384 2024-04-26T18:39:17.658 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4195328 len 16384 2024-04-26T18:39:17.658 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195328 len 16384 2024-04-26T18:39:17.658 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4195840 len 1024 2024-04-26T18:39:17.658 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195840 len 1024 2024-04-26T18:39:17.658 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4195840 len 1024 2024-04-26T18:39:17.658 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195840 len 1024 2024-04-26T18:39:17.659 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4195840 len 2048 2024-04-26T18:39:17.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:17 smithi082 ceph-mon[32808]: pgmap v88: 97 pgs: 97 active+clean; 544 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 151 MiB/s rd, 1.5 MiB/s wr, 526 op/s 2024-04-26T18:39:17.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:17 smithi080 ceph-mon[29135]: pgmap v88: 97 pgs: 97 active+clean; 544 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 151 MiB/s rd, 1.5 MiB/s wr, 526 op/s 2024-04-26T18:39:18.020 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195840 len 2048 2024-04-26T18:39:18.020 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4195840 len 2048 2024-04-26T18:39:18.020 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195840 len 2048 2024-04-26T18:39:18.021 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4195840 len 4096 2024-04-26T18:39:18.021 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195840 len 4096 2024-04-26T18:39:18.021 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4195840 len 4096 2024-04-26T18:39:18.021 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195840 len 4096 2024-04-26T18:39:18.021 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4195840 len 8192 2024-04-26T18:39:18.021 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195840 len 8192 2024-04-26T18:39:18.021 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4195840 len 8192 2024-04-26T18:39:18.021 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195840 len 8192 2024-04-26T18:39:18.021 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4195840 len 16384 2024-04-26T18:39:18.021 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195840 len 16384 2024-04-26T18:39:18.021 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4195840 len 16384 2024-04-26T18:39:18.021 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4195840 len 16384 2024-04-26T18:39:18.021 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4196352 len 1024 2024-04-26T18:39:18.021 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196352 len 1024 2024-04-26T18:39:18.022 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4196352 len 1024 2024-04-26T18:39:18.022 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196352 len 1024 2024-04-26T18:39:18.022 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4196352 len 2048 2024-04-26T18:39:18.022 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196352 len 2048 2024-04-26T18:39:18.022 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4196352 len 2048 2024-04-26T18:39:18.022 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196352 len 2048 2024-04-26T18:39:18.022 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4196352 len 4096 2024-04-26T18:39:18.022 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196352 len 4096 2024-04-26T18:39:18.022 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4196352 len 4096 2024-04-26T18:39:18.022 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196352 len 4096 2024-04-26T18:39:18.022 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4196352 len 8192 2024-04-26T18:39:18.022 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196352 len 8192 2024-04-26T18:39:18.022 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4196352 len 8192 2024-04-26T18:39:18.023 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196352 len 8192 2024-04-26T18:39:18.023 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4196352 len 16384 2024-04-26T18:39:18.023 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196352 len 16384 2024-04-26T18:39:18.023 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4196352 len 16384 2024-04-26T18:39:18.023 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196352 len 16384 2024-04-26T18:39:18.023 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4196864 len 1024 2024-04-26T18:39:18.023 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196864 len 1024 2024-04-26T18:39:18.023 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4196864 len 1024 2024-04-26T18:39:18.023 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196864 len 1024 2024-04-26T18:39:18.023 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4196864 len 2048 2024-04-26T18:39:18.023 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196864 len 2048 2024-04-26T18:39:18.023 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4196864 len 2048 2024-04-26T18:39:18.023 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196864 len 2048 2024-04-26T18:39:18.023 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4196864 len 4096 2024-04-26T18:39:18.023 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196864 len 4096 2024-04-26T18:39:18.024 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4196864 len 4096 2024-04-26T18:39:18.024 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196864 len 4096 2024-04-26T18:39:18.024 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4196864 len 8192 2024-04-26T18:39:18.024 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196864 len 8192 2024-04-26T18:39:18.024 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4196864 len 8192 2024-04-26T18:39:18.024 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196864 len 8192 2024-04-26T18:39:18.024 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4196864 len 16384 2024-04-26T18:39:18.024 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196864 len 16384 2024-04-26T18:39:18.024 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4196864 len 16384 2024-04-26T18:39:18.024 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4196864 len 16384 2024-04-26T18:39:18.024 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4197376 len 1024 2024-04-26T18:39:18.024 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197376 len 1024 2024-04-26T18:39:18.024 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4197376 len 1024 2024-04-26T18:39:18.024 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197376 len 1024 2024-04-26T18:39:18.024 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4197376 len 2048 2024-04-26T18:39:18.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197376 len 2048 2024-04-26T18:39:18.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4197376 len 2048 2024-04-26T18:39:18.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197376 len 2048 2024-04-26T18:39:18.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4197376 len 4096 2024-04-26T18:39:18.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197376 len 4096 2024-04-26T18:39:18.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4197376 len 4096 2024-04-26T18:39:18.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197376 len 4096 2024-04-26T18:39:18.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4197376 len 8192 2024-04-26T18:39:18.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197376 len 8192 2024-04-26T18:39:18.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4197376 len 8192 2024-04-26T18:39:18.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197376 len 8192 2024-04-26T18:39:18.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4197376 len 16384 2024-04-26T18:39:18.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197376 len 16384 2024-04-26T18:39:18.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4197376 len 16384 2024-04-26T18:39:18.025 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197376 len 16384 2024-04-26T18:39:18.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4197888 len 1024 2024-04-26T18:39:18.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197888 len 1024 2024-04-26T18:39:18.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4197888 len 1024 2024-04-26T18:39:18.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197888 len 1024 2024-04-26T18:39:18.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4197888 len 2048 2024-04-26T18:39:18.026 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197888 len 2048 2024-04-26T18:39:18.088 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4197888 len 2048 2024-04-26T18:39:18.088 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197888 len 2048 2024-04-26T18:39:18.088 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4197888 len 4096 2024-04-26T18:39:18.088 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197888 len 4096 2024-04-26T18:39:18.088 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4197888 len 4096 2024-04-26T18:39:18.088 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197888 len 4096 2024-04-26T18:39:18.088 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4197888 len 8192 2024-04-26T18:39:18.088 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197888 len 8192 2024-04-26T18:39:18.088 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4197888 len 8192 2024-04-26T18:39:18.089 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197888 len 8192 2024-04-26T18:39:18.089 INFO:tasks.workunit.client.0.smithi080.stdout:write_direct buf_align 3584 offset 4197888 len 16384 2024-04-26T18:39:18.089 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197888 len 16384 2024-04-26T18:39:18.089 INFO:tasks.workunit.client.0.smithi080.stdout:write_sync buf_align 3584 offset 4197888 len 16384 2024-04-26T18:39:18.089 INFO:tasks.workunit.client.0.smithi080.stdout:write_file buf_align 3584 offset 4197888 len 16384 2024-04-26T18:39:18.089 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T18:39:18.089 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T18:39:18.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:17 smithi192 ceph-mon[32842]: pgmap v88: 97 pgs: 97 active+clean; 544 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 151 MiB/s rd, 1.5 MiB/s wr, 526 op/s 2024-04-26T18:39:18.115 INFO:tasks.workunit:Stopping ['direct_io'] on client.0... 2024-04-26T18:39:18.115 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-26T18:39:18.422 DEBUG:teuthology.parallel:result is None 2024-04-26T18:39:18.422 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T18:39:18.452 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T18:39:18.452 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-04-26T18:39:18.466 INFO:tasks.quiescer:joining Quiescers 2024-04-26T18:39:18.466 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-04-26T18:39:18.466 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:39:18.729 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:39:19.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:19 smithi082 ceph-mon[32808]: pgmap v89: 97 pgs: 97 active+clean; 544 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 151 MiB/s rd, 1.5 MiB/s wr, 526 op/s 2024-04-26T18:39:19.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:19 smithi080 ceph-mon[29135]: pgmap v89: 97 pgs: 97 active+clean; 544 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 151 MiB/s rd, 1.5 MiB/s wr, 526 op/s 2024-04-26T18:39:20.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:19 smithi192 ceph-mon[32842]: pgmap v89: 97 pgs: 97 active+clean; 544 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 151 MiB/s rd, 1.5 MiB/s wr, 526 op/s 2024-04-26T18:39:20.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.579+0000 7f917e7f0700 1 -- 172.21.15.80:0/3850318345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9178108390 msgr2=0x7f9178108770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:20.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.579+0000 7f917e7f0700 1 --2- 172.21.15.80:0/3850318345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9178108390 0x7f9178108770 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9168009990 tx=0x7f9168009ca0 comp rx=0 tx=0).stop 2024-04-26T18:39:20.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.579+0000 7f917e7f0700 1 -- 172.21.15.80:0/3850318345 shutdown_connections 2024-04-26T18:39:20.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.579+0000 7f917e7f0700 1 --2- 172.21.15.80:0/3850318345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9178102ce0 0x7f917810f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:20.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.579+0000 7f917e7f0700 1 --2- 172.21.15.80:0/3850318345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9178108390 0x7f9178108770 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:20.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.579+0000 7f917e7f0700 1 --2- 172.21.15.80:0/3850318345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9178102320 0x7f91781027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:20.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.579+0000 7f917e7f0700 1 -- 172.21.15.80:0/3850318345 >> 172.21.15.80:0/3850318345 conn(0x7f91780792d0 msgr2=0x7f91780796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:39:20.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.579+0000 7f917e7f0700 1 -- 172.21.15.80:0/3850318345 shutdown_connections 2024-04-26T18:39:20.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.579+0000 7f917e7f0700 1 -- 172.21.15.80:0/3850318345 wait complete. 2024-04-26T18:39:20.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.580+0000 7f917e7f0700 1 Processor -- start 2024-04-26T18:39:20.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.580+0000 7f917e7f0700 1 -- start start 2024-04-26T18:39:20.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.580+0000 7f917e7f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9178102320 0x7f917819e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:20.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.580+0000 7f917e7f0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9178102ce0 0x7f917819ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.580+0000 7f917e7f0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9178108390 0x7f9178198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.580+0000 7f917e7f0700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9178112500 con 0x7f9178108390 2024-04-26T18:39:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.580+0000 7f917e7f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9178112380 con 0x7f9178102320 2024-04-26T18:39:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.580+0000 7f917e7f0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9178112680 con 0x7f9178102ce0 2024-04-26T18:39:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.580+0000 7f917cd8d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9178108390 0x7f9178198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.581+0000 7f917cd8d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9178108390 0x7f9178198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43564/0 (socket says 172.21.15.80:43564) 2024-04-26T18:39:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.581+0000 7f917cd8d700 1 -- 172.21.15.80:0/4214664015 learned_addr learned my addr 172.21.15.80:0/4214664015 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:39:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.581+0000 7f9177fff700 1 --2- 172.21.15.80:0/4214664015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9178102320 0x7f917819e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.581+0000 7f91777fe700 1 --2- 172.21.15.80:0/4214664015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9178102ce0 0x7f917819ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.581+0000 7f917cd8d700 1 -- 172.21.15.80:0/4214664015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9178102ce0 msgr2=0x7f917819ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.581+0000 7f917cd8d700 1 --2- 172.21.15.80:0/4214664015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9178102ce0 0x7f917819ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.581+0000 7f917cd8d700 1 -- 172.21.15.80:0/4214664015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9178102320 msgr2=0x7f917819e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.581+0000 7f917cd8d700 1 --2- 172.21.15.80:0/4214664015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9178102320 0x7f917819e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:20.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.581+0000 7f917cd8d700 1 -- 172.21.15.80:0/4214664015 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9178199060 con 0x7f9178108390 2024-04-26T18:39:20.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.581+0000 7f917cd8d700 1 --2- 172.21.15.80:0/4214664015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9178108390 0x7f9178198880 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f917000cfb0 tx=0x7f917000e330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:39:20.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.581+0000 7f91757fa700 1 -- 172.21.15.80:0/4214664015 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917000c2e0 con 0x7f9178108390 2024-04-26T18:39:20.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.581+0000 7f91757fa700 1 -- 172.21.15.80:0/4214664015 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f917000ee30 con 0x7f9178108390 2024-04-26T18:39:20.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.581+0000 7f917e7f0700 1 -- 172.21.15.80:0/4214664015 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9178199350 con 0x7f9178108390 2024-04-26T18:39:20.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.581+0000 7f91757fa700 1 -- 172.21.15.80:0/4214664015 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91700153f0 con 0x7f9178108390 2024-04-26T18:39:20.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.581+0000 7f917e7f0700 1 -- 172.21.15.80:0/4214664015 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f917806b100 con 0x7f9178108390 2024-04-26T18:39:20.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.582+0000 7f917e7f0700 1 -- 172.21.15.80:0/4214664015 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9178103a40 con 0x7f9178108390 2024-04-26T18:39:20.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.583+0000 7f91757fa700 1 -- 172.21.15.80:0/4214664015 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f917000a600 con 0x7f9178108390 2024-04-26T18:39:20.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.584+0000 7f91757fa700 1 --2- 172.21.15.80:0/4214664015 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f91640a3db0 0x7f91640a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:20.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.584+0000 7f91757fa700 1 -- 172.21.15.80:0/4214664015 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8440+0+0 (secure 0 0 0) 0x7f91700d2a40 con 0x7f9178108390 2024-04-26T18:39:20.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.584+0000 7f9177fff700 1 --2- 172.21.15.80:0/4214664015 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f91640a3db0 0x7f91640a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:20.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.584+0000 7f9177fff700 1 --2- 172.21.15.80:0/4214664015 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f91640a3db0 0x7f91640a6270 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9168009750 tx=0x7f9168005fd0 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:39:20.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.588+0000 7f91757fa700 1 -- 172.21.15.80:0/4214664015 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f917009f130 con 0x7f9178108390 2024-04-26T18:39:20.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.836+0000 7f917e7f0700 1 -- 172.21.15.80:0/4214664015 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f917806bb30 con 0x7f9178108390 2024-04-26T18:39:20.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.837+0000 7f91757fa700 1 -- 172.21.15.80:0/4214664015 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11921 (secure 0 0 0) 0x7f917009ea30 con 0x7f9178108390 2024-04-26T18:39:20.837 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:39:20.837 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1967550873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1967550873},{"type":"v1","addr":"172.21.15.80:6835","nonce":1967550873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/559541830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":559541830},{"type":"v1","addr":"172.21.15.80:6837","nonce":559541830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T18:33:08.347399+0000","modified":"2024-04-26T18:39:08.632950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24434,"mds_1":24421,"mds_2":24404,"mds_3":24400,"mds_4":24394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14577":{"gid":14577,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6839/2137993298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":2137993298},{"type":"v1","addr":"172.21.15.80:6839","nonce":2137993298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6841/1544670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1544670},{"type":"v1","addr":"172.21.15.80:6841","nonce":1544670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24371":{"gid":24371,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/3564539039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3564539039},{"type":"v1","addr":"172.21.15.82:6833","nonce":3564539039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24379":{"gid":24379,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.192:6835/719058020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":719058020},{"type":"v1","addr":"172.21.15.192:6835","nonce":719058020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.192:6837/2361996920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2361996920},{"type":"v1","addr":"172.21.15.192:6837","nonce":2361996920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.82:6837/2084055551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2084055551},{"type":"v1","addr":"172.21.15.82:6837","nonce":2084055551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6839/2735406056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":2735406056},{"type":"v1","addr":"172.21.15.192:6839","nonce":2735406056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.82:6839/1482576497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1482576497},{"type":"v1","addr":"172.21.15.82:6839","nonce":1482576497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25220":{"gid":25220,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/1661640740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1661640740},{"type":"v1","addr":"172.21.15.82:6835","nonce":1661640740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24434,"qdb_cluster":[24400,24421,24394,24434,24404]},"id":1}]} 2024-04-26T18:39:20.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.839+0000 7f917e7f0700 1 -- 172.21.15.80:0/4214664015 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f91640a3db0 msgr2=0x7f91640a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:20.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.839+0000 7f917e7f0700 1 --2- 172.21.15.80:0/4214664015 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f91640a3db0 0x7f91640a6270 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9168009750 tx=0x7f9168005fd0 comp rx=0 tx=0).stop 2024-04-26T18:39:20.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.839+0000 7f917e7f0700 1 -- 172.21.15.80:0/4214664015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9178108390 msgr2=0x7f9178198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:20.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.839+0000 7f917e7f0700 1 --2- 172.21.15.80:0/4214664015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9178108390 0x7f9178198880 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f917000cfb0 tx=0x7f917000e330 comp rx=0 tx=0).stop 2024-04-26T18:39:20.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.839+0000 7f917e7f0700 1 -- 172.21.15.80:0/4214664015 shutdown_connections 2024-04-26T18:39:20.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.839+0000 7f917e7f0700 1 --2- 172.21.15.80:0/4214664015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9178108390 0x7f9178198880 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:20.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.839+0000 7f917e7f0700 1 --2- 172.21.15.80:0/4214664015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9178102320 0x7f917819e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:20.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.839+0000 7f917e7f0700 1 --2- 172.21.15.80:0/4214664015 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f91640a3db0 0x7f91640a6270 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:20.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.839+0000 7f917e7f0700 1 --2- 172.21.15.80:0/4214664015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9178102ce0 0x7f917819ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:20.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.839+0000 7f917e7f0700 1 -- 172.21.15.80:0/4214664015 >> 172.21.15.80:0/4214664015 conn(0x7f91780792d0 msgr2=0x7f9178101090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:39:20.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.839+0000 7f917e7f0700 1 -- 172.21.15.80:0/4214664015 shutdown_connections 2024-04-26T18:39:20.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:20.839+0000 7f917e7f0700 1 -- 172.21.15.80:0/4214664015 wait complete. 2024-04-26T18:39:20.840 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 29 2024-04-26T18:39:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.186+0000 7f77a007b640 1 -- 172.21.15.80:0/2277986552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f779806bb20 msgr2=0x7f779810f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.186+0000 7f77a007b640 1 --2- 172.21.15.80:0/2277986552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f779806bb20 0x7f779810f7d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f7790009ca0 tx=0x7f779002a950 comp rx=0 tx=0).stop 2024-04-26T18:39:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.187+0000 7f77a007b640 1 -- 172.21.15.80:0/2277986552 shutdown_connections 2024-04-26T18:39:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.187+0000 7f77a007b640 1 --2- 172.21.15.80:0/2277986552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f779806bb20 0x7f779810f7d0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.187+0000 7f77a007b640 1 --2- 172.21.15.80:0/2277986552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f779806b160 0x7f779806b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.187+0000 7f77a007b640 1 --2- 172.21.15.80:0/2277986552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7798108b30 0x7f7798108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.187+0000 7f77a007b640 1 -- 172.21.15.80:0/2277986552 >> 172.21.15.80:0/2277986552 conn(0x7f7798077630 msgr2=0x7f7798077a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:39:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.187+0000 7f77a007b640 1 -- 172.21.15.80:0/2277986552 shutdown_connections 2024-04-26T18:39:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.187+0000 7f77a007b640 1 -- 172.21.15.80:0/2277986552 wait complete. 2024-04-26T18:39:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.187+0000 7f77a007b640 1 Processor -- start 2024-04-26T18:39:21.191 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.187+0000 7f77a007b640 1 -- start start 2024-04-26T18:39:21.191 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.187+0000 7f77a007b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f779806b160 0x7f7798198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:21.191 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.187+0000 7f77a007b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f779806bb20 0x7f77981994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:21.191 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.187+0000 7f77a007b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7798108b30 0x7f779819d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:21.191 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.187+0000 7f77a007b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7798112c00 con 0x7f779806b160 2024-04-26T18:39:21.191 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.187+0000 7f77a007b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7798112a80 con 0x7f7798108b30 2024-04-26T18:39:21.191 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.187+0000 7f77a007b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7798112d80 con 0x7f779806bb20 2024-04-26T18:39:21.191 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.187+0000 7f779de17640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f779806b160 0x7f7798198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:21.191 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.187+0000 7f779de17640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f779806b160 0x7f7798198f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43580/0 (socket says 172.21.15.80:43580) 2024-04-26T18:39:21.192 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.188+0000 7f779de17640 1 -- 172.21.15.80:0/2819854014 learned_addr learned my addr 172.21.15.80:0/2819854014 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:39:21.192 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.188+0000 7f779de17640 1 -- 172.21.15.80:0/2819854014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f779806bb20 msgr2=0x7f77981994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:21.192 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.188+0000 7f779d616640 1 --2- 172.21.15.80:0/2819854014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f779806bb20 0x7f77981994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:21.192 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.188+0000 7f779e618640 1 --2- 172.21.15.80:0/2819854014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7798108b30 0x7f779819d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:21.192 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.188+0000 7f779de17640 1 --2- 172.21.15.80:0/2819854014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f779806bb20 0x7f77981994c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.192 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.188+0000 7f779de17640 1 -- 172.21.15.80:0/2819854014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7798108b30 msgr2=0x7f779819d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:21.192 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.188+0000 7f779de17640 1 --2- 172.21.15.80:0/2819854014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7798108b30 0x7f779819d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.192 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.188+0000 7f779de17640 1 -- 172.21.15.80:0/2819854014 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f779819df70 con 0x7f779806b160 2024-04-26T18:39:21.192 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.188+0000 7f779de17640 1 --2- 172.21.15.80:0/2819854014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f779806b160 0x7f7798198f80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f779400c920 tx=0x7f779400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:39:21.192 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.188+0000 7f778effd640 1 -- 172.21.15.80:0/2819854014 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7794007c70 con 0x7f779806b160 2024-04-26T18:39:21.193 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.188+0000 7f778effd640 1 -- 172.21.15.80:0/2819854014 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7794007e10 con 0x7f779806b160 2024-04-26T18:39:21.193 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.188+0000 7f77a007b640 1 -- 172.21.15.80:0/2819854014 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f779819e260 con 0x7f779806b160 2024-04-26T18:39:21.193 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.188+0000 7f778effd640 1 -- 172.21.15.80:0/2819854014 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7794018820 con 0x7f779806b160 2024-04-26T18:39:21.193 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.188+0000 7f77a007b640 1 -- 172.21.15.80:0/2819854014 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77981a5af0 con 0x7f779806b160 2024-04-26T18:39:21.201 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.190+0000 7f778effd640 1 -- 172.21.15.80:0/2819854014 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f779400f450 con 0x7f779806b160 2024-04-26T18:39:21.201 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.190+0000 7f77a2d94740 1 Processor -- start 2024-04-26T18:39:21.201 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.191+0000 7f77a2d94740 1 -- start start 2024-04-26T18:39:21.201 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.191+0000 7f77a2d94740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5608d64d1f00 0x5608d64d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:21.201 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.191+0000 7f77a2d94740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608d64d2820 0x5608d64dcba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:21.201 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.191+0000 7f77a2d94740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64dd0e0 0x5608d64df4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:21.201 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.191+0000 7f77a2d94740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5608d6438460 con 0x5608d64dd0e0 2024-04-26T18:39:21.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.191+0000 7f77a2d94740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5608d63f2590 con 0x5608d64d2820 2024-04-26T18:39:21.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.191+0000 7f77a2d94740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5608d6434420 con 0x5608d64d1f00 2024-04-26T18:39:21.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.191+0000 7f778effd640 1 --2- 172.21.15.80:0/2819854014 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f77840a3dc0 0x7f77840a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:21.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.191+0000 7f779d616640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64dd0e0 0x5608d64df4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:21.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.191+0000 7f779d616640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64dd0e0 0x5608d64df4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43594/0 (socket says 172.21.15.80:43594) 2024-04-26T18:39:21.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.191+0000 7f779d616640 1 -- 172.21.15.80:0/3958076662 learned_addr learned my addr 172.21.15.80:0/3958076662 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:39:21.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.191+0000 7f779e618640 1 --2- 172.21.15.80:0/2819854014 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f77840a3dc0 0x7f77840a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:21.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.191+0000 7f779de17640 1 --2- 172.21.15.80:0/3958076662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608d64d2820 0x5608d64dcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:21.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.191+0000 7f778effd640 1 -- 172.21.15.80:0/2819854014 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8440+0+0 (secure 0 0 0) 0x7f77940d0980 con 0x7f779806b160 2024-04-26T18:39:21.202 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.191+0000 7f779e618640 1 --2- 172.21.15.80:0/3958076662 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5608d64d1f00 0x5608d64d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:21.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.191+0000 7f779d616640 1 -- 172.21.15.80:0/3958076662 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5608d64d1f00 msgr2=0x5608d64d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:39:21.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.191+0000 7f779d616640 1 --2- 172.21.15.80:0/3958076662 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5608d64d1f00 0x5608d64d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.191+0000 7f779d616640 1 -- 172.21.15.80:0/3958076662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608d64d2820 msgr2=0x5608d64dcba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:39:21.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.191+0000 7f779d616640 1 --2- 172.21.15.80:0/3958076662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608d64d2820 0x5608d64dcba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.191+0000 7f779d616640 1 -- 172.21.15.80:0/3958076662 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608d63ff0d0 con 0x5608d64dd0e0 2024-04-26T18:39:21.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.191+0000 7f779e618640 1 --2- 172.21.15.80:0/3958076662 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5608d64d1f00 0x5608d64d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:39:21.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.191+0000 7f779d616640 1 --2- 172.21.15.80:0/3958076662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64dd0e0 0x5608d64df4d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f778800a8e0 tx=0x7f778800ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0bdac4e066a47 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:39:21.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.192+0000 7f779e618640 1 --2- 172.21.15.80:0/2819854014 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f77840a3dc0 0x7f77840a6280 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7790005e30 tx=0x7f7790005d80 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:39:21.203 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.192+0000 7f7783fff640 1 -- 172.21.15.80:0/3958076662 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7788015070 con 0x5608d64dd0e0 2024-04-26T18:39:21.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.192+0000 7f7783fff640 1 -- 172.21.15.80:0/3958076662 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77880113f0 con 0x5608d64dd0e0 2024-04-26T18:39:21.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.192+0000 7f7783fff640 1 -- 172.21.15.80:0/3958076662 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7788018560 con 0x5608d64dd0e0 2024-04-26T18:39:21.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.192+0000 7f77a2d94740 1 -- 172.21.15.80:0/3958076662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64dd0e0 msgr2=0x5608d64df4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:21.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.192+0000 7f77a2d94740 1 --2- 172.21.15.80:0/3958076662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64dd0e0 0x5608d64df4d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f778800a8e0 tx=0x7f778800ada0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.192+0000 7f77a2d94740 1 -- 172.21.15.80:0/3958076662 shutdown_connections 2024-04-26T18:39:21.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.192+0000 7f77a2d94740 1 --2- 172.21.15.80:0/3958076662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64dd0e0 0x5608d64df4d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.192+0000 7f77a2d94740 1 --2- 172.21.15.80:0/3958076662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608d64d2820 0x5608d64dcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.192+0000 7f77a2d94740 1 --2- 172.21.15.80:0/3958076662 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5608d64d1f00 0x5608d64d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.192+0000 7f77a2d94740 1 -- 172.21.15.80:0/3958076662 >> 172.21.15.80:0/3958076662 conn(0x5608d64ce410 msgr2=0x5608d64ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:39:21.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.192+0000 7f77a2d94740 1 -- 172.21.15.80:0/3958076662 shutdown_connections 2024-04-26T18:39:21.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.192+0000 7f77a2d94740 1 -- 172.21.15.80:0/3958076662 wait complete. 2024-04-26T18:39:21.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.193+0000 7f77a2d94740 1 -- start start 2024-04-26T18:39:21.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.193+0000 7f77a2d94740 1 Processor -- start 2024-04-26T18:39:21.204 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.193+0000 7f77a2d94740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64d1f00 0x5608d64da010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:21.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.193+0000 7f77a2d94740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5608d64d2820 0x5608d64da550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:21.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.193+0000 7f77a2d94740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608d64dd0e0 0x5608d64daa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:21.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.193+0000 7f77a2d94740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5608d64dfd10 con 0x5608d64d1f00 2024-04-26T18:39:21.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.193+0000 7f77a2d94740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5608d63bfb60 con 0x5608d64dd0e0 2024-04-26T18:39:21.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.193+0000 7f77a2d94740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5608d64dfe90 con 0x5608d64d2820 2024-04-26T18:39:21.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.193+0000 7f77a2d94740 10 client.0 _ll_register_callbacks cb 0x5608d63e42b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:39:21.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.193+0000 7f779de17640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64d1f00 0x5608d64da010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:21.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.193+0000 7f779de17640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64d1f00 0x5608d64da010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43608/0 (socket says 172.21.15.80:43608) 2024-04-26T18:39:21.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.193+0000 7f779de17640 1 -- 172.21.15.80:0/2480439113 learned_addr learned my addr 172.21.15.80:0/2480439113 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:39:21.205 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.193+0000 7f779de17640 1 -- 172.21.15.80:0/2480439113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5608d64d2820 msgr2=0x5608d64da550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:39:21.206 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.193+0000 7f779de17640 1 --2- 172.21.15.80:0/2480439113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5608d64d2820 0x5608d64da550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.206 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.194+0000 7f779de17640 1 -- 172.21.15.80:0/2480439113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608d64dd0e0 msgr2=0x5608d64daa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:39:21.206 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.194+0000 7f779de17640 1 --2- 172.21.15.80:0/2480439113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608d64dd0e0 0x5608d64daa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.206 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.194+0000 7f779de17640 1 -- 172.21.15.80:0/2480439113 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608d614a210 con 0x5608d64d1f00 2024-04-26T18:39:21.206 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.194+0000 7f779de17640 1 --2- 172.21.15.80:0/2480439113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64d1f00 0x5608d64da010 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f779409c900 tx=0x7f7794015aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c155061264b24e00 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:39:21.206 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.194+0000 7f77817fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:39:21.206 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.194+0000 7f77817fa640 1 -- 172.21.15.80:0/2480439113 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7794014210 con 0x5608d64d1f00 2024-04-26T18:39:21.206 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.194+0000 7f77817fa640 1 -- 172.21.15.80:0/2480439113 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8440+0+0 (secure 0 0 0) 0x7f77940ce3a0 con 0x5608d64d1f00 2024-04-26T18:39:21.206 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.194+0000 7f77a2d94740 1 -- 172.21.15.80:0/2480439113 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77880113f0 con 0x5608d64d1f00 2024-04-26T18:39:21.206 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.194+0000 7f77817fa640 1 -- 172.21.15.80:0/2480439113 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f779409c970 con 0x5608d64d1f00 2024-04-26T18:39:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.194+0000 7f77a2d94740 10 client.15765 fetch_fsmap learned FSMap version 29 2024-04-26T18:39:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.194+0000 7f77a2d94740 1 -- 172.21.15.80:0/2480439113 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5608d6216620 con 0x5608d64d1f00 2024-04-26T18:39:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.194+0000 7f77817fa640 1 -- 172.21.15.80:0/2480439113 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77880113f0 con 0x5608d64d1f00 2024-04-26T18:39:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.194+0000 7f77817fa640 1 -- 172.21.15.80:0/2480439113 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f77940a5150 con 0x5608d64d1f00 2024-04-26T18:39:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.194+0000 7f77a2d94740 10 client.15765 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:39:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.194+0000 7f77a2d94740 10 client.15765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:39:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.194+0000 7f77a2d94740 20 client.15765 populate_metadata read hostname 'smithi080' 2024-04-26T18:39:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.194+0000 7f77a2d94740 1 --2- 172.21.15.80:0/2480439113 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x5608d64ed1e0 0x5608d64ef5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.194+0000 7f77a2d94740 4 client.15765 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:39:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.194+0000 7f77a2d94740 1 -- 172.21.15.80:0/2480439113 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608d6446070 con 0x5608d64ed1e0 2024-04-26T18:39:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.195+0000 7f779d616640 1 --2- 172.21.15.80:0/2480439113 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x5608d64ed1e0 0x5608d64ef5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.195+0000 7f779d616640 1 --2- 172.21.15.80:0/2480439113 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x5608d64ed1e0 0x5608d64ef5f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dd9eb4a246689e7 server_cookie=317c24c754b56e3a in_seq=0 out_seq=0 2024-04-26T18:39:21.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.195+0000 7f77817fa640 10 client.15765 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:39:21.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.196+0000 7f77817fa640 1 -- 172.21.15.80:0/2480439113 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5608d6446070 con 0x5608d64ed1e0 2024-04-26T18:39:21.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.196+0000 7f77817fa640 10 client.15765 handle_command_reply: tid=0 2024-04-26T18:39:21.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.196+0000 7f77a2d94740 1 client.15765 shutdown 2024-04-26T18:39:21.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.196+0000 7f77a2d94740 1 -- 172.21.15.80:0/2480439113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64d1f00 msgr2=0x5608d64da010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:21.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.196+0000 7f77a2d94740 1 --2- 172.21.15.80:0/2480439113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64d1f00 0x5608d64da010 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f779409c900 tx=0x7f7794015aa0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.196+0000 7f77a2d94740 1 -- 172.21.15.80:0/2480439113 shutdown_connections 2024-04-26T18:39:21.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.196+0000 7f77a2d94740 1 --2- 172.21.15.80:0/2480439113 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x5608d64ed1e0 0x5608d64ef5f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.196+0000 7f77a2d94740 1 --2- 172.21.15.80:0/2480439113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608d64dd0e0 0x5608d64daa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.196+0000 7f77a2d94740 1 --2- 172.21.15.80:0/2480439113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5608d64d2820 0x5608d64da550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.196+0000 7f77a2d94740 1 --2- 172.21.15.80:0/2480439113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64d1f00 0x5608d64da010 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.208 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.196+0000 7f77817fa640 0 client.15765 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:39:21.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.196+0000 7f77a2d94740 1 -- 172.21.15.80:0/2480439113 >> 172.21.15.80:0/2480439113 conn(0x5608d64ce410 msgr2=0x5608d64cd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:39:21.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.196+0000 7f77a2d94740 1 -- 172.21.15.80:0/2480439113 shutdown_connections 2024-04-26T18:39:21.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.196+0000 7f77a2d94740 1 -- 172.21.15.80:0/2480439113 wait complete. 2024-04-26T18:39:21.209 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.196+0000 7f77a2d94740 20 client.15765 trim_cache size 0 max 16384 2024-04-26T18:39:21.216 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.211+0000 7f77a2d94740 1 Processor -- start 2024-04-26T18:39:21.216 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.211+0000 7f77a2d94740 1 -- start start 2024-04-26T18:39:21.216 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.211+0000 7f77a2d94740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5608d64d1f00 0x5608d64e8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:21.216 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.211+0000 7f77a2d94740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64d2820 0x5608d64f4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:21.216 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.211+0000 7f77a2d94740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608d64dd0e0 0x5608d64f5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:21.216 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.211+0000 7f77a2d94740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f77981ae2c0 con 0x5608d64d2820 2024-04-26T18:39:21.216 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.211+0000 7f77a2d94740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f77981afe00 con 0x5608d64dd0e0 2024-04-26T18:39:21.216 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.211+0000 7f77a2d94740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f77981ae990 con 0x5608d64d1f00 2024-04-26T18:39:21.216 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.211+0000 7f779d616640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64d2820 0x5608d64f4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:21.216 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.211+0000 7f779d616640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64d2820 0x5608d64f4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43614/0 (socket says 172.21.15.80:43614) 2024-04-26T18:39:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.211+0000 7f779d616640 1 -- 172.21.15.80:0/1352690286 learned_addr learned my addr 172.21.15.80:0/1352690286 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:39:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.211+0000 7f779d616640 1 -- 172.21.15.80:0/1352690286 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5608d64d1f00 msgr2=0x5608d64e8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:39:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.211+0000 7f779d616640 1 --2- 172.21.15.80:0/1352690286 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5608d64d1f00 0x5608d64e8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.211+0000 7f779d616640 1 -- 172.21.15.80:0/1352690286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608d64dd0e0 msgr2=0x5608d64f5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:39:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.211+0000 7f779d616640 1 --2- 172.21.15.80:0/1352690286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608d64dd0e0 0x5608d64f5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.211+0000 7f779d616640 1 -- 172.21.15.80:0/1352690286 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608d64ebd80 con 0x5608d64d2820 2024-04-26T18:39:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.211+0000 7f779d616640 1 --2- 172.21.15.80:0/1352690286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64d2820 0x5608d64f4f00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f778800c520 tx=0x7f7788008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8673d31ca284f132 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:39:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.211+0000 7f77837fe640 1 -- 172.21.15.80:0/1352690286 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7788028070 con 0x5608d64d2820 2024-04-26T18:39:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.211+0000 7f77837fe640 1 -- 172.21.15.80:0/1352690286 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7788011e40 con 0x5608d64d2820 2024-04-26T18:39:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.211+0000 7f77837fe640 1 -- 172.21.15.80:0/1352690286 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7788015040 con 0x5608d64d2820 2024-04-26T18:39:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.212+0000 7f77a2d94740 1 -- 172.21.15.80:0/1352690286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64d2820 msgr2=0x5608d64f4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.212+0000 7f77a2d94740 1 --2- 172.21.15.80:0/1352690286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64d2820 0x5608d64f4f00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f778800c520 tx=0x7f7788008040 comp rx=0 tx=0).stop 2024-04-26T18:39:21.218 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.212+0000 7f77a2d94740 1 -- 172.21.15.80:0/1352690286 shutdown_connections 2024-04-26T18:39:21.218 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.212+0000 7f77a2d94740 1 --2- 172.21.15.80:0/1352690286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64d2820 0x5608d64f4f00 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.218 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.212+0000 7f77a2d94740 1 --2- 172.21.15.80:0/1352690286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608d64dd0e0 0x5608d64f5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.218 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.212+0000 7f77a2d94740 1 --2- 172.21.15.80:0/1352690286 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5608d64d1f00 0x5608d64e8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.218 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.212+0000 7f77a2d94740 1 -- 172.21.15.80:0/1352690286 >> 172.21.15.80:0/1352690286 conn(0x5608d64ce410 msgr2=0x5608d64ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:39:21.218 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.212+0000 7f77a2d94740 1 -- 172.21.15.80:0/1352690286 shutdown_connections 2024-04-26T18:39:21.218 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.212+0000 7f77a2d94740 1 -- 172.21.15.80:0/1352690286 wait complete. 2024-04-26T18:39:21.218 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.212+0000 7f77a2d94740 1 -- start start 2024-04-26T18:39:21.218 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.212+0000 7f77a2d94740 1 Processor -- start 2024-04-26T18:39:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.213+0000 7f77a2d94740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64d1f00 0x5608d64e0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.213+0000 7f77a2d94740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608d64d2820 0x5608d64e1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.213+0000 7f77a2d94740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5608d64dd0e0 0x5608d64e1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.213+0000 7f77a2d94740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f77981af730 con 0x5608d64d1f00 2024-04-26T18:39:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.213+0000 7f77a2d94740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f77981af060 con 0x5608d64d2820 2024-04-26T18:39:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.213+0000 7f77a2d94740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f77981ac2a0 con 0x5608d64dd0e0 2024-04-26T18:39:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.213+0000 7f77a2d94740 10 client.0 _ll_register_callbacks cb 0x7f779409c4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:39:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.213+0000 7f779de17640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64d1f00 0x5608d64e0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.213+0000 7f779de17640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64d1f00 0x5608d64e0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43628/0 (socket says 172.21.15.80:43628) 2024-04-26T18:39:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.213+0000 7f779de17640 1 -- 172.21.15.80:0/1299431703 learned_addr learned my addr 172.21.15.80:0/1299431703 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:39:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.213+0000 7f779d616640 1 --2- 172.21.15.80:0/1299431703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608d64d2820 0x5608d64e1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.213+0000 7f779e618640 1 --2- 172.21.15.80:0/1299431703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5608d64dd0e0 0x5608d64e1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.213+0000 7f779de17640 1 -- 172.21.15.80:0/1299431703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5608d64dd0e0 msgr2=0x5608d64e1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:39:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.213+0000 7f779de17640 1 --2- 172.21.15.80:0/1299431703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5608d64dd0e0 0x5608d64e1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.213+0000 7f779de17640 1 -- 172.21.15.80:0/1299431703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608d64d2820 msgr2=0x5608d64e1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:39:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.213+0000 7f779de17640 1 --2- 172.21.15.80:0/1299431703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608d64d2820 0x5608d64e1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.213+0000 7f779de17640 1 -- 172.21.15.80:0/1299431703 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608d6556c80 con 0x5608d64d1f00 2024-04-26T18:39:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.213+0000 7f779de17640 1 --2- 172.21.15.80:0/1299431703 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64d1f00 0x5608d64e0c10 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7794098dd0 tx=0x7f779400a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=847b4bb863655e9f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:39:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.213+0000 7f77817fa640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:39:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.213+0000 7f77817fa640 1 -- 172.21.15.80:0/1299431703 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7794097260 con 0x5608d64d1f00 2024-04-26T18:39:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.213+0000 7f77817fa640 1 -- 172.21.15.80:0/1299431703 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8440+0+0 (secure 0 0 0) 0x7f77940ce3a0 con 0x5608d64d1f00 2024-04-26T18:39:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.213+0000 7f77a2d94740 1 -- 172.21.15.80:0/1299431703 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5608d643fee0 con 0x5608d64d1f00 2024-04-26T18:39:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.214+0000 7f77817fa640 1 -- 172.21.15.80:0/1299431703 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f77940a0d20 con 0x5608d64d1f00 2024-04-26T18:39:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.214+0000 7f77a2d94740 10 client.15771 fetch_fsmap learned FSMap version 29 2024-04-26T18:39:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.214+0000 7f77a2d94740 1 -- 172.21.15.80:0/1299431703 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5608d6557f90 con 0x5608d64d1f00 2024-04-26T18:39:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.214+0000 7f77817fa640 1 -- 172.21.15.80:0/1299431703 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5608d643fee0 con 0x5608d64d1f00 2024-04-26T18:39:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.214+0000 7f77817fa640 1 -- 172.21.15.80:0/1299431703 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f77940988c0 con 0x5608d64d1f00 2024-04-26T18:39:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.214+0000 7f77a2d94740 10 client.15771 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:39:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.214+0000 7f77a2d94740 10 client.15771 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:39:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.214+0000 7f77a2d94740 20 client.15771 populate_metadata read hostname 'smithi080' 2024-04-26T18:39:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.214+0000 7f77a2d94740 1 --2- 172.21.15.80:0/1299431703 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x5608d65584f0 0x5608d655a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.214+0000 7f77a2d94740 4 client.15771 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:39:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.214+0000 7f77a2d94740 1 -- 172.21.15.80:0/1299431703 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5608d63bb5f0 con 0x5608d65584f0 2024-04-26T18:39:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.214+0000 7f779d616640 1 --2- 172.21.15.80:0/1299431703 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x5608d65584f0 0x5608d655a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.214+0000 7f77817fa640 10 client.15771 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:39:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.214+0000 7f779d616640 1 --2- 172.21.15.80:0/1299431703 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x5608d65584f0 0x5608d655a910 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c76ba6abbb76540 server_cookie=3ba981d8fc725439 in_seq=0 out_seq=0 2024-04-26T18:39:21.252 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.251+0000 7f77817fa640 1 -- 172.21.15.80:0/1299431703 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5608d63bb5f0 con 0x5608d65584f0 2024-04-26T18:39:21.252 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.251+0000 7f77817fa640 10 client.15771 handle_command_reply: tid=0 2024-04-26T18:39:21.252 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.251+0000 7f77a2d94740 1 client.15771 shutdown 2024-04-26T18:39:21.252 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.251+0000 7f77a2d94740 1 -- 172.21.15.80:0/1299431703 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64d1f00 msgr2=0x5608d64e0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:21.253 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.251+0000 7f77a2d94740 1 --2- 172.21.15.80:0/1299431703 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64d1f00 0x5608d64e0c10 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7794098dd0 tx=0x7f779400a560 comp rx=0 tx=0).stop 2024-04-26T18:39:21.253 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.252+0000 7f77a2d94740 1 -- 172.21.15.80:0/1299431703 shutdown_connections 2024-04-26T18:39:21.253 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.252+0000 7f77a2d94740 1 --2- 172.21.15.80:0/1299431703 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x5608d65584f0 0x5608d655a910 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.253 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.252+0000 7f77a2d94740 1 --2- 172.21.15.80:0/1299431703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5608d64dd0e0 0x5608d64e1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.253 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.252+0000 7f77a2d94740 1 --2- 172.21.15.80:0/1299431703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608d64d2820 0x5608d64e1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.253 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.252+0000 7f77a2d94740 1 --2- 172.21.15.80:0/1299431703 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5608d64d1f00 0x5608d64e0c10 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.253 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.252+0000 7f77817fa640 0 client.15771 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:39:21.253 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.252+0000 7f77a2d94740 1 -- 172.21.15.80:0/1299431703 >> 172.21.15.80:0/1299431703 conn(0x5608d64ce410 msgr2=0x5608d64d9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:39:21.253 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.252+0000 7f77a2d94740 1 -- 172.21.15.80:0/1299431703 shutdown_connections 2024-04-26T18:39:21.254 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.252+0000 7f77a2d94740 1 -- 172.21.15.80:0/1299431703 wait complete. 2024-04-26T18:39:21.254 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.252+0000 7f77a2d94740 20 client.15771 trim_cache size 0 max 16384 2024-04-26T18:39:21.254 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:{ 2024-04-26T18:39:21.254 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "message": "", 2024-04-26T18:39:21.254 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout: "return_code": 0 2024-04-26T18:39:21.254 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stdout:} 2024-04-26T18:39:21.255 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.252+0000 7f77a007b640 1 -- 172.21.15.80:0/2819854014 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f77840a3dc0 msgr2=0x7f77840a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:21.255 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.252+0000 7f77a007b640 1 --2- 172.21.15.80:0/2819854014 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f77840a3dc0 0x7f77840a6280 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7790005e30 tx=0x7f7790005d80 comp rx=0 tx=0).stop 2024-04-26T18:39:21.255 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.252+0000 7f77a007b640 1 -- 172.21.15.80:0/2819854014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f779806b160 msgr2=0x7f7798198f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:21.255 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.252+0000 7f77a007b640 1 --2- 172.21.15.80:0/2819854014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f779806b160 0x7f7798198f80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f779400c920 tx=0x7f779400cde0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.256 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.252+0000 7f77a007b640 1 -- 172.21.15.80:0/2819854014 shutdown_connections 2024-04-26T18:39:21.256 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.252+0000 7f77a007b640 1 --2- 172.21.15.80:0/2819854014 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f77840a3dc0 0x7f77840a6280 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.256 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.252+0000 7f77a007b640 1 --2- 172.21.15.80:0/2819854014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7798108b30 0x7f779819d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.256 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.252+0000 7f77a007b640 1 --2- 172.21.15.80:0/2819854014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f779806bb20 0x7f77981994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.256 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.252+0000 7f77a007b640 1 --2- 172.21.15.80:0/2819854014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f779806b160 0x7f7798198f80 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:21.256 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.252+0000 7f77a007b640 1 -- 172.21.15.80:0/2819854014 >> 172.21.15.80:0/2819854014 conn(0x7f7798077630 msgr2=0x7f7798100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:39:21.256 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.252+0000 7f77a007b640 1 -- 172.21.15.80:0/2819854014 shutdown_connections 2024-04-26T18:39:21.256 INFO:teuthology.task.background_exec.ubuntu@smithi080.front.sepia.ceph.com.smithi080.stderr:2024-04-26T18:39:21.252+0000 7f77a007b640 1 -- 172.21.15.80:0/2819854014 wait complete. 2024-04-26T18:39:21.688 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24434 quiesce db --cancel --all' 2024-04-26T18:39:21.688 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24434 quiesce db --cancel --all 2024-04-26T18:39:21.927 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:39:21.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:21 smithi082 ceph-mon[32808]: pgmap v90: 97 pgs: 97 active+clean; 292 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 187 MiB/s rd, 2.0 MiB/s wr, 674 op/s 2024-04-26T18:39:21.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:21 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/4214664015' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:39:21.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:21 smithi080 ceph-mon[29135]: pgmap v90: 97 pgs: 97 active+clean; 292 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 187 MiB/s rd, 2.0 MiB/s wr, 674 op/s 2024-04-26T18:39:21.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:21 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/4214664015' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:39:22.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:21 smithi192 ceph-mon[32842]: pgmap v90: 97 pgs: 97 active+clean; 292 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 187 MiB/s rd, 2.0 MiB/s wr, 674 op/s 2024-04-26T18:39:22.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:21 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/4214664015' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:39:23.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.745+0000 7f9e9f434700 1 -- 172.21.15.80:0/398528463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e98103e30 msgr2=0x7f9e98110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:23.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.745+0000 7f9e9f434700 1 --2- 172.21.15.80:0/398528463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e98103e30 0x7f9e98110290 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000b0a0 tx=0x7f9e9000b3b0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.746+0000 7f9e9f434700 1 -- 172.21.15.80:0/398528463 shutdown_connections 2024-04-26T18:39:23.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.746+0000 7f9e9f434700 1 --2- 172.21.15.80:0/398528463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e98103e30 0x7f9e98110290 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.746+0000 7f9e9f434700 1 --2- 172.21.15.80:0/398528463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e981094c0 0x7f9e981098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.746+0000 7f9e9f434700 1 --2- 172.21.15.80:0/398528463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e98103470 0x7f9e981038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.746+0000 7f9e9f434700 1 -- 172.21.15.80:0/398528463 >> 172.21.15.80:0/398528463 conn(0x7f9e9807a580 msgr2=0x7f9e9807a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:39:23.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.746+0000 7f9e9f434700 1 -- 172.21.15.80:0/398528463 shutdown_connections 2024-04-26T18:39:23.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.746+0000 7f9e9f434700 1 -- 172.21.15.80:0/398528463 wait complete. 2024-04-26T18:39:23.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.746+0000 7f9e9f434700 1 Processor -- start 2024-04-26T18:39:23.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.746+0000 7f9e9f434700 1 -- start start 2024-04-26T18:39:23.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.746+0000 7f9e9f434700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e98103470 0x7f9e9819f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:23.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.746+0000 7f9e9f434700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e98103e30 0x7f9e9819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:23.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.747+0000 7f9e9f434700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e981094c0 0x7f9e981998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:23.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.747+0000 7f9e9f434700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9e98113640 con 0x7f9e98103e30 2024-04-26T18:39:23.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.747+0000 7f9e9f434700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9e981134c0 con 0x7f9e981094c0 2024-04-26T18:39:23.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.747+0000 7f9e9f434700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9e981137c0 con 0x7f9e98103470 2024-04-26T18:39:23.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.747+0000 7f9e9c9cf700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e98103e30 0x7f9e9819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:23.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.747+0000 7f9e9c9cf700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e98103e30 0x7f9e9819fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56120/0 (socket says 172.21.15.80:56120) 2024-04-26T18:39:23.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.747+0000 7f9e9c9cf700 1 -- 172.21.15.80:0/1908164805 learned_addr learned my addr 172.21.15.80:0/1908164805 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:39:23.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.747+0000 7f9e9d1d0700 1 --2- 172.21.15.80:0/1908164805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e98103470 0x7f9e9819f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:23.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.747+0000 7f9e9d9d1700 1 --2- 172.21.15.80:0/1908164805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e981094c0 0x7f9e981998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:23.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.747+0000 7f9e9c9cf700 1 -- 172.21.15.80:0/1908164805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e98103470 msgr2=0x7f9e9819f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:23.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.747+0000 7f9e9c9cf700 1 --2- 172.21.15.80:0/1908164805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e98103470 0x7f9e9819f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.747+0000 7f9e9c9cf700 1 -- 172.21.15.80:0/1908164805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e981094c0 msgr2=0x7f9e981998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:23.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.747+0000 7f9e9c9cf700 1 --2- 172.21.15.80:0/1908164805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e981094c0 0x7f9e981998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.747+0000 7f9e9c9cf700 1 -- 172.21.15.80:0/1908164805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9819a020 con 0x7f9e98103e30 2024-04-26T18:39:23.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.747+0000 7f9e9c9cf700 1 --2- 172.21.15.80:0/1908164805 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e98103e30 0x7f9e9819fc40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800c9b0 tx=0x7f9e8800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:39:23.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.747+0000 7f9e8e7fc700 1 -- 172.21.15.80:0/1908164805 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e88007b00 con 0x7f9e98103e30 2024-04-26T18:39:23.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.747+0000 7f9e8e7fc700 1 -- 172.21.15.80:0/1908164805 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e8800ce50 con 0x7f9e98103e30 2024-04-26T18:39:23.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.747+0000 7f9e9f434700 1 -- 172.21.15.80:0/1908164805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e9819a310 con 0x7f9e98103e30 2024-04-26T18:39:23.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.747+0000 7f9e8e7fc700 1 -- 172.21.15.80:0/1908164805 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e88018660 con 0x7f9e98103e30 2024-04-26T18:39:23.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.747+0000 7f9e9f434700 1 -- 172.21.15.80:0/1908164805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e981a65d0 con 0x7f9e98103e30 2024-04-26T18:39:23.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.749+0000 7f9e8e7fc700 1 -- 172.21.15.80:0/1908164805 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f9e8800f450 con 0x7f9e98103e30 2024-04-26T18:39:23.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.750+0000 7f9e8e7fc700 1 --2- 172.21.15.80:0/1908164805 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f9e840a3db0 0x7f9e840a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:23.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.750+0000 7f9e9d1d0700 1 --2- 172.21.15.80:0/1908164805 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f9e840a3db0 0x7f9e840a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:23.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.751+0000 7f9e8e7fc700 1 -- 172.21.15.80:0/1908164805 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8440+0+0 (secure 0 0 0) 0x7f9e880d06d0 con 0x7f9e98103e30 2024-04-26T18:39:23.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.751+0000 7f9e9d1d0700 1 --2- 172.21.15.80:0/1908164805 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f9e840a3db0 0x7f9e840a6270 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9e9819aa00 tx=0x7f9e94009190 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:39:23.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.751+0000 7f9ea9cc6b80 1 Processor -- start 2024-04-26T18:39:23.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.751+0000 7f9ea9cc6b80 1 -- start start 2024-04-26T18:39:23.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.751+0000 7f9ea9cc6b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563481a68e10 0x563481a691f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:23.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.751+0000 7f9ea9cc6b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a69730 0x563481a631c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:23.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.752+0000 7f9ea9cc6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563481a637e0 0x563481a63c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:23.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.752+0000 7f9ea9cc6b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x5634819b58a0 con 0x563481a69730 2024-04-26T18:39:23.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.752+0000 7f9ea9cc6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56348191b9a0 con 0x563481a637e0 2024-04-26T18:39:23.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.752+0000 7f9ea9cc6b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5634819b1860 con 0x563481a68e10 2024-04-26T18:39:23.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.752+0000 7f9e9c9cf700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a69730 0x563481a631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:23.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.752+0000 7f9e9c9cf700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a69730 0x563481a631c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56136/0 (socket says 172.21.15.80:56136) 2024-04-26T18:39:23.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.752+0000 7f9e9c9cf700 1 -- 172.21.15.80:0/792218572 learned_addr learned my addr 172.21.15.80:0/792218572 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:39:23.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.752+0000 7f9e9d9d1700 1 --2- 172.21.15.80:0/792218572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563481a637e0 0x563481a63c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:23.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.752+0000 7f9e9d1d0700 1 --2- 172.21.15.80:0/792218572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563481a68e10 0x563481a691f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:23.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.752+0000 7f9e9c9cf700 1 -- 172.21.15.80:0/792218572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563481a68e10 msgr2=0x563481a691f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:39:23.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.752+0000 7f9e9c9cf700 1 --2- 172.21.15.80:0/792218572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563481a68e10 0x563481a691f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.752+0000 7f9e9c9cf700 1 -- 172.21.15.80:0/792218572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563481a637e0 msgr2=0x563481a63c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:39:23.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.752+0000 7f9e9c9cf700 1 --2- 172.21.15.80:0/792218572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563481a637e0 0x563481a63c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.752+0000 7f9e9c9cf700 1 -- 172.21.15.80:0/792218572 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563481902940 con 0x563481a69730 2024-04-26T18:39:23.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.752+0000 7f9e9c9cf700 1 --2- 172.21.15.80:0/792218572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a69730 0x563481a631c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9e88098b20 tx=0x7f9e8809c020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2cfbb967d10157 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:39:23.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.752+0000 7f9e837fe700 1 -- 172.21.15.80:0/792218572 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e880a0a70 con 0x563481a69730 2024-04-26T18:39:23.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.752+0000 7f9e837fe700 1 -- 172.21.15.80:0/792218572 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e880a5330 con 0x563481a69730 2024-04-26T18:39:23.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.752+0000 7f9e837fe700 1 -- 172.21.15.80:0/792218572 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8800f830 con 0x563481a69730 2024-04-26T18:39:23.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.753+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/792218572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a69730 msgr2=0x563481a631c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:23.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.753+0000 7f9ea9cc6b80 1 --2- 172.21.15.80:0/792218572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a69730 0x563481a631c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9e88098b20 tx=0x7f9e8809c020 comp rx=0 tx=0).stop 2024-04-26T18:39:23.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.753+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/792218572 shutdown_connections 2024-04-26T18:39:23.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.753+0000 7f9ea9cc6b80 1 --2- 172.21.15.80:0/792218572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563481a637e0 0x563481a63c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.753+0000 7f9ea9cc6b80 1 --2- 172.21.15.80:0/792218572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563481a68e10 0x563481a691f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.753+0000 7f9ea9cc6b80 1 --2- 172.21.15.80:0/792218572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a69730 0x563481a631c0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.753+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/792218572 >> 172.21.15.80:0/792218572 conn(0x563481991630 msgr2=0x563481a5df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:39:23.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.753+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/792218572 shutdown_connections 2024-04-26T18:39:23.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.753+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/792218572 wait complete. 2024-04-26T18:39:23.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.754+0000 7f9ea9cc6b80 1 -- start start 2024-04-26T18:39:23.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.754+0000 7f9ea9cc6b80 1 Processor -- start 2024-04-26T18:39:23.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.754+0000 7f9ea9cc6b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a637e0 0x563481a6f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:23.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.754+0000 7f9ea9cc6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563481a68e10 0x563481a6c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:23.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.754+0000 7f9ea9cc6b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563481a69730 0x563481a6cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:23.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.754+0000 7f9ea9cc6b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x563481a745b0 con 0x563481a637e0 2024-04-26T18:39:23.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.754+0000 7f9ea9cc6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56348196faf0 con 0x563481a68e10 2024-04-26T18:39:23.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.754+0000 7f9ea9cc6b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563481a74730 con 0x563481a69730 2024-04-26T18:39:23.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.754+0000 7f9ea9cc6b80 10 client.0 _ll_register_callbacks cb 0x56348194d9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:39:23.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.754+0000 7f9e9d1d0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a637e0 0x563481a6f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:23.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.754+0000 7f9e9c9cf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563481a68e10 0x563481a6c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:23.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.754+0000 7f9e9d1d0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a637e0 0x563481a6f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56144/0 (socket says 172.21.15.80:56144) 2024-04-26T18:39:23.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.754+0000 7f9e9d1d0700 1 -- 172.21.15.80:0/3889774072 learned_addr learned my addr 172.21.15.80:0/3889774072 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:39:23.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.754+0000 7f9e9d9d1700 1 --2- 172.21.15.80:0/3889774072 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563481a69730 0x563481a6cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:23.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.755+0000 7f9e9d1d0700 1 -- 172.21.15.80:0/3889774072 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563481a69730 msgr2=0x563481a6cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:39:23.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.755+0000 7f9e9d1d0700 1 --2- 172.21.15.80:0/3889774072 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563481a69730 0x563481a6cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.755+0000 7f9e9d1d0700 1 -- 172.21.15.80:0/3889774072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563481a68e10 msgr2=0x563481a6c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:39:23.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.755+0000 7f9e9d1d0700 1 --2- 172.21.15.80:0/3889774072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563481a68e10 0x563481a6c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.755+0000 7f9e9d1d0700 1 -- 172.21.15.80:0/3889774072 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634819734f0 con 0x563481a637e0 2024-04-26T18:39:23.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.755+0000 7f9e9d9d1700 1 --2- 172.21.15.80:0/3889774072 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563481a69730 0x563481a6cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:39:23.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.755+0000 7f9e9c9cf700 1 --2- 172.21.15.80:0/3889774072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563481a68e10 0x563481a6c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:39:23.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.755+0000 7f9e9d1d0700 1 --2- 172.21.15.80:0/3889774072 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a637e0 0x563481a6f420 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9e94015700 tx=0x7f9e94004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588dcd402906b794 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:39:23.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.755+0000 7f9e80ff9700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:39:23.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.755+0000 7f9e80ff9700 1 -- 172.21.15.80:0/3889774072 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e94025020 con 0x563481a637e0 2024-04-26T18:39:23.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.755+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/3889774072 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e880a5330 con 0x563481a637e0 2024-04-26T18:39:23.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.755+0000 7f9e80ff9700 1 -- 172.21.15.80:0/3889774072 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8440+0+0 (secure 0 0 0) 0x7f9e94015c70 con 0x563481a637e0 2024-04-26T18:39:23.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.755+0000 7f9e80ff9700 1 -- 172.21.15.80:0/3889774072 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9e94030050 con 0x563481a637e0 2024-04-26T18:39:23.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.755+0000 7f9ea9cc6b80 10 client.15783 fetch_fsmap learned FSMap version 29 2024-04-26T18:39:23.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.755+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/3889774072 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563481a7ee30 con 0x563481a637e0 2024-04-26T18:39:23.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.755+0000 7f9e80ff9700 1 -- 172.21.15.80:0/3889774072 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e880a5330 con 0x563481a637e0 2024-04-26T18:39:23.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.756+0000 7f9e80ff9700 1 -- 172.21.15.80:0/3889774072 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f9e94013450 con 0x563481a637e0 2024-04-26T18:39:23.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.756+0000 7f9ea9cc6b80 10 client.15783 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:39:23.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.756+0000 7f9ea9cc6b80 10 client.15783 resolve_mds: validated gid 24434 aka daemon mds.b 2024-04-26T18:39:23.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.756+0000 7f9ea9cc6b80 20 client.15783 populate_metadata read hostname 'smithi080' 2024-04-26T18:39:23.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.756+0000 7f9ea9cc6b80 1 --2- 172.21.15.80:0/3889774072 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x563481a81470 0x563481a838d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:23.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.756+0000 7f9ea9cc6b80 4 client.15783 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:39:23.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.756+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/3889774072 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634819c3280 con 0x563481a81470 2024-04-26T18:39:23.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.756+0000 7f9e9c9cf700 1 --2- 172.21.15.80:0/3889774072 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x563481a81470 0x563481a838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:23.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.756+0000 7f9e80ff9700 10 client.15783 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:39:23.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.756+0000 7f9e9c9cf700 1 --2- 172.21.15.80:0/3889774072 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x563481a81470 0x563481a838d0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=172aad5609097646 server_cookie=35d84814bd684f9a in_seq=0 out_seq=0 2024-04-26T18:39:23.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.757+0000 7f9e80ff9700 1 -- 172.21.15.80:0/3889774072 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5634819c3280 con 0x563481a81470 2024-04-26T18:39:23.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.757+0000 7f9e80ff9700 10 client.15783 handle_command_reply: tid=0 2024-04-26T18:39:23.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.757+0000 7f9ea9cc6b80 1 client.15783 shutdown 2024-04-26T18:39:23.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.757+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/3889774072 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a637e0 msgr2=0x563481a6f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:23.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.757+0000 7f9ea9cc6b80 1 --2- 172.21.15.80:0/3889774072 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a637e0 0x563481a6f420 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9e94015700 tx=0x7f9e94004860 comp rx=0 tx=0).stop 2024-04-26T18:39:23.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.757+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/3889774072 shutdown_connections 2024-04-26T18:39:23.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.757+0000 7f9ea9cc6b80 1 --2- 172.21.15.80:0/3889774072 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x563481a81470 0x563481a838d0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.757+0000 7f9ea9cc6b80 1 --2- 172.21.15.80:0/3889774072 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563481a69730 0x563481a6cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.757+0000 7f9ea9cc6b80 1 --2- 172.21.15.80:0/3889774072 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a637e0 0x563481a6f420 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.757+0000 7f9ea9cc6b80 1 --2- 172.21.15.80:0/3889774072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563481a68e10 0x563481a6c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.758+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/3889774072 >> 172.21.15.80:0/3889774072 conn(0x563481991630 msgr2=0x563481a621b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:39:23.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.758+0000 7f9e80ff9700 0 client.15783 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:39:23.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.758+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/3889774072 shutdown_connections 2024-04-26T18:39:23.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.758+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/3889774072 wait complete. 2024-04-26T18:39:23.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.758+0000 7f9ea9cc6b80 20 client.15783 trim_cache size 0 max 16384 2024-04-26T18:39:23.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.778+0000 7f9ea9cc6b80 1 Processor -- start 2024-04-26T18:39:23.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.778+0000 7f9ea9cc6b80 1 -- start start 2024-04-26T18:39:23.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.778+0000 7f9ea9cc6b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563481a637e0 0x563481a631c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:23.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.778+0000 7f9ea9cc6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563481a68e10 0x563481a6a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:23.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.778+0000 7f9ea9cc6b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a69730 0x563481a5dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:23.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.778+0000 7f9ea9cc6b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9e981ab9e0 con 0x563481a69730 2024-04-26T18:39:23.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.778+0000 7f9ea9cc6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9e981ad520 con 0x563481a68e10 2024-04-26T18:39:23.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.778+0000 7f9ea9cc6b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9e981ac0b0 con 0x563481a637e0 2024-04-26T18:39:23.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.778+0000 7f9e9d9d1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a69730 0x563481a5dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:23.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.778+0000 7f9e9d9d1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a69730 0x563481a5dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56154/0 (socket says 172.21.15.80:56154) 2024-04-26T18:39:23.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.778+0000 7f9e9d9d1700 1 -- 172.21.15.80:0/3447498402 learned_addr learned my addr 172.21.15.80:0/3447498402 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:39:23.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.778+0000 7f9e9c9cf700 1 --2- 172.21.15.80:0/3447498402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563481a68e10 0x563481a6a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:23.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.778+0000 7f9e9d1d0700 1 --2- 172.21.15.80:0/3447498402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563481a637e0 0x563481a631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:23.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.778+0000 7f9e9d9d1700 1 -- 172.21.15.80:0/3447498402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563481a637e0 msgr2=0x563481a631c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:39:23.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.778+0000 7f9e9d9d1700 1 --2- 172.21.15.80:0/3447498402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563481a637e0 0x563481a631c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.778+0000 7f9e9d9d1700 1 -- 172.21.15.80:0/3447498402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563481a68e10 msgr2=0x563481a6a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:39:23.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.778+0000 7f9e9d9d1700 1 --2- 172.21.15.80:0/3447498402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563481a68e10 0x563481a6a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.778+0000 7f9e9d9d1700 1 -- 172.21.15.80:0/3447498402 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563481a6ad30 con 0x563481a69730 2024-04-26T18:39:23.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.778+0000 7f9e9c9cf700 1 --2- 172.21.15.80:0/3447498402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563481a68e10 0x563481a6a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:39:23.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.779+0000 7f9e9d9d1700 1 --2- 172.21.15.80:0/3447498402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a69730 0x563481a5dfb0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009330 tx=0x7f9e90009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498cd90055c30c0a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:39:23.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.779+0000 7f9e82ffd700 1 -- 172.21.15.80:0/3447498402 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e90003a80 con 0x563481a69730 2024-04-26T18:39:23.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.779+0000 7f9e82ffd700 1 -- 172.21.15.80:0/3447498402 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e90003c20 con 0x563481a69730 2024-04-26T18:39:23.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.779+0000 7f9e82ffd700 1 -- 172.21.15.80:0/3447498402 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e900053b0 con 0x563481a69730 2024-04-26T18:39:23.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.779+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/3447498402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a69730 msgr2=0x563481a5dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:23.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.779+0000 7f9ea9cc6b80 1 --2- 172.21.15.80:0/3447498402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a69730 0x563481a5dfb0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009330 tx=0x7f9e90009360 comp rx=0 tx=0).stop 2024-04-26T18:39:23.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.780+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/3447498402 shutdown_connections 2024-04-26T18:39:23.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.780+0000 7f9ea9cc6b80 1 --2- 172.21.15.80:0/3447498402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a69730 0x563481a5dfb0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.780+0000 7f9ea9cc6b80 1 --2- 172.21.15.80:0/3447498402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563481a637e0 0x563481a631c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.780+0000 7f9ea9cc6b80 1 --2- 172.21.15.80:0/3447498402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563481a68e10 0x563481a6a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.780+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/3447498402 >> 172.21.15.80:0/3447498402 conn(0x563481991630 msgr2=0x563481a575e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:39:23.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.780+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/3447498402 shutdown_connections 2024-04-26T18:39:23.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.780+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/3447498402 wait complete. 2024-04-26T18:39:23.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.780+0000 7f9ea9cc6b80 1 -- start start 2024-04-26T18:39:23.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.780+0000 7f9ea9cc6b80 1 Processor -- start 2024-04-26T18:39:23.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.781+0000 7f9ea9cc6b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563481a637e0 0x563481a88a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:23.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.781+0000 7f9ea9cc6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563481a68e10 0x563481a88fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:23.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.781+0000 7f9ea9cc6b80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a69730 0x563481ae6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:23.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.781+0000 7f9ea9cc6b80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9e981ace50 con 0x563481a69730 2024-04-26T18:39:23.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.781+0000 7f9ea9cc6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9e981ac780 con 0x563481a68e10 2024-04-26T18:39:23.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.781+0000 7f9ea9cc6b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9e981a99a0 con 0x563481a637e0 2024-04-26T18:39:23.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.781+0000 7f9ea9cc6b80 10 client.0 _ll_register_callbacks cb 0x56348194d9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:39:23.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.781+0000 7f9e9d9d1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a69730 0x563481ae6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:23.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.781+0000 7f9e9d9d1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a69730 0x563481ae6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56162/0 (socket says 172.21.15.80:56162) 2024-04-26T18:39:23.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.781+0000 7f9e9d9d1700 1 -- 172.21.15.80:0/4052381847 learned_addr learned my addr 172.21.15.80:0/4052381847 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:39:23.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.781+0000 7f9e9d1d0700 1 --2- 172.21.15.80:0/4052381847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563481a637e0 0x563481a88a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:23.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.781+0000 7f9e9c9cf700 1 --2- 172.21.15.80:0/4052381847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563481a68e10 0x563481a88fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:23.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.781+0000 7f9e9d9d1700 1 -- 172.21.15.80:0/4052381847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563481a637e0 msgr2=0x563481a88a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:39:23.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.781+0000 7f9e9d9d1700 1 --2- 172.21.15.80:0/4052381847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563481a637e0 0x563481a88a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.781+0000 7f9e9d9d1700 1 -- 172.21.15.80:0/4052381847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563481a68e10 msgr2=0x563481a88fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:39:23.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.781+0000 7f9e9d9d1700 1 --2- 172.21.15.80:0/4052381847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563481a68e10 0x563481a88fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.781+0000 7f9e9d9d1700 1 -- 172.21.15.80:0/4052381847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563481ae6f50 con 0x563481a69730 2024-04-26T18:39:23.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.781+0000 7f9e9d9d1700 1 --2- 172.21.15.80:0/4052381847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a69730 0x563481ae6a10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000d010 tx=0x7f9e90007c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5cc88a4b70fbcf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:39:23.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.781+0000 7f9e80ff9700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-26T18:39:23.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.781+0000 7f9e80ff9700 1 -- 172.21.15.80:0/4052381847 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e900052e0 con 0x563481a69730 2024-04-26T18:39:23.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.781+0000 7f9e80ff9700 1 -- 172.21.15.80:0/4052381847 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8440+0+0 (secure 0 0 0) 0x7f9e90022040 con 0x563481a69730 2024-04-26T18:39:23.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.781+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/4052381847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e90003c20 con 0x563481a69730 2024-04-26T18:39:23.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.782+0000 7f9e80ff9700 1 -- 172.21.15.80:0/4052381847 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9e90005480 con 0x563481a69730 2024-04-26T18:39:23.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.782+0000 7f9ea9cc6b80 10 client.15789 fetch_fsmap learned FSMap version 29 2024-04-26T18:39:23.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.782+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/4052381847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563481ae80f0 con 0x563481a69730 2024-04-26T18:39:23.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.782+0000 7f9e80ff9700 1 -- 172.21.15.80:0/4052381847 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e90003c20 con 0x563481a69730 2024-04-26T18:39:23.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.782+0000 7f9e80ff9700 1 -- 172.21.15.80:0/4052381847 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f9e90011070 con 0x563481a69730 2024-04-26T18:39:23.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.782+0000 7f9ea9cc6b80 10 client.15789 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:39:23.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.782+0000 7f9ea9cc6b80 10 client.15789 resolve_mds: validated gid 24434 aka daemon mds.b 2024-04-26T18:39:23.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.782+0000 7f9ea9cc6b80 20 client.15789 populate_metadata read hostname 'smithi080' 2024-04-26T18:39:23.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.782+0000 7f9ea9cc6b80 1 --2- 172.21.15.80:0/4052381847 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x563481ae86f0 0x563481aeab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:39:23.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.782+0000 7f9ea9cc6b80 4 client.15789 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-04-26T18:39:23.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.782+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/4052381847 --> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x5634819bd320 con 0x563481ae86f0 2024-04-26T18:39:23.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.783+0000 7f9e9d1d0700 1 --2- 172.21.15.80:0/4052381847 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x563481ae86f0 0x563481aeab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:39:23.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.783+0000 7f9e9d1d0700 1 --2- 172.21.15.80:0/4052381847 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x563481ae86f0 0x563481aeab10 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94bb1478b9903a15 server_cookie=a52d5c9e758497f0 in_seq=0 out_seq=0 2024-04-26T18:39:23.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.783+0000 7f9e80ff9700 10 client.15789 ms_handle_connect on v2:172.21.15.82:6838/1482576497 2024-04-26T18:39:23.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.783+0000 7f9e80ff9700 1 -- 172.21.15.80:0/4052381847 <== mds.0 v2:172.21.15.82:6838/1482576497 1 ==== command_reply(tid 0: 0 ) ==== 8+0+79 (crc 0 0 0) 0x5634819bd320 con 0x563481ae86f0 2024-04-26T18:39:23.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.783+0000 7f9e80ff9700 10 client.15789 handle_command_reply: tid=0 2024-04-26T18:39:23.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.783+0000 7f9ea9cc6b80 1 client.15789 shutdown 2024-04-26T18:39:23.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.783+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/4052381847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a69730 msgr2=0x563481ae6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:23.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.783+0000 7f9ea9cc6b80 1 --2- 172.21.15.80:0/4052381847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a69730 0x563481ae6a10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000d010 tx=0x7f9e90007c30 comp rx=0 tx=0).stop 2024-04-26T18:39:23.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.783+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/4052381847 shutdown_connections 2024-04-26T18:39:23.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.783+0000 7f9ea9cc6b80 1 --2- 172.21.15.80:0/4052381847 >> [v2:172.21.15.82:6838/1482576497,v1:172.21.15.82:6839/1482576497] conn(0x563481ae86f0 0x563481aeab10 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.783+0000 7f9ea9cc6b80 1 --2- 172.21.15.80:0/4052381847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563481a69730 0x563481ae6a10 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.783+0000 7f9ea9cc6b80 1 --2- 172.21.15.80:0/4052381847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563481a637e0 0x563481a88a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.783+0000 7f9ea9cc6b80 1 --2- 172.21.15.80:0/4052381847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563481a68e10 0x563481a88fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.783+0000 7f9e80ff9700 0 client.15789 ms_handle_reset on v2:172.21.15.82:6838/1482576497 2024-04-26T18:39:23.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.783+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/4052381847 >> 172.21.15.80:0/4052381847 conn(0x563481991630 msgr2=0x563481a57e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:39:23.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.783+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/4052381847 shutdown_connections 2024-04-26T18:39:23.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.783+0000 7f9ea9cc6b80 1 -- 172.21.15.80:0/4052381847 wait complete. 2024-04-26T18:39:23.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.784+0000 7f9ea9cc6b80 20 client.15789 trim_cache size 0 max 16384 2024-04-26T18:39:23.790 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:39:23.790 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 29, 2024-04-26T18:39:23.790 INFO:teuthology.orchestra.run.smithi080.stdout: "leader": 24434, 2024-04-26T18:39:23.790 INFO:teuthology.orchestra.run.smithi080.stdout: "set_version": 8, 2024-04-26T18:39:23.790 INFO:teuthology.orchestra.run.smithi080.stdout: "sets": {} 2024-04-26T18:39:23.790 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:39:23.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.784+0000 7f9e9f434700 1 -- 172.21.15.80:0/1908164805 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f9e840a3db0 msgr2=0x7f9e840a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:23.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.784+0000 7f9e9f434700 1 --2- 172.21.15.80:0/1908164805 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f9e840a3db0 0x7f9e840a6270 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9e9819aa00 tx=0x7f9e94009190 comp rx=0 tx=0).stop 2024-04-26T18:39:23.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.784+0000 7f9e9f434700 1 -- 172.21.15.80:0/1908164805 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e98103e30 msgr2=0x7f9e9819fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:39:23.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.784+0000 7f9e9f434700 1 --2- 172.21.15.80:0/1908164805 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e98103e30 0x7f9e9819fc40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800c9b0 tx=0x7f9e8800ccc0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.784+0000 7f9e9f434700 1 -- 172.21.15.80:0/1908164805 shutdown_connections 2024-04-26T18:39:23.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.784+0000 7f9e9f434700 1 --2- 172.21.15.80:0/1908164805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e981094c0 0x7f9e981998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.784+0000 7f9e9f434700 1 --2- 172.21.15.80:0/1908164805 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f9e840a3db0 0x7f9e840a6270 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.784+0000 7f9e9f434700 1 --2- 172.21.15.80:0/1908164805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e98103470 0x7f9e9819f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.784+0000 7f9e9f434700 1 --2- 172.21.15.80:0/1908164805 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e98103e30 0x7f9e9819fc40 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:39:23.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.784+0000 7f9e9f434700 1 -- 172.21.15.80:0/1908164805 >> 172.21.15.80:0/1908164805 conn(0x7f9e9807a580 msgr2=0x7f9e98101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:39:23.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.784+0000 7f9e9f434700 1 -- 172.21.15.80:0/1908164805 shutdown_connections 2024-04-26T18:39:23.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:39:23.784+0000 7f9e9f434700 1 -- 172.21.15.80:0/1908164805 wait complete. 2024-04-26T18:39:23.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:23 smithi082 ceph-mon[32808]: pgmap v91: 97 pgs: 97 active+clean; 292 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 116 MiB/s rd, 1.2 MiB/s wr, 399 op/s 2024-04-26T18:39:23.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:23 smithi080 ceph-mon[29135]: pgmap v91: 97 pgs: 97 active+clean; 292 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 116 MiB/s rd, 1.2 MiB/s wr, 399 op/s 2024-04-26T18:39:24.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:23 smithi192 ceph-mon[32842]: pgmap v91: 97 pgs: 97 active+clean; 292 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 116 MiB/s rd, 1.2 MiB/s wr, 399 op/s 2024-04-26T18:39:24.618 INFO:tasks.quiescer:done joining Quiescers 2024-04-26T18:39:24.619 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-04-26T18:39:24.629 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi080.front.sepia.ceph.com 2024-04-26T18:39:24.638 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-04-26T18:39:24.649 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-04-26T18:39:24.649 INFO:teuthology.task.exec:Executing custom commands... 2024-04-26T18:39:24.649 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi080.front.sepia.ceph.com 2024-04-26T18:39:24.649 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-04-26T18:39:24.706 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-04-26T18:39:25.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:25 smithi082 ceph-mon[32808]: pgmap v92: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 116 MiB/s rd, 1.2 MiB/s wr, 438 op/s 2024-04-26T18:39:25.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:25 smithi080 ceph-mon[29135]: pgmap v92: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 116 MiB/s rd, 1.2 MiB/s wr, 438 op/s 2024-04-26T18:39:26.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:25 smithi192 ceph-mon[32842]: pgmap v92: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 116 MiB/s rd, 1.2 MiB/s wr, 438 op/s 2024-04-26T18:39:27.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:27 smithi082 ceph-mon[32808]: pgmap v93: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 47 MiB/s rd, 588 KiB/s wr, 226 op/s 2024-04-26T18:39:27.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:27 smithi080 ceph-mon[29135]: pgmap v93: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 47 MiB/s rd, 588 KiB/s wr, 226 op/s 2024-04-26T18:39:28.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:27 smithi192 ceph-mon[32842]: pgmap v93: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 47 MiB/s rd, 588 KiB/s wr, 226 op/s 2024-04-26T18:39:29.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:29 smithi082 ceph-mon[32808]: pgmap v94: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 47 MiB/s rd, 588 KiB/s wr, 226 op/s 2024-04-26T18:39:29.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:29 smithi080 ceph-mon[29135]: pgmap v94: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 47 MiB/s rd, 588 KiB/s wr, 226 op/s 2024-04-26T18:39:30.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:29 smithi192 ceph-mon[32842]: pgmap v94: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 47 MiB/s rd, 588 KiB/s wr, 226 op/s 2024-04-26T18:39:31.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:31 smithi082 ceph-mon[32808]: pgmap v95: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 47 MiB/s rd, 590 KiB/s wr, 231 op/s 2024-04-26T18:39:31.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:31 smithi080 ceph-mon[29135]: pgmap v95: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 47 MiB/s rd, 590 KiB/s wr, 231 op/s 2024-04-26T18:39:32.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:31 smithi192 ceph-mon[32842]: pgmap v95: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 47 MiB/s rd, 590 KiB/s wr, 231 op/s 2024-04-26T18:39:33.914 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:33 smithi192 ceph-mon[32842]: pgmap v96: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 KiB/s wr, 42 op/s 2024-04-26T18:39:33.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:33 smithi082 ceph-mon[32808]: pgmap v96: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 KiB/s wr, 42 op/s 2024-04-26T18:39:33.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:33 smithi080 ceph-mon[29135]: pgmap v96: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 KiB/s wr, 42 op/s 2024-04-26T18:39:34.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:34 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:39:34.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:34 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:39:35.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:34 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:39:35.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:35 smithi082 ceph-mon[32808]: pgmap v97: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 19 KiB/s wr, 47 op/s 2024-04-26T18:39:35.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:35 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:39:35.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:35 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:39:35.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:35 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:39:35.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:35 smithi080 ceph-mon[29135]: pgmap v97: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 19 KiB/s wr, 47 op/s 2024-04-26T18:39:35.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:35 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:39:35.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:35 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:39:35.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:35 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:39:36.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:35 smithi192 ceph-mon[32842]: pgmap v97: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 19 KiB/s wr, 47 op/s 2024-04-26T18:39:36.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:35 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:39:36.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:35 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:39:36.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:35 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:39:37.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:37 smithi082 ceph-mon[32808]: pgmap v98: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-04-26T18:39:37.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:37 smithi080 ceph-mon[29135]: pgmap v98: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-04-26T18:39:38.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:37 smithi192 ceph-mon[32842]: pgmap v98: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-04-26T18:39:39.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:39 smithi082 ceph-mon[32808]: pgmap v99: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-04-26T18:39:39.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:39 smithi080 ceph-mon[29135]: pgmap v99: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-04-26T18:39:40.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:39 smithi192 ceph-mon[32842]: pgmap v99: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-04-26T18:39:41.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:41 smithi082 ceph-mon[32808]: pgmap v100: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-04-26T18:39:41.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:41 smithi080 ceph-mon[29135]: pgmap v100: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-04-26T18:39:42.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:41 smithi192 ceph-mon[32842]: pgmap v100: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-04-26T18:39:43.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:43 smithi082 ceph-mon[32808]: pgmap v101: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:39:43.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:43 smithi080 ceph-mon[29135]: pgmap v101: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:39:44.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:43 smithi192 ceph-mon[32842]: pgmap v101: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:39:45.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:45 smithi082 ceph-mon[32808]: pgmap v102: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:39:45.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:45 smithi080 ceph-mon[29135]: pgmap v102: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:39:46.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:45 smithi192 ceph-mon[32842]: pgmap v102: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:39:47.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:47 smithi082 ceph-mon[32808]: pgmap v103: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:39:47.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:47 smithi080 ceph-mon[29135]: pgmap v103: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:39:48.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:47 smithi192 ceph-mon[32842]: pgmap v103: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:39:49.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:49 smithi082 ceph-mon[32808]: pgmap v104: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:39:49.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:49 smithi080 ceph-mon[29135]: pgmap v104: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:39:50.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:49 smithi192 ceph-mon[32842]: pgmap v104: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:39:51.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:51 smithi082 ceph-mon[32808]: pgmap v105: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:39:51.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:51 smithi080 ceph-mon[29135]: pgmap v105: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:39:52.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:51 smithi192 ceph-mon[32842]: pgmap v105: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:39:53.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:53 smithi082 ceph-mon[32808]: pgmap v106: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:39:53.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:53 smithi080 ceph-mon[29135]: pgmap v106: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:39:54.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:53 smithi192 ceph-mon[32842]: pgmap v106: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:39:55.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:55 smithi082 ceph-mon[32808]: pgmap v107: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:39:55.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:55 smithi080 ceph-mon[29135]: pgmap v107: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:39:56.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:55 smithi192 ceph-mon[32842]: pgmap v107: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:39:57.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:57 smithi082 ceph-mon[32808]: pgmap v108: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:39:57.993 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:57 smithi080 ceph-mon[29135]: pgmap v108: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:39:58.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:57 smithi192 ceph-mon[32842]: pgmap v108: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:39:59.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:39:58 smithi192 ceph-mon[32842]: pgmap v109: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:39:59.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:39:58 smithi082 ceph-mon[32808]: pgmap v109: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:39:59.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:39:58 smithi080 ceph-mon[29135]: pgmap v109: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:01.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:00 smithi192 ceph-mon[32842]: pgmap v110: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:40:01.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:00 smithi192 ceph-mon[32842]: overall HEALTH_OK 2024-04-26T18:40:01.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:00 smithi082 ceph-mon[32808]: pgmap v110: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:40:01.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:00 smithi082 ceph-mon[32808]: overall HEALTH_OK 2024-04-26T18:40:01.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:00 smithi080 ceph-mon[29135]: pgmap v110: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:40:01.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:00 smithi080 ceph-mon[29135]: overall HEALTH_OK 2024-04-26T18:40:03.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:02 smithi192 ceph-mon[32842]: pgmap v111: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:03.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:02 smithi082 ceph-mon[32808]: pgmap v111: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:03.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:02 smithi080 ceph-mon[29135]: pgmap v111: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:05.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:04 smithi192 ceph-mon[32842]: pgmap v112: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:40:05.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:04 smithi082 ceph-mon[32808]: pgmap v112: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:40:05.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:04 smithi080 ceph-mon[29135]: pgmap v112: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:40:07.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:06 smithi192 ceph-mon[32842]: pgmap v113: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:40:07.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:06 smithi082 ceph-mon[32808]: pgmap v113: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:40:07.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:06 smithi080 ceph-mon[29135]: pgmap v113: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:40:09.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:08 smithi192 ceph-mon[32842]: pgmap v114: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:40:09.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:08 smithi082 ceph-mon[32808]: pgmap v114: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:40:09.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:08 smithi080 ceph-mon[29135]: pgmap v114: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:40:11.112 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:10 smithi192 ceph-mon[32842]: pgmap v115: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:40:11.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:10 smithi082 ceph-mon[32808]: pgmap v115: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:40:11.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:10 smithi080 ceph-mon[29135]: pgmap v115: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:40:13.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:12 smithi082 ceph-mon[32808]: pgmap v116: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:40:13.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:12 smithi080 ceph-mon[29135]: pgmap v116: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:40:13.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:12 smithi192 ceph-mon[32842]: pgmap v116: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:40:15.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:14 smithi082 ceph-mon[32808]: pgmap v117: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:40:15.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:14 smithi080 ceph-mon[29135]: pgmap v117: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:40:15.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:14 smithi192 ceph-mon[32842]: pgmap v117: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:40:17.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:16 smithi082 ceph-mon[32808]: pgmap v118: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T18:40:17.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:16 smithi080 ceph-mon[29135]: pgmap v118: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T18:40:17.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:16 smithi192 ceph-mon[32842]: pgmap v118: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T18:40:19.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:18 smithi082 ceph-mon[32808]: pgmap v119: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T18:40:19.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:18 smithi080 ceph-mon[29135]: pgmap v119: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T18:40:19.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:18 smithi192 ceph-mon[32842]: pgmap v119: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T18:40:21.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:20 smithi082 ceph-mon[32808]: pgmap v120: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T18:40:21.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:20 smithi080 ceph-mon[29135]: pgmap v120: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T18:40:21.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:20 smithi192 ceph-mon[32842]: pgmap v120: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T18:40:23.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:22 smithi082 ceph-mon[32808]: pgmap v121: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:23.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:22 smithi080 ceph-mon[29135]: pgmap v121: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:23.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:22 smithi192 ceph-mon[32842]: pgmap v121: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:25.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:24 smithi082 ceph-mon[32808]: pgmap v122: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:40:25.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:24 smithi080 ceph-mon[29135]: pgmap v122: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:40:25.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:24 smithi192 ceph-mon[32842]: pgmap v122: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:40:27.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:26 smithi082 ceph-mon[32808]: pgmap v123: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:27.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:26 smithi080 ceph-mon[29135]: pgmap v123: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:27.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:26 smithi192 ceph-mon[32842]: pgmap v123: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:29.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:28 smithi082 ceph-mon[32808]: pgmap v124: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:29.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:28 smithi080 ceph-mon[29135]: pgmap v124: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:29.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:28 smithi192 ceph-mon[32842]: pgmap v124: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:31.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:30 smithi082 ceph-mon[32808]: pgmap v125: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:40:31.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:30 smithi080 ceph-mon[29135]: pgmap v125: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:40:31.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:30 smithi192 ceph-mon[32842]: pgmap v125: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:40:33.164 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:32 smithi192 ceph-mon[32842]: pgmap v126: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:33.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:32 smithi082 ceph-mon[32808]: pgmap v126: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:33.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:32 smithi080 ceph-mon[29135]: pgmap v126: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:35.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:34 smithi082 ceph-mon[32808]: pgmap v127: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:40:35.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:34 smithi080 ceph-mon[29135]: pgmap v127: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:40:35.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:34 smithi192 ceph-mon[32842]: pgmap v127: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:40:36.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:35 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:40:36.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:35 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:40:36.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:35 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:40:36.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:35 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:40:36.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:35 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:40:36.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:35 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:40:36.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:35 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:40:36.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:35 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:40:36.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:35 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:40:36.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:35 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:40:36.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:35 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:40:36.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:35 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:40:37.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:36 smithi082 ceph-mon[32808]: pgmap v128: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:37.245 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:36 smithi080 ceph-mon[29135]: pgmap v128: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:37.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:36 smithi192 ceph-mon[32842]: pgmap v128: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:39.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:38 smithi082 ceph-mon[32808]: pgmap v129: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:39.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:38 smithi080 ceph-mon[29135]: pgmap v129: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:39.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:38 smithi192 ceph-mon[32842]: pgmap v129: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:41.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:40 smithi082 ceph-mon[32808]: pgmap v130: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:40:41.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:40 smithi080 ceph-mon[29135]: pgmap v130: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:40:41.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:40 smithi192 ceph-mon[32842]: pgmap v130: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:40:43.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:42 smithi082 ceph-mon[32808]: pgmap v131: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:43.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:42 smithi080 ceph-mon[29135]: pgmap v131: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:43.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:42 smithi192 ceph-mon[32842]: pgmap v131: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:45.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:44 smithi082 ceph-mon[32808]: pgmap v132: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:40:45.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:44 smithi080 ceph-mon[29135]: pgmap v132: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:40:45.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:44 smithi192 ceph-mon[32842]: pgmap v132: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:40:47.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:46 smithi082 ceph-mon[32808]: pgmap v133: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:47.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:46 smithi080 ceph-mon[29135]: pgmap v133: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:47.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:46 smithi192 ceph-mon[32842]: pgmap v133: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:49.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:48 smithi082 ceph-mon[32808]: pgmap v134: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:49.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:48 smithi080 ceph-mon[29135]: pgmap v134: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:49.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:48 smithi192 ceph-mon[32842]: pgmap v134: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:51.220 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:50 smithi082 ceph-mon[32808]: pgmap v135: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:40:51.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:50 smithi080 ceph-mon[29135]: pgmap v135: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:40:51.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:50 smithi192 ceph-mon[32842]: pgmap v135: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:40:53.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:52 smithi082 ceph-mon[32808]: pgmap v136: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:53.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:52 smithi080 ceph-mon[29135]: pgmap v136: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:53.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:52 smithi192 ceph-mon[32842]: pgmap v136: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:55.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:54 smithi082 ceph-mon[32808]: pgmap v137: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:40:55.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:54 smithi080 ceph-mon[29135]: pgmap v137: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:40:55.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:54 smithi192 ceph-mon[32842]: pgmap v137: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:40:57.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:56 smithi082 ceph-mon[32808]: pgmap v138: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:57.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:56 smithi080 ceph-mon[29135]: pgmap v138: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:57.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:56 smithi192 ceph-mon[32842]: pgmap v138: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:59.219 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:40:58 smithi082 ceph-mon[32808]: pgmap v139: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:59.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:40:58 smithi080 ceph-mon[29135]: pgmap v139: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:40:59.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:40:58 smithi192 ceph-mon[32842]: pgmap v139: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:01.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:01 smithi192 ceph-mon[32842]: pgmap v140: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:41:01.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:01 smithi082 ceph-mon[32808]: pgmap v140: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:41:01.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:01 smithi080 ceph-mon[29135]: pgmap v140: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:41:03.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:03 smithi192 ceph-mon[32842]: pgmap v141: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:03.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:03 smithi082 ceph-mon[32808]: pgmap v141: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:03.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:03 smithi080 ceph-mon[29135]: pgmap v141: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:05.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:05 smithi192 ceph-mon[32842]: pgmap v142: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:41:05.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:05 smithi082 ceph-mon[32808]: pgmap v142: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:41:05.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:05 smithi080 ceph-mon[29135]: pgmap v142: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:41:07.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:07 smithi192 ceph-mon[32842]: pgmap v143: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:41:07.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:07 smithi082 ceph-mon[32808]: pgmap v143: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:41:07.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:07 smithi080 ceph-mon[29135]: pgmap v143: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:41:09.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:09 smithi192 ceph-mon[32842]: pgmap v144: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:41:09.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:09 smithi082 ceph-mon[32808]: pgmap v144: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:41:09.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:09 smithi080 ceph-mon[29135]: pgmap v144: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:41:11.271 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:11 smithi082 ceph-mon[32808]: pgmap v145: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:41:11.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:11 smithi192 ceph-mon[32842]: pgmap v145: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:41:11.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:11 smithi080 ceph-mon[29135]: pgmap v145: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:41:13.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:13 smithi192 ceph-mon[32842]: pgmap v146: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:41:13.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:13 smithi082 ceph-mon[32808]: pgmap v146: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:41:13.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:13 smithi080 ceph-mon[29135]: pgmap v146: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:41:15.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:15 smithi192 ceph-mon[32842]: pgmap v147: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:41:15.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:15 smithi082 ceph-mon[32808]: pgmap v147: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:41:15.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:15 smithi080 ceph-mon[29135]: pgmap v147: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:41:17.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:17 smithi192 ceph-mon[32842]: pgmap v148: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T18:41:17.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:17 smithi082 ceph-mon[32808]: pgmap v148: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T18:41:17.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:17 smithi080 ceph-mon[29135]: pgmap v148: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T18:41:19.295 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:19 smithi080 ceph-mon[29135]: pgmap v149: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T18:41:19.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:19 smithi192 ceph-mon[32842]: pgmap v149: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T18:41:19.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:19 smithi082 ceph-mon[32808]: pgmap v149: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T18:41:21.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:21 smithi192 ceph-mon[32842]: pgmap v150: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T18:41:21.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:21 smithi082 ceph-mon[32808]: pgmap v150: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T18:41:21.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:21 smithi080 ceph-mon[29135]: pgmap v150: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T18:41:23.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:23 smithi192 ceph-mon[32842]: pgmap v151: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:23.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:23 smithi082 ceph-mon[32808]: pgmap v151: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:23.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:23 smithi080 ceph-mon[29135]: pgmap v151: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:25.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:25 smithi192 ceph-mon[32842]: pgmap v152: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:41:25.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:25 smithi082 ceph-mon[32808]: pgmap v152: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:41:25.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:25 smithi080 ceph-mon[29135]: pgmap v152: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:41:27.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:27 smithi192 ceph-mon[32842]: pgmap v153: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:27.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:27 smithi082 ceph-mon[32808]: pgmap v153: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:27.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:27 smithi080 ceph-mon[29135]: pgmap v153: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:29.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:29 smithi192 ceph-mon[32842]: pgmap v154: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:29.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:29 smithi082 ceph-mon[32808]: pgmap v154: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:29.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:29 smithi080 ceph-mon[29135]: pgmap v154: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:31.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:31 smithi192 ceph-mon[32842]: pgmap v155: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:41:31.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:31 smithi082 ceph-mon[32808]: pgmap v155: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:41:31.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:31 smithi080 ceph-mon[29135]: pgmap v155: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:41:33.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:33 smithi192 ceph-mon[32842]: pgmap v156: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:33.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:33 smithi082 ceph-mon[32808]: pgmap v156: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:33.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:33 smithi080 ceph-mon[29135]: pgmap v156: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:35.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:35 smithi192 ceph-mon[32842]: pgmap v157: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:41:35.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:35 smithi082 ceph-mon[32808]: pgmap v157: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:41:35.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:35 smithi080 ceph-mon[29135]: pgmap v157: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:41:36.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:36 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:41:36.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:36 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:41:36.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:36 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:41:37.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:37 smithi192 ceph-mon[32842]: pgmap v158: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:37.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:37 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:41:37.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:37 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:41:37.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:37 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:41:37.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:37 smithi082 ceph-mon[32808]: pgmap v158: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:37.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:37 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:41:37.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:37 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:41:37.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:37 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:41:37.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:37 smithi080 ceph-mon[29135]: pgmap v158: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:37.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:37 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:41:37.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:37 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:41:37.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:37 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:41:39.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:39 smithi192 ceph-mon[32842]: pgmap v159: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:39.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:39 smithi082 ceph-mon[32808]: pgmap v159: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:39.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:39 smithi080 ceph-mon[29135]: pgmap v159: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:41.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:41 smithi192 ceph-mon[32842]: pgmap v160: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:41:41.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:41 smithi082 ceph-mon[32808]: pgmap v160: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:41:41.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:41 smithi080 ceph-mon[29135]: pgmap v160: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:41:43.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:43 smithi192 ceph-mon[32842]: pgmap v161: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:43.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:43 smithi082 ceph-mon[32808]: pgmap v161: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:43.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:43 smithi080 ceph-mon[29135]: pgmap v161: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:45.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:45 smithi192 ceph-mon[32842]: pgmap v162: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:41:45.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:45 smithi082 ceph-mon[32808]: pgmap v162: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:41:45.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:45 smithi080 ceph-mon[29135]: pgmap v162: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:41:47.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:47 smithi192 ceph-mon[32842]: pgmap v163: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:47.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:47 smithi082 ceph-mon[32808]: pgmap v163: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:47.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:47 smithi080 ceph-mon[29135]: pgmap v163: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:49.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:49 smithi192 ceph-mon[32842]: pgmap v164: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:49.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:49 smithi082 ceph-mon[32808]: pgmap v164: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:49.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:49 smithi080 ceph-mon[29135]: pgmap v164: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:51.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:51 smithi192 ceph-mon[32842]: pgmap v165: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:41:51.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:51 smithi082 ceph-mon[32808]: pgmap v165: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:41:51.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:51 smithi080 ceph-mon[29135]: pgmap v165: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:41:53.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:53 smithi192 ceph-mon[32842]: pgmap v166: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:53.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:53 smithi082 ceph-mon[32808]: pgmap v166: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:53.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:53 smithi080 ceph-mon[29135]: pgmap v166: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:55.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:55 smithi192 ceph-mon[32842]: pgmap v167: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:41:55.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:55 smithi082 ceph-mon[32808]: pgmap v167: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:41:55.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:55 smithi080 ceph-mon[29135]: pgmap v167: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:41:57.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:57 smithi192 ceph-mon[32842]: pgmap v168: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:57.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:57 smithi082 ceph-mon[32808]: pgmap v168: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:57.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:57 smithi080 ceph-mon[29135]: pgmap v168: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:59.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:41:59 smithi192 ceph-mon[32842]: pgmap v169: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:59.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:41:59 smithi082 ceph-mon[32808]: pgmap v169: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:41:59.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:41:59 smithi080 ceph-mon[29135]: pgmap v169: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:01.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:01 smithi192 ceph-mon[32842]: pgmap v170: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:42:01.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:01 smithi082 ceph-mon[32808]: pgmap v170: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:42:01.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:01 smithi080 ceph-mon[29135]: pgmap v170: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:42:03.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:03 smithi192 ceph-mon[32842]: pgmap v171: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:03.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:03 smithi082 ceph-mon[32808]: pgmap v171: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:03.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:03 smithi080 ceph-mon[29135]: pgmap v171: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:05.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:05 smithi192 ceph-mon[32842]: pgmap v172: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:42:05.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:05 smithi082 ceph-mon[32808]: pgmap v172: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:42:05.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:05 smithi080 ceph-mon[29135]: pgmap v172: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:42:07.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:07 smithi192 ceph-mon[32842]: pgmap v173: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:42:07.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:07 smithi082 ceph-mon[32808]: pgmap v173: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:42:07.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:07 smithi080 ceph-mon[29135]: pgmap v173: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:42:09.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:09 smithi192 ceph-mon[32842]: pgmap v174: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:42:09.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:09 smithi082 ceph-mon[32808]: pgmap v174: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:42:09.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:09 smithi080 ceph-mon[29135]: pgmap v174: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:42:11.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:11 smithi082 ceph-mon[32808]: pgmap v175: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:42:11.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:11 smithi080 ceph-mon[29135]: pgmap v175: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:42:11.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:11 smithi192 ceph-mon[32842]: pgmap v175: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:42:13.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:13 smithi082 ceph-mon[32808]: pgmap v176: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:42:13.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:13 smithi080 ceph-mon[29135]: pgmap v176: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:42:13.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:13 smithi192 ceph-mon[32842]: pgmap v176: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-26T18:42:15.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:15 smithi082 ceph-mon[32808]: pgmap v177: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:42:15.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:15 smithi080 ceph-mon[29135]: pgmap v177: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:42:15.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:15 smithi192 ceph-mon[32842]: pgmap v177: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-26T18:42:17.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:17 smithi082 ceph-mon[32808]: pgmap v178: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T18:42:17.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:17 smithi080 ceph-mon[29135]: pgmap v178: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T18:42:17.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:17 smithi192 ceph-mon[32842]: pgmap v178: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T18:42:19.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:19 smithi082 ceph-mon[32808]: pgmap v179: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T18:42:19.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:19 smithi080 ceph-mon[29135]: pgmap v179: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T18:42:19.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:19 smithi192 ceph-mon[32842]: pgmap v179: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T18:42:21.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:21 smithi082 ceph-mon[32808]: pgmap v180: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T18:42:21.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:21 smithi080 ceph-mon[29135]: pgmap v180: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T18:42:21.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:21 smithi192 ceph-mon[32842]: pgmap v180: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T18:42:23.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:23 smithi082 ceph-mon[32808]: pgmap v181: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:42:23.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:23 smithi080 ceph-mon[29135]: pgmap v181: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:42:23.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:23 smithi192 ceph-mon[32842]: pgmap v181: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:42:25.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:25 smithi082 ceph-mon[32808]: pgmap v182: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:42:25.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:25 smithi080 ceph-mon[29135]: pgmap v182: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:42:25.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:25 smithi192 ceph-mon[32842]: pgmap v182: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:42:27.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:27 smithi082 ceph-mon[32808]: pgmap v183: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:42:27.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:27 smithi080 ceph-mon[29135]: pgmap v183: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:42:27.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:27 smithi192 ceph-mon[32842]: pgmap v183: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:42:29.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:29 smithi082 ceph-mon[32808]: pgmap v184: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:42:29.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:29 smithi080 ceph-mon[29135]: pgmap v184: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:42:29.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:29 smithi192 ceph-mon[32842]: pgmap v184: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:42:31.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:31 smithi082 ceph-mon[32808]: pgmap v185: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:42:31.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:31 smithi080 ceph-mon[29135]: pgmap v185: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:42:31.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:31 smithi192 ceph-mon[32842]: pgmap v185: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:42:33.414 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:33 smithi192 ceph-mon[32842]: pgmap v186: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:33.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:33 smithi082 ceph-mon[32808]: pgmap v186: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:33.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:33 smithi080 ceph-mon[29135]: pgmap v186: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:35.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:35 smithi082 ceph-mon[32808]: pgmap v187: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:42:35.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:35 smithi080 ceph-mon[29135]: pgmap v187: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:42:35.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:35 smithi192 ceph-mon[32842]: pgmap v187: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:42:37.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:37 smithi082 ceph-mon[32808]: pgmap v188: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:37.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:37 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:42:37.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:37 smithi080 ceph-mon[29135]: pgmap v188: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:37.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:37 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:42:37.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:37 smithi192 ceph-mon[32842]: pgmap v188: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:37.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:37 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:42:38.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:38 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:42:38.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:38 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:42:38.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:38 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:42:38.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:38 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:42:38.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:38 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:42:38.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:38 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:42:38.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:38 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:42:38.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:38 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:42:38.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:38 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:42:39.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:39 smithi082 ceph-mon[32808]: pgmap v189: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:39.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:39 smithi080 ceph-mon[29135]: pgmap v189: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:39.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:39 smithi192 ceph-mon[32842]: pgmap v189: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:41.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:41 smithi082 ceph-mon[32808]: pgmap v190: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:42:41.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:41 smithi080 ceph-mon[29135]: pgmap v190: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:42:41.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:41 smithi192 ceph-mon[32842]: pgmap v190: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:42:43.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:43 smithi082 ceph-mon[32808]: pgmap v191: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:43.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:43 smithi080 ceph-mon[29135]: pgmap v191: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:43.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:43 smithi192 ceph-mon[32842]: pgmap v191: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:45.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:45 smithi082 ceph-mon[32808]: pgmap v192: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:42:45.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:45 smithi080 ceph-mon[29135]: pgmap v192: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:42:45.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:45 smithi192 ceph-mon[32842]: pgmap v192: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:42:47.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:47 smithi082 ceph-mon[32808]: pgmap v193: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:47.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:47 smithi080 ceph-mon[29135]: pgmap v193: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:47.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:47 smithi192 ceph-mon[32842]: pgmap v193: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:49.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:49 smithi082 ceph-mon[32808]: pgmap v194: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:49.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:49 smithi080 ceph-mon[29135]: pgmap v194: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:49.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:49 smithi192 ceph-mon[32842]: pgmap v194: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:51.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:51 smithi082 ceph-mon[32808]: pgmap v195: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:42:51.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:51 smithi080 ceph-mon[29135]: pgmap v195: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:42:51.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:51 smithi192 ceph-mon[32842]: pgmap v195: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:42:53.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:53 smithi082 ceph-mon[32808]: pgmap v196: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:53.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:53 smithi080 ceph-mon[29135]: pgmap v196: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:53.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:53 smithi192 ceph-mon[32842]: pgmap v196: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:55.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:55 smithi082 ceph-mon[32808]: pgmap v197: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:42:55.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:55 smithi080 ceph-mon[29135]: pgmap v197: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:42:55.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:55 smithi192 ceph-mon[32842]: pgmap v197: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:42:57.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:57 smithi082 ceph-mon[32808]: pgmap v198: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:57.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:57 smithi080 ceph-mon[29135]: pgmap v198: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:57.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:57 smithi192 ceph-mon[32842]: pgmap v198: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:59.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:42:59 smithi082 ceph-mon[32808]: pgmap v199: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:59.745 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:42:59 smithi080 ceph-mon[29135]: pgmap v199: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:42:59.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:42:59 smithi192 ceph-mon[32842]: pgmap v199: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:43:01.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:01 smithi082 ceph-mon[32808]: pgmap v200: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:43:01.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:01 smithi080 ceph-mon[29135]: pgmap v200: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:43:01.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:01 smithi192 ceph-mon[32842]: pgmap v200: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:43:03.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:03 smithi082 ceph-mon[32808]: pgmap v201: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:43:03.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:03 smithi080 ceph-mon[29135]: pgmap v201: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:43:03.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:03 smithi192 ceph-mon[32842]: pgmap v201: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:43:05.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:05 smithi082 ceph-mon[32808]: pgmap v202: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-26T18:43:05.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:05 smithi080 ceph-mon[29135]: pgmap v202: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-26T18:43:05.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:05 smithi192 ceph-mon[32842]: pgmap v202: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-26T18:43:07.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:07 smithi080 ceph-mon[29135]: pgmap v203: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T18:43:07.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:07 smithi192 ceph-mon[32842]: pgmap v203: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T18:43:07.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:07 smithi082 ceph-mon[32808]: pgmap v203: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T18:43:08.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:08 smithi080 ceph-mon[29135]: osdmap e94: 12 total, 12 up, 12 in 2024-04-26T18:43:08.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:08 smithi192 ceph-mon[32842]: osdmap e94: 12 total, 12 up, 12 in 2024-04-26T18:43:08.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:08 smithi082 ceph-mon[32808]: osdmap e94: 12 total, 12 up, 12 in 2024-04-26T18:43:09.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:09 smithi080 ceph-mon[29135]: pgmap v205: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:43:09.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:09 smithi192 ceph-mon[32842]: pgmap v205: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:43:09.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:09 smithi082 ceph-mon[32808]: pgmap v205: 97 pgs: 97 active+clean; 3.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:43:11.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:11 smithi080 ceph-mon[29135]: pgmap v206: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:43:11.772 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:11 smithi082 ceph-mon[32808]: pgmap v206: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:43:11.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:11 smithi192 ceph-mon[32842]: pgmap v206: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:43:13.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:13 smithi080 ceph-mon[29135]: pgmap v207: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:43:13.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:13 smithi192 ceph-mon[32842]: pgmap v207: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:43:13.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:13 smithi082 ceph-mon[32808]: pgmap v207: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:43:15.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:15 smithi192 ceph-mon[32842]: pgmap v208: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T18:43:15.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:15 smithi192 ceph-mon[32842]: osdmap e95: 12 total, 12 up, 12 in 2024-04-26T18:43:15.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:15 smithi082 ceph-mon[32808]: pgmap v208: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T18:43:15.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:15 smithi082 ceph-mon[32808]: osdmap e95: 12 total, 12 up, 12 in 2024-04-26T18:43:15.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:15 smithi080 ceph-mon[29135]: pgmap v208: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T18:43:15.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:15 smithi080 ceph-mon[29135]: osdmap e95: 12 total, 12 up, 12 in 2024-04-26T18:43:17.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:17 smithi192 ceph-mon[32842]: pgmap v210: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2024-04-26T18:43:17.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:17 smithi082 ceph-mon[32808]: pgmap v210: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2024-04-26T18:43:17.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:17 smithi080 ceph-mon[29135]: pgmap v210: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2024-04-26T18:43:19.295 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:19 smithi080 ceph-mon[29135]: pgmap v211: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T18:43:19.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:19 smithi192 ceph-mon[32842]: pgmap v211: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T18:43:19.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:19 smithi082 ceph-mon[32808]: pgmap v211: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T18:43:21.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:21 smithi192 ceph-mon[32842]: pgmap v212: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T18:43:21.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:21 smithi082 ceph-mon[32808]: pgmap v212: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T18:43:21.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:21 smithi080 ceph-mon[29135]: pgmap v212: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T18:43:23.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:23 smithi192 ceph-mon[32842]: pgmap v213: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T18:43:23.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:23 smithi082 ceph-mon[32808]: pgmap v213: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T18:43:23.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:23 smithi080 ceph-mon[29135]: pgmap v213: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T18:43:25.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:25 smithi192 ceph-mon[32842]: pgmap v214: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-04-26T18:43:25.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:25 smithi082 ceph-mon[32808]: pgmap v214: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-04-26T18:43:25.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:25 smithi080 ceph-mon[29135]: pgmap v214: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-04-26T18:43:27.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:27 smithi192 ceph-mon[32842]: pgmap v215: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:43:27.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:27 smithi082 ceph-mon[32808]: pgmap v215: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:43:27.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:27 smithi080 ceph-mon[29135]: pgmap v215: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:43:29.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:29 smithi192 ceph-mon[32842]: pgmap v216: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:43:29.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:29 smithi082 ceph-mon[32808]: pgmap v216: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:43:29.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:29 smithi080 ceph-mon[29135]: pgmap v216: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:43:31.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:31 smithi192 ceph-mon[32842]: pgmap v217: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2024-04-26T18:43:31.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:31 smithi082 ceph-mon[32808]: pgmap v217: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2024-04-26T18:43:31.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:31 smithi080 ceph-mon[29135]: pgmap v217: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2024-04-26T18:43:33.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:33 smithi192 ceph-mon[32842]: pgmap v218: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:43:33.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:33 smithi082 ceph-mon[32808]: pgmap v218: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:43:33.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:33 smithi080 ceph-mon[29135]: pgmap v218: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:43:35.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:35 smithi192 ceph-mon[32842]: pgmap v219: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:43:35.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:35 smithi082 ceph-mon[32808]: pgmap v219: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:43:35.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:35 smithi080 ceph-mon[29135]: pgmap v219: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:43:37.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:37 smithi192 ceph-mon[32842]: pgmap v220: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:43:37.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:37 smithi082 ceph-mon[32808]: pgmap v220: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:43:37.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:37 smithi080 ceph-mon[29135]: pgmap v220: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:43:38.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:38 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:43:38.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:38 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:43:38.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:38 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:43:39.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:39 smithi192 ceph-mon[32842]: pgmap v221: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:43:39.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:39 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:43:39.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:39 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:43:39.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:39 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:43:39.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:39 smithi082 ceph-mon[32808]: pgmap v221: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:43:39.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:39 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:43:39.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:39 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:43:39.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:39 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:43:39.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:39 smithi080 ceph-mon[29135]: pgmap v221: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:43:39.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:39 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:43:39.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:39 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:43:39.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:39 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:43:41.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:41 smithi192 ceph-mon[32842]: pgmap v222: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:43:41.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:41 smithi082 ceph-mon[32808]: pgmap v222: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:43:41.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:41 smithi080 ceph-mon[29135]: pgmap v222: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:43:43.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:43 smithi192 ceph-mon[32842]: pgmap v223: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:43:43.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:43 smithi082 ceph-mon[32808]: pgmap v223: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:43:43.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:43 smithi080 ceph-mon[29135]: pgmap v223: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:43:45.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:45 smithi192 ceph-mon[32842]: pgmap v224: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:43:45.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:45 smithi082 ceph-mon[32808]: pgmap v224: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:43:45.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:45 smithi080 ceph-mon[29135]: pgmap v224: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:43:47.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:47 smithi192 ceph-mon[32842]: pgmap v225: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:43:47.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:47 smithi082 ceph-mon[32808]: pgmap v225: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:43:47.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:47 smithi080 ceph-mon[29135]: pgmap v225: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:43:49.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:49 smithi192 ceph-mon[32842]: pgmap v226: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:43:49.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:49 smithi082 ceph-mon[32808]: pgmap v226: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:43:49.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:49 smithi080 ceph-mon[29135]: pgmap v226: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:43:51.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:51 smithi192 ceph-mon[32842]: pgmap v227: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:43:51.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:51 smithi082 ceph-mon[32808]: pgmap v227: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:43:51.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:51 smithi080 ceph-mon[29135]: pgmap v227: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:43:53.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:53 smithi192 ceph-mon[32842]: pgmap v228: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:43:53.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:53 smithi082 ceph-mon[32808]: pgmap v228: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:43:53.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:53 smithi080 ceph-mon[29135]: pgmap v228: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:43:55.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:55 smithi192 ceph-mon[32842]: pgmap v229: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:43:55.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:55 smithi082 ceph-mon[32808]: pgmap v229: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:43:55.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:55 smithi080 ceph-mon[29135]: pgmap v229: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:43:57.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:57 smithi192 ceph-mon[32842]: pgmap v230: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:43:57.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:57 smithi082 ceph-mon[32808]: pgmap v230: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:43:57.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:57 smithi080 ceph-mon[29135]: pgmap v230: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:43:59.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:43:59 smithi192 ceph-mon[32842]: pgmap v231: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:43:59.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:43:59 smithi082 ceph-mon[32808]: pgmap v231: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:43:59.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:43:59 smithi080 ceph-mon[29135]: pgmap v231: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:01.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:01 smithi082 ceph-mon[32808]: pgmap v232: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:44:01.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:01 smithi080 ceph-mon[29135]: pgmap v232: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:44:01.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:01 smithi192 ceph-mon[32842]: pgmap v232: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:44:03.414 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:03 smithi192 ceph-mon[32842]: pgmap v233: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:03.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:03 smithi082 ceph-mon[32808]: pgmap v233: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:03.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:03 smithi080 ceph-mon[29135]: pgmap v233: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:05.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:05 smithi082 ceph-mon[32808]: pgmap v234: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-26T18:44:05.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:05 smithi080 ceph-mon[29135]: pgmap v234: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-26T18:44:05.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:05 smithi192 ceph-mon[32842]: pgmap v234: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-26T18:44:07.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:07 smithi082 ceph-mon[32808]: pgmap v235: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T18:44:07.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:07 smithi080 ceph-mon[29135]: pgmap v235: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T18:44:07.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:07 smithi192 ceph-mon[32842]: pgmap v235: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T18:44:08.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:08 smithi082 ceph-mon[32808]: osdmap e96: 12 total, 12 up, 12 in 2024-04-26T18:44:08.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:08 smithi080 ceph-mon[29135]: osdmap e96: 12 total, 12 up, 12 in 2024-04-26T18:44:08.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:08 smithi192 ceph-mon[32842]: osdmap e96: 12 total, 12 up, 12 in 2024-04-26T18:44:09.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:09 smithi082 ceph-mon[32808]: pgmap v237: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:44:09.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:09 smithi080 ceph-mon[29135]: pgmap v237: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:44:09.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:09 smithi192 ceph-mon[32842]: pgmap v237: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:44:11.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:11 smithi082 ceph-mon[32808]: pgmap v238: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:44:11.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:11 smithi080 ceph-mon[29135]: pgmap v238: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:44:11.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:11 smithi192 ceph-mon[32842]: pgmap v238: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:44:13.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:13 smithi082 ceph-mon[32808]: pgmap v239: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:44:13.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:13 smithi080 ceph-mon[29135]: pgmap v239: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:44:13.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:13 smithi192 ceph-mon[32842]: pgmap v239: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:44:15.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:15 smithi192 ceph-mon[32842]: pgmap v240: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T18:44:15.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:15 smithi192 ceph-mon[32842]: osdmap e97: 12 total, 12 up, 12 in 2024-04-26T18:44:15.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:15 smithi082 ceph-mon[32808]: pgmap v240: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T18:44:15.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:15 smithi082 ceph-mon[32808]: osdmap e97: 12 total, 12 up, 12 in 2024-04-26T18:44:15.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:15 smithi080 ceph-mon[29135]: pgmap v240: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T18:44:15.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:15 smithi080 ceph-mon[29135]: osdmap e97: 12 total, 12 up, 12 in 2024-04-26T18:44:17.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:17 smithi192 ceph-mon[32842]: pgmap v242: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2024-04-26T18:44:17.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:17 smithi082 ceph-mon[32808]: pgmap v242: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2024-04-26T18:44:17.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:17 smithi080 ceph-mon[29135]: pgmap v242: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2024-04-26T18:44:19.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:19 smithi192 ceph-mon[32842]: pgmap v243: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T18:44:19.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:19 smithi082 ceph-mon[32808]: pgmap v243: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T18:44:19.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:19 smithi080 ceph-mon[29135]: pgmap v243: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T18:44:21.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:21 smithi192 ceph-mon[32842]: pgmap v244: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T18:44:21.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:21 smithi082 ceph-mon[32808]: pgmap v244: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T18:44:21.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:21 smithi080 ceph-mon[29135]: pgmap v244: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T18:44:23.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:23 smithi192 ceph-mon[32842]: pgmap v245: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T18:44:23.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:23 smithi082 ceph-mon[32808]: pgmap v245: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T18:44:23.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:23 smithi080 ceph-mon[29135]: pgmap v245: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T18:44:25.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:25 smithi192 ceph-mon[32842]: pgmap v246: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T18:44:25.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:25 smithi082 ceph-mon[32808]: pgmap v246: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T18:44:25.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:25 smithi080 ceph-mon[29135]: pgmap v246: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T18:44:27.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:27 smithi192 ceph-mon[32842]: pgmap v247: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:27.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:27 smithi082 ceph-mon[32808]: pgmap v247: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:27.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:27 smithi080 ceph-mon[29135]: pgmap v247: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:29.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:29 smithi192 ceph-mon[32842]: pgmap v248: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:29.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:29 smithi082 ceph-mon[32808]: pgmap v248: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:29.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:29 smithi080 ceph-mon[29135]: pgmap v248: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:31.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:31 smithi192 ceph-mon[32842]: pgmap v249: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:44:31.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:31 smithi082 ceph-mon[32808]: pgmap v249: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:44:31.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:31 smithi080 ceph-mon[29135]: pgmap v249: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:44:33.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:33 smithi192 ceph-mon[32842]: pgmap v250: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:33.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:33 smithi082 ceph-mon[32808]: pgmap v250: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:33.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:33 smithi080 ceph-mon[29135]: pgmap v250: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:35.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:35 smithi192 ceph-mon[32842]: pgmap v251: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:44:35.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:35 smithi082 ceph-mon[32808]: pgmap v251: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:44:35.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:35 smithi080 ceph-mon[29135]: pgmap v251: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:44:37.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:37 smithi192 ceph-mon[32842]: pgmap v252: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:37.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:37 smithi082 ceph-mon[32808]: pgmap v252: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:37.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:37 smithi080 ceph-mon[29135]: pgmap v252: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:39.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:39 smithi192 ceph-mon[32842]: pgmap v253: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:39.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:39 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:44:39.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:39 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:44:39.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:39 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:44:39.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:39 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:44:39.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:39 smithi082 ceph-mon[32808]: pgmap v253: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:39.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:39 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:44:39.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:39 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:44:39.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:39 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:44:39.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:39 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:44:39.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:39 smithi080 ceph-mon[29135]: pgmap v253: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:39.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:39 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:44:39.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:39 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:44:39.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:39 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:44:39.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:39 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:44:41.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:41 smithi192 ceph-mon[32842]: pgmap v254: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:44:41.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:41 smithi082 ceph-mon[32808]: pgmap v254: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:44:41.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:41 smithi080 ceph-mon[29135]: pgmap v254: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:44:43.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:43 smithi192 ceph-mon[32842]: pgmap v255: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:43.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:43 smithi082 ceph-mon[32808]: pgmap v255: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:43.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:43 smithi080 ceph-mon[29135]: pgmap v255: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:45.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:45 smithi192 ceph-mon[32842]: pgmap v256: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:44:45.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:45 smithi082 ceph-mon[32808]: pgmap v256: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:44:45.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:45 smithi080 ceph-mon[29135]: pgmap v256: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:44:47.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:47 smithi192 ceph-mon[32842]: pgmap v257: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:47.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:47 smithi082 ceph-mon[32808]: pgmap v257: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:47.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:47 smithi080 ceph-mon[29135]: pgmap v257: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:49.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:49 smithi192 ceph-mon[32842]: pgmap v258: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:49.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:49 smithi082 ceph-mon[32808]: pgmap v258: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:49.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:49 smithi080 ceph-mon[29135]: pgmap v258: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:51.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:51 smithi192 ceph-mon[32842]: pgmap v259: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:44:51.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:51 smithi082 ceph-mon[32808]: pgmap v259: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:44:51.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:51 smithi080 ceph-mon[29135]: pgmap v259: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:44:53.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:53 smithi192 ceph-mon[32842]: pgmap v260: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:53.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:53 smithi082 ceph-mon[32808]: pgmap v260: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:53.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:53 smithi080 ceph-mon[29135]: pgmap v260: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:55.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:55 smithi082 ceph-mon[32808]: pgmap v261: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:44:55.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:55 smithi080 ceph-mon[29135]: pgmap v261: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:44:55.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:55 smithi192 ceph-mon[32842]: pgmap v261: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:44:57.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:57 smithi082 ceph-mon[32808]: pgmap v262: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:57.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:57 smithi080 ceph-mon[29135]: pgmap v262: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:57.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:57 smithi192 ceph-mon[32842]: pgmap v262: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:59.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:44:59 smithi082 ceph-mon[32808]: pgmap v263: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:59.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:44:59 smithi080 ceph-mon[29135]: pgmap v263: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:44:59.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:44:59 smithi192 ceph-mon[32842]: pgmap v263: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:01.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:01 smithi082 ceph-mon[32808]: pgmap v264: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:45:01.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:01 smithi080 ceph-mon[29135]: pgmap v264: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:45:01.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:01 smithi192 ceph-mon[32842]: pgmap v264: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:45:03.414 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:03 smithi192 ceph-mon[32842]: pgmap v265: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:03.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:03 smithi082 ceph-mon[32808]: pgmap v265: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:03.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:03 smithi080 ceph-mon[29135]: pgmap v265: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:05.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:05 smithi082 ceph-mon[32808]: pgmap v266: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-26T18:45:05.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:05 smithi080 ceph-mon[29135]: pgmap v266: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-26T18:45:05.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:05 smithi192 ceph-mon[32842]: pgmap v266: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-26T18:45:07.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:07 smithi082 ceph-mon[32808]: pgmap v267: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T18:45:07.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:07 smithi080 ceph-mon[29135]: pgmap v267: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T18:45:07.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:07 smithi192 ceph-mon[32842]: pgmap v267: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T18:45:08.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:08 smithi082 ceph-mon[32808]: osdmap e98: 12 total, 12 up, 12 in 2024-04-26T18:45:08.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:08 smithi080 ceph-mon[29135]: osdmap e98: 12 total, 12 up, 12 in 2024-04-26T18:45:08.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:08 smithi192 ceph-mon[32842]: osdmap e98: 12 total, 12 up, 12 in 2024-04-26T18:45:09.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:09 smithi082 ceph-mon[32808]: pgmap v269: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:45:09.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:09 smithi080 ceph-mon[29135]: pgmap v269: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:45:09.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:09 smithi192 ceph-mon[32842]: pgmap v269: 97 pgs: 97 active+clean; 3.1 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:45:11.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:11 smithi082 ceph-mon[32808]: pgmap v270: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:45:11.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:11 smithi080 ceph-mon[29135]: pgmap v270: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:45:11.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:11 smithi192 ceph-mon[32842]: pgmap v270: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:45:13.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:13 smithi082 ceph-mon[32808]: pgmap v271: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:45:13.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:13 smithi080 ceph-mon[29135]: pgmap v271: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:45:13.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:13 smithi192 ceph-mon[32842]: pgmap v271: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:45:15.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:15 smithi192 ceph-mon[32842]: pgmap v272: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T18:45:15.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:15 smithi192 ceph-mon[32842]: osdmap e99: 12 total, 12 up, 12 in 2024-04-26T18:45:15.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:15 smithi082 ceph-mon[32808]: pgmap v272: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T18:45:15.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:15 smithi082 ceph-mon[32808]: osdmap e99: 12 total, 12 up, 12 in 2024-04-26T18:45:15.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:15 smithi080 ceph-mon[29135]: pgmap v272: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T18:45:15.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:15 smithi080 ceph-mon[29135]: osdmap e99: 12 total, 12 up, 12 in 2024-04-26T18:45:17.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:17 smithi192 ceph-mon[32842]: pgmap v274: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 234 B/s wr, 11 op/s 2024-04-26T18:45:17.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:17 smithi082 ceph-mon[32808]: pgmap v274: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 234 B/s wr, 11 op/s 2024-04-26T18:45:17.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:17 smithi080 ceph-mon[29135]: pgmap v274: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 234 B/s wr, 11 op/s 2024-04-26T18:45:19.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:19 smithi192 ceph-mon[32842]: pgmap v275: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T18:45:19.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:19 smithi082 ceph-mon[32808]: pgmap v275: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T18:45:19.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:19 smithi080 ceph-mon[29135]: pgmap v275: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T18:45:21.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:21 smithi192 ceph-mon[32842]: pgmap v276: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T18:45:21.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:21 smithi082 ceph-mon[32808]: pgmap v276: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T18:45:21.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:21 smithi080 ceph-mon[29135]: pgmap v276: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T18:45:23.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:23 smithi192 ceph-mon[32842]: pgmap v277: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T18:45:23.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:23 smithi082 ceph-mon[32808]: pgmap v277: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T18:45:23.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:23 smithi080 ceph-mon[29135]: pgmap v277: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T18:45:25.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:25 smithi192 ceph-mon[32842]: pgmap v278: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T18:45:25.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:25 smithi082 ceph-mon[32808]: pgmap v278: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T18:45:25.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:25 smithi080 ceph-mon[29135]: pgmap v278: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T18:45:27.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:27 smithi192 ceph-mon[32842]: pgmap v279: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:27.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:27 smithi082 ceph-mon[32808]: pgmap v279: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:27.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:27 smithi080 ceph-mon[29135]: pgmap v279: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:29.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:29 smithi192 ceph-mon[32842]: pgmap v280: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:29.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:29 smithi082 ceph-mon[32808]: pgmap v280: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:29.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:29 smithi080 ceph-mon[29135]: pgmap v280: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:31.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:31 smithi192 ceph-mon[32842]: pgmap v281: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:45:31.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:31 smithi082 ceph-mon[32808]: pgmap v281: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:45:31.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:31 smithi080 ceph-mon[29135]: pgmap v281: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:45:33.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:33 smithi192 ceph-mon[32842]: pgmap v282: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:33.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:33 smithi082 ceph-mon[32808]: pgmap v282: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:33.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:33 smithi080 ceph-mon[29135]: pgmap v282: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:35.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:35 smithi192 ceph-mon[32842]: pgmap v283: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:45:35.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:35 smithi082 ceph-mon[32808]: pgmap v283: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:45:35.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:35 smithi080 ceph-mon[29135]: pgmap v283: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:45:37.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:37 smithi192 ceph-mon[32842]: pgmap v284: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:37.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:37 smithi082 ceph-mon[32808]: pgmap v284: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:37.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:37 smithi080 ceph-mon[29135]: pgmap v284: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:39.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:39 smithi192 ceph-mon[32842]: pgmap v285: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:39.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:39 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:45:39.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:39 smithi082 ceph-mon[32808]: pgmap v285: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:39.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:39 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:45:39.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:39 smithi080 ceph-mon[29135]: pgmap v285: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:39.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:39 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:45:40.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:40 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:45:40.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:40 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:45:40.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:40 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:45:40.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:40 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:45:40.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:40 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:45:40.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:40 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:45:40.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:40 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:45:40.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:40 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:45:40.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:40 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:45:41.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:41 smithi192 ceph-mon[32842]: pgmap v286: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:45:41.370 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:41 smithi082 ceph-mon[32808]: pgmap v286: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:45:41.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:41 smithi080 ceph-mon[29135]: pgmap v286: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:45:43.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:43 smithi192 ceph-mon[32842]: pgmap v287: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:43.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:43 smithi082 ceph-mon[32808]: pgmap v287: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:43.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:43 smithi080 ceph-mon[29135]: pgmap v287: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:45.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:45 smithi192 ceph-mon[32842]: pgmap v288: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:45:45.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:45 smithi082 ceph-mon[32808]: pgmap v288: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:45:45.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:45 smithi080 ceph-mon[29135]: pgmap v288: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:45:47.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:47 smithi082 ceph-mon[32808]: pgmap v289: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:47.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:47 smithi080 ceph-mon[29135]: pgmap v289: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:47.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:47 smithi192 ceph-mon[32842]: pgmap v289: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:49.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:49 smithi082 ceph-mon[32808]: pgmap v290: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:49.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:49 smithi080 ceph-mon[29135]: pgmap v290: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:49.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:49 smithi192 ceph-mon[32842]: pgmap v290: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:51.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:51 smithi082 ceph-mon[32808]: pgmap v291: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:45:51.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:51 smithi080 ceph-mon[29135]: pgmap v291: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:45:51.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:51 smithi192 ceph-mon[32842]: pgmap v291: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:45:53.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:53 smithi082 ceph-mon[32808]: pgmap v292: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:53.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:53 smithi080 ceph-mon[29135]: pgmap v292: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:53.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:53 smithi192 ceph-mon[32842]: pgmap v292: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:55.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:55 smithi082 ceph-mon[32808]: pgmap v293: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:45:55.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:55 smithi080 ceph-mon[29135]: pgmap v293: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:45:55.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:55 smithi192 ceph-mon[32842]: pgmap v293: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:45:57.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:57 smithi082 ceph-mon[32808]: pgmap v294: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:57.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:57 smithi080 ceph-mon[29135]: pgmap v294: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:57.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:57 smithi192 ceph-mon[32842]: pgmap v294: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:59.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:45:59 smithi082 ceph-mon[32808]: pgmap v295: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:59.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:45:59 smithi080 ceph-mon[29135]: pgmap v295: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:45:59.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:45:59 smithi192 ceph-mon[32842]: pgmap v295: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:46:01.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:01 smithi082 ceph-mon[32808]: pgmap v296: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:46:01.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:01 smithi080 ceph-mon[29135]: pgmap v296: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:46:01.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:01 smithi192 ceph-mon[32842]: pgmap v296: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:46:03.414 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:03 smithi192 ceph-mon[32842]: pgmap v297: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:46:03.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:03 smithi082 ceph-mon[32808]: pgmap v297: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:46:03.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:03 smithi080 ceph-mon[29135]: pgmap v297: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:46:05.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:05 smithi082 ceph-mon[32808]: pgmap v298: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-26T18:46:05.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:05 smithi080 ceph-mon[29135]: pgmap v298: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-26T18:46:05.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:05 smithi192 ceph-mon[32842]: pgmap v298: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-26T18:46:07.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:07 smithi082 ceph-mon[32808]: pgmap v299: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T18:46:07.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:07 smithi080 ceph-mon[29135]: pgmap v299: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T18:46:07.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:07 smithi192 ceph-mon[32842]: pgmap v299: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T18:46:08.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:08 smithi082 ceph-mon[32808]: osdmap e100: 12 total, 12 up, 12 in 2024-04-26T18:46:08.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:08 smithi080 ceph-mon[29135]: osdmap e100: 12 total, 12 up, 12 in 2024-04-26T18:46:08.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:08 smithi192 ceph-mon[32842]: osdmap e100: 12 total, 12 up, 12 in 2024-04-26T18:46:09.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:09 smithi082 ceph-mon[32808]: pgmap v301: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:46:09.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:09 smithi080 ceph-mon[29135]: pgmap v301: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:46:09.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:09 smithi192 ceph-mon[32842]: pgmap v301: 97 pgs: 97 active+clean; 2.7 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:46:11.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:11 smithi082 ceph-mon[32808]: pgmap v302: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:46:11.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:11 smithi080 ceph-mon[29135]: pgmap v302: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:46:11.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:11 smithi192 ceph-mon[32842]: pgmap v302: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:46:13.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:13 smithi082 ceph-mon[32808]: pgmap v303: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:46:13.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:13 smithi080 ceph-mon[29135]: pgmap v303: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:46:13.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:13 smithi192 ceph-mon[32842]: pgmap v303: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:46:15.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:15 smithi192 ceph-mon[32842]: pgmap v304: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T18:46:15.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:15 smithi192 ceph-mon[32842]: osdmap e101: 12 total, 12 up, 12 in 2024-04-26T18:46:15.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:15 smithi082 ceph-mon[32808]: pgmap v304: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T18:46:15.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:15 smithi082 ceph-mon[32808]: osdmap e101: 12 total, 12 up, 12 in 2024-04-26T18:46:15.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:15 smithi080 ceph-mon[29135]: pgmap v304: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T18:46:15.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:15 smithi080 ceph-mon[29135]: osdmap e101: 12 total, 12 up, 12 in 2024-04-26T18:46:17.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:17 smithi192 ceph-mon[32842]: pgmap v306: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 234 B/s wr, 11 op/s 2024-04-26T18:46:17.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:17 smithi082 ceph-mon[32808]: pgmap v306: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 234 B/s wr, 11 op/s 2024-04-26T18:46:17.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:17 smithi080 ceph-mon[29135]: pgmap v306: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 234 B/s wr, 11 op/s 2024-04-26T18:46:19.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:19 smithi192 ceph-mon[32842]: pgmap v307: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T18:46:19.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:19 smithi082 ceph-mon[32808]: pgmap v307: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T18:46:19.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:19 smithi080 ceph-mon[29135]: pgmap v307: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-26T18:46:21.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:21 smithi192 ceph-mon[32842]: pgmap v308: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T18:46:21.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:21 smithi082 ceph-mon[32808]: pgmap v308: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T18:46:21.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:21 smithi080 ceph-mon[29135]: pgmap v308: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T18:46:23.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:23 smithi192 ceph-mon[32842]: pgmap v309: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T18:46:23.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:23 smithi082 ceph-mon[32808]: pgmap v309: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T18:46:23.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:23 smithi080 ceph-mon[29135]: pgmap v309: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-26T18:46:25.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:25 smithi192 ceph-mon[32842]: pgmap v310: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T18:46:25.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:25 smithi082 ceph-mon[32808]: pgmap v310: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T18:46:25.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:25 smithi080 ceph-mon[29135]: pgmap v310: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T18:46:27.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:27 smithi192 ceph-mon[32842]: pgmap v311: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:46:27.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:27 smithi082 ceph-mon[32808]: pgmap v311: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:46:27.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:27 smithi080 ceph-mon[29135]: pgmap v311: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:46:29.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:29 smithi192 ceph-mon[32842]: pgmap v312: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:46:29.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:29 smithi082 ceph-mon[32808]: pgmap v312: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:46:29.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:29 smithi080 ceph-mon[29135]: pgmap v312: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:46:30.774 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-26T18:46:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.890+0000 7f6e15f78640 1 -- 172.21.15.80:0/3308904082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e10101740 msgr2=0x7f6e10101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.890+0000 7f6e15f78640 1 --2- 172.21.15.80:0/3308904082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e10101740 0x7f6e10101b20 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009900 tx=0x7f6e0002a410 comp rx=0 tx=0).stop 2024-04-26T18:46:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.890+0000 7f6e15f78640 1 -- 172.21.15.80:0/3308904082 shutdown_connections 2024-04-26T18:46:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.890+0000 7f6e15f78640 1 --2- 172.21.15.80:0/3308904082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e1010f2f0 0x7f6e101116e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.890+0000 7f6e15f78640 1 --2- 172.21.15.80:0/3308904082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e10102060 0x7f6e1010edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.890+0000 7f6e15f78640 1 --2- 172.21.15.80:0/3308904082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e10101740 0x7f6e10101b20 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.890+0000 7f6e15f78640 1 -- 172.21.15.80:0/3308904082 >> 172.21.15.80:0/3308904082 conn(0x7f6e100789b0 msgr2=0x7f6e10078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:46:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.890+0000 7f6e15f78640 1 -- 172.21.15.80:0/3308904082 shutdown_connections 2024-04-26T18:46:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.890+0000 7f6e15f78640 1 -- 172.21.15.80:0/3308904082 wait complete. 2024-04-26T18:46:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.891+0000 7f6e15f78640 1 Processor -- start 2024-04-26T18:46:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.891+0000 7f6e15f78640 1 -- start start 2024-04-26T18:46:30.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.891+0000 7f6e15f78640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e10101740 0x7f6e1019b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:30.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.891+0000 7f6e15f78640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e10102060 0x7f6e1019b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:30.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.891+0000 7f6e15f78640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e1010f2f0 0x7f6e1019fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:30.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.891+0000 7f6e15f78640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6e10114dd0 con 0x7f6e1010f2f0 2024-04-26T18:46:30.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.891+0000 7f6e15f78640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6e10114c50 con 0x7f6e10102060 2024-04-26T18:46:30.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.891+0000 7f6e15f78640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6e10114f50 con 0x7f6e10101740 2024-04-26T18:46:30.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.891+0000 7f6e0ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e1010f2f0 0x7f6e1019fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:30.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.891+0000 7f6e0ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e1010f2f0 0x7f6e1019fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53730/0 (socket says 172.21.15.80:53730) 2024-04-26T18:46:30.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.891+0000 7f6e0ffff640 1 -- 172.21.15.80:0/2653823802 learned_addr learned my addr 172.21.15.80:0/2653823802 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:46:30.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.892+0000 7f6e0f7fe640 1 --2- 172.21.15.80:0/2653823802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e10101740 0x7f6e1019b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:30.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.892+0000 7f6e07fff640 1 --2- 172.21.15.80:0/2653823802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e10102060 0x7f6e1019b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:30.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.892+0000 7f6e0ffff640 1 -- 172.21.15.80:0/2653823802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e10101740 msgr2=0x7f6e1019b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:30.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.892+0000 7f6e0ffff640 1 --2- 172.21.15.80:0/2653823802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e10101740 0x7f6e1019b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:30.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.892+0000 7f6e0ffff640 1 -- 172.21.15.80:0/2653823802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e10102060 msgr2=0x7f6e1019b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:30.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.892+0000 7f6e0ffff640 1 --2- 172.21.15.80:0/2653823802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e10102060 0x7f6e1019b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:30.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.892+0000 7f6e0ffff640 1 -- 172.21.15.80:0/2653823802 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e101a02d0 con 0x7f6e1010f2f0 2024-04-26T18:46:30.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.892+0000 7f6e0ffff640 1 --2- 172.21.15.80:0/2653823802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e1010f2f0 0x7f6e1019fba0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800e9d0 tx=0x7f6e0800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:46:30.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.892+0000 7f6e0d7fa640 1 -- 172.21.15.80:0/2653823802 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0800cd80 con 0x7f6e1010f2f0 2024-04-26T18:46:30.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.892+0000 7f6e0d7fa640 1 -- 172.21.15.80:0/2653823802 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e08005020 con 0x7f6e1010f2f0 2024-04-26T18:46:30.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.892+0000 7f6e0d7fa640 1 -- 172.21.15.80:0/2653823802 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e080116d0 con 0x7f6e1010f2f0 2024-04-26T18:46:30.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.892+0000 7f6e15f78640 1 -- 172.21.15.80:0/2653823802 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e101a05c0 con 0x7f6e1010f2f0 2024-04-26T18:46:30.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.892+0000 7f6e15f78640 1 -- 172.21.15.80:0/2653823802 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e101a7e50 con 0x7f6e1010f2f0 2024-04-26T18:46:30.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.893+0000 7f6e15f78640 1 -- 172.21.15.80:0/2653823802 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e100506c0 con 0x7f6e1010f2f0 2024-04-26T18:46:30.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.894+0000 7f6e0d7fa640 1 -- 172.21.15.80:0/2653823802 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f6e080051d0 con 0x7f6e1010f2f0 2024-04-26T18:46:30.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.895+0000 7f6e0d7fa640 1 --2- 172.21.15.80:0/2653823802 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f6dfc0a3e40 0x7f6dfc0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:30.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.895+0000 7f6e0f7fe640 1 --2- 172.21.15.80:0/2653823802 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f6dfc0a3e40 0x7f6dfc0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:30.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.895+0000 7f6e0d7fa640 1 -- 172.21.15.80:0/2653823802 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8484+0+0 (secure 0 0 0) 0x7f6e080d0c20 con 0x7f6e1010f2f0 2024-04-26T18:46:30.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.896+0000 7f6e0f7fe640 1 --2- 172.21.15.80:0/2653823802 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f6dfc0a3e40 0x7f6dfc0a6300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6e00031440 tx=0x7f6e00005b50 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:46:30.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:30.899+0000 7f6e0d7fa640 1 -- 172.21.15.80:0/2653823802 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6e08016030 con 0x7f6e1010f2f0 2024-04-26T18:46:31.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.099+0000 7f6e15f78640 1 -- 172.21.15.80:0/2653823802 --> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f6e10062d70 con 0x7f6dfc0a3e40 2024-04-26T18:46:31.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.107+0000 7f6e0d7fa640 1 -- 172.21.15.80:0/2653823802 <== mgr.24736 v2:172.21.15.80:6800/1522002759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f6e10062d70 con 0x7f6dfc0a3e40 2024-04-26T18:46:31.107 INFO:teuthology.orchestra.run.smithi080.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-26T00:00:00", "created": "2024-04-26T18:36:29", "first": "2024-04-26T18:37:00", "last": "2024-04-26T18:46:00", "last_pruned": "2024-04-26T18:46:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-04-26T18:46:31.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.109+0000 7f6e15f78640 1 -- 172.21.15.80:0/2653823802 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f6dfc0a3e40 msgr2=0x7f6dfc0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:31.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.109+0000 7f6e15f78640 1 --2- 172.21.15.80:0/2653823802 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f6dfc0a3e40 0x7f6dfc0a6300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6e00031440 tx=0x7f6e00005b50 comp rx=0 tx=0).stop 2024-04-26T18:46:31.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.109+0000 7f6e15f78640 1 -- 172.21.15.80:0/2653823802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e1010f2f0 msgr2=0x7f6e1019fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:31.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.109+0000 7f6e15f78640 1 --2- 172.21.15.80:0/2653823802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e1010f2f0 0x7f6e1019fba0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800e9d0 tx=0x7f6e0800ee90 comp rx=0 tx=0).stop 2024-04-26T18:46:31.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.109+0000 7f6e15f78640 1 -- 172.21.15.80:0/2653823802 shutdown_connections 2024-04-26T18:46:31.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.109+0000 7f6e15f78640 1 --2- 172.21.15.80:0/2653823802 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f6dfc0a3e40 0x7f6dfc0a6300 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.109+0000 7f6e15f78640 1 --2- 172.21.15.80:0/2653823802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e1010f2f0 0x7f6e1019fba0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.109+0000 7f6e15f78640 1 --2- 172.21.15.80:0/2653823802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e10102060 0x7f6e1019b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.109+0000 7f6e15f78640 1 --2- 172.21.15.80:0/2653823802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e10101740 0x7f6e1019b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.109+0000 7f6e15f78640 1 -- 172.21.15.80:0/2653823802 >> 172.21.15.80:0/2653823802 conn(0x7f6e100789b0 msgr2=0x7f6e101108a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:46:31.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.109+0000 7f6e15f78640 1 -- 172.21.15.80:0/2653823802 shutdown_connections 2024-04-26T18:46:31.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.109+0000 7f6e15f78640 1 -- 172.21.15.80:0/2653823802 wait complete. 2024-04-26T18:46:31.120 DEBUG:teuthology.orchestra.run.smithi080:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-26T18:46:31.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.220+0000 7f7a576f1640 1 -- 172.21.15.80:0/3410623890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a50101860 msgr2=0x7f7a50101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:31.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.220+0000 7f7a576f1640 1 --2- 172.21.15.80:0/3410623890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a50101860 0x7f7a50101ce0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7a40009930 tx=0x7f7a4002a420 comp rx=0 tx=0).stop 2024-04-26T18:46:31.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.220+0000 7f7a576f1640 1 -- 172.21.15.80:0/3410623890 shutdown_connections 2024-04-26T18:46:31.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.220+0000 7f7a576f1640 1 --2- 172.21.15.80:0/3410623890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a50101860 0x7f7a50101ce0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.220+0000 7f7a576f1640 1 --2- 172.21.15.80:0/3410623890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a50102220 0x7f7a5010e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.220+0000 7f7a576f1640 1 --2- 172.21.15.80:0/3410623890 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a50107820 0x7f7a50107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.220+0000 7f7a576f1640 1 -- 172.21.15.80:0/3410623890 >> 172.21.15.80:0/3410623890 conn(0x7f7a500789b0 msgr2=0x7f7a50078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:46:31.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.220+0000 7f7a576f1640 1 -- 172.21.15.80:0/3410623890 shutdown_connections 2024-04-26T18:46:31.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.220+0000 7f7a576f1640 1 -- 172.21.15.80:0/3410623890 wait complete. 2024-04-26T18:46:31.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.220+0000 7f7a576f1640 1 Processor -- start 2024-04-26T18:46:31.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.220+0000 7f7a576f1640 1 -- start start 2024-04-26T18:46:31.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.221+0000 7f7a576f1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a50101860 0x7f7a50197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:31.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.221+0000 7f7a576f1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a50102220 0x7f7a50198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:31.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.221+0000 7f7a576f1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a50107820 0x7f7a5019c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:31.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.221+0000 7f7a576f1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7a50111ae0 con 0x7f7a50102220 2024-04-26T18:46:31.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.221+0000 7f7a576f1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7a50111960 con 0x7f7a50107820 2024-04-26T18:46:31.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.221+0000 7f7a576f1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7a50111c60 con 0x7f7a50101860 2024-04-26T18:46:31.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.221+0000 7f7a54c8c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a50102220 0x7f7a50198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:31.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.221+0000 7f7a54c8c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a50102220 0x7f7a50198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53746/0 (socket says 172.21.15.80:53746) 2024-04-26T18:46:31.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.221+0000 7f7a54c8c640 1 -- 172.21.15.80:0/1575124169 learned_addr learned my addr 172.21.15.80:0/1575124169 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:46:31.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.221+0000 7f7a55c8e640 1 --2- 172.21.15.80:0/1575124169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a50107820 0x7f7a5019c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:31.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.221+0000 7f7a54c8c640 1 -- 172.21.15.80:0/1575124169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a50101860 msgr2=0x7f7a50197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:31.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.221+0000 7f7a5548d640 1 --2- 172.21.15.80:0/1575124169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a50101860 0x7f7a50197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:31.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.221+0000 7f7a54c8c640 1 --2- 172.21.15.80:0/1575124169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a50101860 0x7f7a50197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.221+0000 7f7a54c8c640 1 -- 172.21.15.80:0/1575124169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a50107820 msgr2=0x7f7a5019c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:31.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.221+0000 7f7a54c8c640 1 --2- 172.21.15.80:0/1575124169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a50107820 0x7f7a5019c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.221+0000 7f7a54c8c640 1 -- 172.21.15.80:0/1575124169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a5019cfd0 con 0x7f7a50102220 2024-04-26T18:46:31.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.221+0000 7f7a54c8c640 1 --2- 172.21.15.80:0/1575124169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a50102220 0x7f7a50198520 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7a40004770 tx=0x7f7a400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:46:31.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.221+0000 7f7a467fc640 1 -- 172.21.15.80:0/1575124169 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4003f070 con 0x7f7a50102220 2024-04-26T18:46:31.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.221+0000 7f7a467fc640 1 -- 172.21.15.80:0/1575124169 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a4003b460 con 0x7f7a50102220 2024-04-26T18:46:31.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.221+0000 7f7a576f1640 1 -- 172.21.15.80:0/1575124169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a5019d260 con 0x7f7a50102220 2024-04-26T18:46:31.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.221+0000 7f7a467fc640 1 -- 172.21.15.80:0/1575124169 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a40035070 con 0x7f7a50102220 2024-04-26T18:46:31.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.221+0000 7f7a576f1640 1 -- 172.21.15.80:0/1575124169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a501a4b50 con 0x7f7a50102220 2024-04-26T18:46:31.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.222+0000 7f7a576f1640 1 -- 172.21.15.80:0/1575124169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a500506c0 con 0x7f7a50102220 2024-04-26T18:46:31.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.224+0000 7f7a467fc640 1 -- 172.21.15.80:0/1575124169 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f7a4003b8d0 con 0x7f7a50102220 2024-04-26T18:46:31.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.224+0000 7f7a467fc640 1 --2- 172.21.15.80:0/1575124169 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f7a3c0a3dc0 0x7f7a3c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:31.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.224+0000 7f7a5548d640 1 --2- 172.21.15.80:0/1575124169 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f7a3c0a3dc0 0x7f7a3c0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:31.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.225+0000 7f7a467fc640 1 -- 172.21.15.80:0/1575124169 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8484+0+0 (secure 0 0 0) 0x7f7a400f0b20 con 0x7f7a50102220 2024-04-26T18:46:31.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.225+0000 7f7a5548d640 1 --2- 172.21.15.80:0/1575124169 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f7a3c0a3dc0 0x7f7a3c0a6280 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0058c0 tx=0x7f7a4c005be0 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:46:31.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.229+0000 7f7a467fc640 1 -- 172.21.15.80:0/1575124169 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7a400bd1e0 con 0x7f7a50102220 2024-04-26T18:46:31.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:31 smithi192 ceph-mon[32842]: pgmap v313: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:46:31.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.427+0000 7f7a576f1640 1 -- 172.21.15.80:0/1575124169 --> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f7a50109de0 con 0x7f7a3c0a3dc0 2024-04-26T18:46:31.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.434+0000 7f7a467fc640 1 -- 172.21.15.80:0/1575124169 <== mgr.24736 v2:172.21.15.80:6800/1522002759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f7a50109de0 con 0x7f7a3c0a3dc0 2024-04-26T18:46:31.434 INFO:teuthology.orchestra.run.smithi080.stdout:/ 1m 6m3h 2024-04-26T18:46:31.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.436+0000 7f7a576f1640 1 -- 172.21.15.80:0/1575124169 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f7a3c0a3dc0 msgr2=0x7f7a3c0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:31.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.436+0000 7f7a576f1640 1 --2- 172.21.15.80:0/1575124169 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f7a3c0a3dc0 0x7f7a3c0a6280 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0058c0 tx=0x7f7a4c005be0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.436+0000 7f7a576f1640 1 -- 172.21.15.80:0/1575124169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a50102220 msgr2=0x7f7a50198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:31.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.436+0000 7f7a576f1640 1 --2- 172.21.15.80:0/1575124169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a50102220 0x7f7a50198520 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7a40004770 tx=0x7f7a400042f0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.436+0000 7f7a576f1640 1 -- 172.21.15.80:0/1575124169 shutdown_connections 2024-04-26T18:46:31.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.436+0000 7f7a576f1640 1 --2- 172.21.15.80:0/1575124169 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f7a3c0a3dc0 0x7f7a3c0a6280 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.436+0000 7f7a576f1640 1 --2- 172.21.15.80:0/1575124169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a50102220 0x7f7a50198520 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.436+0000 7f7a576f1640 1 --2- 172.21.15.80:0/1575124169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a50107820 0x7f7a5019c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.436+0000 7f7a576f1640 1 --2- 172.21.15.80:0/1575124169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a50101860 0x7f7a50197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.436+0000 7f7a576f1640 1 -- 172.21.15.80:0/1575124169 >> 172.21.15.80:0/1575124169 conn(0x7f7a500789b0 msgr2=0x7f7a50104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:46:31.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.436+0000 7f7a576f1640 1 -- 172.21.15.80:0/1575124169 shutdown_connections 2024-04-26T18:46:31.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.436+0000 7f7a576f1640 1 -- 172.21.15.80:0/1575124169 wait complete. 2024-04-26T18:46:31.446 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:31 smithi080 ceph-mon[29135]: pgmap v313: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:46:31.447 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-04-26T18:46:31.458 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T18:46:31.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:31 smithi082 ceph-mon[32808]: pgmap v313: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:46:31.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.557+0000 7f8536693640 1 -- 172.21.15.80:0/3160223489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8530103bc0 msgr2=0x7f8530103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:31.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.557+0000 7f8536693640 1 --2- 172.21.15.80:0/3160223489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8530103bc0 0x7f8530103fa0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8520009900 tx=0x7f852002a510 comp rx=0 tx=0).stop 2024-04-26T18:46:31.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.557+0000 7f8536693640 1 -- 172.21.15.80:0/3160223489 shutdown_connections 2024-04-26T18:46:31.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.557+0000 7f8536693640 1 --2- 172.21.15.80:0/3160223489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f853010cf00 0x7f853010f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.557+0000 7f8536693640 1 --2- 172.21.15.80:0/3160223489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85301044e0 0x7f853010c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.557+0000 7f8536693640 1 --2- 172.21.15.80:0/3160223489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8530103bc0 0x7f8530103fa0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.557+0000 7f8536693640 1 -- 172.21.15.80:0/3160223489 >> 172.21.15.80:0/3160223489 conn(0x7f8530078930 msgr2=0x7f8530078d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:46:31.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.557+0000 7f8536693640 1 -- 172.21.15.80:0/3160223489 shutdown_connections 2024-04-26T18:46:31.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.557+0000 7f8536693640 1 -- 172.21.15.80:0/3160223489 wait complete. 2024-04-26T18:46:31.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.557+0000 7f8536693640 1 Processor -- start 2024-04-26T18:46:31.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.557+0000 7f8536693640 1 -- start start 2024-04-26T18:46:31.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.558+0000 7f8536693640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8530103bc0 0x7f85301991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:31.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.558+0000 7f8536693640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85301044e0 0x7f85301996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:31.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.558+0000 7f8536693640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f853010cf00 0x7f853019da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:31.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.558+0000 7f8536693640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8530112bf0 con 0x7f8530103bc0 2024-04-26T18:46:31.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.558+0000 7f8536693640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8530112a70 con 0x7f853010cf00 2024-04-26T18:46:31.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.558+0000 7f8536693640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8530112d70 con 0x7f85301044e0 2024-04-26T18:46:31.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.558+0000 7f852ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8530103bc0 0x7f85301991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:31.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.558+0000 7f852ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8530103bc0 0x7f85301991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53756/0 (socket says 172.21.15.80:53756) 2024-04-26T18:46:31.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.558+0000 7f852ffff640 1 -- 172.21.15.80:0/649610590 learned_addr learned my addr 172.21.15.80:0/649610590 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:46:31.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.558+0000 7f852f7fe640 1 --2- 172.21.15.80:0/649610590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85301044e0 0x7f85301996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:31.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.558+0000 7f8534c30640 1 --2- 172.21.15.80:0/649610590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f853010cf00 0x7f853019da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:31.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.558+0000 7f852ffff640 1 -- 172.21.15.80:0/649610590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85301044e0 msgr2=0x7f85301996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:31.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.558+0000 7f852ffff640 1 --2- 172.21.15.80:0/649610590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85301044e0 0x7f85301996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.558+0000 7f852ffff640 1 -- 172.21.15.80:0/649610590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f853010cf00 msgr2=0x7f853019da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:31.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.558+0000 7f852ffff640 1 --2- 172.21.15.80:0/649610590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f853010cf00 0x7f853019da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.558+0000 7f852ffff640 1 -- 172.21.15.80:0/649610590 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f853019e1a0 con 0x7f8530103bc0 2024-04-26T18:46:31.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.558+0000 7f8534c30640 1 --2- 172.21.15.80:0/649610590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f853010cf00 0x7f853019da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:46:31.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.558+0000 7f852ffff640 1 --2- 172.21.15.80:0/649610590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8530103bc0 0x7f85301991b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8520005940 tx=0x7f85200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:46:31.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.559+0000 7f852d7fa640 1 -- 172.21.15.80:0/649610590 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852003f030 con 0x7f8530103bc0 2024-04-26T18:46:31.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.559+0000 7f852d7fa640 1 -- 172.21.15.80:0/649610590 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8520003cb0 con 0x7f8530103bc0 2024-04-26T18:46:31.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.559+0000 7f852d7fa640 1 -- 172.21.15.80:0/649610590 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8520035070 con 0x7f8530103bc0 2024-04-26T18:46:31.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.559+0000 7f8536693640 1 -- 172.21.15.80:0/649610590 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f853019e430 con 0x7f8530103bc0 2024-04-26T18:46:31.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.559+0000 7f8536693640 1 -- 172.21.15.80:0/649610590 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85301a5d20 con 0x7f8530103bc0 2024-04-26T18:46:31.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.560+0000 7f8536693640 1 -- 172.21.15.80:0/649610590 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8530069750 con 0x7f8530103bc0 2024-04-26T18:46:31.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.561+0000 7f852d7fa640 1 -- 172.21.15.80:0/649610590 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f8520042030 con 0x7f8530103bc0 2024-04-26T18:46:31.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.561+0000 7f852d7fa640 1 --2- 172.21.15.80:0/649610590 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f85180a3d20 0x7f85180a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:31.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.561+0000 7f852f7fe640 1 --2- 172.21.15.80:0/649610590 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f85180a3d20 0x7f85180a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:31.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.562+0000 7f852d7fa640 1 -- 172.21.15.80:0/649610590 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8484+0+0 (secure 0 0 0) 0x7f85200f1350 con 0x7f8530103bc0 2024-04-26T18:46:31.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.562+0000 7f852f7fe640 1 --2- 172.21.15.80:0/649610590 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f85180a3d20 0x7f85180a61e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8524005fd0 tx=0x7f8524005850 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:46:31.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.565+0000 7f852d7fa640 1 -- 172.21.15.80:0/649610590 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f85200bda10 con 0x7f8530103bc0 2024-04-26T18:46:31.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.744+0000 7f8536693640 1 -- 172.21.15.80:0/649610590 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8530108080 con 0x7f8530103bc0 2024-04-26T18:46:31.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.745+0000 7f852d7fa640 1 -- 172.21.15.80:0/649610590 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+23000 (secure 0 0 0) 0x7f85200bd310 con 0x7f8530103bc0 2024-04-26T18:46:31.746 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:46:31.746 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":101,"fsid":"2187ca98-03fa-11ef-bc93-c7b262605968","created":"2024-04-26T18:24:58.809431+0000","modified":"2024-04-26T18:46:14.072198+0000","last_up_change":"2024-04-26T18:32:02.550187+0000","last_in_change":"2024-04-26T18:31:41.630932+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T18:28:14.502290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T18:33:02.102135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T18:33:05.300979+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":100,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a01cfe6-d13a-4828-8c20-ad7fee7e87ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6803","nonce":429487384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6805","nonce":429487384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6809","nonce":429487384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6807","nonce":429487384}]},"public_addr":"172.21.15.80:6803/429487384","cluster_addr":"172.21.15.80:6805/429487384","heartbeat_back_addr":"172.21.15.80:6809/429487384","heartbeat_front_addr":"172.21.15.80:6807/429487384","state":["exists","up"]},{"osd":1,"uuid":"1f815d88-30b1-4540-b4f5-cc3d62707318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913033849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913033849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913033849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913033849}]},"public_addr":"172.21.15.82:6801/3913033849","cluster_addr":"172.21.15.82:6803/3913033849","heartbeat_back_addr":"172.21.15.82:6807/3913033849","heartbeat_front_addr":"172.21.15.82:6805/3913033849","state":["exists","up"]},{"osd":2,"uuid":"b8625dd7-4c1d-4258-ac2b-463ff96f4cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6801","nonce":503427508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6803","nonce":503427508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6807","nonce":503427508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6805","nonce":503427508}]},"public_addr":"172.21.15.192:6801/503427508","cluster_addr":"172.21.15.192:6803/503427508","heartbeat_back_addr":"172.21.15.192:6807/503427508","heartbeat_front_addr":"172.21.15.192:6805/503427508","state":["exists","up"]},{"osd":3,"uuid":"3068321a-3070-44ae-9bbd-a3faac8c21fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6811","nonce":407817066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6813","nonce":407817066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6817","nonce":407817066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6815","nonce":407817066}]},"public_addr":"172.21.15.80:6811/407817066","cluster_addr":"172.21.15.80:6813/407817066","heartbeat_back_addr":"172.21.15.80:6817/407817066","heartbeat_front_addr":"172.21.15.80:6815/407817066","state":["exists","up"]},{"osd":4,"uuid":"6b3d6455-9495-435b-8193-a260b63504ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6809","nonce":2068291934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6811","nonce":2068291934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6815","nonce":2068291934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6813","nonce":2068291934}]},"public_addr":"172.21.15.82:6809/2068291934","cluster_addr":"172.21.15.82:6811/2068291934","heartbeat_back_addr":"172.21.15.82:6815/2068291934","heartbeat_front_addr":"172.21.15.82:6813/2068291934","state":["exists","up"]},{"osd":5,"uuid":"538863f1-1486-45b5-a675-ecb1d3035599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6809","nonce":1770809727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6811","nonce":1770809727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6815","nonce":1770809727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6813","nonce":1770809727}]},"public_addr":"172.21.15.192:6809/1770809727","cluster_addr":"172.21.15.192:6811/1770809727","heartbeat_back_addr":"172.21.15.192:6815/1770809727","heartbeat_front_addr":"172.21.15.192:6813/1770809727","state":["exists","up"]},{"osd":6,"uuid":"7b4374d8-98e6-48e1-924b-c9b70a4baf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6819","nonce":145064490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6821","nonce":145064490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6825","nonce":145064490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6823","nonce":145064490}]},"public_addr":"172.21.15.80:6819/145064490","cluster_addr":"172.21.15.80:6821/145064490","heartbeat_back_addr":"172.21.15.80:6825/145064490","heartbeat_front_addr":"172.21.15.80:6823/145064490","state":["exists","up"]},{"osd":7,"uuid":"f3bb3c7d-4cce-4f49-b924-72ebbaad58ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6817","nonce":208047447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6819","nonce":208047447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6823","nonce":208047447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6821","nonce":208047447}]},"public_addr":"172.21.15.82:6817/208047447","cluster_addr":"172.21.15.82:6819/208047447","heartbeat_back_addr":"172.21.15.82:6823/208047447","heartbeat_front_addr":"172.21.15.82:6821/208047447","state":["exists","up"]},{"osd":8,"uuid":"6557b536-a516-4b01-a607-7981620fb2a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6817","nonce":3763069187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6819","nonce":3763069187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6823","nonce":3763069187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6821","nonce":3763069187}]},"public_addr":"172.21.15.192:6817/3763069187","cluster_addr":"172.21.15.192:6819/3763069187","heartbeat_back_addr":"172.21.15.192:6823/3763069187","heartbeat_front_addr":"172.21.15.192:6821/3763069187","state":["exists","up"]},{"osd":9,"uuid":"838615a7-1e68-4e81-8b3a-fba0ea75f7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6827","nonce":2109877993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6829","nonce":2109877993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6833","nonce":2109877993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6831","nonce":2109877993}]},"public_addr":"172.21.15.80:6827/2109877993","cluster_addr":"172.21.15.80:6829/2109877993","heartbeat_back_addr":"172.21.15.80:6833/2109877993","heartbeat_front_addr":"172.21.15.80:6831/2109877993","state":["exists","up"]},{"osd":10,"uuid":"cd664e50-3217-453d-9a89-6e26d717e6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6825","nonce":2877220993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6827","nonce":2877220993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6831","nonce":2877220993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6829","nonce":2877220993}]},"public_addr":"172.21.15.82:6825/2877220993","cluster_addr":"172.21.15.82:6827/2877220993","heartbeat_back_addr":"172.21.15.82:6831/2877220993","heartbeat_front_addr":"172.21.15.82:6829/2877220993","state":["exists","up"]},{"osd":11,"uuid":"e52807c6-8890-4df7-a8c6-51a7ff4b467b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6825","nonce":3466865106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6827","nonce":3466865106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6831","nonce":3466865106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6829","nonce":3466865106}]},"public_addr":"172.21.15.192:6825/3466865106","cluster_addr":"172.21.15.192:6827/3466865106","heartbeat_back_addr":"172.21.15.192:6831/3466865106","heartbeat_front_addr":"172.21.15.192:6829/3466865106","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:27:23.385471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:27:46.648232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:10.578970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:34.922048+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:59.142838+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:29:24.492250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:29:49.721803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:30:15.177027+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:30:41.544775+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:31:07.562401+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:31:33.498042+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:32:00.584085+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6800/179326828":"2024-04-27T18:36:27.723494+0000","172.21.15.80:0/601829731":"2024-04-27T18:36:27.723494+0000","172.21.15.80:0/2539501834":"2024-04-27T18:36:27.723494+0000","172.21.15.80:0/444150730":"2024-04-27T18:36:27.723494+0000","172.21.15.80:6801/1997155783":"2024-04-27T18:25:50.413207+0000","172.21.15.80:0/323607684":"2024-04-27T18:25:50.413207+0000","172.21.15.80:0/586397709":"2024-04-27T18:25:50.413207+0000","172.21.15.80:6801/4208962819":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/1353083127":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2453252862":"2024-04-27T18:36:27.723494+0000","172.21.15.80:6801/179326828":"2024-04-27T18:36:27.723494+0000","172.21.15.80:6800/1997155783":"2024-04-27T18:25:50.413207+0000","172.21.15.80:6800/4208962819":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2644175019":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/1853513470":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2122929159":"2024-04-27T18:25:50.413207+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T18:46:31.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.747+0000 7f8536693640 1 -- 172.21.15.80:0/649610590 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f85180a3d20 msgr2=0x7f85180a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:31.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.747+0000 7f8536693640 1 --2- 172.21.15.80:0/649610590 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f85180a3d20 0x7f85180a61e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8524005fd0 tx=0x7f8524005850 comp rx=0 tx=0).stop 2024-04-26T18:46:31.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.747+0000 7f8536693640 1 -- 172.21.15.80:0/649610590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8530103bc0 msgr2=0x7f85301991b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:31.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.747+0000 7f8536693640 1 --2- 172.21.15.80:0/649610590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8530103bc0 0x7f85301991b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8520005940 tx=0x7f85200042f0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.747+0000 7f8536693640 1 -- 172.21.15.80:0/649610590 shutdown_connections 2024-04-26T18:46:31.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.747+0000 7f8536693640 1 --2- 172.21.15.80:0/649610590 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f85180a3d20 0x7f85180a61e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.747+0000 7f8536693640 1 --2- 172.21.15.80:0/649610590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f853010cf00 0x7f853019da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.747+0000 7f8536693640 1 --2- 172.21.15.80:0/649610590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85301044e0 0x7f85301996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.747+0000 7f8536693640 1 --2- 172.21.15.80:0/649610590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8530103bc0 0x7f85301991b0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.748+0000 7f8536693640 1 -- 172.21.15.80:0/649610590 >> 172.21.15.80:0/649610590 conn(0x7f8530078930 msgr2=0x7f85300fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:46:31.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.748+0000 7f8536693640 1 -- 172.21.15.80:0/649610590 shutdown_connections 2024-04-26T18:46:31.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.748+0000 7f8536693640 1 -- 172.21.15.80:0/649610590 wait complete. 2024-04-26T18:46:31.759 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T18:28:14.502290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T18:33:02.102135+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T18:33:05.300979+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 100, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T18:46:31.759 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T18:46:31.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.859+0000 7f90612d1640 1 -- 172.21.15.80:0/3139793286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f905c107820 msgr2=0x7f905c107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:31.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.859+0000 7f90612d1640 1 --2- 172.21.15.80:0/3139793286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f905c107820 0x7f905c107c00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f904c009930 tx=0x7f904c02a420 comp rx=0 tx=0).stop 2024-04-26T18:46:31.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.860+0000 7f90612d1640 1 -- 172.21.15.80:0/3139793286 shutdown_connections 2024-04-26T18:46:31.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.860+0000 7f90612d1640 1 --2- 172.21.15.80:0/3139793286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f905c1021d0 0x7f905c10e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.860+0000 7f90612d1640 1 --2- 172.21.15.80:0/3139793286 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f905c101810 0x7f905c101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.860+0000 7f90612d1640 1 --2- 172.21.15.80:0/3139793286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f905c107820 0x7f905c107c00 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.860+0000 7f90612d1640 1 -- 172.21.15.80:0/3139793286 >> 172.21.15.80:0/3139793286 conn(0x7f905c078890 msgr2=0x7f905c078ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:46:31.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.860+0000 7f90612d1640 1 -- 172.21.15.80:0/3139793286 shutdown_connections 2024-04-26T18:46:31.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.860+0000 7f90612d1640 1 -- 172.21.15.80:0/3139793286 wait complete. 2024-04-26T18:46:31.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.860+0000 7f90612d1640 1 Processor -- start 2024-04-26T18:46:31.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.860+0000 7f90612d1640 1 -- start start 2024-04-26T18:46:31.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.861+0000 7f90612d1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f905c101810 0x7f905c198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:31.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.861+0000 7f90612d1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f905c1021d0 0x7f905c1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:31.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.861+0000 7f90612d1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f905c107820 0x7f905c19c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:31.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.861+0000 7f90612d1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f905c111ae0 con 0x7f905c1021d0 2024-04-26T18:46:31.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.861+0000 7f90612d1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f905c111960 con 0x7f905c101810 2024-04-26T18:46:31.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.861+0000 7f90612d1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f905c111c60 con 0x7f905c107820 2024-04-26T18:46:31.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.861+0000 7f905a7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f905c1021d0 0x7f905c1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:31.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.861+0000 7f905a7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f905c1021d0 0x7f905c1985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53780/0 (socket says 172.21.15.80:53780) 2024-04-26T18:46:31.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.861+0000 7f905a7fc640 1 -- 172.21.15.80:0/1012347041 learned_addr learned my addr 172.21.15.80:0/1012347041 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:46:31.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.861+0000 7f905affd640 1 --2- 172.21.15.80:0/1012347041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f905c101810 0x7f905c198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:31.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.861+0000 7f905b7fe640 1 --2- 172.21.15.80:0/1012347041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f905c107820 0x7f905c19c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:31.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.861+0000 7f905a7fc640 1 -- 172.21.15.80:0/1012347041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f905c107820 msgr2=0x7f905c19c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:31.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.861+0000 7f905a7fc640 1 --2- 172.21.15.80:0/1012347041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f905c107820 0x7f905c19c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.861+0000 7f905a7fc640 1 -- 172.21.15.80:0/1012347041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f905c101810 msgr2=0x7f905c198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:31.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.861+0000 7f905a7fc640 1 --2- 172.21.15.80:0/1012347041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f905c101810 0x7f905c198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:31.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.861+0000 7f905a7fc640 1 -- 172.21.15.80:0/1012347041 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f905c19d050 con 0x7f905c1021d0 2024-04-26T18:46:31.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.861+0000 7f905b7fe640 1 --2- 172.21.15.80:0/1012347041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f905c107820 0x7f905c19c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:46:31.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.861+0000 7f905a7fc640 1 --2- 172.21.15.80:0/1012347041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f905c1021d0 0x7f905c1985a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f905000d990 tx=0x7f905000de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:46:31.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.861+0000 7f9043fff640 1 -- 172.21.15.80:0/1012347041 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f905001b070 con 0x7f905c1021d0 2024-04-26T18:46:31.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.861+0000 7f9043fff640 1 -- 172.21.15.80:0/1012347041 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f905000edf0 con 0x7f905c1021d0 2024-04-26T18:46:31.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.861+0000 7f90612d1640 1 -- 172.21.15.80:0/1012347041 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f905c19d340 con 0x7f905c1021d0 2024-04-26T18:46:31.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.861+0000 7f9043fff640 1 -- 172.21.15.80:0/1012347041 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9050014800 con 0x7f905c1021d0 2024-04-26T18:46:31.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.861+0000 7f90612d1640 1 -- 172.21.15.80:0/1012347041 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f905c06af30 con 0x7f905c1021d0 2024-04-26T18:46:31.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.862+0000 7f90612d1640 1 -- 172.21.15.80:0/1012347041 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f905c069ba0 con 0x7f905c1021d0 2024-04-26T18:46:31.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.863+0000 7f9043fff640 1 -- 172.21.15.80:0/1012347041 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f905001e070 con 0x7f905c1021d0 2024-04-26T18:46:31.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.864+0000 7f9043fff640 1 --2- 172.21.15.80:0/1012347041 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f90440a3d20 0x7f90440a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:31.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.864+0000 7f905affd640 1 --2- 172.21.15.80:0/1012347041 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f90440a3d20 0x7f90440a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:31.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.864+0000 7f9043fff640 1 -- 172.21.15.80:0/1012347041 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8484+0+0 (secure 0 0 0) 0x7f90500d1f10 con 0x7f905c1021d0 2024-04-26T18:46:31.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.865+0000 7f905affd640 1 --2- 172.21.15.80:0/1012347041 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f90440a3d20 0x7f90440a61e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f904c009900 tx=0x7f904c000bc0 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:46:31.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:31.869+0000 7f9043fff640 1 -- 172.21.15.80:0/1012347041 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9050052ff0 con 0x7f905c1021d0 2024-04-26T18:46:32.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.047+0000 7f90612d1640 1 -- 172.21.15.80:0/1012347041 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f905c06ba90 con 0x7f905c1021d0 2024-04-26T18:46:32.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.047+0000 7f9043fff640 1 -- 172.21.15.80:0/1012347041 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v101) ==== 93+0+10 (secure 0 0 0) 0x7f905009e6e0 con 0x7f905c1021d0 2024-04-26T18:46:32.047 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-26T18:46:32.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.049+0000 7f90612d1640 1 -- 172.21.15.80:0/1012347041 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f90440a3d20 msgr2=0x7f90440a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:32.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.049+0000 7f90612d1640 1 --2- 172.21.15.80:0/1012347041 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f90440a3d20 0x7f90440a61e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f904c009900 tx=0x7f904c000bc0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.049+0000 7f90612d1640 1 -- 172.21.15.80:0/1012347041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f905c1021d0 msgr2=0x7f905c1985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:32.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.049+0000 7f90612d1640 1 --2- 172.21.15.80:0/1012347041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f905c1021d0 0x7f905c1985a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f905000d990 tx=0x7f905000de50 comp rx=0 tx=0).stop 2024-04-26T18:46:32.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.049+0000 7f90612d1640 1 -- 172.21.15.80:0/1012347041 shutdown_connections 2024-04-26T18:46:32.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.049+0000 7f90612d1640 1 --2- 172.21.15.80:0/1012347041 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f90440a3d20 0x7f90440a61e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.049+0000 7f90612d1640 1 --2- 172.21.15.80:0/1012347041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f905c1021d0 0x7f905c1985a0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.049+0000 7f90612d1640 1 --2- 172.21.15.80:0/1012347041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f905c107820 0x7f905c19c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.049+0000 7f90612d1640 1 --2- 172.21.15.80:0/1012347041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f905c101810 0x7f905c198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.049+0000 7f90612d1640 1 -- 172.21.15.80:0/1012347041 >> 172.21.15.80:0/1012347041 conn(0x7f905c078890 msgr2=0x7f905c104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:46:32.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.049+0000 7f90612d1640 1 -- 172.21.15.80:0/1012347041 shutdown_connections 2024-04-26T18:46:32.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.049+0000 7f90612d1640 1 -- 172.21.15.80:0/1012347041 wait complete. 2024-04-26T18:46:32.061 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T18:46:32.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.164+0000 7fec124c4640 1 -- 172.21.15.80:0/2673446279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec0c103bb0 msgr2=0x7fec0c103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:32.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.164+0000 7fec124c4640 1 --2- 172.21.15.80:0/2673446279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec0c103bb0 0x7fec0c103f90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7febfc009900 tx=0x7febfc02a510 comp rx=0 tx=0).stop 2024-04-26T18:46:32.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.164+0000 7fec124c4640 1 -- 172.21.15.80:0/2673446279 shutdown_connections 2024-04-26T18:46:32.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.164+0000 7fec124c4640 1 --2- 172.21.15.80:0/2673446279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec0c10cef0 0x7fec0c10f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.164+0000 7fec124c4640 1 --2- 172.21.15.80:0/2673446279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec0c1044d0 0x7fec0c10c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.164+0000 7fec124c4640 1 --2- 172.21.15.80:0/2673446279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec0c103bb0 0x7fec0c103f90 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.164+0000 7fec124c4640 1 -- 172.21.15.80:0/2673446279 >> 172.21.15.80:0/2673446279 conn(0x7fec0c078930 msgr2=0x7fec0c078d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:46:32.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.164+0000 7fec124c4640 1 -- 172.21.15.80:0/2673446279 shutdown_connections 2024-04-26T18:46:32.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.165+0000 7fec124c4640 1 -- 172.21.15.80:0/2673446279 wait complete. 2024-04-26T18:46:32.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.165+0000 7fec124c4640 1 Processor -- start 2024-04-26T18:46:32.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.165+0000 7fec124c4640 1 -- start start 2024-04-26T18:46:32.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.165+0000 7fec124c4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec0c103bb0 0x7fec0c1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:32.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.165+0000 7fec124c4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec0c1044d0 0x7fec0c1997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:32.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.165+0000 7fec124c4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec0c10cef0 0x7fec0c19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:32.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.165+0000 7fec124c4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c112c60 con 0x7fec0c103bb0 2024-04-26T18:46:32.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.165+0000 7fec124c4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c112ae0 con 0x7fec0c1044d0 2024-04-26T18:46:32.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.165+0000 7fec124c4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c112de0 con 0x7fec0c10cef0 2024-04-26T18:46:32.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.166+0000 7fec0bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec0c103bb0 0x7fec0c1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:32.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.166+0000 7fec0bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec0c103bb0 0x7fec0c1992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53798/0 (socket says 172.21.15.80:53798) 2024-04-26T18:46:32.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.166+0000 7fec0bfff640 1 -- 172.21.15.80:0/1606514756 learned_addr learned my addr 172.21.15.80:0/1606514756 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:46:32.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.166+0000 7fec10a61640 1 --2- 172.21.15.80:0/1606514756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec0c10cef0 0x7fec0c19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:32.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.166+0000 7fec0b7fe640 1 --2- 172.21.15.80:0/1606514756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec0c1044d0 0x7fec0c1997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:32.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.166+0000 7fec0bfff640 1 -- 172.21.15.80:0/1606514756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec0c10cef0 msgr2=0x7fec0c19db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:32.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.166+0000 7fec0bfff640 1 --2- 172.21.15.80:0/1606514756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec0c10cef0 0x7fec0c19db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.166+0000 7fec0bfff640 1 -- 172.21.15.80:0/1606514756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec0c1044d0 msgr2=0x7fec0c1997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:32.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.166+0000 7fec0bfff640 1 --2- 172.21.15.80:0/1606514756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec0c1044d0 0x7fec0c1997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.166+0000 7fec0bfff640 1 -- 172.21.15.80:0/1606514756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0c19e290 con 0x7fec0c103bb0 2024-04-26T18:46:32.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.166+0000 7fec10a61640 1 --2- 172.21.15.80:0/1606514756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec0c10cef0 0x7fec0c19db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:46:32.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.166+0000 7fec0bfff640 1 --2- 172.21.15.80:0/1606514756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec0c103bb0 0x7fec0c1992a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7febfc006010 tx=0x7febfc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:46:32.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.166+0000 7fec097fa640 1 -- 172.21.15.80:0/1606514756 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc03f030 con 0x7fec0c103bb0 2024-04-26T18:46:32.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.166+0000 7fec124c4640 1 -- 172.21.15.80:0/1606514756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0c19e520 con 0x7fec0c103bb0 2024-04-26T18:46:32.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.166+0000 7fec097fa640 1 -- 172.21.15.80:0/1606514756 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febfc003800 con 0x7fec0c103bb0 2024-04-26T18:46:32.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.166+0000 7fec097fa640 1 -- 172.21.15.80:0/1606514756 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc035070 con 0x7fec0c103bb0 2024-04-26T18:46:32.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.166+0000 7fec124c4640 1 -- 172.21.15.80:0/1606514756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec0c1a5e10 con 0x7fec0c103bb0 2024-04-26T18:46:32.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.167+0000 7fec124c4640 1 -- 172.21.15.80:0/1606514756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec0c069750 con 0x7fec0c103bb0 2024-04-26T18:46:32.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.168+0000 7fec097fa640 1 -- 172.21.15.80:0/1606514756 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7febfc003cb0 con 0x7fec0c103bb0 2024-04-26T18:46:32.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.169+0000 7fec097fa640 1 --2- 172.21.15.80:0/1606514756 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7febf40a3d20 0x7febf40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:32.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.169+0000 7fec0b7fe640 1 --2- 172.21.15.80:0/1606514756 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7febf40a3d20 0x7febf40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:32.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.169+0000 7fec097fa640 1 -- 172.21.15.80:0/1606514756 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8484+0+0 (secure 0 0 0) 0x7febfc0f1480 con 0x7fec0c103bb0 2024-04-26T18:46:32.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.169+0000 7fec0b7fe640 1 --2- 172.21.15.80:0/1606514756 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7febf40a3d20 0x7febf40a61e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fec0c10ef20 tx=0x7fec00008040 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:46:32.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.172+0000 7fec097fa640 1 -- 172.21.15.80:0/1606514756 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7febfc0bdb40 con 0x7fec0c103bb0 2024-04-26T18:46:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.349+0000 7fec124c4640 1 -- 172.21.15.80:0/1606514756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fec0c108070 con 0x7fec0c103bb0 2024-04-26T18:46:32.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.349+0000 7fec097fa640 1 -- 172.21.15.80:0/1606514756 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v101) ==== 104+0+11 (secure 0 0 0) 0x7febfc0bd440 con 0x7fec0c103bb0 2024-04-26T18:46:32.349 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-26T18:46:32.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.351+0000 7fec124c4640 1 -- 172.21.15.80:0/1606514756 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7febf40a3d20 msgr2=0x7febf40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:32.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.351+0000 7fec124c4640 1 --2- 172.21.15.80:0/1606514756 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7febf40a3d20 0x7febf40a61e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fec0c10ef20 tx=0x7fec00008040 comp rx=0 tx=0).stop 2024-04-26T18:46:32.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.351+0000 7fec124c4640 1 -- 172.21.15.80:0/1606514756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec0c103bb0 msgr2=0x7fec0c1992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:32.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.351+0000 7fec124c4640 1 --2- 172.21.15.80:0/1606514756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec0c103bb0 0x7fec0c1992a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7febfc006010 tx=0x7febfc0042f0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.351+0000 7fec124c4640 1 -- 172.21.15.80:0/1606514756 shutdown_connections 2024-04-26T18:46:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.351+0000 7fec124c4640 1 --2- 172.21.15.80:0/1606514756 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7febf40a3d20 0x7febf40a61e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.351+0000 7fec124c4640 1 --2- 172.21.15.80:0/1606514756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec0c10cef0 0x7fec0c19db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.351+0000 7fec124c4640 1 --2- 172.21.15.80:0/1606514756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec0c1044d0 0x7fec0c1997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.351+0000 7fec124c4640 1 --2- 172.21.15.80:0/1606514756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec0c103bb0 0x7fec0c1992a0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.351+0000 7fec124c4640 1 -- 172.21.15.80:0/1606514756 >> 172.21.15.80:0/1606514756 conn(0x7fec0c078930 msgr2=0x7fec0c0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:46:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.351+0000 7fec124c4640 1 -- 172.21.15.80:0/1606514756 shutdown_connections 2024-04-26T18:46:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.351+0000 7fec124c4640 1 -- 172.21.15.80:0/1606514756 wait complete. 2024-04-26T18:46:32.361 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:32 smithi080 ceph-mon[29135]: from='client.15795 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:46:32.361 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:32 smithi080 ceph-mon[29135]: from='client.15801 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:46:32.361 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:32 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/649610590' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:46:32.361 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:32 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1012347041' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T18:46:32.362 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T18:46:32.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:32 smithi192 ceph-mon[32842]: from='client.15795 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:46:32.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:32 smithi192 ceph-mon[32842]: from='client.15801 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:46:32.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:32 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/649610590' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:46:32.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:32 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1012347041' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T18:46:32.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.463+0000 7f30f0299640 1 -- 172.21.15.80:0/4275446005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30e8108a10 msgr2=0x7f30e8108df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:32.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.463+0000 7f30f0299640 1 --2- 172.21.15.80:0/4275446005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30e8108a10 0x7f30e8108df0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009900 tx=0x7f30e402a480 comp rx=0 tx=0).stop 2024-04-26T18:46:32.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.463+0000 7f30f0299640 1 -- 172.21.15.80:0/4275446005 shutdown_connections 2024-04-26T18:46:32.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.463+0000 7f30f0299640 1 --2- 172.21.15.80:0/4275446005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30e806b8f0 0x7f30e810f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.463+0000 7f30f0299640 1 --2- 172.21.15.80:0/4275446005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e806af50 0x7f30e806b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.463+0000 7f30f0299640 1 --2- 172.21.15.80:0/4275446005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30e8108a10 0x7f30e8108df0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.463+0000 7f30f0299640 1 -- 172.21.15.80:0/4275446005 >> 172.21.15.80:0/4275446005 conn(0x7f30e8078810 msgr2=0x7f30e8078c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:46:32.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.463+0000 7f30f0299640 1 -- 172.21.15.80:0/4275446005 shutdown_connections 2024-04-26T18:46:32.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.463+0000 7f30f0299640 1 -- 172.21.15.80:0/4275446005 wait complete. 2024-04-26T18:46:32.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.464+0000 7f30f0299640 1 Processor -- start 2024-04-26T18:46:32.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.464+0000 7f30f0299640 1 -- start start 2024-04-26T18:46:32.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.464+0000 7f30f0299640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30e806af50 0x7f30e8199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:32.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.464+0000 7f30f0299640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30e806b8f0 0x7f30e8199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:32.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.464+0000 7f30f0299640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e8108a10 0x7f30e819d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:32.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.464+0000 7f30f0299640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f30e8112c40 con 0x7f30e806b8f0 2024-04-26T18:46:32.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.464+0000 7f30f0299640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f30e8112ac0 con 0x7f30e8108a10 2024-04-26T18:46:32.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.464+0000 7f30f0299640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f30e8112dc0 con 0x7f30e806af50 2024-04-26T18:46:32.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.464+0000 7f30ed834640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30e806b8f0 0x7f30e8199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:32.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.464+0000 7f30ed834640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30e806b8f0 0x7f30e8199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53826/0 (socket says 172.21.15.80:53826) 2024-04-26T18:46:32.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.464+0000 7f30ed834640 1 -- 172.21.15.80:0/1769170256 learned_addr learned my addr 172.21.15.80:0/1769170256 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:46:32.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.464+0000 7f30ee035640 1 --2- 172.21.15.80:0/1769170256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30e806af50 0x7f30e8199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:32.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.464+0000 7f30ed834640 1 -- 172.21.15.80:0/1769170256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30e806af50 msgr2=0x7f30e8199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:32.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.464+0000 7f30ed834640 1 --2- 172.21.15.80:0/1769170256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30e806af50 0x7f30e8199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.464+0000 7f30ed834640 1 -- 172.21.15.80:0/1769170256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e8108a10 msgr2=0x7f30e819d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:32.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.464+0000 7f30ed834640 1 --2- 172.21.15.80:0/1769170256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e8108a10 0x7f30e819d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.464+0000 7f30ed834640 1 -- 172.21.15.80:0/1769170256 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e819e110 con 0x7f30e806b8f0 2024-04-26T18:46:32.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.464+0000 7f30ed834640 1 --2- 172.21.15.80:0/1769170256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30e806b8f0 0x7f30e8199660 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f30dc00e9f0 tx=0x7f30dc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:46:32.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.464+0000 7f30db7fe640 1 -- 172.21.15.80:0/1769170256 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc00cd80 con 0x7f30e806b8f0 2024-04-26T18:46:32.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.465+0000 7f30db7fe640 1 -- 172.21.15.80:0/1769170256 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30dc0108e0 con 0x7f30e806b8f0 2024-04-26T18:46:32.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.465+0000 7f30f0299640 1 -- 172.21.15.80:0/1769170256 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30e819e400 con 0x7f30e806b8f0 2024-04-26T18:46:32.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.465+0000 7f30db7fe640 1 -- 172.21.15.80:0/1769170256 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc018980 con 0x7f30e806b8f0 2024-04-26T18:46:32.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.465+0000 7f30f0299640 1 -- 172.21.15.80:0/1769170256 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30e81a5c90 con 0x7f30e806b8f0 2024-04-26T18:46:32.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.466+0000 7f30f0299640 1 -- 172.21.15.80:0/1769170256 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30e8069ba0 con 0x7f30e806b8f0 2024-04-26T18:46:32.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.467+0000 7f30db7fe640 1 -- 172.21.15.80:0/1769170256 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f30dc010430 con 0x7f30e806b8f0 2024-04-26T18:46:32.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.467+0000 7f30db7fe640 1 --2- 172.21.15.80:0/1769170256 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f30d40a3d20 0x7f30d40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:32.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.467+0000 7f30db7fe640 1 -- 172.21.15.80:0/1769170256 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8484+0+0 (secure 0 0 0) 0x7f30dc0d0b50 con 0x7f30e806b8f0 2024-04-26T18:46:32.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.467+0000 7f30ee035640 1 --2- 172.21.15.80:0/1769170256 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f30d40a3d20 0x7f30d40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:32.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.467+0000 7f30ee035640 1 --2- 172.21.15.80:0/1769170256 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f30d40a3d20 0x7f30d40a61e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009230 tx=0x7f30e40058d0 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:46:32.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:32 smithi082 ceph-mon[32808]: from='client.15795 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:46:32.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:32 smithi082 ceph-mon[32808]: from='client.15801 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T18:46:32.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:32 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/649610590' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:46:32.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:32 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1012347041' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T18:46:32.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.471+0000 7f30db7fe640 1 -- 172.21.15.80:0/1769170256 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f30dc09d210 con 0x7f30e806b8f0 2024-04-26T18:46:32.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.647+0000 7f30f0299640 1 -- 172.21.15.80:0/1769170256 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f30e802dad0 con 0x7f30e806b8f0 2024-04-26T18:46:32.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.648+0000 7f30db7fe640 1 -- 172.21.15.80:0/1769170256 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v101) ==== 100+0+11 (secure 0 0 0) 0x7f30dc09cb10 con 0x7f30e806b8f0 2024-04-26T18:46:32.648 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-26T18:46:32.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.650+0000 7f30f0299640 1 -- 172.21.15.80:0/1769170256 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f30d40a3d20 msgr2=0x7f30d40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:32.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.650+0000 7f30f0299640 1 --2- 172.21.15.80:0/1769170256 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f30d40a3d20 0x7f30d40a61e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009230 tx=0x7f30e40058d0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.650+0000 7f30f0299640 1 -- 172.21.15.80:0/1769170256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30e806b8f0 msgr2=0x7f30e8199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:32.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.650+0000 7f30f0299640 1 --2- 172.21.15.80:0/1769170256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30e806b8f0 0x7f30e8199660 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f30dc00e9f0 tx=0x7f30dc00eeb0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.650+0000 7f30f0299640 1 -- 172.21.15.80:0/1769170256 shutdown_connections 2024-04-26T18:46:32.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.650+0000 7f30f0299640 1 --2- 172.21.15.80:0/1769170256 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f30d40a3d20 0x7f30d40a61e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.650+0000 7f30f0299640 1 --2- 172.21.15.80:0/1769170256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30e806b8f0 0x7f30e8199660 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.650+0000 7f30f0299640 1 --2- 172.21.15.80:0/1769170256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e8108a10 0x7f30e819d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.650+0000 7f30f0299640 1 --2- 172.21.15.80:0/1769170256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30e806af50 0x7f30e8199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.650+0000 7f30f0299640 1 -- 172.21.15.80:0/1769170256 >> 172.21.15.80:0/1769170256 conn(0x7f30e8078810 msgr2=0x7f30e81007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:46:32.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.650+0000 7f30f0299640 1 -- 172.21.15.80:0/1769170256 shutdown_connections 2024-04-26T18:46:32.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.650+0000 7f30f0299640 1 -- 172.21.15.80:0/1769170256 wait complete. 2024-04-26T18:46:32.661 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-04-26T18:46:32.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.758+0000 7f378da2c640 1 -- 172.21.15.80:0/2346499381 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f378810cf50 msgr2=0x7f378810f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:32.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.758+0000 7f378da2c640 1 --2- 172.21.15.80:0/2346499381 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f378810cf50 0x7f378810f3c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3780009ca0 tx=0x7f378002a950 comp rx=0 tx=0).stop 2024-04-26T18:46:32.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.758+0000 7f378da2c640 1 -- 172.21.15.80:0/2346499381 shutdown_connections 2024-04-26T18:46:32.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.758+0000 7f378da2c640 1 --2- 172.21.15.80:0/2346499381 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f378810cf50 0x7f378810f3c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.758+0000 7f378da2c640 1 --2- 172.21.15.80:0/2346499381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3788104530 0x7f378810ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.758+0000 7f378da2c640 1 --2- 172.21.15.80:0/2346499381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3788103c10 0x7f3788103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.758+0000 7f378da2c640 1 -- 172.21.15.80:0/2346499381 >> 172.21.15.80:0/2346499381 conn(0x7f3788078990 msgr2=0x7f3788078da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:46:32.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.758+0000 7f378da2c640 1 -- 172.21.15.80:0/2346499381 shutdown_connections 2024-04-26T18:46:32.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.758+0000 7f378da2c640 1 -- 172.21.15.80:0/2346499381 wait complete. 2024-04-26T18:46:32.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.758+0000 7f378da2c640 1 Processor -- start 2024-04-26T18:46:32.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.758+0000 7f378da2c640 1 -- start start 2024-04-26T18:46:32.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.759+0000 7f378da2c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3788103c10 0x7f3788199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:32.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.759+0000 7f378da2c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3788104530 0x7f3788199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:32.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.759+0000 7f378da2c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f378810cf50 0x7f378819d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:32.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.759+0000 7f378da2c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3788112c10 con 0x7f3788103c10 2024-04-26T18:46:32.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.759+0000 7f378da2c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3788112a90 con 0x7f3788104530 2024-04-26T18:46:32.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.759+0000 7f378da2c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3788112d90 con 0x7f378810cf50 2024-04-26T18:46:32.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.759+0000 7f3786ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3788103c10 0x7f3788199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:32.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.759+0000 7f3786ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3788103c10 0x7f3788199110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53852/0 (socket says 172.21.15.80:53852) 2024-04-26T18:46:32.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.759+0000 7f3786ffd640 1 -- 172.21.15.80:0/2646723174 learned_addr learned my addr 172.21.15.80:0/2646723174 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:46:32.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.759+0000 7f37867fc640 1 --2- 172.21.15.80:0/2646723174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3788104530 0x7f3788199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:32.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.759+0000 7f3786ffd640 1 -- 172.21.15.80:0/2646723174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f378810cf50 msgr2=0x7f378819d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:32.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.759+0000 7f3786ffd640 1 --2- 172.21.15.80:0/2646723174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f378810cf50 0x7f378819d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.759+0000 7f3786ffd640 1 -- 172.21.15.80:0/2646723174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3788104530 msgr2=0x7f3788199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:32.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.759+0000 7f3786ffd640 1 --2- 172.21.15.80:0/2646723174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3788104530 0x7f3788199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:32.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.759+0000 7f3786ffd640 1 -- 172.21.15.80:0/2646723174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f378819e100 con 0x7f3788103c10 2024-04-26T18:46:32.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.759+0000 7f37867fc640 1 --2- 172.21.15.80:0/2646723174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3788104530 0x7f3788199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:46:32.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.759+0000 7f3786ffd640 1 --2- 172.21.15.80:0/2646723174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3788103c10 0x7f3788199110 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f377c00d950 tx=0x7f377c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:46:32.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.759+0000 7f378ca2a640 1 -- 172.21.15.80:0/2646723174 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c017070 con 0x7f3788103c10 2024-04-26T18:46:32.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.759+0000 7f378da2c640 1 -- 172.21.15.80:0/2646723174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f378819e3f0 con 0x7f3788103c10 2024-04-26T18:46:32.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.759+0000 7f378ca2a640 1 -- 172.21.15.80:0/2646723174 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f377c009c30 con 0x7f3788103c10 2024-04-26T18:46:32.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.759+0000 7f378ca2a640 1 -- 172.21.15.80:0/2646723174 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c00f620 con 0x7f3788103c10 2024-04-26T18:46:32.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.759+0000 7f378da2c640 1 -- 172.21.15.80:0/2646723174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37881a5c80 con 0x7f3788103c10 2024-04-26T18:46:32.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.760+0000 7f378da2c640 1 -- 172.21.15.80:0/2646723174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3788068ec0 con 0x7f3788103c10 2024-04-26T18:46:32.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.761+0000 7f378ca2a640 1 -- 172.21.15.80:0/2646723174 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f377c005030 con 0x7f3788103c10 2024-04-26T18:46:32.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.762+0000 7f378ca2a640 1 --2- 172.21.15.80:0/2646723174 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f37700a3d20 0x7f37700a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:46:32.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.762+0000 7f37867fc640 1 --2- 172.21.15.80:0/2646723174 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f37700a3d20 0x7f37700a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:46:32.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.762+0000 7f378ca2a640 1 -- 172.21.15.80:0/2646723174 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8484+0+0 (secure 0 0 0) 0x7f377c0d0510 con 0x7f3788103c10 2024-04-26T18:46:32.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.763+0000 7f37867fc640 1 --2- 172.21.15.80:0/2646723174 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f37700a3d20 0x7f37700a61e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3788101280 tx=0x7f3778008040 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:46:32.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.766+0000 7f378ca2a640 1 -- 172.21.15.80:0/2646723174 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f377c09cb70 con 0x7f3788103c10 2024-04-26T18:46:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:32.993+0000 7f378da2c640 1 -- 172.21.15.80:0/2646723174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f37881080d0 con 0x7f3788103c10 2024-04-26T18:46:33.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:33.001+0000 7f378ca2a640 1 -- 172.21.15.80:0/2646723174 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+746061 (secure 0 0 0) 0x7f377c009de0 con 0x7f3788103c10 2024-04-26T18:46:33.011 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:46:33.011 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:46:33.011 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 26, 2024-04-26T18:46:33.011 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.011 INFO:teuthology.orchestra.run.smithi080.stdout: "active_gid": 24736, 2024-04-26T18:46:33.011 INFO:teuthology.orchestra.run.smithi080.stdout: "active_name": "x", 2024-04-26T18:46:33.011 INFO:teuthology.orchestra.run.smithi080.stdout: "active_addrs": { 2024-04-26T18:46:33.011 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-04-26T18:46:33.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.011 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-04-26T18:46:33.011 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6800", 2024-04-26T18:46:33.011 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1522002759 2024-04-26T18:46:33.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.012 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-04-26T18:46:33.012 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6801", 2024-04-26T18:46:33.012 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1522002759 2024-04-26T18:46:33.012 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.012 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-26T18:46:33.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.012 INFO:teuthology.orchestra.run.smithi080.stdout: "active_addr": "172.21.15.80:6801/1522002759", 2024-04-26T18:46:33.012 INFO:teuthology.orchestra.run.smithi080.stdout: "active_change": "2024-04-26T18:36:27.723692+0000", 2024-04-26T18:46:33.012 INFO:teuthology.orchestra.run.smithi080.stdout: "active_mgr_features": 4540701547738038271, 2024-04-26T18:46:33.012 INFO:teuthology.orchestra.run.smithi080.stdout: "available": true, 2024-04-26T18:46:33.012 INFO:teuthology.orchestra.run.smithi080.stdout: "standbys": [ 2024-04-26T18:46:33.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.012 INFO:teuthology.orchestra.run.smithi080.stdout: "gid": 24739, 2024-04-26T18:46:33.012 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "z", 2024-04-26T18:46:33.012 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_features": 4540701547738038271, 2024-04-26T18:46:33.013 INFO:teuthology.orchestra.run.smithi080.stdout: "available_modules": [ 2024-04-26T18:46:33.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.013 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "alerts", 2024-04-26T18:46:33.013 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.013 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.013 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.013 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-26T18:46:33.013 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-26T18:46:33.013 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.013 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.013 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.013 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-26T18:46:33.013 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.013 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.013 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.013 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "How frequently to reexamine health status", 2024-04-26T18:46:33.014 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.014 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.014 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.014 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.014 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.014 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.014 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.014 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.014 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.014 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.014 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.014 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.014 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.014 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.014 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.014 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.015 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.015 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.015 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.015 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.015 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.015 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.015 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.015 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.015 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.015 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.015 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.015 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.015 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.015 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.015 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.016 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.016 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.016 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.016 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.016 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.016 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.016 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.016 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.016 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.016 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.016 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.016 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.016 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.016 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.017 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.017 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.017 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.017 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.017 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.017 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.017 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.017 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.017 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.017 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.017 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.017 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.018 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.018 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.018 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.018 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.018 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.018 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.018 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.018 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.018 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.018 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.018 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.018 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.018 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_destination": { 2024-04-26T18:46:33.018 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_destination", 2024-04-26T18:46:33.018 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.019 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.019 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.019 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.019 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.019 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.019 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.019 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Email address to send alerts to", 2024-04-26T18:46:33.019 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.019 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.019 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.019 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_from_name": { 2024-04-26T18:46:33.019 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_from_name", 2024-04-26T18:46:33.019 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.019 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.019 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.019 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "Ceph", 2024-04-26T18:46:33.020 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.020 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.020 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.020 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Email From: name", 2024-04-26T18:46:33.020 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.020 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.020 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.020 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_host": { 2024-04-26T18:46:33.020 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_host", 2024-04-26T18:46:33.020 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.020 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.020 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.020 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.020 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.020 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.021 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.021 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "SMTP server", 2024-04-26T18:46:33.021 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.021 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.021 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.021 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_password": { 2024-04-26T18:46:33.021 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_password", 2024-04-26T18:46:33.021 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.021 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.021 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.021 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.021 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.021 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.021 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.021 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Password to authenticate with", 2024-04-26T18:46:33.021 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.022 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.022 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.022 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_port": { 2024-04-26T18:46:33.022 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_port", 2024-04-26T18:46:33.022 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.022 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.022 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.022 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "465", 2024-04-26T18:46:33.022 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.022 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.022 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.022 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "SMTP port", 2024-04-26T18:46:33.022 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.022 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.023 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.023 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_sender": { 2024-04-26T18:46:33.023 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_sender", 2024-04-26T18:46:33.023 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.023 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.023 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.023 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.023 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.023 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.023 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.023 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "SMTP envelope sender", 2024-04-26T18:46:33.023 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.023 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.023 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.024 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_ssl": { 2024-04-26T18:46:33.024 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_ssl", 2024-04-26T18:46:33.024 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.024 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.024 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.024 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.024 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.024 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.024 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.024 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-26T18:46:33.024 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.024 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.024 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.024 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_user": { 2024-04-26T18:46:33.024 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_user", 2024-04-26T18:46:33.025 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.025 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.025 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.025 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.025 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.025 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.025 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.025 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "User to authenticate as", 2024-04-26T18:46:33.025 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.025 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.025 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.025 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.025 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.025 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "balancer", 2024-04-26T18:46:33.026 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.026 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.026 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.026 INFO:teuthology.orchestra.run.smithi080.stdout: "active": { 2024-04-26T18:46:33.026 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "active", 2024-04-26T18:46:33.026 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.026 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.026 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.026 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.026 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.026 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.026 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.026 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "automatically balance PGs across cluster", 2024-04-26T18:46:33.026 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.026 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.026 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.027 INFO:teuthology.orchestra.run.smithi080.stdout: "begin_time": { 2024-04-26T18:46:33.027 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "begin_time", 2024-04-26T18:46:33.027 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.027 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.027 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.027 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0000", 2024-04-26T18:46:33.027 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.027 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.027 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.027 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "beginning time of day to automatically balance", 2024-04-26T18:46:33.027 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-26T18:46:33.027 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.027 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.027 INFO:teuthology.orchestra.run.smithi080.stdout: "begin_weekday": { 2024-04-26T18:46:33.028 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "begin_weekday", 2024-04-26T18:46:33.028 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-26T18:46:33.028 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.028 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.028 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-26T18:46:33.028 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "0", 2024-04-26T18:46:33.028 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "6", 2024-04-26T18:46:33.028 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.028 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-26T18:46:33.028 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-26T18:46:33.028 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.028 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.028 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_compat_max_iterations": { 2024-04-26T18:46:33.028 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crush_compat_max_iterations", 2024-04-26T18:46:33.029 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-26T18:46:33.029 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.029 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.029 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "25", 2024-04-26T18:46:33.029 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1", 2024-04-26T18:46:33.029 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "250", 2024-04-26T18:46:33.029 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.029 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-26T18:46:33.029 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.029 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.029 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.029 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_compat_metrics": { 2024-04-26T18:46:33.029 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crush_compat_metrics", 2024-04-26T18:46:33.029 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.029 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.029 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.030 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "pgs,objects,bytes", 2024-04-26T18:46:33.030 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.030 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.030 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.030 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-26T18:46:33.030 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-26T18:46:33.030 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.030 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.030 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_compat_step": { 2024-04-26T18:46:33.030 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crush_compat_step", 2024-04-26T18:46:33.030 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-26T18:46:33.030 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.030 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.030 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0.5", 2024-04-26T18:46:33.030 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "0.001", 2024-04-26T18:46:33.031 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "0.999", 2024-04-26T18:46:33.031 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.031 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "aggressiveness of optimization", 2024-04-26T18:46:33.031 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-26T18:46:33.031 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.031 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.031 INFO:teuthology.orchestra.run.smithi080.stdout: "end_time": { 2024-04-26T18:46:33.031 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "end_time", 2024-04-26T18:46:33.031 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.031 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.031 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.031 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "2359", 2024-04-26T18:46:33.031 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.031 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.031 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.032 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "ending time of day to automatically balance", 2024-04-26T18:46:33.032 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-26T18:46:33.032 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.032 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.032 INFO:teuthology.orchestra.run.smithi080.stdout: "end_weekday": { 2024-04-26T18:46:33.032 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "end_weekday", 2024-04-26T18:46:33.032 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-26T18:46:33.032 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.032 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.032 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-26T18:46:33.032 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "0", 2024-04-26T18:46:33.032 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "6", 2024-04-26T18:46:33.032 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.032 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-26T18:46:33.033 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-26T18:46:33.033 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.033 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.033 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.033 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.033 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.033 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.033 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.033 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.033 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.033 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.035 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.035 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.035 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.035 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.035 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.035 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.035 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.035 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.035 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.035 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.035 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.035 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.035 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.036 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.036 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.036 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.036 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.036 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.036 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.036 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.036 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.036 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.036 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.036 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.036 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.037 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.037 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.037 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.037 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.037 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.037 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.037 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.037 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.037 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.037 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.037 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.037 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.037 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.037 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.037 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.037 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.038 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.038 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.038 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.038 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.038 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.038 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.038 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.038 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.038 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.038 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.038 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.039 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.039 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.039 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.039 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.039 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.039 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.039 INFO:teuthology.orchestra.run.smithi080.stdout: "min_score": { 2024-04-26T18:46:33.039 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "min_score", 2024-04-26T18:46:33.039 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-26T18:46:33.039 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.039 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.039 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-26T18:46:33.039 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.039 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.039 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.040 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-26T18:46:33.040 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.040 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.040 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.040 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": { 2024-04-26T18:46:33.040 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mode", 2024-04-26T18:46:33.040 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.040 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.040 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.040 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "upmap", 2024-04-26T18:46:33.040 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.040 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.040 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.041 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-compat", 2024-04-26T18:46:33.041 INFO:teuthology.orchestra.run.smithi080.stdout: "none", 2024-04-26T18:46:33.041 INFO:teuthology.orchestra.run.smithi080.stdout: "read", 2024-04-26T18:46:33.041 INFO:teuthology.orchestra.run.smithi080.stdout: "upmap", 2024-04-26T18:46:33.041 INFO:teuthology.orchestra.run.smithi080.stdout: "upmap-read" 2024-04-26T18:46:33.041 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.041 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Balancer mode", 2024-04-26T18:46:33.041 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.041 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.041 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.041 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_ids": { 2024-04-26T18:46:33.041 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "pool_ids", 2024-04-26T18:46:33.041 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.042 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.042 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.042 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.042 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.042 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.042 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.042 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-26T18:46:33.042 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.042 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.042 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.042 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-26T18:46:33.042 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-26T18:46:33.042 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.042 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.043 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.043 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-26T18:46:33.043 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.043 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.043 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.043 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-26T18:46:33.043 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.043 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.043 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.043 INFO:teuthology.orchestra.run.smithi080.stdout: "upmap_max_deviation": { 2024-04-26T18:46:33.043 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "upmap_max_deviation", 2024-04-26T18:46:33.043 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.044 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.044 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.044 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5", 2024-04-26T18:46:33.044 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1", 2024-04-26T18:46:33.044 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.044 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.044 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-26T18:46:33.044 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-26T18:46:33.044 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.044 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.044 INFO:teuthology.orchestra.run.smithi080.stdout: "upmap_max_optimizations": { 2024-04-26T18:46:33.044 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "upmap_max_optimizations", 2024-04-26T18:46:33.044 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-26T18:46:33.044 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.045 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.045 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-26T18:46:33.045 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.045 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.045 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.045 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-26T18:46:33.045 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.045 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.045 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.045 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.045 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.045 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cephadm", 2024-04-26T18:46:33.045 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.045 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.046 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.046 INFO:teuthology.orchestra.run.smithi080.stdout: "agent_down_multiplier": { 2024-04-26T18:46:33.046 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "agent_down_multiplier", 2024-04-26T18:46:33.046 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-26T18:46:33.046 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.046 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.046 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "3.0", 2024-04-26T18:46:33.046 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.046 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.046 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.046 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-26T18:46:33.046 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.046 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.046 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.047 INFO:teuthology.orchestra.run.smithi080.stdout: "agent_refresh_rate": { 2024-04-26T18:46:33.047 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "agent_refresh_rate", 2024-04-26T18:46:33.047 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.047 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.047 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.047 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "20", 2024-04-26T18:46:33.047 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.047 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.047 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.047 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-26T18:46:33.047 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.047 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.047 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.048 INFO:teuthology.orchestra.run.smithi080.stdout: "agent_starting_port": { 2024-04-26T18:46:33.048 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "agent_starting_port", 2024-04-26T18:46:33.048 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.048 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.048 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.048 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "4721", 2024-04-26T18:46:33.048 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.048 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.048 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.048 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-26T18:46:33.048 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.048 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.048 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.049 INFO:teuthology.orchestra.run.smithi080.stdout: "allow_ptrace": { 2024-04-26T18:46:33.049 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "allow_ptrace", 2024-04-26T18:46:33.049 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.049 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.049 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.049 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.049 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.049 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.049 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.049 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-26T18:46:33.049 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-26T18:46:33.049 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.049 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.049 INFO:teuthology.orchestra.run.smithi080.stdout: "autotune_interval": { 2024-04-26T18:46:33.050 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "autotune_interval", 2024-04-26T18:46:33.050 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.050 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.050 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.050 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-26T18:46:33.050 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.050 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.050 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.050 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-26T18:46:33.050 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.050 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.050 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.050 INFO:teuthology.orchestra.run.smithi080.stdout: "autotune_memory_target_ratio": { 2024-04-26T18:46:33.051 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "autotune_memory_target_ratio", 2024-04-26T18:46:33.051 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-26T18:46:33.051 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.051 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.051 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0.7", 2024-04-26T18:46:33.051 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.051 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.051 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.051 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-26T18:46:33.051 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.051 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.051 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.051 INFO:teuthology.orchestra.run.smithi080.stdout: "cephadm_log_destination": { 2024-04-26T18:46:33.051 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cephadm_log_destination", 2024-04-26T18:46:33.052 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.052 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.052 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.052 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.052 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.052 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.052 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.052 INFO:teuthology.orchestra.run.smithi080.stdout: "file", 2024-04-26T18:46:33.052 INFO:teuthology.orchestra.run.smithi080.stdout: "file,syslog", 2024-04-26T18:46:33.052 INFO:teuthology.orchestra.run.smithi080.stdout: "syslog" 2024-04-26T18:46:33.052 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.052 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-26T18:46:33.052 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.052 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.052 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.053 INFO:teuthology.orchestra.run.smithi080.stdout: "cgroups_split": { 2024-04-26T18:46:33.053 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cgroups_split", 2024-04-26T18:46:33.053 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.053 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.053 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.053 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.053 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.053 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.053 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.053 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-26T18:46:33.053 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.053 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.053 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.053 INFO:teuthology.orchestra.run.smithi080.stdout: "config_checks_enabled": { 2024-04-26T18:46:33.053 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "config_checks_enabled", 2024-04-26T18:46:33.053 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.054 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.054 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.054 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.054 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.054 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.054 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.054 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-26T18:46:33.054 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.054 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.054 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.054 INFO:teuthology.orchestra.run.smithi080.stdout: "config_dashboard": { 2024-04-26T18:46:33.054 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "config_dashboard", 2024-04-26T18:46:33.054 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.055 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.055 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.055 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.055 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.055 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.055 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.055 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-26T18:46:33.055 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.055 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.055 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.055 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_alertmanager": { 2024-04-26T18:46:33.055 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_alertmanager", 2024-04-26T18:46:33.055 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.055 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.055 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.056 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-26T18:46:33.056 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.056 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.056 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.056 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Prometheus container image", 2024-04-26T18:46:33.056 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.056 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.056 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.056 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_base": { 2024-04-26T18:46:33.056 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_base", 2024-04-26T18:46:33.056 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.056 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.056 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.056 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-26T18:46:33.056 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.057 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.057 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.057 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Container image name, without the tag", 2024-04-26T18:46:33.057 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.057 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.057 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.057 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_elasticsearch": { 2024-04-26T18:46:33.057 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_elasticsearch", 2024-04-26T18:46:33.057 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.057 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.057 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.057 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-26T18:46:33.057 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.057 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.057 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.057 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "elasticsearch container image", 2024-04-26T18:46:33.058 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.058 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.058 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.058 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_grafana": { 2024-04-26T18:46:33.058 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_grafana", 2024-04-26T18:46:33.058 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.058 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.058 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.058 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-26T18:46:33.058 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.058 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.058 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.058 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Prometheus container image", 2024-04-26T18:46:33.059 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.059 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.059 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.059 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_haproxy": { 2024-04-26T18:46:33.059 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_haproxy", 2024-04-26T18:46:33.059 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.059 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.059 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.059 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-26T18:46:33.059 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.059 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.059 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.059 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "HAproxy container image", 2024-04-26T18:46:33.059 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.060 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.060 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.060 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_jaeger_agent": { 2024-04-26T18:46:33.060 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_jaeger_agent", 2024-04-26T18:46:33.060 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.060 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.060 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.060 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-26T18:46:33.060 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.060 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.060 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.060 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Jaeger agent container image", 2024-04-26T18:46:33.060 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.060 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.061 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.061 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_jaeger_collector": { 2024-04-26T18:46:33.061 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_jaeger_collector", 2024-04-26T18:46:33.061 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.061 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.061 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.061 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-26T18:46:33.061 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.061 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.061 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.061 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Jaeger collector container image", 2024-04-26T18:46:33.061 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.061 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.061 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.062 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_jaeger_query": { 2024-04-26T18:46:33.062 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_jaeger_query", 2024-04-26T18:46:33.062 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.062 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.062 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.062 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-26T18:46:33.062 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.062 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.062 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.062 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Jaeger query container image", 2024-04-26T18:46:33.062 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.062 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.062 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.063 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_keepalived": { 2024-04-26T18:46:33.063 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_keepalived", 2024-04-26T18:46:33.063 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.063 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.063 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.063 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-26T18:46:33.063 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.063 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.063 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.063 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Keepalived container image", 2024-04-26T18:46:33.063 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.063 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.063 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.064 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_loki": { 2024-04-26T18:46:33.064 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_loki", 2024-04-26T18:46:33.064 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.064 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.064 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.064 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-26T18:46:33.064 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.064 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.064 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.064 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Loki container image", 2024-04-26T18:46:33.064 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.064 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.064 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.064 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_node_exporter": { 2024-04-26T18:46:33.065 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_node_exporter", 2024-04-26T18:46:33.065 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.065 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.065 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.065 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-26T18:46:33.065 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.065 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.065 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.065 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Prometheus container image", 2024-04-26T18:46:33.065 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.065 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.065 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.065 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_nvmeof": { 2024-04-26T18:46:33.065 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_nvmeof", 2024-04-26T18:46:33.066 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.066 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.066 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.066 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-26T18:46:33.066 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.066 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.066 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.066 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Nvme-of container image", 2024-04-26T18:46:33.066 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.066 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.066 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.066 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_prometheus": { 2024-04-26T18:46:33.066 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_prometheus", 2024-04-26T18:46:33.066 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.067 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.067 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.067 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-26T18:46:33.067 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.067 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.067 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.067 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Prometheus container image", 2024-04-26T18:46:33.067 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.067 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.067 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.067 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_promtail": { 2024-04-26T18:46:33.067 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_promtail", 2024-04-26T18:46:33.067 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.067 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.068 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.068 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-26T18:46:33.068 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.068 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.068 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.068 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Promtail container image", 2024-04-26T18:46:33.068 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.068 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.068 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.068 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_samba": { 2024-04-26T18:46:33.068 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_samba", 2024-04-26T18:46:33.068 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.068 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.068 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.069 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-26T18:46:33.069 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.069 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.069 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.069 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Samba/SMB container image", 2024-04-26T18:46:33.069 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.069 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.069 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.069 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_snmp_gateway": { 2024-04-26T18:46:33.069 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_snmp_gateway", 2024-04-26T18:46:33.069 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.069 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.069 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.069 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-26T18:46:33.070 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.070 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.070 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.070 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "SNMP Gateway container image", 2024-04-26T18:46:33.070 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.070 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.070 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.070 INFO:teuthology.orchestra.run.smithi080.stdout: "container_init": { 2024-04-26T18:46:33.070 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_init", 2024-04-26T18:46:33.070 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.070 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.070 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.070 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.071 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.071 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.071 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.071 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Run podman/docker with `--init`", 2024-04-26T18:46:33.071 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.071 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.071 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.071 INFO:teuthology.orchestra.run.smithi080.stdout: "daemon_cache_timeout": { 2024-04-26T18:46:33.071 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "daemon_cache_timeout", 2024-04-26T18:46:33.071 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.071 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.071 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.071 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-26T18:46:33.071 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.072 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.072 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.072 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-26T18:46:33.072 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.072 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.072 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.072 INFO:teuthology.orchestra.run.smithi080.stdout: "default_cephadm_command_timeout": { 2024-04-26T18:46:33.072 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "default_cephadm_command_timeout", 2024-04-26T18:46:33.072 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.072 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.072 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.072 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "900", 2024-04-26T18:46:33.072 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.072 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.072 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.073 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-26T18:46:33.073 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.073 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.073 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.073 INFO:teuthology.orchestra.run.smithi080.stdout: "default_registry": { 2024-04-26T18:46:33.073 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "default_registry", 2024-04-26T18:46:33.073 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.073 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.073 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.073 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "docker.io", 2024-04-26T18:46:33.073 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.073 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.073 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.073 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-26T18:46:33.074 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.074 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.074 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.074 INFO:teuthology.orchestra.run.smithi080.stdout: "device_cache_timeout": { 2024-04-26T18:46:33.074 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "device_cache_timeout", 2024-04-26T18:46:33.074 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.074 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.074 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.074 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "1800", 2024-04-26T18:46:33.074 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.074 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.074 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.074 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "seconds to cache device inventory", 2024-04-26T18:46:33.074 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.074 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.075 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.075 INFO:teuthology.orchestra.run.smithi080.stdout: "device_enhanced_scan": { 2024-04-26T18:46:33.075 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "device_enhanced_scan", 2024-04-26T18:46:33.075 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.075 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.075 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.075 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.075 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.075 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.075 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.075 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-26T18:46:33.075 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.075 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.075 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.076 INFO:teuthology.orchestra.run.smithi080.stdout: "facts_cache_timeout": { 2024-04-26T18:46:33.076 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "facts_cache_timeout", 2024-04-26T18:46:33.076 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.076 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.076 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.076 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-26T18:46:33.076 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.076 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.076 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.076 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "seconds to cache host facts data", 2024-04-26T18:46:33.076 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.076 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.076 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.077 INFO:teuthology.orchestra.run.smithi080.stdout: "grafana_dashboards_path": { 2024-04-26T18:46:33.077 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "grafana_dashboards_path", 2024-04-26T18:46:33.077 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.077 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.077 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.077 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-26T18:46:33.077 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.077 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.077 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.077 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-26T18:46:33.077 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.077 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.077 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.077 INFO:teuthology.orchestra.run.smithi080.stdout: "host_check_interval": { 2024-04-26T18:46:33.077 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "host_check_interval", 2024-04-26T18:46:33.078 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.078 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.078 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.078 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-26T18:46:33.078 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.078 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.078 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.078 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to perform a host check", 2024-04-26T18:46:33.078 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.078 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.078 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.078 INFO:teuthology.orchestra.run.smithi080.stdout: "hw_monitoring": { 2024-04-26T18:46:33.078 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "hw_monitoring", 2024-04-26T18:46:33.078 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.079 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.079 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.079 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.079 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.079 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.079 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.079 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-26T18:46:33.079 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.079 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.079 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.079 INFO:teuthology.orchestra.run.smithi080.stdout: "inventory_list_all": { 2024-04-26T18:46:33.079 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "inventory_list_all", 2024-04-26T18:46:33.079 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.079 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.080 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.080 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.080 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.080 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.080 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.080 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-26T18:46:33.080 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.080 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.080 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.080 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.080 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.080 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.080 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.080 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.081 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.081 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.081 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.081 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.081 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.081 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.081 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.081 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.081 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.081 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.081 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.081 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.081 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.081 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.082 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.082 INFO:teuthology.orchestra.run.smithi080.stdout: "log_refresh_metadata": { 2024-04-26T18:46:33.082 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_refresh_metadata", 2024-04-26T18:46:33.082 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.082 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.082 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.082 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.082 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.082 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.082 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.082 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-26T18:46:33.082 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.082 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.083 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.083 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.083 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.083 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.083 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.083 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.083 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.083 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.083 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.083 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.083 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-26T18:46:33.083 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.083 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.083 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.084 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.084 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.084 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.084 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.084 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.084 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.084 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.084 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.084 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.084 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.084 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.084 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.084 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.084 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.084 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.084 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.085 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.085 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.085 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.085 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.085 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.085 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.085 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.085 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.085 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.085 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.085 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.085 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.085 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.085 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.085 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.086 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.086 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.086 INFO:teuthology.orchestra.run.smithi080.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-26T18:46:33.086 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-26T18:46:33.086 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.086 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.086 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.086 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.086 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.086 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.086 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.086 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-26T18:46:33.086 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.086 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.087 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.087 INFO:teuthology.orchestra.run.smithi080.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-26T18:46:33.087 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-26T18:46:33.087 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.087 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.087 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.087 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "*", 2024-04-26T18:46:33.087 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.087 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.087 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.087 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-26T18:46:33.087 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.087 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.087 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.088 INFO:teuthology.orchestra.run.smithi080.stdout: "max_count_per_host": { 2024-04-26T18:46:33.088 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_count_per_host", 2024-04-26T18:46:33.088 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.088 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.088 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.088 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-26T18:46:33.088 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.088 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.088 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.088 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "max number of daemons per service per host", 2024-04-26T18:46:33.088 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.088 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.088 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.088 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd_draining_count": { 2024-04-26T18:46:33.089 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_osd_draining_count", 2024-04-26T18:46:33.089 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.089 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.089 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.089 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-26T18:46:33.089 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.089 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.089 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.089 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-26T18:46:33.089 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.089 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.089 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.089 INFO:teuthology.orchestra.run.smithi080.stdout: "migration_current": { 2024-04-26T18:46:33.089 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "migration_current", 2024-04-26T18:46:33.089 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.090 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.090 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.090 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.090 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.090 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.090 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.090 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "internal - do not modify", 2024-04-26T18:46:33.090 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.090 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.090 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.090 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": { 2024-04-26T18:46:33.090 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mode", 2024-04-26T18:46:33.090 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.090 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.091 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.091 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "root", 2024-04-26T18:46:33.091 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.091 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.091 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.091 INFO:teuthology.orchestra.run.smithi080.stdout: "cephadm-package", 2024-04-26T18:46:33.091 INFO:teuthology.orchestra.run.smithi080.stdout: "root" 2024-04-26T18:46:33.091 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.091 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "mode for remote execution of cephadm", 2024-04-26T18:46:33.091 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.091 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.091 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.091 INFO:teuthology.orchestra.run.smithi080.stdout: "oob_default_addr": { 2024-04-26T18:46:33.092 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "oob_default_addr", 2024-04-26T18:46:33.092 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.092 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.092 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.092 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "169.254.1.1", 2024-04-26T18:46:33.092 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.092 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.092 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.092 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-26T18:46:33.092 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.092 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.092 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.092 INFO:teuthology.orchestra.run.smithi080.stdout: "prometheus_alerts_path": { 2024-04-26T18:46:33.092 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "prometheus_alerts_path", 2024-04-26T18:46:33.093 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.093 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.093 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.093 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-26T18:46:33.093 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.093 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.093 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.093 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-26T18:46:33.093 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.093 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.093 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.093 INFO:teuthology.orchestra.run.smithi080.stdout: "registry_insecure": { 2024-04-26T18:46:33.093 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "registry_insecure", 2024-04-26T18:46:33.094 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.094 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.094 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.094 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.094 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.094 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.094 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.094 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-26T18:46:33.094 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.094 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.094 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.094 INFO:teuthology.orchestra.run.smithi080.stdout: "registry_password": { 2024-04-26T18:46:33.094 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "registry_password", 2024-04-26T18:46:33.095 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.095 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.095 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.095 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.095 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.095 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.095 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.095 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-26T18:46:33.095 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.095 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.095 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.095 INFO:teuthology.orchestra.run.smithi080.stdout: "registry_url": { 2024-04-26T18:46:33.095 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "registry_url", 2024-04-26T18:46:33.095 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.096 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.096 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.096 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.096 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.096 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.096 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.096 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-26T18:46:33.096 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.096 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.096 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.096 INFO:teuthology.orchestra.run.smithi080.stdout: "registry_username": { 2024-04-26T18:46:33.096 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "registry_username", 2024-04-26T18:46:33.096 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.096 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.097 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.097 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.097 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.097 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.097 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.097 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-26T18:46:33.097 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.097 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.097 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.097 INFO:teuthology.orchestra.run.smithi080.stdout: "secure_monitoring_stack": { 2024-04-26T18:46:33.097 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "secure_monitoring_stack", 2024-04-26T18:46:33.097 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.097 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.097 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.098 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.098 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.098 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.098 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.098 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-26T18:46:33.098 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.098 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.098 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.098 INFO:teuthology.orchestra.run.smithi080.stdout: "service_discovery_port": { 2024-04-26T18:46:33.098 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "service_discovery_port", 2024-04-26T18:46:33.098 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.098 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.098 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.099 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8765", 2024-04-26T18:46:33.099 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.099 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.099 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.099 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "cephadm service discovery port", 2024-04-26T18:46:33.099 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.099 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.099 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.099 INFO:teuthology.orchestra.run.smithi080.stdout: "ssh_config_file": { 2024-04-26T18:46:33.099 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ssh_config_file", 2024-04-26T18:46:33.099 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.099 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.099 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.100 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.100 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.100 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.100 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.100 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-26T18:46:33.100 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.100 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.100 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.100 INFO:teuthology.orchestra.run.smithi080.stdout: "use_agent": { 2024-04-26T18:46:33.100 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "use_agent", 2024-04-26T18:46:33.100 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.100 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.101 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.101 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.101 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.101 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.101 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.101 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-26T18:46:33.101 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.101 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.101 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.101 INFO:teuthology.orchestra.run.smithi080.stdout: "use_repo_digest": { 2024-04-26T18:46:33.101 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "use_repo_digest", 2024-04-26T18:46:33.101 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.101 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.102 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.102 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.102 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.102 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.102 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.102 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-26T18:46:33.102 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.102 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.102 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.102 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_on_failed_host_check": { 2024-04-26T18:46:33.102 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_on_failed_host_check", 2024-04-26T18:46:33.102 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.102 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.102 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.103 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.103 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.103 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.103 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.103 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "raise a health warning if the host check fails", 2024-04-26T18:46:33.103 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.103 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.103 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.103 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_on_stray_daemons": { 2024-04-26T18:46:33.103 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_on_stray_daemons", 2024-04-26T18:46:33.103 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.103 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.103 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.103 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.104 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.104 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.104 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.104 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-26T18:46:33.104 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.104 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.104 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.104 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_on_stray_hosts": { 2024-04-26T18:46:33.104 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_on_stray_hosts", 2024-04-26T18:46:33.104 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.104 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.104 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.104 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.104 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.104 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.105 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.105 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-26T18:46:33.105 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.105 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.105 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.105 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.105 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.105 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crash", 2024-04-26T18:46:33.105 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.105 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.105 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.105 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.105 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.106 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.106 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.106 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.106 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.106 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.106 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.106 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.106 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.106 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.106 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.106 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.106 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.106 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.107 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.107 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.107 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.107 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.107 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.107 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.107 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.107 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.107 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.107 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.107 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.107 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.107 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.107 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.108 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.108 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.108 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.108 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.108 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.108 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.108 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.108 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.108 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.108 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.108 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.108 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.108 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.109 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.109 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.109 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.109 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.109 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.109 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.109 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.109 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.109 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.109 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.109 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.109 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.109 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.109 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.109 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.110 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.110 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.110 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.110 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.110 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.110 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.110 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.110 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.110 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.110 INFO:teuthology.orchestra.run.smithi080.stdout: "retain_interval": { 2024-04-26T18:46:33.110 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "retain_interval", 2024-04-26T18:46:33.110 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.110 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.111 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.111 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "31536000", 2024-04-26T18:46:33.111 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.111 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.111 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.111 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-26T18:46:33.111 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.111 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.111 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.111 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_recent_interval": { 2024-04-26T18:46:33.111 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_recent_interval", 2024-04-26T18:46:33.111 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.111 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.111 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.112 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "1209600", 2024-04-26T18:46:33.112 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.112 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.112 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.112 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-26T18:46:33.112 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.112 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.112 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.112 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.112 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.112 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "dashboard", 2024-04-26T18:46:33.112 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.112 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.113 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.113 INFO:teuthology.orchestra.run.smithi080.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-26T18:46:33.113 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-26T18:46:33.113 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.113 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.113 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.113 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-26T18:46:33.113 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.113 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.113 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.113 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.113 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.113 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.113 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.114 INFO:teuthology.orchestra.run.smithi080.stdout: "ALERTMANAGER_API_HOST": { 2024-04-26T18:46:33.114 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-26T18:46:33.114 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.114 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.114 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.114 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.114 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.114 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.114 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.114 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.114 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.114 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.114 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.114 INFO:teuthology.orchestra.run.smithi080.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-26T18:46:33.115 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-26T18:46:33.115 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.115 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.115 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.115 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.115 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.115 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.115 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.115 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.115 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.115 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.115 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.115 INFO:teuthology.orchestra.run.smithi080.stdout: "AUDIT_API_ENABLED": { 2024-04-26T18:46:33.115 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "AUDIT_API_ENABLED", 2024-04-26T18:46:33.115 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.115 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.116 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.116 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.116 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.116 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.116 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.116 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.116 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.116 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.116 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.116 INFO:teuthology.orchestra.run.smithi080.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-26T18:46:33.116 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-26T18:46:33.116 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.116 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.117 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.117 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.117 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.117 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.117 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.117 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.117 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.117 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.117 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.117 INFO:teuthology.orchestra.run.smithi080.stdout: "ENABLE_BROWSABLE_API": { 2024-04-26T18:46:33.117 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-26T18:46:33.117 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.117 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.117 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.118 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.118 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.118 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.118 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.118 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.118 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.118 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.118 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.118 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-26T18:46:33.118 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-26T18:46:33.118 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.118 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.118 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.119 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.119 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.119 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.119 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.119 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.119 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.119 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.119 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.119 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-26T18:46:33.119 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-26T18:46:33.119 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.119 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.119 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.119 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.120 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.120 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.120 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.120 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.120 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.120 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.120 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.120 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-26T18:46:33.120 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-26T18:46:33.120 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.120 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.120 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.120 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.120 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.120 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.121 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.121 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.121 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.121 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.121 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.121 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-26T18:46:33.121 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-26T18:46:33.121 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.121 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.121 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.121 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.121 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.121 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.121 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.122 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.122 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.122 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.122 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.122 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-26T18:46:33.122 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-26T18:46:33.122 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.122 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.122 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.122 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.122 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.122 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.122 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.122 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.123 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.123 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.123 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.123 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-26T18:46:33.123 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-26T18:46:33.123 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.123 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.123 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.123 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.123 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.123 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.123 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.123 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.123 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.124 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.124 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.124 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-26T18:46:33.124 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-26T18:46:33.124 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.124 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.124 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.124 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.124 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.124 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.124 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.124 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.124 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.124 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.124 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.125 INFO:teuthology.orchestra.run.smithi080.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-26T18:46:33.125 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-26T18:46:33.125 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.125 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.125 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.125 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.125 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.125 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.125 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.125 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.125 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.125 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.125 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.125 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_API_PASSWORD": { 2024-04-26T18:46:33.126 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-26T18:46:33.126 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.126 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.126 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.126 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "admin", 2024-04-26T18:46:33.126 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.126 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.126 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.126 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.126 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.126 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.126 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.126 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-26T18:46:33.127 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-26T18:46:33.127 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.127 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.127 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.127 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.127 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.127 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.127 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.127 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.127 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.127 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.127 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.127 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_API_URL": { 2024-04-26T18:46:33.127 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_API_URL", 2024-04-26T18:46:33.127 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.128 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.128 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.128 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.128 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.128 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.128 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.128 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.128 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.128 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.128 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.128 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_API_USERNAME": { 2024-04-26T18:46:33.128 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-26T18:46:33.128 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.128 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.128 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.129 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "admin", 2024-04-26T18:46:33.129 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.129 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.129 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.129 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.129 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.129 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.129 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.129 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-26T18:46:33.129 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-26T18:46:33.129 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.129 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.129 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.129 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.129 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.129 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.130 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.130 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.130 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.130 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.130 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.130 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-26T18:46:33.130 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-26T18:46:33.130 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.130 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.130 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.130 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.130 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.130 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.131 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.131 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.131 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.131 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.131 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.131 INFO:teuthology.orchestra.run.smithi080.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-26T18:46:33.131 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-26T18:46:33.131 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.131 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.131 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.131 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.131 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.131 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.131 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.131 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.132 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.132 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.132 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.132 INFO:teuthology.orchestra.run.smithi080.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-26T18:46:33.132 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-26T18:46:33.132 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.132 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.132 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.132 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.132 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.132 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.132 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.132 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.132 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.133 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.133 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.133 INFO:teuthology.orchestra.run.smithi080.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-26T18:46:33.133 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-26T18:46:33.133 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.133 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.133 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.133 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "[]", 2024-04-26T18:46:33.133 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.133 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.133 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.133 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.133 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.133 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.133 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.134 INFO:teuthology.orchestra.run.smithi080.stdout: "MULTICLUSTER_CONFIG": { 2024-04-26T18:46:33.134 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-26T18:46:33.134 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.134 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.134 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.134 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "{}", 2024-04-26T18:46:33.134 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.134 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.134 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.134 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.134 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.134 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.134 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.135 INFO:teuthology.orchestra.run.smithi080.stdout: "PROMETHEUS_API_HOST": { 2024-04-26T18:46:33.135 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-26T18:46:33.135 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.135 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.135 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.135 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.135 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.135 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.135 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.135 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.135 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.135 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.135 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.136 INFO:teuthology.orchestra.run.smithi080.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-26T18:46:33.136 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-26T18:46:33.136 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.136 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.136 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.136 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.136 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.136 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.136 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.136 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.136 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.136 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.136 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.136 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-26T18:46:33.136 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-26T18:46:33.137 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.137 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.137 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.137 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.137 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.137 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.137 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.137 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.137 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.137 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.137 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.137 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-26T18:46:33.137 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-26T18:46:33.138 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.138 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.138 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.138 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.138 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.138 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.138 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.138 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.138 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.138 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.138 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.138 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-26T18:46:33.138 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-26T18:46:33.138 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.139 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.139 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.139 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.139 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.139 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.139 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.139 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.139 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.139 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.139 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.139 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-26T18:46:33.139 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-26T18:46:33.139 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.139 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.139 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.140 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.140 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.140 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.140 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.140 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.140 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.140 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.140 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.140 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-26T18:46:33.140 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-26T18:46:33.140 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.140 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.140 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.140 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.140 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.141 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.141 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.141 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.141 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.141 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.141 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.141 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-26T18:46:33.141 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-26T18:46:33.141 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.141 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.141 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.141 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.141 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.141 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.141 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.142 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.142 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.142 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.142 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.142 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-26T18:46:33.142 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-26T18:46:33.142 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.142 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.142 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.142 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.142 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.142 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.142 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.143 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.143 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.143 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.143 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.143 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_ENABLED": { 2024-04-26T18:46:33.143 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-26T18:46:33.143 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.143 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.143 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.143 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.143 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.143 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.143 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.143 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.143 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.144 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.144 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.144 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-26T18:46:33.144 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-26T18:46:33.144 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.144 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.144 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.144 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-26T18:46:33.144 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.144 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.144 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.144 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.144 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.144 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.145 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.145 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-26T18:46:33.145 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-26T18:46:33.145 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.145 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.145 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.145 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-26T18:46:33.145 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.145 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.145 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.145 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.145 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.145 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.145 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.145 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-26T18:46:33.146 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-26T18:46:33.146 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.146 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.146 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.146 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8", 2024-04-26T18:46:33.146 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.146 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.146 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.146 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.146 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.146 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.146 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.146 INFO:teuthology.orchestra.run.smithi080.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-26T18:46:33.146 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-26T18:46:33.147 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.147 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.147 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.147 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "45", 2024-04-26T18:46:33.147 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.147 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.147 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.147 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.147 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.147 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.147 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.147 INFO:teuthology.orchestra.run.smithi080.stdout: "RGW_API_ACCESS_KEY": { 2024-04-26T18:46:33.147 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-26T18:46:33.147 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.148 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.148 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.148 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.148 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.148 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.148 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.148 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.148 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.148 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.148 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.148 INFO:teuthology.orchestra.run.smithi080.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-26T18:46:33.148 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-26T18:46:33.148 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.148 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.148 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.149 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "admin", 2024-04-26T18:46:33.149 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.149 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.149 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.149 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.149 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.149 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.149 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.149 INFO:teuthology.orchestra.run.smithi080.stdout: "RGW_API_SECRET_KEY": { 2024-04-26T18:46:33.149 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-26T18:46:33.149 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.149 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.149 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.149 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.149 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.149 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.150 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.150 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.150 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.150 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.150 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.150 INFO:teuthology.orchestra.run.smithi080.stdout: "RGW_API_SSL_VERIFY": { 2024-04-26T18:46:33.150 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-26T18:46:33.150 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.150 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.150 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.150 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.150 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.150 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.151 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.151 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.151 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.151 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.151 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.151 INFO:teuthology.orchestra.run.smithi080.stdout: "UNSAFE_TLS_v1_2": { 2024-04-26T18:46:33.151 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-26T18:46:33.151 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.151 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.151 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.151 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.151 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.151 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.151 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.151 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.152 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.152 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.152 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.152 INFO:teuthology.orchestra.run.smithi080.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-26T18:46:33.152 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-26T18:46:33.152 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.152 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.152 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.152 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-26T18:46:33.152 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.152 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.152 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.152 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.152 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.152 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.152 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.153 INFO:teuthology.orchestra.run.smithi080.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-26T18:46:33.153 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-26T18:46:33.153 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.153 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.153 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.153 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-26T18:46:33.153 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.153 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.153 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.153 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.153 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.153 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.153 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.153 INFO:teuthology.orchestra.run.smithi080.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-26T18:46:33.154 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-26T18:46:33.154 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.154 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.154 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.154 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5", 2024-04-26T18:46:33.154 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.154 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.154 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.154 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.154 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.154 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.154 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.154 INFO:teuthology.orchestra.run.smithi080.stdout: "cross_origin_url": { 2024-04-26T18:46:33.155 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cross_origin_url", 2024-04-26T18:46:33.155 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.155 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.155 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.155 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.155 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.155 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.155 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.155 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.155 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.155 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.155 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.155 INFO:teuthology.orchestra.run.smithi080.stdout: "crt_file": { 2024-04-26T18:46:33.155 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crt_file", 2024-04-26T18:46:33.156 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.156 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.156 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.156 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.156 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.156 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.156 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.156 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.156 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.156 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.156 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.156 INFO:teuthology.orchestra.run.smithi080.stdout: "debug": { 2024-04-26T18:46:33.156 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "debug", 2024-04-26T18:46:33.156 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.156 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.157 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.157 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.157 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.157 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.157 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.157 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Enable/disable debug options", 2024-04-26T18:46:33.157 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.157 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.157 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.157 INFO:teuthology.orchestra.run.smithi080.stdout: "jwt_token_ttl": { 2024-04-26T18:46:33.157 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "jwt_token_ttl", 2024-04-26T18:46:33.157 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.157 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.157 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.158 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "28800", 2024-04-26T18:46:33.158 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.158 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.158 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.158 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.158 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.158 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.158 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.158 INFO:teuthology.orchestra.run.smithi080.stdout: "key_file": { 2024-04-26T18:46:33.158 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "key_file", 2024-04-26T18:46:33.158 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.158 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.158 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.158 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.158 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.159 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.159 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.159 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.159 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.159 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.159 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.159 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.159 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.159 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.159 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.159 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.159 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.159 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.160 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.160 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.160 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.160 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.160 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.160 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.160 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.160 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.160 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.160 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.160 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.160 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.160 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.161 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.161 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.161 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.161 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.161 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.161 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.161 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.161 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.161 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.161 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.161 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.161 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.161 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.161 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.162 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.162 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.162 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.162 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.162 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.162 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.162 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.162 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.162 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.162 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.162 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.162 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.162 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.162 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.162 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.163 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.163 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.163 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.163 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.163 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.163 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.163 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.163 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.163 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.163 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.163 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.163 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.163 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.164 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.164 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.164 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.164 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.164 INFO:teuthology.orchestra.run.smithi080.stdout: "motd": { 2024-04-26T18:46:33.164 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "motd", 2024-04-26T18:46:33.164 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.164 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.164 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.164 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.164 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.164 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.164 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.165 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "The message of the day", 2024-04-26T18:46:33.165 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.165 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.165 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.165 INFO:teuthology.orchestra.run.smithi080.stdout: "redirect_resolve_ip_addr": { 2024-04-26T18:46:33.165 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "redirect_resolve_ip_addr", 2024-04-26T18:46:33.165 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.165 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.165 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.165 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.165 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.165 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.165 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.165 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.166 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.166 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.166 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.166 INFO:teuthology.orchestra.run.smithi080.stdout: "server_addr": { 2024-04-26T18:46:33.166 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_addr", 2024-04-26T18:46:33.166 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.166 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.166 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.166 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "::", 2024-04-26T18:46:33.166 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.166 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.166 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.166 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.167 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.167 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.167 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.167 INFO:teuthology.orchestra.run.smithi080.stdout: "server_port": { 2024-04-26T18:46:33.167 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_port", 2024-04-26T18:46:33.167 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.167 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.167 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.167 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8080", 2024-04-26T18:46:33.167 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.167 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.167 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.167 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.168 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.168 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.168 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.168 INFO:teuthology.orchestra.run.smithi080.stdout: "ssl": { 2024-04-26T18:46:33.168 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ssl", 2024-04-26T18:46:33.168 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.168 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.168 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.168 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.168 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.168 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.168 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.168 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.169 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.169 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.169 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.169 INFO:teuthology.orchestra.run.smithi080.stdout: "ssl_server_port": { 2024-04-26T18:46:33.169 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ssl_server_port", 2024-04-26T18:46:33.169 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.169 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.169 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.169 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8443", 2024-04-26T18:46:33.169 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.169 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.169 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.169 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.169 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.170 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.170 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.170 INFO:teuthology.orchestra.run.smithi080.stdout: "standby_behaviour": { 2024-04-26T18:46:33.170 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "standby_behaviour", 2024-04-26T18:46:33.170 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.170 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.170 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.170 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "redirect", 2024-04-26T18:46:33.170 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.170 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.170 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.170 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.170 INFO:teuthology.orchestra.run.smithi080.stdout: "redirect" 2024-04-26T18:46:33.170 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.171 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.171 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.171 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.171 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.171 INFO:teuthology.orchestra.run.smithi080.stdout: "standby_error_status_code": { 2024-04-26T18:46:33.171 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "standby_error_status_code", 2024-04-26T18:46:33.171 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.171 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.171 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.171 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "500", 2024-04-26T18:46:33.171 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "400", 2024-04-26T18:46:33.171 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "599", 2024-04-26T18:46:33.171 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.171 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.172 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.172 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.172 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.172 INFO:teuthology.orchestra.run.smithi080.stdout: "url_prefix": { 2024-04-26T18:46:33.172 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "url_prefix", 2024-04-26T18:46:33.172 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.172 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.172 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.172 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.172 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.172 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.172 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.172 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.172 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.173 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.173 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.173 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.173 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.173 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "devicehealth", 2024-04-26T18:46:33.173 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.173 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.173 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.173 INFO:teuthology.orchestra.run.smithi080.stdout: "enable_monitoring": { 2024-04-26T18:46:33.173 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "enable_monitoring", 2024-04-26T18:46:33.173 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.173 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.173 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.173 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.173 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.174 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.174 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.174 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "monitor device health metrics", 2024-04-26T18:46:33.174 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.174 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.174 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.174 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.174 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.174 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.174 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.174 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.174 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.174 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.174 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.175 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.175 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.175 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.175 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.175 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.175 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.175 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.175 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.175 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.175 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.175 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.175 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.175 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.175 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.175 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.175 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.176 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.176 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.176 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.176 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.176 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.176 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.176 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.176 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.176 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.176 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.176 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.176 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.176 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.176 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.176 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.177 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.177 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.177 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.177 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.177 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.177 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.177 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.177 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.177 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.177 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.177 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.177 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.177 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.177 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.177 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.178 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.178 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.178 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.178 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.178 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.178 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.178 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.178 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.178 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.178 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.178 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.178 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.178 INFO:teuthology.orchestra.run.smithi080.stdout: "mark_out_threshold": { 2024-04-26T18:46:33.178 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mark_out_threshold", 2024-04-26T18:46:33.179 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.179 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.179 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.179 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "2419200", 2024-04-26T18:46:33.179 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.179 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.179 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.179 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-26T18:46:33.179 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.179 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.179 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.179 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": { 2024-04-26T18:46:33.179 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "pool_name", 2024-04-26T18:46:33.179 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.180 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.180 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.180 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "device_health_metrics", 2024-04-26T18:46:33.180 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.180 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.180 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.180 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-26T18:46:33.180 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.180 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.180 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.180 INFO:teuthology.orchestra.run.smithi080.stdout: "retention_period": { 2024-04-26T18:46:33.180 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "retention_period", 2024-04-26T18:46:33.180 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.180 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.181 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.181 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "15552000", 2024-04-26T18:46:33.181 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.181 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.181 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.181 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how long to retain device health metrics", 2024-04-26T18:46:33.181 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.181 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.181 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.181 INFO:teuthology.orchestra.run.smithi080.stdout: "scrape_frequency": { 2024-04-26T18:46:33.181 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "scrape_frequency", 2024-04-26T18:46:33.181 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.181 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.181 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.181 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "86400", 2024-04-26T18:46:33.182 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.182 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.182 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.182 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-26T18:46:33.182 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.182 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.182 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.182 INFO:teuthology.orchestra.run.smithi080.stdout: "self_heal": { 2024-04-26T18:46:33.182 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "self_heal", 2024-04-26T18:46:33.182 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.182 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.182 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.182 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.182 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.183 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.183 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.183 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-26T18:46:33.183 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.183 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.183 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.183 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-26T18:46:33.183 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-26T18:46:33.183 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.183 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.183 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.183 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-26T18:46:33.183 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.183 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.184 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.184 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to wake up and check device health", 2024-04-26T18:46:33.184 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.184 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.184 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.184 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_threshold": { 2024-04-26T18:46:33.184 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_threshold", 2024-04-26T18:46:33.184 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.184 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.184 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.184 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "7257600", 2024-04-26T18:46:33.184 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.184 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.184 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.185 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-26T18:46:33.185 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.185 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.185 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.185 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.185 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.185 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "diskprediction_local", 2024-04-26T18:46:33.185 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.185 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.185 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.185 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.185 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.185 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.185 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.186 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.186 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.186 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.186 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.186 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.186 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.186 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.186 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.186 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.186 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.186 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.186 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.186 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.186 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.186 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.186 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.187 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.187 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.187 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.187 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.187 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.187 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.187 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.187 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.187 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.187 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.187 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.187 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.187 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.187 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.188 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.188 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.188 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.188 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.188 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.188 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.188 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.188 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.188 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.188 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.188 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.188 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.188 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.188 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.188 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.188 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.189 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.189 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.189 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.189 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.189 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.189 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.189 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.189 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.189 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.189 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.189 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.189 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.189 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.189 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.189 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.190 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.190 INFO:teuthology.orchestra.run.smithi080.stdout: "predict_interval": { 2024-04-26T18:46:33.190 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "predict_interval", 2024-04-26T18:46:33.190 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.190 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.190 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.190 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "86400", 2024-04-26T18:46:33.190 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.190 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.190 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.190 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.190 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.190 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.190 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.191 INFO:teuthology.orchestra.run.smithi080.stdout: "predictor_model": { 2024-04-26T18:46:33.191 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "predictor_model", 2024-04-26T18:46:33.191 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.191 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.191 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.191 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "prophetstor", 2024-04-26T18:46:33.191 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.191 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.191 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.191 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.191 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.191 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.191 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.192 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-26T18:46:33.192 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-26T18:46:33.192 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.192 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.192 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.192 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-26T18:46:33.192 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.192 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.192 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.192 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.192 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.192 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.192 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.192 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.192 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.193 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "influx", 2024-04-26T18:46:33.193 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": false, 2024-04-26T18:46:33.193 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "influxdb python module not found", 2024-04-26T18:46:33.193 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.193 INFO:teuthology.orchestra.run.smithi080.stdout: "batch_size": { 2024-04-26T18:46:33.193 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "batch_size", 2024-04-26T18:46:33.193 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.193 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.193 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.193 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5000", 2024-04-26T18:46:33.193 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.193 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.193 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.193 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-26T18:46:33.193 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.194 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.194 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.194 INFO:teuthology.orchestra.run.smithi080.stdout: "database": { 2024-04-26T18:46:33.194 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "database", 2024-04-26T18:46:33.194 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.194 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.194 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.194 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "ceph", 2024-04-26T18:46:33.194 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.194 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.194 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.194 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-26T18:46:33.194 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.195 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.195 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.195 INFO:teuthology.orchestra.run.smithi080.stdout: "hostname": { 2024-04-26T18:46:33.195 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "hostname", 2024-04-26T18:46:33.195 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.195 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.195 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.195 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.195 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.195 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.195 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.195 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "InfluxDB server hostname", 2024-04-26T18:46:33.195 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.195 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.195 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.196 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-26T18:46:33.196 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-26T18:46:33.196 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.196 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.196 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.196 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "30", 2024-04-26T18:46:33.196 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "5", 2024-04-26T18:46:33.196 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.196 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.196 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-26T18:46:33.196 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.196 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.196 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.196 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.197 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.197 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.197 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.197 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.197 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.197 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.197 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.197 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.197 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.197 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.197 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.197 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.197 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.197 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.197 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.197 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.198 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.198 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.198 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.198 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.198 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.198 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.198 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.198 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.198 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.198 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.198 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.198 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.198 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.199 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.199 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.199 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.199 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.199 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.199 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.199 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.199 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.199 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.199 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.199 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.199 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.199 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.199 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.199 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.199 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.200 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.200 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.200 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.200 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.200 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.200 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.200 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.200 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.200 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.200 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.200 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.200 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.200 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.200 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.200 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.201 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.201 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.201 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.201 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.201 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.201 INFO:teuthology.orchestra.run.smithi080.stdout: "password": { 2024-04-26T18:46:33.201 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "password", 2024-04-26T18:46:33.201 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.201 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.201 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.201 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.201 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.201 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.201 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.201 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "password of InfluxDB server user", 2024-04-26T18:46:33.202 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.202 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.202 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.202 INFO:teuthology.orchestra.run.smithi080.stdout: "port": { 2024-04-26T18:46:33.202 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "port", 2024-04-26T18:46:33.202 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.202 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.202 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.202 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8086", 2024-04-26T18:46:33.202 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.202 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.202 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.202 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "InfluxDB server port", 2024-04-26T18:46:33.202 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.203 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.203 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.203 INFO:teuthology.orchestra.run.smithi080.stdout: "ssl": { 2024-04-26T18:46:33.203 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ssl", 2024-04-26T18:46:33.203 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.203 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.203 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.203 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "false", 2024-04-26T18:46:33.203 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.203 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.203 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.203 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-26T18:46:33.203 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.203 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.203 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.204 INFO:teuthology.orchestra.run.smithi080.stdout: "threads": { 2024-04-26T18:46:33.204 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "threads", 2024-04-26T18:46:33.204 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.204 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.204 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.204 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5", 2024-04-26T18:46:33.204 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1", 2024-04-26T18:46:33.204 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "32", 2024-04-26T18:46:33.204 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.204 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-26T18:46:33.204 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.204 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.204 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.204 INFO:teuthology.orchestra.run.smithi080.stdout: "username": { 2024-04-26T18:46:33.205 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "username", 2024-04-26T18:46:33.205 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.205 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.205 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.205 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.205 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.205 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.205 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.205 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "username of InfluxDB server user", 2024-04-26T18:46:33.205 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.205 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.205 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.205 INFO:teuthology.orchestra.run.smithi080.stdout: "verify_ssl": { 2024-04-26T18:46:33.205 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "verify_ssl", 2024-04-26T18:46:33.206 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.206 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.206 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.206 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "true", 2024-04-26T18:46:33.206 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.206 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.206 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.206 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-26T18:46:33.206 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.206 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.206 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.206 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.206 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.207 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "insights", 2024-04-26T18:46:33.207 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.207 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.207 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.207 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.207 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.207 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.207 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.207 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.207 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.207 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.207 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.207 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.207 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.208 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.208 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.208 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.208 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.208 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.208 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.208 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.208 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.208 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.208 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.208 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.208 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.208 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.209 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.209 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.209 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.209 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.209 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.209 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.209 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.209 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.209 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.209 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.209 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.209 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.209 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.209 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.210 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.210 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.210 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.210 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.210 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.210 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.210 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.210 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.210 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.210 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.210 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.210 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.210 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.210 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.210 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.210 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.211 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.211 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.211 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.211 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.211 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.211 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.211 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.211 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.211 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.211 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.211 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.211 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.211 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.211 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.212 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.212 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "iostat", 2024-04-26T18:46:33.212 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.212 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.212 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.212 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.212 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.212 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.212 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.212 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.212 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.212 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.212 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.213 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.213 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.213 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.213 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.213 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.213 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.213 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.213 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.213 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.213 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.213 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.213 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.213 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.213 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.213 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.214 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.214 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.214 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.214 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.214 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.214 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.214 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.214 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.214 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.214 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.214 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.214 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.214 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.214 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.215 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.215 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.215 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.215 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.215 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.215 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.215 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.215 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.215 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.215 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.215 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.215 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.215 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.215 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.215 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.215 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.216 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.216 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.216 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.216 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.216 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.216 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.216 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.216 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.216 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.216 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.216 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.216 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.216 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.216 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.217 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.217 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "k8sevents", 2024-04-26T18:46:33.217 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.217 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.217 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.217 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_event_retention_days": { 2024-04-26T18:46:33.217 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ceph_event_retention_days", 2024-04-26T18:46:33.217 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.217 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.217 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.217 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "7", 2024-04-26T18:46:33.217 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.217 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.218 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.218 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-26T18:46:33.218 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.218 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.218 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.218 INFO:teuthology.orchestra.run.smithi080.stdout: "config_check_secs": { 2024-04-26T18:46:33.218 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "config_check_secs", 2024-04-26T18:46:33.218 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.218 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.218 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.218 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-26T18:46:33.218 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "10", 2024-04-26T18:46:33.218 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.219 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.219 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-26T18:46:33.219 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.219 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.219 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.219 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.219 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.219 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.219 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.219 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.219 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.219 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.219 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.219 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.219 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.219 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.220 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.220 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.220 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.220 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.220 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.220 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.220 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.220 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.220 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.220 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.220 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.220 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.220 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.220 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.220 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.221 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.221 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.221 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.221 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.221 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.221 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.221 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.221 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.221 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.221 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.221 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.221 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.221 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.221 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.221 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.222 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.222 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.222 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.222 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.222 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.222 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.222 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.222 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.222 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.222 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.222 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.222 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.222 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.222 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.223 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.223 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.223 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.223 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.223 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.223 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.223 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.223 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.223 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.223 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.223 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.223 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.223 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.223 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "localpool", 2024-04-26T18:46:33.223 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.224 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.224 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.224 INFO:teuthology.orchestra.run.smithi080.stdout: "failure_domain": { 2024-04-26T18:46:33.224 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "failure_domain", 2024-04-26T18:46:33.224 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.224 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.224 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.224 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "host", 2024-04-26T18:46:33.224 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.224 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.224 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.224 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "failure domain for any created local pool", 2024-04-26T18:46:33.224 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-26T18:46:33.224 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.224 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.225 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.225 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.225 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.225 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.225 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.225 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.225 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.225 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.225 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.225 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.225 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.225 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.225 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.225 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.225 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.226 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.226 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.226 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.226 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.226 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.226 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.226 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.226 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.226 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.226 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.226 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.226 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.226 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.226 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.226 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.227 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.227 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.227 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.227 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.227 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.227 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.227 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.227 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.227 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.227 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.227 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.227 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.227 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.227 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.227 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.228 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.228 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.228 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.228 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.228 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.228 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.228 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.228 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.228 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.228 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.228 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.228 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.228 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.228 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.229 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.229 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.229 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.229 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.229 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.229 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.229 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.229 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": { 2024-04-26T18:46:33.229 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "min_size", 2024-04-26T18:46:33.229 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.229 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.229 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.229 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.229 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.229 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.230 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.230 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "default min_size for any created local pool", 2024-04-26T18:46:33.230 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-26T18:46:33.230 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.230 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.230 INFO:teuthology.orchestra.run.smithi080.stdout: "num_rep": { 2024-04-26T18:46:33.230 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "num_rep", 2024-04-26T18:46:33.230 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.230 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.230 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.230 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "3", 2024-04-26T18:46:33.230 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.230 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.230 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.231 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "default replica count for any created local pool", 2024-04-26T18:46:33.231 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.231 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.231 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.231 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": { 2024-04-26T18:46:33.231 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "pg_num", 2024-04-26T18:46:33.231 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.231 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.231 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.231 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "128", 2024-04-26T18:46:33.231 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.231 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.231 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.231 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "default pg_num for any created local pool", 2024-04-26T18:46:33.231 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.232 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.232 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.232 INFO:teuthology.orchestra.run.smithi080.stdout: "prefix": { 2024-04-26T18:46:33.232 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "prefix", 2024-04-26T18:46:33.232 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.232 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.232 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.232 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.232 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.232 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.232 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.232 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "name prefix for any created local pool", 2024-04-26T18:46:33.232 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.232 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.233 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.233 INFO:teuthology.orchestra.run.smithi080.stdout: "subtree": { 2024-04-26T18:46:33.233 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "subtree", 2024-04-26T18:46:33.233 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.233 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.233 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.233 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "rack", 2024-04-26T18:46:33.233 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.233 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.233 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.233 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-26T18:46:33.233 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-26T18:46:33.233 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.233 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.233 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.234 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.234 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mds_autoscaler", 2024-04-26T18:46:33.234 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.234 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.234 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.234 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.234 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.234 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.234 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.234 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.234 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.234 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.235 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.235 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.235 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.235 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.235 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.235 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.235 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.235 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.235 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.235 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.235 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.235 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.235 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.235 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.235 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.236 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.236 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.236 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.236 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.236 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.236 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.236 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.236 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.236 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.236 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.236 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.236 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.236 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.236 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.236 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.237 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.237 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.237 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.237 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.237 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.237 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.237 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.237 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.237 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.237 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.237 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.237 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.237 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.237 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.237 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.238 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.238 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.238 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.238 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.238 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.238 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.238 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.238 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.238 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.238 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.238 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.238 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.238 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.238 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.239 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.239 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.239 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mirroring", 2024-04-26T18:46:33.239 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.239 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.239 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.239 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.239 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.239 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.239 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.239 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.239 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.239 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.240 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.240 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.240 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.240 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.240 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.240 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.240 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.240 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.240 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.240 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.240 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.240 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.240 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.240 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.241 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.241 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.241 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.241 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.241 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.241 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.241 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.241 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.241 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.241 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.241 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.241 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.241 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.241 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.241 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.242 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.242 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.242 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.242 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.242 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.242 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.242 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.242 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.242 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.242 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.242 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.242 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.242 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.242 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.242 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.243 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.243 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.243 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.243 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.243 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.243 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.243 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.243 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.243 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.243 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.243 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.243 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.243 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.243 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.244 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.244 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.244 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.244 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "nfs", 2024-04-26T18:46:33.244 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.244 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.244 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.244 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.244 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.244 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.244 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.244 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.245 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.245 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.245 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.245 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.245 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.245 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.245 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.245 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.245 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.245 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.245 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.245 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.245 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.245 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.245 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.245 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.246 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.246 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.246 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.246 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.246 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.246 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.246 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.246 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.246 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.246 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.246 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.246 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.246 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.247 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.247 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.247 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.247 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.247 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.247 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.247 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.247 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.247 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.247 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.247 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.247 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.247 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.247 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.247 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.248 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.248 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.248 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.248 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.248 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.248 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.248 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.248 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.248 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.248 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.248 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.248 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.248 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.248 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.248 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.249 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.249 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.249 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.249 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.249 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "orchestrator", 2024-04-26T18:46:33.249 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.249 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.249 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.249 INFO:teuthology.orchestra.run.smithi080.stdout: "fail_fs": { 2024-04-26T18:46:33.249 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "fail_fs", 2024-04-26T18:46:33.249 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.249 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.249 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.250 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.250 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.250 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.250 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.250 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-26T18:46:33.250 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.250 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.250 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.250 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.250 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.250 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.250 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.250 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.250 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.251 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.251 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.251 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.251 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.251 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.251 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.251 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.251 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.251 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.251 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.251 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.251 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.251 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.251 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.251 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.252 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.252 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.252 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.252 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.252 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.252 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.252 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.252 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.252 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.252 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.252 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.252 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.252 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.252 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.252 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.253 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.253 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.253 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.253 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.253 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.253 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.253 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.253 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.253 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.253 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.253 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.253 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.253 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.253 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.253 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.253 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.255 INFO:teuthology.orchestra.run.smithi080.stdout: "orchestrator": { 2024-04-26T18:46:33.255 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "orchestrator", 2024-04-26T18:46:33.255 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.255 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.255 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.255 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.255 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.255 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.255 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.255 INFO:teuthology.orchestra.run.smithi080.stdout: "cephadm", 2024-04-26T18:46:33.255 INFO:teuthology.orchestra.run.smithi080.stdout: "rook", 2024-04-26T18:46:33.255 INFO:teuthology.orchestra.run.smithi080.stdout: "test_orchestrator" 2024-04-26T18:46:33.255 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.255 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Orchestrator backend", 2024-04-26T18:46:33.256 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.256 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.256 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.256 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.256 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.256 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "osd_perf_query", 2024-04-26T18:46:33.256 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.256 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.256 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.256 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.256 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.256 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.256 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.256 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.257 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.257 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.257 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.257 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.257 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.257 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.257 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.257 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.257 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.257 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.257 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.257 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.257 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.257 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.257 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.258 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.258 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.258 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.258 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.258 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.258 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.258 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.258 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.258 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.258 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.258 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.258 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.258 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.258 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.259 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.259 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.259 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.259 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.259 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.259 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.259 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.259 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.259 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.259 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.259 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.259 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.259 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.259 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.259 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.259 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.259 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.260 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.260 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.260 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.260 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.260 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.260 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.260 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.260 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.260 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.260 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.260 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.260 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.260 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.260 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.260 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.261 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.261 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.261 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "osd_support", 2024-04-26T18:46:33.261 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.261 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.261 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.261 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.261 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.261 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.261 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.261 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.261 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.261 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.261 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.262 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.262 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.262 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.262 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.262 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.262 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.262 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.262 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.262 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.262 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.262 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.262 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.262 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.262 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.263 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.263 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.263 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.263 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.263 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.263 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.263 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.263 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.263 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.263 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.263 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.263 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.263 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.263 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.263 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.264 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.264 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.264 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.264 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.264 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.264 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.264 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.264 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.264 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.264 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.264 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.264 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.264 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.264 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.264 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.264 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.265 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.265 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.265 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.265 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.265 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.265 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.265 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.265 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.265 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.265 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.265 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.265 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.265 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.265 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.265 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.266 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.266 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.266 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "pg_autoscaler", 2024-04-26T18:46:33.266 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.266 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.266 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.266 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.266 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.266 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.266 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.266 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.266 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.266 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.266 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.266 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.267 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.267 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.267 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.267 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.267 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.267 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.267 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.267 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.267 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.267 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.267 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.267 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.267 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.267 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.268 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.268 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.268 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.268 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.268 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.268 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.268 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.268 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.268 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.268 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.268 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.268 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.268 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.268 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.268 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.269 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.269 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.269 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.269 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.269 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.269 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.269 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.269 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.269 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.269 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.269 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.269 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.269 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.269 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.269 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.270 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.270 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.270 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.270 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.270 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.270 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.270 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.270 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.270 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.270 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.270 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.270 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.270 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.270 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-26T18:46:33.271 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-26T18:46:33.271 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.271 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.271 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.271 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-26T18:46:33.271 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.271 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.271 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.271 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.271 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.271 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.271 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.271 INFO:teuthology.orchestra.run.smithi080.stdout: "threshold": { 2024-04-26T18:46:33.271 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "threshold", 2024-04-26T18:46:33.271 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-26T18:46:33.271 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.272 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.272 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "3.0", 2024-04-26T18:46:33.272 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1.0", 2024-04-26T18:46:33.272 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.272 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.272 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "scaling threshold", 2024-04-26T18:46:33.272 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-26T18:46:33.272 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.272 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.272 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.272 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.272 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "progress", 2024-04-26T18:46:33.272 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.273 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.273 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.273 INFO:teuthology.orchestra.run.smithi080.stdout: "allow_pg_recovery_event": { 2024-04-26T18:46:33.273 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "allow_pg_recovery_event", 2024-04-26T18:46:33.273 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.273 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.273 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.273 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.273 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.273 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.273 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.273 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-26T18:46:33.273 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.273 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.273 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.273 INFO:teuthology.orchestra.run.smithi080.stdout: "enabled": { 2024-04-26T18:46:33.274 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "enabled", 2024-04-26T18:46:33.274 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.274 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.274 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.274 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.274 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.274 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.274 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.274 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.274 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.274 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.274 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.274 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.274 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.275 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.275 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.275 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.275 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.275 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.275 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.275 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.275 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.275 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.275 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.275 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.275 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.275 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.275 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.275 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.275 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.275 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.276 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.276 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.276 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.276 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.276 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.276 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.276 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.276 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.276 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.276 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.276 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.276 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.276 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.276 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.277 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.277 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.277 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.277 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.277 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.277 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.277 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.277 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.277 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.277 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.277 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.277 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.277 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.277 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.278 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.278 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.278 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.278 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.278 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.278 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.278 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.278 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.278 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.278 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.278 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.278 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.278 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.278 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.279 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.279 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.279 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.279 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.279 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.279 INFO:teuthology.orchestra.run.smithi080.stdout: "max_completed_events": { 2024-04-26T18:46:33.279 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_completed_events", 2024-04-26T18:46:33.279 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.279 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.279 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.279 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "50", 2024-04-26T18:46:33.279 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.279 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.279 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.279 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "number of past completed events to remember", 2024-04-26T18:46:33.280 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.280 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.280 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.280 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-26T18:46:33.280 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-26T18:46:33.280 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.280 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.280 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.280 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5", 2024-04-26T18:46:33.280 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.280 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.280 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.280 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how long the module is going to sleep", 2024-04-26T18:46:33.280 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.280 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.281 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.281 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.281 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.281 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.281 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "prometheus", 2024-04-26T18:46:33.281 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.281 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.281 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.281 INFO:teuthology.orchestra.run.smithi080.stdout: "cache": { 2024-04-26T18:46:33.281 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cache", 2024-04-26T18:46:33.281 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.281 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.281 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.281 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.281 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.282 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.282 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.282 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.282 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.282 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.282 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.282 INFO:teuthology.orchestra.run.smithi080.stdout: "exclude_perf_counters": { 2024-04-26T18:46:33.282 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "exclude_perf_counters", 2024-04-26T18:46:33.282 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.282 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.282 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.282 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.282 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.282 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.283 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.283 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-26T18:46:33.283 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-26T18:46:33.283 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.283 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.283 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.283 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.283 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.283 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.283 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.283 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.283 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.283 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.283 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.283 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.284 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.284 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.284 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.284 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.284 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.284 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.284 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.284 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.284 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.284 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.284 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.284 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.284 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.284 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.285 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.285 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.285 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.285 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.285 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.285 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.285 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.285 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.285 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.285 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.285 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.285 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.285 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.285 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.285 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.286 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.286 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.286 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.286 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.286 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.286 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.286 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.286 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.286 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.286 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.286 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.286 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.286 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.286 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.287 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.287 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.287 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.287 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.287 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.287 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.287 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.287 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.287 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.287 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.287 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.287 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.287 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.287 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.287 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_stats_pools": { 2024-04-26T18:46:33.287 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rbd_stats_pools", 2024-04-26T18:46:33.287 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.288 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.288 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.288 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.288 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.288 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.288 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.288 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.288 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.288 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.288 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.288 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-26T18:46:33.288 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-26T18:46:33.288 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.288 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.288 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.289 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "300", 2024-04-26T18:46:33.289 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.289 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.289 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.289 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.289 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.289 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.289 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.289 INFO:teuthology.orchestra.run.smithi080.stdout: "scrape_interval": { 2024-04-26T18:46:33.289 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "scrape_interval", 2024-04-26T18:46:33.289 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-26T18:46:33.289 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.289 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.289 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "15.0", 2024-04-26T18:46:33.290 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.290 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.290 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.290 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.290 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.290 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.290 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.290 INFO:teuthology.orchestra.run.smithi080.stdout: "server_addr": { 2024-04-26T18:46:33.290 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_addr", 2024-04-26T18:46:33.290 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.290 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.290 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.290 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "::", 2024-04-26T18:46:33.290 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.291 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.291 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.291 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-26T18:46:33.291 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.291 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.291 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.291 INFO:teuthology.orchestra.run.smithi080.stdout: "server_port": { 2024-04-26T18:46:33.291 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_port", 2024-04-26T18:46:33.291 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.291 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.291 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.291 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "9283", 2024-04-26T18:46:33.291 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.291 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.292 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.292 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-26T18:46:33.292 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.292 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.292 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.292 INFO:teuthology.orchestra.run.smithi080.stdout: "stale_cache_strategy": { 2024-04-26T18:46:33.292 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "stale_cache_strategy", 2024-04-26T18:46:33.292 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.292 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.292 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.292 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "log", 2024-04-26T18:46:33.292 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.292 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.292 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.293 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.293 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.293 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.293 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.293 INFO:teuthology.orchestra.run.smithi080.stdout: "standby_behaviour": { 2024-04-26T18:46:33.293 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "standby_behaviour", 2024-04-26T18:46:33.293 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.293 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.293 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.293 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "default", 2024-04-26T18:46:33.293 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.293 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.293 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.293 INFO:teuthology.orchestra.run.smithi080.stdout: "default", 2024-04-26T18:46:33.293 INFO:teuthology.orchestra.run.smithi080.stdout: "error" 2024-04-26T18:46:33.294 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.294 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.294 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.294 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.294 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.294 INFO:teuthology.orchestra.run.smithi080.stdout: "standby_error_status_code": { 2024-04-26T18:46:33.294 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "standby_error_status_code", 2024-04-26T18:46:33.294 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.294 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.294 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.294 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "500", 2024-04-26T18:46:33.294 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "400", 2024-04-26T18:46:33.294 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "599", 2024-04-26T18:46:33.295 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.295 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.295 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.295 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.295 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.295 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.295 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.295 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rbd_support", 2024-04-26T18:46:33.295 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.295 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.295 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.295 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.295 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.295 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.296 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.296 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.296 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.296 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.296 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.296 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.296 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.296 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.296 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.296 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.296 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.296 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.296 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.296 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.296 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.296 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.297 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.297 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.297 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.297 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.297 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.297 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.297 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.297 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.297 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.297 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.297 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.297 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.297 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.297 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.298 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.298 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.298 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.298 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.298 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.298 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.298 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.298 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.298 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.298 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.298 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.298 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.298 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.298 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.299 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.299 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.299 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.299 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.299 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.299 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.299 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.299 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.299 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.299 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.299 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.299 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.299 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.299 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.299 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.300 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.300 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.300 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.300 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.300 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.300 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.300 INFO:teuthology.orchestra.run.smithi080.stdout: "max_concurrent_snap_create": { 2024-04-26T18:46:33.300 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_concurrent_snap_create", 2024-04-26T18:46:33.300 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.300 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.300 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.300 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-26T18:46:33.300 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.300 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.300 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.300 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.301 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.301 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.301 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.301 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.301 INFO:teuthology.orchestra.run.smithi080.stdout: "mirror_snapshot_schedule": { 2024-04-26T18:46:33.301 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mirror_snapshot_schedule", 2024-04-26T18:46:33.301 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.301 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.301 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.301 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.301 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.301 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.301 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.301 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.301 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.301 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.302 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.302 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.302 INFO:teuthology.orchestra.run.smithi080.stdout: "trash_purge_schedule": { 2024-04-26T18:46:33.302 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "trash_purge_schedule", 2024-04-26T18:46:33.302 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.302 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.302 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.302 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.302 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.302 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.302 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.303 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.303 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.303 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.303 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.303 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.303 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.303 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.303 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "restful", 2024-04-26T18:46:33.303 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.303 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.303 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.303 INFO:teuthology.orchestra.run.smithi080.stdout: "enable_auth": { 2024-04-26T18:46:33.303 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "enable_auth", 2024-04-26T18:46:33.303 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.304 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.304 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.304 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.304 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.304 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.304 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.304 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.304 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.304 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.304 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.304 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.304 INFO:teuthology.orchestra.run.smithi080.stdout: "key_file": { 2024-04-26T18:46:33.304 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "key_file", 2024-04-26T18:46:33.304 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.304 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.305 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.305 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.305 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.305 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.305 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.305 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.305 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.305 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.305 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.305 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.305 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.305 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.305 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.305 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.305 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.305 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.305 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.306 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.306 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.306 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.306 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.306 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.306 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.306 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.306 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.306 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.306 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.306 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.306 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.306 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.307 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.307 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.307 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.307 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.307 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.307 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.307 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.307 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.307 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.307 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.307 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.307 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.307 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.308 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.308 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.308 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.308 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.308 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.308 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.308 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.308 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.308 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.308 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.308 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.308 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.308 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.308 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.308 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.309 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.309 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.309 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.309 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.309 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.309 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.309 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.309 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.309 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.309 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.309 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.309 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.309 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.309 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.310 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.310 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.310 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.310 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.310 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.310 INFO:teuthology.orchestra.run.smithi080.stdout: "server_addr": { 2024-04-26T18:46:33.310 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_addr", 2024-04-26T18:46:33.310 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.310 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.310 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.310 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.310 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.310 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.310 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.310 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.311 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.311 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.311 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.311 INFO:teuthology.orchestra.run.smithi080.stdout: "server_port": { 2024-04-26T18:46:33.311 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_port", 2024-04-26T18:46:33.311 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.311 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.311 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.311 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.311 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.311 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.311 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.311 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.311 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.312 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.312 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.312 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.312 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.312 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rgw", 2024-04-26T18:46:33.312 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.312 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.312 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.312 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.312 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.312 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.312 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.312 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.312 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.313 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.313 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.313 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.313 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.313 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.313 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.313 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.313 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.313 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.313 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.313 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.313 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.313 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.313 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.313 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.314 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.314 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.314 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.314 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.314 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.314 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.314 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.314 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.314 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.314 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.314 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.314 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.314 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.314 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.315 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.315 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.315 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.315 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.315 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.315 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.315 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.315 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.315 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.315 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.315 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.315 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.315 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.315 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.315 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.316 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.316 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.316 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.316 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.316 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.316 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.316 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.316 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.316 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.316 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.316 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.316 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.316 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.316 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.316 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.317 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.317 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.317 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.317 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.317 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rook", 2024-04-26T18:46:33.317 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.317 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.317 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.317 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.317 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.317 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.317 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.318 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.318 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.318 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.318 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.318 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.318 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.318 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.318 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.318 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.318 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.318 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.318 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.318 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.318 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.318 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.319 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.319 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.319 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.319 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.319 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.319 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.319 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.319 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.319 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.319 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.319 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.319 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.319 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.319 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.320 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.320 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.320 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.320 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.320 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.320 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.320 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.320 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.320 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.320 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.320 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.320 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.320 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.320 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.320 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.321 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.321 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.321 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.321 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.321 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.321 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.321 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.321 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.321 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.321 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.321 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.321 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.321 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.321 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.322 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.322 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.322 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.322 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.322 INFO:teuthology.orchestra.run.smithi080.stdout: "storage_class": { 2024-04-26T18:46:33.322 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "storage_class", 2024-04-26T18:46:33.322 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.322 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.322 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.322 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "local", 2024-04-26T18:46:33.322 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.322 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.322 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.322 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-26T18:46:33.322 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.323 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.323 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.323 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.323 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.323 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "selftest", 2024-04-26T18:46:33.323 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.323 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.323 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.323 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.323 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.323 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.323 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.323 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.323 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.324 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.324 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.324 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.324 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.324 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.324 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.324 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.324 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.324 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.324 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.324 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.324 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.324 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.324 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.324 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.325 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.325 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.325 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.325 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.325 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.325 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.325 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.325 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.325 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.325 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.325 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.325 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.325 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.326 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.326 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.326 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.326 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.326 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.326 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.326 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.326 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.326 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.326 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.326 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.326 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.326 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.326 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.327 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.327 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.327 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.327 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.327 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.327 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.327 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.327 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.327 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.327 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.327 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.327 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.327 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.327 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.327 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.327 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.328 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.328 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.328 INFO:teuthology.orchestra.run.smithi080.stdout: "roption1": { 2024-04-26T18:46:33.328 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "roption1", 2024-04-26T18:46:33.328 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.328 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.328 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.328 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.328 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.328 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.328 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.328 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.328 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.328 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.329 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.329 INFO:teuthology.orchestra.run.smithi080.stdout: "roption2": { 2024-04-26T18:46:33.329 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "roption2", 2024-04-26T18:46:33.329 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.329 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.329 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.329 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "xyz", 2024-04-26T18:46:33.329 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.329 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.329 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.329 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.329 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.329 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.329 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.330 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption1": { 2024-04-26T18:46:33.330 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption1", 2024-04-26T18:46:33.330 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.330 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.330 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.330 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.330 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.330 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.330 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.330 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.330 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.330 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.330 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.330 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption2": { 2024-04-26T18:46:33.331 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption2", 2024-04-26T18:46:33.331 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.331 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.331 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.331 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.331 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.331 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.331 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.331 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.331 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.331 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.331 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.331 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption3": { 2024-04-26T18:46:33.331 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption3", 2024-04-26T18:46:33.331 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-26T18:46:33.332 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.332 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.332 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.332 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.332 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.332 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.332 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.332 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.332 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.332 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.332 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption4": { 2024-04-26T18:46:33.332 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption4", 2024-04-26T18:46:33.332 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.332 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.333 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.333 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.333 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.333 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.333 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.333 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.333 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.333 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.333 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.333 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption5": { 2024-04-26T18:46:33.333 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption5", 2024-04-26T18:46:33.333 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.333 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.333 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.334 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.334 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.334 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.334 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.334 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.334 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.334 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.334 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.334 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption6": { 2024-04-26T18:46:33.334 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption6", 2024-04-26T18:46:33.334 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.334 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.334 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.334 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.334 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.334 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.335 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.335 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.335 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.335 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.335 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.335 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption7": { 2024-04-26T18:46:33.335 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption7", 2024-04-26T18:46:33.335 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.335 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.335 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.335 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.335 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1", 2024-04-26T18:46:33.335 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "42", 2024-04-26T18:46:33.335 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.335 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.336 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.336 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.336 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.336 INFO:teuthology.orchestra.run.smithi080.stdout: "testkey": { 2024-04-26T18:46:33.336 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "testkey", 2024-04-26T18:46:33.336 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.336 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.336 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.336 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.336 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.336 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.336 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.336 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.336 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.336 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.337 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.337 INFO:teuthology.orchestra.run.smithi080.stdout: "testlkey": { 2024-04-26T18:46:33.337 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "testlkey", 2024-04-26T18:46:33.337 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.337 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.337 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.337 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.337 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.337 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.337 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.337 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.337 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.337 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.337 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.338 INFO:teuthology.orchestra.run.smithi080.stdout: "testnewline": { 2024-04-26T18:46:33.338 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "testnewline", 2024-04-26T18:46:33.338 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.338 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.338 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.338 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.338 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.338 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.338 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.338 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.338 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.338 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.338 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.338 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.338 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.339 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "snap_schedule", 2024-04-26T18:46:33.339 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.339 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.339 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.339 INFO:teuthology.orchestra.run.smithi080.stdout: "allow_m_granularity": { 2024-04-26T18:46:33.339 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "allow_m_granularity", 2024-04-26T18:46:33.339 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.339 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.339 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.339 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.339 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.339 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.339 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.340 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "allow minute scheduled snapshots", 2024-04-26T18:46:33.340 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.340 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.340 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.340 INFO:teuthology.orchestra.run.smithi080.stdout: "dump_on_update": { 2024-04-26T18:46:33.340 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "dump_on_update", 2024-04-26T18:46:33.340 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.340 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.340 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.340 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.340 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.340 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.340 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.340 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "dump database to debug log on update", 2024-04-26T18:46:33.341 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.341 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.341 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.341 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.341 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.341 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.341 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.341 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.341 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.341 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.341 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.341 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.341 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.341 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.342 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.342 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.342 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.342 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.342 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.342 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.342 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.342 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.342 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.342 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.342 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.342 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.342 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.342 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.343 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.343 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.343 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.343 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.343 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.343 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.343 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.343 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.343 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.343 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.343 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.343 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.343 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.343 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.344 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.344 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.344 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.344 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.344 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.344 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.344 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.344 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.344 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.344 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.344 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.344 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.344 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.344 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.344 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.344 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.345 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.345 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.345 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.345 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.345 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.345 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.345 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.345 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.345 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.345 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.345 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.345 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.345 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.345 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "stats", 2024-04-26T18:46:33.346 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.346 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.346 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.346 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.346 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.346 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.346 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.346 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.346 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.346 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.346 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.346 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.346 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.346 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.346 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.346 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.347 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.347 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.347 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.347 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.347 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.347 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.347 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.347 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.347 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.347 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.347 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.347 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.347 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.347 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.348 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.348 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.348 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.348 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.348 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.348 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.348 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.348 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.348 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.348 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.348 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.348 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.348 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.348 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.348 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.348 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.349 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.349 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.349 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.349 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.349 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.349 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.349 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.349 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.349 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.349 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.349 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.349 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.349 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.349 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.350 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.350 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.350 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.350 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.350 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.350 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.350 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.350 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.350 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.350 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.350 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.350 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "status", 2024-04-26T18:46:33.350 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.350 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.351 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.351 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.351 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.351 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.351 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.351 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.351 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.351 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.351 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.351 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.351 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.351 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.351 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.351 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.351 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.352 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.352 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.352 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.352 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.352 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.352 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.352 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.352 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.352 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.352 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.352 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.352 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.352 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.352 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.352 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.352 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.353 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.353 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.353 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.353 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.353 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.353 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.353 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.353 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.353 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.353 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.353 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.353 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.353 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.353 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.354 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.354 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.354 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.354 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.354 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.354 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.354 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.354 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.354 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.354 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.354 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.354 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.354 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.354 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.354 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.355 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.355 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.355 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.355 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.355 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.355 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.355 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.355 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.355 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.355 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "telegraf", 2024-04-26T18:46:33.355 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.355 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.355 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.356 INFO:teuthology.orchestra.run.smithi080.stdout: "address": { 2024-04-26T18:46:33.356 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "address", 2024-04-26T18:46:33.356 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.356 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.356 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.356 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-26T18:46:33.356 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.356 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.356 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.356 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.356 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.356 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.356 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.356 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-26T18:46:33.356 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-26T18:46:33.357 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.357 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.357 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.357 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "15", 2024-04-26T18:46:33.357 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.357 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.357 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.357 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.357 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.357 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.357 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.357 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.357 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.357 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.357 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.358 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.358 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.358 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.358 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.358 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.358 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.358 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.358 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.358 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.358 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.358 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.358 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.358 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.358 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.358 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.359 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.359 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.359 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.359 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.359 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.359 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.359 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.359 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.359 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.359 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.359 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.359 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.359 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.359 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.360 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.360 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.360 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.360 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.360 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.360 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.360 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.360 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.360 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.360 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.360 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.360 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.360 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.360 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.360 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.360 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.360 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.361 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.361 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.361 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.361 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.361 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.361 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.361 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.361 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.361 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.361 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.361 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.361 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.361 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.361 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.361 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.362 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.362 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.362 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.362 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.362 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "telemetry", 2024-04-26T18:46:33.362 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.362 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.362 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.362 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_basic": { 2024-04-26T18:46:33.362 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_basic", 2024-04-26T18:46:33.362 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.362 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.362 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.362 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.362 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.363 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.363 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.363 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-26T18:46:33.363 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.363 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.363 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.363 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_crash": { 2024-04-26T18:46:33.363 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_crash", 2024-04-26T18:46:33.363 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.363 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.363 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.363 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.363 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.363 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.363 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.364 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-26T18:46:33.364 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.364 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.364 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.364 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_device": { 2024-04-26T18:46:33.364 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_device", 2024-04-26T18:46:33.364 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.364 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.364 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.364 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.364 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.364 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.364 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.364 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-26T18:46:33.364 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.365 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.365 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.365 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_ident": { 2024-04-26T18:46:33.365 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_ident", 2024-04-26T18:46:33.365 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.365 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.365 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.365 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.365 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.365 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.365 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.365 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-26T18:46:33.365 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.365 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.366 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.366 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_perf": { 2024-04-26T18:46:33.366 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_perf", 2024-04-26T18:46:33.366 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.366 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.366 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.366 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.366 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.366 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.366 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.366 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-26T18:46:33.366 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.366 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.366 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.367 INFO:teuthology.orchestra.run.smithi080.stdout: "contact": { 2024-04-26T18:46:33.367 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "contact", 2024-04-26T18:46:33.367 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.367 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.367 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.367 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.367 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.367 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.367 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.367 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.367 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.367 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.367 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.367 INFO:teuthology.orchestra.run.smithi080.stdout: "description": { 2024-04-26T18:46:33.367 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "description", 2024-04-26T18:46:33.368 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.368 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.368 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.368 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.368 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.368 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.368 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.368 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.368 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.368 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.368 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.368 INFO:teuthology.orchestra.run.smithi080.stdout: "device_url": { 2024-04-26T18:46:33.368 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "device_url", 2024-04-26T18:46:33.368 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.368 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.369 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.369 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-26T18:46:33.369 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.369 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.369 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.369 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.369 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.369 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.369 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.369 INFO:teuthology.orchestra.run.smithi080.stdout: "enabled": { 2024-04-26T18:46:33.369 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "enabled", 2024-04-26T18:46:33.369 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.369 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.369 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.370 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.370 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.370 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.370 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.370 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.370 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.370 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.370 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.370 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-26T18:46:33.370 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-26T18:46:33.370 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.370 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.370 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.370 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "24", 2024-04-26T18:46:33.370 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "8", 2024-04-26T18:46:33.371 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.371 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.371 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.371 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.371 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.371 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.371 INFO:teuthology.orchestra.run.smithi080.stdout: "last_opt_revision": { 2024-04-26T18:46:33.371 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "last_opt_revision", 2024-04-26T18:46:33.371 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.371 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.371 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.371 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "1", 2024-04-26T18:46:33.371 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.371 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.371 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.372 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.372 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.372 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.372 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.372 INFO:teuthology.orchestra.run.smithi080.stdout: "leaderboard": { 2024-04-26T18:46:33.372 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "leaderboard", 2024-04-26T18:46:33.372 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.372 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.372 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.372 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.372 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.372 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.372 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.372 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.372 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.373 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.373 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.373 INFO:teuthology.orchestra.run.smithi080.stdout: "leaderboard_description": { 2024-04-26T18:46:33.373 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "leaderboard_description", 2024-04-26T18:46:33.373 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.373 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.373 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.373 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.373 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.373 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.373 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.373 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.373 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.373 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.373 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.374 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.374 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.374 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.374 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.374 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.374 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.374 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.374 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.374 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.374 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.374 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.374 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.374 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.374 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.375 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.375 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.375 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.375 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.375 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.375 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.375 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.375 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.375 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.375 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.375 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.375 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.375 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.375 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.375 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.376 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.376 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.376 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.376 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.376 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.376 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.376 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.376 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.376 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.376 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.376 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.376 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.376 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.376 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.376 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.377 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.377 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.377 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.377 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.377 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.377 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.377 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.377 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.377 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.377 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.377 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.377 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.377 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.377 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.378 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.378 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.378 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.378 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.378 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.378 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.378 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.378 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.378 INFO:teuthology.orchestra.run.smithi080.stdout: "organization": { 2024-04-26T18:46:33.378 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "organization", 2024-04-26T18:46:33.378 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.378 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.378 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.378 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.378 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.379 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.379 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.379 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.379 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.379 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.379 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.379 INFO:teuthology.orchestra.run.smithi080.stdout: "proxy": { 2024-04-26T18:46:33.379 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "proxy", 2024-04-26T18:46:33.379 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.379 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.379 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.379 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.379 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.379 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.379 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.380 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.380 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.380 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.380 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.380 INFO:teuthology.orchestra.run.smithi080.stdout: "url": { 2024-04-26T18:46:33.380 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "url", 2024-04-26T18:46:33.380 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.380 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.380 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.380 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-26T18:46:33.380 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.380 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.380 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.380 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.381 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.381 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.381 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.381 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.381 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.381 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "test_orchestrator", 2024-04-26T18:46:33.381 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.381 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.381 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.381 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.381 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.381 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.381 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.382 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.382 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.382 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.382 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.382 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.382 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.382 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.382 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.382 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.382 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.382 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.382 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.382 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.382 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.382 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.383 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.383 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.383 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.383 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.383 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.383 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.383 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.383 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.383 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.383 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.383 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.383 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.383 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.383 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.384 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.384 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.384 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.384 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.384 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.384 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.384 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.384 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.384 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.384 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.384 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.384 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.384 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.384 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.385 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.385 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.385 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.385 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.385 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.385 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.385 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.385 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.385 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.385 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.385 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.385 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.385 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.385 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.386 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.386 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.386 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.386 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.386 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.386 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.386 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.386 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "volumes", 2024-04-26T18:46:33.386 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.386 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.386 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.386 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.387 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.387 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.387 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.387 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.387 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.387 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.387 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.387 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.387 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.387 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.387 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.387 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.387 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.387 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.387 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.388 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.388 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.388 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.388 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.388 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.388 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.388 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.388 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.388 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.388 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.388 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.388 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.388 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.388 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.389 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.389 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.389 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.389 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.389 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.389 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.389 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.389 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.389 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.389 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.389 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.389 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.389 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.389 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.389 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.390 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.390 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.390 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.390 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.390 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.390 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.390 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.390 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.390 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.390 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.390 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.390 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.391 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.391 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.391 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.391 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.391 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.391 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.391 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.391 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.391 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.391 INFO:teuthology.orchestra.run.smithi080.stdout: "max_concurrent_clones": { 2024-04-26T18:46:33.391 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_concurrent_clones", 2024-04-26T18:46:33.391 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.391 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.391 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.392 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "4", 2024-04-26T18:46:33.392 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.392 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.392 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.392 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-26T18:46:33.392 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.392 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.392 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.392 INFO:teuthology.orchestra.run.smithi080.stdout: "periodic_async_work": { 2024-04-26T18:46:33.392 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "periodic_async_work", 2024-04-26T18:46:33.392 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.392 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.392 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.392 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.393 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.393 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.393 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.393 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Periodically check for async work", 2024-04-26T18:46:33.393 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.393 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.393 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.393 INFO:teuthology.orchestra.run.smithi080.stdout: "snapshot_clone_delay": { 2024-04-26T18:46:33.393 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "snapshot_clone_delay", 2024-04-26T18:46:33.393 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.393 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.393 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.393 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-26T18:46:33.393 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.394 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.394 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.394 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-26T18:46:33.394 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.394 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.394 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.394 INFO:teuthology.orchestra.run.smithi080.stdout: "snapshot_clone_no_wait": { 2024-04-26T18:46:33.394 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "snapshot_clone_no_wait", 2024-04-26T18:46:33.394 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.394 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.394 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.394 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.394 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.394 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.395 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.395 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-26T18:46:33.395 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.395 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.395 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.395 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.395 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.395 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "zabbix", 2024-04-26T18:46:33.395 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.395 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.395 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.395 INFO:teuthology.orchestra.run.smithi080.stdout: "discovery_interval": { 2024-04-26T18:46:33.396 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "discovery_interval", 2024-04-26T18:46:33.396 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-26T18:46:33.396 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.396 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.396 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "100", 2024-04-26T18:46:33.396 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.396 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.396 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.396 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.396 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.396 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.396 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.396 INFO:teuthology.orchestra.run.smithi080.stdout: "identifier": { 2024-04-26T18:46:33.396 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "identifier", 2024-04-26T18:46:33.396 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.397 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.397 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.397 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.397 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.397 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.397 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.397 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.397 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.397 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.397 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.397 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-26T18:46:33.397 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-26T18:46:33.397 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.397 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.397 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.397 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-26T18:46:33.398 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.398 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.398 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.398 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.398 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.398 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.398 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.398 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.398 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.398 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.398 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.398 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.398 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.398 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.399 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.399 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.399 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.399 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.399 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.399 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.399 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.399 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.399 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.399 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.399 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.399 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.399 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.399 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.400 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.400 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.400 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.400 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.400 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.400 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.400 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.400 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.400 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.400 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.400 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.400 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.400 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.401 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.401 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.401 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.401 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.401 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.401 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.401 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.401 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.401 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.401 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.401 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.401 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.401 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.401 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.401 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.402 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.402 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.402 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.402 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.402 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.402 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.402 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.402 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.402 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.402 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.402 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.402 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.402 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.402 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.402 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.403 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.403 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.403 INFO:teuthology.orchestra.run.smithi080.stdout: "zabbix_host": { 2024-04-26T18:46:33.403 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "zabbix_host", 2024-04-26T18:46:33.403 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.403 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.403 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.403 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.403 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.403 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.403 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.403 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.403 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.404 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.404 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.404 INFO:teuthology.orchestra.run.smithi080.stdout: "zabbix_port": { 2024-04-26T18:46:33.404 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "zabbix_port", 2024-04-26T18:46:33.404 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.404 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.404 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.404 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10051", 2024-04-26T18:46:33.404 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.404 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.404 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.404 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.404 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.404 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.405 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.405 INFO:teuthology.orchestra.run.smithi080.stdout: "zabbix_sender": { 2024-04-26T18:46:33.405 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "zabbix_sender", 2024-04-26T18:46:33.405 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.405 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.405 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.405 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-26T18:46:33.405 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.405 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.405 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.405 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.405 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.405 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.405 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.406 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.406 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.406 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.406 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-26T18:46:33.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.406 INFO:teuthology.orchestra.run.smithi080.stdout: "gid": 24785, 2024-04-26T18:46:33.406 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "y", 2024-04-26T18:46:33.406 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_features": 4540701547738038271, 2024-04-26T18:46:33.406 INFO:teuthology.orchestra.run.smithi080.stdout: "available_modules": [ 2024-04-26T18:46:33.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.406 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "alerts", 2024-04-26T18:46:33.406 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.406 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.407 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.407 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-26T18:46:33.407 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-26T18:46:33.407 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.407 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.407 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.407 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-26T18:46:33.407 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.407 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.407 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.407 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "How frequently to reexamine health status", 2024-04-26T18:46:33.407 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.407 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.407 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.408 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.408 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.408 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.408 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.408 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.408 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.408 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.408 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.408 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.408 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.408 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.408 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.408 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.408 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.409 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.409 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.409 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.409 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.409 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.409 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.409 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.409 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.409 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.409 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.409 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.409 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.409 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.410 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.410 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.410 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.410 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.410 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.410 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.410 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.410 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.410 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.410 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.410 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.410 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.410 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.410 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.411 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.411 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.411 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.411 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.411 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.411 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.411 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.411 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.411 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.411 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.411 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.411 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.411 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.412 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.412 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.412 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.412 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.412 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.412 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.412 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.412 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.412 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.412 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.412 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.412 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.412 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_destination": { 2024-04-26T18:46:33.412 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_destination", 2024-04-26T18:46:33.413 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.413 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.413 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.413 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.413 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.413 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.413 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.413 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Email address to send alerts to", 2024-04-26T18:46:33.413 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.413 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.413 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.413 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_from_name": { 2024-04-26T18:46:33.413 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_from_name", 2024-04-26T18:46:33.413 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.414 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.414 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.414 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "Ceph", 2024-04-26T18:46:33.414 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.414 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.414 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.414 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Email From: name", 2024-04-26T18:46:33.414 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.414 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.414 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.414 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_host": { 2024-04-26T18:46:33.414 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_host", 2024-04-26T18:46:33.414 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.414 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.415 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.415 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.415 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.415 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.415 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.415 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "SMTP server", 2024-04-26T18:46:33.415 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.415 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.415 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.415 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_password": { 2024-04-26T18:46:33.415 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_password", 2024-04-26T18:46:33.415 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.415 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.415 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.415 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.416 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.416 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.416 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.416 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Password to authenticate with", 2024-04-26T18:46:33.416 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.416 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.416 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.416 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_port": { 2024-04-26T18:46:33.416 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_port", 2024-04-26T18:46:33.416 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.416 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.416 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.416 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "465", 2024-04-26T18:46:33.417 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.417 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.417 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.417 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "SMTP port", 2024-04-26T18:46:33.417 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.417 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.417 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.417 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_sender": { 2024-04-26T18:46:33.417 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_sender", 2024-04-26T18:46:33.417 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.417 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.417 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.417 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.418 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.418 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.418 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.418 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "SMTP envelope sender", 2024-04-26T18:46:33.418 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.418 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.418 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.418 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_ssl": { 2024-04-26T18:46:33.418 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_ssl", 2024-04-26T18:46:33.418 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.418 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.418 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.418 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.418 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.419 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.419 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.419 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-26T18:46:33.419 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.419 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.419 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.419 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_user": { 2024-04-26T18:46:33.419 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_user", 2024-04-26T18:46:33.419 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.419 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.419 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.419 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.419 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.419 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.419 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.420 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "User to authenticate as", 2024-04-26T18:46:33.420 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.420 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.420 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.420 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.420 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.420 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "balancer", 2024-04-26T18:46:33.420 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.420 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.420 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.420 INFO:teuthology.orchestra.run.smithi080.stdout: "active": { 2024-04-26T18:46:33.420 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "active", 2024-04-26T18:46:33.420 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.421 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.421 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.421 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.421 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.421 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.421 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.421 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "automatically balance PGs across cluster", 2024-04-26T18:46:33.421 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.421 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.421 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.421 INFO:teuthology.orchestra.run.smithi080.stdout: "begin_time": { 2024-04-26T18:46:33.421 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "begin_time", 2024-04-26T18:46:33.421 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.421 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.421 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.422 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0000", 2024-04-26T18:46:33.422 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.422 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.422 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.422 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "beginning time of day to automatically balance", 2024-04-26T18:46:33.422 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-26T18:46:33.422 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.422 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.422 INFO:teuthology.orchestra.run.smithi080.stdout: "begin_weekday": { 2024-04-26T18:46:33.422 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "begin_weekday", 2024-04-26T18:46:33.422 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-26T18:46:33.422 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.422 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.422 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-26T18:46:33.423 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "0", 2024-04-26T18:46:33.423 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "6", 2024-04-26T18:46:33.423 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.423 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-26T18:46:33.423 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-26T18:46:33.423 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.423 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.423 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_compat_max_iterations": { 2024-04-26T18:46:33.423 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crush_compat_max_iterations", 2024-04-26T18:46:33.423 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-26T18:46:33.423 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.423 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.423 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "25", 2024-04-26T18:46:33.423 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1", 2024-04-26T18:46:33.423 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "250", 2024-04-26T18:46:33.424 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.424 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-26T18:46:33.424 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.424 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.424 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.424 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_compat_metrics": { 2024-04-26T18:46:33.424 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crush_compat_metrics", 2024-04-26T18:46:33.424 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.424 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.424 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.424 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "pgs,objects,bytes", 2024-04-26T18:46:33.424 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.424 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.424 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.424 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-26T18:46:33.424 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-26T18:46:33.425 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.425 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.425 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_compat_step": { 2024-04-26T18:46:33.425 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crush_compat_step", 2024-04-26T18:46:33.425 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-26T18:46:33.425 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.425 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.425 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0.5", 2024-04-26T18:46:33.425 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "0.001", 2024-04-26T18:46:33.425 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "0.999", 2024-04-26T18:46:33.425 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.425 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "aggressiveness of optimization", 2024-04-26T18:46:33.425 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-26T18:46:33.425 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.425 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.426 INFO:teuthology.orchestra.run.smithi080.stdout: "end_time": { 2024-04-26T18:46:33.426 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "end_time", 2024-04-26T18:46:33.426 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.426 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.426 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.426 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "2359", 2024-04-26T18:46:33.426 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.426 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.426 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.426 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "ending time of day to automatically balance", 2024-04-26T18:46:33.426 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-26T18:46:33.426 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.426 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.427 INFO:teuthology.orchestra.run.smithi080.stdout: "end_weekday": { 2024-04-26T18:46:33.427 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "end_weekday", 2024-04-26T18:46:33.427 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-26T18:46:33.427 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.427 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.427 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-26T18:46:33.427 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "0", 2024-04-26T18:46:33.427 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "6", 2024-04-26T18:46:33.427 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.427 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-26T18:46:33.427 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-26T18:46:33.427 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.427 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.427 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.428 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.428 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.428 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.428 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.428 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.428 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.428 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.428 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.428 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.428 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.428 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.428 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.428 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.428 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.428 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.428 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.428 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.429 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.429 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.429 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.429 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.429 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.429 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.429 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.429 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.429 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.429 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.429 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.429 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.429 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.429 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.429 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.430 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.430 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.430 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.430 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.430 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.430 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.430 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.430 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.430 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.430 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.430 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.430 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.430 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.430 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.431 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.431 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.431 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.431 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.431 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.431 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.431 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.431 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.431 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.431 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.431 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.431 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.431 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.431 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.431 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.432 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.432 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.432 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.432 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.432 INFO:teuthology.orchestra.run.smithi080.stdout: "min_score": { 2024-04-26T18:46:33.432 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "min_score", 2024-04-26T18:46:33.432 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-26T18:46:33.432 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.432 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.432 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-26T18:46:33.432 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.432 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.432 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.432 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-26T18:46:33.432 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.433 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.433 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.433 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": { 2024-04-26T18:46:33.433 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mode", 2024-04-26T18:46:33.433 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.433 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.433 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.433 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "upmap", 2024-04-26T18:46:33.433 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.433 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.433 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.433 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-compat", 2024-04-26T18:46:33.433 INFO:teuthology.orchestra.run.smithi080.stdout: "none", 2024-04-26T18:46:33.433 INFO:teuthology.orchestra.run.smithi080.stdout: "read", 2024-04-26T18:46:33.433 INFO:teuthology.orchestra.run.smithi080.stdout: "upmap", 2024-04-26T18:46:33.434 INFO:teuthology.orchestra.run.smithi080.stdout: "upmap-read" 2024-04-26T18:46:33.434 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.434 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Balancer mode", 2024-04-26T18:46:33.434 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.434 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.434 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.434 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_ids": { 2024-04-26T18:46:33.434 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "pool_ids", 2024-04-26T18:46:33.434 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.434 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.434 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.434 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.434 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.434 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.434 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.435 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-26T18:46:33.435 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.435 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.435 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.435 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-26T18:46:33.435 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-26T18:46:33.435 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.435 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.435 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.435 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-26T18:46:33.435 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.435 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.435 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.435 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-26T18:46:33.435 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.436 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.436 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.436 INFO:teuthology.orchestra.run.smithi080.stdout: "upmap_max_deviation": { 2024-04-26T18:46:33.436 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "upmap_max_deviation", 2024-04-26T18:46:33.436 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.436 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.436 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.436 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5", 2024-04-26T18:46:33.436 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1", 2024-04-26T18:46:33.436 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.436 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.436 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-26T18:46:33.436 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-26T18:46:33.436 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.436 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.437 INFO:teuthology.orchestra.run.smithi080.stdout: "upmap_max_optimizations": { 2024-04-26T18:46:33.437 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "upmap_max_optimizations", 2024-04-26T18:46:33.437 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-26T18:46:33.437 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.437 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.437 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-26T18:46:33.437 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.437 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.437 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.437 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-26T18:46:33.437 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.437 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.437 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.437 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.437 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.438 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cephadm", 2024-04-26T18:46:33.438 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.438 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.438 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.438 INFO:teuthology.orchestra.run.smithi080.stdout: "agent_down_multiplier": { 2024-04-26T18:46:33.438 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "agent_down_multiplier", 2024-04-26T18:46:33.438 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-26T18:46:33.438 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.438 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.438 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "3.0", 2024-04-26T18:46:33.438 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.438 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.438 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.439 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-26T18:46:33.439 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.439 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.439 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.439 INFO:teuthology.orchestra.run.smithi080.stdout: "agent_refresh_rate": { 2024-04-26T18:46:33.439 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "agent_refresh_rate", 2024-04-26T18:46:33.439 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.439 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.439 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.439 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "20", 2024-04-26T18:46:33.439 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.439 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.439 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.439 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-26T18:46:33.440 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.440 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.440 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.440 INFO:teuthology.orchestra.run.smithi080.stdout: "agent_starting_port": { 2024-04-26T18:46:33.440 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "agent_starting_port", 2024-04-26T18:46:33.440 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.440 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.440 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.440 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "4721", 2024-04-26T18:46:33.440 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.440 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.440 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.440 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-26T18:46:33.440 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.440 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.441 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.441 INFO:teuthology.orchestra.run.smithi080.stdout: "allow_ptrace": { 2024-04-26T18:46:33.441 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "allow_ptrace", 2024-04-26T18:46:33.441 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.441 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.441 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.441 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.441 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.441 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.441 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.441 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-26T18:46:33.441 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-26T18:46:33.441 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.441 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.442 INFO:teuthology.orchestra.run.smithi080.stdout: "autotune_interval": { 2024-04-26T18:46:33.442 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "autotune_interval", 2024-04-26T18:46:33.442 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.442 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.442 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.442 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-26T18:46:33.442 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.442 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.442 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.442 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-26T18:46:33.442 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.442 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.442 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.443 INFO:teuthology.orchestra.run.smithi080.stdout: "autotune_memory_target_ratio": { 2024-04-26T18:46:33.443 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "autotune_memory_target_ratio", 2024-04-26T18:46:33.443 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-26T18:46:33.443 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.443 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.443 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0.7", 2024-04-26T18:46:33.443 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.443 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.443 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.443 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-26T18:46:33.443 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.443 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.443 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.443 INFO:teuthology.orchestra.run.smithi080.stdout: "cephadm_log_destination": { 2024-04-26T18:46:33.444 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cephadm_log_destination", 2024-04-26T18:46:33.444 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.444 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.444 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.444 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.444 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.444 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.444 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.444 INFO:teuthology.orchestra.run.smithi080.stdout: "file", 2024-04-26T18:46:33.444 INFO:teuthology.orchestra.run.smithi080.stdout: "file,syslog", 2024-04-26T18:46:33.444 INFO:teuthology.orchestra.run.smithi080.stdout: "syslog" 2024-04-26T18:46:33.444 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.444 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-26T18:46:33.444 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.444 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.444 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.445 INFO:teuthology.orchestra.run.smithi080.stdout: "cgroups_split": { 2024-04-26T18:46:33.445 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cgroups_split", 2024-04-26T18:46:33.445 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.445 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.445 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.445 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.445 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.445 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.445 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.445 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-26T18:46:33.445 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.445 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.445 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.445 INFO:teuthology.orchestra.run.smithi080.stdout: "config_checks_enabled": { 2024-04-26T18:46:33.446 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "config_checks_enabled", 2024-04-26T18:46:33.446 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.446 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.446 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.446 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.446 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.446 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.446 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.446 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-26T18:46:33.446 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.446 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.446 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.446 INFO:teuthology.orchestra.run.smithi080.stdout: "config_dashboard": { 2024-04-26T18:46:33.447 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "config_dashboard", 2024-04-26T18:46:33.447 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.447 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.447 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.447 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.447 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.447 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.447 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.447 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-26T18:46:33.447 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.447 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.447 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.447 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_alertmanager": { 2024-04-26T18:46:33.447 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_alertmanager", 2024-04-26T18:46:33.447 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.448 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.448 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.448 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-26T18:46:33.448 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.448 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.448 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.448 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Prometheus container image", 2024-04-26T18:46:33.448 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.448 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.448 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.448 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_base": { 2024-04-26T18:46:33.448 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_base", 2024-04-26T18:46:33.448 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.448 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.448 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.449 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-26T18:46:33.449 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.449 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.449 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.449 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Container image name, without the tag", 2024-04-26T18:46:33.449 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.449 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.449 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.449 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_elasticsearch": { 2024-04-26T18:46:33.449 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_elasticsearch", 2024-04-26T18:46:33.449 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.449 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.449 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.449 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-26T18:46:33.449 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.450 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.450 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.450 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "elasticsearch container image", 2024-04-26T18:46:33.450 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.450 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.450 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.450 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_grafana": { 2024-04-26T18:46:33.450 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_grafana", 2024-04-26T18:46:33.450 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.450 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.450 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.450 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-26T18:46:33.450 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.451 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.451 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.451 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Prometheus container image", 2024-04-26T18:46:33.451 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.451 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.451 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.451 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_haproxy": { 2024-04-26T18:46:33.451 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_haproxy", 2024-04-26T18:46:33.451 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.451 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.451 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.451 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-26T18:46:33.451 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.451 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.452 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.452 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "HAproxy container image", 2024-04-26T18:46:33.452 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.452 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.452 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.452 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_jaeger_agent": { 2024-04-26T18:46:33.452 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_jaeger_agent", 2024-04-26T18:46:33.452 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.452 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.452 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.452 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-26T18:46:33.452 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.452 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.452 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.453 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Jaeger agent container image", 2024-04-26T18:46:33.453 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.453 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.453 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.453 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_jaeger_collector": { 2024-04-26T18:46:33.453 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_jaeger_collector", 2024-04-26T18:46:33.453 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.453 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.453 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.453 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-26T18:46:33.453 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.453 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.453 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.453 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Jaeger collector container image", 2024-04-26T18:46:33.453 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.454 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.454 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.454 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_jaeger_query": { 2024-04-26T18:46:33.454 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_jaeger_query", 2024-04-26T18:46:33.454 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.454 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.454 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.454 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-26T18:46:33.454 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.454 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.454 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.454 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Jaeger query container image", 2024-04-26T18:46:33.454 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.454 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.455 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.455 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_keepalived": { 2024-04-26T18:46:33.455 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_keepalived", 2024-04-26T18:46:33.455 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.455 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.455 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.455 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-26T18:46:33.455 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.455 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.455 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.455 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Keepalived container image", 2024-04-26T18:46:33.455 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.455 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.455 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.456 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_loki": { 2024-04-26T18:46:33.456 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_loki", 2024-04-26T18:46:33.456 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.456 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.456 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.456 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-26T18:46:33.456 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.456 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.456 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.456 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Loki container image", 2024-04-26T18:46:33.456 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.456 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.456 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.456 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_node_exporter": { 2024-04-26T18:46:33.457 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_node_exporter", 2024-04-26T18:46:33.457 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.457 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.457 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.457 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-26T18:46:33.457 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.457 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.457 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.457 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Prometheus container image", 2024-04-26T18:46:33.457 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.457 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.457 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.457 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_nvmeof": { 2024-04-26T18:46:33.457 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_nvmeof", 2024-04-26T18:46:33.457 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.458 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.458 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.458 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-26T18:46:33.458 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.458 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.458 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.458 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Nvme-of container image", 2024-04-26T18:46:33.458 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.458 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.458 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.458 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_prometheus": { 2024-04-26T18:46:33.458 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_prometheus", 2024-04-26T18:46:33.458 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.458 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.459 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.459 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-26T18:46:33.459 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.459 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.459 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.459 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Prometheus container image", 2024-04-26T18:46:33.459 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.459 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.459 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.459 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_promtail": { 2024-04-26T18:46:33.459 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_promtail", 2024-04-26T18:46:33.459 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.459 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.459 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.459 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-26T18:46:33.459 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.460 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.460 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.460 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Promtail container image", 2024-04-26T18:46:33.460 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.460 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.460 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.460 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_samba": { 2024-04-26T18:46:33.460 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_samba", 2024-04-26T18:46:33.460 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.460 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.460 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.460 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-26T18:46:33.460 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.460 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.460 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.461 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Samba/SMB container image", 2024-04-26T18:46:33.461 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.461 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.461 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.461 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_snmp_gateway": { 2024-04-26T18:46:33.461 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_snmp_gateway", 2024-04-26T18:46:33.461 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.461 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.461 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.461 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-26T18:46:33.461 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.461 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.461 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.461 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "SNMP Gateway container image", 2024-04-26T18:46:33.462 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.462 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.462 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.462 INFO:teuthology.orchestra.run.smithi080.stdout: "container_init": { 2024-04-26T18:46:33.462 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_init", 2024-04-26T18:46:33.462 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.462 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.462 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.462 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.462 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.462 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.462 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.462 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Run podman/docker with `--init`", 2024-04-26T18:46:33.463 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.463 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.463 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.463 INFO:teuthology.orchestra.run.smithi080.stdout: "daemon_cache_timeout": { 2024-04-26T18:46:33.463 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "daemon_cache_timeout", 2024-04-26T18:46:33.463 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.463 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.463 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.463 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-26T18:46:33.463 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.463 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.463 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.463 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-26T18:46:33.463 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.463 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.464 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.464 INFO:teuthology.orchestra.run.smithi080.stdout: "default_cephadm_command_timeout": { 2024-04-26T18:46:33.464 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "default_cephadm_command_timeout", 2024-04-26T18:46:33.464 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.464 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.464 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.464 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "900", 2024-04-26T18:46:33.464 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.464 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.464 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.464 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-26T18:46:33.464 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.464 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.464 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.465 INFO:teuthology.orchestra.run.smithi080.stdout: "default_registry": { 2024-04-26T18:46:33.465 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "default_registry", 2024-04-26T18:46:33.465 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.465 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.465 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.465 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "docker.io", 2024-04-26T18:46:33.465 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.465 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.465 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.465 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-26T18:46:33.465 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.465 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.465 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.465 INFO:teuthology.orchestra.run.smithi080.stdout: "device_cache_timeout": { 2024-04-26T18:46:33.466 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "device_cache_timeout", 2024-04-26T18:46:33.466 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.466 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.466 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.466 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "1800", 2024-04-26T18:46:33.466 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.466 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.466 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.466 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "seconds to cache device inventory", 2024-04-26T18:46:33.466 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.466 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.466 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.466 INFO:teuthology.orchestra.run.smithi080.stdout: "device_enhanced_scan": { 2024-04-26T18:46:33.466 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "device_enhanced_scan", 2024-04-26T18:46:33.467 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.467 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.467 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.467 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.467 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.467 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.467 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.467 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-26T18:46:33.467 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.467 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.467 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.467 INFO:teuthology.orchestra.run.smithi080.stdout: "facts_cache_timeout": { 2024-04-26T18:46:33.467 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "facts_cache_timeout", 2024-04-26T18:46:33.467 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.467 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.468 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.468 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-26T18:46:33.468 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.468 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.468 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.468 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "seconds to cache host facts data", 2024-04-26T18:46:33.468 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.468 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.468 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.468 INFO:teuthology.orchestra.run.smithi080.stdout: "grafana_dashboards_path": { 2024-04-26T18:46:33.468 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "grafana_dashboards_path", 2024-04-26T18:46:33.468 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.468 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.468 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.468 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-26T18:46:33.469 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.469 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.469 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.469 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-26T18:46:33.469 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.469 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.469 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.469 INFO:teuthology.orchestra.run.smithi080.stdout: "host_check_interval": { 2024-04-26T18:46:33.469 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "host_check_interval", 2024-04-26T18:46:33.469 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.469 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.469 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.469 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-26T18:46:33.469 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.470 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.470 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.470 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to perform a host check", 2024-04-26T18:46:33.470 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.470 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.470 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.470 INFO:teuthology.orchestra.run.smithi080.stdout: "hw_monitoring": { 2024-04-26T18:46:33.470 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "hw_monitoring", 2024-04-26T18:46:33.470 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.470 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.470 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.470 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.470 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.470 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.471 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.471 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-26T18:46:33.471 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.471 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.471 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.471 INFO:teuthology.orchestra.run.smithi080.stdout: "inventory_list_all": { 2024-04-26T18:46:33.471 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "inventory_list_all", 2024-04-26T18:46:33.471 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.471 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.471 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.471 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.471 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.471 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.471 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.471 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-26T18:46:33.472 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.472 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.472 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.472 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.472 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.472 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.472 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.472 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.472 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.472 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.472 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.472 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.472 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.472 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.473 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.473 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.473 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.473 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.473 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.473 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.473 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.473 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.473 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.473 INFO:teuthology.orchestra.run.smithi080.stdout: "log_refresh_metadata": { 2024-04-26T18:46:33.473 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_refresh_metadata", 2024-04-26T18:46:33.473 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.473 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.473 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.473 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.474 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.474 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.474 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.474 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-26T18:46:33.474 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.474 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.474 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.474 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.474 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.474 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.474 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.474 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.474 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.474 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.475 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.475 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.475 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-26T18:46:33.475 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.475 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.475 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.475 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.475 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.475 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.475 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.475 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.475 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.475 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.475 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.475 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.476 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.476 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.476 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.476 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.476 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.476 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.476 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.476 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.476 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.476 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.476 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.476 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.476 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.476 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.476 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.477 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.477 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.477 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.477 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.477 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.477 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.477 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.477 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.477 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.477 INFO:teuthology.orchestra.run.smithi080.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-26T18:46:33.477 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-26T18:46:33.477 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.477 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.477 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.478 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.478 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.478 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.478 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.478 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-26T18:46:33.478 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.478 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.478 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.478 INFO:teuthology.orchestra.run.smithi080.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-26T18:46:33.478 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-26T18:46:33.478 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.478 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.478 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.478 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "*", 2024-04-26T18:46:33.479 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.479 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.479 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.479 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-26T18:46:33.479 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.479 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.479 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.479 INFO:teuthology.orchestra.run.smithi080.stdout: "max_count_per_host": { 2024-04-26T18:46:33.479 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_count_per_host", 2024-04-26T18:46:33.479 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.479 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.479 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.479 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-26T18:46:33.479 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.479 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.480 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.480 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "max number of daemons per service per host", 2024-04-26T18:46:33.480 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.480 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.480 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.480 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd_draining_count": { 2024-04-26T18:46:33.480 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_osd_draining_count", 2024-04-26T18:46:33.480 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.480 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.480 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.480 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-26T18:46:33.480 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.480 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.480 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.481 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-26T18:46:33.481 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.481 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.481 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.481 INFO:teuthology.orchestra.run.smithi080.stdout: "migration_current": { 2024-04-26T18:46:33.481 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "migration_current", 2024-04-26T18:46:33.481 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.481 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.481 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.481 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.481 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.481 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.481 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.481 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "internal - do not modify", 2024-04-26T18:46:33.482 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.482 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.482 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.482 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": { 2024-04-26T18:46:33.482 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mode", 2024-04-26T18:46:33.482 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.482 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.482 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.482 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "root", 2024-04-26T18:46:33.482 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.482 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.482 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.482 INFO:teuthology.orchestra.run.smithi080.stdout: "cephadm-package", 2024-04-26T18:46:33.482 INFO:teuthology.orchestra.run.smithi080.stdout: "root" 2024-04-26T18:46:33.482 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.483 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "mode for remote execution of cephadm", 2024-04-26T18:46:33.483 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.483 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.483 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.483 INFO:teuthology.orchestra.run.smithi080.stdout: "oob_default_addr": { 2024-04-26T18:46:33.483 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "oob_default_addr", 2024-04-26T18:46:33.483 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.483 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.483 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.483 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "169.254.1.1", 2024-04-26T18:46:33.483 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.483 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.483 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.483 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-26T18:46:33.484 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.484 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.484 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.484 INFO:teuthology.orchestra.run.smithi080.stdout: "prometheus_alerts_path": { 2024-04-26T18:46:33.484 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "prometheus_alerts_path", 2024-04-26T18:46:33.484 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.484 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.484 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.484 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-26T18:46:33.484 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.484 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.484 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.484 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-26T18:46:33.484 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.484 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.485 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.485 INFO:teuthology.orchestra.run.smithi080.stdout: "registry_insecure": { 2024-04-26T18:46:33.485 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "registry_insecure", 2024-04-26T18:46:33.485 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.485 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.485 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.485 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.485 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.485 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.485 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.485 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-26T18:46:33.485 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.485 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.485 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.486 INFO:teuthology.orchestra.run.smithi080.stdout: "registry_password": { 2024-04-26T18:46:33.486 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "registry_password", 2024-04-26T18:46:33.486 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.486 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.486 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.486 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.486 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.486 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.486 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.486 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-26T18:46:33.486 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.486 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.486 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.487 INFO:teuthology.orchestra.run.smithi080.stdout: "registry_url": { 2024-04-26T18:46:33.487 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "registry_url", 2024-04-26T18:46:33.487 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.487 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.487 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.487 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.487 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.487 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.487 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.487 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-26T18:46:33.487 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.487 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.487 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.487 INFO:teuthology.orchestra.run.smithi080.stdout: "registry_username": { 2024-04-26T18:46:33.487 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "registry_username", 2024-04-26T18:46:33.488 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.488 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.488 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.488 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.488 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.488 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.488 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.488 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-26T18:46:33.488 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.488 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.488 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.488 INFO:teuthology.orchestra.run.smithi080.stdout: "secure_monitoring_stack": { 2024-04-26T18:46:33.488 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "secure_monitoring_stack", 2024-04-26T18:46:33.488 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.488 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.489 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.489 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.489 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.489 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.489 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.489 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-26T18:46:33.489 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.489 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.489 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.489 INFO:teuthology.orchestra.run.smithi080.stdout: "service_discovery_port": { 2024-04-26T18:46:33.489 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "service_discovery_port", 2024-04-26T18:46:33.489 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.489 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.489 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.489 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8765", 2024-04-26T18:46:33.490 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.490 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.490 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.490 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "cephadm service discovery port", 2024-04-26T18:46:33.490 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.490 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.490 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.490 INFO:teuthology.orchestra.run.smithi080.stdout: "ssh_config_file": { 2024-04-26T18:46:33.490 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ssh_config_file", 2024-04-26T18:46:33.490 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.490 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.490 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.490 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.490 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.491 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.491 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.491 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-26T18:46:33.491 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.491 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.491 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.491 INFO:teuthology.orchestra.run.smithi080.stdout: "use_agent": { 2024-04-26T18:46:33.491 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "use_agent", 2024-04-26T18:46:33.491 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.491 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.491 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.491 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.491 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.491 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.492 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.492 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-26T18:46:33.492 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.492 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.492 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.492 INFO:teuthology.orchestra.run.smithi080.stdout: "use_repo_digest": { 2024-04-26T18:46:33.492 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "use_repo_digest", 2024-04-26T18:46:33.492 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.492 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.492 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.492 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.492 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.492 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.492 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.492 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-26T18:46:33.492 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.493 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.493 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.493 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_on_failed_host_check": { 2024-04-26T18:46:33.493 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_on_failed_host_check", 2024-04-26T18:46:33.493 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.493 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.493 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.493 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.493 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.493 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.493 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.493 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "raise a health warning if the host check fails", 2024-04-26T18:46:33.493 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.494 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.494 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.494 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_on_stray_daemons": { 2024-04-26T18:46:33.494 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_on_stray_daemons", 2024-04-26T18:46:33.494 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.494 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.494 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.494 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.494 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.494 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.494 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.494 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-26T18:46:33.494 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.494 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.495 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.495 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_on_stray_hosts": { 2024-04-26T18:46:33.495 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_on_stray_hosts", 2024-04-26T18:46:33.495 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.495 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.495 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.495 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.495 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.495 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.495 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.495 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-26T18:46:33.495 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.495 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.495 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.496 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.496 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.496 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crash", 2024-04-26T18:46:33.496 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.496 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.496 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.496 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.496 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.496 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.496 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.496 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.496 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.496 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.497 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.497 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.497 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.497 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.497 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.497 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.497 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.497 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.497 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.497 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.497 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.497 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.497 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.497 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.497 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.498 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.498 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.498 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.498 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.498 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.498 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.498 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.498 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.498 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.498 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.498 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.498 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.498 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.498 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.499 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.499 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.499 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.499 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.499 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.499 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.499 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.499 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.499 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.499 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.499 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.499 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.499 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.499 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.499 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.500 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.500 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.500 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.500 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.500 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.500 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.500 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.500 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.500 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.500 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.500 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.500 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.500 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.500 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.500 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.501 INFO:teuthology.orchestra.run.smithi080.stdout: "retain_interval": { 2024-04-26T18:46:33.501 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "retain_interval", 2024-04-26T18:46:33.501 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.501 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.501 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.501 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "31536000", 2024-04-26T18:46:33.501 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.501 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.501 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.501 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-26T18:46:33.501 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.501 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.501 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.501 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_recent_interval": { 2024-04-26T18:46:33.502 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_recent_interval", 2024-04-26T18:46:33.502 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.502 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.502 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.502 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "1209600", 2024-04-26T18:46:33.502 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.502 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.502 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.502 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-26T18:46:33.502 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.502 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.502 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.502 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.502 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.503 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "dashboard", 2024-04-26T18:46:33.503 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.503 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.503 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.503 INFO:teuthology.orchestra.run.smithi080.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-26T18:46:33.503 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-26T18:46:33.503 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.503 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.503 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.503 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-26T18:46:33.503 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.503 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.503 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.503 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.504 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.504 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.504 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.504 INFO:teuthology.orchestra.run.smithi080.stdout: "ALERTMANAGER_API_HOST": { 2024-04-26T18:46:33.504 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-26T18:46:33.504 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.504 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.504 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.504 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.504 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.504 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.504 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.504 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.504 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.504 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.505 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.505 INFO:teuthology.orchestra.run.smithi080.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-26T18:46:33.505 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-26T18:46:33.505 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.505 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.505 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.505 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.505 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.505 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.505 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.505 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.505 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.505 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.505 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.506 INFO:teuthology.orchestra.run.smithi080.stdout: "AUDIT_API_ENABLED": { 2024-04-26T18:46:33.506 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "AUDIT_API_ENABLED", 2024-04-26T18:46:33.506 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.506 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.506 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.506 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.506 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.506 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.506 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.506 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.506 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.506 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.506 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.506 INFO:teuthology.orchestra.run.smithi080.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-26T18:46:33.507 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-26T18:46:33.507 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.507 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.507 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.507 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.507 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.507 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.507 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.507 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.507 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.507 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.507 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.507 INFO:teuthology.orchestra.run.smithi080.stdout: "ENABLE_BROWSABLE_API": { 2024-04-26T18:46:33.508 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-26T18:46:33.508 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.508 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.508 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.508 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.508 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.508 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.508 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.508 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.508 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.508 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.508 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.508 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-26T18:46:33.508 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-26T18:46:33.509 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.509 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.509 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.509 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.509 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.509 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.509 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.509 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.509 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.509 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.509 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.509 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-26T18:46:33.509 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-26T18:46:33.509 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.510 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.510 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.510 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.510 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.510 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.510 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.510 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.510 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.510 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.510 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.510 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-26T18:46:33.510 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-26T18:46:33.510 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.511 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.511 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.511 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.511 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.511 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.511 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.511 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.511 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.511 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.511 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.511 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-26T18:46:33.511 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-26T18:46:33.511 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.511 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.512 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.512 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.512 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.512 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.512 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.512 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.512 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.512 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.512 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.512 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-26T18:46:33.512 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-26T18:46:33.512 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.512 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.512 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.512 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.513 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.513 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.513 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.513 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.513 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.513 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.513 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.513 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-26T18:46:33.513 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-26T18:46:33.513 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.513 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.513 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.513 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.513 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.514 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.514 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.514 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.514 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.514 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.514 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.514 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-26T18:46:33.514 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-26T18:46:33.514 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.514 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.514 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.514 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.514 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.515 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.515 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.515 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.515 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.515 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.515 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.515 INFO:teuthology.orchestra.run.smithi080.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-26T18:46:33.515 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-26T18:46:33.515 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.515 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.515 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.515 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.515 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.515 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.515 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.515 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.516 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.516 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.516 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.516 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_API_PASSWORD": { 2024-04-26T18:46:33.516 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-26T18:46:33.516 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.516 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.516 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.516 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "admin", 2024-04-26T18:46:33.516 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.516 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.516 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.516 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.516 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.516 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-26T18:46:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-26T18:46:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_API_URL": { 2024-04-26T18:46:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_API_URL", 2024-04-26T18:46:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_API_USERNAME": { 2024-04-26T18:46:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-26T18:46:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "admin", 2024-04-26T18:46:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.520 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-26T18:46:33.520 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-26T18:46:33.520 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.520 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.520 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.520 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.520 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.520 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.520 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.520 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.520 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.520 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.520 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-26T18:46:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-26T18:46:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-26T18:46:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-26T18:46:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-26T18:46:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-26T18:46:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-26T18:46:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-26T18:46:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "[]", 2024-04-26T18:46:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: "MULTICLUSTER_CONFIG": { 2024-04-26T18:46:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-26T18:46:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "{}", 2024-04-26T18:46:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: "PROMETHEUS_API_HOST": { 2024-04-26T18:46:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-26T18:46:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-26T18:46:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-26T18:46:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-26T18:46:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-26T18:46:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-26T18:46:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-26T18:46:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-26T18:46:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-26T18:46:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-26T18:46:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-26T18:46:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-26T18:46:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-26T18:46:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-26T18:46:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-26T18:46:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-26T18:46:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-26T18:46:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_ENABLED": { 2024-04-26T18:46:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-26T18:46:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-26T18:46:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-26T18:46:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-26T18:46:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-26T18:46:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-26T18:46:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-26T18:46:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-26T18:46:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-26T18:46:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8", 2024-04-26T18:46:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-26T18:46:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-26T18:46:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "45", 2024-04-26T18:46:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: "RGW_API_ACCESS_KEY": { 2024-04-26T18:46:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-26T18:46:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-26T18:46:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-26T18:46:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "admin", 2024-04-26T18:46:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: "RGW_API_SECRET_KEY": { 2024-04-26T18:46:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-26T18:46:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "RGW_API_SSL_VERIFY": { 2024-04-26T18:46:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-26T18:46:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "UNSAFE_TLS_v1_2": { 2024-04-26T18:46:33.542 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-26T18:46:33.542 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.542 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.542 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.542 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.542 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.542 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.542 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.542 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.542 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.542 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.542 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.542 INFO:teuthology.orchestra.run.smithi080.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-26T18:46:33.543 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-26T18:46:33.543 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.543 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.543 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.543 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-26T18:46:33.543 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.543 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.543 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.543 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.543 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.543 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.543 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.543 INFO:teuthology.orchestra.run.smithi080.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-26T18:46:33.543 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-26T18:46:33.544 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.544 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.544 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.544 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-26T18:46:33.544 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.544 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.544 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.544 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.544 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.544 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.544 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.544 INFO:teuthology.orchestra.run.smithi080.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-26T18:46:33.544 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-26T18:46:33.544 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.544 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.545 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.545 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5", 2024-04-26T18:46:33.545 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.545 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.545 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.545 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.545 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.545 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.545 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.545 INFO:teuthology.orchestra.run.smithi080.stdout: "cross_origin_url": { 2024-04-26T18:46:33.545 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cross_origin_url", 2024-04-26T18:46:33.545 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.545 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.545 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.546 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.546 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.546 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.546 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.546 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.546 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.546 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.546 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.546 INFO:teuthology.orchestra.run.smithi080.stdout: "crt_file": { 2024-04-26T18:46:33.546 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crt_file", 2024-04-26T18:46:33.546 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.546 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.546 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.546 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.546 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.547 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.547 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.547 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.547 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.547 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.547 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.547 INFO:teuthology.orchestra.run.smithi080.stdout: "debug": { 2024-04-26T18:46:33.547 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "debug", 2024-04-26T18:46:33.547 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.547 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.547 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.547 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.547 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.547 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.548 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.548 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Enable/disable debug options", 2024-04-26T18:46:33.548 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.548 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.548 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.548 INFO:teuthology.orchestra.run.smithi080.stdout: "jwt_token_ttl": { 2024-04-26T18:46:33.548 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "jwt_token_ttl", 2024-04-26T18:46:33.548 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.548 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.548 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.548 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "28800", 2024-04-26T18:46:33.548 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.548 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.548 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.548 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: "key_file": { 2024-04-26T18:46:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "key_file", 2024-04-26T18:46:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: "motd": { 2024-04-26T18:46:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "motd", 2024-04-26T18:46:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "The message of the day", 2024-04-26T18:46:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: "redirect_resolve_ip_addr": { 2024-04-26T18:46:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "redirect_resolve_ip_addr", 2024-04-26T18:46:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: "server_addr": { 2024-04-26T18:46:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_addr", 2024-04-26T18:46:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "::", 2024-04-26T18:46:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "server_port": { 2024-04-26T18:46:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_port", 2024-04-26T18:46:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8080", 2024-04-26T18:46:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: "ssl": { 2024-04-26T18:46:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ssl", 2024-04-26T18:46:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: "ssl_server_port": { 2024-04-26T18:46:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ssl_server_port", 2024-04-26T18:46:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8443", 2024-04-26T18:46:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: "standby_behaviour": { 2024-04-26T18:46:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "standby_behaviour", 2024-04-26T18:46:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "redirect", 2024-04-26T18:46:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: "redirect" 2024-04-26T18:46:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: "standby_error_status_code": { 2024-04-26T18:46:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "standby_error_status_code", 2024-04-26T18:46:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "500", 2024-04-26T18:46:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "400", 2024-04-26T18:46:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "599", 2024-04-26T18:46:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "url_prefix": { 2024-04-26T18:46:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "url_prefix", 2024-04-26T18:46:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "devicehealth", 2024-04-26T18:46:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: "enable_monitoring": { 2024-04-26T18:46:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "enable_monitoring", 2024-04-26T18:46:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "monitor device health metrics", 2024-04-26T18:46:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: "mark_out_threshold": { 2024-04-26T18:46:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mark_out_threshold", 2024-04-26T18:46:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "2419200", 2024-04-26T18:46:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-26T18:46:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": { 2024-04-26T18:46:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "pool_name", 2024-04-26T18:46:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "device_health_metrics", 2024-04-26T18:46:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-26T18:46:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "retention_period": { 2024-04-26T18:46:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "retention_period", 2024-04-26T18:46:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "15552000", 2024-04-26T18:46:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how long to retain device health metrics", 2024-04-26T18:46:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: "scrape_frequency": { 2024-04-26T18:46:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "scrape_frequency", 2024-04-26T18:46:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "86400", 2024-04-26T18:46:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-26T18:46:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: "self_heal": { 2024-04-26T18:46:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "self_heal", 2024-04-26T18:46:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-26T18:46:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-26T18:46:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-26T18:46:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-26T18:46:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to wake up and check device health", 2024-04-26T18:46:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_threshold": { 2024-04-26T18:46:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_threshold", 2024-04-26T18:46:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "7257600", 2024-04-26T18:46:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-26T18:46:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "diskprediction_local", 2024-04-26T18:46:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "predict_interval": { 2024-04-26T18:46:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "predict_interval", 2024-04-26T18:46:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "86400", 2024-04-26T18:46:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: "predictor_model": { 2024-04-26T18:46:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "predictor_model", 2024-04-26T18:46:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "prophetstor", 2024-04-26T18:46:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-26T18:46:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-26T18:46:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-26T18:46:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "influx", 2024-04-26T18:46:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": false, 2024-04-26T18:46:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "influxdb python module not found", 2024-04-26T18:46:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: "batch_size": { 2024-04-26T18:46:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "batch_size", 2024-04-26T18:46:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5000", 2024-04-26T18:46:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-26T18:46:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: "database": { 2024-04-26T18:46:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "database", 2024-04-26T18:46:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "ceph", 2024-04-26T18:46:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-26T18:46:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "hostname": { 2024-04-26T18:46:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "hostname", 2024-04-26T18:46:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "InfluxDB server hostname", 2024-04-26T18:46:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-26T18:46:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-26T18:46:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "30", 2024-04-26T18:46:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "5", 2024-04-26T18:46:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-26T18:46:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: "password": { 2024-04-26T18:46:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "password", 2024-04-26T18:46:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "password of InfluxDB server user", 2024-04-26T18:46:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: "port": { 2024-04-26T18:46:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "port", 2024-04-26T18:46:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8086", 2024-04-26T18:46:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "InfluxDB server port", 2024-04-26T18:46:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "ssl": { 2024-04-26T18:46:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ssl", 2024-04-26T18:46:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "false", 2024-04-26T18:46:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-26T18:46:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "threads": { 2024-04-26T18:46:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "threads", 2024-04-26T18:46:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5", 2024-04-26T18:46:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1", 2024-04-26T18:46:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "32", 2024-04-26T18:46:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-26T18:46:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: "username": { 2024-04-26T18:46:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "username", 2024-04-26T18:46:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "username of InfluxDB server user", 2024-04-26T18:46:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "verify_ssl": { 2024-04-26T18:46:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "verify_ssl", 2024-04-26T18:46:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "true", 2024-04-26T18:46:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-26T18:46:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "insights", 2024-04-26T18:46:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "iostat", 2024-04-26T18:46:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "k8sevents", 2024-04-26T18:46:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_event_retention_days": { 2024-04-26T18:46:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ceph_event_retention_days", 2024-04-26T18:46:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "7", 2024-04-26T18:46:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-26T18:46:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "config_check_secs": { 2024-04-26T18:46:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "config_check_secs", 2024-04-26T18:46:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-26T18:46:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "10", 2024-04-26T18:46:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-26T18:46:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "localpool", 2024-04-26T18:46:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: "failure_domain": { 2024-04-26T18:46:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "failure_domain", 2024-04-26T18:46:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "host", 2024-04-26T18:46:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "failure domain for any created local pool", 2024-04-26T18:46:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-26T18:46:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": { 2024-04-26T18:46:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "min_size", 2024-04-26T18:46:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "default min_size for any created local pool", 2024-04-26T18:46:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-26T18:46:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: "num_rep": { 2024-04-26T18:46:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "num_rep", 2024-04-26T18:46:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "3", 2024-04-26T18:46:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "default replica count for any created local pool", 2024-04-26T18:46:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": { 2024-04-26T18:46:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "pg_num", 2024-04-26T18:46:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "128", 2024-04-26T18:46:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "default pg_num for any created local pool", 2024-04-26T18:46:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: "prefix": { 2024-04-26T18:46:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "prefix", 2024-04-26T18:46:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "name prefix for any created local pool", 2024-04-26T18:46:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: "subtree": { 2024-04-26T18:46:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "subtree", 2024-04-26T18:46:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "rack", 2024-04-26T18:46:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-26T18:46:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-26T18:46:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mds_autoscaler", 2024-04-26T18:46:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mirroring", 2024-04-26T18:46:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.626 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.626 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.626 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.626 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.626 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.626 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.626 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.626 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.626 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.626 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.626 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.626 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.626 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.626 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.627 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.627 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.627 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.627 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.627 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.627 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.627 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.627 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.627 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.627 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.627 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.627 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.627 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.627 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.628 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.628 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.628 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.628 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.628 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.628 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.628 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.628 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.628 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.628 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.628 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.628 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.628 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.628 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.628 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.628 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.629 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.629 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.629 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.629 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.629 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.629 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.629 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.629 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.629 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.629 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.629 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.629 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.629 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.629 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.629 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.630 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "nfs", 2024-04-26T18:46:33.630 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.630 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.630 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.630 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.630 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.630 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.630 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.630 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.630 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.630 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.630 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.630 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.630 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.630 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.631 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.631 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.631 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.631 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.631 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.631 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.631 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.631 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.631 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.631 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.631 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.631 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.631 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.631 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.631 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.632 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.632 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.632 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.632 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.632 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.632 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.632 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.632 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.632 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.632 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.632 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.632 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.632 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.632 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.632 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.632 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.633 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.633 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.633 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.633 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.633 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.633 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.633 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.633 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.633 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.633 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.633 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.633 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.633 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.633 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.633 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.633 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.634 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.634 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.634 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.634 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.634 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.634 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.634 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.634 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.634 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.634 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.634 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "orchestrator", 2024-04-26T18:46:33.634 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.634 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.634 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.635 INFO:teuthology.orchestra.run.smithi080.stdout: "fail_fs": { 2024-04-26T18:46:33.635 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "fail_fs", 2024-04-26T18:46:33.635 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.635 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.635 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.635 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.635 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.635 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.635 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.635 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-26T18:46:33.635 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.635 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.635 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.635 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.635 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.635 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.636 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.636 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.636 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.636 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.636 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.636 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.636 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.636 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.636 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.636 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.636 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.636 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.636 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.636 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.636 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.636 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.636 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.637 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.637 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.637 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.637 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.637 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.637 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.637 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.637 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.637 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.637 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.637 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.637 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.637 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.637 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.637 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.638 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.638 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.638 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.638 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.638 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.638 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.638 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.638 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.638 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.638 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.638 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.638 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.638 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.638 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.638 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.639 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.639 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.639 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.639 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.639 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.639 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.639 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.639 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.639 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.639 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.639 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.639 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.639 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.639 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.639 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.639 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.640 INFO:teuthology.orchestra.run.smithi080.stdout: "orchestrator": { 2024-04-26T18:46:33.640 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "orchestrator", 2024-04-26T18:46:33.640 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.640 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.640 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.640 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.640 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.640 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.640 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.640 INFO:teuthology.orchestra.run.smithi080.stdout: "cephadm", 2024-04-26T18:46:33.640 INFO:teuthology.orchestra.run.smithi080.stdout: "rook", 2024-04-26T18:46:33.640 INFO:teuthology.orchestra.run.smithi080.stdout: "test_orchestrator" 2024-04-26T18:46:33.640 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.640 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Orchestrator backend", 2024-04-26T18:46:33.640 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.640 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.641 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.641 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.641 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.641 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "osd_perf_query", 2024-04-26T18:46:33.641 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.641 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.641 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.641 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.641 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.641 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.641 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.641 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.641 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.641 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.641 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.642 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.642 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.642 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.642 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.642 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.642 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.642 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.642 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.642 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.642 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.642 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.642 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.642 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.642 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.642 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.643 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.643 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.643 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.643 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.643 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.643 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.643 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.643 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.643 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.643 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.643 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.643 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.643 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.643 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.643 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.643 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.644 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.644 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.644 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.644 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.644 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.644 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.644 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.644 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.644 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.644 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.644 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.644 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.644 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.644 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.644 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.644 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.645 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.645 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.645 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.645 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.645 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.645 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.645 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.645 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.645 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.645 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.645 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.645 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.645 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.645 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "osd_support", 2024-04-26T18:46:33.645 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.646 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.646 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.646 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.646 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.646 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.646 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.646 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.646 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.646 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.646 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.646 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.646 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.646 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.646 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.646 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.646 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.647 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.647 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.647 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.647 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.647 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.647 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.647 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.647 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.647 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.647 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.647 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.647 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.647 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.647 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.647 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.647 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.648 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.648 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.648 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.648 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.648 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.648 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.648 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.648 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.648 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.648 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.648 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.648 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.648 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.648 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.648 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.649 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.649 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.649 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.649 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.649 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.649 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.649 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.649 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.649 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.649 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.649 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.649 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.649 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.649 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.649 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.649 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.650 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.650 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.650 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.650 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.650 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.650 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.650 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.650 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "pg_autoscaler", 2024-04-26T18:46:33.650 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.650 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.650 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.650 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.650 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.650 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.651 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.651 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.651 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.651 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.651 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.651 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.651 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.651 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.651 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.651 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.651 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.651 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.651 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.651 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.651 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.651 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.651 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.652 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.652 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.652 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.652 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.652 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.652 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.652 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.652 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.652 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.652 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.652 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.652 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.652 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.652 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.652 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.653 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.653 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.653 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.653 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.653 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.653 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.653 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.653 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.653 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.653 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.653 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.653 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.653 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.653 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.653 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.653 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.653 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.654 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.654 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.654 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.654 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.654 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.654 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.654 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.654 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.654 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.654 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.654 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.654 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.654 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.654 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.655 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-26T18:46:33.655 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-26T18:46:33.655 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.655 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.655 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.655 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-26T18:46:33.655 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.655 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.655 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.655 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.655 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.655 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.655 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.655 INFO:teuthology.orchestra.run.smithi080.stdout: "threshold": { 2024-04-26T18:46:33.655 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "threshold", 2024-04-26T18:46:33.655 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-26T18:46:33.656 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.656 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.656 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "3.0", 2024-04-26T18:46:33.656 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1.0", 2024-04-26T18:46:33.656 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.656 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.656 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "scaling threshold", 2024-04-26T18:46:33.656 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-26T18:46:33.656 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.656 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.656 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.656 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.656 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "progress", 2024-04-26T18:46:33.656 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.656 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.657 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.657 INFO:teuthology.orchestra.run.smithi080.stdout: "allow_pg_recovery_event": { 2024-04-26T18:46:33.657 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "allow_pg_recovery_event", 2024-04-26T18:46:33.657 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.657 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.657 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.657 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.657 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.657 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.657 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.657 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-26T18:46:33.657 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.657 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.657 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.657 INFO:teuthology.orchestra.run.smithi080.stdout: "enabled": { 2024-04-26T18:46:33.657 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "enabled", 2024-04-26T18:46:33.658 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.658 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.658 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.658 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.658 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.658 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.658 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.658 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.658 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.658 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.658 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.658 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.658 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.658 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.658 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.659 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.659 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.659 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.659 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.659 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.659 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.659 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.659 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.659 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.659 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.659 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.659 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.659 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.659 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.659 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.659 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.659 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.660 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.660 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.660 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.660 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.660 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.660 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.660 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.660 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.660 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.660 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.660 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.660 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.660 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.660 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.660 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.661 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.661 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.661 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.661 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.661 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.661 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.661 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.661 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.661 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.661 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.661 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.661 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.661 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.661 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.661 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.661 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.662 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.662 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.662 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.662 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.662 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.662 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.662 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.662 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.662 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.662 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.662 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.662 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.662 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.662 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.662 INFO:teuthology.orchestra.run.smithi080.stdout: "max_completed_events": { 2024-04-26T18:46:33.663 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_completed_events", 2024-04-26T18:46:33.663 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.663 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.663 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.663 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "50", 2024-04-26T18:46:33.663 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.663 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.663 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.663 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "number of past completed events to remember", 2024-04-26T18:46:33.663 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.663 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.663 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.663 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-26T18:46:33.663 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-26T18:46:33.663 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.663 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.664 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.664 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5", 2024-04-26T18:46:33.664 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.664 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.664 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.664 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how long the module is going to sleep", 2024-04-26T18:46:33.664 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.664 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.664 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.664 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.664 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.664 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "prometheus", 2024-04-26T18:46:33.664 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.664 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.665 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.665 INFO:teuthology.orchestra.run.smithi080.stdout: "cache": { 2024-04-26T18:46:33.665 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cache", 2024-04-26T18:46:33.665 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.665 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.665 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.665 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.665 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.665 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.665 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.665 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.665 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.665 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.665 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.665 INFO:teuthology.orchestra.run.smithi080.stdout: "exclude_perf_counters": { 2024-04-26T18:46:33.665 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "exclude_perf_counters", 2024-04-26T18:46:33.666 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.666 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.666 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.666 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.666 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.666 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.666 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.666 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-26T18:46:33.666 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-26T18:46:33.666 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.666 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.666 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.666 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.667 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.667 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.667 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.667 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.667 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.667 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.667 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.667 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.667 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.667 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.667 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.667 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.667 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.667 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.667 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.667 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.667 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.668 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.668 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.668 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.668 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.668 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.668 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.668 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.668 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.668 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.668 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.668 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.668 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.668 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.668 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.668 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.669 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.669 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.669 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.669 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.669 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.669 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.669 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.669 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.669 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.669 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.669 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.669 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.669 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.669 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.669 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.669 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.670 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.670 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.670 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.670 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.670 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.670 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.670 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.670 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.670 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.670 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.670 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.670 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.670 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.670 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.671 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.671 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.671 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_stats_pools": { 2024-04-26T18:46:33.671 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rbd_stats_pools", 2024-04-26T18:46:33.671 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.671 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.671 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.671 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.671 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.671 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.671 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.671 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.671 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.671 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.671 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.672 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-26T18:46:33.672 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-26T18:46:33.672 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.672 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.672 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.672 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "300", 2024-04-26T18:46:33.672 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.672 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.672 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.672 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.672 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.672 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.672 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.672 INFO:teuthology.orchestra.run.smithi080.stdout: "scrape_interval": { 2024-04-26T18:46:33.672 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "scrape_interval", 2024-04-26T18:46:33.673 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-26T18:46:33.673 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.673 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.673 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "15.0", 2024-04-26T18:46:33.673 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.673 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.673 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.673 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.673 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.673 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.673 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.673 INFO:teuthology.orchestra.run.smithi080.stdout: "server_addr": { 2024-04-26T18:46:33.673 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_addr", 2024-04-26T18:46:33.673 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.673 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.673 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.674 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "::", 2024-04-26T18:46:33.674 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.674 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.674 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.674 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-26T18:46:33.674 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.674 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.674 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.674 INFO:teuthology.orchestra.run.smithi080.stdout: "server_port": { 2024-04-26T18:46:33.674 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_port", 2024-04-26T18:46:33.674 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.674 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.674 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.674 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "9283", 2024-04-26T18:46:33.674 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.675 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.675 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.675 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-26T18:46:33.675 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.675 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.675 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.675 INFO:teuthology.orchestra.run.smithi080.stdout: "stale_cache_strategy": { 2024-04-26T18:46:33.675 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "stale_cache_strategy", 2024-04-26T18:46:33.675 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.675 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.675 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.675 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "log", 2024-04-26T18:46:33.675 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.675 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.675 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.675 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.676 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.676 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.676 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.676 INFO:teuthology.orchestra.run.smithi080.stdout: "standby_behaviour": { 2024-04-26T18:46:33.676 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "standby_behaviour", 2024-04-26T18:46:33.676 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.676 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.676 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.676 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "default", 2024-04-26T18:46:33.676 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.676 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.676 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.676 INFO:teuthology.orchestra.run.smithi080.stdout: "default", 2024-04-26T18:46:33.676 INFO:teuthology.orchestra.run.smithi080.stdout: "error" 2024-04-26T18:46:33.676 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.676 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.676 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.677 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.677 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.677 INFO:teuthology.orchestra.run.smithi080.stdout: "standby_error_status_code": { 2024-04-26T18:46:33.677 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "standby_error_status_code", 2024-04-26T18:46:33.677 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.677 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.677 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.677 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "500", 2024-04-26T18:46:33.677 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "400", 2024-04-26T18:46:33.677 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "599", 2024-04-26T18:46:33.677 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.677 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.677 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.677 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.677 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.677 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.678 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.678 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rbd_support", 2024-04-26T18:46:33.678 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.678 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.678 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.678 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.678 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.678 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.678 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.678 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.678 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.678 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.678 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.679 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.679 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.679 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.679 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.679 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.679 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.679 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.679 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.679 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.679 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.679 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.679 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.679 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.679 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.679 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.679 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.680 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.680 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.680 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.680 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.680 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.680 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.680 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.680 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.680 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.680 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.680 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.680 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.680 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.680 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.680 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.680 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.680 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.681 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.681 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.681 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.681 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.681 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.681 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.681 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.681 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.681 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.681 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.681 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.681 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.681 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.681 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.682 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.682 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.682 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.682 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.682 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.682 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.682 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.682 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.682 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.682 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.682 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.682 INFO:teuthology.orchestra.run.smithi080.stdout: "max_concurrent_snap_create": { 2024-04-26T18:46:33.682 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_concurrent_snap_create", 2024-04-26T18:46:33.682 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.682 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.683 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.683 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-26T18:46:33.683 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.683 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.683 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.683 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.683 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.683 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.683 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.683 INFO:teuthology.orchestra.run.smithi080.stdout: "mirror_snapshot_schedule": { 2024-04-26T18:46:33.683 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mirror_snapshot_schedule", 2024-04-26T18:46:33.683 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.683 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.683 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.683 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.684 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.684 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.684 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.684 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.684 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.684 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.684 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.684 INFO:teuthology.orchestra.run.smithi080.stdout: "trash_purge_schedule": { 2024-04-26T18:46:33.684 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "trash_purge_schedule", 2024-04-26T18:46:33.684 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.684 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.684 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.684 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.684 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.684 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.684 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.684 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.685 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.685 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.685 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.685 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.685 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.685 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "restful", 2024-04-26T18:46:33.685 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.685 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.685 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.685 INFO:teuthology.orchestra.run.smithi080.stdout: "enable_auth": { 2024-04-26T18:46:33.685 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "enable_auth", 2024-04-26T18:46:33.685 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.685 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.685 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.686 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.686 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.686 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.686 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.686 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.686 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.686 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.686 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.686 INFO:teuthology.orchestra.run.smithi080.stdout: "key_file": { 2024-04-26T18:46:33.686 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "key_file", 2024-04-26T18:46:33.686 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.686 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.686 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.686 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.686 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.686 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.687 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.687 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.687 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.687 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.687 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.687 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.687 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.687 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.687 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.687 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.687 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.687 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.687 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.687 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.687 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.688 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.688 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.688 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.688 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.688 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.688 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.688 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.688 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.688 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.688 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.688 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.688 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.688 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.688 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.688 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.688 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.689 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.689 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.689 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.689 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.689 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.689 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.689 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.689 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.689 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.689 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.689 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.689 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.689 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.689 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.689 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.689 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.690 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.690 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.690 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.690 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.690 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.690 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.690 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.690 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.690 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.690 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.690 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.690 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.690 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.690 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.690 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.690 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.691 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.691 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.691 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.691 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.691 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.691 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.691 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.691 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.691 INFO:teuthology.orchestra.run.smithi080.stdout: "server_addr": { 2024-04-26T18:46:33.691 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_addr", 2024-04-26T18:46:33.691 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.691 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.691 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.691 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.691 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.691 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.692 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.692 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.692 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.692 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.692 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.692 INFO:teuthology.orchestra.run.smithi080.stdout: "server_port": { 2024-04-26T18:46:33.692 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_port", 2024-04-26T18:46:33.692 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.692 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.692 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.692 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.692 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.692 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.692 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.692 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.692 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.693 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.693 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.693 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.693 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.693 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rgw", 2024-04-26T18:46:33.693 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.693 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.693 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.693 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.693 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.693 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.693 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.693 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.693 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.693 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.694 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.694 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.694 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.694 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.694 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.694 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.694 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.694 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.694 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.694 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.694 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.694 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.694 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.694 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.694 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.694 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.695 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.695 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.695 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.695 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.695 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.695 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.695 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.695 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.695 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.695 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.695 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.695 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.695 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.695 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.695 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.695 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.696 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.696 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.696 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.696 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.696 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.696 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.696 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.696 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.696 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.696 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.696 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.696 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.696 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.696 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.696 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.697 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.697 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.697 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.697 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.697 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.697 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.697 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.697 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.697 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.697 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.697 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.697 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.697 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.697 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.697 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rook", 2024-04-26T18:46:33.698 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.698 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.698 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.698 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.698 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.698 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.698 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.698 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.698 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.698 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.698 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.698 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.698 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.698 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.698 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.699 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.699 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.699 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.699 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.699 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.699 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.699 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.699 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.699 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.699 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.699 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.699 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.699 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.699 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.699 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.699 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.700 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.700 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.700 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.700 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.700 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.700 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.700 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.700 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.700 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.700 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.700 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.700 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.700 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.700 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.700 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.701 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.701 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.701 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.701 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.701 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.701 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.701 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.701 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.701 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.701 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.701 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.701 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.701 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.701 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.701 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.701 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.702 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.702 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.702 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.702 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.702 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.702 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.702 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.702 INFO:teuthology.orchestra.run.smithi080.stdout: "storage_class": { 2024-04-26T18:46:33.702 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "storage_class", 2024-04-26T18:46:33.702 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.702 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.702 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.702 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "local", 2024-04-26T18:46:33.702 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.702 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.702 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.703 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-26T18:46:33.703 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.703 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.703 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.703 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.703 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.703 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "selftest", 2024-04-26T18:46:33.703 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.703 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.703 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.703 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.703 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.703 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.703 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.704 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.704 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.704 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.704 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.704 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.704 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.704 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.704 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.704 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.704 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.704 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.704 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.704 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.704 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.704 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.704 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.705 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.705 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.705 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.705 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.705 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.705 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.705 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.705 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.705 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.705 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.705 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.705 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.705 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.705 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.705 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.705 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.705 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.706 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.706 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.706 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.706 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.706 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.706 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.706 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.706 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.706 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.706 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.706 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.706 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.706 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.706 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.706 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.707 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.707 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.707 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.707 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.707 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.707 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.707 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.707 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.707 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.707 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.707 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.707 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.707 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.707 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.707 INFO:teuthology.orchestra.run.smithi080.stdout: "roption1": { 2024-04-26T18:46:33.708 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "roption1", 2024-04-26T18:46:33.708 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.708 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.708 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.708 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.708 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.708 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.708 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.708 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.708 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.708 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.708 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.708 INFO:teuthology.orchestra.run.smithi080.stdout: "roption2": { 2024-04-26T18:46:33.708 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "roption2", 2024-04-26T18:46:33.708 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.708 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.709 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.709 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "xyz", 2024-04-26T18:46:33.709 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.709 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.709 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.709 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.709 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.709 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.709 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.709 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption1": { 2024-04-26T18:46:33.709 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption1", 2024-04-26T18:46:33.709 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.709 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.709 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.710 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.710 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.710 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.710 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.710 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.710 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.710 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.710 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.710 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption2": { 2024-04-26T18:46:33.710 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption2", 2024-04-26T18:46:33.710 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.710 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.710 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.710 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.711 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.711 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.711 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.711 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.711 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.711 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.711 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.711 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption3": { 2024-04-26T18:46:33.711 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption3", 2024-04-26T18:46:33.711 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-26T18:46:33.711 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.711 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.711 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.711 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.711 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.711 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.712 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.712 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.712 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.712 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.712 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption4": { 2024-04-26T18:46:33.712 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption4", 2024-04-26T18:46:33.712 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.712 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.712 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.712 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.712 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.712 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.712 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.712 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.712 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.712 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.713 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.713 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption5": { 2024-04-26T18:46:33.713 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption5", 2024-04-26T18:46:33.713 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.713 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.713 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.713 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.713 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.713 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.713 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.713 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.713 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.713 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.713 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.714 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption6": { 2024-04-26T18:46:33.714 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption6", 2024-04-26T18:46:33.714 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.714 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.714 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.714 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.714 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.714 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.714 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.714 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.714 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.714 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.714 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.714 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption7": { 2024-04-26T18:46:33.715 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption7", 2024-04-26T18:46:33.715 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.715 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.715 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.715 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.715 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1", 2024-04-26T18:46:33.715 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "42", 2024-04-26T18:46:33.715 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.715 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.715 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.715 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.715 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.715 INFO:teuthology.orchestra.run.smithi080.stdout: "testkey": { 2024-04-26T18:46:33.715 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "testkey", 2024-04-26T18:46:33.715 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.715 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.716 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.716 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.716 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.716 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.716 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.716 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.716 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.716 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.716 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.716 INFO:teuthology.orchestra.run.smithi080.stdout: "testlkey": { 2024-04-26T18:46:33.716 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "testlkey", 2024-04-26T18:46:33.716 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.716 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.716 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.716 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.716 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.717 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.717 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.717 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.717 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.717 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.717 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.717 INFO:teuthology.orchestra.run.smithi080.stdout: "testnewline": { 2024-04-26T18:46:33.717 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "testnewline", 2024-04-26T18:46:33.717 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.717 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.717 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.717 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.717 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.717 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.717 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.718 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.718 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.718 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.718 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.718 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.718 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.718 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "snap_schedule", 2024-04-26T18:46:33.718 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.718 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.718 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.718 INFO:teuthology.orchestra.run.smithi080.stdout: "allow_m_granularity": { 2024-04-26T18:46:33.718 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "allow_m_granularity", 2024-04-26T18:46:33.718 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.719 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.719 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.719 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.719 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.719 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.719 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.719 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "allow minute scheduled snapshots", 2024-04-26T18:46:33.719 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.719 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.719 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.719 INFO:teuthology.orchestra.run.smithi080.stdout: "dump_on_update": { 2024-04-26T18:46:33.719 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "dump_on_update", 2024-04-26T18:46:33.719 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.720 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.720 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.720 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.720 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.720 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.720 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.720 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "dump database to debug log on update", 2024-04-26T18:46:33.720 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.720 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.720 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.720 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.720 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.720 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.720 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.720 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.720 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.721 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.721 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.721 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.721 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.721 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.721 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.721 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.721 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.721 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.721 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.721 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.721 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.721 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.721 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.721 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.721 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.722 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.722 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.722 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.722 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.722 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.722 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.722 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.722 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.722 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.722 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.722 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.722 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.722 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.722 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.722 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.723 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.723 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.723 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.723 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.723 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.723 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.723 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.723 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.723 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.723 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.723 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.723 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.723 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.723 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.723 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.723 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.724 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.724 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.724 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.724 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.724 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.724 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.724 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.724 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.724 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.724 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.724 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.724 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.724 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.724 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.724 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.725 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "stats", 2024-04-26T18:46:33.725 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.725 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.725 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.725 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.725 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.725 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.725 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.725 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.725 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.725 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.725 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.725 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.725 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.725 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.725 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.725 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.726 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.726 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.726 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.726 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.726 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.726 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.726 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.726 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.726 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.726 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.726 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.726 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.726 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.726 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.726 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.726 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.727 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.727 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.727 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.727 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.727 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.727 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.727 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.727 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.727 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.727 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.727 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.727 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.727 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.727 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.727 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.727 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.728 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.728 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.728 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.728 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.728 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.728 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.728 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.728 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.728 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.728 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.728 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.728 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.728 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.728 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.728 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.729 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.729 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.729 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.729 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.729 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.729 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.729 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.729 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.729 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "status", 2024-04-26T18:46:33.729 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.729 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.729 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.729 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.729 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.729 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.729 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.730 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.730 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.730 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.730 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.730 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.730 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.730 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.730 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.730 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.730 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.730 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.730 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.730 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.730 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.730 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.730 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.731 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.731 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.731 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.731 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.731 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.731 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.731 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.731 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.731 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.731 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.731 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.731 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.731 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.731 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.732 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.732 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.732 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.732 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.732 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.732 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.732 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.732 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.732 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.732 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.732 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.732 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.732 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.732 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.732 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.732 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.732 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.733 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.733 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.733 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.733 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.733 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.733 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.733 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.733 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.733 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.733 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.733 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.733 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.733 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.733 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.733 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.733 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.734 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.734 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "telegraf", 2024-04-26T18:46:33.734 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.734 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.734 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.734 INFO:teuthology.orchestra.run.smithi080.stdout: "address": { 2024-04-26T18:46:33.734 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "address", 2024-04-26T18:46:33.734 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.734 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.734 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.734 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-26T18:46:33.734 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.734 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.734 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.735 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.735 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.735 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.735 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.735 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-26T18:46:33.735 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-26T18:46:33.735 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.735 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.735 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.735 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "15", 2024-04-26T18:46:33.735 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.735 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.735 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.735 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.735 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.735 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.736 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.736 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.736 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.736 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.736 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.736 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.736 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.736 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.736 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.736 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.736 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.736 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.736 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.736 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.736 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.736 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.737 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.737 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.737 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.737 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.737 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.737 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.737 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.737 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.737 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.737 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.737 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.737 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.737 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.737 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.737 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.737 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.738 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.738 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.738 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.738 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.738 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.738 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.738 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.738 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.738 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.738 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.738 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.738 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.738 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.738 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.738 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.738 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.739 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.739 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.739 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.739 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.739 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.739 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.739 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.739 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.739 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.739 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.739 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.739 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.739 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.739 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.739 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.739 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.740 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.740 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.740 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.740 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.740 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.740 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "telemetry", 2024-04-26T18:46:33.740 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.740 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.740 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.740 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_basic": { 2024-04-26T18:46:33.740 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_basic", 2024-04-26T18:46:33.740 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.740 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.740 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.740 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.741 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.741 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.741 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.741 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-26T18:46:33.741 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.741 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.741 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.741 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_crash": { 2024-04-26T18:46:33.741 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_crash", 2024-04-26T18:46:33.741 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.741 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.741 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.741 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.741 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.741 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.741 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.742 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-26T18:46:33.742 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.742 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.742 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.742 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_device": { 2024-04-26T18:46:33.742 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_device", 2024-04-26T18:46:33.742 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.742 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.742 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.742 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.742 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.742 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.742 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.742 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-26T18:46:33.742 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.743 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.743 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.743 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_ident": { 2024-04-26T18:46:33.743 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_ident", 2024-04-26T18:46:33.743 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.743 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.743 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.743 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.743 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.743 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.743 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.743 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-26T18:46:33.743 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.743 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.743 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.744 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_perf": { 2024-04-26T18:46:33.744 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_perf", 2024-04-26T18:46:33.744 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.744 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.744 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.744 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.744 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.744 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.744 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.744 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-26T18:46:33.744 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.744 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.744 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.744 INFO:teuthology.orchestra.run.smithi080.stdout: "contact": { 2024-04-26T18:46:33.744 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "contact", 2024-04-26T18:46:33.744 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.745 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.745 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.745 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.745 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.745 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.745 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.745 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.745 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.745 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.745 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.745 INFO:teuthology.orchestra.run.smithi080.stdout: "description": { 2024-04-26T18:46:33.745 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "description", 2024-04-26T18:46:33.745 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.745 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.745 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.745 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.746 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.746 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.746 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.746 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.746 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.746 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.746 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.746 INFO:teuthology.orchestra.run.smithi080.stdout: "device_url": { 2024-04-26T18:46:33.746 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "device_url", 2024-04-26T18:46:33.746 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.746 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.746 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.746 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-26T18:46:33.746 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.746 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.747 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.747 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.747 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.747 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.747 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.747 INFO:teuthology.orchestra.run.smithi080.stdout: "enabled": { 2024-04-26T18:46:33.747 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "enabled", 2024-04-26T18:46:33.747 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.747 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.747 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.747 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.747 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.747 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.747 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.747 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.747 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.748 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.748 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.748 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-26T18:46:33.748 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-26T18:46:33.748 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.748 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.748 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.748 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "24", 2024-04-26T18:46:33.748 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "8", 2024-04-26T18:46:33.748 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.748 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.748 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.748 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.748 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.748 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.749 INFO:teuthology.orchestra.run.smithi080.stdout: "last_opt_revision": { 2024-04-26T18:46:33.749 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "last_opt_revision", 2024-04-26T18:46:33.749 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.749 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.749 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.749 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "1", 2024-04-26T18:46:33.749 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.749 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.749 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.749 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.749 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.749 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.749 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.749 INFO:teuthology.orchestra.run.smithi080.stdout: "leaderboard": { 2024-04-26T18:46:33.749 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "leaderboard", 2024-04-26T18:46:33.749 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.749 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.750 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.750 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.750 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.750 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.750 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.750 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.750 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.750 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.750 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.750 INFO:teuthology.orchestra.run.smithi080.stdout: "leaderboard_description": { 2024-04-26T18:46:33.750 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "leaderboard_description", 2024-04-26T18:46:33.750 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.750 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.750 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.750 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.751 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.751 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.751 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.751 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.751 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.751 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.751 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.751 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.751 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.751 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.751 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.751 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.751 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.751 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.751 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.751 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.752 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.752 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.752 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.752 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.752 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.752 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.752 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.752 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.752 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.752 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.752 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.752 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.752 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.752 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.752 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.752 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.753 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.753 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.753 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.753 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.753 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.753 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.753 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.753 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.753 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.753 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.753 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.753 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.753 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.753 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.753 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.753 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.754 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.754 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.754 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.754 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.754 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.754 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.754 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.754 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.754 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.754 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.754 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.754 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.754 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.754 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.754 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.755 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.755 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.755 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.755 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.755 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.755 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.755 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.755 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.755 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.755 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.755 INFO:teuthology.orchestra.run.smithi080.stdout: "organization": { 2024-04-26T18:46:33.755 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "organization", 2024-04-26T18:46:33.755 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.755 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.755 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.755 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.756 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.756 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.756 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.756 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.756 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.756 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.756 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.756 INFO:teuthology.orchestra.run.smithi080.stdout: "proxy": { 2024-04-26T18:46:33.756 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "proxy", 2024-04-26T18:46:33.756 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.756 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.756 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.756 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.756 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.756 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.757 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.757 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.757 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.757 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.757 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.757 INFO:teuthology.orchestra.run.smithi080.stdout: "url": { 2024-04-26T18:46:33.757 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "url", 2024-04-26T18:46:33.757 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.757 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.757 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.757 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-26T18:46:33.757 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.757 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.757 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.757 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.758 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.758 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.758 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.758 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.758 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.758 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "test_orchestrator", 2024-04-26T18:46:33.758 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.758 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.758 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.758 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.758 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.758 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.758 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.758 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.758 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.759 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.759 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.759 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.759 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.759 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.759 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.759 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.759 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.759 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.759 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.759 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.759 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.759 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.759 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.759 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.759 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.760 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.760 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.760 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.760 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.760 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.760 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.760 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.760 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.760 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.760 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.760 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.760 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.760 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.760 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.760 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.760 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.761 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.761 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.761 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.761 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.761 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.761 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.761 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.761 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.761 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.761 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.761 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.761 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.761 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.761 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.761 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.761 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.762 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.762 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.762 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.762 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.762 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.762 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.762 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.762 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.762 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.762 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.762 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.762 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.762 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.762 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.763 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "volumes", 2024-04-26T18:46:33.763 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.763 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.763 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.763 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.763 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.763 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.763 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.763 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.763 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.763 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.763 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.763 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.763 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.763 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.763 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.763 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.764 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.764 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.764 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.764 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.764 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.764 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.764 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.764 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.764 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.764 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.764 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.764 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.764 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.764 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.764 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.764 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.765 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.765 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.765 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.765 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.765 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.765 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.765 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.765 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.765 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.765 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.765 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.765 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.765 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.765 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.765 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.765 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.766 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.766 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.766 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.766 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.766 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.766 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.766 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.766 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.766 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.766 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.766 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.766 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.766 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.766 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.767 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.767 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.767 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.767 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.767 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.767 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.767 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.767 INFO:teuthology.orchestra.run.smithi080.stdout: "max_concurrent_clones": { 2024-04-26T18:46:33.767 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_concurrent_clones", 2024-04-26T18:46:33.767 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.767 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.767 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.767 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "4", 2024-04-26T18:46:33.767 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.767 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.767 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.768 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-26T18:46:33.768 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.768 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.768 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.768 INFO:teuthology.orchestra.run.smithi080.stdout: "periodic_async_work": { 2024-04-26T18:46:33.768 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "periodic_async_work", 2024-04-26T18:46:33.768 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.768 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.768 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.768 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.768 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.768 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.768 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.768 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Periodically check for async work", 2024-04-26T18:46:33.768 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.768 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.769 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.769 INFO:teuthology.orchestra.run.smithi080.stdout: "snapshot_clone_delay": { 2024-04-26T18:46:33.769 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "snapshot_clone_delay", 2024-04-26T18:46:33.769 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.769 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.769 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.769 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-26T18:46:33.769 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.769 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.769 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.769 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-26T18:46:33.769 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.769 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.769 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.769 INFO:teuthology.orchestra.run.smithi080.stdout: "snapshot_clone_no_wait": { 2024-04-26T18:46:33.770 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "snapshot_clone_no_wait", 2024-04-26T18:46:33.770 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.770 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.770 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.770 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.770 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.770 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.770 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.770 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-26T18:46:33.770 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.770 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.770 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.770 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.770 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.771 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "zabbix", 2024-04-26T18:46:33.771 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.771 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.771 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.771 INFO:teuthology.orchestra.run.smithi080.stdout: "discovery_interval": { 2024-04-26T18:46:33.771 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "discovery_interval", 2024-04-26T18:46:33.771 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-26T18:46:33.771 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.771 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.771 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "100", 2024-04-26T18:46:33.771 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.771 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.771 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.771 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.771 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.771 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.771 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.772 INFO:teuthology.orchestra.run.smithi080.stdout: "identifier": { 2024-04-26T18:46:33.772 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "identifier", 2024-04-26T18:46:33.772 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.772 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.772 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.772 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.772 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.772 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.772 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.772 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.772 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.772 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.772 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.772 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-26T18:46:33.772 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-26T18:46:33.773 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.773 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.773 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.773 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-26T18:46:33.773 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.773 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.773 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.773 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.773 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.773 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.773 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.773 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.773 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.773 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.773 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.773 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.773 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.774 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.774 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.774 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.774 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.774 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.774 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.774 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.774 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.774 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.774 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.774 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.774 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.774 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.774 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.774 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.775 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.775 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.775 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.775 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.775 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.775 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.775 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.775 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.775 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.775 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.775 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.775 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.775 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.775 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.775 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.775 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.776 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.776 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.776 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.776 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.776 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.776 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.776 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.776 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.776 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.776 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.776 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.776 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.776 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.776 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.776 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.776 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.777 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.777 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.777 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.777 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.777 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.777 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.777 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.777 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.777 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.777 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.777 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.777 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.777 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.777 INFO:teuthology.orchestra.run.smithi080.stdout: "zabbix_host": { 2024-04-26T18:46:33.777 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "zabbix_host", 2024-04-26T18:46:33.778 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.778 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.778 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.778 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.778 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.778 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.778 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.778 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.778 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.778 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.778 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.778 INFO:teuthology.orchestra.run.smithi080.stdout: "zabbix_port": { 2024-04-26T18:46:33.778 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "zabbix_port", 2024-04-26T18:46:33.778 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.778 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.778 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.779 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10051", 2024-04-26T18:46:33.779 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.779 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.779 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.779 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.779 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.779 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.779 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.779 INFO:teuthology.orchestra.run.smithi080.stdout: "zabbix_sender": { 2024-04-26T18:46:33.779 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "zabbix_sender", 2024-04-26T18:46:33.779 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.779 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.779 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.779 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-26T18:46:33.779 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.780 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.780 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.780 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.780 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.780 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.780 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.780 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.780 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.780 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.780 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-26T18:46:33.780 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.780 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.780 INFO:teuthology.orchestra.run.smithi080.stdout: "modules": [ 2024-04-26T18:46:33.780 INFO:teuthology.orchestra.run.smithi080.stdout: "cephadm", 2024-04-26T18:46:33.780 INFO:teuthology.orchestra.run.smithi080.stdout: "dashboard", 2024-04-26T18:46:33.780 INFO:teuthology.orchestra.run.smithi080.stdout: "iostat", 2024-04-26T18:46:33.780 INFO:teuthology.orchestra.run.smithi080.stdout: "nfs", 2024-04-26T18:46:33.781 INFO:teuthology.orchestra.run.smithi080.stdout: "restful", 2024-04-26T18:46:33.781 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_schedule" 2024-04-26T18:46:33.781 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.781 INFO:teuthology.orchestra.run.smithi080.stdout: "available_modules": [ 2024-04-26T18:46:33.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.781 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "alerts", 2024-04-26T18:46:33.781 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.781 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.781 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.781 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-26T18:46:33.781 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-26T18:46:33.781 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.781 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.781 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.781 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-26T18:46:33.781 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.782 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.782 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.782 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "How frequently to reexamine health status", 2024-04-26T18:46:33.782 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.782 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.782 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.782 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.782 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.782 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.782 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.782 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.782 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.782 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.782 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.782 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.783 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.783 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.783 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.783 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.783 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.783 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.783 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.783 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.783 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.783 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.783 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.783 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.783 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.783 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.783 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.783 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.783 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.784 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.784 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.784 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.784 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.784 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.784 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.784 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.784 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.784 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.784 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.784 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.784 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.784 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.784 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.784 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.784 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.785 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.785 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.785 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.785 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.785 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.785 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.785 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.785 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.785 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.785 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.785 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.785 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.785 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.785 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.785 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.785 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.786 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.786 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.786 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.786 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.786 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.786 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.786 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.786 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.786 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_destination": { 2024-04-26T18:46:33.786 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_destination", 2024-04-26T18:46:33.786 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.786 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.786 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.786 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.786 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.786 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.787 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.787 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Email address to send alerts to", 2024-04-26T18:46:33.787 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.787 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.787 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.787 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_from_name": { 2024-04-26T18:46:33.787 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_from_name", 2024-04-26T18:46:33.787 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.787 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.787 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.787 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "Ceph", 2024-04-26T18:46:33.787 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.787 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.787 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.787 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Email From: name", 2024-04-26T18:46:33.787 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.788 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.788 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.788 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_host": { 2024-04-26T18:46:33.788 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_host", 2024-04-26T18:46:33.788 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.788 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.788 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.788 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.788 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.788 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.788 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.788 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "SMTP server", 2024-04-26T18:46:33.788 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.788 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.788 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.789 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_password": { 2024-04-26T18:46:33.789 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_password", 2024-04-26T18:46:33.789 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.789 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.789 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.789 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.789 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.789 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.789 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.789 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Password to authenticate with", 2024-04-26T18:46:33.789 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.789 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.789 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.789 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_port": { 2024-04-26T18:46:33.789 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_port", 2024-04-26T18:46:33.790 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.790 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.790 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.790 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "465", 2024-04-26T18:46:33.790 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.790 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.790 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.790 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "SMTP port", 2024-04-26T18:46:33.790 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.790 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.790 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.790 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_sender": { 2024-04-26T18:46:33.790 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_sender", 2024-04-26T18:46:33.790 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.790 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.791 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.791 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.791 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.791 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.791 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.791 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "SMTP envelope sender", 2024-04-26T18:46:33.791 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.791 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.791 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.791 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_ssl": { 2024-04-26T18:46:33.791 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_ssl", 2024-04-26T18:46:33.791 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.791 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.791 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.791 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.792 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.792 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.792 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.792 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-26T18:46:33.792 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.792 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.792 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.792 INFO:teuthology.orchestra.run.smithi080.stdout: "smtp_user": { 2024-04-26T18:46:33.792 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "smtp_user", 2024-04-26T18:46:33.792 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.792 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.792 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.792 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.792 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.792 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.792 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.793 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "User to authenticate as", 2024-04-26T18:46:33.793 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.793 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.793 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.793 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.793 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.793 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "balancer", 2024-04-26T18:46:33.793 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.793 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.793 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.793 INFO:teuthology.orchestra.run.smithi080.stdout: "active": { 2024-04-26T18:46:33.793 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "active", 2024-04-26T18:46:33.793 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.793 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.793 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.794 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.794 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.794 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.794 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.794 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "automatically balance PGs across cluster", 2024-04-26T18:46:33.794 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.794 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.794 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.794 INFO:teuthology.orchestra.run.smithi080.stdout: "begin_time": { 2024-04-26T18:46:33.794 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "begin_time", 2024-04-26T18:46:33.794 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.794 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.794 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.794 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0000", 2024-04-26T18:46:33.794 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.795 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.795 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.795 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "beginning time of day to automatically balance", 2024-04-26T18:46:33.795 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-26T18:46:33.795 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.795 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.795 INFO:teuthology.orchestra.run.smithi080.stdout: "begin_weekday": { 2024-04-26T18:46:33.795 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "begin_weekday", 2024-04-26T18:46:33.795 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-26T18:46:33.795 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.795 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.795 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-26T18:46:33.795 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "0", 2024-04-26T18:46:33.795 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "6", 2024-04-26T18:46:33.795 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.795 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-26T18:46:33.796 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-26T18:46:33.796 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.796 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.796 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_compat_max_iterations": { 2024-04-26T18:46:33.796 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crush_compat_max_iterations", 2024-04-26T18:46:33.796 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-26T18:46:33.796 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.796 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.796 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "25", 2024-04-26T18:46:33.796 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1", 2024-04-26T18:46:33.796 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "250", 2024-04-26T18:46:33.796 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.796 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-26T18:46:33.796 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.796 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.796 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.797 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_compat_metrics": { 2024-04-26T18:46:33.797 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crush_compat_metrics", 2024-04-26T18:46:33.797 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.797 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.797 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.797 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "pgs,objects,bytes", 2024-04-26T18:46:33.797 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.797 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.797 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.797 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-26T18:46:33.797 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-26T18:46:33.797 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.797 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.797 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_compat_step": { 2024-04-26T18:46:33.798 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crush_compat_step", 2024-04-26T18:46:33.798 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-26T18:46:33.798 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.798 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.798 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0.5", 2024-04-26T18:46:33.798 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "0.001", 2024-04-26T18:46:33.798 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "0.999", 2024-04-26T18:46:33.798 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.798 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "aggressiveness of optimization", 2024-04-26T18:46:33.798 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-26T18:46:33.798 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.798 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.798 INFO:teuthology.orchestra.run.smithi080.stdout: "end_time": { 2024-04-26T18:46:33.798 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "end_time", 2024-04-26T18:46:33.798 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.799 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.799 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.799 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "2359", 2024-04-26T18:46:33.799 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.799 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.799 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.799 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "ending time of day to automatically balance", 2024-04-26T18:46:33.799 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-26T18:46:33.799 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.799 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.799 INFO:teuthology.orchestra.run.smithi080.stdout: "end_weekday": { 2024-04-26T18:46:33.799 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "end_weekday", 2024-04-26T18:46:33.799 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-26T18:46:33.799 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.799 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.799 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-26T18:46:33.800 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "0", 2024-04-26T18:46:33.800 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "6", 2024-04-26T18:46:33.800 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.800 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-26T18:46:33.800 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-26T18:46:33.800 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.800 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.800 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.800 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.800 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.800 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.800 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.800 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.800 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.800 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.800 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.801 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.801 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.801 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.801 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.801 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.801 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.801 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.801 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.801 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.801 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.801 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.801 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.801 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.801 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.801 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.802 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.802 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.802 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.802 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.802 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.802 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.802 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.802 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.802 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.802 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.802 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.802 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.802 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.803 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.803 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.803 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.803 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.803 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.803 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.803 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.803 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.803 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.803 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.803 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.803 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.803 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.803 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.803 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.803 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.804 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.804 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.804 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.804 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.804 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.804 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.804 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.804 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.804 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.804 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.804 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.804 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.804 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.804 INFO:teuthology.orchestra.run.smithi080.stdout: "min_score": { 2024-04-26T18:46:33.804 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "min_score", 2024-04-26T18:46:33.805 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-26T18:46:33.805 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.805 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.805 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-26T18:46:33.805 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.805 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.805 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.805 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-26T18:46:33.805 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.805 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.805 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.805 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": { 2024-04-26T18:46:33.805 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mode", 2024-04-26T18:46:33.805 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.805 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.805 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.806 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "upmap", 2024-04-26T18:46:33.806 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.806 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.806 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.806 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-compat", 2024-04-26T18:46:33.806 INFO:teuthology.orchestra.run.smithi080.stdout: "none", 2024-04-26T18:46:33.806 INFO:teuthology.orchestra.run.smithi080.stdout: "read", 2024-04-26T18:46:33.806 INFO:teuthology.orchestra.run.smithi080.stdout: "upmap", 2024-04-26T18:46:33.806 INFO:teuthology.orchestra.run.smithi080.stdout: "upmap-read" 2024-04-26T18:46:33.806 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.806 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Balancer mode", 2024-04-26T18:46:33.806 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.806 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.806 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.806 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_ids": { 2024-04-26T18:46:33.807 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "pool_ids", 2024-04-26T18:46:33.807 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.807 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.807 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.807 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.807 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.807 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.807 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.807 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-26T18:46:33.807 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.807 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.807 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.807 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-26T18:46:33.807 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-26T18:46:33.807 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.807 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.808 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.808 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-26T18:46:33.808 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.808 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.808 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.808 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-26T18:46:33.808 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.808 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.808 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.808 INFO:teuthology.orchestra.run.smithi080.stdout: "upmap_max_deviation": { 2024-04-26T18:46:33.808 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "upmap_max_deviation", 2024-04-26T18:46:33.808 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.808 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.808 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.808 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5", 2024-04-26T18:46:33.808 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1", 2024-04-26T18:46:33.809 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.809 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.809 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-26T18:46:33.809 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-26T18:46:33.809 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.809 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.809 INFO:teuthology.orchestra.run.smithi080.stdout: "upmap_max_optimizations": { 2024-04-26T18:46:33.809 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "upmap_max_optimizations", 2024-04-26T18:46:33.809 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-26T18:46:33.809 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.809 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.809 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-26T18:46:33.809 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.809 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.809 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.810 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-26T18:46:33.810 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.810 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.810 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.810 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.810 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.810 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cephadm", 2024-04-26T18:46:33.810 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.810 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.810 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.810 INFO:teuthology.orchestra.run.smithi080.stdout: "agent_down_multiplier": { 2024-04-26T18:46:33.810 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "agent_down_multiplier", 2024-04-26T18:46:33.810 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-26T18:46:33.810 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.811 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.811 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "3.0", 2024-04-26T18:46:33.811 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.811 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.811 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.811 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-26T18:46:33.811 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.811 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.811 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.811 INFO:teuthology.orchestra.run.smithi080.stdout: "agent_refresh_rate": { 2024-04-26T18:46:33.811 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "agent_refresh_rate", 2024-04-26T18:46:33.811 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.811 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.811 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.811 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "20", 2024-04-26T18:46:33.811 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.812 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.812 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.812 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-26T18:46:33.812 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.812 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.812 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.812 INFO:teuthology.orchestra.run.smithi080.stdout: "agent_starting_port": { 2024-04-26T18:46:33.812 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "agent_starting_port", 2024-04-26T18:46:33.812 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.812 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.812 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.812 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "4721", 2024-04-26T18:46:33.812 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.812 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.812 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.812 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-26T18:46:33.813 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.813 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.813 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.813 INFO:teuthology.orchestra.run.smithi080.stdout: "allow_ptrace": { 2024-04-26T18:46:33.813 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "allow_ptrace", 2024-04-26T18:46:33.813 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.813 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.813 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.813 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.813 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.813 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.813 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.813 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-26T18:46:33.813 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-26T18:46:33.813 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.813 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.814 INFO:teuthology.orchestra.run.smithi080.stdout: "autotune_interval": { 2024-04-26T18:46:33.814 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "autotune_interval", 2024-04-26T18:46:33.814 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.814 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.814 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.814 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-26T18:46:33.814 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.814 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.814 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.814 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-26T18:46:33.814 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.814 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.814 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.814 INFO:teuthology.orchestra.run.smithi080.stdout: "autotune_memory_target_ratio": { 2024-04-26T18:46:33.815 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "autotune_memory_target_ratio", 2024-04-26T18:46:33.815 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-26T18:46:33.815 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.815 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.815 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0.7", 2024-04-26T18:46:33.815 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.815 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.815 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.815 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-26T18:46:33.815 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.815 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.815 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.815 INFO:teuthology.orchestra.run.smithi080.stdout: "cephadm_log_destination": { 2024-04-26T18:46:33.815 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cephadm_log_destination", 2024-04-26T18:46:33.815 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.816 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.816 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.816 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.816 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.816 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.816 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.816 INFO:teuthology.orchestra.run.smithi080.stdout: "file", 2024-04-26T18:46:33.816 INFO:teuthology.orchestra.run.smithi080.stdout: "file,syslog", 2024-04-26T18:46:33.816 INFO:teuthology.orchestra.run.smithi080.stdout: "syslog" 2024-04-26T18:46:33.816 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.816 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-26T18:46:33.816 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.816 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.816 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.816 INFO:teuthology.orchestra.run.smithi080.stdout: "cgroups_split": { 2024-04-26T18:46:33.817 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cgroups_split", 2024-04-26T18:46:33.817 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.817 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.817 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.817 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.817 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.817 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.817 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.817 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-26T18:46:33.817 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.817 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.817 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.817 INFO:teuthology.orchestra.run.smithi080.stdout: "config_checks_enabled": { 2024-04-26T18:46:33.817 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "config_checks_enabled", 2024-04-26T18:46:33.817 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.818 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.818 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.818 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.818 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.818 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.818 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.818 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-26T18:46:33.818 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.818 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.818 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.818 INFO:teuthology.orchestra.run.smithi080.stdout: "config_dashboard": { 2024-04-26T18:46:33.818 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "config_dashboard", 2024-04-26T18:46:33.818 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.818 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.818 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.819 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.819 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.819 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.819 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.819 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-26T18:46:33.819 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.819 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.819 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.819 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_alertmanager": { 2024-04-26T18:46:33.819 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_alertmanager", 2024-04-26T18:46:33.819 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.819 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.819 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.819 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-26T18:46:33.820 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.820 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.820 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.820 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Prometheus container image", 2024-04-26T18:46:33.820 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.820 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.820 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.820 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_base": { 2024-04-26T18:46:33.820 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_base", 2024-04-26T18:46:33.820 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.820 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.820 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.820 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-26T18:46:33.820 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.820 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.821 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.821 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Container image name, without the tag", 2024-04-26T18:46:33.821 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.821 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.821 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.821 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_elasticsearch": { 2024-04-26T18:46:33.821 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_elasticsearch", 2024-04-26T18:46:33.821 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.821 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.821 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.821 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-26T18:46:33.821 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.821 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.821 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.821 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "elasticsearch container image", 2024-04-26T18:46:33.821 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.822 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.822 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.822 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_grafana": { 2024-04-26T18:46:33.822 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_grafana", 2024-04-26T18:46:33.822 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.822 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.822 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.822 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-26T18:46:33.822 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.822 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.822 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.822 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Prometheus container image", 2024-04-26T18:46:33.822 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.822 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.823 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.823 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.823 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_haproxy": { 2024-04-26T18:46:33.823 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_haproxy", 2024-04-26T18:46:33.823 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.823 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.823 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.823 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-26T18:46:33.823 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.823 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.823 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.823 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "HAproxy container image", 2024-04-26T18:46:33.823 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.823 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.823 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.823 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.823 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_jaeger_agent": { 2024-04-26T18:46:33.824 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_jaeger_agent", 2024-04-26T18:46:33.824 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.824 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.824 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.824 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-26T18:46:33.824 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.824 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.824 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.824 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Jaeger agent container image", 2024-04-26T18:46:33.824 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.824 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.824 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.824 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_jaeger_collector": { 2024-04-26T18:46:33.824 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_jaeger_collector", 2024-04-26T18:46:33.824 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.824 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.825 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.825 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-26T18:46:33.825 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.825 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.825 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.825 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Jaeger collector container image", 2024-04-26T18:46:33.825 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.825 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.825 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.825 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_jaeger_query": { 2024-04-26T18:46:33.825 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_jaeger_query", 2024-04-26T18:46:33.825 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.825 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.825 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.825 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-26T18:46:33.825 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.826 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.826 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.826 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Jaeger query container image", 2024-04-26T18:46:33.826 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.826 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.826 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.826 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_keepalived": { 2024-04-26T18:46:33.826 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_keepalived", 2024-04-26T18:46:33.826 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.826 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.826 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.826 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-26T18:46:33.826 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.826 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.826 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.827 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Keepalived container image", 2024-04-26T18:46:33.827 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.827 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.827 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.827 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_loki": { 2024-04-26T18:46:33.827 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_loki", 2024-04-26T18:46:33.827 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.827 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.827 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.827 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-26T18:46:33.827 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.827 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.827 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.827 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Loki container image", 2024-04-26T18:46:33.827 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.828 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.828 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.828 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.828 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_node_exporter": { 2024-04-26T18:46:33.828 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_node_exporter", 2024-04-26T18:46:33.828 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.828 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.828 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.828 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-26T18:46:33.828 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.828 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.828 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.828 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Prometheus container image", 2024-04-26T18:46:33.828 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.828 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.828 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.829 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_nvmeof": { 2024-04-26T18:46:33.829 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_nvmeof", 2024-04-26T18:46:33.829 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.829 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.829 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.829 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-26T18:46:33.829 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.829 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.829 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.829 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Nvme-of container image", 2024-04-26T18:46:33.829 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.829 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.829 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.830 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_prometheus": { 2024-04-26T18:46:33.830 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_prometheus", 2024-04-26T18:46:33.830 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.830 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.830 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.830 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-26T18:46:33.830 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.830 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.830 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.830 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Prometheus container image", 2024-04-26T18:46:33.830 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.830 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.830 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.830 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_promtail": { 2024-04-26T18:46:33.830 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_promtail", 2024-04-26T18:46:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-26T18:46:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Promtail container image", 2024-04-26T18:46:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_samba": { 2024-04-26T18:46:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_samba", 2024-04-26T18:46:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.831 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-26T18:46:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Samba/SMB container image", 2024-04-26T18:46:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image_snmp_gateway": { 2024-04-26T18:46:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_image_snmp_gateway", 2024-04-26T18:46:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-26T18:46:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.832 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.833 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.833 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "SNMP Gateway container image", 2024-04-26T18:46:33.833 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.833 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.833 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.833 INFO:teuthology.orchestra.run.smithi080.stdout: "container_init": { 2024-04-26T18:46:33.833 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "container_init", 2024-04-26T18:46:33.833 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.833 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.833 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.833 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.833 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.833 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.833 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.833 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Run podman/docker with `--init`", 2024-04-26T18:46:33.834 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.834 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.834 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.834 INFO:teuthology.orchestra.run.smithi080.stdout: "daemon_cache_timeout": { 2024-04-26T18:46:33.834 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "daemon_cache_timeout", 2024-04-26T18:46:33.834 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.834 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.834 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.834 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-26T18:46:33.834 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.834 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.834 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.834 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-26T18:46:33.834 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.834 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.835 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.835 INFO:teuthology.orchestra.run.smithi080.stdout: "default_cephadm_command_timeout": { 2024-04-26T18:46:33.835 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "default_cephadm_command_timeout", 2024-04-26T18:46:33.835 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.835 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.835 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.835 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "900", 2024-04-26T18:46:33.835 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.835 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.835 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.835 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-26T18:46:33.835 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.835 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.835 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.836 INFO:teuthology.orchestra.run.smithi080.stdout: "default_registry": { 2024-04-26T18:46:33.836 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "default_registry", 2024-04-26T18:46:33.836 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.836 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.836 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.836 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "docker.io", 2024-04-26T18:46:33.836 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.836 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.836 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.836 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-26T18:46:33.836 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.836 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.836 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.836 INFO:teuthology.orchestra.run.smithi080.stdout: "device_cache_timeout": { 2024-04-26T18:46:33.837 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "device_cache_timeout", 2024-04-26T18:46:33.837 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.837 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.837 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.837 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "1800", 2024-04-26T18:46:33.837 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.837 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.837 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.837 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "seconds to cache device inventory", 2024-04-26T18:46:33.837 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.837 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.837 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.837 INFO:teuthology.orchestra.run.smithi080.stdout: "device_enhanced_scan": { 2024-04-26T18:46:33.837 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "device_enhanced_scan", 2024-04-26T18:46:33.837 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.838 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.838 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.838 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.838 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.838 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.838 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.838 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-26T18:46:33.838 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.838 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.838 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.838 INFO:teuthology.orchestra.run.smithi080.stdout: "facts_cache_timeout": { 2024-04-26T18:46:33.838 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "facts_cache_timeout", 2024-04-26T18:46:33.838 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.838 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.839 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.839 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-26T18:46:33.839 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.839 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.839 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.839 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "seconds to cache host facts data", 2024-04-26T18:46:33.839 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.839 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.839 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.839 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.839 INFO:teuthology.orchestra.run.smithi080.stdout: "grafana_dashboards_path": { 2024-04-26T18:46:33.839 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "grafana_dashboards_path", 2024-04-26T18:46:33.839 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.839 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.839 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.840 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-26T18:46:33.840 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.840 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.840 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.840 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-26T18:46:33.840 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.840 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.840 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.840 INFO:teuthology.orchestra.run.smithi080.stdout: "host_check_interval": { 2024-04-26T18:46:33.840 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "host_check_interval", 2024-04-26T18:46:33.840 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.840 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.840 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.840 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-26T18:46:33.840 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.840 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.841 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.841 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to perform a host check", 2024-04-26T18:46:33.841 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.841 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.841 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.841 INFO:teuthology.orchestra.run.smithi080.stdout: "hw_monitoring": { 2024-04-26T18:46:33.841 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "hw_monitoring", 2024-04-26T18:46:33.841 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.841 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.841 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.841 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.841 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.841 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.841 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.841 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-26T18:46:33.842 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.842 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.842 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.842 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.842 INFO:teuthology.orchestra.run.smithi080.stdout: "inventory_list_all": { 2024-04-26T18:46:33.842 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "inventory_list_all", 2024-04-26T18:46:33.842 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.842 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.842 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.842 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.842 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.842 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.842 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.842 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-26T18:46:33.842 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.842 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.843 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.843 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.843 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.843 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.843 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.843 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.843 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.843 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.843 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.843 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.843 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.843 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.843 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.843 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.843 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.843 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.844 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.844 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.844 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.844 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.844 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.844 INFO:teuthology.orchestra.run.smithi080.stdout: "log_refresh_metadata": { 2024-04-26T18:46:33.844 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_refresh_metadata", 2024-04-26T18:46:33.844 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.844 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.844 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.844 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.844 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.844 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.844 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.844 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-26T18:46:33.844 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.845 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.845 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.845 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.845 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.845 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.845 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.845 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.845 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.845 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.845 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.845 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.845 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-26T18:46:33.845 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.845 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.845 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.846 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.846 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.846 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.846 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.846 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.846 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.846 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.846 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.846 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.846 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.846 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.846 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.846 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.846 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.846 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.846 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.847 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.847 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.847 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.847 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.847 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.847 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.847 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.847 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.847 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.847 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.847 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.847 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.847 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.847 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.847 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.847 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.848 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.848 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.848 INFO:teuthology.orchestra.run.smithi080.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-26T18:46:33.848 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-26T18:46:33.848 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.848 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.848 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.848 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.848 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.848 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.848 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.848 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-26T18:46:33.848 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.848 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.848 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.849 INFO:teuthology.orchestra.run.smithi080.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-26T18:46:33.849 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-26T18:46:33.849 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.849 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.849 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.849 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "*", 2024-04-26T18:46:33.849 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.849 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.849 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.849 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-26T18:46:33.849 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.849 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.849 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.849 INFO:teuthology.orchestra.run.smithi080.stdout: "max_count_per_host": { 2024-04-26T18:46:33.849 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_count_per_host", 2024-04-26T18:46:33.849 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.850 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.850 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.850 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-26T18:46:33.850 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.850 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.850 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.850 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "max number of daemons per service per host", 2024-04-26T18:46:33.850 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.850 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.850 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.850 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd_draining_count": { 2024-04-26T18:46:33.850 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_osd_draining_count", 2024-04-26T18:46:33.850 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.850 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.850 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.851 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-26T18:46:33.851 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.851 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.851 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.851 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-26T18:46:33.851 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.851 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.851 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.851 INFO:teuthology.orchestra.run.smithi080.stdout: "migration_current": { 2024-04-26T18:46:33.851 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "migration_current", 2024-04-26T18:46:33.851 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.851 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.851 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.851 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.851 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.851 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.852 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.852 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "internal - do not modify", 2024-04-26T18:46:33.852 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.852 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.852 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.852 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.852 INFO:teuthology.orchestra.run.smithi080.stdout: "mode": { 2024-04-26T18:46:33.852 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mode", 2024-04-26T18:46:33.852 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.852 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.852 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.852 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "root", 2024-04-26T18:46:33.852 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.852 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.852 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.852 INFO:teuthology.orchestra.run.smithi080.stdout: "cephadm-package", 2024-04-26T18:46:33.852 INFO:teuthology.orchestra.run.smithi080.stdout: "root" 2024-04-26T18:46:33.852 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.853 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "mode for remote execution of cephadm", 2024-04-26T18:46:33.853 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.853 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.853 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.853 INFO:teuthology.orchestra.run.smithi080.stdout: "oob_default_addr": { 2024-04-26T18:46:33.853 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "oob_default_addr", 2024-04-26T18:46:33.853 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.853 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.853 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.853 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "169.254.1.1", 2024-04-26T18:46:33.853 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.853 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.853 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.853 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-26T18:46:33.853 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.854 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.854 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.854 INFO:teuthology.orchestra.run.smithi080.stdout: "prometheus_alerts_path": { 2024-04-26T18:46:33.854 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "prometheus_alerts_path", 2024-04-26T18:46:33.854 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.854 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.854 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.854 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-26T18:46:33.854 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.854 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.854 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.854 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-26T18:46:33.854 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.854 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.855 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.855 INFO:teuthology.orchestra.run.smithi080.stdout: "registry_insecure": { 2024-04-26T18:46:33.855 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "registry_insecure", 2024-04-26T18:46:33.855 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.855 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.855 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.855 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.855 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.855 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.855 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.855 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-26T18:46:33.855 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.855 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.855 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.855 INFO:teuthology.orchestra.run.smithi080.stdout: "registry_password": { 2024-04-26T18:46:33.855 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "registry_password", 2024-04-26T18:46:33.856 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.856 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.856 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.856 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.856 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.856 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.856 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.856 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-26T18:46:33.856 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.856 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.856 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.856 INFO:teuthology.orchestra.run.smithi080.stdout: "registry_url": { 2024-04-26T18:46:33.856 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "registry_url", 2024-04-26T18:46:33.856 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.857 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.857 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.857 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.857 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.857 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.857 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.857 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-26T18:46:33.857 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.857 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.857 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.857 INFO:teuthology.orchestra.run.smithi080.stdout: "registry_username": { 2024-04-26T18:46:33.857 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "registry_username", 2024-04-26T18:46:33.857 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.857 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.857 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.857 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.858 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.858 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.858 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.858 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-26T18:46:33.858 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.858 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.858 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.858 INFO:teuthology.orchestra.run.smithi080.stdout: "secure_monitoring_stack": { 2024-04-26T18:46:33.858 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "secure_monitoring_stack", 2024-04-26T18:46:33.858 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.858 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.858 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.858 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.858 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.859 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.859 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.859 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-26T18:46:33.859 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.859 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.859 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.859 INFO:teuthology.orchestra.run.smithi080.stdout: "service_discovery_port": { 2024-04-26T18:46:33.859 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "service_discovery_port", 2024-04-26T18:46:33.859 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.859 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.859 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.859 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8765", 2024-04-26T18:46:33.859 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.859 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.859 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.859 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "cephadm service discovery port", 2024-04-26T18:46:33.860 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.860 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.860 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.860 INFO:teuthology.orchestra.run.smithi080.stdout: "ssh_config_file": { 2024-04-26T18:46:33.860 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ssh_config_file", 2024-04-26T18:46:33.860 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.860 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.860 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.860 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.860 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.860 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.860 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.860 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-26T18:46:33.860 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.860 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.860 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.861 INFO:teuthology.orchestra.run.smithi080.stdout: "use_agent": { 2024-04-26T18:46:33.861 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "use_agent", 2024-04-26T18:46:33.861 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.861 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.861 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.861 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.861 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.861 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.861 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.861 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-26T18:46:33.861 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.861 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.861 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.861 INFO:teuthology.orchestra.run.smithi080.stdout: "use_repo_digest": { 2024-04-26T18:46:33.861 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "use_repo_digest", 2024-04-26T18:46:33.862 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.862 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.862 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.862 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.862 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.862 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.862 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.862 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-26T18:46:33.862 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.862 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.862 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.862 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_on_failed_host_check": { 2024-04-26T18:46:33.862 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_on_failed_host_check", 2024-04-26T18:46:33.862 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.862 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.863 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.863 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.863 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.863 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.863 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.863 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "raise a health warning if the host check fails", 2024-04-26T18:46:33.863 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.863 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.863 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.863 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_on_stray_daemons": { 2024-04-26T18:46:33.863 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_on_stray_daemons", 2024-04-26T18:46:33.863 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.863 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.863 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.863 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.864 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.864 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.864 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.864 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-26T18:46:33.864 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.864 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.864 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.864 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.864 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_on_stray_hosts": { 2024-04-26T18:46:33.864 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_on_stray_hosts", 2024-04-26T18:46:33.864 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.864 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.864 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.864 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.864 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.864 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.864 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.864 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-26T18:46:33.865 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.865 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.865 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.865 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.865 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.865 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.865 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.865 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crash", 2024-04-26T18:46:33.865 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.865 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.865 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.865 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.865 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.865 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.865 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.865 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.866 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.866 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.866 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.866 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.866 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.866 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.866 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.866 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.866 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.866 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.866 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.866 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.866 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.866 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.866 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.866 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.867 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.867 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.867 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.867 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.867 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.867 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.867 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.867 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.867 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.867 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.867 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.867 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.867 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.867 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.867 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.867 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.868 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.868 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.868 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.868 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.868 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.868 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.868 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.868 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.868 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.868 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.868 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.868 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.868 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.868 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.868 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.868 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.868 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.869 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.869 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.869 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.869 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.869 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.869 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.869 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.869 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.869 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.869 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.869 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.869 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.869 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.869 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.869 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.869 INFO:teuthology.orchestra.run.smithi080.stdout: "retain_interval": { 2024-04-26T18:46:33.869 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "retain_interval", 2024-04-26T18:46:33.870 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.870 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.870 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.870 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "31536000", 2024-04-26T18:46:33.870 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.870 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.870 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.870 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-26T18:46:33.870 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.870 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.870 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.870 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.870 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_recent_interval": { 2024-04-26T18:46:33.870 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_recent_interval", 2024-04-26T18:46:33.870 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.870 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.870 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.871 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "1209600", 2024-04-26T18:46:33.871 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.871 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.871 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.871 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-26T18:46:33.871 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.871 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.871 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.871 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.871 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.871 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.871 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.871 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "dashboard", 2024-04-26T18:46:33.871 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.871 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.871 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.871 INFO:teuthology.orchestra.run.smithi080.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-26T18:46:33.872 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-26T18:46:33.872 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.872 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.872 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.872 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-26T18:46:33.872 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.872 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.872 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.872 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.872 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.872 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.872 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.872 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.872 INFO:teuthology.orchestra.run.smithi080.stdout: "ALERTMANAGER_API_HOST": { 2024-04-26T18:46:33.872 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-26T18:46:33.872 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.872 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.873 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.873 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.873 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.873 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.873 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.873 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.873 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.873 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.873 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.873 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.873 INFO:teuthology.orchestra.run.smithi080.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-26T18:46:33.873 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-26T18:46:33.873 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.873 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.873 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.873 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.873 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.874 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.874 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.874 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.874 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.874 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.874 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.874 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.874 INFO:teuthology.orchestra.run.smithi080.stdout: "AUDIT_API_ENABLED": { 2024-04-26T18:46:33.874 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "AUDIT_API_ENABLED", 2024-04-26T18:46:33.874 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.874 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.874 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.874 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.874 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.874 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.875 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.875 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.875 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.875 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.875 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.875 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.875 INFO:teuthology.orchestra.run.smithi080.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-26T18:46:33.875 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-26T18:46:33.875 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.875 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.875 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.875 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.875 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.875 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.875 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.875 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.875 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.876 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.876 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.876 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.876 INFO:teuthology.orchestra.run.smithi080.stdout: "ENABLE_BROWSABLE_API": { 2024-04-26T18:46:33.876 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-26T18:46:33.876 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.876 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.876 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.876 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.876 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.876 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.876 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.876 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.876 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.876 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.876 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.876 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.877 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-26T18:46:33.877 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-26T18:46:33.877 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.877 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.877 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.877 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.877 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.877 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.877 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.877 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.877 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.877 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.877 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.877 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-26T18:46:33.877 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-26T18:46:33.877 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.877 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.878 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.878 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.878 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.878 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.878 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.878 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.878 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.878 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.878 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.878 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-26T18:46:33.878 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-26T18:46:33.878 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.878 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.878 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.878 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.879 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.879 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.879 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.879 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.879 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.879 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.879 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.879 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-26T18:46:33.879 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-26T18:46:33.879 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.879 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.879 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.879 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.879 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.879 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.879 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.880 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.880 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.880 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.880 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.880 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.880 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-26T18:46:33.880 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-26T18:46:33.880 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.880 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.880 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.880 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.880 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.880 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.880 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.880 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.880 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.880 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.881 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.881 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.881 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-26T18:46:33.881 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-26T18:46:33.881 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.881 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.881 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.881 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.881 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.881 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.881 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.881 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.881 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.881 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.881 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.881 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.881 INFO:teuthology.orchestra.run.smithi080.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-26T18:46:33.882 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-26T18:46:33.882 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.882 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.882 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.882 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.882 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.882 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.882 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.882 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.882 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.882 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.882 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.882 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.882 INFO:teuthology.orchestra.run.smithi080.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-26T18:46:33.882 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-26T18:46:33.882 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.883 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.883 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.883 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.883 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.883 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.883 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.883 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.883 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.883 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.883 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.883 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.883 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_API_PASSWORD": { 2024-04-26T18:46:33.883 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-26T18:46:33.883 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.883 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.883 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.883 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "admin", 2024-04-26T18:46:33.884 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.884 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.884 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.884 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.884 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.884 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.884 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.884 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.884 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-26T18:46:33.884 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-26T18:46:33.884 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.884 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.884 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.884 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.884 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.884 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.884 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.885 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.885 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.885 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.885 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.885 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.885 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_API_URL": { 2024-04-26T18:46:33.885 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_API_URL", 2024-04-26T18:46:33.885 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.885 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.885 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.885 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.885 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.885 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.885 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.885 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.885 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.885 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.885 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.886 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_API_USERNAME": { 2024-04-26T18:46:33.886 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-26T18:46:33.886 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.886 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.886 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.886 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "admin", 2024-04-26T18:46:33.886 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.886 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.886 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.886 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.886 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.886 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.886 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.886 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-26T18:46:33.887 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-26T18:46:33.887 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.887 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.887 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.887 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.887 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.887 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.887 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.887 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.887 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.887 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.887 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.887 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.887 INFO:teuthology.orchestra.run.smithi080.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-26T18:46:33.887 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-26T18:46:33.887 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.887 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.888 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.888 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.888 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.888 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.888 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.888 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.888 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.888 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.888 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.888 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.888 INFO:teuthology.orchestra.run.smithi080.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-26T18:46:33.888 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-26T18:46:33.888 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.888 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.888 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.888 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.888 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.889 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.889 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.889 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.889 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.889 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.889 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.889 INFO:teuthology.orchestra.run.smithi080.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-26T18:46:33.889 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-26T18:46:33.889 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.889 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.889 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.889 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.889 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.889 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.889 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.889 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.890 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.890 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.890 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.890 INFO:teuthology.orchestra.run.smithi080.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-26T18:46:33.890 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-26T18:46:33.890 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.890 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.890 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.890 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "[]", 2024-04-26T18:46:33.890 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.890 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.890 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.890 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.890 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.890 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.890 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.891 INFO:teuthology.orchestra.run.smithi080.stdout: "MULTICLUSTER_CONFIG": { 2024-04-26T18:46:33.891 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-26T18:46:33.891 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.891 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.891 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.891 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "{}", 2024-04-26T18:46:33.891 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.891 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.891 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.891 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.891 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.891 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.891 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.891 INFO:teuthology.orchestra.run.smithi080.stdout: "PROMETHEUS_API_HOST": { 2024-04-26T18:46:33.891 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-26T18:46:33.892 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.892 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.892 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.892 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.892 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.892 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.892 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.892 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.892 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.892 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.892 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.892 INFO:teuthology.orchestra.run.smithi080.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-26T18:46:33.892 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-26T18:46:33.892 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.892 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.892 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.893 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.893 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.893 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.893 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.893 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.893 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.893 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.893 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.893 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-26T18:46:33.893 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-26T18:46:33.893 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.893 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.893 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.893 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.893 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.894 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.894 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.894 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.894 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.894 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.894 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.894 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-26T18:46:33.894 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-26T18:46:33.894 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.894 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.894 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.894 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.894 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.894 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.894 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.895 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.895 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.895 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.895 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.895 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-26T18:46:33.895 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-26T18:46:33.895 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.895 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.895 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.895 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.895 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.895 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.895 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.895 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.895 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.895 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.896 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.896 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-26T18:46:33.896 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-26T18:46:33.896 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.896 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.896 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.896 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.896 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.896 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.896 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.896 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.896 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.896 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.896 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.896 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-26T18:46:33.897 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-26T18:46:33.897 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.897 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.897 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.897 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.897 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.897 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.897 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.897 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.897 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.897 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.897 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.897 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.897 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-26T18:46:33.897 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-26T18:46:33.897 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.897 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.898 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.898 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.898 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.898 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.898 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.898 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.898 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.898 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.898 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.898 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-26T18:46:33.898 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-26T18:46:33.898 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.898 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.898 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.898 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.899 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.899 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.899 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.899 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.899 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.899 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.899 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.899 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_ENABLED": { 2024-04-26T18:46:33.899 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-26T18:46:33.899 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.899 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.899 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.899 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.899 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.899 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.899 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.900 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.900 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.900 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.900 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.900 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-26T18:46:33.900 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-26T18:46:33.900 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.900 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.900 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.900 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-26T18:46:33.900 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.900 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.900 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.900 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.900 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.900 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.900 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.901 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-26T18:46:33.901 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-26T18:46:33.901 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.901 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.901 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.901 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-26T18:46:33.901 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.901 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.901 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.901 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.901 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.901 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.901 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.901 INFO:teuthology.orchestra.run.smithi080.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-26T18:46:33.902 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-26T18:46:33.902 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.902 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.902 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.902 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8", 2024-04-26T18:46:33.902 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.902 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.902 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.902 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.902 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.902 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.902 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.902 INFO:teuthology.orchestra.run.smithi080.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-26T18:46:33.902 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-26T18:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "45", 2024-04-26T18:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout: "RGW_API_ACCESS_KEY": { 2024-04-26T18:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-26T18:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.903 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-26T18:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-26T18:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "admin", 2024-04-26T18:46:33.904 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: "RGW_API_SECRET_KEY": { 2024-04-26T18:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-26T18:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.905 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.906 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.906 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.906 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.906 INFO:teuthology.orchestra.run.smithi080.stdout: "RGW_API_SSL_VERIFY": { 2024-04-26T18:46:33.906 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-26T18:46:33.906 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.906 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.906 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.906 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.906 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.906 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.906 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.906 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.906 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.907 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.907 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.907 INFO:teuthology.orchestra.run.smithi080.stdout: "UNSAFE_TLS_v1_2": { 2024-04-26T18:46:33.907 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-26T18:46:33.907 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.907 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.907 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.907 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.907 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.907 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.907 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.907 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.907 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.907 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.907 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.908 INFO:teuthology.orchestra.run.smithi080.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-26T18:46:33.908 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-26T18:46:33.908 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.908 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.908 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.908 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-26T18:46:33.908 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.908 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.908 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.908 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.908 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.908 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.908 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.908 INFO:teuthology.orchestra.run.smithi080.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-26T18:46:33.909 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-26T18:46:33.909 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.909 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.909 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.909 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-26T18:46:33.909 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.909 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.909 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.909 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.909 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.909 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.909 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.909 INFO:teuthology.orchestra.run.smithi080.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-26T18:46:33.909 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-26T18:46:33.910 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.910 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.910 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.910 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5", 2024-04-26T18:46:33.910 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.910 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.910 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.910 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.910 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.910 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.910 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.910 INFO:teuthology.orchestra.run.smithi080.stdout: "cross_origin_url": { 2024-04-26T18:46:33.910 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cross_origin_url", 2024-04-26T18:46:33.910 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.910 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.910 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.911 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.911 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.911 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.911 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.911 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.911 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.911 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.911 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.911 INFO:teuthology.orchestra.run.smithi080.stdout: "crt_file": { 2024-04-26T18:46:33.911 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "crt_file", 2024-04-26T18:46:33.911 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.911 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.911 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.911 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.911 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.912 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.912 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.912 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.912 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.912 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.912 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.912 INFO:teuthology.orchestra.run.smithi080.stdout: "debug": { 2024-04-26T18:46:33.912 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "debug", 2024-04-26T18:46:33.912 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.912 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.912 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.912 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.912 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.912 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.912 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.912 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Enable/disable debug options", 2024-04-26T18:46:33.913 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.913 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.913 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.913 INFO:teuthology.orchestra.run.smithi080.stdout: "jwt_token_ttl": { 2024-04-26T18:46:33.913 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "jwt_token_ttl", 2024-04-26T18:46:33.913 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.913 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.913 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.913 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "28800", 2024-04-26T18:46:33.913 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.913 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.913 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.913 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.913 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.913 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.914 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.914 INFO:teuthology.orchestra.run.smithi080.stdout: "key_file": { 2024-04-26T18:46:33.914 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "key_file", 2024-04-26T18:46:33.914 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.914 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.914 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.914 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.914 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.914 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.914 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.914 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.914 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.914 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.914 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.915 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.915 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.915 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.915 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.915 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.915 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.915 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.915 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.915 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.915 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.915 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.915 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.915 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.915 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.915 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.916 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.916 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.916 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.916 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.916 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.916 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.916 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.916 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.916 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.916 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.916 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.916 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.916 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.916 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.917 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.917 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.917 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.917 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.917 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.917 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.917 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.917 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.917 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.917 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.917 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.917 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.917 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.917 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.917 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.918 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.918 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.918 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.918 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.918 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.918 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.918 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.918 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.918 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.918 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.918 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.918 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.918 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.918 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.919 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.919 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.919 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.919 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.919 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.919 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.919 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.919 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.919 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.919 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.919 INFO:teuthology.orchestra.run.smithi080.stdout: "motd": { 2024-04-26T18:46:33.919 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "motd", 2024-04-26T18:46:33.919 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.919 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.919 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.920 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.920 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.920 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.920 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.920 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "The message of the day", 2024-04-26T18:46:33.920 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.920 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.920 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.920 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.920 INFO:teuthology.orchestra.run.smithi080.stdout: "redirect_resolve_ip_addr": { 2024-04-26T18:46:33.920 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "redirect_resolve_ip_addr", 2024-04-26T18:46:33.920 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.920 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.920 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.920 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.921 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.921 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.921 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.921 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.921 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.921 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.921 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.921 INFO:teuthology.orchestra.run.smithi080.stdout: "server_addr": { 2024-04-26T18:46:33.921 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_addr", 2024-04-26T18:46:33.921 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.921 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.921 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.921 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "::", 2024-04-26T18:46:33.921 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.922 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.922 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.922 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.922 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.922 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.922 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.922 INFO:teuthology.orchestra.run.smithi080.stdout: "server_port": { 2024-04-26T18:46:33.922 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_port", 2024-04-26T18:46:33.922 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.922 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.922 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.922 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8080", 2024-04-26T18:46:33.922 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.923 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.923 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.923 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.923 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.923 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.923 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.923 INFO:teuthology.orchestra.run.smithi080.stdout: "ssl": { 2024-04-26T18:46:33.923 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ssl", 2024-04-26T18:46:33.923 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.923 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.923 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.923 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.923 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.923 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.924 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.924 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.924 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.924 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.924 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.924 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.924 INFO:teuthology.orchestra.run.smithi080.stdout: "ssl_server_port": { 2024-04-26T18:46:33.924 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ssl_server_port", 2024-04-26T18:46:33.924 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.924 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.924 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.924 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8443", 2024-04-26T18:46:33.924 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.924 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.924 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.924 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.925 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.925 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.925 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.925 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.925 INFO:teuthology.orchestra.run.smithi080.stdout: "standby_behaviour": { 2024-04-26T18:46:33.925 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "standby_behaviour", 2024-04-26T18:46:33.925 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.925 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.925 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.925 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "redirect", 2024-04-26T18:46:33.925 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.925 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.925 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.925 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.925 INFO:teuthology.orchestra.run.smithi080.stdout: "redirect" 2024-04-26T18:46:33.925 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.926 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.926 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.926 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.926 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.926 INFO:teuthology.orchestra.run.smithi080.stdout: "standby_error_status_code": { 2024-04-26T18:46:33.926 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "standby_error_status_code", 2024-04-26T18:46:33.926 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.926 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.926 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.926 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "500", 2024-04-26T18:46:33.926 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "400", 2024-04-26T18:46:33.926 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "599", 2024-04-26T18:46:33.926 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.926 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.927 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.927 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.927 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.927 INFO:teuthology.orchestra.run.smithi080.stdout: "url_prefix": { 2024-04-26T18:46:33.927 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "url_prefix", 2024-04-26T18:46:33.927 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.927 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.927 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.927 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.927 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.927 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.927 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.927 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.927 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.927 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.928 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.928 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.928 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.928 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "devicehealth", 2024-04-26T18:46:33.928 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.928 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.928 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.928 INFO:teuthology.orchestra.run.smithi080.stdout: "enable_monitoring": { 2024-04-26T18:46:33.928 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "enable_monitoring", 2024-04-26T18:46:33.928 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.928 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.928 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.928 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.928 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.928 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.929 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.929 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "monitor device health metrics", 2024-04-26T18:46:33.929 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.929 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.929 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.929 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.929 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.929 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.929 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.929 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.929 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.929 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.929 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.929 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.930 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.930 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.930 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.930 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.930 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.930 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.930 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.930 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.930 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.930 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.930 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.930 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.930 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.930 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.931 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.931 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.931 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.931 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.931 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.931 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.931 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.931 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.931 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.931 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.931 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.931 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.931 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.931 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.931 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.931 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.931 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: "mark_out_threshold": { 2024-04-26T18:46:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mark_out_threshold", 2024-04-26T18:46:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "2419200", 2024-04-26T18:46:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-26T18:46:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": { 2024-04-26T18:46:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "pool_name", 2024-04-26T18:46:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "device_health_metrics", 2024-04-26T18:46:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-26T18:46:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: "retention_period": { 2024-04-26T18:46:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "retention_period", 2024-04-26T18:46:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "15552000", 2024-04-26T18:46:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how long to retain device health metrics", 2024-04-26T18:46:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: "scrape_frequency": { 2024-04-26T18:46:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "scrape_frequency", 2024-04-26T18:46:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "86400", 2024-04-26T18:46:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-26T18:46:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "self_heal": { 2024-04-26T18:46:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "self_heal", 2024-04-26T18:46:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-26T18:46:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-26T18:46:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-26T18:46:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-26T18:46:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how frequently to wake up and check device health", 2024-04-26T18:46:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: "warn_threshold": { 2024-04-26T18:46:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "warn_threshold", 2024-04-26T18:46:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "7257600", 2024-04-26T18:46:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-26T18:46:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "diskprediction_local", 2024-04-26T18:46:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "predict_interval": { 2024-04-26T18:46:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "predict_interval", 2024-04-26T18:46:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "86400", 2024-04-26T18:46:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: "predictor_model": { 2024-04-26T18:46:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "predictor_model", 2024-04-26T18:46:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "prophetstor", 2024-04-26T18:46:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-26T18:46:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-26T18:46:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "600", 2024-04-26T18:46:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "influx", 2024-04-26T18:46:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": false, 2024-04-26T18:46:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "influxdb python module not found", 2024-04-26T18:46:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "batch_size": { 2024-04-26T18:46:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "batch_size", 2024-04-26T18:46:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5000", 2024-04-26T18:46:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-26T18:46:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: "database": { 2024-04-26T18:46:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "database", 2024-04-26T18:46:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "ceph", 2024-04-26T18:46:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-26T18:46:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: "hostname": { 2024-04-26T18:46:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "hostname", 2024-04-26T18:46:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "InfluxDB server hostname", 2024-04-26T18:46:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-26T18:46:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-26T18:46:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "30", 2024-04-26T18:46:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "5", 2024-04-26T18:46:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-26T18:46:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: "password": { 2024-04-26T18:46:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "password", 2024-04-26T18:46:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "password of InfluxDB server user", 2024-04-26T18:46:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: "port": { 2024-04-26T18:46:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "port", 2024-04-26T18:46:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "8086", 2024-04-26T18:46:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "InfluxDB server port", 2024-04-26T18:46:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: "ssl": { 2024-04-26T18:46:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ssl", 2024-04-26T18:46:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "false", 2024-04-26T18:46:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-26T18:46:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: "threads": { 2024-04-26T18:46:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "threads", 2024-04-26T18:46:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5", 2024-04-26T18:46:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1", 2024-04-26T18:46:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "32", 2024-04-26T18:46:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-26T18:46:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: "username": { 2024-04-26T18:46:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "username", 2024-04-26T18:46:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "username of InfluxDB server user", 2024-04-26T18:46:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: "verify_ssl": { 2024-04-26T18:46:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "verify_ssl", 2024-04-26T18:46:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "true", 2024-04-26T18:46:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-26T18:46:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "insights", 2024-04-26T18:46:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "iostat", 2024-04-26T18:46:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "k8sevents", 2024-04-26T18:46:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_event_retention_days": { 2024-04-26T18:46:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "ceph_event_retention_days", 2024-04-26T18:46:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "7", 2024-04-26T18:46:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-26T18:46:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "config_check_secs": { 2024-04-26T18:46:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "config_check_secs", 2024-04-26T18:46:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-26T18:46:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "10", 2024-04-26T18:46:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-26T18:46:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "localpool", 2024-04-26T18:46:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: "failure_domain": { 2024-04-26T18:46:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "failure_domain", 2024-04-26T18:46:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "host", 2024-04-26T18:46:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "failure domain for any created local pool", 2024-04-26T18:46:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-26T18:46:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": { 2024-04-26T18:46:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "min_size", 2024-04-26T18:46:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "default min_size for any created local pool", 2024-04-26T18:46:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-26T18:46:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: "num_rep": { 2024-04-26T18:46:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "num_rep", 2024-04-26T18:46:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "3", 2024-04-26T18:46:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "default replica count for any created local pool", 2024-04-26T18:46:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": { 2024-04-26T18:46:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "pg_num", 2024-04-26T18:46:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "128", 2024-04-26T18:46:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "default pg_num for any created local pool", 2024-04-26T18:46:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: "prefix": { 2024-04-26T18:46:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "prefix", 2024-04-26T18:46:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "name prefix for any created local pool", 2024-04-26T18:46:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: "subtree": { 2024-04-26T18:46:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "subtree", 2024-04-26T18:46:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "rack", 2024-04-26T18:46:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-26T18:46:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-26T18:46:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mds_autoscaler", 2024-04-26T18:46:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mirroring", 2024-04-26T18:46:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "nfs", 2024-04-26T18:46:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "orchestrator", 2024-04-26T18:46:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: "fail_fs": { 2024-04-26T18:46:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "fail_fs", 2024-04-26T18:46:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.003 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.003 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-26T18:46:34.003 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.003 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.003 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.003 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:34.003 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:34.004 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.004 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.004 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.004 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.004 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.004 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.004 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.004 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.005 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.005 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.005 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.005 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.005 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.005 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.005 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.005 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "orchestrator": { 2024-04-26T18:46:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "orchestrator", 2024-04-26T18:46:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: "cephadm", 2024-04-26T18:46:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: "rook", 2024-04-26T18:46:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: "test_orchestrator" 2024-04-26T18:46:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Orchestrator backend", 2024-04-26T18:46:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "osd_perf_query", 2024-04-26T18:46:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "osd_support", 2024-04-26T18:46:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "pg_autoscaler", 2024-04-26T18:46:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.022 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.022 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.022 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.022 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.022 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:34.022 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:34.022 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.022 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.022 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.022 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.022 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.022 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.022 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.022 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.022 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-26T18:46:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-26T18:46:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-26T18:46:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.026 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.026 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.026 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.026 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.026 INFO:teuthology.orchestra.run.smithi080.stdout: "threshold": { 2024-04-26T18:46:34.026 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "threshold", 2024-04-26T18:46:34.026 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-26T18:46:34.026 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.026 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.026 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "3.0", 2024-04-26T18:46:34.026 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1.0", 2024-04-26T18:46:34.026 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.026 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.026 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "scaling threshold", 2024-04-26T18:46:34.027 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-26T18:46:34.027 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.027 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.027 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.027 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.027 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "progress", 2024-04-26T18:46:34.027 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:34.027 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:34.027 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:34.027 INFO:teuthology.orchestra.run.smithi080.stdout: "allow_pg_recovery_event": { 2024-04-26T18:46:34.027 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "allow_pg_recovery_event", 2024-04-26T18:46:34.027 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.027 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.028 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.028 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.028 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.028 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.028 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.028 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-26T18:46:34.028 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.028 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.028 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.028 INFO:teuthology.orchestra.run.smithi080.stdout: "enabled": { 2024-04-26T18:46:34.028 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "enabled", 2024-04-26T18:46:34.028 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.028 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.028 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.028 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:34.028 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.029 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.029 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.029 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.029 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.029 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.029 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.029 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:34.029 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:34.029 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.029 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.029 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.029 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.029 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.029 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.030 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.030 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.030 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.030 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.030 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.030 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.030 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.030 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.030 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.030 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.030 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.030 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.030 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:34.030 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:34.030 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.031 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.031 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.031 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.031 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.031 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.031 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.031 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.031 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.031 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.031 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.031 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:34.031 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:34.031 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.031 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.031 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.032 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:34.032 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.032 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.032 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.032 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.032 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.032 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.032 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.032 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.032 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.032 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.032 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.032 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.032 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.032 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.033 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:34.033 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:34.033 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.033 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.033 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.033 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.033 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.033 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.033 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.033 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.033 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.033 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.033 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.033 INFO:teuthology.orchestra.run.smithi080.stdout: "max_completed_events": { 2024-04-26T18:46:34.033 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_completed_events", 2024-04-26T18:46:34.034 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:34.034 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.034 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.034 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "50", 2024-04-26T18:46:34.034 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.034 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.034 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.034 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "number of past completed events to remember", 2024-04-26T18:46:34.034 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.034 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.034 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.034 INFO:teuthology.orchestra.run.smithi080.stdout: "sleep_interval": { 2024-04-26T18:46:34.034 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "sleep_interval", 2024-04-26T18:46:34.034 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:34.035 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.035 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.035 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "5", 2024-04-26T18:46:34.035 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.035 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.035 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.035 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "how long the module is going to sleep", 2024-04-26T18:46:34.035 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.035 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.035 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.035 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.035 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.035 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "prometheus", 2024-04-26T18:46:34.035 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:34.036 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:34.036 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:34.036 INFO:teuthology.orchestra.run.smithi080.stdout: "cache": { 2024-04-26T18:46:34.036 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "cache", 2024-04-26T18:46:34.036 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.036 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.036 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.036 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:34.036 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.036 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.036 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.036 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.036 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.036 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.036 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.036 INFO:teuthology.orchestra.run.smithi080.stdout: "exclude_perf_counters": { 2024-04-26T18:46:34.037 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "exclude_perf_counters", 2024-04-26T18:46:34.037 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.037 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.037 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.037 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:34.037 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.037 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.037 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.037 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-26T18:46:34.037 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-26T18:46:34.037 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.037 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.037 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:34.037 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:34.038 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.038 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.038 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.038 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.038 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.038 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.038 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.038 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.038 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.038 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.038 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.038 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.038 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.038 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.038 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.038 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.039 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.039 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.039 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:34.039 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:34.039 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.039 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.039 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.039 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.039 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.039 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.039 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.039 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.039 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.039 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.040 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.040 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:34.040 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:34.040 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.040 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.040 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.040 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:34.040 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.040 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.040 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.040 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.040 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.040 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.040 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.040 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.040 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.041 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.041 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.041 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.041 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.041 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.041 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:34.041 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:34.041 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.041 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.041 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.041 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.041 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.041 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.041 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.042 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.042 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.042 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.042 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.042 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_stats_pools": { 2024-04-26T18:46:34.042 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rbd_stats_pools", 2024-04-26T18:46:34.042 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.042 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.042 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.042 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.042 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.042 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.042 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.042 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.042 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.043 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.043 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.043 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-26T18:46:34.043 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-26T18:46:34.043 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:34.043 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.043 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.043 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "300", 2024-04-26T18:46:34.043 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.043 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.043 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.043 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.043 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.043 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.044 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.044 INFO:teuthology.orchestra.run.smithi080.stdout: "scrape_interval": { 2024-04-26T18:46:34.044 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "scrape_interval", 2024-04-26T18:46:34.044 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-26T18:46:34.044 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.044 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.044 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "15.0", 2024-04-26T18:46:34.044 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.044 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.044 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.044 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.044 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.044 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.044 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.044 INFO:teuthology.orchestra.run.smithi080.stdout: "server_addr": { 2024-04-26T18:46:34.045 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_addr", 2024-04-26T18:46:34.045 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.045 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.045 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.045 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "::", 2024-04-26T18:46:34.045 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.045 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.045 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.045 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-26T18:46:34.045 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.045 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.045 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.045 INFO:teuthology.orchestra.run.smithi080.stdout: "server_port": { 2024-04-26T18:46:34.045 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_port", 2024-04-26T18:46:34.045 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:34.046 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.046 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.046 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "9283", 2024-04-26T18:46:34.046 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.046 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.046 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.046 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-26T18:46:34.046 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.046 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.046 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.046 INFO:teuthology.orchestra.run.smithi080.stdout: "stale_cache_strategy": { 2024-04-26T18:46:34.046 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "stale_cache_strategy", 2024-04-26T18:46:34.046 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.046 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.047 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.047 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "log", 2024-04-26T18:46:34.047 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.047 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.047 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.047 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.047 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.047 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.047 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.047 INFO:teuthology.orchestra.run.smithi080.stdout: "standby_behaviour": { 2024-04-26T18:46:34.047 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "standby_behaviour", 2024-04-26T18:46:34.047 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.047 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.047 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.048 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "default", 2024-04-26T18:46:34.048 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.048 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.048 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.048 INFO:teuthology.orchestra.run.smithi080.stdout: "default", 2024-04-26T18:46:34.048 INFO:teuthology.orchestra.run.smithi080.stdout: "error" 2024-04-26T18:46:34.048 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.048 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.048 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.048 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.048 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.048 INFO:teuthology.orchestra.run.smithi080.stdout: "standby_error_status_code": { 2024-04-26T18:46:34.048 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "standby_error_status_code", 2024-04-26T18:46:34.048 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:34.048 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.049 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.049 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "500", 2024-04-26T18:46:34.049 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "400", 2024-04-26T18:46:34.049 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "599", 2024-04-26T18:46:34.049 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.049 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.049 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.049 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.049 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.049 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.049 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.049 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rbd_support", 2024-04-26T18:46:34.049 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:34.050 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:34.050 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:34.050 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:34.050 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:34.050 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.050 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.050 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.050 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.050 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.050 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.050 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.050 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.050 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.050 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.050 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.050 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.051 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.051 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.051 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.051 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.051 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.051 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.051 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:34.051 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:34.051 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.051 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.051 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.051 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.051 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.051 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.052 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.052 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.052 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.052 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.052 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.052 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:34.052 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:34.052 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.052 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.052 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.052 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:34.052 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.052 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.052 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.052 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.053 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.053 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.053 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.053 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.053 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.053 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.053 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.053 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.053 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.053 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.053 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:34.053 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:34.053 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.053 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.054 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.054 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.054 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.054 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.054 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.054 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.054 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.054 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.054 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.054 INFO:teuthology.orchestra.run.smithi080.stdout: "max_concurrent_snap_create": { 2024-04-26T18:46:34.054 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_concurrent_snap_create", 2024-04-26T18:46:34.054 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:34.054 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.054 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.054 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10", 2024-04-26T18:46:34.055 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.055 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.055 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.055 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.055 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.055 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.055 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.055 INFO:teuthology.orchestra.run.smithi080.stdout: "mirror_snapshot_schedule": { 2024-04-26T18:46:34.055 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mirror_snapshot_schedule", 2024-04-26T18:46:34.055 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.055 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.055 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.055 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.055 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.055 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.056 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.056 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.056 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.056 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.056 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.056 INFO:teuthology.orchestra.run.smithi080.stdout: "trash_purge_schedule": { 2024-04-26T18:46:34.056 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "trash_purge_schedule", 2024-04-26T18:46:34.056 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.056 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.056 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.056 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.056 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.056 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.056 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.056 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.057 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.057 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.057 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.057 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.057 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.057 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "restful", 2024-04-26T18:46:34.057 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:34.057 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:34.057 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:34.057 INFO:teuthology.orchestra.run.smithi080.stdout: "enable_auth": { 2024-04-26T18:46:34.057 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "enable_auth", 2024-04-26T18:46:34.057 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.057 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.057 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.058 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:34.058 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.058 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.058 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.058 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.058 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.058 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.058 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.058 INFO:teuthology.orchestra.run.smithi080.stdout: "key_file": { 2024-04-26T18:46:34.058 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "key_file", 2024-04-26T18:46:34.058 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.058 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.058 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.059 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.059 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.059 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.059 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.059 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.059 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.059 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.059 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.059 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:34.059 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:34.059 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.059 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.059 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.059 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.060 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.060 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.060 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.060 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.060 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.060 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.060 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.060 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.060 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.060 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.060 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.060 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.060 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.060 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.060 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:34.060 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:34.061 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.061 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.061 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.061 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.061 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.061 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.061 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.061 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.061 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.061 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.061 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.061 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:34.061 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:34.061 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.062 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.062 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.062 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:34.062 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.062 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.062 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.062 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.062 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.062 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.062 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.062 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.062 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.062 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.062 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.062 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.063 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.063 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.063 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:34.063 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:34.063 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.063 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.063 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.063 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.063 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.063 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.063 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.063 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.063 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.063 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.063 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.064 INFO:teuthology.orchestra.run.smithi080.stdout: "server_addr": { 2024-04-26T18:46:34.064 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_addr", 2024-04-26T18:46:34.064 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.064 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.064 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.064 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.064 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.064 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.064 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.064 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.064 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.064 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.064 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.064 INFO:teuthology.orchestra.run.smithi080.stdout: "server_port": { 2024-04-26T18:46:34.065 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "server_port", 2024-04-26T18:46:34.065 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.065 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.065 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.065 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.065 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.065 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.065 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.065 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.065 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.065 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.065 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.065 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.065 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.066 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rgw", 2024-04-26T18:46:34.066 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:34.066 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:34.066 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:34.066 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:34.066 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:34.066 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.066 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.066 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.066 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.066 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.066 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.066 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.066 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.066 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.067 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.067 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.067 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.067 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.067 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.067 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.067 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.067 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.067 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.067 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:34.067 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:34.067 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.067 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.067 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.067 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.068 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.068 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.068 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.068 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.068 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.068 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.068 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.068 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:34.068 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:34.068 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.068 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.068 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.068 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:34.068 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.069 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.069 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.069 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.069 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.069 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.069 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.069 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.069 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.069 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.069 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.069 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.069 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.069 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.069 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:34.069 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:34.070 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.070 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.070 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.070 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.070 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.070 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.070 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.070 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.070 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.070 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.070 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.070 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.070 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.071 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rook", 2024-04-26T18:46:34.071 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:34.071 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:34.071 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:34.071 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:34.071 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:34.071 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.071 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.071 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.071 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.071 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.071 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.071 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.071 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.071 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.071 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.072 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.072 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.072 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.072 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.072 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.072 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.072 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.072 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.072 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:34.072 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:34.072 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.072 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.072 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.072 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.072 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.073 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.073 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.073 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.073 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.073 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.073 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.073 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:34.073 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:34.073 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.073 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.073 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.073 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:34.073 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.073 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.073 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.074 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.074 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.074 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.074 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.074 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.074 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.074 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.074 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.074 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.074 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.074 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.074 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:34.074 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:34.074 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.075 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.075 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.075 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.075 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.075 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.075 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.075 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.075 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.075 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.075 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.075 INFO:teuthology.orchestra.run.smithi080.stdout: "storage_class": { 2024-04-26T18:46:34.075 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "storage_class", 2024-04-26T18:46:34.075 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.075 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.076 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.076 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "local", 2024-04-26T18:46:34.076 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.076 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.076 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.076 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-26T18:46:34.076 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.076 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.076 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.076 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.076 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.076 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "selftest", 2024-04-26T18:46:34.076 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:34.076 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:34.076 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:34.077 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:34.077 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:34.077 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.077 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.077 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.077 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.077 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.077 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.077 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.077 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.077 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.077 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.077 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.077 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.077 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.078 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.078 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.078 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.078 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.078 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.078 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:34.078 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:34.078 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.078 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.078 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.078 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.078 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.079 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.079 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.079 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.079 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.079 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.079 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.079 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:34.079 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:34.079 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.079 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.079 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.079 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:34.079 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.079 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.079 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.080 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.080 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.080 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.080 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.080 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.080 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.080 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.080 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.080 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.080 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.080 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.080 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:34.080 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:34.080 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.080 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.081 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.081 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.081 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.081 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.081 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.081 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.081 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.081 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.081 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.081 INFO:teuthology.orchestra.run.smithi080.stdout: "roption1": { 2024-04-26T18:46:34.081 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "roption1", 2024-04-26T18:46:34.081 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.081 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.081 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.082 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.082 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.082 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.082 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.082 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.082 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.082 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.082 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.082 INFO:teuthology.orchestra.run.smithi080.stdout: "roption2": { 2024-04-26T18:46:34.082 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "roption2", 2024-04-26T18:46:34.082 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.082 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.082 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.082 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "xyz", 2024-04-26T18:46:34.083 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.083 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.083 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.083 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.083 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.083 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.083 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.083 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption1": { 2024-04-26T18:46:34.083 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption1", 2024-04-26T18:46:34.083 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.083 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.083 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.083 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.083 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.083 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.084 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.084 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.084 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.084 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.084 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.084 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption2": { 2024-04-26T18:46:34.084 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption2", 2024-04-26T18:46:34.084 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:34.084 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.084 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.084 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.084 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.084 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.084 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.084 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.085 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.085 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.085 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.085 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption3": { 2024-04-26T18:46:34.085 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption3", 2024-04-26T18:46:34.085 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "float", 2024-04-26T18:46:34.085 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.085 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.085 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.085 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.085 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.085 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.085 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.085 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.085 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.086 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.086 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption4": { 2024-04-26T18:46:34.086 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption4", 2024-04-26T18:46:34.086 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.086 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.086 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.086 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.086 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.086 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.086 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.086 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.086 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.086 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.086 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.087 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption5": { 2024-04-26T18:46:34.087 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption5", 2024-04-26T18:46:34.087 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.087 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.087 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.087 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.087 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.087 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.087 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.087 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.087 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.087 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.087 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.087 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption6": { 2024-04-26T18:46:34.088 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption6", 2024-04-26T18:46:34.088 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.088 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.088 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.088 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:34.088 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.088 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.088 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.088 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.088 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.088 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.088 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.088 INFO:teuthology.orchestra.run.smithi080.stdout: "rwoption7": { 2024-04-26T18:46:34.088 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rwoption7", 2024-04-26T18:46:34.088 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:34.088 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.089 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.089 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.089 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "1", 2024-04-26T18:46:34.089 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "42", 2024-04-26T18:46:34.089 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.089 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.089 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.089 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.089 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.089 INFO:teuthology.orchestra.run.smithi080.stdout: "testkey": { 2024-04-26T18:46:34.089 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "testkey", 2024-04-26T18:46:34.089 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.089 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.089 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.090 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.090 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.090 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.090 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.090 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.090 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.090 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.090 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.090 INFO:teuthology.orchestra.run.smithi080.stdout: "testlkey": { 2024-04-26T18:46:34.090 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "testlkey", 2024-04-26T18:46:34.090 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.090 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.090 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.090 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.091 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.091 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.091 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.091 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.091 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.091 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.091 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.091 INFO:teuthology.orchestra.run.smithi080.stdout: "testnewline": { 2024-04-26T18:46:34.091 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "testnewline", 2024-04-26T18:46:34.091 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.091 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.091 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.091 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.091 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.092 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.092 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.092 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.092 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.092 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.092 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.092 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.092 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.092 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "snap_schedule", 2024-04-26T18:46:34.092 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:34.092 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:34.092 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:34.092 INFO:teuthology.orchestra.run.smithi080.stdout: "allow_m_granularity": { 2024-04-26T18:46:34.092 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "allow_m_granularity", 2024-04-26T18:46:34.092 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.093 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.093 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.093 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.093 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.093 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.093 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.093 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "allow minute scheduled snapshots", 2024-04-26T18:46:34.093 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.093 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.093 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.093 INFO:teuthology.orchestra.run.smithi080.stdout: "dump_on_update": { 2024-04-26T18:46:34.093 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "dump_on_update", 2024-04-26T18:46:34.093 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.093 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.093 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.094 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.094 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.094 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.094 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.094 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "dump database to debug log on update", 2024-04-26T18:46:34.094 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.094 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.094 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.094 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:34.094 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:34.094 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.094 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.094 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.094 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.095 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.095 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.095 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.095 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.095 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.095 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.095 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.095 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.095 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.095 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.095 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.095 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.095 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.095 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.095 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:34.096 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:34.096 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.096 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.096 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.096 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.096 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.096 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.096 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.096 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.096 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.096 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.096 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.096 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:34.096 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:34.096 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.096 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.097 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.097 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:34.097 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.097 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.097 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.097 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.097 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.097 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.097 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.097 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.097 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.097 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.097 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.097 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.097 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.097 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.098 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:34.098 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:34.098 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.098 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.098 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.098 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.098 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.098 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.098 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.098 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.098 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.098 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.098 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.098 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.098 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.099 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "stats", 2024-04-26T18:46:34.099 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:34.099 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:34.099 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:34.099 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:34.099 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:34.099 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.099 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.099 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.099 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.099 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.099 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.099 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.100 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.100 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.100 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.100 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.100 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.100 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.100 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.100 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.100 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.100 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.100 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.100 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:34.100 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:34.100 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.100 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.100 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.101 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.101 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.101 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.101 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.101 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.101 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.101 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.101 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.101 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:34.101 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:34.101 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.101 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.101 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.101 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:34.101 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.102 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.102 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.102 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.102 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.102 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.102 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.102 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.102 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.102 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.102 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.102 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.102 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.102 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.102 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:34.102 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:34.103 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.103 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.103 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.103 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.103 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.103 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.103 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.103 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.103 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.103 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.103 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.103 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.103 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.104 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "status", 2024-04-26T18:46:34.104 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:34.104 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:34.104 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:34.104 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:34.104 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:34.104 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.104 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.104 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.104 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.104 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.104 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.104 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.104 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.104 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.105 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.105 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.105 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.105 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.105 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.105 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.105 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.105 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.105 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.105 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:34.105 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:34.105 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.105 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.105 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.106 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.106 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.106 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.106 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.106 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.106 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.106 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.106 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.106 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:34.106 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:34.106 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.106 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.106 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.106 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:34.107 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.107 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.107 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.107 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.107 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.107 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.107 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.107 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.107 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.107 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.107 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.107 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.107 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.107 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.107 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:34.108 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:34.108 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.108 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.108 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.108 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.108 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.108 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.108 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.108 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.108 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.108 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.108 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.108 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.108 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.109 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "telegraf", 2024-04-26T18:46:34.109 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:34.109 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:34.109 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:34.109 INFO:teuthology.orchestra.run.smithi080.stdout: "address": { 2024-04-26T18:46:34.109 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "address", 2024-04-26T18:46:34.109 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.109 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.109 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.109 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-26T18:46:34.109 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.109 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.109 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.109 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.110 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.110 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.110 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.110 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-26T18:46:34.110 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-26T18:46:34.110 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:34.110 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.110 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.110 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "15", 2024-04-26T18:46:34.110 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.110 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.110 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.110 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.110 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.111 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.111 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.111 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:34.111 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:34.111 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.111 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.111 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.111 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.111 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.111 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.111 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.111 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.111 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.111 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.111 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.112 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.112 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.112 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.112 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.112 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.112 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.112 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.112 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:34.112 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:34.112 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.112 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.112 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.112 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.112 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.112 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.113 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.113 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.113 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.113 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.113 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.113 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:34.113 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:34.113 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.113 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.113 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.113 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:34.113 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.113 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.113 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.113 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.113 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.114 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.114 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.114 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.114 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.114 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.114 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.114 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.114 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.114 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.114 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:34.114 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:34.114 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.114 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.114 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.114 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.115 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.115 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.115 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.115 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.115 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.115 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.115 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.115 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.115 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.115 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "telemetry", 2024-04-26T18:46:34.115 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:34.115 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:34.115 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:34.116 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_basic": { 2024-04-26T18:46:34.116 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_basic", 2024-04-26T18:46:34.116 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.116 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.116 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.116 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:34.116 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.116 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.116 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.116 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-26T18:46:34.116 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.116 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.116 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.116 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_crash": { 2024-04-26T18:46:34.116 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_crash", 2024-04-26T18:46:34.117 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.117 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.117 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.117 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:34.117 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.117 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.117 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.117 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-26T18:46:34.117 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.117 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.117 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.117 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_device": { 2024-04-26T18:46:34.117 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_device", 2024-04-26T18:46:34.117 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.117 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.117 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.118 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:34.118 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.118 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.118 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.118 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-26T18:46:34.118 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.118 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.118 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.118 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_ident": { 2024-04-26T18:46:34.118 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_ident", 2024-04-26T18:46:34.118 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.118 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.118 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.119 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.119 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.119 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.119 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.119 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-26T18:46:34.119 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.119 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.119 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.119 INFO:teuthology.orchestra.run.smithi080.stdout: "channel_perf": { 2024-04-26T18:46:34.119 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "channel_perf", 2024-04-26T18:46:34.119 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.119 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.119 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.119 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.120 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.120 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.120 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.120 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-26T18:46:34.120 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.120 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.120 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.120 INFO:teuthology.orchestra.run.smithi080.stdout: "contact": { 2024-04-26T18:46:34.120 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "contact", 2024-04-26T18:46:34.120 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.120 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.120 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.120 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.120 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.121 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.121 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.121 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.121 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.121 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.121 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.121 INFO:teuthology.orchestra.run.smithi080.stdout: "description": { 2024-04-26T18:46:34.121 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "description", 2024-04-26T18:46:34.121 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.121 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.121 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.121 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.121 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.121 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.121 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.122 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.122 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.122 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.122 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.122 INFO:teuthology.orchestra.run.smithi080.stdout: "device_url": { 2024-04-26T18:46:34.122 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "device_url", 2024-04-26T18:46:34.122 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.122 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.122 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.122 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-26T18:46:34.122 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.122 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.122 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.122 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.122 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.123 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.123 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.123 INFO:teuthology.orchestra.run.smithi080.stdout: "enabled": { 2024-04-26T18:46:34.123 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "enabled", 2024-04-26T18:46:34.123 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.123 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.123 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.123 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.123 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.123 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.123 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.123 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.123 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.123 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.124 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.124 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-26T18:46:34.124 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-26T18:46:34.124 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:34.124 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.124 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.124 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "24", 2024-04-26T18:46:34.124 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "8", 2024-04-26T18:46:34.124 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.124 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.124 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.124 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.124 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.124 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.125 INFO:teuthology.orchestra.run.smithi080.stdout: "last_opt_revision": { 2024-04-26T18:46:34.125 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "last_opt_revision", 2024-04-26T18:46:34.125 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:34.125 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.125 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.125 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "1", 2024-04-26T18:46:34.125 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.125 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.125 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.125 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.125 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.125 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.125 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.125 INFO:teuthology.orchestra.run.smithi080.stdout: "leaderboard": { 2024-04-26T18:46:34.125 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "leaderboard", 2024-04-26T18:46:34.125 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.126 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.126 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.126 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.126 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.126 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.126 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.126 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.126 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.126 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.126 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.126 INFO:teuthology.orchestra.run.smithi080.stdout: "leaderboard_description": { 2024-04-26T18:46:34.126 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "leaderboard_description", 2024-04-26T18:46:34.126 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.126 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.127 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.127 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.127 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.127 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.127 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.127 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.127 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.127 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.127 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.127 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:34.127 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:34.127 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.127 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.127 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.127 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.128 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.128 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.128 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.128 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.128 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.128 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.128 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.128 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.128 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.128 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.128 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.128 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.128 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.128 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.128 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:34.128 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:34.129 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.129 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.129 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.129 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.129 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.129 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.129 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.129 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.129 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.129 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.129 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.129 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:34.129 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:34.129 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.129 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.130 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.130 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:34.130 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.130 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.130 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.130 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.130 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.130 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.130 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.130 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.130 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.130 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.130 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.130 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.130 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.131 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.131 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:34.131 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:34.131 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.131 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.131 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.131 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.131 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.131 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.131 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.131 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.131 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.131 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.131 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.132 INFO:teuthology.orchestra.run.smithi080.stdout: "organization": { 2024-04-26T18:46:34.132 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "organization", 2024-04-26T18:46:34.132 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.132 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.132 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.132 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.132 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.132 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.132 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.132 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.132 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.132 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.132 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.132 INFO:teuthology.orchestra.run.smithi080.stdout: "proxy": { 2024-04-26T18:46:34.132 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "proxy", 2024-04-26T18:46:34.133 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.133 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.133 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.133 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.133 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.133 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.133 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.133 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.133 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.133 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.133 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.133 INFO:teuthology.orchestra.run.smithi080.stdout: "url": { 2024-04-26T18:46:34.133 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "url", 2024-04-26T18:46:34.133 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.133 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.134 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.134 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-26T18:46:34.134 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.134 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.134 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.134 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.134 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.134 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.134 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.134 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.134 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.134 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "test_orchestrator", 2024-04-26T18:46:34.134 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:34.135 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:34.135 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:34.135 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:34.135 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:34.135 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.135 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.135 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.135 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.135 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.135 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.135 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.135 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.135 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.135 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.135 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.135 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.136 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.136 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.136 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.136 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.136 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.136 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.136 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:34.136 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:34.136 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.136 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.136 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.136 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.136 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.136 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.136 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.136 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.137 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.137 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.137 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.137 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:34.137 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:34.137 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.137 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.137 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.137 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:34.137 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.137 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.137 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.137 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.137 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.137 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.138 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.138 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.138 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.138 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.138 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.138 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.138 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.138 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.138 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:34.138 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:34.138 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.138 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.138 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.138 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.138 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.139 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.139 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.139 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.139 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.139 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.139 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.139 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.139 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.139 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "volumes", 2024-04-26T18:46:34.139 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:34.139 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:34.139 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:34.139 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:34.140 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:34.140 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.140 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.140 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.140 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.140 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.140 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.140 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.140 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.140 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.140 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.140 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.140 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.140 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.140 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.140 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.141 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.141 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.141 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.141 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:34.141 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:34.141 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.141 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.141 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.141 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.141 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.141 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.141 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.141 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.141 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.141 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.142 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.142 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:34.142 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:34.142 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.142 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.142 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.142 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:34.142 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.142 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.142 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.142 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.142 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.142 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.142 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.142 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.143 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.143 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.143 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.143 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.143 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.143 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.143 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:34.143 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:34.143 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.143 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.143 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.143 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.143 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.143 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.143 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.144 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.144 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.144 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.144 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.144 INFO:teuthology.orchestra.run.smithi080.stdout: "max_concurrent_clones": { 2024-04-26T18:46:34.144 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "max_concurrent_clones", 2024-04-26T18:46:34.144 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:34.144 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.144 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.144 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "4", 2024-04-26T18:46:34.144 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.144 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.144 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.144 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-26T18:46:34.144 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.145 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.145 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.145 INFO:teuthology.orchestra.run.smithi080.stdout: "periodic_async_work": { 2024-04-26T18:46:34.145 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "periodic_async_work", 2024-04-26T18:46:34.145 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.145 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.145 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.145 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.145 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.145 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.145 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.145 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Periodically check for async work", 2024-04-26T18:46:34.145 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.145 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.145 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.146 INFO:teuthology.orchestra.run.smithi080.stdout: "snapshot_clone_delay": { 2024-04-26T18:46:34.146 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "snapshot_clone_delay", 2024-04-26T18:46:34.146 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:34.146 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.146 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.146 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "0", 2024-04-26T18:46:34.146 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.146 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.146 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.146 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-26T18:46:34.146 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.146 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.146 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.146 INFO:teuthology.orchestra.run.smithi080.stdout: "snapshot_clone_no_wait": { 2024-04-26T18:46:34.147 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "snapshot_clone_no_wait", 2024-04-26T18:46:34.147 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.147 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.147 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.147 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "True", 2024-04-26T18:46:34.147 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.147 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.147 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.147 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-26T18:46:34.147 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.147 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.147 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.147 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.147 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.148 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "zabbix", 2024-04-26T18:46:34.148 INFO:teuthology.orchestra.run.smithi080.stdout: "can_run": true, 2024-04-26T18:46:34.148 INFO:teuthology.orchestra.run.smithi080.stdout: "error_string": "", 2024-04-26T18:46:34.148 INFO:teuthology.orchestra.run.smithi080.stdout: "module_options": { 2024-04-26T18:46:34.148 INFO:teuthology.orchestra.run.smithi080.stdout: "discovery_interval": { 2024-04-26T18:46:34.148 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "discovery_interval", 2024-04-26T18:46:34.148 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "uint", 2024-04-26T18:46:34.148 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.148 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.148 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "100", 2024-04-26T18:46:34.148 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.148 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.148 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.148 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.148 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.148 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.149 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.149 INFO:teuthology.orchestra.run.smithi080.stdout: "identifier": { 2024-04-26T18:46:34.149 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "identifier", 2024-04-26T18:46:34.149 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.149 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.149 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.149 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.149 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.149 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.149 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.149 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.149 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.149 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.149 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.150 INFO:teuthology.orchestra.run.smithi080.stdout: "interval": { 2024-04-26T18:46:34.150 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "interval", 2024-04-26T18:46:34.150 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "secs", 2024-04-26T18:46:34.150 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.150 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.150 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "60", 2024-04-26T18:46:34.150 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.150 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.150 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.150 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.150 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.150 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.150 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.150 INFO:teuthology.orchestra.run.smithi080.stdout: "log_level": { 2024-04-26T18:46:34.151 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_level", 2024-04-26T18:46:34.151 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.151 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.151 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.151 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.151 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.151 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.151 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.151 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.151 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.151 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.151 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.151 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.151 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.151 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.151 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.152 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.152 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.152 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.152 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster": { 2024-04-26T18:46:34.152 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster", 2024-04-26T18:46:34.152 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.152 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.152 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.152 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.152 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.152 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.152 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.152 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.152 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.152 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.153 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.153 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_cluster_level": { 2024-04-26T18:46:34.153 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_cluster_level", 2024-04-26T18:46:34.153 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.153 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.153 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.153 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "info", 2024-04-26T18:46:34.153 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.153 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.153 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [ 2024-04-26T18:46:34.153 INFO:teuthology.orchestra.run.smithi080.stdout: "", 2024-04-26T18:46:34.153 INFO:teuthology.orchestra.run.smithi080.stdout: "critical", 2024-04-26T18:46:34.153 INFO:teuthology.orchestra.run.smithi080.stdout: "debug", 2024-04-26T18:46:34.153 INFO:teuthology.orchestra.run.smithi080.stdout: "error", 2024-04-26T18:46:34.154 INFO:teuthology.orchestra.run.smithi080.stdout: "info", 2024-04-26T18:46:34.154 INFO:teuthology.orchestra.run.smithi080.stdout: "warning" 2024-04-26T18:46:34.154 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.154 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.154 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.154 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.154 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.154 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": { 2024-04-26T18:46:34.154 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "log_to_file", 2024-04-26T18:46:34.154 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "bool", 2024-04-26T18:46:34.154 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.154 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-04-26T18:46:34.154 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "False", 2024-04-26T18:46:34.154 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.154 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.155 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.155 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.155 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.155 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.155 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.155 INFO:teuthology.orchestra.run.smithi080.stdout: "zabbix_host": { 2024-04-26T18:46:34.155 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "zabbix_host", 2024-04-26T18:46:34.155 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.155 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.155 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.155 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "", 2024-04-26T18:46:34.155 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.155 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.155 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.155 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.155 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.156 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.156 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.156 INFO:teuthology.orchestra.run.smithi080.stdout: "zabbix_port": { 2024-04-26T18:46:34.156 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "zabbix_port", 2024-04-26T18:46:34.156 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "int", 2024-04-26T18:46:34.156 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.156 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.156 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "10051", 2024-04-26T18:46:34.156 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.156 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.156 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.156 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.156 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.156 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.156 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.157 INFO:teuthology.orchestra.run.smithi080.stdout: "zabbix_sender": { 2024-04-26T18:46:34.157 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "zabbix_sender", 2024-04-26T18:46:34.157 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "str", 2024-04-26T18:46:34.157 INFO:teuthology.orchestra.run.smithi080.stdout: "level": "advanced", 2024-04-26T18:46:34.157 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 0, 2024-04-26T18:46:34.157 INFO:teuthology.orchestra.run.smithi080.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-26T18:46:34.157 INFO:teuthology.orchestra.run.smithi080.stdout: "min": "", 2024-04-26T18:46:34.157 INFO:teuthology.orchestra.run.smithi080.stdout: "max": "", 2024-04-26T18:46:34.157 INFO:teuthology.orchestra.run.smithi080.stdout: "enum_allowed": [], 2024-04-26T18:46:34.157 INFO:teuthology.orchestra.run.smithi080.stdout: "desc": "", 2024-04-26T18:46:34.157 INFO:teuthology.orchestra.run.smithi080.stdout: "long_desc": "", 2024-04-26T18:46:34.157 INFO:teuthology.orchestra.run.smithi080.stdout: "tags": [], 2024-04-26T18:46:34.157 INFO:teuthology.orchestra.run.smithi080.stdout: "see_also": [] 2024-04-26T18:46:34.157 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.157 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.158 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.158 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.158 INFO:teuthology.orchestra.run.smithi080.stdout: "services": { 2024-04-26T18:46:34.158 INFO:teuthology.orchestra.run.smithi080.stdout: "dashboard": "https://172.21.15.80:8443/" 2024-04-26T18:46:34.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.158 INFO:teuthology.orchestra.run.smithi080.stdout: "always_on_modules": { 2024-04-26T18:46:34.158 INFO:teuthology.orchestra.run.smithi080.stdout: "octopus": [ 2024-04-26T18:46:34.158 INFO:teuthology.orchestra.run.smithi080.stdout: "balancer", 2024-04-26T18:46:34.158 INFO:teuthology.orchestra.run.smithi080.stdout: "crash", 2024-04-26T18:46:34.158 INFO:teuthology.orchestra.run.smithi080.stdout: "devicehealth", 2024-04-26T18:46:34.158 INFO:teuthology.orchestra.run.smithi080.stdout: "orchestrator", 2024-04-26T18:46:34.158 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscaler", 2024-04-26T18:46:34.158 INFO:teuthology.orchestra.run.smithi080.stdout: "progress", 2024-04-26T18:46:34.158 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_support", 2024-04-26T18:46:34.158 INFO:teuthology.orchestra.run.smithi080.stdout: "status", 2024-04-26T18:46:34.159 INFO:teuthology.orchestra.run.smithi080.stdout: "telemetry", 2024-04-26T18:46:34.159 INFO:teuthology.orchestra.run.smithi080.stdout: "volumes" 2024-04-26T18:46:34.159 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.159 INFO:teuthology.orchestra.run.smithi080.stdout: "pacific": [ 2024-04-26T18:46:34.159 INFO:teuthology.orchestra.run.smithi080.stdout: "balancer", 2024-04-26T18:46:34.159 INFO:teuthology.orchestra.run.smithi080.stdout: "crash", 2024-04-26T18:46:34.159 INFO:teuthology.orchestra.run.smithi080.stdout: "devicehealth", 2024-04-26T18:46:34.159 INFO:teuthology.orchestra.run.smithi080.stdout: "orchestrator", 2024-04-26T18:46:34.159 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscaler", 2024-04-26T18:46:34.159 INFO:teuthology.orchestra.run.smithi080.stdout: "progress", 2024-04-26T18:46:34.159 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_support", 2024-04-26T18:46:34.159 INFO:teuthology.orchestra.run.smithi080.stdout: "status", 2024-04-26T18:46:34.159 INFO:teuthology.orchestra.run.smithi080.stdout: "telemetry", 2024-04-26T18:46:34.159 INFO:teuthology.orchestra.run.smithi080.stdout: "volumes" 2024-04-26T18:46:34.159 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.159 INFO:teuthology.orchestra.run.smithi080.stdout: "quincy": [ 2024-04-26T18:46:34.160 INFO:teuthology.orchestra.run.smithi080.stdout: "balancer", 2024-04-26T18:46:34.160 INFO:teuthology.orchestra.run.smithi080.stdout: "crash", 2024-04-26T18:46:34.160 INFO:teuthology.orchestra.run.smithi080.stdout: "devicehealth", 2024-04-26T18:46:34.160 INFO:teuthology.orchestra.run.smithi080.stdout: "orchestrator", 2024-04-26T18:46:34.160 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscaler", 2024-04-26T18:46:34.160 INFO:teuthology.orchestra.run.smithi080.stdout: "progress", 2024-04-26T18:46:34.160 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_support", 2024-04-26T18:46:34.160 INFO:teuthology.orchestra.run.smithi080.stdout: "status", 2024-04-26T18:46:34.160 INFO:teuthology.orchestra.run.smithi080.stdout: "telemetry", 2024-04-26T18:46:34.160 INFO:teuthology.orchestra.run.smithi080.stdout: "volumes" 2024-04-26T18:46:34.160 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.160 INFO:teuthology.orchestra.run.smithi080.stdout: "reef": [ 2024-04-26T18:46:34.160 INFO:teuthology.orchestra.run.smithi080.stdout: "balancer", 2024-04-26T18:46:34.160 INFO:teuthology.orchestra.run.smithi080.stdout: "crash", 2024-04-26T18:46:34.160 INFO:teuthology.orchestra.run.smithi080.stdout: "devicehealth", 2024-04-26T18:46:34.160 INFO:teuthology.orchestra.run.smithi080.stdout: "orchestrator", 2024-04-26T18:46:34.161 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscaler", 2024-04-26T18:46:34.161 INFO:teuthology.orchestra.run.smithi080.stdout: "progress", 2024-04-26T18:46:34.161 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_support", 2024-04-26T18:46:34.161 INFO:teuthology.orchestra.run.smithi080.stdout: "status", 2024-04-26T18:46:34.161 INFO:teuthology.orchestra.run.smithi080.stdout: "telemetry", 2024-04-26T18:46:34.161 INFO:teuthology.orchestra.run.smithi080.stdout: "volumes" 2024-04-26T18:46:34.161 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-04-26T18:46:34.161 INFO:teuthology.orchestra.run.smithi080.stdout: "squid": [ 2024-04-26T18:46:34.161 INFO:teuthology.orchestra.run.smithi080.stdout: "balancer", 2024-04-26T18:46:34.161 INFO:teuthology.orchestra.run.smithi080.stdout: "crash", 2024-04-26T18:46:34.161 INFO:teuthology.orchestra.run.smithi080.stdout: "devicehealth", 2024-04-26T18:46:34.161 INFO:teuthology.orchestra.run.smithi080.stdout: "orchestrator", 2024-04-26T18:46:34.161 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscaler", 2024-04-26T18:46:34.161 INFO:teuthology.orchestra.run.smithi080.stdout: "progress", 2024-04-26T18:46:34.161 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_support", 2024-04-26T18:46:34.161 INFO:teuthology.orchestra.run.smithi080.stdout: "status", 2024-04-26T18:46:34.162 INFO:teuthology.orchestra.run.smithi080.stdout: "telemetry", 2024-04-26T18:46:34.162 INFO:teuthology.orchestra.run.smithi080.stdout: "volumes" 2024-04-26T18:46:34.162 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-26T18:46:34.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.162 INFO:teuthology.orchestra.run.smithi080.stdout: "last_failure_osd_epoch": 92, 2024-04-26T18:46:34.162 INFO:teuthology.orchestra.run.smithi080.stdout: "active_clients": [ 2024-04-26T18:46:34.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.162 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "devicehealth", 2024-04-26T18:46:34.162 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-04-26T18:46:34.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.162 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-04-26T18:46:34.162 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:0", 2024-04-26T18:46:34.162 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3655006844 2024-04-26T18:46:34.162 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.162 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-26T18:46:34.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.163 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "libcephsqlite", 2024-04-26T18:46:34.163 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-04-26T18:46:34.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.163 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-04-26T18:46:34.163 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:0", 2024-04-26T18:46:34.163 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 784356589 2024-04-26T18:46:34.163 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.163 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-26T18:46:34.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.163 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "rbd_support", 2024-04-26T18:46:34.163 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-04-26T18:46:34.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.163 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-04-26T18:46:34.163 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:0", 2024-04-26T18:46:34.164 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3120482244 2024-04-26T18:46:34.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.164 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-26T18:46:34.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.164 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "snap_schedule", 2024-04-26T18:46:34.164 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-04-26T18:46:34.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.164 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-04-26T18:46:34.164 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:0", 2024-04-26T18:46:34.164 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1275919919 2024-04-26T18:46:34.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.164 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-26T18:46:34.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.164 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "snap_schedule", 2024-04-26T18:46:34.164 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-04-26T18:46:34.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.165 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-04-26T18:46:34.165 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:0", 2024-04-26T18:46:34.165 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 784458641 2024-04-26T18:46:34.165 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.165 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-26T18:46:34.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:34.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.165 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "volumes", 2024-04-26T18:46:34.165 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-04-26T18:46:34.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-26T18:46:34.165 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-04-26T18:46:34.165 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:0", 2024-04-26T18:46:34.165 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4231160891 2024-04-26T18:46:34.165 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.165 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-26T18:46:34.165 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:34.166 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-26T18:46:34.166 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:46:34.167 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:33 smithi082 ceph-mon[32808]: pgmap v314: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:46:34.167 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:33 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1606514756' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T18:46:34.167 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:33 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1769170256' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T18:46:34.167 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:33 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/2646723174' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-26T18:46:34.167 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:33 smithi192 ceph-mon[32842]: pgmap v314: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:46:34.167 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:33 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1606514756' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T18:46:34.167 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:33 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1769170256' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T18:46:34.167 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:33 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/2646723174' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-26T18:46:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:33.006+0000 7f378da2c640 1 -- 172.21.15.80:0/2646723174 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f37700a3d20 msgr2=0x7f37700a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:33.006+0000 7f378da2c640 1 --2- 172.21.15.80:0/2646723174 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f37700a3d20 0x7f37700a61e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3788101280 tx=0x7f3778008040 comp rx=0 tx=0).stop 2024-04-26T18:46:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:33.006+0000 7f378da2c640 1 -- 172.21.15.80:0/2646723174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3788103c10 msgr2=0x7f3788199110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:46:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:33.006+0000 7f378da2c640 1 --2- 172.21.15.80:0/2646723174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3788103c10 0x7f3788199110 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f377c00d950 tx=0x7f377c00de10 comp rx=0 tx=0).stop 2024-04-26T18:46:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:33.006+0000 7f378da2c640 1 -- 172.21.15.80:0/2646723174 shutdown_connections 2024-04-26T18:46:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:33.006+0000 7f378da2c640 1 --2- 172.21.15.80:0/2646723174 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f37700a3d20 0x7f37700a61e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:33.006+0000 7f378da2c640 1 --2- 172.21.15.80:0/2646723174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f378810cf50 0x7f378819d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:33.006+0000 7f378da2c640 1 --2- 172.21.15.80:0/2646723174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3788104530 0x7f3788199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:33.006+0000 7f378da2c640 1 --2- 172.21.15.80:0/2646723174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3788103c10 0x7f3788199110 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:46:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:33.006+0000 7f378da2c640 1 -- 172.21.15.80:0/2646723174 >> 172.21.15.80:0/2646723174 conn(0x7f3788078990 msgr2=0x7f37880fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:46:34.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:33.006+0000 7f378da2c640 1 -- 172.21.15.80:0/2646723174 shutdown_connections 2024-04-26T18:46:34.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:46:33.006+0000 7f378da2c640 1 -- 172.21.15.80:0/2646723174 wait complete. 2024-04-26T18:46:34.173 DEBUG:tasks.check_counter:Getting stats from a 2024-04-26T18:46:34.174 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph daemon mds.a perf dump 2024-04-26T18:46:34.174 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:33 smithi080 ceph-mon[29135]: pgmap v314: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:46:34.174 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:33 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1606514756' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T18:46:34.174 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:33 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1769170256' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T18:46:34.174 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:33 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2646723174' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-26T18:46:34.420 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:46:35.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:35 smithi192 ceph-mon[32842]: pgmap v315: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T18:46:35.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:35 smithi082 ceph-mon[32808]: pgmap v315: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T18:46:35.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:35 smithi080 ceph-mon[29135]: pgmap v315: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T18:46:36.254 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:46:36.254 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T18:46:36.254 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 1585, 2024-04-26T18:46:36.254 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 1587, 2024-04-26T18:46:36.254 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 474770, 2024-04-26T18:46:36.255 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 504031, 2024-04-26T18:46:36.255 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 6, 2024-04-26T18:46:36.255 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 2, 2024-04-26T18:46:36.255 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.163648137, 2024-04-26T18:46:36.255 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.052950680, 2024-04-26T18:46:36.255 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.042813982, 2024-04-26T18:46:36.255 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.053260075, 2024-04-26T18:46:36.255 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:36.255 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 1585, 2024-04-26T18:46:36.255 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.058204702, 2024-04-26T18:46:36.255 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000036722 2024-04-26T18:46:36.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.255 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:36.255 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.256 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.256 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.256 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-26T18:46:36.256 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 0 2024-04-26T18:46:36.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.256 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T18:46:36.256 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 831, 2024-04-26T18:46:36.256 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 816, 2024-04-26T18:46:36.256 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 1784690, 2024-04-26T18:46:36.256 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 322866, 2024-04-26T18:46:36.256 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 4, 2024-04-26T18:46:36.256 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 3, 2024-04-26T18:46:36.256 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.110823321, 2024-04-26T18:46:36.257 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.033904325, 2024-04-26T18:46:36.257 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.048348721, 2024-04-26T18:46:36.257 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.031733190, 2024-04-26T18:46:36.257 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:36.257 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 815, 2024-04-26T18:46:36.257 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.035258339, 2024-04-26T18:46:36.257 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000043261 2024-04-26T18:46:36.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.257 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:36.257 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.257 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.257 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.257 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 1642096, 2024-04-26T18:46:36.257 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 139312 2024-04-26T18:46:36.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.258 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T18:46:36.258 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 7, 2024-04-26T18:46:36.258 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 173, 2024-04-26T18:46:36.258 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 3580, 2024-04-26T18:46:36.258 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 461678, 2024-04-26T18:46:36.258 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 6, 2024-04-26T18:46:36.258 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 4, 2024-04-26T18:46:36.258 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.013577388, 2024-04-26T18:46:36.258 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.008693215, 2024-04-26T18:46:36.258 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.002737783, 2024-04-26T18:46:36.258 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.000022883, 2024-04-26T18:46:36.258 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:36.258 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 171, 2024-04-26T18:46:36.259 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.013520450, 2024-04-26T18:46:36.259 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000079066 2024-04-26T18:46:36.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.259 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:36.259 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.259 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.259 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.259 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-04-26T18:46:36.259 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 461360 2024-04-26T18:46:36.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.259 INFO:teuthology.orchestra.run.smithi080.stdout: "cct": { 2024-04-26T18:46:36.259 INFO:teuthology.orchestra.run.smithi080.stdout: "total_workers": 1, 2024-04-26T18:46:36.259 INFO:teuthology.orchestra.run.smithi080.stdout: "unhealthy_workers": 0 2024-04-26T18:46:36.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.260 INFO:teuthology.orchestra.run.smithi080.stdout: "finisher-MDSRank": { 2024-04-26T18:46:36.260 INFO:teuthology.orchestra.run.smithi080.stdout: "queue_len": 0, 2024-04-26T18:46:36.260 INFO:teuthology.orchestra.run.smithi080.stdout: "complete_latency": { 2024-04-26T18:46:36.260 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 3553, 2024-04-26T18:46:36.260 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.110407519, 2024-04-26T18:46:36.260 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000031074 2024-04-26T18:46:36.260 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:36.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.260 INFO:teuthology.orchestra.run.smithi080.stdout: "finisher-PurgeQueue": { 2024-04-26T18:46:36.260 INFO:teuthology.orchestra.run.smithi080.stdout: "queue_len": 0, 2024-04-26T18:46:36.260 INFO:teuthology.orchestra.run.smithi080.stdout: "complete_latency": { 2024-04-26T18:46:36.260 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.260 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.260 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.260 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:36.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.261 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": { 2024-04-26T18:46:36.261 INFO:teuthology.orchestra.run.smithi080.stdout: "request": 0, 2024-04-26T18:46:36.261 INFO:teuthology.orchestra.run.smithi080.stdout: "reply": 0, 2024-04-26T18:46:36.261 INFO:teuthology.orchestra.run.smithi080.stdout: "reply_latency": { 2024-04-26T18:46:36.261 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.261 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.261 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.261 INFO:teuthology.orchestra.run.smithi080.stdout: "slow_reply": 0, 2024-04-26T18:46:36.261 INFO:teuthology.orchestra.run.smithi080.stdout: "forward": 0, 2024-04-26T18:46:36.261 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_fetch_complete": 0, 2024-04-26T18:46:36.261 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_fetch_keys": 0, 2024-04-26T18:46:36.261 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_commit": 0, 2024-04-26T18:46:36.262 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_split": 0, 2024-04-26T18:46:36.262 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_merge": 0, 2024-04-26T18:46:36.262 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes": 0, 2024-04-26T18:46:36.262 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_top": 0, 2024-04-26T18:46:36.262 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_bottom": 0, 2024-04-26T18:46:36.262 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_pin_tail": 0, 2024-04-26T18:46:36.262 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_pinned": 0, 2024-04-26T18:46:36.262 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_expired": 0, 2024-04-26T18:46:36.262 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_with_caps": 0, 2024-04-26T18:46:36.262 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": 0, 2024-04-26T18:46:36.262 INFO:teuthology.orchestra.run.smithi080.stdout: "subtrees": 1, 2024-04-26T18:46:36.262 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse": 0, 2024-04-26T18:46:36.262 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_hit": 0, 2024-04-26T18:46:36.262 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_forward": 0, 2024-04-26T18:46:36.262 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_discover": 0, 2024-04-26T18:46:36.263 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_dir_fetch": 0, 2024-04-26T18:46:36.263 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_remote_ino": 0, 2024-04-26T18:46:36.263 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_lock": 0, 2024-04-26T18:46:36.263 INFO:teuthology.orchestra.run.smithi080.stdout: "load_cent": 0, 2024-04-26T18:46:36.263 INFO:teuthology.orchestra.run.smithi080.stdout: "q": 0, 2024-04-26T18:46:36.263 INFO:teuthology.orchestra.run.smithi080.stdout: "exported": 0, 2024-04-26T18:46:36.263 INFO:teuthology.orchestra.run.smithi080.stdout: "exported_inodes": 0, 2024-04-26T18:46:36.263 INFO:teuthology.orchestra.run.smithi080.stdout: "imported": 0, 2024-04-26T18:46:36.263 INFO:teuthology.orchestra.run.smithi080.stdout: "imported_inodes": 0, 2024-04-26T18:46:36.263 INFO:teuthology.orchestra.run.smithi080.stdout: "openino_dir_fetch": 0, 2024-04-26T18:46:36.263 INFO:teuthology.orchestra.run.smithi080.stdout: "openino_backtrace_fetch": 0, 2024-04-26T18:46:36.263 INFO:teuthology.orchestra.run.smithi080.stdout: "openino_peer_discover": 0, 2024-04-26T18:46:36.263 INFO:teuthology.orchestra.run.smithi080.stdout: "root_rfiles": 0, 2024-04-26T18:46:36.263 INFO:teuthology.orchestra.run.smithi080.stdout: "root_rbytes": 0, 2024-04-26T18:46:36.263 INFO:teuthology.orchestra.run.smithi080.stdout: "root_rsnaps": 0, 2024-04-26T18:46:36.264 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T18:46:36.264 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_set_tag": 0, 2024-04-26T18:46:36.264 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T18:46:36.264 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_inotable_repaired": 0, 2024-04-26T18:46:36.264 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_dir_inodes": 0, 2024-04-26T18:46:36.264 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T18:46:36.264 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T18:46:36.264 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_file_inodes": 0, 2024-04-26T18:46:36.264 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_inode_file_caps": 0, 2024-04-26T18:46:36.264 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_revoke": 0, 2024-04-26T18:46:36.264 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_grant": 0, 2024-04-26T18:46:36.264 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T18:46:36.264 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T18:46:36.264 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T18:46:36.264 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_caps": 0, 2024-04-26T18:46:36.265 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_caps_dirty": 0, 2024-04-26T18:46:36.265 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_cap_release": 0, 2024-04-26T18:46:36.265 INFO:teuthology.orchestra.run.smithi080.stdout: "process_request_cap_release": 0 2024-04-26T18:46:36.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.265 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache": { 2024-04-26T18:46:36.265 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_update": 0, 2024-04-26T18:46:36.265 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_update_receipt": 0, 2024-04-26T18:46:36.265 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_try_discover": 0, 2024-04-26T18:46:36.265 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_send_discover": 0, 2024-04-26T18:46:36.265 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_handle_discover": 0, 2024-04-26T18:46:36.265 INFO:teuthology.orchestra.run.smithi080.stdout: "num_strays": 0, 2024-04-26T18:46:36.265 INFO:teuthology.orchestra.run.smithi080.stdout: "num_strays_delayed": 0, 2024-04-26T18:46:36.265 INFO:teuthology.orchestra.run.smithi080.stdout: "num_strays_enqueuing": 0, 2024-04-26T18:46:36.265 INFO:teuthology.orchestra.run.smithi080.stdout: "strays_created": 0, 2024-04-26T18:46:36.265 INFO:teuthology.orchestra.run.smithi080.stdout: "strays_enqueued": 0, 2024-04-26T18:46:36.265 INFO:teuthology.orchestra.run.smithi080.stdout: "strays_reintegrated": 0, 2024-04-26T18:46:36.266 INFO:teuthology.orchestra.run.smithi080.stdout: "strays_migrated": 0, 2024-04-26T18:46:36.266 INFO:teuthology.orchestra.run.smithi080.stdout: "num_recovering_processing": 0, 2024-04-26T18:46:36.266 INFO:teuthology.orchestra.run.smithi080.stdout: "num_recovering_enqueued": 0, 2024-04-26T18:46:36.266 INFO:teuthology.orchestra.run.smithi080.stdout: "num_recovering_prioritized": 0, 2024-04-26T18:46:36.266 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_started": 0, 2024-04-26T18:46:36.266 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_completed": 0, 2024-04-26T18:46:36.266 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_quiesce_path": 0, 2024-04-26T18:46:36.266 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_quiesce_inode": 0, 2024-04-26T18:46:36.266 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T18:46:36.266 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_exportdir": 0, 2024-04-26T18:46:36.266 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_flush": 0, 2024-04-26T18:46:36.266 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_fragmentdir": 0, 2024-04-26T18:46:36.266 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_fragstats": 0, 2024-04-26T18:46:36.266 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_inodestats": 0 2024-04-26T18:46:36.266 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.267 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log": { 2024-04-26T18:46:36.267 INFO:teuthology.orchestra.run.smithi080.stdout: "evlrg": 0, 2024-04-26T18:46:36.267 INFO:teuthology.orchestra.run.smithi080.stdout: "evadd": 0, 2024-04-26T18:46:36.267 INFO:teuthology.orchestra.run.smithi080.stdout: "evex": 0, 2024-04-26T18:46:36.267 INFO:teuthology.orchestra.run.smithi080.stdout: "evtrm": 0, 2024-04-26T18:46:36.267 INFO:teuthology.orchestra.run.smithi080.stdout: "ev": 3, 2024-04-26T18:46:36.267 INFO:teuthology.orchestra.run.smithi080.stdout: "evexg": 0, 2024-04-26T18:46:36.267 INFO:teuthology.orchestra.run.smithi080.stdout: "evexd": 0, 2024-04-26T18:46:36.267 INFO:teuthology.orchestra.run.smithi080.stdout: "segadd": 0, 2024-04-26T18:46:36.267 INFO:teuthology.orchestra.run.smithi080.stdout: "segex": 0, 2024-04-26T18:46:36.267 INFO:teuthology.orchestra.run.smithi080.stdout: "segtrm": 0, 2024-04-26T18:46:36.267 INFO:teuthology.orchestra.run.smithi080.stdout: "seg": 2, 2024-04-26T18:46:36.267 INFO:teuthology.orchestra.run.smithi080.stdout: "segmjr": 2, 2024-04-26T18:46:36.267 INFO:teuthology.orchestra.run.smithi080.stdout: "segexg": 0, 2024-04-26T18:46:36.267 INFO:teuthology.orchestra.run.smithi080.stdout: "segexd": 0, 2024-04-26T18:46:36.268 INFO:teuthology.orchestra.run.smithi080.stdout: "expos": 4194304, 2024-04-26T18:46:36.268 INFO:teuthology.orchestra.run.smithi080.stdout: "wrpos": 4195283, 2024-04-26T18:46:36.268 INFO:teuthology.orchestra.run.smithi080.stdout: "rdpos": 4194892, 2024-04-26T18:46:36.268 INFO:teuthology.orchestra.run.smithi080.stdout: "jlat": { 2024-04-26T18:46:36.268 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.268 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.268 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.268 INFO:teuthology.orchestra.run.smithi080.stdout: "replayed": 3 2024-04-26T18:46:36.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.268 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_mem": { 2024-04-26T18:46:36.268 INFO:teuthology.orchestra.run.smithi080.stdout: "ino": 3, 2024-04-26T18:46:36.268 INFO:teuthology.orchestra.run.smithi080.stdout: "ino+": 3, 2024-04-26T18:46:36.268 INFO:teuthology.orchestra.run.smithi080.stdout: "ino-": 0, 2024-04-26T18:46:36.268 INFO:teuthology.orchestra.run.smithi080.stdout: "dir": 1, 2024-04-26T18:46:36.268 INFO:teuthology.orchestra.run.smithi080.stdout: "dir+": 1, 2024-04-26T18:46:36.269 INFO:teuthology.orchestra.run.smithi080.stdout: "dir-": 0, 2024-04-26T18:46:36.269 INFO:teuthology.orchestra.run.smithi080.stdout: "dn": 0, 2024-04-26T18:46:36.269 INFO:teuthology.orchestra.run.smithi080.stdout: "dn+": 0, 2024-04-26T18:46:36.269 INFO:teuthology.orchestra.run.smithi080.stdout: "dn-": 0, 2024-04-26T18:46:36.269 INFO:teuthology.orchestra.run.smithi080.stdout: "cap": 0, 2024-04-26T18:46:36.269 INFO:teuthology.orchestra.run.smithi080.stdout: "cap+": 0, 2024-04-26T18:46:36.269 INFO:teuthology.orchestra.run.smithi080.stdout: "cap-": 0, 2024-04-26T18:46:36.269 INFO:teuthology.orchestra.run.smithi080.stdout: "rss": 50480, 2024-04-26T18:46:36.269 INFO:teuthology.orchestra.run.smithi080.stdout: "heap": 215416 2024-04-26T18:46:36.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.269 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_server": { 2024-04-26T18:46:36.269 INFO:teuthology.orchestra.run.smithi080.stdout: "dispatch_client_request": 0, 2024-04-26T18:46:36.269 INFO:teuthology.orchestra.run.smithi080.stdout: "dispatch_server_request": 0, 2024-04-26T18:46:36.269 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_request": 0, 2024-04-26T18:46:36.269 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_session": 0, 2024-04-26T18:46:36.269 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_peer_request": 0, 2024-04-26T18:46:36.270 INFO:teuthology.orchestra.run.smithi080.stdout: "req_create_latency": { 2024-04-26T18:46:36.270 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.270 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.270 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.270 INFO:teuthology.orchestra.run.smithi080.stdout: "req_getattr_latency": { 2024-04-26T18:46:36.270 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.270 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.270 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.270 INFO:teuthology.orchestra.run.smithi080.stdout: "req_getfilelock_latency": { 2024-04-26T18:46:36.270 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.270 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.270 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.271 INFO:teuthology.orchestra.run.smithi080.stdout: "req_link_latency": { 2024-04-26T18:46:36.271 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.271 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.271 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.271 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookup_latency": { 2024-04-26T18:46:36.271 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.271 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.271 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.271 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookuphash_latency": { 2024-04-26T18:46:36.271 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.271 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.271 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.271 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookupino_latency": { 2024-04-26T18:46:36.272 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.272 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.272 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.272 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookupname_latency": { 2024-04-26T18:46:36.272 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.272 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.272 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.272 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookupparent_latency": { 2024-04-26T18:46:36.272 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.272 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.272 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.272 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookupsnap_latency": { 2024-04-26T18:46:36.272 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.273 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.273 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.273 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lssnap_latency": { 2024-04-26T18:46:36.273 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.273 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.273 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.273 INFO:teuthology.orchestra.run.smithi080.stdout: "req_mkdir_latency": { 2024-04-26T18:46:36.273 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.274 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.274 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.274 INFO:teuthology.orchestra.run.smithi080.stdout: "req_mknod_latency": { 2024-04-26T18:46:36.274 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.274 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.274 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.274 INFO:teuthology.orchestra.run.smithi080.stdout: "req_mksnap_latency": { 2024-04-26T18:46:36.274 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.274 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.275 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.275 INFO:teuthology.orchestra.run.smithi080.stdout: "req_open_latency": { 2024-04-26T18:46:36.275 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.275 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.275 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.275 INFO:teuthology.orchestra.run.smithi080.stdout: "req_readdir_latency": { 2024-04-26T18:46:36.275 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.275 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.275 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.275 INFO:teuthology.orchestra.run.smithi080.stdout: "req_rename_latency": { 2024-04-26T18:46:36.275 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.275 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.275 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.276 INFO:teuthology.orchestra.run.smithi080.stdout: "req_renamesnap_latency": { 2024-04-26T18:46:36.276 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.276 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.276 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.276 INFO:teuthology.orchestra.run.smithi080.stdout: "req_snapdiff_latency": { 2024-04-26T18:46:36.276 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.276 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.276 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.276 INFO:teuthology.orchestra.run.smithi080.stdout: "req_rmdir_latency": { 2024-04-26T18:46:36.276 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.276 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.276 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.277 INFO:teuthology.orchestra.run.smithi080.stdout: "req_rmsnap_latency": { 2024-04-26T18:46:36.277 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.277 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.277 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.277 INFO:teuthology.orchestra.run.smithi080.stdout: "req_rmxattr_latency": { 2024-04-26T18:46:36.277 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.277 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.277 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.277 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setattr_latency": { 2024-04-26T18:46:36.277 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.277 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.277 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.278 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setdirlayout_latency": { 2024-04-26T18:46:36.278 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.278 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.278 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.278 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setfilelock_latency": { 2024-04-26T18:46:36.278 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.278 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.278 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.278 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setlayout_latency": { 2024-04-26T18:46:36.278 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.278 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.278 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.279 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setxattr_latency": { 2024-04-26T18:46:36.279 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.279 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.279 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.279 INFO:teuthology.orchestra.run.smithi080.stdout: "req_symlink_latency": { 2024-04-26T18:46:36.279 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.279 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.279 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.279 INFO:teuthology.orchestra.run.smithi080.stdout: "req_unlink_latency": { 2024-04-26T18:46:36.279 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.279 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.279 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.279 INFO:teuthology.orchestra.run.smithi080.stdout: "cap_revoke_eviction": 0, 2024-04-26T18:46:36.280 INFO:teuthology.orchestra.run.smithi080.stdout: "cap_acquisition_throttle": 0, 2024-04-26T18:46:36.280 INFO:teuthology.orchestra.run.smithi080.stdout: "req_getvxattr_latency": { 2024-04-26T18:46:36.280 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.280 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.280 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.280 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:36.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.280 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_sessions": { 2024-04-26T18:46:36.280 INFO:teuthology.orchestra.run.smithi080.stdout: "session_count": 1, 2024-04-26T18:46:36.280 INFO:teuthology.orchestra.run.smithi080.stdout: "session_add": 1, 2024-04-26T18:46:36.280 INFO:teuthology.orchestra.run.smithi080.stdout: "session_remove": 0, 2024-04-26T18:46:36.280 INFO:teuthology.orchestra.run.smithi080.stdout: "sessions_open": 1, 2024-04-26T18:46:36.280 INFO:teuthology.orchestra.run.smithi080.stdout: "sessions_stale": 0, 2024-04-26T18:46:36.280 INFO:teuthology.orchestra.run.smithi080.stdout: "total_load": 0, 2024-04-26T18:46:36.280 INFO:teuthology.orchestra.run.smithi080.stdout: "average_load": 0, 2024-04-26T18:46:36.280 INFO:teuthology.orchestra.run.smithi080.stdout: "avg_session_uptime": 1783, 2024-04-26T18:46:36.281 INFO:teuthology.orchestra.run.smithi080.stdout: "mdthresh_evicted": 0 2024-04-26T18:46:36.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.281 INFO:teuthology.orchestra.run.smithi080.stdout: "mempool": { 2024-04-26T18:46:36.281 INFO:teuthology.orchestra.run.smithi080.stdout: "bloom_filter_bytes": 0, 2024-04-26T18:46:36.281 INFO:teuthology.orchestra.run.smithi080.stdout: "bloom_filter_items": 0, 2024-04-26T18:46:36.281 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T18:46:36.281 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_items": 0, 2024-04-26T18:46:36.281 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T18:46:36.281 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_data_items": 0, 2024-04-26T18:46:36.281 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T18:46:36.281 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T18:46:36.281 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T18:46:36.281 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T18:46:36.281 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T18:46:36.281 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_other_items": 0, 2024-04-26T18:46:36.281 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T18:46:36.282 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T18:46:36.282 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_bytes": 0, 2024-04-26T18:46:36.282 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_items": 0, 2024-04-26T18:46:36.282 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blob_bytes": 0, 2024-04-26T18:46:36.282 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blob_items": 0, 2024-04-26T18:46:36.282 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T18:46:36.282 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T18:46:36.282 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T18:46:36.282 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T18:46:36.282 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T18:46:36.282 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_items": 0, 2024-04-26T18:46:36.282 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_txc_bytes": 0, 2024-04-26T18:46:36.282 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_txc_items": 0, 2024-04-26T18:46:36.282 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T18:46:36.282 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T18:46:36.282 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_bytes": 0, 2024-04-26T18:46:36.283 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_items": 0, 2024-04-26T18:46:36.283 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_bytes": 0, 2024-04-26T18:46:36.283 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_items": 0, 2024-04-26T18:46:36.283 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T18:46:36.283 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_reader_items": 0, 2024-04-26T18:46:36.283 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T18:46:36.283 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_writer_items": 0, 2024-04-26T18:46:36.283 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_anon_bytes": 190195, 2024-04-26T18:46:36.283 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_anon_items": 54, 2024-04-26T18:46:36.283 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_meta_bytes": 0, 2024-04-26T18:46:36.283 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_meta_items": 0, 2024-04-26T18:46:36.283 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_bytes": 0, 2024-04-26T18:46:36.283 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_items": 0, 2024-04-26T18:46:36.283 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mapbl_bytes": 0, 2024-04-26T18:46:36.283 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mapbl_items": 0, 2024-04-26T18:46:36.283 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pglog_bytes": 0, 2024-04-26T18:46:36.284 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pglog_items": 0, 2024-04-26T18:46:36.284 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_bytes": 7936, 2024-04-26T18:46:36.284 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_items": 165, 2024-04-26T18:46:36.284 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T18:46:36.284 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_mapping_items": 0, 2024-04-26T18:46:36.284 INFO:teuthology.orchestra.run.smithi080.stdout: "pgmap_bytes": 0, 2024-04-26T18:46:36.284 INFO:teuthology.orchestra.run.smithi080.stdout: "pgmap_items": 0, 2024-04-26T18:46:36.284 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_co_bytes": 8512, 2024-04-26T18:46:36.284 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_co_items": 13, 2024-04-26T18:46:36.284 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_1_bytes": 0, 2024-04-26T18:46:36.284 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_1_items": 0, 2024-04-26T18:46:36.284 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_2_bytes": 0, 2024-04-26T18:46:36.284 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_2_items": 0 2024-04-26T18:46:36.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.284 INFO:teuthology.orchestra.run.smithi080.stdout: "objecter": { 2024-04-26T18:46:36.284 INFO:teuthology.orchestra.run.smithi080.stdout: "op_active": 0, 2024-04-26T18:46:36.285 INFO:teuthology.orchestra.run.smithi080.stdout: "op_laggy": 0, 2024-04-26T18:46:36.285 INFO:teuthology.orchestra.run.smithi080.stdout: "op_send": 2163, 2024-04-26T18:46:36.285 INFO:teuthology.orchestra.run.smithi080.stdout: "op_send_bytes": 21, 2024-04-26T18:46:36.285 INFO:teuthology.orchestra.run.smithi080.stdout: "op_resend": 3, 2024-04-26T18:46:36.285 INFO:teuthology.orchestra.run.smithi080.stdout: "op_reply": 2163, 2024-04-26T18:46:36.285 INFO:teuthology.orchestra.run.smithi080.stdout: "op_latency": { 2024-04-26T18:46:36.285 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 2163, 2024-04-26T18:46:36.285 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 1.403968196, 2024-04-26T18:46:36.285 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000649083 2024-04-26T18:46:36.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.285 INFO:teuthology.orchestra.run.smithi080.stdout: "op_inflight": 0, 2024-04-26T18:46:36.285 INFO:teuthology.orchestra.run.smithi080.stdout: "oplen_avg": { 2024-04-26T18:46:36.285 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 2163, 2024-04-26T18:46:36.285 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 2164 2024-04-26T18:46:36.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.285 INFO:teuthology.orchestra.run.smithi080.stdout: "op": 2163, 2024-04-26T18:46:36.286 INFO:teuthology.orchestra.run.smithi080.stdout: "op_r": 2163, 2024-04-26T18:46:36.286 INFO:teuthology.orchestra.run.smithi080.stdout: "op_w": 0, 2024-04-26T18:46:36.286 INFO:teuthology.orchestra.run.smithi080.stdout: "op_rmw": 0, 2024-04-26T18:46:36.286 INFO:teuthology.orchestra.run.smithi080.stdout: "op_pg": 0, 2024-04-26T18:46:36.286 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_stat": 1365, 2024-04-26T18:46:36.286 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_create": 0, 2024-04-26T18:46:36.286 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_read": 796, 2024-04-26T18:46:36.286 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_write": 0, 2024-04-26T18:46:36.286 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_writefull": 0, 2024-04-26T18:46:36.286 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_writesame": 0, 2024-04-26T18:46:36.286 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_append": 0, 2024-04-26T18:46:36.286 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_zero": 0, 2024-04-26T18:46:36.286 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_truncate": 0, 2024-04-26T18:46:36.286 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_delete": 0, 2024-04-26T18:46:36.286 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_mapext": 0, 2024-04-26T18:46:36.287 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_sparse_read": 0, 2024-04-26T18:46:36.287 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_clonerange": 0, 2024-04-26T18:46:36.287 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_getxattr": 1, 2024-04-26T18:46:36.287 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_setxattr": 0, 2024-04-26T18:46:36.287 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_cmpxattr": 0, 2024-04-26T18:46:36.287 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_rmxattr": 0, 2024-04-26T18:46:36.287 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_resetxattrs": 0, 2024-04-26T18:46:36.287 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_call": 0, 2024-04-26T18:46:36.287 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_watch": 0, 2024-04-26T18:46:36.287 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_notify": 0, 2024-04-26T18:46:36.287 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T18:46:36.287 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_pgls": 0, 2024-04-26T18:46:36.287 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_pgls_filter": 0, 2024-04-26T18:46:36.287 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_other": 0, 2024-04-26T18:46:36.287 INFO:teuthology.orchestra.run.smithi080.stdout: "linger_active": 0, 2024-04-26T18:46:36.287 INFO:teuthology.orchestra.run.smithi080.stdout: "linger_send": 0, 2024-04-26T18:46:36.288 INFO:teuthology.orchestra.run.smithi080.stdout: "linger_resend": 0, 2024-04-26T18:46:36.288 INFO:teuthology.orchestra.run.smithi080.stdout: "linger_ping": 0, 2024-04-26T18:46:36.288 INFO:teuthology.orchestra.run.smithi080.stdout: "poolop_active": 0, 2024-04-26T18:46:36.288 INFO:teuthology.orchestra.run.smithi080.stdout: "poolop_send": 0, 2024-04-26T18:46:36.288 INFO:teuthology.orchestra.run.smithi080.stdout: "poolop_resend": 0, 2024-04-26T18:46:36.288 INFO:teuthology.orchestra.run.smithi080.stdout: "poolstat_active": 0, 2024-04-26T18:46:36.288 INFO:teuthology.orchestra.run.smithi080.stdout: "poolstat_send": 0, 2024-04-26T18:46:36.288 INFO:teuthology.orchestra.run.smithi080.stdout: "poolstat_resend": 0, 2024-04-26T18:46:36.288 INFO:teuthology.orchestra.run.smithi080.stdout: "statfs_active": 0, 2024-04-26T18:46:36.288 INFO:teuthology.orchestra.run.smithi080.stdout: "statfs_send": 0, 2024-04-26T18:46:36.288 INFO:teuthology.orchestra.run.smithi080.stdout: "statfs_resend": 0, 2024-04-26T18:46:36.288 INFO:teuthology.orchestra.run.smithi080.stdout: "command_active": 0, 2024-04-26T18:46:36.288 INFO:teuthology.orchestra.run.smithi080.stdout: "command_send": 0, 2024-04-26T18:46:36.288 INFO:teuthology.orchestra.run.smithi080.stdout: "command_resend": 0, 2024-04-26T18:46:36.288 INFO:teuthology.orchestra.run.smithi080.stdout: "map_epoch": 101, 2024-04-26T18:46:36.288 INFO:teuthology.orchestra.run.smithi080.stdout: "map_full": 0, 2024-04-26T18:46:36.289 INFO:teuthology.orchestra.run.smithi080.stdout: "map_inc": 12, 2024-04-26T18:46:36.289 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_sessions": 5, 2024-04-26T18:46:36.289 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_session_open": 5, 2024-04-26T18:46:36.289 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_session_close": 0, 2024-04-26T18:46:36.289 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_laggy": 0, 2024-04-26T18:46:36.289 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_wr": 0, 2024-04-26T18:46:36.289 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_rd": 2, 2024-04-26T18:46:36.289 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_del": 0 2024-04-26T18:46:36.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.289 INFO:teuthology.orchestra.run.smithi080.stdout: "oft": { 2024-04-26T18:46:36.289 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_total_objs": 0, 2024-04-26T18:46:36.289 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_total_kv_pairs": 0, 2024-04-26T18:46:36.289 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_total_updates": 0, 2024-04-26T18:46:36.289 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_total_removes": 0 2024-04-26T18:46:36.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.289 INFO:teuthology.orchestra.run.smithi080.stdout: "osd-slow-ops": { 2024-04-26T18:46:36.290 INFO:teuthology.orchestra.run.smithi080.stdout: "slow_ops_count": 0 2024-04-26T18:46:36.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.290 INFO:teuthology.orchestra.run.smithi080.stdout: "purge_queue": { 2024-04-26T18:46:36.290 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executing_ops": 0, 2024-04-26T18:46:36.290 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executing_ops_high_water": 0, 2024-04-26T18:46:36.290 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executing": 0, 2024-04-26T18:46:36.290 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executing_high_water": 0, 2024-04-26T18:46:36.290 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executed_ops": 0, 2024-04-26T18:46:36.290 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executed": 0, 2024-04-26T18:46:36.290 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_item_in_journal": 0 2024-04-26T18:46:36.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.290 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T18:46:36.290 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T18:46:36.290 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 104857600, 2024-04-26T18:46:36.290 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T18:46:36.290 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 2419, 2024-04-26T18:46:36.291 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 2029336, 2024-04-26T18:46:36.291 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:36.291 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 2419, 2024-04-26T18:46:36.291 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 0, 2024-04-26T18:46:36.291 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 0, 2024-04-26T18:46:36.291 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 2419, 2024-04-26T18:46:36.291 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 2029336, 2024-04-26T18:46:36.291 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T18:46:36.291 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.291 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.291 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.291 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:36.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.292 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-objecter_bytes": { 2024-04-26T18:46:36.292 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T18:46:36.292 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 104857600, 2024-04-26T18:46:36.292 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T18:46:36.292 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 0, 2024-04-26T18:46:36.292 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 0, 2024-04-26T18:46:36.292 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:36.292 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 0, 2024-04-26T18:46:36.292 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 2163, 2024-04-26T18:46:36.292 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 984, 2024-04-26T18:46:36.292 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 2163, 2024-04-26T18:46:36.292 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 984, 2024-04-26T18:46:36.292 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T18:46:36.292 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.292 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.293 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.293 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:36.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.293 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-objecter_ops": { 2024-04-26T18:46:36.293 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T18:46:36.293 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 1024, 2024-04-26T18:46:36.293 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T18:46:36.293 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 0, 2024-04-26T18:46:36.293 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 0, 2024-04-26T18:46:36.293 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:36.293 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 0, 2024-04-26T18:46:36.293 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 2163, 2024-04-26T18:46:36.293 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 2163, 2024-04-26T18:46:36.293 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 2163, 2024-04-26T18:46:36.293 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 2163, 2024-04-26T18:46:36.293 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T18:46:36.294 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.294 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.294 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.294 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:36.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.294 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-write_buf_throttle": { 2024-04-26T18:46:36.294 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T18:46:36.294 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 3758096384, 2024-04-26T18:46:36.294 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T18:46:36.294 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 0, 2024-04-26T18:46:36.294 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 0, 2024-04-26T18:46:36.294 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:36.294 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 0, 2024-04-26T18:46:36.294 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 0, 2024-04-26T18:46:36.294 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 0, 2024-04-26T18:46:36.294 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 0, 2024-04-26T18:46:36.295 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 0, 2024-04-26T18:46:36.295 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T18:46:36.295 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.295 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.295 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.295 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:36.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:36.295 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-write_buf_throttle-0x560e68eb86e0": { 2024-04-26T18:46:36.295 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T18:46:36.295 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 3758096384, 2024-04-26T18:46:36.295 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T18:46:36.295 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 0, 2024-04-26T18:46:36.295 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 0, 2024-04-26T18:46:36.295 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:36.295 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 0, 2024-04-26T18:46:36.295 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 0, 2024-04-26T18:46:36.296 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 0, 2024-04-26T18:46:36.296 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 0, 2024-04-26T18:46:36.296 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 0, 2024-04-26T18:46:36.296 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T18:46:36.296 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:36.296 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:36.296 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:36.296 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:36.296 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:36.296 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:46:37.049 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-04-26T18:46:37.049 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-04-26T18:46:37.049 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-04-26T18:46:37.049 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-04-26T18:46:37.049 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-04-26T18:46:37.049 DEBUG:tasks.check_counter:Getting stats from d 2024-04-26T18:46:37.050 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph daemon mds.d perf dump 2024-04-26T18:46:37.294 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:46:37.355 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:37 smithi080 ceph-mon[29135]: pgmap v316: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-26T18:46:37.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:37 smithi082 ceph-mon[32808]: pgmap v316: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-26T18:46:37.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:37 smithi192 ceph-mon[32842]: pgmap v316: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-26T18:46:39.028 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:46:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T18:46:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 240, 2024-04-26T18:46:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 229, 2024-04-26T18:46:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 1594832, 2024-04-26T18:46:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 140864, 2024-04-26T18:46:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 4, 2024-04-26T18:46:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 0, 2024-04-26T18:46:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.044001273, 2024-04-26T18:46:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.014994346, 2024-04-26T18:46:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.032448596, 2024-04-26T18:46:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.004507567, 2024-04-26T18:46:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 228, 2024-04-26T18:46:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.011442777, 2024-04-26T18:46:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000050187 2024-04-26T18:46:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 1594832, 2024-04-26T18:46:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 140864 2024-04-26T18:46:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T18:46:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 2, 2024-04-26T18:46:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 175, 2024-04-26T18:46:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 320, 2024-04-26T18:46:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 187904, 2024-04-26T18:46:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 5, 2024-04-26T18:46:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 3, 2024-04-26T18:46:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.014493984, 2024-04-26T18:46:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.010026481, 2024-04-26T18:46:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.001803609, 2024-04-26T18:46:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-26T18:46:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 172, 2024-04-26T18:46:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.016214745, 2024-04-26T18:46:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000094271 2024-04-26T18:46:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-26T18:46:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 187904 2024-04-26T18:46:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T18:46:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 4, 2024-04-26T18:46:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 4, 2024-04-26T18:46:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 2992, 2024-04-26T18:46:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 448, 2024-04-26T18:46:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 2, 2024-04-26T18:46:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 1, 2024-04-26T18:46:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.000628466, 2024-04-26T18:46:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.000040206, 2024-04-26T18:46:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.000566438, 2024-04-26T18:46:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-26T18:46:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 3, 2024-04-26T18:46:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000696177, 2024-04-26T18:46:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000232059 2024-04-26T18:46:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-04-26T18:46:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 448 2024-04-26T18:46:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "cct": { 2024-04-26T18:46:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "total_workers": 0, 2024-04-26T18:46:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "unhealthy_workers": 0 2024-04-26T18:46:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "mempool": { 2024-04-26T18:46:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bloom_filter_bytes": 0, 2024-04-26T18:46:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bloom_filter_items": 0, 2024-04-26T18:46:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T18:46:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_items": 0, 2024-04-26T18:46:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T18:46:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_data_items": 0, 2024-04-26T18:46:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T18:46:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T18:46:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T18:46:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T18:46:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T18:46:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_other_items": 0, 2024-04-26T18:46:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T18:46:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T18:46:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_bytes": 0, 2024-04-26T18:46:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_items": 0, 2024-04-26T18:46:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blob_bytes": 0, 2024-04-26T18:46:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blob_items": 0, 2024-04-26T18:46:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T18:46:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T18:46:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T18:46:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T18:46:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T18:46:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_items": 0, 2024-04-26T18:46:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_txc_bytes": 0, 2024-04-26T18:46:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_txc_items": 0, 2024-04-26T18:46:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T18:46:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T18:46:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_bytes": 0, 2024-04-26T18:46:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_items": 0, 2024-04-26T18:46:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_bytes": 0, 2024-04-26T18:46:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_items": 0, 2024-04-26T18:46:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T18:46:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_reader_items": 0, 2024-04-26T18:46:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T18:46:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_writer_items": 0, 2024-04-26T18:46:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_anon_bytes": 148754, 2024-04-26T18:46:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_anon_items": 31, 2024-04-26T18:46:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_meta_bytes": 0, 2024-04-26T18:46:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_meta_items": 0, 2024-04-26T18:46:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_bytes": 0, 2024-04-26T18:46:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_items": 0, 2024-04-26T18:46:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mapbl_bytes": 0, 2024-04-26T18:46:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mapbl_items": 0, 2024-04-26T18:46:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pglog_bytes": 0, 2024-04-26T18:46:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pglog_items": 0, 2024-04-26T18:46:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_bytes": 0, 2024-04-26T18:46:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_items": 0, 2024-04-26T18:46:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T18:46:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_mapping_items": 0, 2024-04-26T18:46:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "pgmap_bytes": 0, 2024-04-26T18:46:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "pgmap_items": 0, 2024-04-26T18:46:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_co_bytes": 928, 2024-04-26T18:46:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_co_items": 2, 2024-04-26T18:46:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_1_bytes": 0, 2024-04-26T18:46:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_1_items": 0, 2024-04-26T18:46:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_2_bytes": 0, 2024-04-26T18:46:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_2_items": 0 2024-04-26T18:46:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T18:46:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T18:46:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 104857600, 2024-04-26T18:46:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T18:46:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 242, 2024-04-26T18:46:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 1560964, 2024-04-26T18:46:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 242, 2024-04-26T18:46:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 0, 2024-04-26T18:46:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 0, 2024-04-26T18:46:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 242, 2024-04-26T18:46:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 1560964, 2024-04-26T18:46:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T18:46:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:39.039 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:46:39.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:39 smithi082 ceph-mon[32808]: pgmap v317: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-26T18:46:39.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:39 smithi080 ceph-mon[29135]: pgmap v317: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-26T18:46:39.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:39 smithi192 ceph-mon[32842]: pgmap v317: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-26T18:46:39.827 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-04-26T18:46:39.827 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-04-26T18:46:39.827 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-04-26T18:46:39.827 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-04-26T18:46:39.827 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-04-26T18:46:39.827 DEBUG:tasks.check_counter:Getting stats from g 2024-04-26T18:46:39.827 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph daemon mds.g perf dump 2024-04-26T18:46:40.086 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:46:40.462 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:40 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:46:40.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:40 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:46:40.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:40 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:46:41.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:41 smithi192 ceph-mon[32842]: pgmap v318: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T18:46:41.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:41 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:41.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:41 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:41.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:41 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:41.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:41 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:41.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:41 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:41.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:41 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:41.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:41 smithi080 ceph-mon[29135]: pgmap v318: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T18:46:41.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:41 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:41.622 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:41 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:41.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:41 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:41.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:41 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:41.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:41 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:41.623 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:41 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:41.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:41 smithi082 ceph-mon[32808]: pgmap v318: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T18:46:41.772 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:41 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:41.772 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:41 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:41.772 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:41 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:41.773 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:41 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:41.773 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:41 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:41.773 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:41 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:41.929 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:46:41.929 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T18:46:41.929 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 1054, 2024-04-26T18:46:41.929 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 1038, 2024-04-26T18:46:41.929 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 1910842, 2024-04-26T18:46:41.929 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 394054, 2024-04-26T18:46:41.929 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 5, 2024-04-26T18:46:41.929 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 1, 2024-04-26T18:46:41.929 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.137784143, 2024-04-26T18:46:41.929 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.053738016, 2024-04-26T18:46:41.930 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.057364645, 2024-04-26T18:46:41.930 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.027983725, 2024-04-26T18:46:41.930 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:41.930 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 1037, 2024-04-26T18:46:41.930 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.050729068, 2024-04-26T18:46:41.930 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000048919 2024-04-26T18:46:41.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.930 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:41.930 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.930 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.930 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.930 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 1642640, 2024-04-26T18:46:41.931 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 140608 2024-04-26T18:46:41.931 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.931 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T18:46:41.931 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 1421, 2024-04-26T18:46:41.931 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 1590, 2024-04-26T18:46:41.931 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 364029, 2024-04-26T18:46:41.931 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 912387, 2024-04-26T18:46:41.931 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 7, 2024-04-26T18:46:41.931 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 5, 2024-04-26T18:46:41.931 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.104208966, 2024-04-26T18:46:41.931 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.034719763, 2024-04-26T18:46:41.931 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.024345036, 2024-04-26T18:46:41.931 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.035604113, 2024-04-26T18:46:41.931 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:41.931 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 1587, 2024-04-26T18:46:41.932 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.061359376, 2024-04-26T18:46:41.932 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000038663 2024-04-26T18:46:41.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.932 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:41.932 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.932 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.932 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.932 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-26T18:46:41.932 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 461088 2024-04-26T18:46:41.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.932 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T18:46:41.932 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 8, 2024-04-26T18:46:41.932 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 8, 2024-04-26T18:46:41.933 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 4621, 2024-04-26T18:46:41.933 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 1732, 2024-04-26T18:46:41.933 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 5, 2024-04-26T18:46:41.933 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 4, 2024-04-26T18:46:41.933 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.001647756, 2024-04-26T18:46:41.933 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.000084901, 2024-04-26T18:46:41.933 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.001419425, 2024-04-26T18:46:41.933 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.000083634, 2024-04-26T18:46:41.933 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:41.933 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 7, 2024-04-26T18:46:41.933 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.002845421, 2024-04-26T18:46:41.933 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000406488 2024-04-26T18:46:41.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.933 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:41.934 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.934 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.934 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.934 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-04-26T18:46:41.934 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 448 2024-04-26T18:46:41.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.934 INFO:teuthology.orchestra.run.smithi080.stdout: "cct": { 2024-04-26T18:46:41.934 INFO:teuthology.orchestra.run.smithi080.stdout: "total_workers": 1, 2024-04-26T18:46:41.934 INFO:teuthology.orchestra.run.smithi080.stdout: "unhealthy_workers": 0 2024-04-26T18:46:41.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.934 INFO:teuthology.orchestra.run.smithi080.stdout: "finisher-MDSRank": { 2024-04-26T18:46:41.934 INFO:teuthology.orchestra.run.smithi080.stdout: "queue_len": 0, 2024-04-26T18:46:41.934 INFO:teuthology.orchestra.run.smithi080.stdout: "complete_latency": { 2024-04-26T18:46:41.934 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 3793, 2024-04-26T18:46:41.935 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.091783170, 2024-04-26T18:46:41.935 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000024198 2024-04-26T18:46:41.935 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:41.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.935 INFO:teuthology.orchestra.run.smithi080.stdout: "finisher-PurgeQueue": { 2024-04-26T18:46:41.935 INFO:teuthology.orchestra.run.smithi080.stdout: "queue_len": 0, 2024-04-26T18:46:41.935 INFO:teuthology.orchestra.run.smithi080.stdout: "complete_latency": { 2024-04-26T18:46:41.935 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.935 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.935 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.935 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:41.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.935 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": { 2024-04-26T18:46:41.935 INFO:teuthology.orchestra.run.smithi080.stdout: "request": 0, 2024-04-26T18:46:41.935 INFO:teuthology.orchestra.run.smithi080.stdout: "reply": 0, 2024-04-26T18:46:41.936 INFO:teuthology.orchestra.run.smithi080.stdout: "reply_latency": { 2024-04-26T18:46:41.936 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.936 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.936 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.936 INFO:teuthology.orchestra.run.smithi080.stdout: "slow_reply": 0, 2024-04-26T18:46:41.936 INFO:teuthology.orchestra.run.smithi080.stdout: "forward": 0, 2024-04-26T18:46:41.936 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_fetch_complete": 0, 2024-04-26T18:46:41.936 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_fetch_keys": 0, 2024-04-26T18:46:41.936 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_commit": 0, 2024-04-26T18:46:41.936 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_split": 0, 2024-04-26T18:46:41.936 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_merge": 0, 2024-04-26T18:46:41.936 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes": 0, 2024-04-26T18:46:41.936 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_top": 0, 2024-04-26T18:46:41.936 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_bottom": 0, 2024-04-26T18:46:41.937 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_pin_tail": 0, 2024-04-26T18:46:41.937 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_pinned": 0, 2024-04-26T18:46:41.937 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_expired": 0, 2024-04-26T18:46:41.937 INFO:teuthology.orchestra.run.smithi080.stdout: "inodes_with_caps": 0, 2024-04-26T18:46:41.937 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": 0, 2024-04-26T18:46:41.937 INFO:teuthology.orchestra.run.smithi080.stdout: "subtrees": 1, 2024-04-26T18:46:41.937 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse": 0, 2024-04-26T18:46:41.937 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_hit": 0, 2024-04-26T18:46:41.937 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_forward": 0, 2024-04-26T18:46:41.937 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_discover": 0, 2024-04-26T18:46:41.937 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_dir_fetch": 0, 2024-04-26T18:46:41.937 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_remote_ino": 0, 2024-04-26T18:46:41.937 INFO:teuthology.orchestra.run.smithi080.stdout: "traverse_lock": 0, 2024-04-26T18:46:41.937 INFO:teuthology.orchestra.run.smithi080.stdout: "load_cent": 0, 2024-04-26T18:46:41.937 INFO:teuthology.orchestra.run.smithi080.stdout: "q": 0, 2024-04-26T18:46:41.938 INFO:teuthology.orchestra.run.smithi080.stdout: "exported": 0, 2024-04-26T18:46:41.938 INFO:teuthology.orchestra.run.smithi080.stdout: "exported_inodes": 0, 2024-04-26T18:46:41.938 INFO:teuthology.orchestra.run.smithi080.stdout: "imported": 0, 2024-04-26T18:46:41.938 INFO:teuthology.orchestra.run.smithi080.stdout: "imported_inodes": 0, 2024-04-26T18:46:41.938 INFO:teuthology.orchestra.run.smithi080.stdout: "openino_dir_fetch": 0, 2024-04-26T18:46:41.938 INFO:teuthology.orchestra.run.smithi080.stdout: "openino_backtrace_fetch": 0, 2024-04-26T18:46:41.938 INFO:teuthology.orchestra.run.smithi080.stdout: "openino_peer_discover": 0, 2024-04-26T18:46:41.938 INFO:teuthology.orchestra.run.smithi080.stdout: "root_rfiles": 0, 2024-04-26T18:46:41.938 INFO:teuthology.orchestra.run.smithi080.stdout: "root_rbytes": 0, 2024-04-26T18:46:41.938 INFO:teuthology.orchestra.run.smithi080.stdout: "root_rsnaps": 0, 2024-04-26T18:46:41.938 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T18:46:41.938 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_set_tag": 0, 2024-04-26T18:46:41.938 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T18:46:41.938 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_inotable_repaired": 0, 2024-04-26T18:46:41.939 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_dir_inodes": 0, 2024-04-26T18:46:41.939 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T18:46:41.939 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T18:46:41.939 INFO:teuthology.orchestra.run.smithi080.stdout: "scrub_file_inodes": 0, 2024-04-26T18:46:41.939 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_inode_file_caps": 0, 2024-04-26T18:46:41.939 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_revoke": 0, 2024-04-26T18:46:41.939 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_grant": 0, 2024-04-26T18:46:41.939 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T18:46:41.939 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T18:46:41.939 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T18:46:41.939 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_caps": 0, 2024-04-26T18:46:41.939 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_caps_dirty": 0, 2024-04-26T18:46:41.939 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_cap_release": 0, 2024-04-26T18:46:41.939 INFO:teuthology.orchestra.run.smithi080.stdout: "process_request_cap_release": 0 2024-04-26T18:46:41.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.939 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache": { 2024-04-26T18:46:41.940 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_update": 0, 2024-04-26T18:46:41.940 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_update_receipt": 0, 2024-04-26T18:46:41.940 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_try_discover": 0, 2024-04-26T18:46:41.940 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_send_discover": 0, 2024-04-26T18:46:41.940 INFO:teuthology.orchestra.run.smithi080.stdout: "dir_handle_discover": 0, 2024-04-26T18:46:41.940 INFO:teuthology.orchestra.run.smithi080.stdout: "num_strays": 0, 2024-04-26T18:46:41.940 INFO:teuthology.orchestra.run.smithi080.stdout: "num_strays_delayed": 0, 2024-04-26T18:46:41.940 INFO:teuthology.orchestra.run.smithi080.stdout: "num_strays_enqueuing": 0, 2024-04-26T18:46:41.940 INFO:teuthology.orchestra.run.smithi080.stdout: "strays_created": 0, 2024-04-26T18:46:41.940 INFO:teuthology.orchestra.run.smithi080.stdout: "strays_enqueued": 0, 2024-04-26T18:46:41.940 INFO:teuthology.orchestra.run.smithi080.stdout: "strays_reintegrated": 0, 2024-04-26T18:46:41.940 INFO:teuthology.orchestra.run.smithi080.stdout: "strays_migrated": 0, 2024-04-26T18:46:41.940 INFO:teuthology.orchestra.run.smithi080.stdout: "num_recovering_processing": 0, 2024-04-26T18:46:41.940 INFO:teuthology.orchestra.run.smithi080.stdout: "num_recovering_enqueued": 0, 2024-04-26T18:46:41.940 INFO:teuthology.orchestra.run.smithi080.stdout: "num_recovering_prioritized": 0, 2024-04-26T18:46:41.940 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_started": 0, 2024-04-26T18:46:41.941 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_completed": 0, 2024-04-26T18:46:41.941 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_quiesce_path": 0, 2024-04-26T18:46:41.941 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_quiesce_inode": 0, 2024-04-26T18:46:41.941 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T18:46:41.941 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_exportdir": 0, 2024-04-26T18:46:41.941 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_flush": 0, 2024-04-26T18:46:41.941 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_fragmentdir": 0, 2024-04-26T18:46:41.941 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_fragstats": 0, 2024-04-26T18:46:41.941 INFO:teuthology.orchestra.run.smithi080.stdout: "ireq_inodestats": 0 2024-04-26T18:46:41.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.941 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log": { 2024-04-26T18:46:41.941 INFO:teuthology.orchestra.run.smithi080.stdout: "evlrg": 0, 2024-04-26T18:46:41.941 INFO:teuthology.orchestra.run.smithi080.stdout: "evadd": 0, 2024-04-26T18:46:41.941 INFO:teuthology.orchestra.run.smithi080.stdout: "evex": 0, 2024-04-26T18:46:41.941 INFO:teuthology.orchestra.run.smithi080.stdout: "evtrm": 0, 2024-04-26T18:46:41.942 INFO:teuthology.orchestra.run.smithi080.stdout: "ev": 6, 2024-04-26T18:46:41.942 INFO:teuthology.orchestra.run.smithi080.stdout: "evexg": 0, 2024-04-26T18:46:41.942 INFO:teuthology.orchestra.run.smithi080.stdout: "evexd": 0, 2024-04-26T18:46:41.942 INFO:teuthology.orchestra.run.smithi080.stdout: "segadd": 0, 2024-04-26T18:46:41.942 INFO:teuthology.orchestra.run.smithi080.stdout: "segex": 0, 2024-04-26T18:46:41.942 INFO:teuthology.orchestra.run.smithi080.stdout: "segtrm": 0, 2024-04-26T18:46:41.942 INFO:teuthology.orchestra.run.smithi080.stdout: "seg": 2, 2024-04-26T18:46:41.942 INFO:teuthology.orchestra.run.smithi080.stdout: "segmjr": 2, 2024-04-26T18:46:41.942 INFO:teuthology.orchestra.run.smithi080.stdout: "segexg": 0, 2024-04-26T18:46:41.942 INFO:teuthology.orchestra.run.smithi080.stdout: "segexd": 0, 2024-04-26T18:46:41.942 INFO:teuthology.orchestra.run.smithi080.stdout: "expos": 4194304, 2024-04-26T18:46:41.942 INFO:teuthology.orchestra.run.smithi080.stdout: "wrpos": 4196123, 2024-04-26T18:46:41.942 INFO:teuthology.orchestra.run.smithi080.stdout: "rdpos": 4195982, 2024-04-26T18:46:41.942 INFO:teuthology.orchestra.run.smithi080.stdout: "jlat": { 2024-04-26T18:46:41.942 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.942 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.943 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.943 INFO:teuthology.orchestra.run.smithi080.stdout: "replayed": 6 2024-04-26T18:46:41.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.943 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_mem": { 2024-04-26T18:46:41.943 INFO:teuthology.orchestra.run.smithi080.stdout: "ino": 3, 2024-04-26T18:46:41.943 INFO:teuthology.orchestra.run.smithi080.stdout: "ino+": 3, 2024-04-26T18:46:41.943 INFO:teuthology.orchestra.run.smithi080.stdout: "ino-": 0, 2024-04-26T18:46:41.943 INFO:teuthology.orchestra.run.smithi080.stdout: "dir": 1, 2024-04-26T18:46:41.943 INFO:teuthology.orchestra.run.smithi080.stdout: "dir+": 1, 2024-04-26T18:46:41.943 INFO:teuthology.orchestra.run.smithi080.stdout: "dir-": 0, 2024-04-26T18:46:41.943 INFO:teuthology.orchestra.run.smithi080.stdout: "dn": 0, 2024-04-26T18:46:41.943 INFO:teuthology.orchestra.run.smithi080.stdout: "dn+": 0, 2024-04-26T18:46:41.943 INFO:teuthology.orchestra.run.smithi080.stdout: "dn-": 0, 2024-04-26T18:46:41.943 INFO:teuthology.orchestra.run.smithi080.stdout: "cap": 0, 2024-04-26T18:46:41.943 INFO:teuthology.orchestra.run.smithi080.stdout: "cap+": 0, 2024-04-26T18:46:41.944 INFO:teuthology.orchestra.run.smithi080.stdout: "cap-": 0, 2024-04-26T18:46:41.944 INFO:teuthology.orchestra.run.smithi080.stdout: "rss": 52972, 2024-04-26T18:46:41.944 INFO:teuthology.orchestra.run.smithi080.stdout: "heap": 215416 2024-04-26T18:46:41.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.944 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_server": { 2024-04-26T18:46:41.944 INFO:teuthology.orchestra.run.smithi080.stdout: "dispatch_client_request": 0, 2024-04-26T18:46:41.944 INFO:teuthology.orchestra.run.smithi080.stdout: "dispatch_server_request": 0, 2024-04-26T18:46:41.944 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_request": 0, 2024-04-26T18:46:41.944 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_client_session": 0, 2024-04-26T18:46:41.944 INFO:teuthology.orchestra.run.smithi080.stdout: "handle_peer_request": 0, 2024-04-26T18:46:41.944 INFO:teuthology.orchestra.run.smithi080.stdout: "req_create_latency": { 2024-04-26T18:46:41.944 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.944 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.944 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.944 INFO:teuthology.orchestra.run.smithi080.stdout: "req_getattr_latency": { 2024-04-26T18:46:41.944 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.945 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.945 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.945 INFO:teuthology.orchestra.run.smithi080.stdout: "req_getfilelock_latency": { 2024-04-26T18:46:41.945 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.945 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.945 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.945 INFO:teuthology.orchestra.run.smithi080.stdout: "req_link_latency": { 2024-04-26T18:46:41.945 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.945 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.945 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.945 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookup_latency": { 2024-04-26T18:46:41.945 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.945 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.946 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.946 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookuphash_latency": { 2024-04-26T18:46:41.946 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.946 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.946 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.946 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookupino_latency": { 2024-04-26T18:46:41.946 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.946 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.946 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.946 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookupname_latency": { 2024-04-26T18:46:41.946 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.947 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.947 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.947 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookupparent_latency": { 2024-04-26T18:46:41.947 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.947 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.947 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.947 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lookupsnap_latency": { 2024-04-26T18:46:41.947 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.947 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.947 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.947 INFO:teuthology.orchestra.run.smithi080.stdout: "req_lssnap_latency": { 2024-04-26T18:46:41.947 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.947 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.948 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.948 INFO:teuthology.orchestra.run.smithi080.stdout: "req_mkdir_latency": { 2024-04-26T18:46:41.948 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.948 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.948 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.949 INFO:teuthology.orchestra.run.smithi080.stdout: "req_mknod_latency": { 2024-04-26T18:46:41.949 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.949 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.949 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.949 INFO:teuthology.orchestra.run.smithi080.stdout: "req_mksnap_latency": { 2024-04-26T18:46:41.949 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.949 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.949 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.949 INFO:teuthology.orchestra.run.smithi080.stdout: "req_open_latency": { 2024-04-26T18:46:41.949 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.949 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.949 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.950 INFO:teuthology.orchestra.run.smithi080.stdout: "req_readdir_latency": { 2024-04-26T18:46:41.950 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.950 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.950 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.950 INFO:teuthology.orchestra.run.smithi080.stdout: "req_rename_latency": { 2024-04-26T18:46:41.950 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.950 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.950 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.950 INFO:teuthology.orchestra.run.smithi080.stdout: "req_renamesnap_latency": { 2024-04-26T18:46:41.950 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.950 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.950 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.951 INFO:teuthology.orchestra.run.smithi080.stdout: "req_snapdiff_latency": { 2024-04-26T18:46:41.951 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.951 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.951 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.951 INFO:teuthology.orchestra.run.smithi080.stdout: "req_rmdir_latency": { 2024-04-26T18:46:41.951 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.951 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.951 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.951 INFO:teuthology.orchestra.run.smithi080.stdout: "req_rmsnap_latency": { 2024-04-26T18:46:41.951 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.951 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.951 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.952 INFO:teuthology.orchestra.run.smithi080.stdout: "req_rmxattr_latency": { 2024-04-26T18:46:41.952 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.952 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.952 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.952 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setattr_latency": { 2024-04-26T18:46:41.952 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.952 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.952 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.952 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setdirlayout_latency": { 2024-04-26T18:46:41.952 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.952 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.952 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.952 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setfilelock_latency": { 2024-04-26T18:46:41.953 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.953 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.953 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.953 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setlayout_latency": { 2024-04-26T18:46:41.953 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.953 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.953 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.953 INFO:teuthology.orchestra.run.smithi080.stdout: "req_setxattr_latency": { 2024-04-26T18:46:41.953 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.953 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.953 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.953 INFO:teuthology.orchestra.run.smithi080.stdout: "req_symlink_latency": { 2024-04-26T18:46:41.954 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.954 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.954 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.954 INFO:teuthology.orchestra.run.smithi080.stdout: "req_unlink_latency": { 2024-04-26T18:46:41.954 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.954 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.954 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.954 INFO:teuthology.orchestra.run.smithi080.stdout: "cap_revoke_eviction": 0, 2024-04-26T18:46:41.954 INFO:teuthology.orchestra.run.smithi080.stdout: "cap_acquisition_throttle": 0, 2024-04-26T18:46:41.954 INFO:teuthology.orchestra.run.smithi080.stdout: "req_getvxattr_latency": { 2024-04-26T18:46:41.954 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.954 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.954 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.955 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:41.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.955 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_sessions": { 2024-04-26T18:46:41.955 INFO:teuthology.orchestra.run.smithi080.stdout: "session_count": 2, 2024-04-26T18:46:41.955 INFO:teuthology.orchestra.run.smithi080.stdout: "session_add": 3, 2024-04-26T18:46:41.955 INFO:teuthology.orchestra.run.smithi080.stdout: "session_remove": 1, 2024-04-26T18:46:41.955 INFO:teuthology.orchestra.run.smithi080.stdout: "sessions_open": 3, 2024-04-26T18:46:41.955 INFO:teuthology.orchestra.run.smithi080.stdout: "sessions_stale": 0, 2024-04-26T18:46:41.955 INFO:teuthology.orchestra.run.smithi080.stdout: "total_load": 0, 2024-04-26T18:46:41.955 INFO:teuthology.orchestra.run.smithi080.stdout: "average_load": 0, 2024-04-26T18:46:41.955 INFO:teuthology.orchestra.run.smithi080.stdout: "avg_session_uptime": 2379, 2024-04-26T18:46:41.955 INFO:teuthology.orchestra.run.smithi080.stdout: "mdthresh_evicted": 0 2024-04-26T18:46:41.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.955 INFO:teuthology.orchestra.run.smithi080.stdout: "mempool": { 2024-04-26T18:46:41.955 INFO:teuthology.orchestra.run.smithi080.stdout: "bloom_filter_bytes": 0, 2024-04-26T18:46:41.955 INFO:teuthology.orchestra.run.smithi080.stdout: "bloom_filter_items": 0, 2024-04-26T18:46:41.956 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T18:46:41.956 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_items": 0, 2024-04-26T18:46:41.956 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T18:46:41.956 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_data_items": 0, 2024-04-26T18:46:41.956 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T18:46:41.956 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T18:46:41.956 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T18:46:41.956 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T18:46:41.956 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T18:46:41.956 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_other_items": 0, 2024-04-26T18:46:41.956 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T18:46:41.956 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T18:46:41.956 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_bytes": 0, 2024-04-26T18:46:41.956 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_items": 0, 2024-04-26T18:46:41.956 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blob_bytes": 0, 2024-04-26T18:46:41.956 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blob_items": 0, 2024-04-26T18:46:41.956 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T18:46:41.957 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T18:46:41.957 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T18:46:41.957 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T18:46:41.957 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T18:46:41.957 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_items": 0, 2024-04-26T18:46:41.957 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_txc_bytes": 0, 2024-04-26T18:46:41.957 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_txc_items": 0, 2024-04-26T18:46:41.957 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T18:46:41.957 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T18:46:41.957 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_bytes": 0, 2024-04-26T18:46:41.957 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_items": 0, 2024-04-26T18:46:41.957 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_bytes": 0, 2024-04-26T18:46:41.957 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_items": 0, 2024-04-26T18:46:41.957 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T18:46:41.957 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_reader_items": 0, 2024-04-26T18:46:41.958 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T18:46:41.958 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_writer_items": 0, 2024-04-26T18:46:41.958 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_anon_bytes": 198241, 2024-04-26T18:46:41.958 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_anon_items": 56, 2024-04-26T18:46:41.958 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_meta_bytes": 0, 2024-04-26T18:46:41.958 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_meta_items": 0, 2024-04-26T18:46:41.958 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_bytes": 0, 2024-04-26T18:46:41.958 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_items": 0, 2024-04-26T18:46:41.958 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mapbl_bytes": 0, 2024-04-26T18:46:41.958 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mapbl_items": 0, 2024-04-26T18:46:41.958 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pglog_bytes": 0, 2024-04-26T18:46:41.958 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pglog_items": 0, 2024-04-26T18:46:41.958 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_bytes": 7936, 2024-04-26T18:46:41.958 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_items": 165, 2024-04-26T18:46:41.958 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T18:46:41.959 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_mapping_items": 0, 2024-04-26T18:46:41.959 INFO:teuthology.orchestra.run.smithi080.stdout: "pgmap_bytes": 0, 2024-04-26T18:46:41.959 INFO:teuthology.orchestra.run.smithi080.stdout: "pgmap_items": 0, 2024-04-26T18:46:41.959 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_co_bytes": 8512, 2024-04-26T18:46:41.959 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_co_items": 13, 2024-04-26T18:46:41.959 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_1_bytes": 0, 2024-04-26T18:46:41.959 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_1_items": 0, 2024-04-26T18:46:41.959 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_2_bytes": 0, 2024-04-26T18:46:41.959 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_2_items": 0 2024-04-26T18:46:41.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.959 INFO:teuthology.orchestra.run.smithi080.stdout: "objecter": { 2024-04-26T18:46:41.959 INFO:teuthology.orchestra.run.smithi080.stdout: "op_active": 0, 2024-04-26T18:46:41.959 INFO:teuthology.orchestra.run.smithi080.stdout: "op_laggy": 0, 2024-04-26T18:46:41.959 INFO:teuthology.orchestra.run.smithi080.stdout: "op_send": 2220, 2024-04-26T18:46:41.959 INFO:teuthology.orchestra.run.smithi080.stdout: "op_send_bytes": 21, 2024-04-26T18:46:41.960 INFO:teuthology.orchestra.run.smithi080.stdout: "op_resend": 3, 2024-04-26T18:46:41.960 INFO:teuthology.orchestra.run.smithi080.stdout: "op_reply": 2220, 2024-04-26T18:46:41.960 INFO:teuthology.orchestra.run.smithi080.stdout: "op_latency": { 2024-04-26T18:46:41.960 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 2220, 2024-04-26T18:46:41.960 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 1.893957083, 2024-04-26T18:46:41.960 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000853133 2024-04-26T18:46:41.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.960 INFO:teuthology.orchestra.run.smithi080.stdout: "op_inflight": 0, 2024-04-26T18:46:41.960 INFO:teuthology.orchestra.run.smithi080.stdout: "oplen_avg": { 2024-04-26T18:46:41.960 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 2220, 2024-04-26T18:46:41.960 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 2221 2024-04-26T18:46:41.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.960 INFO:teuthology.orchestra.run.smithi080.stdout: "op": 2220, 2024-04-26T18:46:41.960 INFO:teuthology.orchestra.run.smithi080.stdout: "op_r": 2220, 2024-04-26T18:46:41.960 INFO:teuthology.orchestra.run.smithi080.stdout: "op_w": 0, 2024-04-26T18:46:41.960 INFO:teuthology.orchestra.run.smithi080.stdout: "op_rmw": 0, 2024-04-26T18:46:41.961 INFO:teuthology.orchestra.run.smithi080.stdout: "op_pg": 0, 2024-04-26T18:46:41.961 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_stat": 1413, 2024-04-26T18:46:41.961 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_create": 0, 2024-04-26T18:46:41.961 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_read": 805, 2024-04-26T18:46:41.961 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_write": 0, 2024-04-26T18:46:41.961 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_writefull": 0, 2024-04-26T18:46:41.961 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_writesame": 0, 2024-04-26T18:46:41.961 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_append": 0, 2024-04-26T18:46:41.961 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_zero": 0, 2024-04-26T18:46:41.961 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_truncate": 0, 2024-04-26T18:46:41.961 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_delete": 0, 2024-04-26T18:46:41.961 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_mapext": 0, 2024-04-26T18:46:41.961 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_sparse_read": 0, 2024-04-26T18:46:41.961 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_clonerange": 0, 2024-04-26T18:46:41.961 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_getxattr": 1, 2024-04-26T18:46:41.962 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_setxattr": 0, 2024-04-26T18:46:41.962 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_cmpxattr": 0, 2024-04-26T18:46:41.962 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_rmxattr": 0, 2024-04-26T18:46:41.962 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_resetxattrs": 0, 2024-04-26T18:46:41.962 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_call": 0, 2024-04-26T18:46:41.962 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_watch": 0, 2024-04-26T18:46:41.962 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_notify": 0, 2024-04-26T18:46:41.962 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T18:46:41.962 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_pgls": 0, 2024-04-26T18:46:41.962 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_pgls_filter": 0, 2024-04-26T18:46:41.962 INFO:teuthology.orchestra.run.smithi080.stdout: "osdop_other": 0, 2024-04-26T18:46:41.962 INFO:teuthology.orchestra.run.smithi080.stdout: "linger_active": 0, 2024-04-26T18:46:41.962 INFO:teuthology.orchestra.run.smithi080.stdout: "linger_send": 0, 2024-04-26T18:46:41.962 INFO:teuthology.orchestra.run.smithi080.stdout: "linger_resend": 0, 2024-04-26T18:46:41.962 INFO:teuthology.orchestra.run.smithi080.stdout: "linger_ping": 0, 2024-04-26T18:46:41.963 INFO:teuthology.orchestra.run.smithi080.stdout: "poolop_active": 0, 2024-04-26T18:46:41.963 INFO:teuthology.orchestra.run.smithi080.stdout: "poolop_send": 0, 2024-04-26T18:46:41.963 INFO:teuthology.orchestra.run.smithi080.stdout: "poolop_resend": 0, 2024-04-26T18:46:41.963 INFO:teuthology.orchestra.run.smithi080.stdout: "poolstat_active": 0, 2024-04-26T18:46:41.963 INFO:teuthology.orchestra.run.smithi080.stdout: "poolstat_send": 0, 2024-04-26T18:46:41.963 INFO:teuthology.orchestra.run.smithi080.stdout: "poolstat_resend": 0, 2024-04-26T18:46:41.963 INFO:teuthology.orchestra.run.smithi080.stdout: "statfs_active": 0, 2024-04-26T18:46:41.963 INFO:teuthology.orchestra.run.smithi080.stdout: "statfs_send": 0, 2024-04-26T18:46:41.963 INFO:teuthology.orchestra.run.smithi080.stdout: "statfs_resend": 0, 2024-04-26T18:46:41.963 INFO:teuthology.orchestra.run.smithi080.stdout: "command_active": 0, 2024-04-26T18:46:41.963 INFO:teuthology.orchestra.run.smithi080.stdout: "command_send": 0, 2024-04-26T18:46:41.963 INFO:teuthology.orchestra.run.smithi080.stdout: "command_resend": 0, 2024-04-26T18:46:41.963 INFO:teuthology.orchestra.run.smithi080.stdout: "map_epoch": 101, 2024-04-26T18:46:41.963 INFO:teuthology.orchestra.run.smithi080.stdout: "map_full": 0, 2024-04-26T18:46:41.963 INFO:teuthology.orchestra.run.smithi080.stdout: "map_inc": 12, 2024-04-26T18:46:41.964 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_sessions": 6, 2024-04-26T18:46:41.964 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_session_open": 6, 2024-04-26T18:46:41.964 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_session_close": 0, 2024-04-26T18:46:41.964 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_laggy": 0, 2024-04-26T18:46:41.964 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_wr": 0, 2024-04-26T18:46:41.964 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_rd": 2, 2024-04-26T18:46:41.964 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_del": 0 2024-04-26T18:46:41.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.964 INFO:teuthology.orchestra.run.smithi080.stdout: "oft": { 2024-04-26T18:46:41.964 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_total_objs": 0, 2024-04-26T18:46:41.964 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_total_kv_pairs": 0, 2024-04-26T18:46:41.964 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_total_updates": 0, 2024-04-26T18:46:41.964 INFO:teuthology.orchestra.run.smithi080.stdout: "omap_total_removes": 0 2024-04-26T18:46:41.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.964 INFO:teuthology.orchestra.run.smithi080.stdout: "osd-slow-ops": { 2024-04-26T18:46:41.964 INFO:teuthology.orchestra.run.smithi080.stdout: "slow_ops_count": 0 2024-04-26T18:46:41.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.965 INFO:teuthology.orchestra.run.smithi080.stdout: "purge_queue": { 2024-04-26T18:46:41.965 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executing_ops": 0, 2024-04-26T18:46:41.965 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executing_ops_high_water": 0, 2024-04-26T18:46:41.965 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executing": 0, 2024-04-26T18:46:41.965 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executing_high_water": 0, 2024-04-26T18:46:41.965 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executed_ops": 0, 2024-04-26T18:46:41.965 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_executed": 0, 2024-04-26T18:46:41.965 INFO:teuthology.orchestra.run.smithi080.stdout: "pq_item_in_journal": 0 2024-04-26T18:46:41.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.965 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T18:46:41.965 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T18:46:41.965 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 104857600, 2024-04-26T18:46:41.965 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T18:46:41.965 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 2479, 2024-04-26T18:46:41.965 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 2040284, 2024-04-26T18:46:41.966 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:41.966 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 2479, 2024-04-26T18:46:41.966 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 0, 2024-04-26T18:46:41.966 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 0, 2024-04-26T18:46:41.966 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 2479, 2024-04-26T18:46:41.966 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 2040284, 2024-04-26T18:46:41.966 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T18:46:41.966 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.966 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.966 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.966 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:41.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.966 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-objecter_bytes": { 2024-04-26T18:46:41.966 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T18:46:41.966 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 104857600, 2024-04-26T18:46:41.967 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T18:46:41.967 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 0, 2024-04-26T18:46:41.967 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 0, 2024-04-26T18:46:41.967 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:41.967 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 0, 2024-04-26T18:46:41.967 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 2220, 2024-04-26T18:46:41.967 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 1824, 2024-04-26T18:46:41.967 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 2220, 2024-04-26T18:46:41.967 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 1824, 2024-04-26T18:46:41.967 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T18:46:41.967 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.967 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.967 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.967 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:41.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.968 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-objecter_ops": { 2024-04-26T18:46:41.968 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T18:46:41.968 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 1024, 2024-04-26T18:46:41.968 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T18:46:41.968 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 0, 2024-04-26T18:46:41.968 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 0, 2024-04-26T18:46:41.968 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:41.968 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 0, 2024-04-26T18:46:41.968 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 2220, 2024-04-26T18:46:41.968 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 2220, 2024-04-26T18:46:41.968 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 2220, 2024-04-26T18:46:41.968 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 2220, 2024-04-26T18:46:41.968 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T18:46:41.968 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.968 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.968 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.969 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:41.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.969 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-write_buf_throttle": { 2024-04-26T18:46:41.969 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T18:46:41.969 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 3758096384, 2024-04-26T18:46:41.969 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T18:46:41.969 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 0, 2024-04-26T18:46:41.969 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 0, 2024-04-26T18:46:41.969 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:41.969 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 0, 2024-04-26T18:46:41.969 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 0, 2024-04-26T18:46:41.969 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 0, 2024-04-26T18:46:41.969 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 0, 2024-04-26T18:46:41.969 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 0, 2024-04-26T18:46:41.969 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T18:46:41.969 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.970 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.970 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.970 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:41.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:41.970 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-write_buf_throttle-0x55dcf516a6e0": { 2024-04-26T18:46:41.970 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T18:46:41.970 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 3758096384, 2024-04-26T18:46:41.970 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T18:46:41.970 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 0, 2024-04-26T18:46:41.970 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 0, 2024-04-26T18:46:41.970 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:41.970 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 0, 2024-04-26T18:46:41.970 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 0, 2024-04-26T18:46:41.970 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 0, 2024-04-26T18:46:41.970 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 0, 2024-04-26T18:46:41.971 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 0, 2024-04-26T18:46:41.971 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T18:46:41.971 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:41.971 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:41.971 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:41.971 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:41.971 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:41.971 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:46:42.723 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-04-26T18:46:42.723 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-04-26T18:46:42.723 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-04-26T18:46:42.724 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-04-26T18:46:42.724 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-04-26T18:46:42.724 DEBUG:tasks.check_counter:Getting stats from j 2024-04-26T18:46:42.724 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph daemon mds.j perf dump 2024-04-26T18:46:43.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:43 smithi192 ceph-mon[32842]: pgmap v319: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-26T18:46:43.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:43 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:43.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:43 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:43.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:43 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:43.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:43 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:43.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:43 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:43.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:43 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:43.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:43 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:43.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:43 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:43.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:43 smithi192 ceph-mon[32842]: Adjusting osd_memory_target on smithi192 to 176.2M 2024-04-26T18:46:43.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:43 smithi192 ceph-mon[32842]: Unable to set osd_memory_target on smithi192 to 184769536: error parsing value: Value '184769536' is below minimum 939524096 2024-04-26T18:46:43.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:43 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:43.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:43 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:43.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:43 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:43.364 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:43 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:43.364 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:43 smithi192 ceph-mon[32842]: Adjusting osd_memory_target on smithi082 to 176.2M 2024-04-26T18:46:43.364 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:43 smithi192 ceph-mon[32842]: Unable to set osd_memory_target on smithi082 to 184763084: error parsing value: Value '184763084' is below minimum 939524096 2024-04-26T18:46:43.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:43 smithi082 ceph-mon[32808]: pgmap v319: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-26T18:46:43.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:43 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:43.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:43 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:43.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:43 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:43.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:43 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:43.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:43 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:43.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:43 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:43.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:43 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:43.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:43 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:43.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:43 smithi082 ceph-mon[32808]: Adjusting osd_memory_target on smithi192 to 176.2M 2024-04-26T18:46:43.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:43 smithi082 ceph-mon[32808]: Unable to set osd_memory_target on smithi192 to 184769536: error parsing value: Value '184769536' is below minimum 939524096 2024-04-26T18:46:43.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:43 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:43.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:43 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:43.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:43 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:43.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:43 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:43.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:43 smithi082 ceph-mon[32808]: Adjusting osd_memory_target on smithi082 to 176.2M 2024-04-26T18:46:43.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:43 smithi082 ceph-mon[32808]: Unable to set osd_memory_target on smithi082 to 184763084: error parsing value: Value '184763084' is below minimum 939524096 2024-04-26T18:46:43.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:43 smithi080 ceph-mon[29135]: pgmap v319: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-26T18:46:43.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:43 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:43.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:43 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:43.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:43 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:43.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:43 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:43.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:43 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:43.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:43 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:43.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:43 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:43.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:43 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:43.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:43 smithi080 ceph-mon[29135]: Adjusting osd_memory_target on smithi192 to 176.2M 2024-04-26T18:46:43.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:43 smithi080 ceph-mon[29135]: Unable to set osd_memory_target on smithi192 to 184769536: error parsing value: Value '184769536' is below minimum 939524096 2024-04-26T18:46:43.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:43 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:43.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:43 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:43.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:43 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:43.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:43 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:43.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:43 smithi080 ceph-mon[29135]: Adjusting osd_memory_target on smithi082 to 176.2M 2024-04-26T18:46:43.494 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:43 smithi080 ceph-mon[29135]: Unable to set osd_memory_target on smithi082 to 184763084: error parsing value: Value '184763084' is below minimum 939524096 2024-04-26T18:46:43.613 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:46:45.332 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:45 smithi080 ceph-mon[29135]: pgmap v320: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T18:46:45.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:45 smithi192 ceph-mon[32842]: pgmap v320: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T18:46:45.383 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-26T18:46:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T18:46:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 0, 2024-04-26T18:46:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 2, 2024-04-26T18:46:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 0, 2024-04-26T18:46:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 0, 2024-04-26T18:46:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 4, 2024-04-26T18:46:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 0, 2024-04-26T18:46:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.001084482, 2024-04-26T18:46:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.000000000, 2024-04-26T18:46:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.000248698, 2024-04-26T18:46:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-26T18:46:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-26T18:46:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 0 2024-04-26T18:46:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T18:46:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 242, 2024-04-26T18:46:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 231, 2024-04-26T18:46:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 1595376, 2024-04-26T18:46:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 142144, 2024-04-26T18:46:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 2, 2024-04-26T18:46:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 1, 2024-04-26T18:46:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.047199589, 2024-04-26T18:46:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.014603589, 2024-04-26T18:46:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.036756937, 2024-04-26T18:46:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.004659757, 2024-04-26T18:46:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 230, 2024-04-26T18:46:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.010845779, 2024-04-26T18:46:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000047155 2024-04-26T18:46:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 1595376, 2024-04-26T18:46:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 142144 2024-04-26T18:46:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T18:46:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_messages": 6, 2024-04-26T18:46:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages": 179, 2024-04-26T18:46:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_bytes": 3312, 2024-04-26T18:46:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_bytes": 188704, 2024-04-26T18:46:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_created_connections": 5, 2024-04-26T18:46:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_active_connections": 3, 2024-04-26T18:46:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_total_time": 0.014578556, 2024-04-26T18:46:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_send_time": 0.010001297, 2024-04-26T18:46:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_recv_time": 0.002136954, 2024-04-26T18:46:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-26T18:46:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 177, 2024-04-26T18:46:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.015445660, 2024-04-26T18:46:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000087263 2024-04-26T18:46:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-04-26T18:46:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "msgr_send_encrypted_bytes": 188704 2024-04-26T18:46:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "cct": { 2024-04-26T18:46:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "total_workers": 0, 2024-04-26T18:46:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "unhealthy_workers": 0 2024-04-26T18:46:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "mempool": { 2024-04-26T18:46:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "bloom_filter_bytes": 0, 2024-04-26T18:46:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "bloom_filter_items": 0, 2024-04-26T18:46:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T18:46:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_items": 0, 2024-04-26T18:46:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T18:46:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_data_items": 0, 2024-04-26T18:46:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T18:46:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T18:46:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T18:46:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T18:46:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T18:46:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_other_items": 0, 2024-04-26T18:46:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T18:46:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T18:46:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_bytes": 0, 2024-04-26T18:46:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_items": 0, 2024-04-26T18:46:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blob_bytes": 0, 2024-04-26T18:46:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blob_items": 0, 2024-04-26T18:46:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T18:46:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T18:46:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T18:46:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T18:46:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T18:46:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_items": 0, 2024-04-26T18:46:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_txc_bytes": 0, 2024-04-26T18:46:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_txc_items": 0, 2024-04-26T18:46:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T18:46:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T18:46:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_bytes": 0, 2024-04-26T18:46:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_writing_items": 0, 2024-04-26T18:46:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_bytes": 0, 2024-04-26T18:46:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_items": 0, 2024-04-26T18:46:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T18:46:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_reader_items": 0, 2024-04-26T18:46:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T18:46:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_file_writer_items": 0, 2024-04-26T18:46:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_anon_bytes": 148754, 2024-04-26T18:46:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_anon_items": 31, 2024-04-26T18:46:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_meta_bytes": 0, 2024-04-26T18:46:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "buffer_meta_items": 0, 2024-04-26T18:46:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_bytes": 0, 2024-04-26T18:46:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_items": 0, 2024-04-26T18:46:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mapbl_bytes": 0, 2024-04-26T18:46:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mapbl_items": 0, 2024-04-26T18:46:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pglog_bytes": 0, 2024-04-26T18:46:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pglog_items": 0, 2024-04-26T18:46:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_bytes": 0, 2024-04-26T18:46:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_items": 0, 2024-04-26T18:46:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T18:46:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_mapping_items": 0, 2024-04-26T18:46:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "pgmap_bytes": 0, 2024-04-26T18:46:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "pgmap_items": 0, 2024-04-26T18:46:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_co_bytes": 928, 2024-04-26T18:46:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_co_items": 2, 2024-04-26T18:46:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_1_bytes": 0, 2024-04-26T18:46:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_1_items": 0, 2024-04-26T18:46:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_2_bytes": 0, 2024-04-26T18:46:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "unittest_2_items": 0 2024-04-26T18:46:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-26T18:46:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T18:46:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "val": 0, 2024-04-26T18:46:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "max": 104857600, 2024-04-26T18:46:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "get_started": 0, 2024-04-26T18:46:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "get": 244, 2024-04-26T18:46:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "get_sum": 1561224, 2024-04-26T18:46:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "get_or_fail_success": 244, 2024-04-26T18:46:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "take": 0, 2024-04-26T18:46:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "take_sum": 0, 2024-04-26T18:46:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "put": 244, 2024-04-26T18:46:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "put_sum": 1561224, 2024-04-26T18:46:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "wait": { 2024-04-26T18:46:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "avgcount": 0, 2024-04-26T18:46:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "sum": 0.000000000, 2024-04-26T18:46:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: "avgtime": 0.000000000 2024-04-26T18:46:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-26T18:46:45.394 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-26T18:46:45.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:45 smithi082 ceph-mon[32808]: pgmap v320: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T18:46:46.089 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-04-26T18:46:46.089 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-04-26T18:46:46.089 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-04-26T18:46:46.089 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-04-26T18:46:46.090 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-04-26T18:46:46.090 DEBUG:tasks.check_counter:Getting stats from b 2024-04-26T18:46:46.090 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph daemon mds.b perf dump 2024-04-26T18:46:46.341 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T18:46:46.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:46 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:46.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:46 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:46.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:46 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:46.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:46 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:46.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:46 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:46.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:46 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:46.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:46 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:46:46.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:46 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:46:46.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:46 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:46.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:46 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:46.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:46 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:46.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:46 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:46.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:46 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:46.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:46 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:46.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:46 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:46.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:46 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:46:46.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:46 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:46:46.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:46 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:46.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:46 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:46.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:46 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:46.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:46 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:46.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:46 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:46.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:46 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:46.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:46 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:46:46.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:46 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:46:46.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:46 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:46:46.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:46 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' 2024-04-26T18:46:47.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:47 smithi082 ceph-mon[32808]: pgmap v321: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:46:47.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:47 smithi082 ceph-mon[32808]: Adjusting osd_memory_target on smithi080 to 176.2M 2024-04-26T18:46:47.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:47 smithi082 ceph-mon[32808]: Unable to set osd_memory_target on smithi080 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T18:46:47.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:47 smithi080 ceph-mon[29135]: pgmap v321: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:46:47.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:47 smithi080 ceph-mon[29135]: Adjusting osd_memory_target on smithi080 to 176.2M 2024-04-26T18:46:47.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:47 smithi080 ceph-mon[29135]: Unable to set osd_memory_target on smithi080 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T18:46:47.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:47 smithi192 ceph-mon[32842]: pgmap v321: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:46:47.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:47 smithi192 ceph-mon[32842]: Adjusting osd_memory_target on smithi080 to 176.2M 2024-04-26T18:46:47.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:47 smithi192 ceph-mon[32842]: Unable to set osd_memory_target on smithi080 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T18:46:48.177 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T18:46:48.177 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T18:46:48.177 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 3977, 2024-04-26T18:46:48.177 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 3705, 2024-04-26T18:46:48.177 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 1253777, 2024-04-26T18:46:48.177 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 10139181, 2024-04-26T18:46:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 24, 2024-04-26T18:46:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 4, 2024-04-26T18:46:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.312463496, 2024-04-26T18:46:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.106657225, 2024-04-26T18:46:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.087756134, 2024-04-26T18:46:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.095943520, 2024-04-26T18:46:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 3707, 2024-04-26T18:46:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.322824208, 2024-04-26T18:46:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000087085 2024-04-26T18:46:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1628, 2024-04-26T18:46:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000344307, 2024-04-26T18:46:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000211 2024-04-26T18:46:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-04-26T18:46:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 312928 2024-04-26T18:46:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T18:46:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 8976, 2024-04-26T18:46:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 12974, 2024-04-26T18:46:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 3195826, 2024-04-26T18:46:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 10045606, 2024-04-26T18:46:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 12, 2024-04-26T18:46:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 6, 2024-04-26T18:46:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.690115134, 2024-04-26T18:46:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.263885011, 2024-04-26T18:46:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.362286676, 2024-04-26T18:46:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.124016677, 2024-04-26T18:46:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 12972, 2024-04-26T18:46:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.973248327, 2024-04-26T18:46:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000075026 2024-04-26T18:46:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 14241, 2024-04-26T18:46:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.002075984, 2024-04-26T18:46:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000145 2024-04-26T18:46:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 2157712, 2024-04-26T18:46:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 4612352 2024-04-26T18:46:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T18:46:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 3090, 2024-04-26T18:46:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 2065, 2024-04-26T18:46:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 2555144, 2024-04-26T18:46:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 2699044, 2024-04-26T18:46:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 42, 2024-04-26T18:46:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 9, 2024-04-26T18:46:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.331360825, 2024-04-26T18:46:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.099760974, 2024-04-26T18:46:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.132455331, 2024-04-26T18:46:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.097433705, 2024-04-26T18:46:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2060, 2024-04-26T18:46:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.281055652, 2024-04-26T18:46:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000136434 2024-04-26T18:46:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2063, 2024-04-26T18:46:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000411436, 2024-04-26T18:46:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000199 2024-04-26T18:46:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 2121696, 2024-04-26T18:46:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 268912 2024-04-26T18:46:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-04-26T18:46:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 1, 2024-04-26T18:46:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-04-26T18:46:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-MDSRank": { 2024-04-26T18:46:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-04-26T18:46:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-04-26T18:46:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 4603, 2024-04-26T18:46:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 2.398934959, 2024-04-26T18:46:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000521167 2024-04-26T18:46:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-PurgeQueue": { 2024-04-26T18:46:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-04-26T18:46:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-04-26T18:46:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 5550, 2024-04-26T18:46:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.208085003, 2024-04-26T18:46:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000037492 2024-04-26T18:46:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-26T18:46:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "request": 2583, 2024-04-26T18:46:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "reply": 2583, 2024-04-26T18:46:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "reply_latency": { 2024-04-26T18:46:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2583, 2024-04-26T18:46:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 38.539133775, 2024-04-26T18:46:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.014920299 2024-04-26T18:46:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_reply": 0, 2024-04-26T18:46:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "forward": 0, 2024-04-26T18:46:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_complete": 0, 2024-04-26T18:46:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_keys": 0, 2024-04-26T18:46:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_commit": 71, 2024-04-26T18:46:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_split": 0, 2024-04-26T18:46:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_merge": 0, 2024-04-26T18:46:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes": 57, 2024-04-26T18:46:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_top": 9, 2024-04-26T18:46:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_bottom": 48, 2024-04-26T18:46:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pin_tail": 0, 2024-04-26T18:46:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pinned": 41, 2024-04-26T18:46:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_expired": 0, 2024-04-26T18:46:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_with_caps": 2, 2024-04-26T18:46:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": 2, 2024-04-26T18:46:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "subtrees": 2, 2024-04-26T18:46:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse": 2634, 2024-04-26T18:46:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_hit": 2614, 2024-04-26T18:46:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_forward": 0, 2024-04-26T18:46:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_discover": 0, 2024-04-26T18:46:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_dir_fetch": 0, 2024-04-26T18:46:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_remote_ino": 0, 2024-04-26T18:46:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_lock": 0, 2024-04-26T18:46:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "load_cent": 0, 2024-04-26T18:46:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "q": 0, 2024-04-26T18:46:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "exported": 0, 2024-04-26T18:46:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "exported_inodes": 0, 2024-04-26T18:46:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "imported": 0, 2024-04-26T18:46:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "imported_inodes": 0, 2024-04-26T18:46:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_dir_fetch": 0, 2024-04-26T18:46:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_backtrace_fetch": 0, 2024-04-26T18:46:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_peer_discover": 0, 2024-04-26T18:46:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rfiles": 4, 2024-04-26T18:46:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rbytes": 234, 2024-04-26T18:46:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rsnaps": 6, 2024-04-26T18:46:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T18:46:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_set_tag": 0, 2024-04-26T18:46:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T18:46:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_inotable_repaired": 0, 2024-04-26T18:46:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_inodes": 0, 2024-04-26T18:46:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T18:46:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T18:46:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_file_inodes": 0, 2024-04-26T18:46:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_inode_file_caps": 3, 2024-04-26T18:46:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_revoke": 30, 2024-04-26T18:46:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_grant": 3640, 2024-04-26T18:46:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T18:46:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T18:46:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T18:46:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps": 2449, 2024-04-26T18:46:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps_dirty": 1214, 2024-04-26T18:46:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_cap_release": 13, 2024-04-26T18:46:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "process_request_cap_release": 1241 2024-04-26T18:46:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_cache": { 2024-04-26T18:46:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update": 0, 2024-04-26T18:46:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update_receipt": 0, 2024-04-26T18:46:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_try_discover": 0, 2024-04-26T18:46:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_send_discover": 0, 2024-04-26T18:46:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_handle_discover": 7, 2024-04-26T18:46:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays": 2, 2024-04-26T18:46:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_delayed": 0, 2024-04-26T18:46:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_enqueuing": 0, 2024-04-26T18:46:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_created": 1212, 2024-04-26T18:46:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_enqueued": 1210, 2024-04-26T18:46:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_reintegrated": 0, 2024-04-26T18:46:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_migrated": 0, 2024-04-26T18:46:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_processing": 0, 2024-04-26T18:46:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_enqueued": 0, 2024-04-26T18:46:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_prioritized": 0, 2024-04-26T18:46:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_started": 0, 2024-04-26T18:46:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_completed": 0, 2024-04-26T18:46:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_path": 2, 2024-04-26T18:46:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_inode": 24, 2024-04-26T18:46:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T18:46:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_exportdir": 0, 2024-04-26T18:46:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_flush": 0, 2024-04-26T18:46:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragmentdir": 0, 2024-04-26T18:46:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragstats": 0, 2024-04-26T18:46:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_inodestats": 0 2024-04-26T18:46:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_log": { 2024-04-26T18:46:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "evlrg": 0, 2024-04-26T18:46:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "evadd": 6194, 2024-04-26T18:46:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "evex": 6114, 2024-04-26T18:46:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "evtrm": 6114, 2024-04-26T18:46:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "ev": 80, 2024-04-26T18:46:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "evexg": 0, 2024-04-26T18:46:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "evexd": 4259, 2024-04-26T18:46:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "segadd": 21, 2024-04-26T18:46:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "segex": 20, 2024-04-26T18:46:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "segtrm": 20, 2024-04-26T18:46:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "seg": 1, 2024-04-26T18:46:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "segmjr": 1, 2024-04-26T18:46:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "segexg": 0, 2024-04-26T18:46:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "segexd": 5, 2024-04-26T18:46:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "expos": 18129239, 2024-04-26T18:46:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "wrpos": 18209877, 2024-04-26T18:46:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "rdpos": 0, 2024-04-26T18:46:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "jlat": { 2024-04-26T18:46:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2507, 2024-04-26T18:46:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 3.983511133, 2024-04-26T18:46:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.001588955 2024-04-26T18:46:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "replayed": 0 2024-04-26T18:46:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_mem": { 2024-04-26T18:46:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 26, 2024-04-26T18:46:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "ino+": 1236, 2024-04-26T18:46:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "ino-": 1210, 2024-04-26T18:46:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "dir": 20, 2024-04-26T18:46:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "dir+": 24, 2024-04-26T18:46:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "dir-": 4, 2024-04-26T18:46:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "dn": 57, 2024-04-26T18:46:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "dn+": 1248, 2024-04-26T18:46:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "dn-": 1191, 2024-04-26T18:46:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "cap": 2, 2024-04-26T18:46:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "cap+": 1231, 2024-04-26T18:46:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "cap-": 1229, 2024-04-26T18:46:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "rss": 64644, 2024-04-26T18:46:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "heap": 231800 2024-04-26T18:46:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_server": { 2024-04-26T18:46:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_client_request": 2644, 2024-04-26T18:46:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_server_request": 18, 2024-04-26T18:46:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_request": 2583, 2024-04-26T18:46:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_session": 36, 2024-04-26T18:46:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_peer_request": 36, 2024-04-26T18:46:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "req_create_latency": { 2024-04-26T18:46:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1210, 2024-04-26T18:46:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 1.293992006, 2024-04-26T18:46:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.001069414 2024-04-26T18:46:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getattr_latency": { 2024-04-26T18:46:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 98, 2024-04-26T18:46:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.019775616, 2024-04-26T18:46:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000201792 2024-04-26T18:46:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getfilelock_latency": { 2024-04-26T18:46:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "req_link_latency": { 2024-04-26T18:46:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookup_latency": { 2024-04-26T18:46:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 9, 2024-04-26T18:46:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.002782307, 2024-04-26T18:46:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000309145 2024-04-26T18:46:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookuphash_latency": { 2024-04-26T18:46:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupino_latency": { 2024-04-26T18:46:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupname_latency": { 2024-04-26T18:46:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupparent_latency": { 2024-04-26T18:46:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupsnap_latency": { 2024-04-26T18:46:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lssnap_latency": { 2024-04-26T18:46:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 10, 2024-04-26T18:46:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.001566057, 2024-04-26T18:46:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000156605 2024-04-26T18:46:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mkdir_latency": { 2024-04-26T18:46:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 12, 2024-04-26T18:46:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 35.626028008, 2024-04-26T18:46:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 2.968835667 2024-04-26T18:46:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mknod_latency": { 2024-04-26T18:46:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mksnap_latency": { 2024-04-26T18:46:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 10, 2024-04-26T18:46:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.053444687, 2024-04-26T18:46:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.005344468 2024-04-26T18:46:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "req_open_latency": { 2024-04-26T18:46:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1, 2024-04-26T18:46:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000196417, 2024-04-26T18:46:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000196417 2024-04-26T18:46:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "req_readdir_latency": { 2024-04-26T18:46:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 6, 2024-04-26T18:46:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.005207429, 2024-04-26T18:46:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000867904 2024-04-26T18:46:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rename_latency": { 2024-04-26T18:46:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2, 2024-04-26T18:46:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.002258438, 2024-04-26T18:46:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.001129219 2024-04-26T18:46:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "req_renamesnap_latency": { 2024-04-26T18:46:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "req_snapdiff_latency": { 2024-04-26T18:46:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmdir_latency": { 2024-04-26T18:46:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 6, 2024-04-26T18:46:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.021761644, 2024-04-26T18:46:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.003626940 2024-04-26T18:46:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmsnap_latency": { 2024-04-26T18:46:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 4, 2024-04-26T18:46:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.020059406, 2024-04-26T18:46:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.005014851 2024-04-26T18:46:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmxattr_latency": { 2024-04-26T18:46:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setattr_latency": { 2024-04-26T18:46:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1, 2024-04-26T18:46:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.001030638, 2024-04-26T18:46:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.001030638 2024-04-26T18:46:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setdirlayout_latency": { 2024-04-26T18:46:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setfilelock_latency": { 2024-04-26T18:46:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setlayout_latency": { 2024-04-26T18:46:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setxattr_latency": { 2024-04-26T18:46:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 8, 2024-04-26T18:46:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.021374489, 2024-04-26T18:46:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.002671811 2024-04-26T18:46:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: "req_symlink_latency": { 2024-04-26T18:46:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "req_unlink_latency": { 2024-04-26T18:46:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1206, 2024-04-26T18:46:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 1.469656633, 2024-04-26T18:46:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.001218620 2024-04-26T18:46:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_revoke_eviction": 0, 2024-04-26T18:46:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_acquisition_throttle": 0, 2024-04-26T18:46:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getvxattr_latency": { 2024-04-26T18:46:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_sessions": { 2024-04-26T18:46:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "session_count": 2, 2024-04-26T18:46:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "session_add": 6, 2024-04-26T18:46:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "session_remove": 4, 2024-04-26T18:46:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_open": 2, 2024-04-26T18:46:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_stale": 0, 2024-04-26T18:46:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "total_load": 48, 2024-04-26T18:46:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "average_load": 24, 2024-04-26T18:46:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "avg_session_uptime": 603, 2024-04-26T18:46:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "mdthresh_evicted": 0 2024-04-26T18:46:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-04-26T18:46:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-04-26T18:46:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-04-26T18:46:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T18:46:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-04-26T18:46:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T18:46:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-04-26T18:46:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T18:46:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T18:46:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T18:46:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T18:46:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T18:46:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-04-26T18:46:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T18:46:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T18:46:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-04-26T18:46:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-04-26T18:46:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-04-26T18:46:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-04-26T18:46:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T18:46:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T18:46:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T18:46:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T18:46:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T18:46:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-04-26T18:46:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-04-26T18:46:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-04-26T18:46:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T18:46:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T18:46:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-04-26T18:46:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-04-26T18:46:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-04-26T18:46:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-04-26T18:46:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T18:46:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-04-26T18:46:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T18:46:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-04-26T18:46:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 344230, 2024-04-26T18:46:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 124, 2024-04-26T18:46:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 88, 2024-04-26T18:46:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 1, 2024-04-26T18:46:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-04-26T18:46:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-04-26T18:46:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-04-26T18:46:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-04-26T18:46:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-04-26T18:46:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-04-26T18:46:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 7936, 2024-04-26T18:46:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 165, 2024-04-26T18:46:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T18:46:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-04-26T18:46:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-04-26T18:46:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-04-26T18:46:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 142129, 2024-04-26T18:46:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 1262, 2024-04-26T18:46:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-04-26T18:46:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-04-26T18:46:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-04-26T18:46:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-04-26T18:46:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "objecter": { 2024-04-26T18:46:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "op_active": 0, 2024-04-26T18:46:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "op_laggy": 0, 2024-04-26T18:46:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send": 7043, 2024-04-26T18:46:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send_bytes": 14540989, 2024-04-26T18:46:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "op_resend": 37, 2024-04-26T18:46:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "op_reply": 7043, 2024-04-26T18:46:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "op_latency": { 2024-04-26T18:46:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 7043, 2024-04-26T18:46:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 32.260374138, 2024-04-26T18:46:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.004580487 2024-04-26T18:46:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "op_inflight": 0, 2024-04-26T18:46:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "oplen_avg": { 2024-04-26T18:46:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 7043, 2024-04-26T18:46:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 7733 2024-04-26T18:46:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "op": 7043, 2024-04-26T18:46:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "op_r": 25, 2024-04-26T18:46:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "op_w": 7018, 2024-04-26T18:46:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "op_rmw": 0, 2024-04-26T18:46:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "op_pg": 0, 2024-04-26T18:46:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_stat": 50, 2024-04-26T18:46:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_create": 259, 2024-04-26T18:46:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_read": 25, 2024-04-26T18:46:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_write": 2532, 2024-04-26T18:46:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writefull": 74, 2024-04-26T18:46:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writesame": 0, 2024-04-26T18:46:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_append": 0, 2024-04-26T18:46:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_zero": 0, 2024-04-26T18:46:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_truncate": 0, 2024-04-26T18:46:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_delete": 4014, 2024-04-26T18:46:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_mapext": 0, 2024-04-26T18:46:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_sparse_read": 0, 2024-04-26T18:46:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_clonerange": 0, 2024-04-26T18:46:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_getxattr": 0, 2024-04-26T18:46:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_setxattr": 518, 2024-04-26T18:46:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_cmpxattr": 0, 2024-04-26T18:46:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_rmxattr": 0, 2024-04-26T18:46:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_resetxattrs": 0, 2024-04-26T18:46:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_call": 0, 2024-04-26T18:46:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_watch": 0, 2024-04-26T18:46:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_notify": 0, 2024-04-26T18:46:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T18:46:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls": 0, 2024-04-26T18:46:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls_filter": 0, 2024-04-26T18:46:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_other": 0, 2024-04-26T18:46:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_active": 0, 2024-04-26T18:46:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_send": 0, 2024-04-26T18:46:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_resend": 0, 2024-04-26T18:46:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_ping": 0, 2024-04-26T18:46:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_active": 0, 2024-04-26T18:46:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_send": 0, 2024-04-26T18:46:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_resend": 0, 2024-04-26T18:46:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_active": 0, 2024-04-26T18:46:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_send": 0, 2024-04-26T18:46:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_resend": 0, 2024-04-26T18:46:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_active": 0, 2024-04-26T18:46:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_send": 0, 2024-04-26T18:46:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_resend": 0, 2024-04-26T18:46:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "command_active": 0, 2024-04-26T18:46:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "command_send": 0, 2024-04-26T18:46:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "command_resend": 0, 2024-04-26T18:46:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "map_epoch": 101, 2024-04-26T18:46:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "map_full": 0, 2024-04-26T18:46:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "map_inc": 12, 2024-04-26T18:46:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_sessions": 12, 2024-04-26T18:46:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_open": 12, 2024-04-26T18:46:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_close": 0, 2024-04-26T18:46:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_laggy": 0, 2024-04-26T18:46:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_wr": 230, 2024-04-26T18:46:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_rd": 0, 2024-04-26T18:46:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_del": 31 2024-04-26T18:46:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "oft": { 2024-04-26T18:46:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_objs": 1, 2024-04-26T18:46:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_kv_pairs": 0, 2024-04-26T18:46:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_updates": 0, 2024-04-26T18:46:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_removes": 0 2024-04-26T18:46:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "osd-slow-ops": { 2024-04-26T18:46:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_ops_count": 45 2024-04-26T18:46:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "purge_queue": { 2024-04-26T18:46:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops": 0, 2024-04-26T18:46:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops_high_water": 10, 2024-04-26T18:46:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing": 0, 2024-04-26T18:46:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_high_water": 4, 2024-04-26T18:46:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed_ops": 3496, 2024-04-26T18:46:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed": 1210, 2024-04-26T18:46:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_item_in_journal": 0 2024-04-26T18:46:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T18:46:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T18:46:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-04-26T18:46:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T18:46:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 16039, 2024-04-26T18:46:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 5231725, 2024-04-26T18:46:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 16039, 2024-04-26T18:46:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-26T18:46:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-26T18:46:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 16039, 2024-04-26T18:46:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 5231725, 2024-04-26T18:46:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T18:46:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_bytes": { 2024-04-26T18:46:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T18:46:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-04-26T18:46:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T18:46:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-26T18:46:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-26T18:46:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-26T18:46:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 7043, 2024-04-26T18:46:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 14663207, 2024-04-26T18:46:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 7043, 2024-04-26T18:46:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 14663207, 2024-04-26T18:46:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T18:46:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_ops": { 2024-04-26T18:46:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T18:46:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 1024, 2024-04-26T18:46:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T18:46:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-26T18:46:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-26T18:46:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-26T18:46:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 7043, 2024-04-26T18:46:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 7043, 2024-04-26T18:46:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 7043, 2024-04-26T18:46:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 7043, 2024-04-26T18:46:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T18:46:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle": { 2024-04-26T18:46:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T18:46:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-04-26T18:46:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T18:46:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 1210, 2024-04-26T18:46:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 122218, 2024-04-26T18:46:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 1210, 2024-04-26T18:46:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-26T18:46:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-26T18:46:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 25, 2024-04-26T18:46:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 122218, 2024-04-26T18:46:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T18:46:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle-0x55ccf8cc2500": { 2024-04-26T18:46:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T18:46:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-04-26T18:46:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T18:46:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 6194, 2024-04-26T18:46:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 14015573, 2024-04-26T18:46:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 6194, 2024-04-26T18:46:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-26T18:46:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-26T18:46:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2507, 2024-04-26T18:46:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 14015573, 2024-04-26T18:46:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T18:46:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:48.220 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T18:46:48.986 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-04-26T18:46:48.986 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-04-26T18:46:48.986 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-04-26T18:46:48.986 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=10 2024-04-26T18:46:48.986 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-04-26T18:46:48.986 DEBUG:tasks.check_counter:Getting stats from e 2024-04-26T18:46:48.987 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph daemon mds.e perf dump 2024-04-26T18:46:49.232 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T18:46:49.628 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:49 smithi082 ceph-mon[32808]: pgmap v322: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:46:49.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:49 smithi080 ceph-mon[29135]: pgmap v322: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:46:49.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:49 smithi192 ceph-mon[32842]: pgmap v322: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T18:46:50.978 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T18:46:50.978 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T18:46:50.978 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 3, 2024-04-26T18:46:50.979 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 5, 2024-04-26T18:46:50.979 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 795, 2024-04-26T18:46:50.979 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 960, 2024-04-26T18:46:50.979 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 6, 2024-04-26T18:46:50.979 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 2, 2024-04-26T18:46:50.979 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.002209815, 2024-04-26T18:46:50.979 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.000025348, 2024-04-26T18:46:50.979 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.000882411, 2024-04-26T18:46:50.979 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000076916, 2024-04-26T18:46:50.979 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:50.979 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 3, 2024-04-26T18:46:50.979 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.001400140, 2024-04-26T18:46:50.979 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000466713 2024-04-26T18:46:50.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.979 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:50.979 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-26T18:46:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 0 2024-04-26T18:46:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T18:46:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 932, 2024-04-26T18:46:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 1027, 2024-04-26T18:46:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 4468275, 2024-04-26T18:46:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 551047, 2024-04-26T18:46:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 5, 2024-04-26T18:46:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 4, 2024-04-26T18:46:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.094965071, 2024-04-26T18:46:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.036198158, 2024-04-26T18:46:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.021740159, 2024-04-26T18:46:50.981 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.028437339, 2024-04-26T18:46:50.981 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:50.981 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1025, 2024-04-26T18:46:50.981 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.042297577, 2024-04-26T18:46:50.981 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000041265 2024-04-26T18:46:50.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.981 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:50.981 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.981 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.981 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.981 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-26T18:46:50.981 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 254928 2024-04-26T18:46:50.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.981 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T18:46:50.981 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 650, 2024-04-26T18:46:50.982 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 647, 2024-04-26T18:46:50.982 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 5605436, 2024-04-26T18:46:50.982 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 240296, 2024-04-26T18:46:50.982 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2024-04-26T18:46:50.982 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 3, 2024-04-26T18:46:50.982 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.065095718, 2024-04-26T18:46:50.982 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.020540765, 2024-04-26T18:46:50.982 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.025366768, 2024-04-26T18:46:50.982 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.016110982, 2024-04-26T18:46:50.982 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:50.982 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 647, 2024-04-26T18:46:50.982 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.024126697, 2024-04-26T18:46:50.982 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000037290 2024-04-26T18:46:50.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.982 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:50.982 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.983 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.983 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.983 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 201504, 2024-04-26T18:46:50.983 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 79696 2024-04-26T18:46:50.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.983 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-04-26T18:46:50.983 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 1, 2024-04-26T18:46:50.983 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-04-26T18:46:50.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.983 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-MDSRank": { 2024-04-26T18:46:50.983 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-04-26T18:46:50.983 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-04-26T18:46:50.983 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2395, 2024-04-26T18:46:50.983 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.062159867, 2024-04-26T18:46:50.983 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000025954 2024-04-26T18:46:50.983 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:50.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.984 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-PurgeQueue": { 2024-04-26T18:46:50.984 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-04-26T18:46:50.984 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-04-26T18:46:50.984 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.984 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.984 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.984 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:50.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.984 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-26T18:46:50.984 INFO:teuthology.orchestra.run.smithi082.stdout: "request": 0, 2024-04-26T18:46:50.984 INFO:teuthology.orchestra.run.smithi082.stdout: "reply": 0, 2024-04-26T18:46:50.984 INFO:teuthology.orchestra.run.smithi082.stdout: "reply_latency": { 2024-04-26T18:46:50.984 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.984 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.985 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.985 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_reply": 0, 2024-04-26T18:46:50.985 INFO:teuthology.orchestra.run.smithi082.stdout: "forward": 0, 2024-04-26T18:46:50.985 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_complete": 0, 2024-04-26T18:46:50.985 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_keys": 0, 2024-04-26T18:46:50.985 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_commit": 0, 2024-04-26T18:46:50.985 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_split": 0, 2024-04-26T18:46:50.985 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_merge": 0, 2024-04-26T18:46:50.985 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes": 1027, 2024-04-26T18:46:50.985 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_top": 693, 2024-04-26T18:46:50.985 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_bottom": 334, 2024-04-26T18:46:50.985 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pin_tail": 0, 2024-04-26T18:46:50.985 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pinned": 37, 2024-04-26T18:46:50.985 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_expired": 0, 2024-04-26T18:46:50.985 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_with_caps": 0, 2024-04-26T18:46:50.986 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": 0, 2024-04-26T18:46:50.986 INFO:teuthology.orchestra.run.smithi082.stdout: "subtrees": 2, 2024-04-26T18:46:50.986 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse": 0, 2024-04-26T18:46:50.986 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_hit": 0, 2024-04-26T18:46:50.986 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_forward": 0, 2024-04-26T18:46:50.986 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_discover": 0, 2024-04-26T18:46:50.986 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_dir_fetch": 0, 2024-04-26T18:46:50.986 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_remote_ino": 0, 2024-04-26T18:46:50.986 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_lock": 0, 2024-04-26T18:46:50.986 INFO:teuthology.orchestra.run.smithi082.stdout: "load_cent": 0, 2024-04-26T18:46:50.986 INFO:teuthology.orchestra.run.smithi082.stdout: "q": 0, 2024-04-26T18:46:50.986 INFO:teuthology.orchestra.run.smithi082.stdout: "exported": 0, 2024-04-26T18:46:50.986 INFO:teuthology.orchestra.run.smithi082.stdout: "exported_inodes": 0, 2024-04-26T18:46:50.986 INFO:teuthology.orchestra.run.smithi082.stdout: "imported": 0, 2024-04-26T18:46:50.987 INFO:teuthology.orchestra.run.smithi082.stdout: "imported_inodes": 0, 2024-04-26T18:46:50.987 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_dir_fetch": 0, 2024-04-26T18:46:50.987 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_backtrace_fetch": 0, 2024-04-26T18:46:50.987 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_peer_discover": 0, 2024-04-26T18:46:50.987 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rfiles": 4, 2024-04-26T18:46:50.987 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rbytes": 234, 2024-04-26T18:46:50.987 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rsnaps": 6, 2024-04-26T18:46:50.987 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T18:46:50.987 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_set_tag": 0, 2024-04-26T18:46:50.987 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T18:46:50.987 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_inotable_repaired": 0, 2024-04-26T18:46:50.987 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_inodes": 0, 2024-04-26T18:46:50.987 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T18:46:50.987 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T18:46:50.987 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_file_inodes": 0, 2024-04-26T18:46:50.987 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_inode_file_caps": 0, 2024-04-26T18:46:50.987 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_revoke": 0, 2024-04-26T18:46:50.988 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_grant": 0, 2024-04-26T18:46:50.988 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T18:46:50.988 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T18:46:50.988 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T18:46:50.988 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps": 0, 2024-04-26T18:46:50.988 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps_dirty": 0, 2024-04-26T18:46:50.988 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_cap_release": 0, 2024-04-26T18:46:50.988 INFO:teuthology.orchestra.run.smithi082.stdout: "process_request_cap_release": 0 2024-04-26T18:46:50.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.988 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_cache": { 2024-04-26T18:46:50.988 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update": 0, 2024-04-26T18:46:50.988 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update_receipt": 0, 2024-04-26T18:46:50.988 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_try_discover": 0, 2024-04-26T18:46:50.988 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_send_discover": 0, 2024-04-26T18:46:50.988 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_handle_discover": 0, 2024-04-26T18:46:50.988 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays": 0, 2024-04-26T18:46:50.988 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_delayed": 0, 2024-04-26T18:46:50.989 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_enqueuing": 0, 2024-04-26T18:46:50.989 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_created": 0, 2024-04-26T18:46:50.989 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_enqueued": 0, 2024-04-26T18:46:50.989 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_reintegrated": 0, 2024-04-26T18:46:50.989 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_migrated": 0, 2024-04-26T18:46:50.989 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_processing": 0, 2024-04-26T18:46:50.989 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_enqueued": 0, 2024-04-26T18:46:50.989 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_prioritized": 0, 2024-04-26T18:46:50.989 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_started": 0, 2024-04-26T18:46:50.989 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_completed": 0, 2024-04-26T18:46:50.989 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_path": 0, 2024-04-26T18:46:50.989 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_inode": 0, 2024-04-26T18:46:50.989 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T18:46:50.989 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_exportdir": 0, 2024-04-26T18:46:50.989 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_flush": 0, 2024-04-26T18:46:50.989 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragmentdir": 0, 2024-04-26T18:46:50.989 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragstats": 0, 2024-04-26T18:46:50.990 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_inodestats": 0 2024-04-26T18:46:50.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.990 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_log": { 2024-04-26T18:46:50.990 INFO:teuthology.orchestra.run.smithi082.stdout: "evlrg": 0, 2024-04-26T18:46:50.990 INFO:teuthology.orchestra.run.smithi082.stdout: "evadd": 0, 2024-04-26T18:46:50.990 INFO:teuthology.orchestra.run.smithi082.stdout: "evex": 0, 2024-04-26T18:46:50.990 INFO:teuthology.orchestra.run.smithi082.stdout: "evtrm": 0, 2024-04-26T18:46:50.990 INFO:teuthology.orchestra.run.smithi082.stdout: "ev": 4339, 2024-04-26T18:46:50.990 INFO:teuthology.orchestra.run.smithi082.stdout: "evexg": 0, 2024-04-26T18:46:50.990 INFO:teuthology.orchestra.run.smithi082.stdout: "evexd": 0, 2024-04-26T18:46:50.990 INFO:teuthology.orchestra.run.smithi082.stdout: "segadd": 0, 2024-04-26T18:46:50.990 INFO:teuthology.orchestra.run.smithi082.stdout: "segex": 0, 2024-04-26T18:46:50.990 INFO:teuthology.orchestra.run.smithi082.stdout: "segtrm": 0, 2024-04-26T18:46:50.990 INFO:teuthology.orchestra.run.smithi082.stdout: "seg": 2, 2024-04-26T18:46:50.990 INFO:teuthology.orchestra.run.smithi082.stdout: "segmjr": 2, 2024-04-26T18:46:50.991 INFO:teuthology.orchestra.run.smithi082.stdout: "segexg": 0, 2024-04-26T18:46:50.991 INFO:teuthology.orchestra.run.smithi082.stdout: "segexd": 0, 2024-04-26T18:46:50.991 INFO:teuthology.orchestra.run.smithi082.stdout: "expos": 18129239, 2024-04-26T18:46:50.991 INFO:teuthology.orchestra.run.smithi082.stdout: "wrpos": 18209877, 2024-04-26T18:46:50.991 INFO:teuthology.orchestra.run.smithi082.stdout: "rdpos": 18209765, 2024-04-26T18:46:50.991 INFO:teuthology.orchestra.run.smithi082.stdout: "jlat": { 2024-04-26T18:46:50.991 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.991 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.991 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.991 INFO:teuthology.orchestra.run.smithi082.stdout: "replayed": 4339 2024-04-26T18:46:50.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.991 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_mem": { 2024-04-26T18:46:50.991 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 16, 2024-04-26T18:46:50.991 INFO:teuthology.orchestra.run.smithi082.stdout: "ino+": 831, 2024-04-26T18:46:50.992 INFO:teuthology.orchestra.run.smithi082.stdout: "ino-": 815, 2024-04-26T18:46:50.992 INFO:teuthology.orchestra.run.smithi082.stdout: "dir": 15, 2024-04-26T18:46:50.992 INFO:teuthology.orchestra.run.smithi082.stdout: "dir+": 16, 2024-04-26T18:46:50.992 INFO:teuthology.orchestra.run.smithi082.stdout: "dir-": 1, 2024-04-26T18:46:50.992 INFO:teuthology.orchestra.run.smithi082.stdout: "dn": 1027, 2024-04-26T18:46:50.992 INFO:teuthology.orchestra.run.smithi082.stdout: "dn+": 1028, 2024-04-26T18:46:50.992 INFO:teuthology.orchestra.run.smithi082.stdout: "dn-": 1, 2024-04-26T18:46:50.992 INFO:teuthology.orchestra.run.smithi082.stdout: "cap": 0, 2024-04-26T18:46:50.992 INFO:teuthology.orchestra.run.smithi082.stdout: "cap+": 0, 2024-04-26T18:46:50.992 INFO:teuthology.orchestra.run.smithi082.stdout: "cap-": 0, 2024-04-26T18:46:50.992 INFO:teuthology.orchestra.run.smithi082.stdout: "rss": 50168, 2024-04-26T18:46:50.992 INFO:teuthology.orchestra.run.smithi082.stdout: "heap": 215392 2024-04-26T18:46:50.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.992 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_server": { 2024-04-26T18:46:50.992 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_client_request": 0, 2024-04-26T18:46:50.992 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_server_request": 0, 2024-04-26T18:46:50.992 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_request": 0, 2024-04-26T18:46:50.993 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_session": 0, 2024-04-26T18:46:50.993 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_peer_request": 0, 2024-04-26T18:46:50.993 INFO:teuthology.orchestra.run.smithi082.stdout: "req_create_latency": { 2024-04-26T18:46:50.993 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.993 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.993 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.993 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getattr_latency": { 2024-04-26T18:46:50.993 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.993 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.993 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.993 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getfilelock_latency": { 2024-04-26T18:46:50.993 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.993 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.993 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.994 INFO:teuthology.orchestra.run.smithi082.stdout: "req_link_latency": { 2024-04-26T18:46:50.994 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.994 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.994 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.994 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookup_latency": { 2024-04-26T18:46:50.994 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.994 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.994 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.994 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookuphash_latency": { 2024-04-26T18:46:50.994 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.994 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.994 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.995 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupino_latency": { 2024-04-26T18:46:50.995 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.995 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.995 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.995 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupname_latency": { 2024-04-26T18:46:50.995 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.995 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.995 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.995 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupparent_latency": { 2024-04-26T18:46:50.995 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.995 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.995 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.996 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupsnap_latency": { 2024-04-26T18:46:50.996 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.996 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.996 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.996 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lssnap_latency": { 2024-04-26T18:46:50.996 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.996 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.996 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.996 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mkdir_latency": { 2024-04-26T18:46:50.996 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.997 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.997 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.997 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mknod_latency": { 2024-04-26T18:46:50.997 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.997 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.997 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.997 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mksnap_latency": { 2024-04-26T18:46:50.997 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.997 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.997 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.998 INFO:teuthology.orchestra.run.smithi082.stdout: "req_open_latency": { 2024-04-26T18:46:50.998 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.998 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.998 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.998 INFO:teuthology.orchestra.run.smithi082.stdout: "req_readdir_latency": { 2024-04-26T18:46:50.998 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.998 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.998 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.998 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rename_latency": { 2024-04-26T18:46:50.998 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.998 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.998 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.999 INFO:teuthology.orchestra.run.smithi082.stdout: "req_renamesnap_latency": { 2024-04-26T18:46:50.999 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.999 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.999 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.999 INFO:teuthology.orchestra.run.smithi082.stdout: "req_snapdiff_latency": { 2024-04-26T18:46:50.999 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.999 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.999 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:50.999 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmdir_latency": { 2024-04-26T18:46:50.999 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:50.999 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:50.999 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:50.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:51.000 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmsnap_latency": { 2024-04-26T18:46:51.000 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:51.000 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:51.000 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:51.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:51.000 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmxattr_latency": { 2024-04-26T18:46:51.000 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:51.000 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:51.000 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:51.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:51.000 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setattr_latency": { 2024-04-26T18:46:51.000 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:51.000 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:51.000 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:51.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:51.000 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setdirlayout_latency": { 2024-04-26T18:46:51.000 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:51.001 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:51.001 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:51.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:51.001 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setfilelock_latency": { 2024-04-26T18:46:51.001 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:51.001 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:51.001 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:51.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:51.001 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setlayout_latency": { 2024-04-26T18:46:51.001 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:51.001 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:51.001 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:51.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:51.001 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setxattr_latency": { 2024-04-26T18:46:51.001 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:51.001 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:51.002 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:51.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:51.002 INFO:teuthology.orchestra.run.smithi082.stdout: "req_symlink_latency": { 2024-04-26T18:46:51.002 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:51.002 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:51.002 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:51.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:51.002 INFO:teuthology.orchestra.run.smithi082.stdout: "req_unlink_latency": { 2024-04-26T18:46:51.002 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:51.002 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:51.002 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:51.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:51.002 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_revoke_eviction": 0, 2024-04-26T18:46:51.002 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_acquisition_throttle": 0, 2024-04-26T18:46:51.002 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getvxattr_latency": { 2024-04-26T18:46:51.003 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:51.003 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:51.003 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:51.003 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:51.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:51.003 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_sessions": { 2024-04-26T18:46:51.003 INFO:teuthology.orchestra.run.smithi082.stdout: "session_count": 2, 2024-04-26T18:46:51.003 INFO:teuthology.orchestra.run.smithi082.stdout: "session_add": 2, 2024-04-26T18:46:51.003 INFO:teuthology.orchestra.run.smithi082.stdout: "session_remove": 0, 2024-04-26T18:46:51.003 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_open": 0, 2024-04-26T18:46:51.003 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_stale": 0, 2024-04-26T18:46:51.003 INFO:teuthology.orchestra.run.smithi082.stdout: "total_load": 0, 2024-04-26T18:46:51.003 INFO:teuthology.orchestra.run.smithi082.stdout: "average_load": 0, 2024-04-26T18:46:51.003 INFO:teuthology.orchestra.run.smithi082.stdout: "avg_session_uptime": 1799, 2024-04-26T18:46:51.003 INFO:teuthology.orchestra.run.smithi082.stdout: "mdthresh_evicted": 0 2024-04-26T18:46:51.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:51.004 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-04-26T18:46:51.004 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-04-26T18:46:51.004 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-04-26T18:46:51.004 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T18:46:51.004 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-04-26T18:46:51.004 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T18:46:51.004 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-04-26T18:46:51.004 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T18:46:51.004 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T18:46:51.004 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T18:46:51.004 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T18:46:51.004 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T18:46:51.004 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-04-26T18:46:51.004 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T18:46:51.004 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T18:46:51.004 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-04-26T18:46:51.004 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-04-26T18:46:51.005 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-04-26T18:46:51.005 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-04-26T18:46:51.005 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T18:46:51.005 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T18:46:51.005 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T18:46:51.005 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T18:46:51.005 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T18:46:51.005 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-04-26T18:46:51.005 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-04-26T18:46:51.005 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-04-26T18:46:51.005 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T18:46:51.005 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T18:46:51.005 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-04-26T18:46:51.005 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-04-26T18:46:51.005 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-04-26T18:46:51.005 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-04-26T18:46:51.005 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T18:46:51.006 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-04-26T18:46:51.006 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T18:46:51.006 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-04-26T18:46:51.006 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 198498, 2024-04-26T18:46:51.006 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 57, 2024-04-26T18:46:51.006 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-04-26T18:46:51.006 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-04-26T18:46:51.006 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-04-26T18:46:51.006 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-04-26T18:46:51.006 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-04-26T18:46:51.006 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-04-26T18:46:51.006 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-04-26T18:46:51.006 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-04-26T18:46:51.006 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 7936, 2024-04-26T18:46:51.007 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 165, 2024-04-26T18:46:51.007 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T18:46:51.007 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-04-26T18:46:51.007 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-04-26T18:46:51.007 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-04-26T18:46:51.007 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 792504, 2024-04-26T18:46:51.007 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 4266, 2024-04-26T18:46:51.007 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-04-26T18:46:51.007 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-04-26T18:46:51.007 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-04-26T18:46:51.007 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-04-26T18:46:51.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:51.007 INFO:teuthology.orchestra.run.smithi082.stdout: "objecter": { 2024-04-26T18:46:51.007 INFO:teuthology.orchestra.run.smithi082.stdout: "op_active": 0, 2024-04-26T18:46:51.007 INFO:teuthology.orchestra.run.smithi082.stdout: "op_laggy": 0, 2024-04-26T18:46:51.007 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send": 1439, 2024-04-26T18:46:51.007 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send_bytes": 26, 2024-04-26T18:46:51.008 INFO:teuthology.orchestra.run.smithi082.stdout: "op_resend": 4, 2024-04-26T18:46:51.008 INFO:teuthology.orchestra.run.smithi082.stdout: "op_reply": 1439, 2024-04-26T18:46:51.008 INFO:teuthology.orchestra.run.smithi082.stdout: "op_latency": { 2024-04-26T18:46:51.008 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1439, 2024-04-26T18:46:51.008 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.643987376, 2024-04-26T18:46:51.008 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000447524 2024-04-26T18:46:51.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:51.008 INFO:teuthology.orchestra.run.smithi082.stdout: "op_inflight": 0, 2024-04-26T18:46:51.008 INFO:teuthology.orchestra.run.smithi082.stdout: "oplen_avg": { 2024-04-26T18:46:51.008 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1439, 2024-04-26T18:46:51.008 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 1440 2024-04-26T18:46:51.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:51.008 INFO:teuthology.orchestra.run.smithi082.stdout: "op": 1439, 2024-04-26T18:46:51.008 INFO:teuthology.orchestra.run.smithi082.stdout: "op_r": 1439, 2024-04-26T18:46:51.008 INFO:teuthology.orchestra.run.smithi082.stdout: "op_w": 0, 2024-04-26T18:46:51.008 INFO:teuthology.orchestra.run.smithi082.stdout: "op_rmw": 0, 2024-04-26T18:46:51.008 INFO:teuthology.orchestra.run.smithi082.stdout: "op_pg": 0, 2024-04-26T18:46:51.009 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_stat": 929, 2024-04-26T18:46:51.009 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_create": 0, 2024-04-26T18:46:51.009 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_read": 507, 2024-04-26T18:46:51.009 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_write": 0, 2024-04-26T18:46:51.009 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writefull": 0, 2024-04-26T18:46:51.009 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writesame": 0, 2024-04-26T18:46:51.009 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_append": 0, 2024-04-26T18:46:51.009 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_zero": 0, 2024-04-26T18:46:51.009 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_truncate": 0, 2024-04-26T18:46:51.009 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_delete": 0, 2024-04-26T18:46:51.009 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_mapext": 0, 2024-04-26T18:46:51.009 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_sparse_read": 0, 2024-04-26T18:46:51.009 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_clonerange": 0, 2024-04-26T18:46:51.009 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_getxattr": 2, 2024-04-26T18:46:51.009 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_setxattr": 0, 2024-04-26T18:46:51.010 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_cmpxattr": 0, 2024-04-26T18:46:51.010 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_rmxattr": 0, 2024-04-26T18:46:51.010 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_resetxattrs": 0, 2024-04-26T18:46:51.010 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_call": 0, 2024-04-26T18:46:51.010 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_watch": 0, 2024-04-26T18:46:51.010 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_notify": 0, 2024-04-26T18:46:51.010 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T18:46:51.010 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls": 0, 2024-04-26T18:46:51.010 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls_filter": 0, 2024-04-26T18:46:51.010 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_other": 0, 2024-04-26T18:46:51.010 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_active": 0, 2024-04-26T18:46:51.010 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_send": 0, 2024-04-26T18:46:51.010 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_resend": 0, 2024-04-26T18:46:51.010 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_ping": 0, 2024-04-26T18:46:51.010 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_active": 0, 2024-04-26T18:46:51.011 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_send": 0, 2024-04-26T18:46:51.011 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_resend": 0, 2024-04-26T18:46:51.011 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_active": 0, 2024-04-26T18:46:51.011 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_send": 0, 2024-04-26T18:46:51.011 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_resend": 0, 2024-04-26T18:46:51.011 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_active": 0, 2024-04-26T18:46:51.011 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_send": 0, 2024-04-26T18:46:51.011 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_resend": 0, 2024-04-26T18:46:51.011 INFO:teuthology.orchestra.run.smithi082.stdout: "command_active": 0, 2024-04-26T18:46:51.011 INFO:teuthology.orchestra.run.smithi082.stdout: "command_send": 0, 2024-04-26T18:46:51.011 INFO:teuthology.orchestra.run.smithi082.stdout: "command_resend": 0, 2024-04-26T18:46:51.011 INFO:teuthology.orchestra.run.smithi082.stdout: "map_epoch": 101, 2024-04-26T18:46:51.011 INFO:teuthology.orchestra.run.smithi082.stdout: "map_full": 0, 2024-04-26T18:46:51.011 INFO:teuthology.orchestra.run.smithi082.stdout: "map_inc": 8, 2024-04-26T18:46:51.011 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_sessions": 6, 2024-04-26T18:46:51.011 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_open": 6, 2024-04-26T18:46:51.011 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_close": 0, 2024-04-26T18:46:51.012 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_laggy": 0, 2024-04-26T18:46:51.012 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_wr": 0, 2024-04-26T18:46:51.012 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_rd": 2, 2024-04-26T18:46:51.012 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_del": 0 2024-04-26T18:46:51.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:51.012 INFO:teuthology.orchestra.run.smithi082.stdout: "oft": { 2024-04-26T18:46:51.012 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_objs": 0, 2024-04-26T18:46:51.012 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_kv_pairs": 0, 2024-04-26T18:46:51.012 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_updates": 0, 2024-04-26T18:46:51.012 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_removes": 0 2024-04-26T18:46:51.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:51.012 INFO:teuthology.orchestra.run.smithi082.stdout: "osd-slow-ops": { 2024-04-26T18:46:51.012 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_ops_count": 0 2024-04-26T18:46:51.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:51.012 INFO:teuthology.orchestra.run.smithi082.stdout: "purge_queue": { 2024-04-26T18:46:51.012 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops": 0, 2024-04-26T18:46:51.013 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops_high_water": 0, 2024-04-26T18:46:51.013 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing": 0, 2024-04-26T18:46:51.013 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_high_water": 0, 2024-04-26T18:46:51.013 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed_ops": 0, 2024-04-26T18:46:51.013 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed": 0, 2024-04-26T18:46:51.013 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_item_in_journal": 0 2024-04-26T18:46:51.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:51.013 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T18:46:51.013 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T18:46:51.013 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-04-26T18:46:51.013 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T18:46:51.013 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 1581, 2024-04-26T18:46:51.013 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 9922003, 2024-04-26T18:46:51.013 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:51.013 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 1581, 2024-04-26T18:46:51.013 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-26T18:46:51.013 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-26T18:46:51.014 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 1581, 2024-04-26T18:46:51.014 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 9922003, 2024-04-26T18:46:51.014 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T18:46:51.014 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:51.014 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:51.014 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:51.014 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:51.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:51.014 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_bytes": { 2024-04-26T18:46:51.014 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T18:46:51.014 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-04-26T18:46:51.014 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T18:46:51.014 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-26T18:46:51.014 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-26T18:46:51.014 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:51.015 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-26T18:46:51.015 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 1439, 2024-04-26T18:46:51.015 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 9465638, 2024-04-26T18:46:51.015 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 1439, 2024-04-26T18:46:51.015 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 9465638, 2024-04-26T18:46:51.015 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T18:46:51.015 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:51.015 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:51.015 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:51.015 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:51.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:51.015 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_ops": { 2024-04-26T18:46:51.015 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T18:46:51.015 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 1024, 2024-04-26T18:46:51.015 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T18:46:51.015 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-26T18:46:51.015 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-26T18:46:51.016 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:51.016 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-26T18:46:51.016 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 1439, 2024-04-26T18:46:51.016 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 1439, 2024-04-26T18:46:51.016 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 1439, 2024-04-26T18:46:51.016 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 1439, 2024-04-26T18:46:51.016 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T18:46:51.016 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:51.016 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:51.016 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:51.016 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:51.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:51.016 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle": { 2024-04-26T18:46:51.016 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T18:46:51.016 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-04-26T18:46:51.016 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T18:46:51.016 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-26T18:46:51.017 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-26T18:46:51.017 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:51.017 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-26T18:46:51.017 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-26T18:46:51.017 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-26T18:46:51.017 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2024-04-26T18:46:51.017 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2024-04-26T18:46:51.017 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T18:46:51.017 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:51.017 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:51.017 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:51.017 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:51.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:51.017 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle-0x555cdbeb66e0": { 2024-04-26T18:46:51.017 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T18:46:51.017 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-04-26T18:46:51.017 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T18:46:51.018 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-26T18:46:51.018 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-26T18:46:51.018 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:51.018 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-26T18:46:51.018 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-26T18:46:51.018 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-26T18:46:51.018 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2024-04-26T18:46:51.018 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2024-04-26T18:46:51.018 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T18:46:51.018 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:51.018 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:51.018 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:51.018 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:51.018 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:51.018 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T18:46:51.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:51 smithi082 ceph-mon[32808]: pgmap v323: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:46:51.721 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-04-26T18:46:51.721 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-04-26T18:46:51.721 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=6 2024-04-26T18:46:51.721 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-04-26T18:46:51.721 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-04-26T18:46:51.721 DEBUG:tasks.check_counter:Getting stats from h 2024-04-26T18:46:51.722 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph daemon mds.h perf dump 2024-04-26T18:46:51.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:51 smithi080 ceph-mon[29135]: pgmap v323: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:46:51.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:51 smithi192 ceph-mon[32842]: pgmap v323: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:46:51.958 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T18:46:53.698 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:53 smithi082 ceph-mon[32808]: pgmap v324: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:46:53.699 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T18:46:53.699 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T18:46:53.699 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 290, 2024-04-26T18:46:53.699 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 513, 2024-04-26T18:46:53.699 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 85239, 2024-04-26T18:46:53.699 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 209241, 2024-04-26T18:46:53.699 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 8, 2024-04-26T18:46:53.699 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 2, 2024-04-26T18:46:53.699 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.054544754, 2024-04-26T18:46:53.700 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.026545000, 2024-04-26T18:46:53.700 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.018302333, 2024-04-26T18:46:53.700 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.004424754, 2024-04-26T18:46:53.700 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:53.700 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 515, 2024-04-26T18:46:53.700 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.040263191, 2024-04-26T18:46:53.700 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000078180 2024-04-26T18:46:53.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.700 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:53.700 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 742, 2024-04-26T18:46:53.700 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000194398, 2024-04-26T18:46:53.700 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000261 2024-04-26T18:46:53.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.700 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-26T18:46:53.700 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 0 2024-04-26T18:46:53.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.701 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T18:46:53.701 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 34, 2024-04-26T18:46:53.701 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 109, 2024-04-26T18:46:53.701 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 10142, 2024-04-26T18:46:53.701 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 177256, 2024-04-26T18:46:53.701 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 9, 2024-04-26T18:46:53.701 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 5, 2024-04-26T18:46:53.701 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.015990780, 2024-04-26T18:46:53.701 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.005270574, 2024-04-26T18:46:53.701 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.008926259, 2024-04-26T18:46:53.701 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000586511, 2024-04-26T18:46:53.701 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:53.701 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 107, 2024-04-26T18:46:53.701 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.016583557, 2024-04-26T18:46:53.702 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000154986 2024-04-26T18:46:53.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.702 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:53.702 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 55, 2024-04-26T18:46:53.702 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000011263, 2024-04-26T18:46:53.702 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000204 2024-04-26T18:46:53.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.702 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 6352, 2024-04-26T18:46:53.702 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 165152 2024-04-26T18:46:53.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.702 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T18:46:53.702 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 308, 2024-04-26T18:46:53.702 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 417, 2024-04-26T18:46:53.702 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 1666656, 2024-04-26T18:46:53.703 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 534675, 2024-04-26T18:46:53.703 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 12, 2024-04-26T18:46:53.703 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 5, 2024-04-26T18:46:53.703 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.059726082, 2024-04-26T18:46:53.703 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.020471875, 2024-04-26T18:46:53.703 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.042751879, 2024-04-26T18:46:53.703 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.005946963, 2024-04-26T18:46:53.703 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:53.703 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 412, 2024-04-26T18:46:53.703 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.028701184, 2024-04-26T18:46:53.703 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000069663 2024-04-26T18:46:53.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.703 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:53.703 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 6, 2024-04-26T18:46:53.704 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000584, 2024-04-26T18:46:53.704 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000097 2024-04-26T18:46:53.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.704 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 1664400, 2024-04-26T18:46:53.704 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 460880 2024-04-26T18:46:53.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.704 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-04-26T18:46:53.704 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 1, 2024-04-26T18:46:53.704 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-04-26T18:46:53.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.704 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-MDSRank": { 2024-04-26T18:46:53.704 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-04-26T18:46:53.704 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-04-26T18:46:53.704 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 48, 2024-04-26T18:46:53.704 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.001396174, 2024-04-26T18:46:53.705 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000029086 2024-04-26T18:46:53.705 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:53.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.705 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-PurgeQueue": { 2024-04-26T18:46:53.705 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-04-26T18:46:53.705 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-04-26T18:46:53.705 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2, 2024-04-26T18:46:53.705 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000010829, 2024-04-26T18:46:53.705 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000005414 2024-04-26T18:46:53.705 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:53.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.705 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-26T18:46:53.705 INFO:teuthology.orchestra.run.smithi082.stdout: "request": 1, 2024-04-26T18:46:53.705 INFO:teuthology.orchestra.run.smithi082.stdout: "reply": 1, 2024-04-26T18:46:53.706 INFO:teuthology.orchestra.run.smithi082.stdout: "reply_latency": { 2024-04-26T18:46:53.706 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1, 2024-04-26T18:46:53.706 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000119437, 2024-04-26T18:46:53.706 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000119437 2024-04-26T18:46:53.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.706 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_reply": 0, 2024-04-26T18:46:53.706 INFO:teuthology.orchestra.run.smithi082.stdout: "forward": 0, 2024-04-26T18:46:53.706 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_complete": 0, 2024-04-26T18:46:53.706 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_keys": 0, 2024-04-26T18:46:53.706 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_commit": 11, 2024-04-26T18:46:53.706 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_split": 0, 2024-04-26T18:46:53.706 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_merge": 0, 2024-04-26T18:46:53.706 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes": 10, 2024-04-26T18:46:53.706 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_top": 0, 2024-04-26T18:46:53.707 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_bottom": 10, 2024-04-26T18:46:53.707 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pin_tail": 0, 2024-04-26T18:46:53.707 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pinned": 10, 2024-04-26T18:46:53.707 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_expired": 0, 2024-04-26T18:46:53.707 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_with_caps": 1, 2024-04-26T18:46:53.707 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": 1, 2024-04-26T18:46:53.707 INFO:teuthology.orchestra.run.smithi082.stdout: "subtrees": 1, 2024-04-26T18:46:53.707 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse": 4, 2024-04-26T18:46:53.707 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_hit": 4, 2024-04-26T18:46:53.707 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_forward": 0, 2024-04-26T18:46:53.707 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_discover": 0, 2024-04-26T18:46:53.707 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_dir_fetch": 0, 2024-04-26T18:46:53.707 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_remote_ino": 0, 2024-04-26T18:46:53.707 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_lock": 0, 2024-04-26T18:46:53.707 INFO:teuthology.orchestra.run.smithi082.stdout: "load_cent": 0, 2024-04-26T18:46:53.708 INFO:teuthology.orchestra.run.smithi082.stdout: "q": 0, 2024-04-26T18:46:53.708 INFO:teuthology.orchestra.run.smithi082.stdout: "exported": 0, 2024-04-26T18:46:53.708 INFO:teuthology.orchestra.run.smithi082.stdout: "exported_inodes": 0, 2024-04-26T18:46:53.708 INFO:teuthology.orchestra.run.smithi082.stdout: "imported": 0, 2024-04-26T18:46:53.708 INFO:teuthology.orchestra.run.smithi082.stdout: "imported_inodes": 0, 2024-04-26T18:46:53.708 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_dir_fetch": 0, 2024-04-26T18:46:53.708 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_backtrace_fetch": 0, 2024-04-26T18:46:53.708 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_peer_discover": 0, 2024-04-26T18:46:53.708 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rfiles": 4, 2024-04-26T18:46:53.708 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rbytes": 234, 2024-04-26T18:46:53.708 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rsnaps": 0, 2024-04-26T18:46:53.708 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T18:46:53.708 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_set_tag": 0, 2024-04-26T18:46:53.708 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T18:46:53.708 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_inotable_repaired": 0, 2024-04-26T18:46:53.709 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_inodes": 0, 2024-04-26T18:46:53.709 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T18:46:53.709 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T18:46:53.709 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_file_inodes": 0, 2024-04-26T18:46:53.709 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_inode_file_caps": 0, 2024-04-26T18:46:53.709 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_revoke": 1, 2024-04-26T18:46:53.709 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_grant": 0, 2024-04-26T18:46:53.709 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T18:46:53.709 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T18:46:53.709 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T18:46:53.709 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps": 1, 2024-04-26T18:46:53.709 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps_dirty": 0, 2024-04-26T18:46:53.709 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_cap_release": 0, 2024-04-26T18:46:53.709 INFO:teuthology.orchestra.run.smithi082.stdout: "process_request_cap_release": 0 2024-04-26T18:46:53.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.710 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_cache": { 2024-04-26T18:46:53.710 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update": 0, 2024-04-26T18:46:53.710 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update_receipt": 0, 2024-04-26T18:46:53.710 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_try_discover": 0, 2024-04-26T18:46:53.710 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_send_discover": 1, 2024-04-26T18:46:53.710 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_handle_discover": 0, 2024-04-26T18:46:53.710 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays": 0, 2024-04-26T18:46:53.710 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_delayed": 0, 2024-04-26T18:46:53.710 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_enqueuing": 0, 2024-04-26T18:46:53.710 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_created": 0, 2024-04-26T18:46:53.710 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_enqueued": 0, 2024-04-26T18:46:53.710 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_reintegrated": 0, 2024-04-26T18:46:53.710 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_migrated": 0, 2024-04-26T18:46:53.710 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_processing": 0, 2024-04-26T18:46:53.711 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_enqueued": 0, 2024-04-26T18:46:53.711 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_prioritized": 0, 2024-04-26T18:46:53.711 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_started": 0, 2024-04-26T18:46:53.711 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_completed": 0, 2024-04-26T18:46:53.711 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_path": 2, 2024-04-26T18:46:53.711 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_inode": 2, 2024-04-26T18:46:53.711 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T18:46:53.711 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_exportdir": 0, 2024-04-26T18:46:53.711 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_flush": 0, 2024-04-26T18:46:53.711 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragmentdir": 0, 2024-04-26T18:46:53.711 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragstats": 0, 2024-04-26T18:46:53.711 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_inodestats": 0 2024-04-26T18:46:53.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.711 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_log": { 2024-04-26T18:46:53.711 INFO:teuthology.orchestra.run.smithi082.stdout: "evlrg": 0, 2024-04-26T18:46:53.712 INFO:teuthology.orchestra.run.smithi082.stdout: "evadd": 5, 2024-04-26T18:46:53.712 INFO:teuthology.orchestra.run.smithi082.stdout: "evex": 0, 2024-04-26T18:46:53.712 INFO:teuthology.orchestra.run.smithi082.stdout: "evtrm": 0, 2024-04-26T18:46:53.712 INFO:teuthology.orchestra.run.smithi082.stdout: "ev": 5, 2024-04-26T18:46:53.712 INFO:teuthology.orchestra.run.smithi082.stdout: "evexg": 0, 2024-04-26T18:46:53.712 INFO:teuthology.orchestra.run.smithi082.stdout: "evexd": 0, 2024-04-26T18:46:53.712 INFO:teuthology.orchestra.run.smithi082.stdout: "segadd": 2, 2024-04-26T18:46:53.712 INFO:teuthology.orchestra.run.smithi082.stdout: "segex": 0, 2024-04-26T18:46:53.712 INFO:teuthology.orchestra.run.smithi082.stdout: "segtrm": 0, 2024-04-26T18:46:53.712 INFO:teuthology.orchestra.run.smithi082.stdout: "seg": 2, 2024-04-26T18:46:53.712 INFO:teuthology.orchestra.run.smithi082.stdout: "segmjr": 2, 2024-04-26T18:46:53.712 INFO:teuthology.orchestra.run.smithi082.stdout: "segexg": 0, 2024-04-26T18:46:53.712 INFO:teuthology.orchestra.run.smithi082.stdout: "segexd": 0, 2024-04-26T18:46:53.712 INFO:teuthology.orchestra.run.smithi082.stdout: "expos": 4194304, 2024-04-26T18:46:53.712 INFO:teuthology.orchestra.run.smithi082.stdout: "wrpos": 4195732, 2024-04-26T18:46:53.712 INFO:teuthology.orchestra.run.smithi082.stdout: "rdpos": 0, 2024-04-26T18:46:53.713 INFO:teuthology.orchestra.run.smithi082.stdout: "jlat": { 2024-04-26T18:46:53.713 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 4, 2024-04-26T18:46:53.713 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.009400585, 2024-04-26T18:46:53.713 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.002350146 2024-04-26T18:46:53.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.713 INFO:teuthology.orchestra.run.smithi082.stdout: "replayed": 0 2024-04-26T18:46:53.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.713 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_mem": { 2024-04-26T18:46:53.713 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 13, 2024-04-26T18:46:53.713 INFO:teuthology.orchestra.run.smithi082.stdout: "ino+": 13, 2024-04-26T18:46:53.713 INFO:teuthology.orchestra.run.smithi082.stdout: "ino-": 0, 2024-04-26T18:46:53.713 INFO:teuthology.orchestra.run.smithi082.stdout: "dir": 11, 2024-04-26T18:46:53.713 INFO:teuthology.orchestra.run.smithi082.stdout: "dir+": 12, 2024-04-26T18:46:53.713 INFO:teuthology.orchestra.run.smithi082.stdout: "dir-": 1, 2024-04-26T18:46:53.713 INFO:teuthology.orchestra.run.smithi082.stdout: "dn": 10, 2024-04-26T18:46:53.714 INFO:teuthology.orchestra.run.smithi082.stdout: "dn+": 10, 2024-04-26T18:46:53.714 INFO:teuthology.orchestra.run.smithi082.stdout: "dn-": 0, 2024-04-26T18:46:53.714 INFO:teuthology.orchestra.run.smithi082.stdout: "cap": 1, 2024-04-26T18:46:53.714 INFO:teuthology.orchestra.run.smithi082.stdout: "cap+": 1, 2024-04-26T18:46:53.714 INFO:teuthology.orchestra.run.smithi082.stdout: "cap-": 0, 2024-04-26T18:46:53.714 INFO:teuthology.orchestra.run.smithi082.stdout: "rss": 52924, 2024-04-26T18:46:53.714 INFO:teuthology.orchestra.run.smithi082.stdout: "heap": 223608 2024-04-26T18:46:53.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.714 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_server": { 2024-04-26T18:46:53.714 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_client_request": 1, 2024-04-26T18:46:53.714 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_server_request": 0, 2024-04-26T18:46:53.714 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_request": 1, 2024-04-26T18:46:53.714 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_session": 13, 2024-04-26T18:46:53.714 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_peer_request": 2, 2024-04-26T18:46:53.715 INFO:teuthology.orchestra.run.smithi082.stdout: "req_create_latency": { 2024-04-26T18:46:53.715 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.715 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.715 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.715 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getattr_latency": { 2024-04-26T18:46:53.715 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.715 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.715 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.715 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getfilelock_latency": { 2024-04-26T18:46:53.715 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.715 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.715 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.716 INFO:teuthology.orchestra.run.smithi082.stdout: "req_link_latency": { 2024-04-26T18:46:53.716 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.716 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.716 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.716 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookup_latency": { 2024-04-26T18:46:53.716 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.716 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.716 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.716 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookuphash_latency": { 2024-04-26T18:46:53.716 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.716 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.716 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.716 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupino_latency": { 2024-04-26T18:46:53.717 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1, 2024-04-26T18:46:53.717 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000119437, 2024-04-26T18:46:53.717 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000119437 2024-04-26T18:46:53.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.717 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupname_latency": { 2024-04-26T18:46:53.717 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.717 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.717 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.717 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupparent_latency": { 2024-04-26T18:46:53.717 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.717 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.717 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.717 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupsnap_latency": { 2024-04-26T18:46:53.718 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.718 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.718 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.718 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lssnap_latency": { 2024-04-26T18:46:53.718 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.718 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.718 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.718 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mkdir_latency": { 2024-04-26T18:46:53.718 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.719 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.719 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.719 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mknod_latency": { 2024-04-26T18:46:53.719 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.719 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.719 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.719 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mksnap_latency": { 2024-04-26T18:46:53.719 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.720 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.720 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.720 INFO:teuthology.orchestra.run.smithi082.stdout: "req_open_latency": { 2024-04-26T18:46:53.720 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.720 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.720 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.720 INFO:teuthology.orchestra.run.smithi082.stdout: "req_readdir_latency": { 2024-04-26T18:46:53.720 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.720 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.720 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.720 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rename_latency": { 2024-04-26T18:46:53.720 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.721 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.721 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.721 INFO:teuthology.orchestra.run.smithi082.stdout: "req_renamesnap_latency": { 2024-04-26T18:46:53.721 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.721 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.721 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.721 INFO:teuthology.orchestra.run.smithi082.stdout: "req_snapdiff_latency": { 2024-04-26T18:46:53.721 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.721 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.721 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.722 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmdir_latency": { 2024-04-26T18:46:53.722 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.722 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.722 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.722 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmsnap_latency": { 2024-04-26T18:46:53.722 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.722 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.722 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.722 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmxattr_latency": { 2024-04-26T18:46:53.722 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.722 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.723 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.723 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setattr_latency": { 2024-04-26T18:46:53.723 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.723 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.723 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.723 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setdirlayout_latency": { 2024-04-26T18:46:53.723 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.723 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.723 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.723 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setfilelock_latency": { 2024-04-26T18:46:53.723 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.723 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.724 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.724 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setlayout_latency": { 2024-04-26T18:46:53.724 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.724 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.724 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.724 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setxattr_latency": { 2024-04-26T18:46:53.724 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.724 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.724 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.724 INFO:teuthology.orchestra.run.smithi082.stdout: "req_symlink_latency": { 2024-04-26T18:46:53.724 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.724 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.725 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.725 INFO:teuthology.orchestra.run.smithi082.stdout: "req_unlink_latency": { 2024-04-26T18:46:53.725 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.725 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.725 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.725 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_revoke_eviction": 0, 2024-04-26T18:46:53.725 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_acquisition_throttle": 0, 2024-04-26T18:46:53.725 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getvxattr_latency": { 2024-04-26T18:46:53.725 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.725 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.725 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.725 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:53.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.726 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_sessions": { 2024-04-26T18:46:53.726 INFO:teuthology.orchestra.run.smithi082.stdout: "session_count": 1, 2024-04-26T18:46:53.726 INFO:teuthology.orchestra.run.smithi082.stdout: "session_add": 2, 2024-04-26T18:46:53.726 INFO:teuthology.orchestra.run.smithi082.stdout: "session_remove": 1, 2024-04-26T18:46:53.726 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_open": 1, 2024-04-26T18:46:53.726 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_stale": 0, 2024-04-26T18:46:53.726 INFO:teuthology.orchestra.run.smithi082.stdout: "total_load": 1, 2024-04-26T18:46:53.726 INFO:teuthology.orchestra.run.smithi082.stdout: "average_load": 0, 2024-04-26T18:46:53.726 INFO:teuthology.orchestra.run.smithi082.stdout: "avg_session_uptime": 602, 2024-04-26T18:46:53.726 INFO:teuthology.orchestra.run.smithi082.stdout: "mdthresh_evicted": 0 2024-04-26T18:46:53.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.726 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-04-26T18:46:53.726 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-04-26T18:46:53.727 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-04-26T18:46:53.727 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T18:46:53.727 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-04-26T18:46:53.727 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T18:46:53.727 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-04-26T18:46:53.727 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T18:46:53.727 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T18:46:53.727 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T18:46:53.727 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T18:46:53.727 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T18:46:53.727 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-04-26T18:46:53.727 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T18:46:53.727 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T18:46:53.727 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-04-26T18:46:53.727 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-04-26T18:46:53.728 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-04-26T18:46:53.728 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-04-26T18:46:53.728 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T18:46:53.728 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T18:46:53.728 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T18:46:53.728 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T18:46:53.728 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T18:46:53.728 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-04-26T18:46:53.728 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-04-26T18:46:53.728 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-04-26T18:46:53.728 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T18:46:53.728 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T18:46:53.728 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-04-26T18:46:53.728 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-04-26T18:46:53.728 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-04-26T18:46:53.729 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-04-26T18:46:53.729 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T18:46:53.729 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-04-26T18:46:53.729 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T18:46:53.729 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-04-26T18:46:53.729 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 238983, 2024-04-26T18:46:53.729 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 74, 2024-04-26T18:46:53.729 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-04-26T18:46:53.729 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-04-26T18:46:53.729 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-04-26T18:46:53.729 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-04-26T18:46:53.729 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-04-26T18:46:53.729 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-04-26T18:46:53.729 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-04-26T18:46:53.729 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-04-26T18:46:53.730 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 7936, 2024-04-26T18:46:53.730 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 165, 2024-04-26T18:46:53.730 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T18:46:53.730 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-04-26T18:46:53.730 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-04-26T18:46:53.730 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-04-26T18:46:53.730 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 51248, 2024-04-26T18:46:53.730 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 201, 2024-04-26T18:46:53.730 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-04-26T18:46:53.730 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-04-26T18:46:53.730 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-04-26T18:46:53.730 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-04-26T18:46:53.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.730 INFO:teuthology.orchestra.run.smithi082.stdout: "objecter": { 2024-04-26T18:46:53.730 INFO:teuthology.orchestra.run.smithi082.stdout: "op_active": 0, 2024-04-26T18:46:53.731 INFO:teuthology.orchestra.run.smithi082.stdout: "op_laggy": 0, 2024-04-26T18:46:53.731 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send": 41, 2024-04-26T18:46:53.731 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send_bytes": 11820, 2024-04-26T18:46:53.731 INFO:teuthology.orchestra.run.smithi082.stdout: "op_resend": 33, 2024-04-26T18:46:53.731 INFO:teuthology.orchestra.run.smithi082.stdout: "op_reply": 41, 2024-04-26T18:46:53.731 INFO:teuthology.orchestra.run.smithi082.stdout: "op_latency": { 2024-04-26T18:46:53.731 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 41, 2024-04-26T18:46:53.731 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.217995769, 2024-04-26T18:46:53.731 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.005316969 2024-04-26T18:46:53.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.731 INFO:teuthology.orchestra.run.smithi082.stdout: "op_inflight": 0, 2024-04-26T18:46:53.731 INFO:teuthology.orchestra.run.smithi082.stdout: "oplen_avg": { 2024-04-26T18:46:53.731 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 41, 2024-04-26T18:46:53.731 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 63 2024-04-26T18:46:53.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.732 INFO:teuthology.orchestra.run.smithi082.stdout: "op": 41, 2024-04-26T18:46:53.732 INFO:teuthology.orchestra.run.smithi082.stdout: "op_r": 0, 2024-04-26T18:46:53.732 INFO:teuthology.orchestra.run.smithi082.stdout: "op_w": 41, 2024-04-26T18:46:53.732 INFO:teuthology.orchestra.run.smithi082.stdout: "op_rmw": 0, 2024-04-26T18:46:53.732 INFO:teuthology.orchestra.run.smithi082.stdout: "op_pg": 0, 2024-04-26T18:46:53.732 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_stat": 0, 2024-04-26T18:46:53.732 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_create": 10, 2024-04-26T18:46:53.732 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_read": 0, 2024-04-26T18:46:53.732 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_write": 4, 2024-04-26T18:46:53.732 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writefull": 8, 2024-04-26T18:46:53.732 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writesame": 0, 2024-04-26T18:46:53.732 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_append": 0, 2024-04-26T18:46:53.732 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_zero": 0, 2024-04-26T18:46:53.732 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_truncate": 0, 2024-04-26T18:46:53.732 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_delete": 6, 2024-04-26T18:46:53.733 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_mapext": 0, 2024-04-26T18:46:53.733 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_sparse_read": 0, 2024-04-26T18:46:53.733 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_clonerange": 0, 2024-04-26T18:46:53.733 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_getxattr": 0, 2024-04-26T18:46:53.733 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_setxattr": 20, 2024-04-26T18:46:53.733 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_cmpxattr": 0, 2024-04-26T18:46:53.733 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_rmxattr": 0, 2024-04-26T18:46:53.733 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_resetxattrs": 0, 2024-04-26T18:46:53.733 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_call": 0, 2024-04-26T18:46:53.733 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_watch": 0, 2024-04-26T18:46:53.733 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_notify": 0, 2024-04-26T18:46:53.733 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T18:46:53.733 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls": 0, 2024-04-26T18:46:53.733 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls_filter": 0, 2024-04-26T18:46:53.733 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_other": 0, 2024-04-26T18:46:53.733 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_active": 0, 2024-04-26T18:46:53.734 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_send": 0, 2024-04-26T18:46:53.734 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_resend": 0, 2024-04-26T18:46:53.734 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_ping": 0, 2024-04-26T18:46:53.734 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_active": 0, 2024-04-26T18:46:53.734 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_send": 0, 2024-04-26T18:46:53.734 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_resend": 0, 2024-04-26T18:46:53.734 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_active": 0, 2024-04-26T18:46:53.734 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_send": 0, 2024-04-26T18:46:53.734 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_resend": 0, 2024-04-26T18:46:53.734 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_active": 0, 2024-04-26T18:46:53.734 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_send": 0, 2024-04-26T18:46:53.734 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_resend": 0, 2024-04-26T18:46:53.734 INFO:teuthology.orchestra.run.smithi082.stdout: "command_active": 0, 2024-04-26T18:46:53.734 INFO:teuthology.orchestra.run.smithi082.stdout: "command_send": 0, 2024-04-26T18:46:53.734 INFO:teuthology.orchestra.run.smithi082.stdout: "command_resend": 0, 2024-04-26T18:46:53.735 INFO:teuthology.orchestra.run.smithi082.stdout: "map_epoch": 101, 2024-04-26T18:46:53.735 INFO:teuthology.orchestra.run.smithi082.stdout: "map_full": 0, 2024-04-26T18:46:53.735 INFO:teuthology.orchestra.run.smithi082.stdout: "map_inc": 12, 2024-04-26T18:46:53.735 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_sessions": 8, 2024-04-26T18:46:53.735 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_open": 8, 2024-04-26T18:46:53.735 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_close": 0, 2024-04-26T18:46:53.735 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_laggy": 0, 2024-04-26T18:46:53.735 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_wr": 14, 2024-04-26T18:46:53.735 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_rd": 0, 2024-04-26T18:46:53.735 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_del": 1 2024-04-26T18:46:53.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.735 INFO:teuthology.orchestra.run.smithi082.stdout: "oft": { 2024-04-26T18:46:53.735 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_objs": 1, 2024-04-26T18:46:53.735 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_kv_pairs": 0, 2024-04-26T18:46:53.735 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_updates": 0, 2024-04-26T18:46:53.736 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_removes": 0 2024-04-26T18:46:53.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.736 INFO:teuthology.orchestra.run.smithi082.stdout: "osd-slow-ops": { 2024-04-26T18:46:53.736 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_ops_count": 4 2024-04-26T18:46:53.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.736 INFO:teuthology.orchestra.run.smithi082.stdout: "purge_queue": { 2024-04-26T18:46:53.736 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops": 0, 2024-04-26T18:46:53.736 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops_high_water": 0, 2024-04-26T18:46:53.736 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing": 0, 2024-04-26T18:46:53.736 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_high_water": 0, 2024-04-26T18:46:53.736 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed_ops": 0, 2024-04-26T18:46:53.736 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed": 0, 2024-04-26T18:46:53.736 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_item_in_journal": 0 2024-04-26T18:46:53.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.737 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T18:46:53.737 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T18:46:53.737 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-04-26T18:46:53.737 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T18:46:53.737 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 628, 2024-04-26T18:46:53.737 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 1686910, 2024-04-26T18:46:53.737 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:53.737 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 628, 2024-04-26T18:46:53.737 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-26T18:46:53.737 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-26T18:46:53.737 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 628, 2024-04-26T18:46:53.737 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 1686910, 2024-04-26T18:46:53.737 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T18:46:53.737 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.737 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.738 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.738 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:53.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.738 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_bytes": { 2024-04-26T18:46:53.738 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T18:46:53.738 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-04-26T18:46:53.738 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T18:46:53.738 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-26T18:46:53.738 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-26T18:46:53.738 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:53.738 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-26T18:46:53.738 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 41, 2024-04-26T18:46:53.738 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 11820, 2024-04-26T18:46:53.738 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 41, 2024-04-26T18:46:53.739 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 11820, 2024-04-26T18:46:53.739 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T18:46:53.739 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.739 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.739 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.739 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:53.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.739 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_ops": { 2024-04-26T18:46:53.739 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T18:46:53.739 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 1024, 2024-04-26T18:46:53.739 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T18:46:53.739 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-26T18:46:53.739 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-26T18:46:53.739 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:53.739 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-26T18:46:53.740 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 41, 2024-04-26T18:46:53.740 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 41, 2024-04-26T18:46:53.740 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 41, 2024-04-26T18:46:53.740 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 41, 2024-04-26T18:46:53.740 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T18:46:53.740 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.740 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.740 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.740 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:53.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.740 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle": { 2024-04-26T18:46:53.740 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T18:46:53.740 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-04-26T18:46:53.740 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T18:46:53.740 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-26T18:46:53.741 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-26T18:46:53.741 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:53.741 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-26T18:46:53.741 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-26T18:46:53.741 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-26T18:46:53.741 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2024-04-26T18:46:53.741 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2024-04-26T18:46:53.741 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T18:46:53.741 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.741 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.741 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.741 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:53.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:53.741 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle-0x55798f7a8500": { 2024-04-26T18:46:53.741 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T18:46:53.742 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-04-26T18:46:53.742 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T18:46:53.742 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 5, 2024-04-26T18:46:53.742 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 1428, 2024-04-26T18:46:53.742 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:53.742 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 5, 2024-04-26T18:46:53.742 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-26T18:46:53.742 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-26T18:46:53.742 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 4, 2024-04-26T18:46:53.742 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 1428, 2024-04-26T18:46:53.742 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T18:46:53.742 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:53.742 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:53.742 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:53.743 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:53.743 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:53.743 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T18:46:53.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:53 smithi080 ceph-mon[29135]: pgmap v324: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:46:53.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:53 smithi192 ceph-mon[32842]: pgmap v324: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:46:54.532 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-04-26T18:46:54.532 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-04-26T18:46:54.532 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2024-04-26T18:46:54.532 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-04-26T18:46:54.532 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-04-26T18:46:54.532 DEBUG:tasks.check_counter:Getting stats from k 2024-04-26T18:46:54.533 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph daemon mds.k perf dump 2024-04-26T18:46:54.774 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T18:46:55.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:55 smithi082 ceph-mon[32808]: pgmap v325: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:46:55.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:55 smithi080 ceph-mon[29135]: pgmap v325: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:46:55.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:55 smithi192 ceph-mon[32842]: pgmap v325: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-26T18:46:56.489 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T18:46:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T18:46:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 268, 2024-04-26T18:46:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 253, 2024-04-26T18:46:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 1646466, 2024-04-26T18:46:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 147972, 2024-04-26T18:46:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 5, 2024-04-26T18:46:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 1, 2024-04-26T18:46:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.049974309, 2024-04-26T18:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.015191549, 2024-04-26T18:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.037897478, 2024-04-26T18:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.006022129, 2024-04-26T18:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 252, 2024-04-26T18:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.012771568, 2024-04-26T18:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000050680 2024-04-26T18:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 1645632, 2024-04-26T18:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 147648 2024-04-26T18:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T18:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 632, 2024-04-26T18:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 810, 2024-04-26T18:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 155322, 2024-04-26T18:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 667865, 2024-04-26T18:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 7, 2024-04-26T18:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 5, 2024-04-26T18:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.069368396, 2024-04-26T18:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.025543425, 2024-04-26T18:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.014441260, 2024-04-26T18:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.021656843, 2024-04-26T18:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 807, 2024-04-26T18:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.046037354, 2024-04-26T18:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000057047 2024-04-26T18:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-26T18:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 467520 2024-04-26T18:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T18:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 1634, 2024-04-26T18:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 1634, 2024-04-26T18:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 491571, 2024-04-26T18:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 518846, 2024-04-26T18:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2024-04-26T18:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 3, 2024-04-26T18:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.163680322, 2024-04-26T18:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.059515815, 2024-04-26T18:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.040025632, 2024-04-26T18:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.049110355, 2024-04-26T18:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1633, 2024-04-26T18:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.067100254, 2024-04-26T18:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000041090 2024-04-26T18:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-04-26T18:46:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 448 2024-04-26T18:46:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-04-26T18:46:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 1, 2024-04-26T18:46:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-04-26T18:46:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-MDSRank": { 2024-04-26T18:46:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-04-26T18:46:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-04-26T18:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 3809, 2024-04-26T18:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.107710197, 2024-04-26T18:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000028277 2024-04-26T18:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-PurgeQueue": { 2024-04-26T18:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-04-26T18:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-04-26T18:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-26T18:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "request": 0, 2024-04-26T18:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "reply": 0, 2024-04-26T18:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "reply_latency": { 2024-04-26T18:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_reply": 0, 2024-04-26T18:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "forward": 0, 2024-04-26T18:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_complete": 0, 2024-04-26T18:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_keys": 0, 2024-04-26T18:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_commit": 0, 2024-04-26T18:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_split": 0, 2024-04-26T18:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_merge": 0, 2024-04-26T18:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes": 0, 2024-04-26T18:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_top": 0, 2024-04-26T18:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_bottom": 0, 2024-04-26T18:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pin_tail": 0, 2024-04-26T18:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pinned": 0, 2024-04-26T18:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_expired": 0, 2024-04-26T18:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_with_caps": 0, 2024-04-26T18:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": 0, 2024-04-26T18:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "subtrees": 1, 2024-04-26T18:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse": 0, 2024-04-26T18:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_hit": 0, 2024-04-26T18:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_forward": 0, 2024-04-26T18:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_discover": 0, 2024-04-26T18:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_dir_fetch": 0, 2024-04-26T18:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_remote_ino": 0, 2024-04-26T18:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_lock": 0, 2024-04-26T18:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "load_cent": 0, 2024-04-26T18:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "q": 0, 2024-04-26T18:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "exported": 0, 2024-04-26T18:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "exported_inodes": 0, 2024-04-26T18:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "imported": 0, 2024-04-26T18:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "imported_inodes": 0, 2024-04-26T18:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_dir_fetch": 0, 2024-04-26T18:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_backtrace_fetch": 0, 2024-04-26T18:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_peer_discover": 0, 2024-04-26T18:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rfiles": 0, 2024-04-26T18:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rbytes": 0, 2024-04-26T18:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rsnaps": 0, 2024-04-26T18:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T18:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_set_tag": 0, 2024-04-26T18:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T18:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_inotable_repaired": 0, 2024-04-26T18:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_inodes": 0, 2024-04-26T18:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T18:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T18:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_file_inodes": 0, 2024-04-26T18:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_inode_file_caps": 0, 2024-04-26T18:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_revoke": 0, 2024-04-26T18:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_grant": 0, 2024-04-26T18:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T18:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T18:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T18:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps": 0, 2024-04-26T18:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps_dirty": 0, 2024-04-26T18:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_cap_release": 0, 2024-04-26T18:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "process_request_cap_release": 0 2024-04-26T18:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_cache": { 2024-04-26T18:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update": 0, 2024-04-26T18:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update_receipt": 0, 2024-04-26T18:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_try_discover": 0, 2024-04-26T18:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_send_discover": 0, 2024-04-26T18:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_handle_discover": 0, 2024-04-26T18:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays": 0, 2024-04-26T18:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_delayed": 0, 2024-04-26T18:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_enqueuing": 0, 2024-04-26T18:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_created": 0, 2024-04-26T18:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_enqueued": 0, 2024-04-26T18:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_reintegrated": 0, 2024-04-26T18:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_migrated": 0, 2024-04-26T18:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_processing": 0, 2024-04-26T18:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_enqueued": 0, 2024-04-26T18:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_prioritized": 0, 2024-04-26T18:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_started": 0, 2024-04-26T18:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_completed": 0, 2024-04-26T18:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_path": 0, 2024-04-26T18:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_inode": 0, 2024-04-26T18:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T18:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_exportdir": 0, 2024-04-26T18:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_flush": 0, 2024-04-26T18:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragmentdir": 0, 2024-04-26T18:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragstats": 0, 2024-04-26T18:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_inodestats": 0 2024-04-26T18:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_log": { 2024-04-26T18:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "evlrg": 0, 2024-04-26T18:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "evadd": 0, 2024-04-26T18:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "evex": 0, 2024-04-26T18:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "evtrm": 0, 2024-04-26T18:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "ev": 5, 2024-04-26T18:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "evexg": 0, 2024-04-26T18:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "evexd": 0, 2024-04-26T18:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "segadd": 0, 2024-04-26T18:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "segex": 0, 2024-04-26T18:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "segtrm": 0, 2024-04-26T18:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "seg": 2, 2024-04-26T18:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "segmjr": 2, 2024-04-26T18:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "segexg": 0, 2024-04-26T18:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "segexd": 0, 2024-04-26T18:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "expos": 4194304, 2024-04-26T18:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "wrpos": 4195732, 2024-04-26T18:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "rdpos": 4195591, 2024-04-26T18:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "jlat": { 2024-04-26T18:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "replayed": 5 2024-04-26T18:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_mem": { 2024-04-26T18:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3, 2024-04-26T18:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "ino+": 3, 2024-04-26T18:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "ino-": 0, 2024-04-26T18:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "dir": 1, 2024-04-26T18:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "dir+": 1, 2024-04-26T18:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "dir-": 0, 2024-04-26T18:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "dn": 0, 2024-04-26T18:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "dn+": 0, 2024-04-26T18:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "dn-": 0, 2024-04-26T18:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "cap": 0, 2024-04-26T18:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "cap+": 0, 2024-04-26T18:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "cap-": 0, 2024-04-26T18:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "rss": 49800, 2024-04-26T18:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "heap": 215416 2024-04-26T18:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_server": { 2024-04-26T18:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_client_request": 0, 2024-04-26T18:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_server_request": 0, 2024-04-26T18:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_request": 0, 2024-04-26T18:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_session": 0, 2024-04-26T18:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_peer_request": 0, 2024-04-26T18:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "req_create_latency": { 2024-04-26T18:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getattr_latency": { 2024-04-26T18:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getfilelock_latency": { 2024-04-26T18:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "req_link_latency": { 2024-04-26T18:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookup_latency": { 2024-04-26T18:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookuphash_latency": { 2024-04-26T18:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupino_latency": { 2024-04-26T18:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupname_latency": { 2024-04-26T18:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupparent_latency": { 2024-04-26T18:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupsnap_latency": { 2024-04-26T18:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lssnap_latency": { 2024-04-26T18:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mkdir_latency": { 2024-04-26T18:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mknod_latency": { 2024-04-26T18:46:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mksnap_latency": { 2024-04-26T18:46:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "req_open_latency": { 2024-04-26T18:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "req_readdir_latency": { 2024-04-26T18:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rename_latency": { 2024-04-26T18:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "req_renamesnap_latency": { 2024-04-26T18:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "req_snapdiff_latency": { 2024-04-26T18:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmdir_latency": { 2024-04-26T18:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmsnap_latency": { 2024-04-26T18:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmxattr_latency": { 2024-04-26T18:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setattr_latency": { 2024-04-26T18:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setdirlayout_latency": { 2024-04-26T18:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setfilelock_latency": { 2024-04-26T18:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setlayout_latency": { 2024-04-26T18:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setxattr_latency": { 2024-04-26T18:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "req_symlink_latency": { 2024-04-26T18:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "req_unlink_latency": { 2024-04-26T18:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_revoke_eviction": 0, 2024-04-26T18:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_acquisition_throttle": 0, 2024-04-26T18:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getvxattr_latency": { 2024-04-26T18:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_sessions": { 2024-04-26T18:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "session_count": 1, 2024-04-26T18:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "session_add": 2, 2024-04-26T18:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "session_remove": 1, 2024-04-26T18:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_open": 2, 2024-04-26T18:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_stale": 0, 2024-04-26T18:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "total_load": 0, 2024-04-26T18:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "average_load": 0, 2024-04-26T18:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "avg_session_uptime": 2983, 2024-04-26T18:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "mdthresh_evicted": 0 2024-04-26T18:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-04-26T18:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-04-26T18:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-04-26T18:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T18:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-04-26T18:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T18:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-04-26T18:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T18:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T18:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T18:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T18:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T18:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-04-26T18:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T18:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T18:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-04-26T18:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-04-26T18:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-04-26T18:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-04-26T18:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T18:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T18:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T18:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T18:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T18:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-04-26T18:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-04-26T18:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-04-26T18:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T18:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T18:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-04-26T18:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-04-26T18:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-04-26T18:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-04-26T18:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T18:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-04-26T18:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T18:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-04-26T18:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 190177, 2024-04-26T18:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 53, 2024-04-26T18:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-04-26T18:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-04-26T18:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-04-26T18:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-04-26T18:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-04-26T18:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-04-26T18:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-04-26T18:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-04-26T18:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 7936, 2024-04-26T18:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 165, 2024-04-26T18:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T18:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-04-26T18:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-04-26T18:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-04-26T18:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 8512, 2024-04-26T18:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 13, 2024-04-26T18:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-04-26T18:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-04-26T18:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-04-26T18:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-04-26T18:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "objecter": { 2024-04-26T18:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "op_active": 0, 2024-04-26T18:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "op_laggy": 0, 2024-04-26T18:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send": 2261, 2024-04-26T18:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send_bytes": 21, 2024-04-26T18:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "op_resend": 3, 2024-04-26T18:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "op_reply": 2261, 2024-04-26T18:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "op_latency": { 2024-04-26T18:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2261, 2024-04-26T18:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 1.042979597, 2024-04-26T18:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000461291 2024-04-26T18:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "op_inflight": 0, 2024-04-26T18:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "oplen_avg": { 2024-04-26T18:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2261, 2024-04-26T18:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 2262 2024-04-26T18:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "op": 2261, 2024-04-26T18:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "op_r": 2261, 2024-04-26T18:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "op_w": 0, 2024-04-26T18:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "op_rmw": 0, 2024-04-26T18:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "op_pg": 0, 2024-04-26T18:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_stat": 1440, 2024-04-26T18:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_create": 0, 2024-04-26T18:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_read": 819, 2024-04-26T18:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_write": 0, 2024-04-26T18:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writefull": 0, 2024-04-26T18:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writesame": 0, 2024-04-26T18:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_append": 0, 2024-04-26T18:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_zero": 0, 2024-04-26T18:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_truncate": 0, 2024-04-26T18:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_delete": 0, 2024-04-26T18:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_mapext": 0, 2024-04-26T18:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_sparse_read": 0, 2024-04-26T18:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_clonerange": 0, 2024-04-26T18:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_getxattr": 1, 2024-04-26T18:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_setxattr": 0, 2024-04-26T18:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_cmpxattr": 0, 2024-04-26T18:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_rmxattr": 0, 2024-04-26T18:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_resetxattrs": 0, 2024-04-26T18:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_call": 0, 2024-04-26T18:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_watch": 0, 2024-04-26T18:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_notify": 0, 2024-04-26T18:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T18:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls": 0, 2024-04-26T18:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls_filter": 0, 2024-04-26T18:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_other": 0, 2024-04-26T18:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_active": 0, 2024-04-26T18:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_send": 0, 2024-04-26T18:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_resend": 0, 2024-04-26T18:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_ping": 0, 2024-04-26T18:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_active": 0, 2024-04-26T18:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_send": 0, 2024-04-26T18:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_resend": 0, 2024-04-26T18:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_active": 0, 2024-04-26T18:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_send": 0, 2024-04-26T18:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_resend": 0, 2024-04-26T18:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_active": 0, 2024-04-26T18:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_send": 0, 2024-04-26T18:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_resend": 0, 2024-04-26T18:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "command_active": 0, 2024-04-26T18:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "command_send": 0, 2024-04-26T18:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "command_resend": 0, 2024-04-26T18:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "map_epoch": 101, 2024-04-26T18:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "map_full": 0, 2024-04-26T18:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "map_inc": 12, 2024-04-26T18:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_sessions": 5, 2024-04-26T18:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_open": 5, 2024-04-26T18:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_close": 0, 2024-04-26T18:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_laggy": 0, 2024-04-26T18:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_wr": 0, 2024-04-26T18:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_rd": 2, 2024-04-26T18:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_del": 0 2024-04-26T18:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "oft": { 2024-04-26T18:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_objs": 0, 2024-04-26T18:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_kv_pairs": 0, 2024-04-26T18:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_updates": 0, 2024-04-26T18:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_removes": 0 2024-04-26T18:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "osd-slow-ops": { 2024-04-26T18:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_ops_count": 0 2024-04-26T18:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "purge_queue": { 2024-04-26T18:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops": 0, 2024-04-26T18:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops_high_water": 0, 2024-04-26T18:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing": 0, 2024-04-26T18:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_high_water": 0, 2024-04-26T18:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed_ops": 0, 2024-04-26T18:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed": 0, 2024-04-26T18:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_item_in_journal": 0 2024-04-26T18:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T18:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T18:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-04-26T18:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T18:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 2530, 2024-04-26T18:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 2048989, 2024-04-26T18:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 2530, 2024-04-26T18:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-26T18:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-26T18:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2530, 2024-04-26T18:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 2048989, 2024-04-26T18:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T18:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_bytes": { 2024-04-26T18:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T18:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-04-26T18:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T18:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-26T18:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-26T18:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-26T18:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 2261, 2024-04-26T18:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 1433, 2024-04-26T18:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2261, 2024-04-26T18:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 1433, 2024-04-26T18:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T18:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_ops": { 2024-04-26T18:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T18:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 1024, 2024-04-26T18:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T18:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-26T18:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-26T18:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-26T18:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 2261, 2024-04-26T18:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 2261, 2024-04-26T18:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2261, 2024-04-26T18:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 2261, 2024-04-26T18:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T18:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle": { 2024-04-26T18:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T18:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-04-26T18:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T18:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-26T18:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-26T18:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-26T18:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-26T18:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-26T18:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2024-04-26T18:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2024-04-26T18:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T18:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T18:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle-0x55f4bbe246e0": { 2024-04-26T18:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T18:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-04-26T18:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T18:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-26T18:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-26T18:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-26T18:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-26T18:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-26T18:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2024-04-26T18:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2024-04-26T18:46:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T18:46:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T18:46:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T18:46:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T18:46:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T18:46:56.533 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T18:46:57.415 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-04-26T18:46:57.415 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-04-26T18:46:57.415 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-04-26T18:46:57.416 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-04-26T18:46:57.416 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-04-26T18:46:57.416 DEBUG:tasks.check_counter:Getting stats from c 2024-04-26T18:46:57.416 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph daemon mds.c perf dump 2024-04-26T18:46:57.667 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T18:46:57.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:57 smithi082 ceph-mon[32808]: pgmap v326: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:46:57.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:57 smithi080 ceph-mon[29135]: pgmap v326: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:46:57.788 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:57 smithi192 ceph-mon[32842]: pgmap v326: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:46:59.710 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:46:59 smithi192 ceph-mon[32842]: pgmap v327: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:46:59.711 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-04-26T18:46:59.711 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T18:46:59.711 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 33, 2024-04-26T18:46:59.711 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 49, 2024-04-26T18:46:59.711 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 7567, 2024-04-26T18:46:59.711 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 86054, 2024-04-26T18:46:59.711 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 14, 2024-04-26T18:46:59.711 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 6, 2024-04-26T18:46:59.711 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.008231497, 2024-04-26T18:46:59.712 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.001316636, 2024-04-26T18:46:59.712 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.004957528, 2024-04-26T18:46:59.712 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.000378878, 2024-04-26T18:46:59.712 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:59.712 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 47, 2024-04-26T18:46:59.712 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.016115536, 2024-04-26T18:46:59.712 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000342883 2024-04-26T18:46:59.712 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.712 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:59.712 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 36, 2024-04-26T18:46:59.712 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000007532, 2024-04-26T18:46:59.712 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000209 2024-04-26T18:46:59.712 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.712 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-04-26T18:46:59.712 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 5152 2024-04-26T18:46:59.713 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.713 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T18:46:59.713 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 305, 2024-04-26T18:46:59.713 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 287, 2024-04-26T18:46:59.713 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 1662507, 2024-04-26T18:46:59.713 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 155559, 2024-04-26T18:46:59.713 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 5, 2024-04-26T18:46:59.713 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 4, 2024-04-26T18:46:59.713 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.054157829, 2024-04-26T18:46:59.713 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.015715793, 2024-04-26T18:46:59.713 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.043112490, 2024-04-26T18:46:59.713 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.006203861, 2024-04-26T18:46:59.713 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:59.713 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 286, 2024-04-26T18:46:59.713 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.027371107, 2024-04-26T18:46:59.713 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000095703 2024-04-26T18:46:59.714 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.714 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:59.714 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.714 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.714 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.714 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.714 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 1659216, 2024-04-26T18:46:59.714 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 149888 2024-04-26T18:46:59.714 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.714 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T18:46:59.714 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 289, 2024-04-26T18:46:59.714 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 674, 2024-04-26T18:46:59.714 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 86763, 2024-04-26T18:46:59.715 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 660375, 2024-04-26T18:46:59.715 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 8, 2024-04-26T18:46:59.715 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 5, 2024-04-26T18:46:59.715 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.059915140, 2024-04-26T18:46:59.715 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.027998471, 2024-04-26T18:46:59.715 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.021360782, 2024-04-26T18:46:59.715 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.004877312, 2024-04-26T18:46:59.715 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:46:59.715 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 672, 2024-04-26T18:46:59.715 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.046689880, 2024-04-26T18:46:59.715 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000069478 2024-04-26T18:46:59.715 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.715 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:46:59.715 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 748, 2024-04-26T18:46:59.715 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000221761, 2024-04-26T18:46:59.715 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000296 2024-04-26T18:46:59.716 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.716 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-04-26T18:46:59.716 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 469056 2024-04-26T18:46:59.716 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.716 INFO:teuthology.orchestra.run.smithi192.stdout: "cct": { 2024-04-26T18:46:59.716 INFO:teuthology.orchestra.run.smithi192.stdout: "total_workers": 1, 2024-04-26T18:46:59.716 INFO:teuthology.orchestra.run.smithi192.stdout: "unhealthy_workers": 0 2024-04-26T18:46:59.716 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.716 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-MDSRank": { 2024-04-26T18:46:59.716 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-04-26T18:46:59.716 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-04-26T18:46:59.716 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 35, 2024-04-26T18:46:59.716 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.002577488, 2024-04-26T18:46:59.716 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000073642 2024-04-26T18:46:59.716 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:46:59.716 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.717 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-PurgeQueue": { 2024-04-26T18:46:59.717 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-04-26T18:46:59.717 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-04-26T18:46:59.717 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2, 2024-04-26T18:46:59.717 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000006637, 2024-04-26T18:46:59.717 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000003318 2024-04-26T18:46:59.717 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:46:59.717 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.717 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": { 2024-04-26T18:46:59.717 INFO:teuthology.orchestra.run.smithi192.stdout: "request": 0, 2024-04-26T18:46:59.717 INFO:teuthology.orchestra.run.smithi192.stdout: "reply": 0, 2024-04-26T18:46:59.717 INFO:teuthology.orchestra.run.smithi192.stdout: "reply_latency": { 2024-04-26T18:46:59.717 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.717 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.717 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.718 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.718 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_reply": 0, 2024-04-26T18:46:59.718 INFO:teuthology.orchestra.run.smithi192.stdout: "forward": 0, 2024-04-26T18:46:59.718 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_complete": 0, 2024-04-26T18:46:59.718 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_keys": 0, 2024-04-26T18:46:59.718 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_commit": 11, 2024-04-26T18:46:59.718 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_split": 0, 2024-04-26T18:46:59.718 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_merge": 0, 2024-04-26T18:46:59.718 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes": 10, 2024-04-26T18:46:59.718 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_top": 0, 2024-04-26T18:46:59.718 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_bottom": 10, 2024-04-26T18:46:59.718 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pin_tail": 0, 2024-04-26T18:46:59.718 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pinned": 10, 2024-04-26T18:46:59.718 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_expired": 0, 2024-04-26T18:46:59.719 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_with_caps": 0, 2024-04-26T18:46:59.719 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": 0, 2024-04-26T18:46:59.719 INFO:teuthology.orchestra.run.smithi192.stdout: "subtrees": 1, 2024-04-26T18:46:59.719 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse": 4, 2024-04-26T18:46:59.719 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_hit": 4, 2024-04-26T18:46:59.719 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_forward": 0, 2024-04-26T18:46:59.719 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_discover": 0, 2024-04-26T18:46:59.719 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_dir_fetch": 0, 2024-04-26T18:46:59.719 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_remote_ino": 0, 2024-04-26T18:46:59.719 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_lock": 0, 2024-04-26T18:46:59.719 INFO:teuthology.orchestra.run.smithi192.stdout: "load_cent": 0, 2024-04-26T18:46:59.719 INFO:teuthology.orchestra.run.smithi192.stdout: "q": 0, 2024-04-26T18:46:59.719 INFO:teuthology.orchestra.run.smithi192.stdout: "exported": 0, 2024-04-26T18:46:59.719 INFO:teuthology.orchestra.run.smithi192.stdout: "exported_inodes": 0, 2024-04-26T18:46:59.719 INFO:teuthology.orchestra.run.smithi192.stdout: "imported": 0, 2024-04-26T18:46:59.720 INFO:teuthology.orchestra.run.smithi192.stdout: "imported_inodes": 0, 2024-04-26T18:46:59.720 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_dir_fetch": 0, 2024-04-26T18:46:59.720 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_backtrace_fetch": 0, 2024-04-26T18:46:59.720 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_peer_discover": 0, 2024-04-26T18:46:59.720 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rfiles": 4, 2024-04-26T18:46:59.720 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rbytes": 234, 2024-04-26T18:46:59.720 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rsnaps": 0, 2024-04-26T18:46:59.720 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T18:46:59.720 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_set_tag": 0, 2024-04-26T18:46:59.720 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T18:46:59.720 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_inotable_repaired": 0, 2024-04-26T18:46:59.720 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_inodes": 0, 2024-04-26T18:46:59.720 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T18:46:59.720 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T18:46:59.720 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_file_inodes": 0, 2024-04-26T18:46:59.720 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_inode_file_caps": 0, 2024-04-26T18:46:59.721 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_revoke": 0, 2024-04-26T18:46:59.721 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_grant": 0, 2024-04-26T18:46:59.721 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T18:46:59.721 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T18:46:59.721 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T18:46:59.721 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps": 0, 2024-04-26T18:46:59.721 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps_dirty": 0, 2024-04-26T18:46:59.721 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_cap_release": 0, 2024-04-26T18:46:59.721 INFO:teuthology.orchestra.run.smithi192.stdout: "process_request_cap_release": 0 2024-04-26T18:46:59.721 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.721 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_cache": { 2024-04-26T18:46:59.721 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update": 0, 2024-04-26T18:46:59.721 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update_receipt": 0, 2024-04-26T18:46:59.721 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_try_discover": 0, 2024-04-26T18:46:59.721 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_send_discover": 1, 2024-04-26T18:46:59.722 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_handle_discover": 0, 2024-04-26T18:46:59.722 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays": 0, 2024-04-26T18:46:59.722 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_delayed": 0, 2024-04-26T18:46:59.722 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_enqueuing": 0, 2024-04-26T18:46:59.722 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_created": 0, 2024-04-26T18:46:59.722 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_enqueued": 0, 2024-04-26T18:46:59.722 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_reintegrated": 0, 2024-04-26T18:46:59.722 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_migrated": 0, 2024-04-26T18:46:59.722 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_processing": 0, 2024-04-26T18:46:59.722 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_enqueued": 0, 2024-04-26T18:46:59.722 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_prioritized": 0, 2024-04-26T18:46:59.722 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_started": 0, 2024-04-26T18:46:59.722 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_completed": 0, 2024-04-26T18:46:59.722 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_path": 2, 2024-04-26T18:46:59.723 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_inode": 2, 2024-04-26T18:46:59.723 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T18:46:59.723 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_exportdir": 0, 2024-04-26T18:46:59.723 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_flush": 0, 2024-04-26T18:46:59.723 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragmentdir": 0, 2024-04-26T18:46:59.723 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragstats": 0, 2024-04-26T18:46:59.723 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_inodestats": 0 2024-04-26T18:46:59.723 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.723 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_log": { 2024-04-26T18:46:59.723 INFO:teuthology.orchestra.run.smithi192.stdout: "evlrg": 0, 2024-04-26T18:46:59.723 INFO:teuthology.orchestra.run.smithi192.stdout: "evadd": 3, 2024-04-26T18:46:59.723 INFO:teuthology.orchestra.run.smithi192.stdout: "evex": 0, 2024-04-26T18:46:59.723 INFO:teuthology.orchestra.run.smithi192.stdout: "evtrm": 0, 2024-04-26T18:46:59.723 INFO:teuthology.orchestra.run.smithi192.stdout: "ev": 3, 2024-04-26T18:46:59.723 INFO:teuthology.orchestra.run.smithi192.stdout: "evexg": 0, 2024-04-26T18:46:59.724 INFO:teuthology.orchestra.run.smithi192.stdout: "evexd": 0, 2024-04-26T18:46:59.724 INFO:teuthology.orchestra.run.smithi192.stdout: "segadd": 2, 2024-04-26T18:46:59.724 INFO:teuthology.orchestra.run.smithi192.stdout: "segex": 0, 2024-04-26T18:46:59.724 INFO:teuthology.orchestra.run.smithi192.stdout: "segtrm": 0, 2024-04-26T18:46:59.724 INFO:teuthology.orchestra.run.smithi192.stdout: "seg": 2, 2024-04-26T18:46:59.724 INFO:teuthology.orchestra.run.smithi192.stdout: "segmjr": 2, 2024-04-26T18:46:59.724 INFO:teuthology.orchestra.run.smithi192.stdout: "segexg": 0, 2024-04-26T18:46:59.724 INFO:teuthology.orchestra.run.smithi192.stdout: "segexd": 0, 2024-04-26T18:46:59.724 INFO:teuthology.orchestra.run.smithi192.stdout: "expos": 4194304, 2024-04-26T18:46:59.724 INFO:teuthology.orchestra.run.smithi192.stdout: "wrpos": 4195283, 2024-04-26T18:46:59.724 INFO:teuthology.orchestra.run.smithi192.stdout: "rdpos": 0, 2024-04-26T18:46:59.724 INFO:teuthology.orchestra.run.smithi192.stdout: "jlat": { 2024-04-26T18:46:59.724 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2, 2024-04-26T18:46:59.724 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.003288757, 2024-04-26T18:46:59.724 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001644378 2024-04-26T18:46:59.725 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.725 INFO:teuthology.orchestra.run.smithi192.stdout: "replayed": 0 2024-04-26T18:46:59.725 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.725 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_mem": { 2024-04-26T18:46:59.725 INFO:teuthology.orchestra.run.smithi192.stdout: "ino": 13, 2024-04-26T18:46:59.725 INFO:teuthology.orchestra.run.smithi192.stdout: "ino+": 13, 2024-04-26T18:46:59.725 INFO:teuthology.orchestra.run.smithi192.stdout: "ino-": 0, 2024-04-26T18:46:59.725 INFO:teuthology.orchestra.run.smithi192.stdout: "dir": 11, 2024-04-26T18:46:59.725 INFO:teuthology.orchestra.run.smithi192.stdout: "dir+": 12, 2024-04-26T18:46:59.725 INFO:teuthology.orchestra.run.smithi192.stdout: "dir-": 1, 2024-04-26T18:46:59.725 INFO:teuthology.orchestra.run.smithi192.stdout: "dn": 10, 2024-04-26T18:46:59.725 INFO:teuthology.orchestra.run.smithi192.stdout: "dn+": 10, 2024-04-26T18:46:59.725 INFO:teuthology.orchestra.run.smithi192.stdout: "dn-": 0, 2024-04-26T18:46:59.725 INFO:teuthology.orchestra.run.smithi192.stdout: "cap": 0, 2024-04-26T18:46:59.725 INFO:teuthology.orchestra.run.smithi192.stdout: "cap+": 0, 2024-04-26T18:46:59.726 INFO:teuthology.orchestra.run.smithi192.stdout: "cap-": 0, 2024-04-26T18:46:59.726 INFO:teuthology.orchestra.run.smithi192.stdout: "rss": 51368, 2024-04-26T18:46:59.726 INFO:teuthology.orchestra.run.smithi192.stdout: "heap": 223608 2024-04-26T18:46:59.726 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.726 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_server": { 2024-04-26T18:46:59.726 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_client_request": 0, 2024-04-26T18:46:59.726 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_server_request": 0, 2024-04-26T18:46:59.726 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_request": 0, 2024-04-26T18:46:59.726 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_session": 8, 2024-04-26T18:46:59.726 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_peer_request": 2, 2024-04-26T18:46:59.726 INFO:teuthology.orchestra.run.smithi192.stdout: "req_create_latency": { 2024-04-26T18:46:59.726 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.726 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.726 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.726 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.727 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getattr_latency": { 2024-04-26T18:46:59.727 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.727 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.727 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.727 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.727 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getfilelock_latency": { 2024-04-26T18:46:59.727 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.727 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.727 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.727 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.727 INFO:teuthology.orchestra.run.smithi192.stdout: "req_link_latency": { 2024-04-26T18:46:59.727 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.727 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.727 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.727 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.728 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookup_latency": { 2024-04-26T18:46:59.728 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.728 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.728 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.728 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.728 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookuphash_latency": { 2024-04-26T18:46:59.728 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.728 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.728 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.728 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.728 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupino_latency": { 2024-04-26T18:46:59.728 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.728 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.728 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.728 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.728 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupname_latency": { 2024-04-26T18:46:59.729 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.729 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.729 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.729 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.729 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupparent_latency": { 2024-04-26T18:46:59.729 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.729 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.729 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.729 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.729 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupsnap_latency": { 2024-04-26T18:46:59.729 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.729 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.729 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.729 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.729 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lssnap_latency": { 2024-04-26T18:46:59.730 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.730 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.730 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.730 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.730 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mkdir_latency": { 2024-04-26T18:46:59.730 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.730 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:46:59 smithi082 ceph-mon[32808]: pgmap v327: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:46:59.731 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.731 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.731 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.731 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mknod_latency": { 2024-04-26T18:46:59.731 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.731 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.731 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.731 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.731 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mksnap_latency": { 2024-04-26T18:46:59.731 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.731 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.731 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.732 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.732 INFO:teuthology.orchestra.run.smithi192.stdout: "req_open_latency": { 2024-04-26T18:46:59.732 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.732 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.732 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.732 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.732 INFO:teuthology.orchestra.run.smithi192.stdout: "req_readdir_latency": { 2024-04-26T18:46:59.732 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.732 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.732 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.732 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.732 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rename_latency": { 2024-04-26T18:46:59.732 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.732 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.732 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.733 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.733 INFO:teuthology.orchestra.run.smithi192.stdout: "req_renamesnap_latency": { 2024-04-26T18:46:59.733 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.733 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.733 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.733 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.733 INFO:teuthology.orchestra.run.smithi192.stdout: "req_snapdiff_latency": { 2024-04-26T18:46:59.733 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.733 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.733 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.733 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.733 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmdir_latency": { 2024-04-26T18:46:59.733 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.733 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.733 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.733 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.734 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmsnap_latency": { 2024-04-26T18:46:59.734 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.734 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.734 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.734 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.734 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmxattr_latency": { 2024-04-26T18:46:59.734 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.734 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.734 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.734 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.734 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setattr_latency": { 2024-04-26T18:46:59.734 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.734 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.734 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.734 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.734 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setdirlayout_latency": { 2024-04-26T18:46:59.735 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.735 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.735 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.735 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.735 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setfilelock_latency": { 2024-04-26T18:46:59.735 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.735 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.735 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.735 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.735 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setlayout_latency": { 2024-04-26T18:46:59.735 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.735 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.735 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.735 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.736 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setxattr_latency": { 2024-04-26T18:46:59.736 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.736 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.736 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.736 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.736 INFO:teuthology.orchestra.run.smithi192.stdout: "req_symlink_latency": { 2024-04-26T18:46:59.736 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.736 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.736 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.736 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.736 INFO:teuthology.orchestra.run.smithi192.stdout: "req_unlink_latency": { 2024-04-26T18:46:59.736 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.736 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.736 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.736 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.736 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_revoke_eviction": 0, 2024-04-26T18:46:59.737 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_acquisition_throttle": 0, 2024-04-26T18:46:59.737 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getvxattr_latency": { 2024-04-26T18:46:59.737 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.737 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.737 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.737 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:46:59.737 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.737 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_sessions": { 2024-04-26T18:46:59.737 INFO:teuthology.orchestra.run.smithi192.stdout: "session_count": 1, 2024-04-26T18:46:59.737 INFO:teuthology.orchestra.run.smithi192.stdout: "session_add": 1, 2024-04-26T18:46:59.737 INFO:teuthology.orchestra.run.smithi192.stdout: "session_remove": 0, 2024-04-26T18:46:59.737 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_open": 1, 2024-04-26T18:46:59.737 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_stale": 0, 2024-04-26T18:46:59.737 INFO:teuthology.orchestra.run.smithi192.stdout: "total_load": 0, 2024-04-26T18:46:59.737 INFO:teuthology.orchestra.run.smithi192.stdout: "average_load": 0, 2024-04-26T18:46:59.737 INFO:teuthology.orchestra.run.smithi192.stdout: "avg_session_uptime": 594, 2024-04-26T18:46:59.738 INFO:teuthology.orchestra.run.smithi192.stdout: "mdthresh_evicted": 0 2024-04-26T18:46:59.738 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.738 INFO:teuthology.orchestra.run.smithi192.stdout: "mempool": { 2024-04-26T18:46:59.738 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_bytes": 0, 2024-04-26T18:46:59.738 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_items": 0, 2024-04-26T18:46:59.738 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T18:46:59.738 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_items": 0, 2024-04-26T18:46:59.738 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T18:46:59.738 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_items": 0, 2024-04-26T18:46:59.738 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T18:46:59.738 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T18:46:59.738 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T18:46:59.738 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T18:46:59.739 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T18:46:59.739 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_items": 0, 2024-04-26T18:46:59.739 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T18:46:59.739 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T18:46:59.739 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_bytes": 0, 2024-04-26T18:46:59.739 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_items": 0, 2024-04-26T18:46:59.739 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_bytes": 0, 2024-04-26T18:46:59.739 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_items": 0, 2024-04-26T18:46:59.739 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T18:46:59.739 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T18:46:59.739 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T18:46:59.739 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T18:46:59.739 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T18:46:59.739 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_items": 0, 2024-04-26T18:46:59.739 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_bytes": 0, 2024-04-26T18:46:59.739 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_items": 0, 2024-04-26T18:46:59.740 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T18:46:59.740 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T18:46:59.740 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_bytes": 0, 2024-04-26T18:46:59.740 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_items": 0, 2024-04-26T18:46:59.740 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_bytes": 0, 2024-04-26T18:46:59.740 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_items": 0, 2024-04-26T18:46:59.740 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T18:46:59.740 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_items": 0, 2024-04-26T18:46:59.740 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T18:46:59.740 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_items": 0, 2024-04-26T18:46:59.740 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_bytes": 231185, 2024-04-26T18:46:59.740 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_items": 78, 2024-04-26T18:46:59.740 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_bytes": 0, 2024-04-26T18:46:59.740 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_items": 0, 2024-04-26T18:46:59.741 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_bytes": 0, 2024-04-26T18:46:59.741 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_items": 0, 2024-04-26T18:46:59.741 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_bytes": 0, 2024-04-26T18:46:59.741 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_items": 0, 2024-04-26T18:46:59.741 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_bytes": 0, 2024-04-26T18:46:59.741 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_items": 0, 2024-04-26T18:46:59.741 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_bytes": 7936, 2024-04-26T18:46:59.741 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_items": 165, 2024-04-26T18:46:59.741 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T18:46:59.741 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_items": 0, 2024-04-26T18:46:59.741 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_bytes": 0, 2024-04-26T18:46:59.741 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_items": 0, 2024-04-26T18:46:59.741 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_bytes": 50880, 2024-04-26T18:46:59.741 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_items": 199, 2024-04-26T18:46:59.741 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_bytes": 0, 2024-04-26T18:46:59.742 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_items": 0, 2024-04-26T18:46:59.742 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_bytes": 0, 2024-04-26T18:46:59.742 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_items": 0 2024-04-26T18:46:59.742 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.742 INFO:teuthology.orchestra.run.smithi192.stdout: "objecter": { 2024-04-26T18:46:59.742 INFO:teuthology.orchestra.run.smithi192.stdout: "op_active": 0, 2024-04-26T18:46:59.742 INFO:teuthology.orchestra.run.smithi192.stdout: "op_laggy": 0, 2024-04-26T18:46:59.742 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send": 37, 2024-04-26T18:46:59.742 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send_bytes": 11191, 2024-04-26T18:46:59.742 INFO:teuthology.orchestra.run.smithi192.stdout: "op_resend": 29, 2024-04-26T18:46:59.742 INFO:teuthology.orchestra.run.smithi192.stdout: "op_reply": 37, 2024-04-26T18:46:59.742 INFO:teuthology.orchestra.run.smithi192.stdout: "op_latency": { 2024-04-26T18:46:59.742 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 37, 2024-04-26T18:46:59.742 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.186996367, 2024-04-26T18:46:59.742 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.005053955 2024-04-26T18:46:59.743 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.743 INFO:teuthology.orchestra.run.smithi192.stdout: "op_inflight": 0, 2024-04-26T18:46:59.743 INFO:teuthology.orchestra.run.smithi192.stdout: "oplen_avg": { 2024-04-26T18:46:59.743 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 37, 2024-04-26T18:46:59.743 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 59 2024-04-26T18:46:59.743 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.743 INFO:teuthology.orchestra.run.smithi192.stdout: "op": 37, 2024-04-26T18:46:59.743 INFO:teuthology.orchestra.run.smithi192.stdout: "op_r": 0, 2024-04-26T18:46:59.743 INFO:teuthology.orchestra.run.smithi192.stdout: "op_w": 37, 2024-04-26T18:46:59.743 INFO:teuthology.orchestra.run.smithi192.stdout: "op_rmw": 0, 2024-04-26T18:46:59.743 INFO:teuthology.orchestra.run.smithi192.stdout: "op_pg": 0, 2024-04-26T18:46:59.743 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_stat": 0, 2024-04-26T18:46:59.743 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_create": 10, 2024-04-26T18:46:59.743 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_read": 0, 2024-04-26T18:46:59.743 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_write": 2, 2024-04-26T18:46:59.744 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writefull": 6, 2024-04-26T18:46:59.744 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writesame": 0, 2024-04-26T18:46:59.744 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_append": 0, 2024-04-26T18:46:59.744 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_zero": 0, 2024-04-26T18:46:59.744 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_truncate": 0, 2024-04-26T18:46:59.744 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_delete": 6, 2024-04-26T18:46:59.744 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_mapext": 0, 2024-04-26T18:46:59.744 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_sparse_read": 0, 2024-04-26T18:46:59.744 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_clonerange": 0, 2024-04-26T18:46:59.744 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_getxattr": 0, 2024-04-26T18:46:59.744 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_setxattr": 20, 2024-04-26T18:46:59.744 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_cmpxattr": 0, 2024-04-26T18:46:59.744 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_rmxattr": 0, 2024-04-26T18:46:59.744 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_resetxattrs": 0, 2024-04-26T18:46:59.744 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_call": 0, 2024-04-26T18:46:59.745 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_watch": 0, 2024-04-26T18:46:59.745 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_notify": 0, 2024-04-26T18:46:59.745 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T18:46:59.745 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls": 0, 2024-04-26T18:46:59.745 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls_filter": 0, 2024-04-26T18:46:59.745 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_other": 0, 2024-04-26T18:46:59.745 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_active": 0, 2024-04-26T18:46:59.745 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_send": 0, 2024-04-26T18:46:59.745 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_resend": 0, 2024-04-26T18:46:59.745 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_ping": 0, 2024-04-26T18:46:59.745 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_active": 0, 2024-04-26T18:46:59.745 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_send": 0, 2024-04-26T18:46:59.745 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_resend": 0, 2024-04-26T18:46:59.745 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_active": 0, 2024-04-26T18:46:59.745 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_send": 0, 2024-04-26T18:46:59.746 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_resend": 0, 2024-04-26T18:46:59.746 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_active": 0, 2024-04-26T18:46:59.746 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_send": 0, 2024-04-26T18:46:59.746 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_resend": 0, 2024-04-26T18:46:59.746 INFO:teuthology.orchestra.run.smithi192.stdout: "command_active": 0, 2024-04-26T18:46:59.746 INFO:teuthology.orchestra.run.smithi192.stdout: "command_send": 0, 2024-04-26T18:46:59.746 INFO:teuthology.orchestra.run.smithi192.stdout: "command_resend": 0, 2024-04-26T18:46:59.746 INFO:teuthology.orchestra.run.smithi192.stdout: "map_epoch": 101, 2024-04-26T18:46:59.746 INFO:teuthology.orchestra.run.smithi192.stdout: "map_full": 0, 2024-04-26T18:46:59.746 INFO:teuthology.orchestra.run.smithi192.stdout: "map_inc": 12, 2024-04-26T18:46:59.746 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_sessions": 8, 2024-04-26T18:46:59.746 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_open": 8, 2024-04-26T18:46:59.746 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_close": 0, 2024-04-26T18:46:59.746 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_laggy": 0, 2024-04-26T18:46:59.746 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_wr": 14, 2024-04-26T18:46:59.747 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_rd": 0, 2024-04-26T18:46:59.747 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_del": 1 2024-04-26T18:46:59.747 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.747 INFO:teuthology.orchestra.run.smithi192.stdout: "oft": { 2024-04-26T18:46:59.747 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_objs": 1, 2024-04-26T18:46:59.747 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_kv_pairs": 0, 2024-04-26T18:46:59.747 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_updates": 0, 2024-04-26T18:46:59.747 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_removes": 0 2024-04-26T18:46:59.747 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.747 INFO:teuthology.orchestra.run.smithi192.stdout: "osd-slow-ops": { 2024-04-26T18:46:59.747 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_ops_count": 4 2024-04-26T18:46:59.747 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.747 INFO:teuthology.orchestra.run.smithi192.stdout: "purge_queue": { 2024-04-26T18:46:59.747 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops": 0, 2024-04-26T18:46:59.747 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops_high_water": 0, 2024-04-26T18:46:59.747 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing": 0, 2024-04-26T18:46:59.748 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_high_water": 0, 2024-04-26T18:46:59.748 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed_ops": 0, 2024-04-26T18:46:59.748 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed": 0, 2024-04-26T18:46:59.748 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_item_in_journal": 0 2024-04-26T18:46:59.748 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.748 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T18:46:59.748 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-04-26T18:46:59.748 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-04-26T18:46:59.748 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-04-26T18:46:59.748 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 623, 2024-04-26T18:46:59.748 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 1682581, 2024-04-26T18:46:59.748 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:59.748 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 623, 2024-04-26T18:46:59.748 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-04-26T18:46:59.748 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-04-26T18:46:59.749 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 623, 2024-04-26T18:46:59.749 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 1682581, 2024-04-26T18:46:59.749 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-04-26T18:46:59.749 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.749 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.749 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.749 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:46:59.749 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.749 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_bytes": { 2024-04-26T18:46:59.749 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-04-26T18:46:59.749 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-04-26T18:46:59.749 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-04-26T18:46:59.749 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-04-26T18:46:59.749 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-04-26T18:46:59.749 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:59.750 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-04-26T18:46:59.750 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 37, 2024-04-26T18:46:59.750 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 11191, 2024-04-26T18:46:59.750 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 37, 2024-04-26T18:46:59.750 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 11191, 2024-04-26T18:46:59.750 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-04-26T18:46:59.750 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.750 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.750 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.750 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:46:59.750 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.750 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_ops": { 2024-04-26T18:46:59.750 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-04-26T18:46:59.750 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 1024, 2024-04-26T18:46:59.750 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-04-26T18:46:59.751 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-04-26T18:46:59.751 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-04-26T18:46:59.751 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:59.751 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-04-26T18:46:59.751 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 37, 2024-04-26T18:46:59.751 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 37, 2024-04-26T18:46:59.751 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 37, 2024-04-26T18:46:59.751 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 37, 2024-04-26T18:46:59.751 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-04-26T18:46:59.751 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.751 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.751 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.751 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:46:59.751 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.752 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle": { 2024-04-26T18:46:59.752 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-04-26T18:46:59.752 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-04-26T18:46:59.752 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-04-26T18:46:59.752 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-04-26T18:46:59.752 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-04-26T18:46:59.752 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:59.752 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-04-26T18:46:59.752 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-04-26T18:46:59.752 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-04-26T18:46:59.752 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 0, 2024-04-26T18:46:59.752 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 0, 2024-04-26T18:46:59.752 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-04-26T18:46:59.752 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.753 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.753 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.753 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:46:59.753 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:46:59.753 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle-0x5590c0a5c500": { 2024-04-26T18:46:59.753 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-04-26T18:46:59.753 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-04-26T18:46:59.753 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-04-26T18:46:59.753 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 3, 2024-04-26T18:46:59.753 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 979, 2024-04-26T18:46:59.753 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-04-26T18:46:59.753 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 3, 2024-04-26T18:46:59.753 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-04-26T18:46:59.753 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-04-26T18:46:59.753 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 2, 2024-04-26T18:46:59.753 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 979, 2024-04-26T18:46:59.754 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-04-26T18:46:59.754 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:46:59.754 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:46:59.754 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:46:59.754 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:46:59.754 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:46:59.754 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-04-26T18:46:59.754 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:46:59 smithi080 ceph-mon[29135]: pgmap v327: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:47:00.524 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-04-26T18:47:00.524 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-04-26T18:47:00.524 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=0 2024-04-26T18:47:00.524 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-04-26T18:47:00.524 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-04-26T18:47:00.524 DEBUG:tasks.check_counter:Getting stats from f 2024-04-26T18:47:00.525 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph daemon mds.f perf dump 2024-04-26T18:47:00.776 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T18:47:01.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:01 smithi082 ceph-mon[32808]: pgmap v328: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2024-04-26T18:47:01.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:01 smithi080 ceph-mon[29135]: pgmap v328: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2024-04-26T18:47:01.767 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:01 smithi192 ceph-mon[32842]: pgmap v328: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2024-04-26T18:47:02.586 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-04-26T18:47:02.587 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T18:47:02.587 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 404, 2024-04-26T18:47:02.587 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 608, 2024-04-26T18:47:02.587 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 124421, 2024-04-26T18:47:02.587 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 360249, 2024-04-26T18:47:02.587 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 11, 2024-04-26T18:47:02.587 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 4, 2024-04-26T18:47:02.587 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.059187233, 2024-04-26T18:47:02.587 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.022809224, 2024-04-26T18:47:02.587 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.027069837, 2024-04-26T18:47:02.587 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.005475339, 2024-04-26T18:47:02.587 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:47:02.587 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 606, 2024-04-26T18:47:02.588 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.039170868, 2024-04-26T18:47:02.588 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000064638 2024-04-26T18:47:02.588 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.588 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:47:02.588 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 948, 2024-04-26T18:47:02.588 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000304744, 2024-04-26T18:47:02.588 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000321 2024-04-26T18:47:02.588 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.588 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 4048, 2024-04-26T18:47:02.588 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 12736 2024-04-26T18:47:02.588 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.588 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T18:47:02.588 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 36, 2024-04-26T18:47:02.589 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 122, 2024-04-26T18:47:02.589 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 8937, 2024-04-26T18:47:02.589 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 226002, 2024-04-26T18:47:02.589 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 14, 2024-04-26T18:47:02.589 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 4, 2024-04-26T18:47:02.589 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.018841219, 2024-04-26T18:47:02.589 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.006181868, 2024-04-26T18:47:02.589 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.010165606, 2024-04-26T18:47:02.589 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.000202525, 2024-04-26T18:47:02.589 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:47:02.589 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 119, 2024-04-26T18:47:02.589 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.012520003, 2024-04-26T18:47:02.589 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000105210 2024-04-26T18:47:02.589 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.590 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:47:02.590 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 76, 2024-04-26T18:47:02.590 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000014291, 2024-04-26T18:47:02.590 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000188 2024-04-26T18:47:02.590 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.590 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 5856, 2024-04-26T18:47:02.590 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 168672 2024-04-26T18:47:02.590 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.590 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T18:47:02.590 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 315, 2024-04-26T18:47:02.590 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 424, 2024-04-26T18:47:02.590 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 1661313, 2024-04-26T18:47:02.590 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 476139, 2024-04-26T18:47:02.590 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 6, 2024-04-26T18:47:02.591 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 5, 2024-04-26T18:47:02.591 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.062438964, 2024-04-26T18:47:02.591 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.020534003, 2024-04-26T18:47:02.591 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.044907045, 2024-04-26T18:47:02.591 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.006820698, 2024-04-26T18:47:02.591 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:47:02.591 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 424, 2024-04-26T18:47:02.591 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.048478249, 2024-04-26T18:47:02.591 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000114335 2024-04-26T18:47:02.591 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.591 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:47:02.591 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.591 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.591 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.592 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.592 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 1656064, 2024-04-26T18:47:02.592 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 466672 2024-04-26T18:47:02.592 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.592 INFO:teuthology.orchestra.run.smithi192.stdout: "cct": { 2024-04-26T18:47:02.592 INFO:teuthology.orchestra.run.smithi192.stdout: "total_workers": 1, 2024-04-26T18:47:02.592 INFO:teuthology.orchestra.run.smithi192.stdout: "unhealthy_workers": 0 2024-04-26T18:47:02.592 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.592 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-MDSRank": { 2024-04-26T18:47:02.592 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-04-26T18:47:02.592 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-04-26T18:47:02.592 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 45, 2024-04-26T18:47:02.592 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.002221286, 2024-04-26T18:47:02.592 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000049361 2024-04-26T18:47:02.593 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:02.593 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.593 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-PurgeQueue": { 2024-04-26T18:47:02.593 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-04-26T18:47:02.593 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-04-26T18:47:02.593 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2, 2024-04-26T18:47:02.593 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000007146, 2024-04-26T18:47:02.593 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000003573 2024-04-26T18:47:02.593 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:02.593 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.593 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": { 2024-04-26T18:47:02.593 INFO:teuthology.orchestra.run.smithi192.stdout: "request": 9, 2024-04-26T18:47:02.593 INFO:teuthology.orchestra.run.smithi192.stdout: "reply": 5, 2024-04-26T18:47:02.593 INFO:teuthology.orchestra.run.smithi192.stdout: "reply_latency": { 2024-04-26T18:47:02.593 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 5, 2024-04-26T18:47:02.594 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.001815291, 2024-04-26T18:47:02.594 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000363058 2024-04-26T18:47:02.594 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.594 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_reply": 0, 2024-04-26T18:47:02.594 INFO:teuthology.orchestra.run.smithi192.stdout: "forward": 4, 2024-04-26T18:47:02.594 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_complete": 0, 2024-04-26T18:47:02.594 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_keys": 0, 2024-04-26T18:47:02.594 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_commit": 11, 2024-04-26T18:47:02.594 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_split": 0, 2024-04-26T18:47:02.594 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_merge": 0, 2024-04-26T18:47:02.594 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes": 14, 2024-04-26T18:47:02.594 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_top": 0, 2024-04-26T18:47:02.594 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_bottom": 14, 2024-04-26T18:47:02.594 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pin_tail": 0, 2024-04-26T18:47:02.595 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pinned": 14, 2024-04-26T18:47:02.595 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_expired": 0, 2024-04-26T18:47:02.595 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_with_caps": 3, 2024-04-26T18:47:02.595 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": 3, 2024-04-26T18:47:02.595 INFO:teuthology.orchestra.run.smithi192.stdout: "subtrees": 2, 2024-04-26T18:47:02.595 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse": 14, 2024-04-26T18:47:02.595 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_hit": 11, 2024-04-26T18:47:02.595 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_forward": 0, 2024-04-26T18:47:02.595 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_discover": 1, 2024-04-26T18:47:02.595 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_dir_fetch": 0, 2024-04-26T18:47:02.596 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_remote_ino": 0, 2024-04-26T18:47:02.596 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_lock": 0, 2024-04-26T18:47:02.596 INFO:teuthology.orchestra.run.smithi192.stdout: "load_cent": 0, 2024-04-26T18:47:02.596 INFO:teuthology.orchestra.run.smithi192.stdout: "q": 0, 2024-04-26T18:47:02.596 INFO:teuthology.orchestra.run.smithi192.stdout: "exported": 0, 2024-04-26T18:47:02.596 INFO:teuthology.orchestra.run.smithi192.stdout: "exported_inodes": 0, 2024-04-26T18:47:02.596 INFO:teuthology.orchestra.run.smithi192.stdout: "imported": 0, 2024-04-26T18:47:02.596 INFO:teuthology.orchestra.run.smithi192.stdout: "imported_inodes": 0, 2024-04-26T18:47:02.596 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_dir_fetch": 0, 2024-04-26T18:47:02.596 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_backtrace_fetch": 0, 2024-04-26T18:47:02.596 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_peer_discover": 0, 2024-04-26T18:47:02.596 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rfiles": 4, 2024-04-26T18:47:02.596 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rbytes": 234, 2024-04-26T18:47:02.596 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rsnaps": 0, 2024-04-26T18:47:02.597 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T18:47:02.597 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_set_tag": 0, 2024-04-26T18:47:02.597 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T18:47:02.597 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_inotable_repaired": 0, 2024-04-26T18:47:02.597 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_inodes": 0, 2024-04-26T18:47:02.597 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T18:47:02.597 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T18:47:02.597 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_file_inodes": 0, 2024-04-26T18:47:02.597 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_inode_file_caps": 0, 2024-04-26T18:47:02.597 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_revoke": 6, 2024-04-26T18:47:02.597 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_grant": 5, 2024-04-26T18:47:02.597 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T18:47:02.597 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T18:47:02.597 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T18:47:02.597 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps": 7, 2024-04-26T18:47:02.598 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps_dirty": 0, 2024-04-26T18:47:02.598 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_cap_release": 0, 2024-04-26T18:47:02.598 INFO:teuthology.orchestra.run.smithi192.stdout: "process_request_cap_release": 1 2024-04-26T18:47:02.598 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.598 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_cache": { 2024-04-26T18:47:02.598 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update": 0, 2024-04-26T18:47:02.598 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update_receipt": 0, 2024-04-26T18:47:02.598 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_try_discover": 0, 2024-04-26T18:47:02.598 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_send_discover": 2, 2024-04-26T18:47:02.598 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_handle_discover": 0, 2024-04-26T18:47:02.598 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays": 0, 2024-04-26T18:47:02.598 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_delayed": 0, 2024-04-26T18:47:02.598 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_enqueuing": 0, 2024-04-26T18:47:02.598 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_created": 0, 2024-04-26T18:47:02.599 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_enqueued": 0, 2024-04-26T18:47:02.599 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_reintegrated": 0, 2024-04-26T18:47:02.599 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_migrated": 0, 2024-04-26T18:47:02.599 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_processing": 0, 2024-04-26T18:47:02.599 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_enqueued": 0, 2024-04-26T18:47:02.599 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_prioritized": 0, 2024-04-26T18:47:02.599 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_started": 0, 2024-04-26T18:47:02.599 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_completed": 0, 2024-04-26T18:47:02.599 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_path": 2, 2024-04-26T18:47:02.599 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_inode": 10, 2024-04-26T18:47:02.599 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T18:47:02.599 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_exportdir": 0, 2024-04-26T18:47:02.599 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_flush": 0, 2024-04-26T18:47:02.599 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragmentdir": 0, 2024-04-26T18:47:02.599 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragstats": 0, 2024-04-26T18:47:02.600 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_inodestats": 0 2024-04-26T18:47:02.600 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.600 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_log": { 2024-04-26T18:47:02.600 INFO:teuthology.orchestra.run.smithi192.stdout: "evlrg": 0, 2024-04-26T18:47:02.600 INFO:teuthology.orchestra.run.smithi192.stdout: "evadd": 6, 2024-04-26T18:47:02.600 INFO:teuthology.orchestra.run.smithi192.stdout: "evex": 0, 2024-04-26T18:47:02.600 INFO:teuthology.orchestra.run.smithi192.stdout: "evtrm": 0, 2024-04-26T18:47:02.600 INFO:teuthology.orchestra.run.smithi192.stdout: "ev": 6, 2024-04-26T18:47:02.600 INFO:teuthology.orchestra.run.smithi192.stdout: "evexg": 0, 2024-04-26T18:47:02.600 INFO:teuthology.orchestra.run.smithi192.stdout: "evexd": 0, 2024-04-26T18:47:02.600 INFO:teuthology.orchestra.run.smithi192.stdout: "segadd": 2, 2024-04-26T18:47:02.600 INFO:teuthology.orchestra.run.smithi192.stdout: "segex": 0, 2024-04-26T18:47:02.600 INFO:teuthology.orchestra.run.smithi192.stdout: "segtrm": 0, 2024-04-26T18:47:02.600 INFO:teuthology.orchestra.run.smithi192.stdout: "seg": 2, 2024-04-26T18:47:02.601 INFO:teuthology.orchestra.run.smithi192.stdout: "segmjr": 2, 2024-04-26T18:47:02.601 INFO:teuthology.orchestra.run.smithi192.stdout: "segexg": 0, 2024-04-26T18:47:02.601 INFO:teuthology.orchestra.run.smithi192.stdout: "segexd": 0, 2024-04-26T18:47:02.601 INFO:teuthology.orchestra.run.smithi192.stdout: "expos": 4194304, 2024-04-26T18:47:02.601 INFO:teuthology.orchestra.run.smithi192.stdout: "wrpos": 4196123, 2024-04-26T18:47:02.601 INFO:teuthology.orchestra.run.smithi192.stdout: "rdpos": 0, 2024-04-26T18:47:02.601 INFO:teuthology.orchestra.run.smithi192.stdout: "jlat": { 2024-04-26T18:47:02.601 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 5, 2024-04-26T18:47:02.601 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.008654633, 2024-04-26T18:47:02.601 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001730926 2024-04-26T18:47:02.601 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.601 INFO:teuthology.orchestra.run.smithi192.stdout: "replayed": 0 2024-04-26T18:47:02.601 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.601 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_mem": { 2024-04-26T18:47:02.601 INFO:teuthology.orchestra.run.smithi192.stdout: "ino": 17, 2024-04-26T18:47:02.602 INFO:teuthology.orchestra.run.smithi192.stdout: "ino+": 17, 2024-04-26T18:47:02.602 INFO:teuthology.orchestra.run.smithi192.stdout: "ino-": 0, 2024-04-26T18:47:02.602 INFO:teuthology.orchestra.run.smithi192.stdout: "dir": 15, 2024-04-26T18:47:02.602 INFO:teuthology.orchestra.run.smithi192.stdout: "dir+": 16, 2024-04-26T18:47:02.602 INFO:teuthology.orchestra.run.smithi192.stdout: "dir-": 1, 2024-04-26T18:47:02.602 INFO:teuthology.orchestra.run.smithi192.stdout: "dn": 14, 2024-04-26T18:47:02.602 INFO:teuthology.orchestra.run.smithi192.stdout: "dn+": 14, 2024-04-26T18:47:02.602 INFO:teuthology.orchestra.run.smithi192.stdout: "dn-": 0, 2024-04-26T18:47:02.602 INFO:teuthology.orchestra.run.smithi192.stdout: "cap": 3, 2024-04-26T18:47:02.602 INFO:teuthology.orchestra.run.smithi192.stdout: "cap+": 3, 2024-04-26T18:47:02.602 INFO:teuthology.orchestra.run.smithi192.stdout: "cap-": 0, 2024-04-26T18:47:02.602 INFO:teuthology.orchestra.run.smithi192.stdout: "rss": 51892, 2024-04-26T18:47:02.602 INFO:teuthology.orchestra.run.smithi192.stdout: "heap": 223608 2024-04-26T18:47:02.602 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.603 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_server": { 2024-04-26T18:47:02.603 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_client_request": 10, 2024-04-26T18:47:02.603 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_server_request": 0, 2024-04-26T18:47:02.603 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_request": 9, 2024-04-26T18:47:02.603 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_session": 22, 2024-04-26T18:47:02.603 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_peer_request": 10, 2024-04-26T18:47:02.603 INFO:teuthology.orchestra.run.smithi192.stdout: "req_create_latency": { 2024-04-26T18:47:02.603 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.603 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.603 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.603 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.603 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getattr_latency": { 2024-04-26T18:47:02.603 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 4, 2024-04-26T18:47:02.603 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.001608055, 2024-04-26T18:47:02.603 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000402013 2024-04-26T18:47:02.604 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.604 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getfilelock_latency": { 2024-04-26T18:47:02.604 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.604 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.604 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.604 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.604 INFO:teuthology.orchestra.run.smithi192.stdout: "req_link_latency": { 2024-04-26T18:47:02.604 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.604 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.604 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.604 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.604 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookup_latency": { 2024-04-26T18:47:02.604 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.604 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.604 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.605 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.605 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookuphash_latency": { 2024-04-26T18:47:02.605 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.605 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.605 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.605 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.605 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupino_latency": { 2024-04-26T18:47:02.605 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1, 2024-04-26T18:47:02.605 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000207236, 2024-04-26T18:47:02.605 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000207236 2024-04-26T18:47:02.605 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.605 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupname_latency": { 2024-04-26T18:47:02.605 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.605 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.605 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.606 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.606 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupparent_latency": { 2024-04-26T18:47:02.606 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.606 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.606 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.606 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.606 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupsnap_latency": { 2024-04-26T18:47:02.606 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.606 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.606 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.606 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.606 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lssnap_latency": { 2024-04-26T18:47:02.606 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.606 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.607 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.607 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.607 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mkdir_latency": { 2024-04-26T18:47:02.607 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.607 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.607 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.607 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.608 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mknod_latency": { 2024-04-26T18:47:02.608 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.608 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.608 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.608 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.608 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mksnap_latency": { 2024-04-26T18:47:02.608 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.608 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.608 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.608 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.608 INFO:teuthology.orchestra.run.smithi192.stdout: "req_open_latency": { 2024-04-26T18:47:02.608 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.608 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.608 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.609 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.609 INFO:teuthology.orchestra.run.smithi192.stdout: "req_readdir_latency": { 2024-04-26T18:47:02.609 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.609 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.609 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.609 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.609 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rename_latency": { 2024-04-26T18:47:02.609 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.609 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.609 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.609 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.609 INFO:teuthology.orchestra.run.smithi192.stdout: "req_renamesnap_latency": { 2024-04-26T18:47:02.609 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.609 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.609 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.610 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.610 INFO:teuthology.orchestra.run.smithi192.stdout: "req_snapdiff_latency": { 2024-04-26T18:47:02.610 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.610 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.610 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.610 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.610 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmdir_latency": { 2024-04-26T18:47:02.610 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.610 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.610 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.610 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.610 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmsnap_latency": { 2024-04-26T18:47:02.610 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.610 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.611 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.611 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.611 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmxattr_latency": { 2024-04-26T18:47:02.611 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.611 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.611 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.611 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.611 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setattr_latency": { 2024-04-26T18:47:02.611 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.611 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.611 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.611 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.611 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setdirlayout_latency": { 2024-04-26T18:47:02.611 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.612 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.612 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.612 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.612 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setfilelock_latency": { 2024-04-26T18:47:02.612 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.612 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.612 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.612 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.612 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setlayout_latency": { 2024-04-26T18:47:02.612 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.612 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.612 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.612 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.612 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setxattr_latency": { 2024-04-26T18:47:02.613 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.613 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.613 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.613 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.613 INFO:teuthology.orchestra.run.smithi192.stdout: "req_symlink_latency": { 2024-04-26T18:47:02.613 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.613 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.613 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.613 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.613 INFO:teuthology.orchestra.run.smithi192.stdout: "req_unlink_latency": { 2024-04-26T18:47:02.613 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.613 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.613 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.613 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.613 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_revoke_eviction": 0, 2024-04-26T18:47:02.614 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_acquisition_throttle": 0, 2024-04-26T18:47:02.614 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getvxattr_latency": { 2024-04-26T18:47:02.614 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.614 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.614 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.614 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:02.614 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.614 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_sessions": { 2024-04-26T18:47:02.614 INFO:teuthology.orchestra.run.smithi192.stdout: "session_count": 2, 2024-04-26T18:47:02.614 INFO:teuthology.orchestra.run.smithi192.stdout: "session_add": 3, 2024-04-26T18:47:02.614 INFO:teuthology.orchestra.run.smithi192.stdout: "session_remove": 1, 2024-04-26T18:47:02.614 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_open": 2, 2024-04-26T18:47:02.614 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_stale": 0, 2024-04-26T18:47:02.614 INFO:teuthology.orchestra.run.smithi192.stdout: "total_load": 4, 2024-04-26T18:47:02.615 INFO:teuthology.orchestra.run.smithi192.stdout: "average_load": 1, 2024-04-26T18:47:02.615 INFO:teuthology.orchestra.run.smithi192.stdout: "avg_session_uptime": 614, 2024-04-26T18:47:02.615 INFO:teuthology.orchestra.run.smithi192.stdout: "mdthresh_evicted": 0 2024-04-26T18:47:02.615 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.615 INFO:teuthology.orchestra.run.smithi192.stdout: "mempool": { 2024-04-26T18:47:02.615 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_bytes": 0, 2024-04-26T18:47:02.615 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_items": 0, 2024-04-26T18:47:02.615 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T18:47:02.615 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_items": 0, 2024-04-26T18:47:02.615 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T18:47:02.615 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_items": 0, 2024-04-26T18:47:02.615 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T18:47:02.615 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T18:47:02.615 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T18:47:02.615 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T18:47:02.616 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T18:47:02.616 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_items": 0, 2024-04-26T18:47:02.616 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T18:47:02.616 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T18:47:02.616 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_bytes": 0, 2024-04-26T18:47:02.616 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_items": 0, 2024-04-26T18:47:02.616 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_bytes": 0, 2024-04-26T18:47:02.616 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_items": 0, 2024-04-26T18:47:02.616 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T18:47:02.616 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T18:47:02.616 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T18:47:02.616 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T18:47:02.616 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T18:47:02.616 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_items": 0, 2024-04-26T18:47:02.616 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_bytes": 0, 2024-04-26T18:47:02.617 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_items": 0, 2024-04-26T18:47:02.617 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T18:47:02.617 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T18:47:02.617 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_bytes": 0, 2024-04-26T18:47:02.617 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_items": 0, 2024-04-26T18:47:02.617 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_bytes": 0, 2024-04-26T18:47:02.617 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_items": 0, 2024-04-26T18:47:02.617 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T18:47:02.617 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_items": 0, 2024-04-26T18:47:02.617 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T18:47:02.617 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_items": 0, 2024-04-26T18:47:02.617 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_bytes": 272711, 2024-04-26T18:47:02.617 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_items": 97, 2024-04-26T18:47:02.617 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_bytes": 88, 2024-04-26T18:47:02.618 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_items": 1, 2024-04-26T18:47:02.618 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_bytes": 0, 2024-04-26T18:47:02.618 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_items": 0, 2024-04-26T18:47:02.618 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_bytes": 0, 2024-04-26T18:47:02.618 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_items": 0, 2024-04-26T18:47:02.618 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_bytes": 0, 2024-04-26T18:47:02.618 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_items": 0, 2024-04-26T18:47:02.618 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_bytes": 7936, 2024-04-26T18:47:02.618 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_items": 165, 2024-04-26T18:47:02.618 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T18:47:02.618 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_items": 0, 2024-04-26T18:47:02.618 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_bytes": 0, 2024-04-26T18:47:02.618 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_items": 0, 2024-04-26T18:47:02.618 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_bytes": 68805, 2024-04-26T18:47:02.619 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_items": 296, 2024-04-26T18:47:02.619 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_bytes": 0, 2024-04-26T18:47:02.619 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_items": 0, 2024-04-26T18:47:02.619 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_bytes": 0, 2024-04-26T18:47:02.619 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_items": 0 2024-04-26T18:47:02.619 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.619 INFO:teuthology.orchestra.run.smithi192.stdout: "objecter": { 2024-04-26T18:47:02.619 INFO:teuthology.orchestra.run.smithi192.stdout: "op_active": 0, 2024-04-26T18:47:02.619 INFO:teuthology.orchestra.run.smithi192.stdout: "op_laggy": 0, 2024-04-26T18:47:02.619 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send": 46, 2024-04-26T18:47:02.619 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send_bytes": 12873, 2024-04-26T18:47:02.619 INFO:teuthology.orchestra.run.smithi192.stdout: "op_resend": 28, 2024-04-26T18:47:02.619 INFO:teuthology.orchestra.run.smithi192.stdout: "op_reply": 46, 2024-04-26T18:47:02.619 INFO:teuthology.orchestra.run.smithi192.stdout: "op_latency": { 2024-04-26T18:47:02.619 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 46, 2024-04-26T18:47:02.620 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.207995953, 2024-04-26T18:47:02.620 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.004521651 2024-04-26T18:47:02.620 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.620 INFO:teuthology.orchestra.run.smithi192.stdout: "op_inflight": 0, 2024-04-26T18:47:02.620 INFO:teuthology.orchestra.run.smithi192.stdout: "oplen_avg": { 2024-04-26T18:47:02.620 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 46, 2024-04-26T18:47:02.620 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 72 2024-04-26T18:47:02.620 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.620 INFO:teuthology.orchestra.run.smithi192.stdout: "op": 46, 2024-04-26T18:47:02.620 INFO:teuthology.orchestra.run.smithi192.stdout: "op_r": 0, 2024-04-26T18:47:02.620 INFO:teuthology.orchestra.run.smithi192.stdout: "op_w": 46, 2024-04-26T18:47:02.620 INFO:teuthology.orchestra.run.smithi192.stdout: "op_rmw": 0, 2024-04-26T18:47:02.620 INFO:teuthology.orchestra.run.smithi192.stdout: "op_pg": 0, 2024-04-26T18:47:02.620 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_stat": 0, 2024-04-26T18:47:02.621 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_create": 10, 2024-04-26T18:47:02.621 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_read": 0, 2024-04-26T18:47:02.621 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_write": 5, 2024-04-26T18:47:02.621 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writefull": 8, 2024-04-26T18:47:02.621 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writesame": 0, 2024-04-26T18:47:02.621 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_append": 0, 2024-04-26T18:47:02.621 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_zero": 0, 2024-04-26T18:47:02.621 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_truncate": 0, 2024-04-26T18:47:02.621 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_delete": 6, 2024-04-26T18:47:02.621 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_mapext": 0, 2024-04-26T18:47:02.621 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_sparse_read": 0, 2024-04-26T18:47:02.621 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_clonerange": 0, 2024-04-26T18:47:02.621 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_getxattr": 0, 2024-04-26T18:47:02.621 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_setxattr": 20, 2024-04-26T18:47:02.621 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_cmpxattr": 0, 2024-04-26T18:47:02.622 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_rmxattr": 0, 2024-04-26T18:47:02.622 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_resetxattrs": 0, 2024-04-26T18:47:02.622 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_call": 0, 2024-04-26T18:47:02.622 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_watch": 0, 2024-04-26T18:47:02.622 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_notify": 0, 2024-04-26T18:47:02.622 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T18:47:02.622 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls": 0, 2024-04-26T18:47:02.622 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls_filter": 0, 2024-04-26T18:47:02.622 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_other": 0, 2024-04-26T18:47:02.622 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_active": 0, 2024-04-26T18:47:02.622 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_send": 0, 2024-04-26T18:47:02.622 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_resend": 0, 2024-04-26T18:47:02.622 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_ping": 0, 2024-04-26T18:47:02.622 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_active": 0, 2024-04-26T18:47:02.623 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_send": 0, 2024-04-26T18:47:02.623 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_resend": 0, 2024-04-26T18:47:02.623 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_active": 0, 2024-04-26T18:47:02.623 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_send": 0, 2024-04-26T18:47:02.623 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_resend": 0, 2024-04-26T18:47:02.623 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_active": 0, 2024-04-26T18:47:02.623 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_send": 0, 2024-04-26T18:47:02.623 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_resend": 0, 2024-04-26T18:47:02.623 INFO:teuthology.orchestra.run.smithi192.stdout: "command_active": 0, 2024-04-26T18:47:02.623 INFO:teuthology.orchestra.run.smithi192.stdout: "command_send": 0, 2024-04-26T18:47:02.623 INFO:teuthology.orchestra.run.smithi192.stdout: "command_resend": 0, 2024-04-26T18:47:02.623 INFO:teuthology.orchestra.run.smithi192.stdout: "map_epoch": 101, 2024-04-26T18:47:02.623 INFO:teuthology.orchestra.run.smithi192.stdout: "map_full": 0, 2024-04-26T18:47:02.623 INFO:teuthology.orchestra.run.smithi192.stdout: "map_inc": 12, 2024-04-26T18:47:02.623 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_sessions": 9, 2024-04-26T18:47:02.624 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_open": 9, 2024-04-26T18:47:02.624 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_close": 0, 2024-04-26T18:47:02.624 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_laggy": 0, 2024-04-26T18:47:02.624 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_wr": 21, 2024-04-26T18:47:02.624 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_rd": 0, 2024-04-26T18:47:02.624 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_del": 2 2024-04-26T18:47:02.624 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.624 INFO:teuthology.orchestra.run.smithi192.stdout: "oft": { 2024-04-26T18:47:02.624 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_objs": 1, 2024-04-26T18:47:02.624 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_kv_pairs": 0, 2024-04-26T18:47:02.624 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_updates": 0, 2024-04-26T18:47:02.624 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_removes": 0 2024-04-26T18:47:02.624 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.624 INFO:teuthology.orchestra.run.smithi192.stdout: "osd-slow-ops": { 2024-04-26T18:47:02.624 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_ops_count": 12 2024-04-26T18:47:02.625 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.625 INFO:teuthology.orchestra.run.smithi192.stdout: "purge_queue": { 2024-04-26T18:47:02.625 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops": 0, 2024-04-26T18:47:02.625 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops_high_water": 0, 2024-04-26T18:47:02.625 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing": 0, 2024-04-26T18:47:02.625 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_high_water": 0, 2024-04-26T18:47:02.625 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed_ops": 0, 2024-04-26T18:47:02.625 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed": 0, 2024-04-26T18:47:02.625 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_item_in_journal": 0 2024-04-26T18:47:02.625 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.625 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T18:47:02.625 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-04-26T18:47:02.625 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-04-26T18:47:02.625 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-04-26T18:47:02.625 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 751, 2024-04-26T18:47:02.625 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 1707660, 2024-04-26T18:47:02.626 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-04-26T18:47:02.626 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 751, 2024-04-26T18:47:02.626 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-04-26T18:47:02.626 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-04-26T18:47:02.626 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 751, 2024-04-26T18:47:02.626 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 1707660, 2024-04-26T18:47:02.626 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-04-26T18:47:02.626 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.626 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.626 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.626 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:02.626 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.626 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_bytes": { 2024-04-26T18:47:02.626 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-04-26T18:47:02.627 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-04-26T18:47:02.627 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-04-26T18:47:02.627 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-04-26T18:47:02.627 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-04-26T18:47:02.627 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-04-26T18:47:02.627 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-04-26T18:47:02.627 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 46, 2024-04-26T18:47:02.627 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 12873, 2024-04-26T18:47:02.627 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 46, 2024-04-26T18:47:02.627 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 12873, 2024-04-26T18:47:02.627 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-04-26T18:47:02.627 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.627 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.627 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.627 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:02.628 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.628 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_ops": { 2024-04-26T18:47:02.628 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-04-26T18:47:02.628 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 1024, 2024-04-26T18:47:02.628 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-04-26T18:47:02.628 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-04-26T18:47:02.628 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-04-26T18:47:02.628 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-04-26T18:47:02.628 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-04-26T18:47:02.628 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 46, 2024-04-26T18:47:02.628 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 46, 2024-04-26T18:47:02.628 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 46, 2024-04-26T18:47:02.628 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 46, 2024-04-26T18:47:02.628 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-04-26T18:47:02.628 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.628 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.629 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.629 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:02.629 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.629 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle": { 2024-04-26T18:47:02.629 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-04-26T18:47:02.629 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-04-26T18:47:02.629 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-04-26T18:47:02.629 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-04-26T18:47:02.629 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-04-26T18:47:02.629 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-04-26T18:47:02.629 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-04-26T18:47:02.629 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-04-26T18:47:02.629 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-04-26T18:47:02.630 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 0, 2024-04-26T18:47:02.630 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 0, 2024-04-26T18:47:02.630 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-04-26T18:47:02.630 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.630 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.630 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.630 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:02.630 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:02.630 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle-0x555f2462e500": { 2024-04-26T18:47:02.630 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-04-26T18:47:02.630 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-04-26T18:47:02.630 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-04-26T18:47:02.630 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 6, 2024-04-26T18:47:02.630 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 1819, 2024-04-26T18:47:02.631 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-04-26T18:47:02.631 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 6, 2024-04-26T18:47:02.631 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-04-26T18:47:02.631 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-04-26T18:47:02.631 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 5, 2024-04-26T18:47:02.631 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 1819, 2024-04-26T18:47:02.631 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-04-26T18:47:02.631 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:02.631 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:02.631 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:02.631 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:02.631 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:02.631 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-04-26T18:47:03.447 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-04-26T18:47:03.447 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-04-26T18:47:03.447 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-04-26T18:47:03.447 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-04-26T18:47:03.448 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-04-26T18:47:03.448 DEBUG:tasks.check_counter:Getting stats from i 2024-04-26T18:47:03.448 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph daemon mds.i perf dump 2024-04-26T18:47:03.689 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T18:47:03.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:03 smithi080 ceph-mon[29135]: pgmap v329: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:47:03.810 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:03 smithi192 ceph-mon[32842]: pgmap v329: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:47:03.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:03 smithi082 ceph-mon[32808]: pgmap v329: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T18:47:05.419 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-04-26T18:47:05.419 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T18:47:05.419 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 39, 2024-04-26T18:47:05.419 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 45, 2024-04-26T18:47:05.419 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 9625, 2024-04-26T18:47:05.419 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 85929, 2024-04-26T18:47:05.419 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 16, 2024-04-26T18:47:05.419 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 5, 2024-04-26T18:47:05.419 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.007562710, 2024-04-26T18:47:05.419 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.000779475, 2024-04-26T18:47:05.419 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.004409509, 2024-04-26T18:47:05.419 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.000659917, 2024-04-26T18:47:05.420 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:47:05.420 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 39, 2024-04-26T18:47:05.420 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.013130746, 2024-04-26T18:47:05.420 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000336685 2024-04-26T18:47:05.420 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.420 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:47:05.420 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 19, 2024-04-26T18:47:05.420 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000002386, 2024-04-26T18:47:05.420 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000125 2024-04-26T18:47:05.420 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.420 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 1936, 2024-04-26T18:47:05.420 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 1584 2024-04-26T18:47:05.420 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.420 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T18:47:05.421 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 627, 2024-04-26T18:47:05.421 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 804, 2024-04-26T18:47:05.421 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 1768050, 2024-04-26T18:47:05.421 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 268440, 2024-04-26T18:47:05.421 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 6, 2024-04-26T18:47:05.421 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 4, 2024-04-26T18:47:05.421 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.101978159, 2024-04-26T18:47:05.421 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.037914662, 2024-04-26T18:47:05.421 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.058221532, 2024-04-26T18:47:05.421 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.011203561, 2024-04-26T18:47:05.421 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:47:05.421 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 808, 2024-04-26T18:47:05.421 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.057309199, 2024-04-26T18:47:05.421 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000070927 2024-04-26T18:47:05.421 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.421 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:47:05.422 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 816, 2024-04-26T18:47:05.422 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000229303, 2024-04-26T18:47:05.422 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000281 2024-04-26T18:47:05.422 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.422 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 1671376, 2024-04-26T18:47:05.422 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 150336 2024-04-26T18:47:05.422 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.422 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T18:47:05.422 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 19, 2024-04-26T18:47:05.422 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 196, 2024-04-26T18:47:05.422 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 5187, 2024-04-26T18:47:05.422 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 484579, 2024-04-26T18:47:05.422 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 9, 2024-04-26T18:47:05.422 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 5, 2024-04-26T18:47:05.422 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.012717721, 2024-04-26T18:47:05.423 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.007175235, 2024-04-26T18:47:05.423 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.003524266, 2024-04-26T18:47:05.423 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.000190924, 2024-04-26T18:47:05.423 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:47:05.423 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 193, 2024-04-26T18:47:05.423 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.021843689, 2024-04-26T18:47:05.423 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000113179 2024-04-26T18:47:05.423 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.423 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:47:05.423 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 17, 2024-04-26T18:47:05.423 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000002141, 2024-04-26T18:47:05.423 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000125 2024-04-26T18:47:05.423 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.423 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 2960, 2024-04-26T18:47:05.423 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 475520 2024-04-26T18:47:05.424 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.424 INFO:teuthology.orchestra.run.smithi192.stdout: "cct": { 2024-04-26T18:47:05.424 INFO:teuthology.orchestra.run.smithi192.stdout: "total_workers": 1, 2024-04-26T18:47:05.424 INFO:teuthology.orchestra.run.smithi192.stdout: "unhealthy_workers": 0 2024-04-26T18:47:05.424 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.424 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-MDSRank": { 2024-04-26T18:47:05.424 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-04-26T18:47:05.424 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-04-26T18:47:05.424 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 38, 2024-04-26T18:47:05.424 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.002042265, 2024-04-26T18:47:05.424 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000053743 2024-04-26T18:47:05.424 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:05.424 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.424 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-PurgeQueue": { 2024-04-26T18:47:05.424 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-04-26T18:47:05.425 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-04-26T18:47:05.425 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2, 2024-04-26T18:47:05.425 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000006342, 2024-04-26T18:47:05.425 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000003171 2024-04-26T18:47:05.425 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:05.425 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.425 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": { 2024-04-26T18:47:05.425 INFO:teuthology.orchestra.run.smithi192.stdout: "request": 6, 2024-04-26T18:47:05.425 INFO:teuthology.orchestra.run.smithi192.stdout: "reply": 4, 2024-04-26T18:47:05.425 INFO:teuthology.orchestra.run.smithi192.stdout: "reply_latency": { 2024-04-26T18:47:05.425 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 4, 2024-04-26T18:47:05.425 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000891234, 2024-04-26T18:47:05.425 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000222808 2024-04-26T18:47:05.425 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.425 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_reply": 0, 2024-04-26T18:47:05.426 INFO:teuthology.orchestra.run.smithi192.stdout: "forward": 2, 2024-04-26T18:47:05.426 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_complete": 0, 2024-04-26T18:47:05.426 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_keys": 0, 2024-04-26T18:47:05.426 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_commit": 11, 2024-04-26T18:47:05.426 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_split": 0, 2024-04-26T18:47:05.426 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_merge": 0, 2024-04-26T18:47:05.426 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes": 11, 2024-04-26T18:47:05.426 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_top": 0, 2024-04-26T18:47:05.426 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_bottom": 11, 2024-04-26T18:47:05.426 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pin_tail": 0, 2024-04-26T18:47:05.426 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pinned": 10, 2024-04-26T18:47:05.426 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_expired": 1, 2024-04-26T18:47:05.426 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_with_caps": 0, 2024-04-26T18:47:05.427 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": 0, 2024-04-26T18:47:05.427 INFO:teuthology.orchestra.run.smithi192.stdout: "subtrees": 2, 2024-04-26T18:47:05.427 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse": 16, 2024-04-26T18:47:05.427 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_hit": 10, 2024-04-26T18:47:05.427 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_forward": 0, 2024-04-26T18:47:05.427 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_discover": 2, 2024-04-26T18:47:05.427 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_dir_fetch": 0, 2024-04-26T18:47:05.427 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_remote_ino": 0, 2024-04-26T18:47:05.427 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_lock": 0, 2024-04-26T18:47:05.427 INFO:teuthology.orchestra.run.smithi192.stdout: "load_cent": 0, 2024-04-26T18:47:05.427 INFO:teuthology.orchestra.run.smithi192.stdout: "q": 0, 2024-04-26T18:47:05.427 INFO:teuthology.orchestra.run.smithi192.stdout: "exported": 0, 2024-04-26T18:47:05.427 INFO:teuthology.orchestra.run.smithi192.stdout: "exported_inodes": 0, 2024-04-26T18:47:05.427 INFO:teuthology.orchestra.run.smithi192.stdout: "imported": 0, 2024-04-26T18:47:05.427 INFO:teuthology.orchestra.run.smithi192.stdout: "imported_inodes": 0, 2024-04-26T18:47:05.428 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_dir_fetch": 0, 2024-04-26T18:47:05.428 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_backtrace_fetch": 0, 2024-04-26T18:47:05.428 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_peer_discover": 0, 2024-04-26T18:47:05.428 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rfiles": 4, 2024-04-26T18:47:05.428 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rbytes": 234, 2024-04-26T18:47:05.428 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rsnaps": 0, 2024-04-26T18:47:05.428 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T18:47:05.428 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_set_tag": 0, 2024-04-26T18:47:05.428 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T18:47:05.428 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_inotable_repaired": 0, 2024-04-26T18:47:05.428 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_inodes": 0, 2024-04-26T18:47:05.428 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T18:47:05.428 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T18:47:05.428 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_file_inodes": 0, 2024-04-26T18:47:05.428 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_inode_file_caps": 0, 2024-04-26T18:47:05.429 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_revoke": 2, 2024-04-26T18:47:05.429 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_grant": 0, 2024-04-26T18:47:05.429 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T18:47:05.429 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T18:47:05.429 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T18:47:05.429 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps": 2, 2024-04-26T18:47:05.429 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps_dirty": 0, 2024-04-26T18:47:05.429 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_cap_release": 0, 2024-04-26T18:47:05.429 INFO:teuthology.orchestra.run.smithi192.stdout: "process_request_cap_release": 2 2024-04-26T18:47:05.429 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.429 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_cache": { 2024-04-26T18:47:05.429 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update": 0, 2024-04-26T18:47:05.429 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update_receipt": 0, 2024-04-26T18:47:05.429 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_try_discover": 0, 2024-04-26T18:47:05.430 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_send_discover": 3, 2024-04-26T18:47:05.430 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_handle_discover": 0, 2024-04-26T18:47:05.430 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays": 0, 2024-04-26T18:47:05.430 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_delayed": 0, 2024-04-26T18:47:05.430 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_enqueuing": 0, 2024-04-26T18:47:05.430 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_created": 0, 2024-04-26T18:47:05.430 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_enqueued": 0, 2024-04-26T18:47:05.430 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_reintegrated": 0, 2024-04-26T18:47:05.430 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_migrated": 0, 2024-04-26T18:47:05.430 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_processing": 0, 2024-04-26T18:47:05.430 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_enqueued": 0, 2024-04-26T18:47:05.430 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_prioritized": 0, 2024-04-26T18:47:05.430 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_started": 0, 2024-04-26T18:47:05.430 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_completed": 0, 2024-04-26T18:47:05.431 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_path": 2, 2024-04-26T18:47:05.431 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_inode": 4, 2024-04-26T18:47:05.431 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T18:47:05.431 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_exportdir": 0, 2024-04-26T18:47:05.431 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_flush": 0, 2024-04-26T18:47:05.431 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragmentdir": 0, 2024-04-26T18:47:05.431 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragstats": 0, 2024-04-26T18:47:05.431 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_inodestats": 0 2024-04-26T18:47:05.431 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.431 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_log": { 2024-04-26T18:47:05.431 INFO:teuthology.orchestra.run.smithi192.stdout: "evlrg": 0, 2024-04-26T18:47:05.431 INFO:teuthology.orchestra.run.smithi192.stdout: "evadd": 6, 2024-04-26T18:47:05.431 INFO:teuthology.orchestra.run.smithi192.stdout: "evex": 0, 2024-04-26T18:47:05.431 INFO:teuthology.orchestra.run.smithi192.stdout: "evtrm": 0, 2024-04-26T18:47:05.431 INFO:teuthology.orchestra.run.smithi192.stdout: "ev": 6, 2024-04-26T18:47:05.432 INFO:teuthology.orchestra.run.smithi192.stdout: "evexg": 0, 2024-04-26T18:47:05.432 INFO:teuthology.orchestra.run.smithi192.stdout: "evexd": 0, 2024-04-26T18:47:05.432 INFO:teuthology.orchestra.run.smithi192.stdout: "segadd": 2, 2024-04-26T18:47:05.432 INFO:teuthology.orchestra.run.smithi192.stdout: "segex": 0, 2024-04-26T18:47:05.432 INFO:teuthology.orchestra.run.smithi192.stdout: "segtrm": 0, 2024-04-26T18:47:05.432 INFO:teuthology.orchestra.run.smithi192.stdout: "seg": 2, 2024-04-26T18:47:05.432 INFO:teuthology.orchestra.run.smithi192.stdout: "segmjr": 2, 2024-04-26T18:47:05.432 INFO:teuthology.orchestra.run.smithi192.stdout: "segexg": 0, 2024-04-26T18:47:05.432 INFO:teuthology.orchestra.run.smithi192.stdout: "segexd": 0, 2024-04-26T18:47:05.432 INFO:teuthology.orchestra.run.smithi192.stdout: "expos": 4194304, 2024-04-26T18:47:05.432 INFO:teuthology.orchestra.run.smithi192.stdout: "wrpos": 4195956, 2024-04-26T18:47:05.432 INFO:teuthology.orchestra.run.smithi192.stdout: "rdpos": 0, 2024-04-26T18:47:05.432 INFO:teuthology.orchestra.run.smithi192.stdout: "jlat": { 2024-04-26T18:47:05.432 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 5, 2024-04-26T18:47:05.433 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.008485518, 2024-04-26T18:47:05.433 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001697103 2024-04-26T18:47:05.433 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.433 INFO:teuthology.orchestra.run.smithi192.stdout: "replayed": 0 2024-04-26T18:47:05.433 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.433 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_mem": { 2024-04-26T18:47:05.433 INFO:teuthology.orchestra.run.smithi192.stdout: "ino": 14, 2024-04-26T18:47:05.433 INFO:teuthology.orchestra.run.smithi192.stdout: "ino+": 14, 2024-04-26T18:47:05.433 INFO:teuthology.orchestra.run.smithi192.stdout: "ino-": 0, 2024-04-26T18:47:05.433 INFO:teuthology.orchestra.run.smithi192.stdout: "dir": 13, 2024-04-26T18:47:05.433 INFO:teuthology.orchestra.run.smithi192.stdout: "dir+": 14, 2024-04-26T18:47:05.433 INFO:teuthology.orchestra.run.smithi192.stdout: "dir-": 1, 2024-04-26T18:47:05.433 INFO:teuthology.orchestra.run.smithi192.stdout: "dn": 11, 2024-04-26T18:47:05.433 INFO:teuthology.orchestra.run.smithi192.stdout: "dn+": 12, 2024-04-26T18:47:05.433 INFO:teuthology.orchestra.run.smithi192.stdout: "dn-": 1, 2024-04-26T18:47:05.434 INFO:teuthology.orchestra.run.smithi192.stdout: "cap": 0, 2024-04-26T18:47:05.434 INFO:teuthology.orchestra.run.smithi192.stdout: "cap+": 3, 2024-04-26T18:47:05.434 INFO:teuthology.orchestra.run.smithi192.stdout: "cap-": 3, 2024-04-26T18:47:05.434 INFO:teuthology.orchestra.run.smithi192.stdout: "rss": 53556, 2024-04-26T18:47:05.434 INFO:teuthology.orchestra.run.smithi192.stdout: "heap": 223608 2024-04-26T18:47:05.434 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.434 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_server": { 2024-04-26T18:47:05.434 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_client_request": 8, 2024-04-26T18:47:05.434 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_server_request": 0, 2024-04-26T18:47:05.434 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_request": 6, 2024-04-26T18:47:05.434 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_session": 8, 2024-04-26T18:47:05.434 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_peer_request": 4, 2024-04-26T18:47:05.434 INFO:teuthology.orchestra.run.smithi192.stdout: "req_create_latency": { 2024-04-26T18:47:05.434 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.435 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.435 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.435 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.435 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getattr_latency": { 2024-04-26T18:47:05.435 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2, 2024-04-26T18:47:05.435 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000369178, 2024-04-26T18:47:05.435 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000184589 2024-04-26T18:47:05.435 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.435 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getfilelock_latency": { 2024-04-26T18:47:05.435 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.435 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.435 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.435 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.435 INFO:teuthology.orchestra.run.smithi192.stdout: "req_link_latency": { 2024-04-26T18:47:05.435 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.435 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.436 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.436 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.436 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookup_latency": { 2024-04-26T18:47:05.436 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2, 2024-04-26T18:47:05.436 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000522056, 2024-04-26T18:47:05.436 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000261028 2024-04-26T18:47:05.436 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.436 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookuphash_latency": { 2024-04-26T18:47:05.436 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.436 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.436 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.436 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.436 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupino_latency": { 2024-04-26T18:47:05.436 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.436 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.436 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.436 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.437 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupname_latency": { 2024-04-26T18:47:05.437 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.437 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.437 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.437 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.437 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupparent_latency": { 2024-04-26T18:47:05.437 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.437 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.437 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.437 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.437 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupsnap_latency": { 2024-04-26T18:47:05.437 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.437 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.437 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.437 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.437 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lssnap_latency": { 2024-04-26T18:47:05.438 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.438 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.438 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.438 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.438 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mkdir_latency": { 2024-04-26T18:47:05.438 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.438 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.439 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.439 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.439 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mknod_latency": { 2024-04-26T18:47:05.439 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.439 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.439 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.439 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.439 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mksnap_latency": { 2024-04-26T18:47:05.439 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.439 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.439 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.439 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.439 INFO:teuthology.orchestra.run.smithi192.stdout: "req_open_latency": { 2024-04-26T18:47:05.439 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.439 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.440 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.440 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.440 INFO:teuthology.orchestra.run.smithi192.stdout: "req_readdir_latency": { 2024-04-26T18:47:05.440 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.440 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.440 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.440 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.440 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rename_latency": { 2024-04-26T18:47:05.440 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.440 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.440 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.440 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.440 INFO:teuthology.orchestra.run.smithi192.stdout: "req_renamesnap_latency": { 2024-04-26T18:47:05.440 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.440 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.440 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.441 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.441 INFO:teuthology.orchestra.run.smithi192.stdout: "req_snapdiff_latency": { 2024-04-26T18:47:05.441 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.441 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.441 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.441 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.441 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmdir_latency": { 2024-04-26T18:47:05.441 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.441 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.441 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.441 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.441 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmsnap_latency": { 2024-04-26T18:47:05.441 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.441 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.441 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.441 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.442 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmxattr_latency": { 2024-04-26T18:47:05.442 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.442 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.442 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.442 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.442 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setattr_latency": { 2024-04-26T18:47:05.442 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.442 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.442 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.442 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.442 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setdirlayout_latency": { 2024-04-26T18:47:05.442 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.442 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.442 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.443 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.443 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setfilelock_latency": { 2024-04-26T18:47:05.443 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.443 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.443 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.443 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.443 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setlayout_latency": { 2024-04-26T18:47:05.443 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.443 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.443 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.443 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.443 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setxattr_latency": { 2024-04-26T18:47:05.443 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.443 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.443 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.444 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.444 INFO:teuthology.orchestra.run.smithi192.stdout: "req_symlink_latency": { 2024-04-26T18:47:05.444 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.444 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.444 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.444 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.444 INFO:teuthology.orchestra.run.smithi192.stdout: "req_unlink_latency": { 2024-04-26T18:47:05.444 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.444 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.444 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.444 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.444 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_revoke_eviction": 0, 2024-04-26T18:47:05.444 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_acquisition_throttle": 0, 2024-04-26T18:47:05.444 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getvxattr_latency": { 2024-04-26T18:47:05.444 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.445 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.445 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.445 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:05.445 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.445 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_sessions": { 2024-04-26T18:47:05.445 INFO:teuthology.orchestra.run.smithi192.stdout: "session_count": 0, 2024-04-26T18:47:05.445 INFO:teuthology.orchestra.run.smithi192.stdout: "session_add": 2, 2024-04-26T18:47:05.445 INFO:teuthology.orchestra.run.smithi192.stdout: "session_remove": 2, 2024-04-26T18:47:05.445 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_open": 0, 2024-04-26T18:47:05.445 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_stale": 0, 2024-04-26T18:47:05.445 INFO:teuthology.orchestra.run.smithi192.stdout: "total_load": 3, 2024-04-26T18:47:05.445 INFO:teuthology.orchestra.run.smithi192.stdout: "average_load": 3, 2024-04-26T18:47:05.445 INFO:teuthology.orchestra.run.smithi192.stdout: "avg_session_uptime": 88, 2024-04-26T18:47:05.445 INFO:teuthology.orchestra.run.smithi192.stdout: "mdthresh_evicted": 0 2024-04-26T18:47:05.445 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.445 INFO:teuthology.orchestra.run.smithi192.stdout: "mempool": { 2024-04-26T18:47:05.446 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_bytes": 0, 2024-04-26T18:47:05.446 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_items": 0, 2024-04-26T18:47:05.446 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T18:47:05.446 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_items": 0, 2024-04-26T18:47:05.446 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T18:47:05.446 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_items": 0, 2024-04-26T18:47:05.446 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T18:47:05.446 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T18:47:05.446 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T18:47:05.446 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T18:47:05.446 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T18:47:05.446 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_items": 0, 2024-04-26T18:47:05.446 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T18:47:05.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T18:47:05.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_bytes": 0, 2024-04-26T18:47:05.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_items": 0, 2024-04-26T18:47:05.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_bytes": 0, 2024-04-26T18:47:05.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_items": 0, 2024-04-26T18:47:05.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T18:47:05.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T18:47:05.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T18:47:05.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T18:47:05.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T18:47:05.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_items": 0, 2024-04-26T18:47:05.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_bytes": 0, 2024-04-26T18:47:05.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_items": 0, 2024-04-26T18:47:05.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T18:47:05.448 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T18:47:05.448 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_bytes": 0, 2024-04-26T18:47:05.448 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_items": 0, 2024-04-26T18:47:05.448 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_bytes": 0, 2024-04-26T18:47:05.448 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_items": 0, 2024-04-26T18:47:05.448 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T18:47:05.448 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_items": 0, 2024-04-26T18:47:05.448 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T18:47:05.448 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_items": 0, 2024-04-26T18:47:05.448 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_bytes": 256295, 2024-04-26T18:47:05.448 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_items": 89, 2024-04-26T18:47:05.448 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_bytes": 0, 2024-04-26T18:47:05.448 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_items": 0, 2024-04-26T18:47:05.448 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_bytes": 0, 2024-04-26T18:47:05.448 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_items": 0, 2024-04-26T18:47:05.448 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_bytes": 0, 2024-04-26T18:47:05.449 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_items": 0, 2024-04-26T18:47:05.449 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_bytes": 0, 2024-04-26T18:47:05.449 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_items": 0, 2024-04-26T18:47:05.449 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_bytes": 7936, 2024-04-26T18:47:05.449 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_items": 165, 2024-04-26T18:47:05.449 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T18:47:05.449 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_items": 0, 2024-04-26T18:47:05.449 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_bytes": 0, 2024-04-26T18:47:05.449 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_items": 0, 2024-04-26T18:47:05.449 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_bytes": 56544, 2024-04-26T18:47:05.449 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_items": 224, 2024-04-26T18:47:05.449 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_bytes": 0, 2024-04-26T18:47:05.449 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_items": 0, 2024-04-26T18:47:05.449 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_bytes": 0, 2024-04-26T18:47:05.450 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_items": 0 2024-04-26T18:47:05.450 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.450 INFO:teuthology.orchestra.run.smithi192.stdout: "objecter": { 2024-04-26T18:47:05.450 INFO:teuthology.orchestra.run.smithi192.stdout: "op_active": 0, 2024-04-26T18:47:05.450 INFO:teuthology.orchestra.run.smithi192.stdout: "op_laggy": 0, 2024-04-26T18:47:05.450 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send": 44, 2024-04-26T18:47:05.450 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send_bytes": 12189, 2024-04-26T18:47:05.450 INFO:teuthology.orchestra.run.smithi192.stdout: "op_resend": 29, 2024-04-26T18:47:05.450 INFO:teuthology.orchestra.run.smithi192.stdout: "op_reply": 44, 2024-04-26T18:47:05.450 INFO:teuthology.orchestra.run.smithi192.stdout: "op_latency": { 2024-04-26T18:47:05.450 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 44, 2024-04-26T18:47:05.450 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.212995880, 2024-04-26T18:47:05.450 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.004840815 2024-04-26T18:47:05.450 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.451 INFO:teuthology.orchestra.run.smithi192.stdout: "op_inflight": 0, 2024-04-26T18:47:05.451 INFO:teuthology.orchestra.run.smithi192.stdout: "oplen_avg": { 2024-04-26T18:47:05.451 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 44, 2024-04-26T18:47:05.451 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 68 2024-04-26T18:47:05.451 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.451 INFO:teuthology.orchestra.run.smithi192.stdout: "op": 44, 2024-04-26T18:47:05.451 INFO:teuthology.orchestra.run.smithi192.stdout: "op_r": 0, 2024-04-26T18:47:05.451 INFO:teuthology.orchestra.run.smithi192.stdout: "op_w": 44, 2024-04-26T18:47:05.451 INFO:teuthology.orchestra.run.smithi192.stdout: "op_rmw": 0, 2024-04-26T18:47:05.451 INFO:teuthology.orchestra.run.smithi192.stdout: "op_pg": 0, 2024-04-26T18:47:05.451 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_stat": 0, 2024-04-26T18:47:05.451 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_create": 10, 2024-04-26T18:47:05.451 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_read": 0, 2024-04-26T18:47:05.451 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_write": 5, 2024-04-26T18:47:05.451 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writefull": 8, 2024-04-26T18:47:05.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writesame": 0, 2024-04-26T18:47:05.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_append": 0, 2024-04-26T18:47:05.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_zero": 0, 2024-04-26T18:47:05.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_truncate": 0, 2024-04-26T18:47:05.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_delete": 6, 2024-04-26T18:47:05.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_mapext": 0, 2024-04-26T18:47:05.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_sparse_read": 0, 2024-04-26T18:47:05.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_clonerange": 0, 2024-04-26T18:47:05.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_getxattr": 0, 2024-04-26T18:47:05.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_setxattr": 20, 2024-04-26T18:47:05.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_cmpxattr": 0, 2024-04-26T18:47:05.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_rmxattr": 0, 2024-04-26T18:47:05.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_resetxattrs": 0, 2024-04-26T18:47:05.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_call": 0, 2024-04-26T18:47:05.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_watch": 0, 2024-04-26T18:47:05.453 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_notify": 0, 2024-04-26T18:47:05.453 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T18:47:05.453 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls": 0, 2024-04-26T18:47:05.453 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls_filter": 0, 2024-04-26T18:47:05.453 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_other": 0, 2024-04-26T18:47:05.453 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_active": 0, 2024-04-26T18:47:05.453 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_send": 0, 2024-04-26T18:47:05.453 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_resend": 0, 2024-04-26T18:47:05.453 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_ping": 0, 2024-04-26T18:47:05.453 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_active": 0, 2024-04-26T18:47:05.453 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_send": 0, 2024-04-26T18:47:05.453 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_resend": 0, 2024-04-26T18:47:05.453 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_active": 0, 2024-04-26T18:47:05.453 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_send": 0, 2024-04-26T18:47:05.454 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_resend": 0, 2024-04-26T18:47:05.454 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_active": 0, 2024-04-26T18:47:05.454 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_send": 0, 2024-04-26T18:47:05.454 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_resend": 0, 2024-04-26T18:47:05.454 INFO:teuthology.orchestra.run.smithi192.stdout: "command_active": 0, 2024-04-26T18:47:05.454 INFO:teuthology.orchestra.run.smithi192.stdout: "command_send": 0, 2024-04-26T18:47:05.454 INFO:teuthology.orchestra.run.smithi192.stdout: "command_resend": 0, 2024-04-26T18:47:05.454 INFO:teuthology.orchestra.run.smithi192.stdout: "map_epoch": 101, 2024-04-26T18:47:05.454 INFO:teuthology.orchestra.run.smithi192.stdout: "map_full": 0, 2024-04-26T18:47:05.454 INFO:teuthology.orchestra.run.smithi192.stdout: "map_inc": 12, 2024-04-26T18:47:05.454 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_sessions": 10, 2024-04-26T18:47:05.454 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_open": 10, 2024-04-26T18:47:05.454 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_close": 0, 2024-04-26T18:47:05.454 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_laggy": 0, 2024-04-26T18:47:05.455 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_wr": 17, 2024-04-26T18:47:05.455 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_rd": 0, 2024-04-26T18:47:05.455 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_del": 2 2024-04-26T18:47:05.455 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.455 INFO:teuthology.orchestra.run.smithi192.stdout: "oft": { 2024-04-26T18:47:05.455 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_objs": 1, 2024-04-26T18:47:05.455 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_kv_pairs": 0, 2024-04-26T18:47:05.455 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_updates": 0, 2024-04-26T18:47:05.455 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_removes": 0 2024-04-26T18:47:05.455 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.455 INFO:teuthology.orchestra.run.smithi192.stdout: "osd-slow-ops": { 2024-04-26T18:47:05.455 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_ops_count": 6 2024-04-26T18:47:05.455 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.455 INFO:teuthology.orchestra.run.smithi192.stdout: "purge_queue": { 2024-04-26T18:47:05.456 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops": 0, 2024-04-26T18:47:05.456 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops_high_water": 0, 2024-04-26T18:47:05.456 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing": 0, 2024-04-26T18:47:05.456 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_high_water": 0, 2024-04-26T18:47:05.456 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed_ops": 0, 2024-04-26T18:47:05.456 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed": 0, 2024-04-26T18:47:05.456 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_item_in_journal": 0 2024-04-26T18:47:05.456 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.456 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T18:47:05.456 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-04-26T18:47:05.456 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-04-26T18:47:05.456 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-04-26T18:47:05.456 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 681, 2024-04-26T18:47:05.456 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 1702839, 2024-04-26T18:47:05.456 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-04-26T18:47:05.457 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 681, 2024-04-26T18:47:05.457 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-04-26T18:47:05.457 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-04-26T18:47:05.457 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 681, 2024-04-26T18:47:05.457 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 1702839, 2024-04-26T18:47:05.457 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-04-26T18:47:05.457 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.457 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.457 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.457 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:05.457 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.457 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_bytes": { 2024-04-26T18:47:05.457 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-04-26T18:47:05.457 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-04-26T18:47:05.457 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-04-26T18:47:05.458 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-04-26T18:47:05.458 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-04-26T18:47:05.458 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-04-26T18:47:05.458 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-04-26T18:47:05.458 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 44, 2024-04-26T18:47:05.458 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 12189, 2024-04-26T18:47:05.458 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 44, 2024-04-26T18:47:05.458 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 12189, 2024-04-26T18:47:05.458 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-04-26T18:47:05.458 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.458 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.458 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.458 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:05.459 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.459 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_ops": { 2024-04-26T18:47:05.459 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-04-26T18:47:05.459 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 1024, 2024-04-26T18:47:05.459 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-04-26T18:47:05.459 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-04-26T18:47:05.459 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-04-26T18:47:05.459 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-04-26T18:47:05.459 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-04-26T18:47:05.459 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 44, 2024-04-26T18:47:05.459 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 44, 2024-04-26T18:47:05.459 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 44, 2024-04-26T18:47:05.459 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 44, 2024-04-26T18:47:05.459 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-04-26T18:47:05.459 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.459 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.460 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.460 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:05.460 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.460 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle": { 2024-04-26T18:47:05.460 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-04-26T18:47:05.460 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-04-26T18:47:05.460 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-04-26T18:47:05.460 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-04-26T18:47:05.460 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-04-26T18:47:05.460 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-04-26T18:47:05.460 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-04-26T18:47:05.460 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-04-26T18:47:05.460 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-04-26T18:47:05.460 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 0, 2024-04-26T18:47:05.460 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 0, 2024-04-26T18:47:05.460 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-04-26T18:47:05.461 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.461 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.461 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.461 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:05.461 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:05.461 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle-0x55ad1c292500": { 2024-04-26T18:47:05.461 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-04-26T18:47:05.461 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-04-26T18:47:05.461 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-04-26T18:47:05.461 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 6, 2024-04-26T18:47:05.461 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 1652, 2024-04-26T18:47:05.461 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-04-26T18:47:05.461 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 6, 2024-04-26T18:47:05.461 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-04-26T18:47:05.461 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-04-26T18:47:05.461 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 5, 2024-04-26T18:47:05.462 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 1652, 2024-04-26T18:47:05.462 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-04-26T18:47:05.462 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:05.462 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:05.462 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:05.462 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:05.462 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:05.462 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-04-26T18:47:05.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:05 smithi080 ceph-mon[29135]: pgmap v330: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-26T18:47:05.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:05 smithi192 ceph-mon[32842]: pgmap v330: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-26T18:47:05.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:05 smithi082 ceph-mon[32808]: pgmap v330: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-26T18:47:06.205 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-04-26T18:47:06.205 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-04-26T18:47:06.205 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=0 2024-04-26T18:47:06.205 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-04-26T18:47:06.205 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-04-26T18:47:06.205 DEBUG:tasks.check_counter:Getting stats from l 2024-04-26T18:47:06.206 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph daemon mds.l perf dump 2024-04-26T18:47:06.445 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T18:47:07.597 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:07 smithi192 ceph-mon[32842]: pgmap v331: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T18:47:07.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:07 smithi080 ceph-mon[29135]: pgmap v331: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T18:47:07.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:07 smithi082 ceph-mon[32808]: pgmap v331: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T18:47:08.168 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-04-26T18:47:08.168 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T18:47:08.168 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 2392, 2024-04-26T18:47:08.168 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 2394, 2024-04-26T18:47:08.169 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 678051, 2024-04-26T18:47:08.169 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 760663, 2024-04-26T18:47:08.169 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 6, 2024-04-26T18:47:08.169 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 2, 2024-04-26T18:47:08.169 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.208245608, 2024-04-26T18:47:08.169 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.069871146, 2024-04-26T18:47:08.169 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.050341287, 2024-04-26T18:47:08.169 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.071590561, 2024-04-26T18:47:08.169 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:47:08.169 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2392, 2024-04-26T18:47:08.169 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.090907979, 2024-04-26T18:47:08.169 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000038005 2024-04-26T18:47:08.169 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.169 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:47:08.169 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.170 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.170 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.170 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.170 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-26T18:47:08.170 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 0 2024-04-26T18:47:08.170 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.170 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T18:47:08.170 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 274, 2024-04-26T18:47:08.170 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 259, 2024-04-26T18:47:08.170 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 1648140, 2024-04-26T18:47:08.170 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 151082, 2024-04-26T18:47:08.170 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 3, 2024-04-26T18:47:08.170 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 2, 2024-04-26T18:47:08.170 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.053576330, 2024-04-26T18:47:08.171 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.016139408, 2024-04-26T18:47:08.171 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.040883495, 2024-04-26T18:47:08.171 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.006484700, 2024-04-26T18:47:08.171 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:47:08.171 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 258, 2024-04-26T18:47:08.171 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.014653346, 2024-04-26T18:47:08.171 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000056795 2024-04-26T18:47:08.171 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.171 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:47:08.171 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.171 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.171 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.171 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.171 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 1647584, 2024-04-26T18:47:08.171 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 150384 2024-04-26T18:47:08.172 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.172 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T18:47:08.172 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 7, 2024-04-26T18:47:08.172 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 186, 2024-04-26T18:47:08.172 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 3580, 2024-04-26T18:47:08.172 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 473662, 2024-04-26T18:47:08.172 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 6, 2024-04-26T18:47:08.172 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 4, 2024-04-26T18:47:08.172 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.012071345, 2024-04-26T18:47:08.172 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.007489496, 2024-04-26T18:47:08.172 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.002244993, 2024-04-26T18:47:08.172 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.000025760, 2024-04-26T18:47:08.172 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T18:47:08.172 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 184, 2024-04-26T18:47:08.173 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.015432900, 2024-04-26T18:47:08.173 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000083874 2024-04-26T18:47:08.173 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.173 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-04-26T18:47:08.173 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.173 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.173 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.173 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.173 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-04-26T18:47:08.173 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 473344 2024-04-26T18:47:08.173 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.173 INFO:teuthology.orchestra.run.smithi192.stdout: "cct": { 2024-04-26T18:47:08.173 INFO:teuthology.orchestra.run.smithi192.stdout: "total_workers": 1, 2024-04-26T18:47:08.173 INFO:teuthology.orchestra.run.smithi192.stdout: "unhealthy_workers": 0 2024-04-26T18:47:08.173 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.173 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-MDSRank": { 2024-04-26T18:47:08.174 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-04-26T18:47:08.174 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-04-26T18:47:08.174 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 4045, 2024-04-26T18:47:08.174 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.110512891, 2024-04-26T18:47:08.174 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000027320 2024-04-26T18:47:08.174 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:08.174 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.174 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-PurgeQueue": { 2024-04-26T18:47:08.174 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-04-26T18:47:08.174 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-04-26T18:47:08.174 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.174 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.174 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.174 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:08.175 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.175 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": { 2024-04-26T18:47:08.175 INFO:teuthology.orchestra.run.smithi192.stdout: "request": 0, 2024-04-26T18:47:08.175 INFO:teuthology.orchestra.run.smithi192.stdout: "reply": 0, 2024-04-26T18:47:08.175 INFO:teuthology.orchestra.run.smithi192.stdout: "reply_latency": { 2024-04-26T18:47:08.175 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.175 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.175 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.175 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.175 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_reply": 0, 2024-04-26T18:47:08.175 INFO:teuthology.orchestra.run.smithi192.stdout: "forward": 0, 2024-04-26T18:47:08.175 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_complete": 0, 2024-04-26T18:47:08.175 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_keys": 0, 2024-04-26T18:47:08.175 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_commit": 0, 2024-04-26T18:47:08.175 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_split": 0, 2024-04-26T18:47:08.175 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_merge": 0, 2024-04-26T18:47:08.176 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes": 0, 2024-04-26T18:47:08.176 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_top": 0, 2024-04-26T18:47:08.176 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_bottom": 0, 2024-04-26T18:47:08.176 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pin_tail": 0, 2024-04-26T18:47:08.176 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pinned": 0, 2024-04-26T18:47:08.176 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_expired": 0, 2024-04-26T18:47:08.176 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_with_caps": 0, 2024-04-26T18:47:08.176 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": 0, 2024-04-26T18:47:08.176 INFO:teuthology.orchestra.run.smithi192.stdout: "subtrees": 1, 2024-04-26T18:47:08.176 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse": 0, 2024-04-26T18:47:08.176 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_hit": 0, 2024-04-26T18:47:08.176 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_forward": 0, 2024-04-26T18:47:08.176 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_discover": 0, 2024-04-26T18:47:08.176 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_dir_fetch": 0, 2024-04-26T18:47:08.176 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_remote_ino": 0, 2024-04-26T18:47:08.176 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_lock": 0, 2024-04-26T18:47:08.177 INFO:teuthology.orchestra.run.smithi192.stdout: "load_cent": 0, 2024-04-26T18:47:08.177 INFO:teuthology.orchestra.run.smithi192.stdout: "q": 0, 2024-04-26T18:47:08.177 INFO:teuthology.orchestra.run.smithi192.stdout: "exported": 0, 2024-04-26T18:47:08.177 INFO:teuthology.orchestra.run.smithi192.stdout: "exported_inodes": 0, 2024-04-26T18:47:08.177 INFO:teuthology.orchestra.run.smithi192.stdout: "imported": 0, 2024-04-26T18:47:08.177 INFO:teuthology.orchestra.run.smithi192.stdout: "imported_inodes": 0, 2024-04-26T18:47:08.177 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_dir_fetch": 0, 2024-04-26T18:47:08.177 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_backtrace_fetch": 0, 2024-04-26T18:47:08.177 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_peer_discover": 0, 2024-04-26T18:47:08.177 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rfiles": 0, 2024-04-26T18:47:08.177 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rbytes": 0, 2024-04-26T18:47:08.177 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rsnaps": 0, 2024-04-26T18:47:08.177 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T18:47:08.177 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_set_tag": 0, 2024-04-26T18:47:08.177 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T18:47:08.178 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_inotable_repaired": 0, 2024-04-26T18:47:08.178 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_inodes": 0, 2024-04-26T18:47:08.178 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T18:47:08.178 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T18:47:08.178 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_file_inodes": 0, 2024-04-26T18:47:08.178 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_inode_file_caps": 0, 2024-04-26T18:47:08.178 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_revoke": 0, 2024-04-26T18:47:08.178 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_grant": 0, 2024-04-26T18:47:08.178 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T18:47:08.178 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T18:47:08.178 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T18:47:08.178 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps": 0, 2024-04-26T18:47:08.178 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps_dirty": 0, 2024-04-26T18:47:08.178 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_cap_release": 0, 2024-04-26T18:47:08.179 INFO:teuthology.orchestra.run.smithi192.stdout: "process_request_cap_release": 0 2024-04-26T18:47:08.179 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.179 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_cache": { 2024-04-26T18:47:08.179 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update": 0, 2024-04-26T18:47:08.179 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update_receipt": 0, 2024-04-26T18:47:08.179 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_try_discover": 0, 2024-04-26T18:47:08.179 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_send_discover": 0, 2024-04-26T18:47:08.179 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_handle_discover": 0, 2024-04-26T18:47:08.179 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays": 0, 2024-04-26T18:47:08.179 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_delayed": 0, 2024-04-26T18:47:08.179 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_enqueuing": 0, 2024-04-26T18:47:08.179 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_created": 0, 2024-04-26T18:47:08.179 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_enqueued": 0, 2024-04-26T18:47:08.180 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_reintegrated": 0, 2024-04-26T18:47:08.180 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_migrated": 0, 2024-04-26T18:47:08.180 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_processing": 0, 2024-04-26T18:47:08.180 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_enqueued": 0, 2024-04-26T18:47:08.180 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_prioritized": 0, 2024-04-26T18:47:08.180 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_started": 0, 2024-04-26T18:47:08.180 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_completed": 0, 2024-04-26T18:47:08.180 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_path": 0, 2024-04-26T18:47:08.180 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_inode": 0, 2024-04-26T18:47:08.180 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T18:47:08.180 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_exportdir": 0, 2024-04-26T18:47:08.180 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_flush": 0, 2024-04-26T18:47:08.180 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragmentdir": 0, 2024-04-26T18:47:08.180 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragstats": 0, 2024-04-26T18:47:08.181 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_inodestats": 0 2024-04-26T18:47:08.181 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.181 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_log": { 2024-04-26T18:47:08.181 INFO:teuthology.orchestra.run.smithi192.stdout: "evlrg": 0, 2024-04-26T18:47:08.181 INFO:teuthology.orchestra.run.smithi192.stdout: "evadd": 0, 2024-04-26T18:47:08.181 INFO:teuthology.orchestra.run.smithi192.stdout: "evex": 0, 2024-04-26T18:47:08.181 INFO:teuthology.orchestra.run.smithi192.stdout: "evtrm": 0, 2024-04-26T18:47:08.181 INFO:teuthology.orchestra.run.smithi192.stdout: "ev": 6, 2024-04-26T18:47:08.181 INFO:teuthology.orchestra.run.smithi192.stdout: "evexg": 0, 2024-04-26T18:47:08.181 INFO:teuthology.orchestra.run.smithi192.stdout: "evexd": 0, 2024-04-26T18:47:08.181 INFO:teuthology.orchestra.run.smithi192.stdout: "segadd": 0, 2024-04-26T18:47:08.181 INFO:teuthology.orchestra.run.smithi192.stdout: "segex": 0, 2024-04-26T18:47:08.181 INFO:teuthology.orchestra.run.smithi192.stdout: "segtrm": 0, 2024-04-26T18:47:08.181 INFO:teuthology.orchestra.run.smithi192.stdout: "seg": 2, 2024-04-26T18:47:08.182 INFO:teuthology.orchestra.run.smithi192.stdout: "segmjr": 2, 2024-04-26T18:47:08.182 INFO:teuthology.orchestra.run.smithi192.stdout: "segexg": 0, 2024-04-26T18:47:08.182 INFO:teuthology.orchestra.run.smithi192.stdout: "segexd": 0, 2024-04-26T18:47:08.182 INFO:teuthology.orchestra.run.smithi192.stdout: "expos": 4194304, 2024-04-26T18:47:08.182 INFO:teuthology.orchestra.run.smithi192.stdout: "wrpos": 4195956, 2024-04-26T18:47:08.182 INFO:teuthology.orchestra.run.smithi192.stdout: "rdpos": 4195815, 2024-04-26T18:47:08.182 INFO:teuthology.orchestra.run.smithi192.stdout: "jlat": { 2024-04-26T18:47:08.182 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.182 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.182 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.182 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.182 INFO:teuthology.orchestra.run.smithi192.stdout: "replayed": 6 2024-04-26T18:47:08.182 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.182 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_mem": { 2024-04-26T18:47:08.183 INFO:teuthology.orchestra.run.smithi192.stdout: "ino": 3, 2024-04-26T18:47:08.183 INFO:teuthology.orchestra.run.smithi192.stdout: "ino+": 3, 2024-04-26T18:47:08.183 INFO:teuthology.orchestra.run.smithi192.stdout: "ino-": 0, 2024-04-26T18:47:08.183 INFO:teuthology.orchestra.run.smithi192.stdout: "dir": 1, 2024-04-26T18:47:08.183 INFO:teuthology.orchestra.run.smithi192.stdout: "dir+": 1, 2024-04-26T18:47:08.183 INFO:teuthology.orchestra.run.smithi192.stdout: "dir-": 0, 2024-04-26T18:47:08.183 INFO:teuthology.orchestra.run.smithi192.stdout: "dn": 0, 2024-04-26T18:47:08.183 INFO:teuthology.orchestra.run.smithi192.stdout: "dn+": 0, 2024-04-26T18:47:08.183 INFO:teuthology.orchestra.run.smithi192.stdout: "dn-": 0, 2024-04-26T18:47:08.183 INFO:teuthology.orchestra.run.smithi192.stdout: "cap": 0, 2024-04-26T18:47:08.183 INFO:teuthology.orchestra.run.smithi192.stdout: "cap+": 0, 2024-04-26T18:47:08.183 INFO:teuthology.orchestra.run.smithi192.stdout: "cap-": 0, 2024-04-26T18:47:08.183 INFO:teuthology.orchestra.run.smithi192.stdout: "rss": 49988, 2024-04-26T18:47:08.184 INFO:teuthology.orchestra.run.smithi192.stdout: "heap": 215416 2024-04-26T18:47:08.184 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.184 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_server": { 2024-04-26T18:47:08.184 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_client_request": 0, 2024-04-26T18:47:08.184 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_server_request": 0, 2024-04-26T18:47:08.184 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_request": 0, 2024-04-26T18:47:08.184 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_session": 0, 2024-04-26T18:47:08.184 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_peer_request": 0, 2024-04-26T18:47:08.184 INFO:teuthology.orchestra.run.smithi192.stdout: "req_create_latency": { 2024-04-26T18:47:08.184 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.184 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.184 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.184 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.184 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getattr_latency": { 2024-04-26T18:47:08.184 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.185 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.185 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.185 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.185 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getfilelock_latency": { 2024-04-26T18:47:08.185 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.185 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.185 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.185 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.185 INFO:teuthology.orchestra.run.smithi192.stdout: "req_link_latency": { 2024-04-26T18:47:08.185 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.185 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.185 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.185 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.185 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookup_latency": { 2024-04-26T18:47:08.186 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.186 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.186 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.186 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.186 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookuphash_latency": { 2024-04-26T18:47:08.186 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.186 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.186 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.186 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.186 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupino_latency": { 2024-04-26T18:47:08.186 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.186 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.186 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.186 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.186 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupname_latency": { 2024-04-26T18:47:08.187 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.187 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.187 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.187 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.187 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupparent_latency": { 2024-04-26T18:47:08.187 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.187 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.187 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.187 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.187 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupsnap_latency": { 2024-04-26T18:47:08.187 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.187 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.187 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.188 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.188 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lssnap_latency": { 2024-04-26T18:47:08.188 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.188 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.188 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.188 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.188 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mkdir_latency": { 2024-04-26T18:47:08.188 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.189 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.189 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.189 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.189 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mknod_latency": { 2024-04-26T18:47:08.189 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.189 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.189 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.189 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.189 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mksnap_latency": { 2024-04-26T18:47:08.189 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.189 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.189 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.189 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.190 INFO:teuthology.orchestra.run.smithi192.stdout: "req_open_latency": { 2024-04-26T18:47:08.190 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.190 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.190 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.190 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.190 INFO:teuthology.orchestra.run.smithi192.stdout: "req_readdir_latency": { 2024-04-26T18:47:08.190 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.190 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.190 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.190 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.190 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rename_latency": { 2024-04-26T18:47:08.190 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.190 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.190 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.191 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.191 INFO:teuthology.orchestra.run.smithi192.stdout: "req_renamesnap_latency": { 2024-04-26T18:47:08.191 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.191 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.191 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.191 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.191 INFO:teuthology.orchestra.run.smithi192.stdout: "req_snapdiff_latency": { 2024-04-26T18:47:08.191 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.191 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.191 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.191 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.191 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmdir_latency": { 2024-04-26T18:47:08.191 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.191 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.191 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.192 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.192 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmsnap_latency": { 2024-04-26T18:47:08.192 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.192 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.192 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.192 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.192 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmxattr_latency": { 2024-04-26T18:47:08.192 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.192 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.192 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.192 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.192 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setattr_latency": { 2024-04-26T18:47:08.192 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.192 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.193 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.193 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.193 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setdirlayout_latency": { 2024-04-26T18:47:08.193 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.193 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.193 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.193 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.193 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setfilelock_latency": { 2024-04-26T18:47:08.193 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.193 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.193 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.193 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.193 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setlayout_latency": { 2024-04-26T18:47:08.193 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.193 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.194 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.194 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.194 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setxattr_latency": { 2024-04-26T18:47:08.194 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.194 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.194 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.194 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.194 INFO:teuthology.orchestra.run.smithi192.stdout: "req_symlink_latency": { 2024-04-26T18:47:08.194 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.194 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.194 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.194 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.194 INFO:teuthology.orchestra.run.smithi192.stdout: "req_unlink_latency": { 2024-04-26T18:47:08.195 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.195 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.195 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.195 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.195 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_revoke_eviction": 0, 2024-04-26T18:47:08.195 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_acquisition_throttle": 0, 2024-04-26T18:47:08.195 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getvxattr_latency": { 2024-04-26T18:47:08.195 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.195 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.195 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.195 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:08.195 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.195 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_sessions": { 2024-04-26T18:47:08.195 INFO:teuthology.orchestra.run.smithi192.stdout: "session_count": 0, 2024-04-26T18:47:08.196 INFO:teuthology.orchestra.run.smithi192.stdout: "session_add": 2, 2024-04-26T18:47:08.196 INFO:teuthology.orchestra.run.smithi192.stdout: "session_remove": 2, 2024-04-26T18:47:08.196 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_open": 1, 2024-04-26T18:47:08.196 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_stale": 0, 2024-04-26T18:47:08.196 INFO:teuthology.orchestra.run.smithi192.stdout: "total_load": 0, 2024-04-26T18:47:08.196 INFO:teuthology.orchestra.run.smithi192.stdout: "average_load": 0, 2024-04-26T18:47:08.196 INFO:teuthology.orchestra.run.smithi192.stdout: "avg_session_uptime": 1274, 2024-04-26T18:47:08.196 INFO:teuthology.orchestra.run.smithi192.stdout: "mdthresh_evicted": 0 2024-04-26T18:47:08.196 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.196 INFO:teuthology.orchestra.run.smithi192.stdout: "mempool": { 2024-04-26T18:47:08.196 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_bytes": 0, 2024-04-26T18:47:08.196 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_items": 0, 2024-04-26T18:47:08.196 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T18:47:08.196 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_items": 0, 2024-04-26T18:47:08.196 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T18:47:08.197 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_items": 0, 2024-04-26T18:47:08.197 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T18:47:08.197 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T18:47:08.197 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T18:47:08.197 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T18:47:08.197 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T18:47:08.197 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_items": 0, 2024-04-26T18:47:08.197 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T18:47:08.197 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T18:47:08.197 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_bytes": 0, 2024-04-26T18:47:08.197 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_items": 0, 2024-04-26T18:47:08.197 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_bytes": 0, 2024-04-26T18:47:08.197 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_items": 0, 2024-04-26T18:47:08.197 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T18:47:08.198 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T18:47:08.198 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T18:47:08.198 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T18:47:08.198 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T18:47:08.198 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_items": 0, 2024-04-26T18:47:08.198 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_bytes": 0, 2024-04-26T18:47:08.198 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_items": 0, 2024-04-26T18:47:08.198 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T18:47:08.198 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T18:47:08.198 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_bytes": 0, 2024-04-26T18:47:08.198 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_items": 0, 2024-04-26T18:47:08.198 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_bytes": 0, 2024-04-26T18:47:08.198 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_items": 0, 2024-04-26T18:47:08.198 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T18:47:08.199 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_items": 0, 2024-04-26T18:47:08.199 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T18:47:08.199 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_items": 0, 2024-04-26T18:47:08.199 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_bytes": 182121, 2024-04-26T18:47:08.199 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_items": 49, 2024-04-26T18:47:08.199 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_bytes": 0, 2024-04-26T18:47:08.199 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_items": 0, 2024-04-26T18:47:08.199 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_bytes": 0, 2024-04-26T18:47:08.199 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_items": 0, 2024-04-26T18:47:08.199 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_bytes": 0, 2024-04-26T18:47:08.199 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_items": 0, 2024-04-26T18:47:08.199 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_bytes": 0, 2024-04-26T18:47:08.199 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_items": 0, 2024-04-26T18:47:08.199 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_bytes": 7936, 2024-04-26T18:47:08.200 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_items": 165, 2024-04-26T18:47:08.200 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T18:47:08.200 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_items": 0, 2024-04-26T18:47:08.200 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_bytes": 0, 2024-04-26T18:47:08.200 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_items": 0, 2024-04-26T18:47:08.200 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_bytes": 8512, 2024-04-26T18:47:08.200 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_items": 13, 2024-04-26T18:47:08.200 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_bytes": 0, 2024-04-26T18:47:08.200 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_items": 0, 2024-04-26T18:47:08.200 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_bytes": 0, 2024-04-26T18:47:08.200 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_items": 0 2024-04-26T18:47:08.200 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.200 INFO:teuthology.orchestra.run.smithi192.stdout: "objecter": { 2024-04-26T18:47:08.200 INFO:teuthology.orchestra.run.smithi192.stdout: "op_active": 0, 2024-04-26T18:47:08.200 INFO:teuthology.orchestra.run.smithi192.stdout: "op_laggy": 0, 2024-04-26T18:47:08.201 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send": 2395, 2024-04-26T18:47:08.201 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send_bytes": 21, 2024-04-26T18:47:08.201 INFO:teuthology.orchestra.run.smithi192.stdout: "op_resend": 3, 2024-04-26T18:47:08.201 INFO:teuthology.orchestra.run.smithi192.stdout: "op_reply": 2395, 2024-04-26T18:47:08.201 INFO:teuthology.orchestra.run.smithi192.stdout: "op_latency": { 2024-04-26T18:47:08.201 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2395, 2024-04-26T18:47:08.201 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 1.061979303, 2024-04-26T18:47:08.201 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000443415 2024-04-26T18:47:08.201 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.201 INFO:teuthology.orchestra.run.smithi192.stdout: "op_inflight": 0, 2024-04-26T18:47:08.201 INFO:teuthology.orchestra.run.smithi192.stdout: "oplen_avg": { 2024-04-26T18:47:08.201 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2395, 2024-04-26T18:47:08.201 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 2396 2024-04-26T18:47:08.201 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.201 INFO:teuthology.orchestra.run.smithi192.stdout: "op": 2395, 2024-04-26T18:47:08.202 INFO:teuthology.orchestra.run.smithi192.stdout: "op_r": 2395, 2024-04-26T18:47:08.202 INFO:teuthology.orchestra.run.smithi192.stdout: "op_w": 0, 2024-04-26T18:47:08.202 INFO:teuthology.orchestra.run.smithi192.stdout: "op_rmw": 0, 2024-04-26T18:47:08.202 INFO:teuthology.orchestra.run.smithi192.stdout: "op_pg": 0, 2024-04-26T18:47:08.202 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_stat": 1561, 2024-04-26T18:47:08.202 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_create": 0, 2024-04-26T18:47:08.202 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_read": 832, 2024-04-26T18:47:08.202 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_write": 0, 2024-04-26T18:47:08.202 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writefull": 0, 2024-04-26T18:47:08.202 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writesame": 0, 2024-04-26T18:47:08.202 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_append": 0, 2024-04-26T18:47:08.202 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_zero": 0, 2024-04-26T18:47:08.202 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_truncate": 0, 2024-04-26T18:47:08.202 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_delete": 0, 2024-04-26T18:47:08.202 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_mapext": 0, 2024-04-26T18:47:08.203 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_sparse_read": 0, 2024-04-26T18:47:08.203 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_clonerange": 0, 2024-04-26T18:47:08.203 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_getxattr": 1, 2024-04-26T18:47:08.203 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_setxattr": 0, 2024-04-26T18:47:08.203 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_cmpxattr": 0, 2024-04-26T18:47:08.203 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_rmxattr": 0, 2024-04-26T18:47:08.203 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_resetxattrs": 0, 2024-04-26T18:47:08.203 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_call": 0, 2024-04-26T18:47:08.203 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_watch": 0, 2024-04-26T18:47:08.203 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_notify": 0, 2024-04-26T18:47:08.203 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T18:47:08.203 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls": 0, 2024-04-26T18:47:08.203 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls_filter": 0, 2024-04-26T18:47:08.203 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_other": 0, 2024-04-26T18:47:08.203 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_active": 0, 2024-04-26T18:47:08.204 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_send": 0, 2024-04-26T18:47:08.204 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_resend": 0, 2024-04-26T18:47:08.204 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_ping": 0, 2024-04-26T18:47:08.204 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_active": 0, 2024-04-26T18:47:08.204 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_send": 0, 2024-04-26T18:47:08.204 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_resend": 0, 2024-04-26T18:47:08.204 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_active": 0, 2024-04-26T18:47:08.204 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_send": 0, 2024-04-26T18:47:08.204 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_resend": 0, 2024-04-26T18:47:08.204 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_active": 0, 2024-04-26T18:47:08.204 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_send": 0, 2024-04-26T18:47:08.204 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_resend": 0, 2024-04-26T18:47:08.204 INFO:teuthology.orchestra.run.smithi192.stdout: "command_active": 0, 2024-04-26T18:47:08.204 INFO:teuthology.orchestra.run.smithi192.stdout: "command_send": 0, 2024-04-26T18:47:08.205 INFO:teuthology.orchestra.run.smithi192.stdout: "command_resend": 0, 2024-04-26T18:47:08.205 INFO:teuthology.orchestra.run.smithi192.stdout: "map_epoch": 102, 2024-04-26T18:47:08.205 INFO:teuthology.orchestra.run.smithi192.stdout: "map_full": 0, 2024-04-26T18:47:08.205 INFO:teuthology.orchestra.run.smithi192.stdout: "map_inc": 13, 2024-04-26T18:47:08.205 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_sessions": 4, 2024-04-26T18:47:08.205 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_open": 4, 2024-04-26T18:47:08.205 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_close": 0, 2024-04-26T18:47:08.205 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_laggy": 0, 2024-04-26T18:47:08.205 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_wr": 0, 2024-04-26T18:47:08.205 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_rd": 2, 2024-04-26T18:47:08.205 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_del": 0 2024-04-26T18:47:08.205 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.205 INFO:teuthology.orchestra.run.smithi192.stdout: "oft": { 2024-04-26T18:47:08.205 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_objs": 0, 2024-04-26T18:47:08.205 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_kv_pairs": 0, 2024-04-26T18:47:08.206 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_updates": 0, 2024-04-26T18:47:08.206 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_removes": 0 2024-04-26T18:47:08.206 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.206 INFO:teuthology.orchestra.run.smithi192.stdout: "osd-slow-ops": { 2024-04-26T18:47:08.206 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_ops_count": 0 2024-04-26T18:47:08.206 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.206 INFO:teuthology.orchestra.run.smithi192.stdout: "purge_queue": { 2024-04-26T18:47:08.206 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops": 0, 2024-04-26T18:47:08.206 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops_high_water": 0, 2024-04-26T18:47:08.206 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing": 0, 2024-04-26T18:47:08.206 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_high_water": 0, 2024-04-26T18:47:08.206 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed_ops": 0, 2024-04-26T18:47:08.206 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed": 0, 2024-04-26T18:47:08.206 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_item_in_journal": 0 2024-04-26T18:47:08.207 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.207 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T18:47:08.207 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-04-26T18:47:08.207 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-04-26T18:47:08.207 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-04-26T18:47:08.207 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 2669, 2024-04-26T18:47:08.207 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 2072632, 2024-04-26T18:47:08.207 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-04-26T18:47:08.207 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 2669, 2024-04-26T18:47:08.207 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-04-26T18:47:08.207 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-04-26T18:47:08.207 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 2669, 2024-04-26T18:47:08.207 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 2072632, 2024-04-26T18:47:08.207 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-04-26T18:47:08.208 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.208 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.208 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.208 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:08.208 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.208 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_bytes": { 2024-04-26T18:47:08.208 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-04-26T18:47:08.208 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-04-26T18:47:08.208 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-04-26T18:47:08.208 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-04-26T18:47:08.208 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-04-26T18:47:08.208 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-04-26T18:47:08.208 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-04-26T18:47:08.208 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 2395, 2024-04-26T18:47:08.208 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 1657, 2024-04-26T18:47:08.209 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 2395, 2024-04-26T18:47:08.209 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 1657, 2024-04-26T18:47:08.209 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-04-26T18:47:08.209 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.209 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.209 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.209 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:08.209 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.209 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_ops": { 2024-04-26T18:47:08.209 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-04-26T18:47:08.209 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 1024, 2024-04-26T18:47:08.209 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-04-26T18:47:08.209 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-04-26T18:47:08.210 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-04-26T18:47:08.210 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-04-26T18:47:08.210 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-04-26T18:47:08.210 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 2395, 2024-04-26T18:47:08.210 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 2395, 2024-04-26T18:47:08.210 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 2395, 2024-04-26T18:47:08.210 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 2395, 2024-04-26T18:47:08.210 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-04-26T18:47:08.210 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.210 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.210 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.210 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:08.210 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.210 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle": { 2024-04-26T18:47:08.211 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-04-26T18:47:08.211 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-04-26T18:47:08.211 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-04-26T18:47:08.211 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-04-26T18:47:08.211 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-04-26T18:47:08.211 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-04-26T18:47:08.211 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-04-26T18:47:08.211 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-04-26T18:47:08.211 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-04-26T18:47:08.211 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 0, 2024-04-26T18:47:08.211 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 0, 2024-04-26T18:47:08.211 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-04-26T18:47:08.211 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.211 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.212 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.212 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:08.212 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-04-26T18:47:08.212 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle-0x55b6b7fc06e0": { 2024-04-26T18:47:08.212 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-04-26T18:47:08.212 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-04-26T18:47:08.212 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-04-26T18:47:08.212 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-04-26T18:47:08.212 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-04-26T18:47:08.212 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-04-26T18:47:08.212 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-04-26T18:47:08.212 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-04-26T18:47:08.212 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-04-26T18:47:08.212 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 0, 2024-04-26T18:47:08.212 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 0, 2024-04-26T18:47:08.213 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-04-26T18:47:08.213 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-04-26T18:47:08.213 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-04-26T18:47:08.213 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-04-26T18:47:08.213 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:08.213 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-04-26T18:47:08.213 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-04-26T18:47:08.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:08 smithi080 ceph-mon[29135]: osdmap e102: 12 total, 12 up, 12 in 2024-04-26T18:47:08.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:08 smithi192 ceph-mon[32842]: osdmap e102: 12 total, 12 up, 12 in 2024-04-26T18:47:08.961 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-04-26T18:47:08.961 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-04-26T18:47:08.961 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-04-26T18:47:08.961 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-04-26T18:47:08.961 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-04-26T18:47:08.961 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-26T18:47:08.972 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-26T18:47:08.972 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T18:47:08.972 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T18:47:08.973 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:08 smithi082 ceph-mon[32808]: osdmap e102: 12 total, 12 up, 12 in 2024-04-26T18:47:08.993 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-26T18:47:08.993 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T18:47:09.052 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd blocklist ls 2024-04-26T18:47:09.336 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:47:09.740 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:09 smithi080 ceph-mon[29135]: pgmap v333: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:47:09.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:09 smithi192 ceph-mon[32842]: pgmap v333: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:47:09.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:09 smithi082 ceph-mon[32808]: pgmap v333: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:47:11.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.061+0000 7f468652f700 1 -- 172.21.15.80:0/3598426965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46801094c0 msgr2=0x7f46801098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:11.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.061+0000 7f468652f700 1 --2- 172.21.15.80:0/3598426965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46801094c0 0x7f46801098a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4670009990 tx=0x7f4670009ca0 comp rx=0 tx=0).stop 2024-04-26T18:47:11.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.061+0000 7f468652f700 1 -- 172.21.15.80:0/3598426965 shutdown_connections 2024-04-26T18:47:11.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.061+0000 7f468652f700 1 --2- 172.21.15.80:0/3598426965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4680103e30 0x7f4680110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:11.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.061+0000 7f468652f700 1 --2- 172.21.15.80:0/3598426965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46801094c0 0x7f46801098a0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:11.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.061+0000 7f468652f700 1 --2- 172.21.15.80:0/3598426965 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4680103470 0x7f46801038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:11.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.061+0000 7f468652f700 1 -- 172.21.15.80:0/3598426965 >> 172.21.15.80:0/3598426965 conn(0x7f468007a580 msgr2=0x7f468007a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:47:11.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.061+0000 7f468652f700 1 -- 172.21.15.80:0/3598426965 shutdown_connections 2024-04-26T18:47:11.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.061+0000 7f468652f700 1 -- 172.21.15.80:0/3598426965 wait complete. 2024-04-26T18:47:11.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.062+0000 7f468652f700 1 Processor -- start 2024-04-26T18:47:11.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.062+0000 7f468652f700 1 -- start start 2024-04-26T18:47:11.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.062+0000 7f468652f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4680103470 0x7f4680075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:11.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.062+0000 7f468652f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4680103e30 0x7f4680075c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:11.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.062+0000 7f468652f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46801094c0 0x7f46800761a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:11.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.062+0000 7f468652f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4680113640 con 0x7f46801094c0 2024-04-26T18:47:11.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.062+0000 7f468652f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f46801134c0 con 0x7f4680103e30 2024-04-26T18:47:11.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.062+0000 7f468652f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f46801137c0 con 0x7f4680103470 2024-04-26T18:47:11.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.062+0000 7f4684acc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46801094c0 0x7f46800761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:11.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.062+0000 7f4684acc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46801094c0 0x7f46800761a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39530/0 (socket says 172.21.15.80:39530) 2024-04-26T18:47:11.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.062+0000 7f4684acc700 1 -- 172.21.15.80:0/2040196914 learned_addr learned my addr 172.21.15.80:0/2040196914 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:47:11.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.062+0000 7f467ffff700 1 --2- 172.21.15.80:0/2040196914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4680103470 0x7f4680075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:11.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.062+0000 7f467f7fe700 1 --2- 172.21.15.80:0/2040196914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4680103e30 0x7f4680075c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:11.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.063+0000 7f4684acc700 1 -- 172.21.15.80:0/2040196914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4680103470 msgr2=0x7f4680075720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:11.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.063+0000 7f4684acc700 1 --2- 172.21.15.80:0/2040196914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4680103470 0x7f4680075720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:11.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.063+0000 7f4684acc700 1 -- 172.21.15.80:0/2040196914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4680103e30 msgr2=0x7f4680075c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:11.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.063+0000 7f4684acc700 1 --2- 172.21.15.80:0/2040196914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4680103e30 0x7f4680075c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:11.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.063+0000 7f4684acc700 1 -- 172.21.15.80:0/2040196914 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46801a80a0 con 0x7f46801094c0 2024-04-26T18:47:11.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.063+0000 7f467ffff700 1 --2- 172.21.15.80:0/2040196914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4680103470 0x7f4680075720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:47:11.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.063+0000 7f4684acc700 1 --2- 172.21.15.80:0/2040196914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46801094c0 0x7f46800761a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4678007ee0 tx=0x7f467800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:47:11.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.063+0000 7f467d7fa700 1 -- 172.21.15.80:0/2040196914 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467800dbd0 con 0x7f46801094c0 2024-04-26T18:47:11.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.063+0000 7f468652f700 1 -- 172.21.15.80:0/2040196914 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46801a8390 con 0x7f46801094c0 2024-04-26T18:47:11.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.063+0000 7f467d7fa700 1 -- 172.21.15.80:0/2040196914 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f467800dd70 con 0x7f46801094c0 2024-04-26T18:47:11.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.063+0000 7f467d7fa700 1 -- 172.21.15.80:0/2040196914 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4678005990 con 0x7f46801094c0 2024-04-26T18:47:11.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.063+0000 7f468652f700 1 -- 172.21.15.80:0/2040196914 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46801a88d0 con 0x7f46801094c0 2024-04-26T18:47:11.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.064+0000 7f468652f700 1 -- 172.21.15.80:0/2040196914 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f468006a110 con 0x7f46801094c0 2024-04-26T18:47:11.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.066+0000 7f467d7fa700 1 -- 172.21.15.80:0/2040196914 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f467801a020 con 0x7f46801094c0 2024-04-26T18:47:11.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.066+0000 7f467d7fa700 1 --2- 172.21.15.80:0/2040196914 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f46680a3db0 0x7f46680a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:11.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.066+0000 7f467ffff700 1 --2- 172.21.15.80:0/2040196914 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f46680a3db0 0x7f46680a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:11.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.066+0000 7f467d7fa700 1 -- 172.21.15.80:0/2040196914 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8528+0+0 (secure 0 0 0) 0x7f46780d0740 con 0x7f46801094c0 2024-04-26T18:47:11.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.067+0000 7f467ffff700 1 --2- 172.21.15.80:0/2040196914 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f46680a3db0 0x7f46680a6270 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4670006010 tx=0x7f467000b540 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:47:11.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.070+0000 7f467d7fa700 1 -- 172.21.15.80:0/2040196914 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4678010070 con 0x7f46801094c0 2024-04-26T18:47:11.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.284+0000 7f468652f700 1 -- 172.21.15.80:0/2040196914 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f468002e490 con 0x7f46801094c0 2024-04-26T18:47:11.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.285+0000 7f467d7fa700 1 -- 172.21.15.80:0/2040196914 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v102) ==== 81+0+940 (secure 0 0 0) 0x7f467809cde0 con 0x7f46801094c0 2024-04-26T18:47:11.285 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:6800/179326828 2024-04-27T18:36:27.723494+0000 2024-04-26T18:47:11.286 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/601829731 2024-04-27T18:36:27.723494+0000 2024-04-26T18:47:11.286 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/2539501834 2024-04-27T18:36:27.723494+0000 2024-04-26T18:47:11.286 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/444150730 2024-04-27T18:36:27.723494+0000 2024-04-26T18:47:11.286 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:6801/1997155783 2024-04-27T18:25:50.413207+0000 2024-04-26T18:47:11.286 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/323607684 2024-04-27T18:25:50.413207+0000 2024-04-26T18:47:11.286 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/586397709 2024-04-27T18:25:50.413207+0000 2024-04-26T18:47:11.286 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:6801/4208962819 2024-04-27T18:25:24.440373+0000 2024-04-26T18:47:11.286 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/1353083127 2024-04-27T18:25:24.440373+0000 2024-04-26T18:47:11.286 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/2453252862 2024-04-27T18:36:27.723494+0000 2024-04-26T18:47:11.286 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:6801/179326828 2024-04-27T18:36:27.723494+0000 2024-04-26T18:47:11.286 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:6800/1997155783 2024-04-27T18:25:50.413207+0000 2024-04-26T18:47:11.286 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:6800/4208962819 2024-04-27T18:25:24.440373+0000 2024-04-26T18:47:11.286 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/2644175019 2024-04-27T18:25:24.440373+0000 2024-04-26T18:47:11.286 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/1853513470 2024-04-27T18:25:24.440373+0000 2024-04-26T18:47:11.287 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80:0/2122929159 2024-04-27T18:25:50.413207+0000 2024-04-26T18:47:11.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.287+0000 7f468652f700 1 -- 172.21.15.80:0/2040196914 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f46680a3db0 msgr2=0x7f46680a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:11.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.287+0000 7f468652f700 1 --2- 172.21.15.80:0/2040196914 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f46680a3db0 0x7f46680a6270 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4670006010 tx=0x7f467000b540 comp rx=0 tx=0).stop 2024-04-26T18:47:11.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.287+0000 7f468652f700 1 -- 172.21.15.80:0/2040196914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46801094c0 msgr2=0x7f46800761a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:11.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.287+0000 7f468652f700 1 --2- 172.21.15.80:0/2040196914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46801094c0 0x7f46800761a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4678007ee0 tx=0x7f467800d3b0 comp rx=0 tx=0).stop 2024-04-26T18:47:11.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.287+0000 7f468652f700 1 -- 172.21.15.80:0/2040196914 shutdown_connections 2024-04-26T18:47:11.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.287+0000 7f468652f700 1 --2- 172.21.15.80:0/2040196914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46801094c0 0x7f46800761a0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:11.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.287+0000 7f468652f700 1 --2- 172.21.15.80:0/2040196914 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f46680a3db0 0x7f46680a6270 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:11.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.287+0000 7f468652f700 1 --2- 172.21.15.80:0/2040196914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4680103470 0x7f4680075720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:11.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.287+0000 7f468652f700 1 --2- 172.21.15.80:0/2040196914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4680103e30 0x7f4680075c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:11.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.287+0000 7f468652f700 1 -- 172.21.15.80:0/2040196914 >> 172.21.15.80:0/2040196914 conn(0x7f468007a580 msgr2=0x7f4680102270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:47:11.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.287+0000 7f468652f700 1 -- 172.21.15.80:0/2040196914 shutdown_connections 2024-04-26T18:47:11.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:11.287+0000 7f468652f700 1 -- 172.21.15.80:0/2040196914 wait complete. 2024-04-26T18:47:11.289 INFO:teuthology.orchestra.run.smithi080.stderr:listed 16 entries 2024-04-26T18:47:11.771 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:11 smithi082 ceph-mon[32808]: pgmap v334: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:47:11.772 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:11 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/2040196914' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-26T18:47:11.856 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:11 smithi080 ceph-mon[29135]: pgmap v334: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:47:11.856 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:11 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2040196914' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-26T18:47:11.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:11 smithi192 ceph-mon[32842]: pgmap v334: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:47:11.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:11 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/2040196914' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-26T18:47:12.210 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T18:47:12.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T18:47:12.210 DEBUG:teuthology.orchestra.run.smithi080:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T18:47:12.250 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi080.front.sepia.ceph.com 2024-04-26T18:47:12.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T18:47:12.250 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T18:47:12.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T18:47:12.313 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-26T18:47:12.367 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T18:47:12.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T18:47:12.368 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T18:47:12.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T18:47:12.432 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link delete ceph-brx 2024-04-26T18:47:12.526 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-26T18:47:12.537 INFO:tasks.cephadm:Teardown begin 2024-04-26T18:47:12.538 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T18:47:12.538 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:47:12.777 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:47:13.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:13 smithi192 ceph-mon[32842]: pgmap v335: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:47:13.925 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:13 smithi080 ceph-mon[29135]: pgmap v335: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:47:13.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:13 smithi082 ceph-mon[32808]: pgmap v335: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-26T18:47:14.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.499+0000 7fced0dd8700 1 -- 172.21.15.80:0/2513876078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcecc102640 msgr2=0x7fcecc102aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:14.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.499+0000 7fced0dd8700 1 --2- 172.21.15.80:0/2513876078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcecc102640 0x7fcecc102aa0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fceb40099c0 tx=0x7fceb4009cd0 comp rx=0 tx=0).stop 2024-04-26T18:47:14.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.499+0000 7fced0dd8700 1 -- 172.21.15.80:0/2513876078 shutdown_connections 2024-04-26T18:47:14.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.499+0000 7fced0dd8700 1 --2- 172.21.15.80:0/2513876078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcecc102fe0 0x7fcecc10f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:14.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.499+0000 7fced0dd8700 1 --2- 172.21.15.80:0/2513876078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcecc108450 0x7fcecc108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:14.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.499+0000 7fced0dd8700 1 --2- 172.21.15.80:0/2513876078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcecc102640 0x7fcecc102aa0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:14.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.499+0000 7fced0dd8700 1 -- 172.21.15.80:0/2513876078 >> 172.21.15.80:0/2513876078 conn(0x7fcecc0790f0 msgr2=0x7fcecc079500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:47:14.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.499+0000 7fced0dd8700 1 -- 172.21.15.80:0/2513876078 shutdown_connections 2024-04-26T18:47:14.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.499+0000 7fced0dd8700 1 -- 172.21.15.80:0/2513876078 wait complete. 2024-04-26T18:47:14.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.500+0000 7fced0dd8700 1 Processor -- start 2024-04-26T18:47:14.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.500+0000 7fced0dd8700 1 -- start start 2024-04-26T18:47:14.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.500+0000 7fced0dd8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcecc102640 0x7fcecc19e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:14.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.500+0000 7fced0dd8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcecc102fe0 0x7fcecc19ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:14.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.500+0000 7fced0dd8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcecc108450 0x7fcecc198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:14.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.500+0000 7fced0dd8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcecc1124f0 con 0x7fcecc102640 2024-04-26T18:47:14.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.500+0000 7fced0dd8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcecc112370 con 0x7fcecc108450 2024-04-26T18:47:14.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.500+0000 7fced0dd8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcecc112670 con 0x7fcecc102fe0 2024-04-26T18:47:14.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.500+0000 7fceca59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcecc102640 0x7fcecc19e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:14.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.500+0000 7fceca59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcecc102640 0x7fcecc19e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48254/0 (socket says 172.21.15.80:48254) 2024-04-26T18:47:14.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.500+0000 7fceca59c700 1 -- 172.21.15.80:0/3979620483 learned_addr learned my addr 172.21.15.80:0/3979620483 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:47:14.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.500+0000 7fcecad9d700 1 --2- 172.21.15.80:0/3979620483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcecc108450 0x7fcecc198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:14.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.501+0000 7fcec1d9b700 1 --2- 172.21.15.80:0/3979620483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcecc102fe0 0x7fcecc19ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:14.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.501+0000 7fceca59c700 1 -- 172.21.15.80:0/3979620483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcecc102fe0 msgr2=0x7fcecc19ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:14.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.501+0000 7fceca59c700 1 --2- 172.21.15.80:0/3979620483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcecc102fe0 0x7fcecc19ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:14.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.501+0000 7fceca59c700 1 -- 172.21.15.80:0/3979620483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcecc108450 msgr2=0x7fcecc198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:14.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.501+0000 7fceca59c700 1 --2- 172.21.15.80:0/3979620483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcecc108450 0x7fcecc198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:14.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.501+0000 7fceca59c700 1 -- 172.21.15.80:0/3979620483 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcecc199010 con 0x7fcecc102640 2024-04-26T18:47:14.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.501+0000 7fceca59c700 1 --2- 172.21.15.80:0/3979620483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcecc102640 0x7fcecc19e6b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00e9c0 tx=0x7fcebc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:47:14.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.503+0000 7fcec3fff700 1 -- 172.21.15.80:0/3979620483 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc00cbd0 con 0x7fcecc102640 2024-04-26T18:47:14.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.503+0000 7fcec3fff700 1 -- 172.21.15.80:0/3979620483 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcebc00ee60 con 0x7fcecc102640 2024-04-26T18:47:14.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.503+0000 7fcec3fff700 1 -- 172.21.15.80:0/3979620483 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc0055c0 con 0x7fcecc102640 2024-04-26T18:47:14.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.503+0000 7fced0dd8700 1 -- 172.21.15.80:0/3979620483 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcecc199300 con 0x7fcecc102640 2024-04-26T18:47:14.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.503+0000 7fced0dd8700 1 -- 172.21.15.80:0/3979620483 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcecc06bb50 con 0x7fcecc102640 2024-04-26T18:47:14.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.504+0000 7fced0dd8700 1 -- 172.21.15.80:0/3979620483 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcecc103ab0 con 0x7fcecc102640 2024-04-26T18:47:14.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.505+0000 7fcec3fff700 1 -- 172.21.15.80:0/3979620483 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fcebc004750 con 0x7fcecc102640 2024-04-26T18:47:14.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.506+0000 7fcec3fff700 1 --2- 172.21.15.80:0/3979620483 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fceb80a3db0 0x7fceb80a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:14.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.506+0000 7fcec1d9b700 1 --2- 172.21.15.80:0/3979620483 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fceb80a3db0 0x7fceb80a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:14.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.506+0000 7fcec3fff700 1 -- 172.21.15.80:0/3979620483 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8484+0+0 (secure 0 0 0) 0x7fcebc0d09b0 con 0x7fcecc102640 2024-04-26T18:47:14.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.506+0000 7fcec1d9b700 1 --2- 172.21.15.80:0/3979620483 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fceb80a3db0 0x7fceb80a6270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0797d0 tx=0x7fceb4005fb0 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:47:14.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.510+0000 7fcec3fff700 1 -- 172.21.15.80:0/3979620483 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcebc09d070 con 0x7fcecc102640 2024-04-26T18:47:14.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.762+0000 7fced0dd8700 1 -- 172.21.15.80:0/3979620483 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcecc06c640 con 0x7fcecc102640 2024-04-26T18:47:14.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.763+0000 7fcec3fff700 1 -- 172.21.15.80:0/3979620483 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11921 (secure 0 0 0) 0x7fcebc09c970 con 0x7fcecc102640 2024-04-26T18:47:14.763 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:47:14.763 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1967550873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1967550873},{"type":"v1","addr":"172.21.15.80:6835","nonce":1967550873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/559541830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":559541830},{"type":"v1","addr":"172.21.15.80:6837","nonce":559541830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T18:33:08.347399+0000","modified":"2024-04-26T18:39:08.632950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24434,"mds_1":24421,"mds_2":24404,"mds_3":24400,"mds_4":24394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14577":{"gid":14577,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6839/2137993298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":2137993298},{"type":"v1","addr":"172.21.15.80:6839","nonce":2137993298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6841/1544670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1544670},{"type":"v1","addr":"172.21.15.80:6841","nonce":1544670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24371":{"gid":24371,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/3564539039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3564539039},{"type":"v1","addr":"172.21.15.82:6833","nonce":3564539039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24379":{"gid":24379,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.192:6835/719058020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":719058020},{"type":"v1","addr":"172.21.15.192:6835","nonce":719058020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.192:6837/2361996920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2361996920},{"type":"v1","addr":"172.21.15.192:6837","nonce":2361996920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.82:6837/2084055551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2084055551},{"type":"v1","addr":"172.21.15.82:6837","nonce":2084055551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6839/2735406056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":2735406056},{"type":"v1","addr":"172.21.15.192:6839","nonce":2735406056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.82:6839/1482576497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1482576497},{"type":"v1","addr":"172.21.15.82:6839","nonce":1482576497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25220":{"gid":25220,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/1661640740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1661640740},{"type":"v1","addr":"172.21.15.82:6835","nonce":1661640740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24434,"qdb_cluster":[24400,24421,24394,24434,24404]},"id":1}]} 2024-04-26T18:47:14.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.765+0000 7fced0dd8700 1 -- 172.21.15.80:0/3979620483 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fceb80a3db0 msgr2=0x7fceb80a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:14.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.765+0000 7fced0dd8700 1 --2- 172.21.15.80:0/3979620483 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fceb80a3db0 0x7fceb80a6270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0797d0 tx=0x7fceb4005fb0 comp rx=0 tx=0).stop 2024-04-26T18:47:14.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.765+0000 7fced0dd8700 1 -- 172.21.15.80:0/3979620483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcecc102640 msgr2=0x7fcecc19e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:14.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.765+0000 7fced0dd8700 1 --2- 172.21.15.80:0/3979620483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcecc102640 0x7fcecc19e6b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00e9c0 tx=0x7fcebc00ecd0 comp rx=0 tx=0).stop 2024-04-26T18:47:14.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.765+0000 7fced0dd8700 1 -- 172.21.15.80:0/3979620483 shutdown_connections 2024-04-26T18:47:14.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.765+0000 7fced0dd8700 1 --2- 172.21.15.80:0/3979620483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcecc108450 0x7fcecc198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:14.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.765+0000 7fced0dd8700 1 --2- 172.21.15.80:0/3979620483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcecc102640 0x7fcecc19e6b0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:14.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.765+0000 7fced0dd8700 1 --2- 172.21.15.80:0/3979620483 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fceb80a3db0 0x7fceb80a6270 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:14.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.765+0000 7fced0dd8700 1 --2- 172.21.15.80:0/3979620483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcecc102fe0 0x7fcecc19ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:14.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.765+0000 7fced0dd8700 1 -- 172.21.15.80:0/3979620483 >> 172.21.15.80:0/3979620483 conn(0x7fcecc0790f0 msgr2=0x7fcecc101480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:47:14.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.765+0000 7fced0dd8700 1 -- 172.21.15.80:0/3979620483 shutdown_connections 2024-04-26T18:47:14.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:14.765+0000 7fced0dd8700 1 -- 172.21.15.80:0/3979620483 wait complete. 2024-04-26T18:47:14.766 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 29 2024-04-26T18:47:15.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:15 smithi192 ceph-mon[32842]: pgmap v336: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 818 B/s wr, 11 op/s 2024-04-26T18:47:15.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:15 smithi192 ceph-mon[32842]: osdmap e103: 12 total, 12 up, 12 in 2024-04-26T18:47:15.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:15 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3979620483' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:47:15.396 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:15 smithi080 ceph-mon[29135]: pgmap v336: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 818 B/s wr, 11 op/s 2024-04-26T18:47:15.396 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:15 smithi080 ceph-mon[29135]: osdmap e103: 12 total, 12 up, 12 in 2024-04-26T18:47:15.396 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:15 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3979620483' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:47:15.425 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:47:15.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:15 smithi082 ceph-mon[32808]: pgmap v336: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 818 B/s wr, 11 op/s 2024-04-26T18:47:15.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:15 smithi082 ceph-mon[32808]: osdmap e103: 12 total, 12 up, 12 in 2024-04-26T18:47:15.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:15 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3979620483' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:47:15.667 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:47:17.202 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:17 smithi080 ceph-mon[29135]: pgmap v338: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 971 B/s wr, 13 op/s 2024-04-26T18:47:17.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:17 smithi192 ceph-mon[32842]: pgmap v338: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 971 B/s wr, 13 op/s 2024-04-26T18:47:17.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.452+0000 7f81cc470700 1 -- 172.21.15.80:0/2146984774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81c4101de0 msgr2=0x7f81c4102260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:17.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.452+0000 7f81cc470700 1 --2- 172.21.15.80:0/2146984774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81c4101de0 0x7f81c4102260 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009990 tx=0x7f81b4009ca0 comp rx=0 tx=0).stop 2024-04-26T18:47:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.453+0000 7f81cc470700 1 -- 172.21.15.80:0/2146984774 shutdown_connections 2024-04-26T18:47:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.453+0000 7f81cc470700 1 --2- 172.21.15.80:0/2146984774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c41027a0 0x7f81c4110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.453+0000 7f81cc470700 1 --2- 172.21.15.80:0/2146984774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c4108500 0x7f81c41088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.453+0000 7f81cc470700 1 --2- 172.21.15.80:0/2146984774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81c4101de0 0x7f81c4102260 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.453+0000 7f81cc470700 1 -- 172.21.15.80:0/2146984774 >> 172.21.15.80:0/2146984774 conn(0x7f81c4077640 msgr2=0x7f81c4077a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:47:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.453+0000 7f81cc470700 1 -- 172.21.15.80:0/2146984774 shutdown_connections 2024-04-26T18:47:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.453+0000 7f81cc470700 1 -- 172.21.15.80:0/2146984774 wait complete. 2024-04-26T18:47:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.453+0000 7f81cc470700 1 Processor -- start 2024-04-26T18:47:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.453+0000 7f81cc470700 1 -- start start 2024-04-26T18:47:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.453+0000 7f81cc470700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c4101de0 0x7f81c4102fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.453+0000 7f81cc470700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c41027a0 0x7f81c4103500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.454+0000 7f81cc470700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81c4108500 0x7f81c4103a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:17.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.454+0000 7f81cc470700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f81c41135f0 con 0x7f81c4108500 2024-04-26T18:47:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.454+0000 7f81cc470700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f81c4113470 con 0x7f81c4101de0 2024-04-26T18:47:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.454+0000 7f81cc470700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f81c4113770 con 0x7f81c41027a0 2024-04-26T18:47:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.454+0000 7f81caa0d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81c4108500 0x7f81c4103a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.454+0000 7f81caa0d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81c4108500 0x7f81c4103a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48278/0 (socket says 172.21.15.80:48278) 2024-04-26T18:47:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.454+0000 7f81caa0d700 1 -- 172.21.15.80:0/1228405244 learned_addr learned my addr 172.21.15.80:0/1228405244 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:47:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.454+0000 7f81c9a0b700 1 --2- 172.21.15.80:0/1228405244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c41027a0 0x7f81c4103500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.454+0000 7f81ca20c700 1 --2- 172.21.15.80:0/1228405244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c4101de0 0x7f81c4102fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.454+0000 7f81caa0d700 1 -- 172.21.15.80:0/1228405244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c41027a0 msgr2=0x7f81c4103500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.454+0000 7f81caa0d700 1 --2- 172.21.15.80:0/1228405244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c41027a0 0x7f81c4103500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.454+0000 7f81caa0d700 1 -- 172.21.15.80:0/1228405244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c4101de0 msgr2=0x7f81c4102fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.454+0000 7f81caa0d700 1 --2- 172.21.15.80:0/1228405244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c4101de0 0x7f81c4102fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.454+0000 7f81caa0d700 1 -- 172.21.15.80:0/1228405244 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c41a7f80 con 0x7f81c4108500 2024-04-26T18:47:17.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.454+0000 7f81ca20c700 1 --2- 172.21.15.80:0/1228405244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c4101de0 0x7f81c4102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:47:17.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.454+0000 7f81caa0d700 1 --2- 172.21.15.80:0/1228405244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81c4108500 0x7f81c4103a40 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f81bc00ada0 tx=0x7f81bc00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:47:17.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.454+0000 7f81bb7fe700 1 -- 172.21.15.80:0/1228405244 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc017020 con 0x7f81c4108500 2024-04-26T18:47:17.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.454+0000 7f81bb7fe700 1 -- 172.21.15.80:0/1228405244 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81bc00ce30 con 0x7f81c4108500 2024-04-26T18:47:17.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.454+0000 7f81bb7fe700 1 -- 172.21.15.80:0/1228405244 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc005350 con 0x7f81c4108500 2024-04-26T18:47:17.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.454+0000 7f81cc470700 1 -- 172.21.15.80:0/1228405244 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81c41a8270 con 0x7f81c4108500 2024-04-26T18:47:17.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.455+0000 7f81cc470700 1 -- 172.21.15.80:0/1228405244 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81c41a8780 con 0x7f81c4108500 2024-04-26T18:47:17.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.455+0000 7f81cc470700 1 -- 172.21.15.80:0/1228405244 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81c406b610 con 0x7f81c4108500 2024-04-26T18:47:17.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.457+0000 7f81bb7fe700 1 -- 172.21.15.80:0/1228405244 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f81bc00c980 con 0x7f81c4108500 2024-04-26T18:47:17.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.458+0000 7f81bb7fe700 1 --2- 172.21.15.80:0/1228405244 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f81b00a3e30 0x7f81b00a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:17.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.458+0000 7f81ca20c700 1 --2- 172.21.15.80:0/1228405244 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f81b00a3e30 0x7f81b00a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:17.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.458+0000 7f81bb7fe700 1 -- 172.21.15.80:0/1228405244 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8484+0+0 (secure 0 0 0) 0x7f81bc0d04c0 con 0x7f81c4108500 2024-04-26T18:47:17.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.458+0000 7f81ca20c700 1 --2- 172.21.15.80:0/1228405244 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f81b00a3e30 0x7f81b00a62f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f81c00059d0 tx=0x7f81c0005900 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:47:17.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.461+0000 7f81bb7fe700 1 -- 172.21.15.80:0/1228405244 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f81bc021020 con 0x7f81c4108500 2024-04-26T18:47:17.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:17 smithi082 ceph-mon[32808]: pgmap v338: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 971 B/s wr, 13 op/s 2024-04-26T18:47:17.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.712+0000 7f81cc470700 1 -- 172.21.15.80:0/1228405244 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81c402e490 con 0x7f81c4108500 2024-04-26T18:47:17.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.712+0000 7f81bb7fe700 1 -- 172.21.15.80:0/1228405244 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11921 (secure 0 0 0) 0x7f81bc01a310 con 0x7f81c4108500 2024-04-26T18:47:17.713 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:47:17.714 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/1967550873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1967550873},{"type":"v1","addr":"172.21.15.80:6835","nonce":1967550873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/559541830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6836","nonce":559541830},{"type":"v1","addr":"172.21.15.80:6837","nonce":559541830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T18:33:08.347399+0000","modified":"2024-04-26T18:39:08.632950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24434,"mds_1":24421,"mds_2":24404,"mds_3":24400,"mds_4":24394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14577":{"gid":14577,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6839/2137993298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":2137993298},{"type":"v1","addr":"172.21.15.80:6839","nonce":2137993298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.80:6841/1544670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6840","nonce":1544670},{"type":"v1","addr":"172.21.15.80:6841","nonce":1544670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24371":{"gid":24371,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/3564539039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3564539039},{"type":"v1","addr":"172.21.15.82:6833","nonce":3564539039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24379":{"gid":24379,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2905926211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2905926211},{"type":"v1","addr":"172.21.15.192:6833","nonce":2905926211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.192:6835/719058020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":719058020},{"type":"v1","addr":"172.21.15.192:6835","nonce":719058020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.192:6837/2361996920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2361996920},{"type":"v1","addr":"172.21.15.192:6837","nonce":2361996920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.82:6837/2084055551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2084055551},{"type":"v1","addr":"172.21.15.82:6837","nonce":2084055551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6839/2735406056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":2735406056},{"type":"v1","addr":"172.21.15.192:6839","nonce":2735406056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24434":{"gid":24434,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.82:6839/1482576497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1482576497},{"type":"v1","addr":"172.21.15.82:6839","nonce":1482576497}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25220":{"gid":25220,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/1661640740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1661640740},{"type":"v1","addr":"172.21.15.82:6835","nonce":1661640740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24434,"qdb_cluster":[24400,24421,24394,24434,24404]},"id":1}]} 2024-04-26T18:47:17.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.714+0000 7f81cc470700 1 -- 172.21.15.80:0/1228405244 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f81b00a3e30 msgr2=0x7f81b00a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:17.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.714+0000 7f81cc470700 1 --2- 172.21.15.80:0/1228405244 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f81b00a3e30 0x7f81b00a62f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f81c00059d0 tx=0x7f81c0005900 comp rx=0 tx=0).stop 2024-04-26T18:47:17.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.714+0000 7f81cc470700 1 -- 172.21.15.80:0/1228405244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81c4108500 msgr2=0x7f81c4103a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:17.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.715+0000 7f81cc470700 1 --2- 172.21.15.80:0/1228405244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81c4108500 0x7f81c4103a40 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f81bc00ada0 tx=0x7f81bc00c330 comp rx=0 tx=0).stop 2024-04-26T18:47:17.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.715+0000 7f81cc470700 1 -- 172.21.15.80:0/1228405244 shutdown_connections 2024-04-26T18:47:17.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.715+0000 7f81cc470700 1 --2- 172.21.15.80:0/1228405244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81c4108500 0x7f81c4103a40 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:17.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.715+0000 7f81cc470700 1 --2- 172.21.15.80:0/1228405244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c4101de0 0x7f81c4102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:17.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.715+0000 7f81cc470700 1 --2- 172.21.15.80:0/1228405244 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f81b00a3e30 0x7f81b00a62f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:17.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.715+0000 7f81cc470700 1 --2- 172.21.15.80:0/1228405244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c41027a0 0x7f81c4103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:17.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.715+0000 7f81cc470700 1 -- 172.21.15.80:0/1228405244 >> 172.21.15.80:0/1228405244 conn(0x7f81c4077640 msgr2=0x7f81c4100b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:47:17.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.715+0000 7f81cc470700 1 -- 172.21.15.80:0/1228405244 shutdown_connections 2024-04-26T18:47:17.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:17.715+0000 7f81cc470700 1 -- 172.21.15.80:0/1228405244 wait complete. 2024-04-26T18:47:17.719 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 29 2024-04-26T18:47:18.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:18 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/1228405244' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:47:18.399 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:18 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/1228405244' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:47:18.429 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T18:47:18.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:18 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/1228405244' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:47:18.666 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:47:19.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:19 smithi192 ceph-mon[32842]: pgmap v339: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 818 B/s wr, 11 op/s 2024-04-26T18:47:19.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:19 smithi082 ceph-mon[32808]: pgmap v339: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 818 B/s wr, 11 op/s 2024-04-26T18:47:19.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:19 smithi080 ceph-mon[29135]: pgmap v339: 97 pgs: 97 active+clean; 2.7 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 818 B/s wr, 11 op/s 2024-04-26T18:47:20.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.381+0000 7fb0189c9700 1 -- 172.21.15.80:0/165647989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0141085f0 msgr2=0x7fb0141089d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.381+0000 7fb0189c9700 1 --2- 172.21.15.80:0/165647989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0141085f0 0x7fb0141089d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb0040099c0 tx=0x7fb004009cd0 comp rx=0 tx=0).stop 2024-04-26T18:47:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.381+0000 7fb0189c9700 1 -- 172.21.15.80:0/165647989 shutdown_connections 2024-04-26T18:47:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.381+0000 7fb0189c9700 1 --2- 172.21.15.80:0/165647989 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb014103890 0x7fb01410f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.381+0000 7fb0189c9700 1 --2- 172.21.15.80:0/165647989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0141085f0 0x7fb0141089d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.381+0000 7fb0189c9700 1 --2- 172.21.15.80:0/165647989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb014102ed0 0x7fb014103350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.381+0000 7fb0189c9700 1 -- 172.21.15.80:0/165647989 >> 172.21.15.80:0/165647989 conn(0x7fb014077640 msgr2=0x7fb014077a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:47:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.382+0000 7fb0189c9700 1 -- 172.21.15.80:0/165647989 shutdown_connections 2024-04-26T18:47:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.382+0000 7fb0189c9700 1 -- 172.21.15.80:0/165647989 wait complete. 2024-04-26T18:47:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.382+0000 7fb0189c9700 1 Processor -- start 2024-04-26T18:47:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.382+0000 7fb0189c9700 1 -- start start 2024-04-26T18:47:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.383+0000 7fb0189c9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb014102ed0 0x7fb01419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.383+0000 7fb0189c9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb014103890 0x7fb01419af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.383+0000 7fb0189c9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0141085f0 0x7fb0141a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.383+0000 7fb0189c9700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb0141125f0 con 0x7fb0141085f0 2024-04-26T18:47:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.383+0000 7fb0189c9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb014112470 con 0x7fb014103890 2024-04-26T18:47:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.383+0000 7fb0189c9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb014112770 con 0x7fb014102ed0 2024-04-26T18:47:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.383+0000 7fb012d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0141085f0 0x7fb0141a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.383+0000 7fb012d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0141085f0 0x7fb0141a5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48294/0 (socket says 172.21.15.80:48294) 2024-04-26T18:47:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.383+0000 7fb012d9d700 1 -- 172.21.15.80:0/2741123586 learned_addr learned my addr 172.21.15.80:0/2741123586 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:47:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.383+0000 7fb01259c700 1 --2- 172.21.15.80:0/2741123586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb014102ed0 0x7fb01419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.383+0000 7fb011d9b700 1 --2- 172.21.15.80:0/2741123586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb014103890 0x7fb01419af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.383+0000 7fb012d9d700 1 -- 172.21.15.80:0/2741123586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb014102ed0 msgr2=0x7fb01419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.383+0000 7fb012d9d700 1 --2- 172.21.15.80:0/2741123586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb014102ed0 0x7fb01419aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.383+0000 7fb012d9d700 1 -- 172.21.15.80:0/2741123586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb014103890 msgr2=0x7fb01419af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.383+0000 7fb012d9d700 1 --2- 172.21.15.80:0/2741123586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb014103890 0x7fb01419af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.383+0000 7fb012d9d700 1 -- 172.21.15.80:0/2741123586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0141a5ff0 con 0x7fb0141085f0 2024-04-26T18:47:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.383+0000 7fb011d9b700 1 --2- 172.21.15.80:0/2741123586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb014103890 0x7fb01419af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:47:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.383+0000 7fb012d9d700 1 --2- 172.21.15.80:0/2741123586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0141085f0 0x7fb0141a5ab0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00ada0 tx=0x7fb00c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:47:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.383+0000 7fb0037fe700 1 -- 172.21.15.80:0/2741123586 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c018070 con 0x7fb0141085f0 2024-04-26T18:47:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.383+0000 7fb0037fe700 1 -- 172.21.15.80:0/2741123586 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb00c00a0d0 con 0x7fb0141085f0 2024-04-26T18:47:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.383+0000 7fb0189c9700 1 -- 172.21.15.80:0/2741123586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0141a6220 con 0x7fb0141085f0 2024-04-26T18:47:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.383+0000 7fb0037fe700 1 -- 172.21.15.80:0/2741123586 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c004290 con 0x7fb0141085f0 2024-04-26T18:47:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.383+0000 7fb0189c9700 1 -- 172.21.15.80:0/2741123586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0141a66e0 con 0x7fb0141085f0 2024-04-26T18:47:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.384+0000 7fb0189c9700 1 -- 172.21.15.80:0/2741123586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb01406a110 con 0x7fb0141085f0 2024-04-26T18:47:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.386+0000 7fb0037fe700 1 -- 172.21.15.80:0/2741123586 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fb00c01b070 con 0x7fb0141085f0 2024-04-26T18:47:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.386+0000 7fb0037fe700 1 --2- 172.21.15.80:0/2741123586 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7faffc0a3db0 0x7faffc0a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.386+0000 7fb01259c700 1 --2- 172.21.15.80:0/2741123586 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7faffc0a3db0 0x7faffc0a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.386+0000 7fb0037fe700 1 -- 172.21.15.80:0/2741123586 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8484+0+0 (secure 0 0 0) 0x7fb00c0cfa00 con 0x7fb0141085f0 2024-04-26T18:47:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.387+0000 7fb01259c700 1 --2- 172.21.15.80:0/2741123586 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7faffc0a3db0 0x7faffc0a6270 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb004009990 tx=0x7fb004009650 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:47:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.390+0000 7fb0037fe700 1 -- 172.21.15.80:0/2741123586 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb00c022080 con 0x7fb0141085f0 2024-04-26T18:47:20.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.592+0000 7fb0189c9700 1 -- 172.21.15.80:0/2741123586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb01402e490 con 0x7fb0141085f0 2024-04-26T18:47:20.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.594+0000 7fb0037fe700 1 -- 172.21.15.80:0/2741123586 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+23000 (secure 0 0 0) 0x7fb00c09c0c0 con 0x7fb0141085f0 2024-04-26T18:47:20.594 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-26T18:47:20.594 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":103,"fsid":"2187ca98-03fa-11ef-bc93-c7b262605968","created":"2024-04-26T18:24:58.809431+0000","modified":"2024-04-26T18:47:14.087489+0000","last_up_change":"2024-04-26T18:32:02.550187+0000","last_in_change":"2024-04-26T18:31:41.630932+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T18:28:14.502290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T18:33:02.102135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T18:33:05.300979+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":102,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a01cfe6-d13a-4828-8c20-ad7fee7e87ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6803","nonce":429487384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6805","nonce":429487384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6809","nonce":429487384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":429487384},{"type":"v1","addr":"172.21.15.80:6807","nonce":429487384}]},"public_addr":"172.21.15.80:6803/429487384","cluster_addr":"172.21.15.80:6805/429487384","heartbeat_back_addr":"172.21.15.80:6809/429487384","heartbeat_front_addr":"172.21.15.80:6807/429487384","state":["exists","up"]},{"osd":1,"uuid":"1f815d88-30b1-4540-b4f5-cc3d62707318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6801","nonce":3913033849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6803","nonce":3913033849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6807","nonce":3913033849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":3913033849},{"type":"v1","addr":"172.21.15.82:6805","nonce":3913033849}]},"public_addr":"172.21.15.82:6801/3913033849","cluster_addr":"172.21.15.82:6803/3913033849","heartbeat_back_addr":"172.21.15.82:6807/3913033849","heartbeat_front_addr":"172.21.15.82:6805/3913033849","state":["exists","up"]},{"osd":2,"uuid":"b8625dd7-4c1d-4258-ac2b-463ff96f4cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6801","nonce":503427508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6803","nonce":503427508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6807","nonce":503427508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":503427508},{"type":"v1","addr":"172.21.15.192:6805","nonce":503427508}]},"public_addr":"172.21.15.192:6801/503427508","cluster_addr":"172.21.15.192:6803/503427508","heartbeat_back_addr":"172.21.15.192:6807/503427508","heartbeat_front_addr":"172.21.15.192:6805/503427508","state":["exists","up"]},{"osd":3,"uuid":"3068321a-3070-44ae-9bbd-a3faac8c21fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6811","nonce":407817066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6813","nonce":407817066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6817","nonce":407817066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":407817066},{"type":"v1","addr":"172.21.15.80:6815","nonce":407817066}]},"public_addr":"172.21.15.80:6811/407817066","cluster_addr":"172.21.15.80:6813/407817066","heartbeat_back_addr":"172.21.15.80:6817/407817066","heartbeat_front_addr":"172.21.15.80:6815/407817066","state":["exists","up"]},{"osd":4,"uuid":"6b3d6455-9495-435b-8193-a260b63504ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6809","nonce":2068291934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6811","nonce":2068291934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6815","nonce":2068291934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2068291934},{"type":"v1","addr":"172.21.15.82:6813","nonce":2068291934}]},"public_addr":"172.21.15.82:6809/2068291934","cluster_addr":"172.21.15.82:6811/2068291934","heartbeat_back_addr":"172.21.15.82:6815/2068291934","heartbeat_front_addr":"172.21.15.82:6813/2068291934","state":["exists","up"]},{"osd":5,"uuid":"538863f1-1486-45b5-a675-ecb1d3035599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6809","nonce":1770809727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6811","nonce":1770809727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6815","nonce":1770809727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1770809727},{"type":"v1","addr":"172.21.15.192:6813","nonce":1770809727}]},"public_addr":"172.21.15.192:6809/1770809727","cluster_addr":"172.21.15.192:6811/1770809727","heartbeat_back_addr":"172.21.15.192:6815/1770809727","heartbeat_front_addr":"172.21.15.192:6813/1770809727","state":["exists","up"]},{"osd":6,"uuid":"7b4374d8-98e6-48e1-924b-c9b70a4baf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6819","nonce":145064490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6821","nonce":145064490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6825","nonce":145064490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":145064490},{"type":"v1","addr":"172.21.15.80:6823","nonce":145064490}]},"public_addr":"172.21.15.80:6819/145064490","cluster_addr":"172.21.15.80:6821/145064490","heartbeat_back_addr":"172.21.15.80:6825/145064490","heartbeat_front_addr":"172.21.15.80:6823/145064490","state":["exists","up"]},{"osd":7,"uuid":"f3bb3c7d-4cce-4f49-b924-72ebbaad58ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6817","nonce":208047447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6819","nonce":208047447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6823","nonce":208047447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":208047447},{"type":"v1","addr":"172.21.15.82:6821","nonce":208047447}]},"public_addr":"172.21.15.82:6817/208047447","cluster_addr":"172.21.15.82:6819/208047447","heartbeat_back_addr":"172.21.15.82:6823/208047447","heartbeat_front_addr":"172.21.15.82:6821/208047447","state":["exists","up"]},{"osd":8,"uuid":"6557b536-a516-4b01-a607-7981620fb2a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6817","nonce":3763069187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6819","nonce":3763069187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6823","nonce":3763069187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3763069187},{"type":"v1","addr":"172.21.15.192:6821","nonce":3763069187}]},"public_addr":"172.21.15.192:6817/3763069187","cluster_addr":"172.21.15.192:6819/3763069187","heartbeat_back_addr":"172.21.15.192:6823/3763069187","heartbeat_front_addr":"172.21.15.192:6821/3763069187","state":["exists","up"]},{"osd":9,"uuid":"838615a7-1e68-4e81-8b3a-fba0ea75f7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6827","nonce":2109877993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6829","nonce":2109877993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6833","nonce":2109877993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":2109877993},{"type":"v1","addr":"172.21.15.80:6831","nonce":2109877993}]},"public_addr":"172.21.15.80:6827/2109877993","cluster_addr":"172.21.15.80:6829/2109877993","heartbeat_back_addr":"172.21.15.80:6833/2109877993","heartbeat_front_addr":"172.21.15.80:6831/2109877993","state":["exists","up"]},{"osd":10,"uuid":"cd664e50-3217-453d-9a89-6e26d717e6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6825","nonce":2877220993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6827","nonce":2877220993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6831","nonce":2877220993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2877220993},{"type":"v1","addr":"172.21.15.82:6829","nonce":2877220993}]},"public_addr":"172.21.15.82:6825/2877220993","cluster_addr":"172.21.15.82:6827/2877220993","heartbeat_back_addr":"172.21.15.82:6831/2877220993","heartbeat_front_addr":"172.21.15.82:6829/2877220993","state":["exists","up"]},{"osd":11,"uuid":"e52807c6-8890-4df7-a8c6-51a7ff4b467b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6825","nonce":3466865106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6827","nonce":3466865106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6831","nonce":3466865106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3466865106},{"type":"v1","addr":"172.21.15.192:6829","nonce":3466865106}]},"public_addr":"172.21.15.192:6825/3466865106","cluster_addr":"172.21.15.192:6827/3466865106","heartbeat_back_addr":"172.21.15.192:6831/3466865106","heartbeat_front_addr":"172.21.15.192:6829/3466865106","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:27:23.385471+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:27:46.648232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:10.578970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:34.922048+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:28:59.142838+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:29:24.492250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:29:49.721803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:30:15.177027+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:30:41.544775+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:31:07.562401+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:31:33.498042+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T18:32:00.584085+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6800/179326828":"2024-04-27T18:36:27.723494+0000","172.21.15.80:0/601829731":"2024-04-27T18:36:27.723494+0000","172.21.15.80:0/2539501834":"2024-04-27T18:36:27.723494+0000","172.21.15.80:0/444150730":"2024-04-27T18:36:27.723494+0000","172.21.15.80:6801/1997155783":"2024-04-27T18:25:50.413207+0000","172.21.15.80:0/323607684":"2024-04-27T18:25:50.413207+0000","172.21.15.80:0/586397709":"2024-04-27T18:25:50.413207+0000","172.21.15.80:6801/4208962819":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/1353083127":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2453252862":"2024-04-27T18:36:27.723494+0000","172.21.15.80:6801/179326828":"2024-04-27T18:36:27.723494+0000","172.21.15.80:6800/1997155783":"2024-04-27T18:25:50.413207+0000","172.21.15.80:6800/4208962819":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2644175019":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/1853513470":"2024-04-27T18:25:24.440373+0000","172.21.15.80:0/2122929159":"2024-04-27T18:25:50.413207+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T18:47:20.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.596+0000 7fb0189c9700 1 -- 172.21.15.80:0/2741123586 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7faffc0a3db0 msgr2=0x7faffc0a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:20.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.596+0000 7fb0189c9700 1 --2- 172.21.15.80:0/2741123586 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7faffc0a3db0 0x7faffc0a6270 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb004009990 tx=0x7fb004009650 comp rx=0 tx=0).stop 2024-04-26T18:47:20.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.596+0000 7fb0189c9700 1 -- 172.21.15.80:0/2741123586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0141085f0 msgr2=0x7fb0141a5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:20.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.596+0000 7fb0189c9700 1 --2- 172.21.15.80:0/2741123586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0141085f0 0x7fb0141a5ab0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00ada0 tx=0x7fb00c00c330 comp rx=0 tx=0).stop 2024-04-26T18:47:20.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.596+0000 7fb0189c9700 1 -- 172.21.15.80:0/2741123586 shutdown_connections 2024-04-26T18:47:20.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.596+0000 7fb0189c9700 1 --2- 172.21.15.80:0/2741123586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0141085f0 0x7fb0141a5ab0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:20.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.596+0000 7fb0189c9700 1 --2- 172.21.15.80:0/2741123586 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7faffc0a3db0 0x7faffc0a6270 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:20.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.596+0000 7fb0189c9700 1 --2- 172.21.15.80:0/2741123586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb014102ed0 0x7fb01419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:20.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.596+0000 7fb0189c9700 1 --2- 172.21.15.80:0/2741123586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb014103890 0x7fb01419af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:20.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.596+0000 7fb0189c9700 1 -- 172.21.15.80:0/2741123586 >> 172.21.15.80:0/2741123586 conn(0x7fb014077640 msgr2=0x7fb0140ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:47:20.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.596+0000 7fb0189c9700 1 -- 172.21.15.80:0/2741123586 shutdown_connections 2024-04-26T18:47:20.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:20.596+0000 7fb0189c9700 1 -- 172.21.15.80:0/2741123586 wait complete. 2024-04-26T18:47:21.281 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs fail cephfs 2024-04-26T18:47:21.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:21 smithi192 ceph-mon[32842]: pgmap v340: 97 pgs: 97 active+clean; 2.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 11 op/s 2024-04-26T18:47:21.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:21 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/2741123586' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:47:21.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:21 smithi082 ceph-mon[32808]: pgmap v340: 97 pgs: 97 active+clean; 2.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 11 op/s 2024-04-26T18:47:21.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:21 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/2741123586' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:47:21.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:21 smithi080 ceph-mon[29135]: pgmap v340: 97 pgs: 97 active+clean; 2.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 11 op/s 2024-04-26T18:47:21.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:21 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2741123586' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T18:47:21.520 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:47:23.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.194+0000 7fecf3431700 1 -- 172.21.15.80:0/2959356431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecec102320 msgr2=0x7fecec1027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:23.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.194+0000 7fecf3431700 1 --2- 172.21.15.80:0/2959356431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecec102320 0x7fecec1027a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fece8009990 tx=0x7fece8009ca0 comp rx=0 tx=0).stop 2024-04-26T18:47:23.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.194+0000 7fecf3431700 1 -- 172.21.15.80:0/2959356431 shutdown_connections 2024-04-26T18:47:23.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.194+0000 7fecf3431700 1 --2- 172.21.15.80:0/2959356431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fecec102ce0 0x7fecec10f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:23.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.194+0000 7fecf3431700 1 --2- 172.21.15.80:0/2959356431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecec108390 0x7fecec108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:23.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.194+0000 7fecf3431700 1 --2- 172.21.15.80:0/2959356431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecec102320 0x7fecec1027a0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:23.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.194+0000 7fecf3431700 1 -- 172.21.15.80:0/2959356431 >> 172.21.15.80:0/2959356431 conn(0x7fecec0792d0 msgr2=0x7fecec0796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:47:23.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.194+0000 7fecf3431700 1 -- 172.21.15.80:0/2959356431 shutdown_connections 2024-04-26T18:47:23.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.194+0000 7fecf3431700 1 -- 172.21.15.80:0/2959356431 wait complete. 2024-04-26T18:47:23.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.195+0000 7fecf3431700 1 Processor -- start 2024-04-26T18:47:23.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.195+0000 7fecf3431700 1 -- start start 2024-04-26T18:47:23.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.195+0000 7fecf3431700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecec102320 0x7fecec104000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:23.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.195+0000 7fecf3431700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecec102ce0 0x7fecec104540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:23.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.195+0000 7fecf3431700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fecec108390 0x7fecec104a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:23.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.195+0000 7fecf3431700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fecec112580 con 0x7fecec102320 2024-04-26T18:47:23.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.195+0000 7fecf3431700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fecec112400 con 0x7fecec102ce0 2024-04-26T18:47:23.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.195+0000 7fecf3431700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fecec112700 con 0x7fecec108390 2024-04-26T18:47:23.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.195+0000 7fecf11cd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecec102320 0x7fecec104000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:23.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.195+0000 7fecf11cd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecec102320 0x7fecec104000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48310/0 (socket says 172.21.15.80:48310) 2024-04-26T18:47:23.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.195+0000 7fecf11cd700 1 -- 172.21.15.80:0/2151921820 learned_addr learned my addr 172.21.15.80:0/2151921820 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:47:23.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.195+0000 7fecf19ce700 1 --2- 172.21.15.80:0/2151921820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fecec108390 0x7fecec104a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:23.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.195+0000 7fecf09cc700 1 --2- 172.21.15.80:0/2151921820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecec102ce0 0x7fecec104540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:23.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.196+0000 7fecf11cd700 1 -- 172.21.15.80:0/2151921820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fecec108390 msgr2=0x7fecec104a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:23.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.196+0000 7fecf11cd700 1 --2- 172.21.15.80:0/2151921820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fecec108390 0x7fecec104a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:23.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.196+0000 7fecf11cd700 1 -- 172.21.15.80:0/2151921820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecec102ce0 msgr2=0x7fecec104540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:23.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.196+0000 7fecf11cd700 1 --2- 172.21.15.80:0/2151921820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecec102ce0 0x7fecec104540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:23.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.196+0000 7fecf11cd700 1 -- 172.21.15.80:0/2151921820 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecec1a8090 con 0x7fecec102320 2024-04-26T18:47:23.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.196+0000 7fecf11cd700 1 --2- 172.21.15.80:0/2151921820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecec102320 0x7fecec104000 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fecdc00d950 tx=0x7fecdc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:47:23.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.196+0000 7fece27fc700 1 -- 172.21.15.80:0/2151921820 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc016070 con 0x7fecec102320 2024-04-26T18:47:23.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.196+0000 7fece27fc700 1 -- 172.21.15.80:0/2151921820 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecdc00fd40 con 0x7fecec102320 2024-04-26T18:47:23.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.196+0000 7fecf3431700 1 -- 172.21.15.80:0/2151921820 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecec1a8380 con 0x7fecec102320 2024-04-26T18:47:23.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.196+0000 7fece27fc700 1 -- 172.21.15.80:0/2151921820 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc00e3b0 con 0x7fecec102320 2024-04-26T18:47:23.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.196+0000 7fecf3431700 1 -- 172.21.15.80:0/2151921820 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecec1a8890 con 0x7fecec102320 2024-04-26T18:47:23.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.197+0000 7fecf3431700 1 -- 172.21.15.80:0/2151921820 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecec06a110 con 0x7fecec102320 2024-04-26T18:47:23.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.199+0000 7fece27fc700 1 -- 172.21.15.80:0/2151921820 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fecdc019070 con 0x7fecec102320 2024-04-26T18:47:23.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.199+0000 7fece27fc700 1 --2- 172.21.15.80:0/2151921820 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fecd80a3db0 0x7fecd80a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:23.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.199+0000 7fecf09cc700 1 --2- 172.21.15.80:0/2151921820 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fecd80a3db0 0x7fecd80a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:23.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.199+0000 7fece27fc700 1 -- 172.21.15.80:0/2151921820 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8484+0+0 (secure 0 0 0) 0x7fecdc0d0220 con 0x7fecec102320 2024-04-26T18:47:23.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.200+0000 7fecf09cc700 1 --2- 172.21.15.80:0/2151921820 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fecd80a3db0 0x7fecd80a6270 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fecec105a90 tx=0x7fece8005a90 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:47:23.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.203+0000 7fece27fc700 1 -- 172.21.15.80:0/2151921820 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fecdc09c8e0 con 0x7fecec102320 2024-04-26T18:47:23.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:23 smithi080 ceph-mon[29135]: pgmap v341: 97 pgs: 97 active+clean; 2.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 11 op/s 2024-04-26T18:47:23.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:23 smithi192 ceph-mon[32842]: pgmap v341: 97 pgs: 97 active+clean; 2.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 11 op/s 2024-04-26T18:47:23.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.446+0000 7fecf3431700 1 -- 172.21.15.80:0/2151921820 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fecec1a8b20 con 0x7fecec102320 2024-04-26T18:47:23.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.450+0000 7fece27fc700 1 -- 172.21.15.80:0/2151921820 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) ==== 161+0+0 (secure 0 0 0) 0x7fecdc09c1e0 con 0x7fecec102320 2024-04-26T18:47:23.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.454+0000 7fecf3431700 1 -- 172.21.15.80:0/2151921820 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fecd80a3db0 msgr2=0x7fecd80a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:23.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.454+0000 7fecf3431700 1 --2- 172.21.15.80:0/2151921820 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fecd80a3db0 0x7fecd80a6270 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fecec105a90 tx=0x7fece8005a90 comp rx=0 tx=0).stop 2024-04-26T18:47:23.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.454+0000 7fecf3431700 1 -- 172.21.15.80:0/2151921820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecec102320 msgr2=0x7fecec104000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:23.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.454+0000 7fecf3431700 1 --2- 172.21.15.80:0/2151921820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecec102320 0x7fecec104000 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fecdc00d950 tx=0x7fecdc00dc60 comp rx=0 tx=0).stop 2024-04-26T18:47:23.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.454+0000 7fecf3431700 1 -- 172.21.15.80:0/2151921820 shutdown_connections 2024-04-26T18:47:23.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.454+0000 7fecf3431700 1 --2- 172.21.15.80:0/2151921820 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fecd80a3db0 0x7fecd80a6270 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:23.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.454+0000 7fecf3431700 1 --2- 172.21.15.80:0/2151921820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fecec108390 0x7fecec104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:23.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.454+0000 7fecf3431700 1 --2- 172.21.15.80:0/2151921820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecec102320 0x7fecec104000 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:23.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.454+0000 7fecf3431700 1 --2- 172.21.15.80:0/2151921820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecec102ce0 0x7fecec104540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:23.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.454+0000 7fecf3431700 1 -- 172.21.15.80:0/2151921820 >> 172.21.15.80:0/2151921820 conn(0x7fecec0792d0 msgr2=0x7fecec101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:47:23.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.454+0000 7fecf3431700 1 -- 172.21.15.80:0/2151921820 shutdown_connections 2024-04-26T18:47:23.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:23.455+0000 7fecf3431700 1 -- 172.21.15.80:0/2151921820 wait complete. 2024-04-26T18:47:23.456 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T18:47:23.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:23 smithi082 ceph-mon[32808]: pgmap v341: 97 pgs: 97 active+clean; 2.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 11 op/s 2024-04-26T18:47:23.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-a[29131]: 2024-04-26T18:47:23.447+0000 7f65096a7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T18:47:23.743 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 26 18:47:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-g[68699]: ignoring --setuser ceph since I am not root 2024-04-26T18:47:23.743 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 26 18:47:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-g[68699]: ignoring --setgroup ceph since I am not root 2024-04-26T18:47:23.744 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 26 18:47:23 smithi080 ceph-mds[68725]: -- 172.21.15.80:0/3568104745 <== mon.0 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561aca69da40 con 0x561aca670800 2024-04-26T18:47:23.744 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 26 18:47:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-g[68699]: starting mds.g at 2024-04-26T18:47:23.744 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 26 18:47:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-a[69058]: ignoring --setuser ceph since I am not root 2024-04-26T18:47:23.744 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 26 18:47:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-a[69058]: ignoring --setgroup ceph since I am not root 2024-04-26T18:47:23.744 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 26 18:47:23 smithi080 ceph-mds[69076]: -- 172.21.15.80:0/936646864 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55840099fa40 con 0x558400972800 2024-04-26T18:47:23.744 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 26 18:47:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-a[69058]: starting mds.a at 2024-04-26T18:47:23.862 INFO:journalctl@ceph.mds.l.smithi192.stdout:Apr 26 18:47:23 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-l[62343]: ignoring --setuser ceph since I am not root 2024-04-26T18:47:23.863 INFO:journalctl@ceph.mds.l.smithi192.stdout:Apr 26 18:47:23 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-l[62343]: ignoring --setgroup ceph since I am not root 2024-04-26T18:47:23.863 INFO:journalctl@ceph.mds.l.smithi192.stdout:Apr 26 18:47:23 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-l[62343]: starting mds.l at 2024-04-26T18:47:23.863 INFO:journalctl@ceph.mds.c.smithi192.stdout:Apr 26 18:47:23 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-c[62967]: ignoring --setuser ceph since I am not root 2024-04-26T18:47:23.863 INFO:journalctl@ceph.mds.c.smithi192.stdout:Apr 26 18:47:23 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-c[62967]: ignoring --setgroup ceph since I am not root 2024-04-26T18:47:23.863 INFO:journalctl@ceph.mds.c.smithi192.stdout:Apr 26 18:47:23 smithi192 ceph-mds[62971]: -- 172.21.15.192:0/1912243118 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562dbb7c7a40 con 0x562dbb79ac00 2024-04-26T18:47:23.863 INFO:journalctl@ceph.mds.c.smithi192.stdout:Apr 26 18:47:23 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-c[62967]: starting mds.c at 2024-04-26T18:47:23.864 INFO:journalctl@ceph.mds.f.smithi192.stdout:Apr 26 18:47:23 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-f[62651]: ignoring --setuser ceph since I am not root 2024-04-26T18:47:23.864 INFO:journalctl@ceph.mds.f.smithi192.stdout:Apr 26 18:47:23 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-f[62651]: ignoring --setgroup ceph since I am not root 2024-04-26T18:47:23.864 INFO:journalctl@ceph.mds.f.smithi192.stdout:Apr 26 18:47:23 smithi192 ceph-mds[62660]: -- 172.21.15.192:0/875006854 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56479c0a5a40 con 0x56479c078800 2024-04-26T18:47:23.864 INFO:journalctl@ceph.mds.f.smithi192.stdout:Apr 26 18:47:23 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-f[62651]: starting mds.f at 2024-04-26T18:47:23.864 INFO:journalctl@ceph.mds.i.smithi192.stdout:Apr 26 18:47:23 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-i[63277]: ignoring --setuser ceph since I am not root 2024-04-26T18:47:23.864 INFO:journalctl@ceph.mds.i.smithi192.stdout:Apr 26 18:47:23 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-i[63277]: ignoring --setgroup ceph since I am not root 2024-04-26T18:47:23.864 INFO:journalctl@ceph.mds.i.smithi192.stdout:Apr 26 18:47:23 smithi192 ceph-mds[63281]: -- 172.21.15.192:0/3917984733 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561195b2ba40 con 0x561195afec00 2024-04-26T18:47:23.864 INFO:journalctl@ceph.mds.i.smithi192.stdout:Apr 26 18:47:23 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-i[63277]: starting mds.i at 2024-04-26T18:47:23.970 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 26 18:47:23 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-h[63210]: ignoring --setuser ceph since I am not root 2024-04-26T18:47:23.970 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 26 18:47:23 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-h[63210]: ignoring --setgroup ceph since I am not root 2024-04-26T18:47:23.970 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 26 18:47:23 smithi082 ceph-mds[63214]: -- 172.21.15.82:0/2894441274 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5629718e9a40 con 0x5629718bd000 2024-04-26T18:47:23.970 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 26 18:47:23 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-h[63210]: starting mds.h at 2024-04-26T18:47:23.970 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 26 18:47:23 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-b[63537]: ignoring --setuser ceph since I am not root 2024-04-26T18:47:23.970 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 26 18:47:23 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-b[63537]: ignoring --setgroup ceph since I am not root 2024-04-26T18:47:23.970 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 26 18:47:23 smithi082 ceph-mds[63541]: -- 172.21.15.82:0/1306851700 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d5461cfa40 con 0x55d5461a2800 2024-04-26T18:47:23.970 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 26 18:47:23 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-b[63537]: starting mds.b at 2024-04-26T18:47:23.971 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 26 18:47:23 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-e[62895]: ignoring --setuser ceph since I am not root 2024-04-26T18:47:23.971 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 26 18:47:23 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-e[62895]: ignoring --setgroup ceph since I am not root 2024-04-26T18:47:23.971 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 26 18:47:23 smithi082 ceph-mds[62899]: -- 172.21.15.82:0/2454911878 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cde620ba40 con 0x55cde61df000 2024-04-26T18:47:23.971 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 26 18:47:23 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-e[62895]: starting mds.e at 2024-04-26T18:47:23.971 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 26 18:47:23 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-k[62579]: ignoring --setuser ceph since I am not root 2024-04-26T18:47:23.971 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 26 18:47:23 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-k[62579]: ignoring --setgroup ceph since I am not root 2024-04-26T18:47:23.971 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 26 18:47:23 smithi082 ceph-mds[62583]: -- 172.21.15.82:0/1715850447 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ad0dddba40 con 0x55ad0ddae800 2024-04-26T18:47:23.971 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 26 18:47:23 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-k[62579]: starting mds.k at 2024-04-26T18:47:24.143 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T18:47:24.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:24 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/2151921820' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-26T18:47:24.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:24 smithi192 ceph-mon[32842]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:47:24.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:24 smithi192 ceph-mon[32842]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T18:47:24.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:24 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/2151921820' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-26T18:47:24.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:24 smithi192 ceph-mon[32842]: osdmap e104: 12 total, 12 up, 12 in 2024-04-26T18:47:24.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:24 smithi192 ceph-mon[32842]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-26T18:47:24.379 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:47:24.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:24 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/2151921820' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-26T18:47:24.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:24 smithi082 ceph-mon[32808]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:47:24.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:24 smithi082 ceph-mon[32808]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T18:47:24.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:24 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/2151921820' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-26T18:47:24.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:24 smithi082 ceph-mon[32808]: osdmap e104: 12 total, 12 up, 12 in 2024-04-26T18:47:24.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:24 smithi082 ceph-mon[32808]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-26T18:47:24.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:24 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2151921820' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-26T18:47:24.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:24 smithi080 ceph-mon[29135]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:47:24.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:24 smithi080 ceph-mon[29135]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T18:47:24.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:24 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2151921820' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-26T18:47:24.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:24 smithi080 ceph-mon[29135]: osdmap e104: 12 total, 12 up, 12 in 2024-04-26T18:47:24.493 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:24 smithi080 ceph-mon[29135]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-26T18:47:25.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:25 smithi082 ceph-mon[32808]: pgmap v343: 97 pgs: 97 active+clean; 2.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-26T18:47:25.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:25 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.80:6838/3614187619,v1:172.21.15.80:6839/3614187619] up:boot 2024-04-26T18:47:25.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:25 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.192:6832/3402538123,v1:172.21.15.192:6834/3402538123] up:boot 2024-04-26T18:47:25.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:25 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.192:6833/1671926397,v1:172.21.15.192:6835/1671926397] up:boot 2024-04-26T18:47:25.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:25 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.80:6840/4031284136,v1:172.21.15.80:6841/4031284136] up:boot 2024-04-26T18:47:25.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:25 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.82:6832/2418356926,v1:172.21.15.82:6835/2418356926] up:boot 2024-04-26T18:47:25.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:25 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.82:6834/1338746917,v1:172.21.15.82:6838/1338746917] up:boot 2024-04-26T18:47:25.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:25 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.82:6836/93370207,v1:172.21.15.82:6839/93370207] up:boot 2024-04-26T18:47:25.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:25 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.192:6836/1772025614,v1:172.21.15.192:6838/1772025614] up:boot 2024-04-26T18:47:25.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:25 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.82:6833/2852752207,v1:172.21.15.82:6837/2852752207] up:boot 2024-04-26T18:47:25.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:25 smithi082 ceph-mon[32808]: mds.? [v2:172.21.15.192:6837/960806817,v1:172.21.15.192:6839/960806817] up:boot 2024-04-26T18:47:25.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:25 smithi082 ceph-mon[32808]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-04-26T18:47:25.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:25 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T18:47:25.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:25 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T18:47:25.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:25 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T18:47:25.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:25 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T18:47:25.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:25 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T18:47:25.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:25 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T18:47:25.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:25 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T18:47:25.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:25 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T18:47:25.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:25 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T18:47:25.721 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:25 smithi082 ceph-mon[32808]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T18:47:25.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:25 smithi080 ceph-mon[29135]: pgmap v343: 97 pgs: 97 active+clean; 2.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-26T18:47:25.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:25 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.80:6838/3614187619,v1:172.21.15.80:6839/3614187619] up:boot 2024-04-26T18:47:25.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:25 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.192:6832/3402538123,v1:172.21.15.192:6834/3402538123] up:boot 2024-04-26T18:47:25.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:25 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.192:6833/1671926397,v1:172.21.15.192:6835/1671926397] up:boot 2024-04-26T18:47:25.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:25 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.80:6840/4031284136,v1:172.21.15.80:6841/4031284136] up:boot 2024-04-26T18:47:25.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:25 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.82:6832/2418356926,v1:172.21.15.82:6835/2418356926] up:boot 2024-04-26T18:47:25.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:25 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.82:6834/1338746917,v1:172.21.15.82:6838/1338746917] up:boot 2024-04-26T18:47:25.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:25 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.82:6836/93370207,v1:172.21.15.82:6839/93370207] up:boot 2024-04-26T18:47:25.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:25 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.192:6836/1772025614,v1:172.21.15.192:6838/1772025614] up:boot 2024-04-26T18:47:25.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:25 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.82:6833/2852752207,v1:172.21.15.82:6837/2852752207] up:boot 2024-04-26T18:47:25.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:25 smithi080 ceph-mon[29135]: mds.? [v2:172.21.15.192:6837/960806817,v1:172.21.15.192:6839/960806817] up:boot 2024-04-26T18:47:25.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:25 smithi080 ceph-mon[29135]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-04-26T18:47:25.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:25 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T18:47:25.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:25 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T18:47:25.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:25 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T18:47:25.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:25 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T18:47:25.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:25 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T18:47:25.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:25 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T18:47:25.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:25 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T18:47:25.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:25 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T18:47:25.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:25 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T18:47:25.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:25 smithi080 ceph-mon[29135]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T18:47:25.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:25 smithi192 ceph-mon[32842]: pgmap v343: 97 pgs: 97 active+clean; 2.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-26T18:47:25.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:25 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.80:6838/3614187619,v1:172.21.15.80:6839/3614187619] up:boot 2024-04-26T18:47:25.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:25 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.192:6832/3402538123,v1:172.21.15.192:6834/3402538123] up:boot 2024-04-26T18:47:25.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:25 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.192:6833/1671926397,v1:172.21.15.192:6835/1671926397] up:boot 2024-04-26T18:47:25.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:25 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.80:6840/4031284136,v1:172.21.15.80:6841/4031284136] up:boot 2024-04-26T18:47:25.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:25 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.82:6832/2418356926,v1:172.21.15.82:6835/2418356926] up:boot 2024-04-26T18:47:25.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:25 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.82:6834/1338746917,v1:172.21.15.82:6838/1338746917] up:boot 2024-04-26T18:47:25.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:25 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.82:6836/93370207,v1:172.21.15.82:6839/93370207] up:boot 2024-04-26T18:47:25.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:25 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.192:6836/1772025614,v1:172.21.15.192:6838/1772025614] up:boot 2024-04-26T18:47:25.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:25 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.82:6833/2852752207,v1:172.21.15.82:6837/2852752207] up:boot 2024-04-26T18:47:25.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:25 smithi192 ceph-mon[32842]: mds.? [v2:172.21.15.192:6837/960806817,v1:172.21.15.192:6839/960806817] up:boot 2024-04-26T18:47:25.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:25 smithi192 ceph-mon[32842]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-04-26T18:47:25.863 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:25 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T18:47:25.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:25 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T18:47:25.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:25 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T18:47:25.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:25 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T18:47:25.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:25 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T18:47:25.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:25 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T18:47:25.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:25 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T18:47:25.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:25 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T18:47:25.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:25 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T18:47:25.864 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:25 smithi192 ceph-mon[32842]: from='mgr.24736 172.21.15.80:0/2013379832' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T18:47:26.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.088+0000 7f70b184c700 1 -- 172.21.15.80:0/3876487214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70ac06b130 msgr2=0x7f70ac06b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:26.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.088+0000 7f70b184c700 1 --2- 172.21.15.80:0/3876487214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70ac06b130 0x7f70ac06b510 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f709c009990 tx=0x7f709c009ca0 comp rx=0 tx=0).stop 2024-04-26T18:47:26.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.088+0000 7f70b184c700 1 -- 172.21.15.80:0/3876487214 shutdown_connections 2024-04-26T18:47:26.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.088+0000 7f70b184c700 1 --2- 172.21.15.80:0/3876487214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70ac10fed0 0x7f70ac1122c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:26.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.088+0000 7f70b184c700 1 --2- 172.21.15.80:0/3876487214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70ac06b130 0x7f70ac06b510 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:26.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.088+0000 7f70b184c700 1 --2- 172.21.15.80:0/3876487214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70ac06ba50 0x7f70ac10f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:26.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.088+0000 7f70b184c700 1 -- 172.21.15.80:0/3876487214 >> 172.21.15.80:0/3876487214 conn(0x7f70ac0792d0 msgr2=0x7f70ac0796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:47:26.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.088+0000 7f70b184c700 1 -- 172.21.15.80:0/3876487214 shutdown_connections 2024-04-26T18:47:26.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.088+0000 7f70b184c700 1 -- 172.21.15.80:0/3876487214 wait complete. 2024-04-26T18:47:26.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.089+0000 7f70b184c700 1 Processor -- start 2024-04-26T18:47:26.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.089+0000 7f70b184c700 1 -- start start 2024-04-26T18:47:26.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.089+0000 7f70b184c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70ac06b130 0x7f70ac1a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:26.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.089+0000 7f70b184c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70ac06ba50 0x7f70ac1a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:26.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.089+0000 7f70b184c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70ac10fed0 0x7f70ac19bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:26.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.089+0000 7f70b184c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac1157e0 con 0x7f70ac06b130 2024-04-26T18:47:26.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.089+0000 7f70b184c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac115660 con 0x7f70ac06ba50 2024-04-26T18:47:26.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.089+0000 7f70b184c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac115960 con 0x7f70ac10fed0 2024-04-26T18:47:26.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.089+0000 7f70aaffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70ac06b130 0x7f70ac1a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:26.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.089+0000 7f70aaffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70ac06b130 0x7f70ac1a18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54480/0 (socket says 172.21.15.80:54480) 2024-04-26T18:47:26.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.089+0000 7f70aaffd700 1 -- 172.21.15.80:0/2785233531 learned_addr learned my addr 172.21.15.80:0/2785233531 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:47:26.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.089+0000 7f70a3fff700 1 --2- 172.21.15.80:0/2785233531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70ac06ba50 0x7f70ac1a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:26.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.089+0000 7f70ab7fe700 1 --2- 172.21.15.80:0/2785233531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70ac10fed0 0x7f70ac19bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:26.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.089+0000 7f70aaffd700 1 -- 172.21.15.80:0/2785233531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70ac10fed0 msgr2=0x7f70ac19bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:26.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.089+0000 7f70aaffd700 1 --2- 172.21.15.80:0/2785233531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70ac10fed0 0x7f70ac19bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:26.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.089+0000 7f70aaffd700 1 -- 172.21.15.80:0/2785233531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70ac06ba50 msgr2=0x7f70ac1a1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:26.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.089+0000 7f70aaffd700 1 --2- 172.21.15.80:0/2785233531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70ac06ba50 0x7f70ac1a1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:26.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.089+0000 7f70aaffd700 1 -- 172.21.15.80:0/2785233531 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ac19c220 con 0x7f70ac06b130 2024-04-26T18:47:26.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.089+0000 7f70ab7fe700 1 --2- 172.21.15.80:0/2785233531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70ac10fed0 0x7f70ac19bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:47:26.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.089+0000 7f70a3fff700 1 --2- 172.21.15.80:0/2785233531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70ac06ba50 0x7f70ac1a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:47:26.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.089+0000 7f70aaffd700 1 --2- 172.21.15.80:0/2785233531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70ac06b130 0x7f70ac1a18b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f709c000c00 tx=0x7f709c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:47:26.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.090+0000 7f70b084a700 1 -- 172.21.15.80:0/2785233531 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c027070 con 0x7f70ac06b130 2024-04-26T18:47:26.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.090+0000 7f70b084a700 1 -- 172.21.15.80:0/2785233531 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f709c003fa0 con 0x7f70ac06b130 2024-04-26T18:47:26.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.090+0000 7f70b184c700 1 -- 172.21.15.80:0/2785233531 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70ac19c4b0 con 0x7f70ac06b130 2024-04-26T18:47:26.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.090+0000 7f70b084a700 1 -- 172.21.15.80:0/2785233531 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c022db0 con 0x7f70ac06b130 2024-04-26T18:47:26.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.090+0000 7f70b184c700 1 -- 172.21.15.80:0/2785233531 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70ac1a8780 con 0x7f70ac06b130 2024-04-26T18:47:26.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.091+0000 7f70b184c700 1 -- 172.21.15.80:0/2785233531 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70ac102940 con 0x7f70ac06b130 2024-04-26T18:47:26.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.092+0000 7f70b084a700 1 -- 172.21.15.80:0/2785233531 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f709c02a070 con 0x7f70ac06b130 2024-04-26T18:47:26.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.092+0000 7f70b084a700 1 --2- 172.21.15.80:0/2785233531 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f70980a3db0 0x7f70980a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:26.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.092+0000 7f70a3fff700 1 --2- 172.21.15.80:0/2785233531 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f70980a3db0 0x7f70980a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:26.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.092+0000 7f70b084a700 1 -- 172.21.15.80:0/2785233531 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8870+0+0 (secure 0 0 0) 0x7f709c0d1ac0 con 0x7f70ac06b130 2024-04-26T18:47:26.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.093+0000 7f70a3fff700 1 --2- 172.21.15.80:0/2785233531 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f70980a3db0 0x7f70980a6270 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7094005fd0 tx=0x7f7094005e30 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:47:26.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.096+0000 7f70b084a700 1 -- 172.21.15.80:0/2785233531 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f709c013070 con 0x7f70ac06b130 2024-04-26T18:47:26.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.341+0000 7f70b184c700 1 -- 172.21.15.80:0/2785233531 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f70ac19cfa0 con 0x7f70ac06b130 2024-04-26T18:47:26.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.464+0000 7f70b084a700 1 -- 172.21.15.80:0/2785233531 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7f709c09e030 con 0x7f70ac06b130 2024-04-26T18:47:26.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.466+0000 7f70b184c700 1 -- 172.21.15.80:0/2785233531 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f70980a3db0 msgr2=0x7f70980a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:26.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.466+0000 7f70b184c700 1 --2- 172.21.15.80:0/2785233531 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f70980a3db0 0x7f70980a6270 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7094005fd0 tx=0x7f7094005e30 comp rx=0 tx=0).stop 2024-04-26T18:47:26.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.466+0000 7f70b184c700 1 -- 172.21.15.80:0/2785233531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70ac06b130 msgr2=0x7f70ac1a18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:26.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.466+0000 7f70b184c700 1 --2- 172.21.15.80:0/2785233531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70ac06b130 0x7f70ac1a18b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f709c000c00 tx=0x7f709c0047b0 comp rx=0 tx=0).stop 2024-04-26T18:47:26.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.466+0000 7f70b184c700 1 -- 172.21.15.80:0/2785233531 shutdown_connections 2024-04-26T18:47:26.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.466+0000 7f70b184c700 1 --2- 172.21.15.80:0/2785233531 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f70980a3db0 0x7f70980a6270 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:26.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.466+0000 7f70b184c700 1 --2- 172.21.15.80:0/2785233531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70ac10fed0 0x7f70ac19bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:26.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.466+0000 7f70b184c700 1 --2- 172.21.15.80:0/2785233531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70ac06b130 0x7f70ac1a18b0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:26.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.466+0000 7f70b184c700 1 --2- 172.21.15.80:0/2785233531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70ac06ba50 0x7f70ac1a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:26.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.466+0000 7f70b184c700 1 -- 172.21.15.80:0/2785233531 >> 172.21.15.80:0/2785233531 conn(0x7f70ac0792d0 msgr2=0x7f70ac1112c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:47:26.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.466+0000 7f70b184c700 1 -- 172.21.15.80:0/2785233531 shutdown_connections 2024-04-26T18:47:26.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:26.466+0000 7f70b184c700 1 -- 172.21.15.80:0/2785233531 wait complete. 2024-04-26T18:47:26.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:26 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/2785233531' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T18:47:26.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:26 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2785233531' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T18:47:26.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:26 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/2785233531' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T18:47:27.120 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T18:47:27.357 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:47:27.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:27 smithi082 ceph-mon[32808]: pgmap v344: 97 pgs: 97 active+clean; 2.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T18:47:27.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:27 smithi082 ceph-mon[32808]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:47:27.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:27 smithi082 ceph-mon[32808]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T18:47:27.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:27 smithi082 ceph-mon[32808]: Cluster is now healthy 2024-04-26T18:47:27.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:27 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/2785233531' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-26T18:47:27.720 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:27 smithi082 ceph-mon[32808]: fsmap 12 up:standby 2024-04-26T18:47:27.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:27 smithi080 ceph-mon[29135]: pgmap v344: 97 pgs: 97 active+clean; 2.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T18:47:27.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:27 smithi080 ceph-mon[29135]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:47:27.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:27 smithi080 ceph-mon[29135]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T18:47:27.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:27 smithi080 ceph-mon[29135]: Cluster is now healthy 2024-04-26T18:47:27.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:27 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/2785233531' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-26T18:47:27.744 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:27 smithi080 ceph-mon[29135]: fsmap 12 up:standby 2024-04-26T18:47:27.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:27 smithi192 ceph-mon[32842]: pgmap v344: 97 pgs: 97 active+clean; 2.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T18:47:27.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:27 smithi192 ceph-mon[32842]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:47:27.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:27 smithi192 ceph-mon[32842]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T18:47:27.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:27 smithi192 ceph-mon[32842]: Cluster is now healthy 2024-04-26T18:47:27.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:27 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/2785233531' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-26T18:47:27.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:27 smithi192 ceph-mon[32842]: fsmap 12 up:standby 2024-04-26T18:47:29.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.185+0000 7fd753064700 1 -- 172.21.15.80:0/3436353102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74c101970 msgr2=0x7fd74c101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:29.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.185+0000 7fd753064700 1 --2- 172.21.15.80:0/3436353102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74c101970 0x7fd74c101df0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd7380099c0 tx=0x7fd738009cd0 comp rx=0 tx=0).stop 2024-04-26T18:47:29.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.185+0000 7fd753064700 1 -- 172.21.15.80:0/3436353102 shutdown_connections 2024-04-26T18:47:29.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.185+0000 7fd753064700 1 --2- 172.21.15.80:0/3436353102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd74c102330 0x7fd74c1102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:29.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.185+0000 7fd753064700 1 --2- 172.21.15.80:0/3436353102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd74c1094d0 0x7fd74c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.185+0000 7fd753064700 1 --2- 172.21.15.80:0/3436353102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74c101970 0x7fd74c101df0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.185+0000 7fd753064700 1 -- 172.21.15.80:0/3436353102 >> 172.21.15.80:0/3436353102 conn(0x7fd74c078920 msgr2=0x7fd74c0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.185+0000 7fd753064700 1 -- 172.21.15.80:0/3436353102 shutdown_connections 2024-04-26T18:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.185+0000 7fd753064700 1 -- 172.21.15.80:0/3436353102 wait complete. 2024-04-26T18:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.186+0000 7fd753064700 1 Processor -- start 2024-04-26T18:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.186+0000 7fd753064700 1 -- start start 2024-04-26T18:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.186+0000 7fd753064700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd74c101970 0x7fd74c102b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.186+0000 7fd753064700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74c102330 0x7fd74c103090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.186+0000 7fd753064700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd74c1094d0 0x7fd74c1035d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.186+0000 7fd753064700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c113660 con 0x7fd74c102330 2024-04-26T18:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.186+0000 7fd753064700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c1134e0 con 0x7fd74c1094d0 2024-04-26T18:47:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.186+0000 7fd753064700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c1137e0 con 0x7fd74c101970 2024-04-26T18:47:29.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.186+0000 7fd74bfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74c102330 0x7fd74c103090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:29.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.186+0000 7fd74bfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74c102330 0x7fd74c103090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54498/0 (socket says 172.21.15.80:54498) 2024-04-26T18:47:29.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.186+0000 7fd74bfff700 1 -- 172.21.15.80:0/3796255670 learned_addr learned my addr 172.21.15.80:0/3796255670 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:47:29.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.186+0000 7fd750e00700 1 --2- 172.21.15.80:0/3796255670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd74c101970 0x7fd74c102b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:29.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.186+0000 7fd751601700 1 --2- 172.21.15.80:0/3796255670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd74c1094d0 0x7fd74c1035d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:29.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.186+0000 7fd74bfff700 1 -- 172.21.15.80:0/3796255670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd74c101970 msgr2=0x7fd74c102b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:29.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.186+0000 7fd74bfff700 1 --2- 172.21.15.80:0/3796255670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd74c101970 0x7fd74c102b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:29.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.186+0000 7fd74bfff700 1 -- 172.21.15.80:0/3796255670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd74c1094d0 msgr2=0x7fd74c1035d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:29.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.186+0000 7fd74bfff700 1 --2- 172.21.15.80:0/3796255670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd74c1094d0 0x7fd74c1035d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:29.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.186+0000 7fd74bfff700 1 -- 172.21.15.80:0/3796255670 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74c1a8060 con 0x7fd74c102330 2024-04-26T18:47:29.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.187+0000 7fd751601700 1 --2- 172.21.15.80:0/3796255670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd74c1094d0 0x7fd74c1035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:47:29.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.187+0000 7fd74bfff700 1 --2- 172.21.15.80:0/3796255670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74c102330 0x7fd74c103090 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd738009990 tx=0x7fd7380047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:47:29.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.187+0000 7fd749ffb700 1 -- 172.21.15.80:0/3796255670 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd738026070 con 0x7fd74c102330 2024-04-26T18:47:29.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.187+0000 7fd753064700 1 -- 172.21.15.80:0/3796255670 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74c1a82f0 con 0x7fd74c102330 2024-04-26T18:47:29.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.187+0000 7fd749ffb700 1 -- 172.21.15.80:0/3796255670 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd738003f20 con 0x7fd74c102330 2024-04-26T18:47:29.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.187+0000 7fd749ffb700 1 -- 172.21.15.80:0/3796255670 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73800fcc0 con 0x7fd74c102330 2024-04-26T18:47:29.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.187+0000 7fd753064700 1 -- 172.21.15.80:0/3796255670 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd74c1a87a0 con 0x7fd74c102330 2024-04-26T18:47:29.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.188+0000 7fd753064700 1 -- 172.21.15.80:0/3796255670 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd74c06a110 con 0x7fd74c102330 2024-04-26T18:47:29.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.189+0000 7fd749ffb700 1 -- 172.21.15.80:0/3796255670 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7fd738029070 con 0x7fd74c102330 2024-04-26T18:47:29.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.190+0000 7fd749ffb700 1 --2- 172.21.15.80:0/3796255670 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fd73c0a3e30 0x7fd73c0a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:29.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.190+0000 7fd750e00700 1 --2- 172.21.15.80:0/3796255670 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fd73c0a3e30 0x7fd73c0a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:29.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.190+0000 7fd749ffb700 1 -- 172.21.15.80:0/3796255670 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8870+0+0 (secure 0 0 0) 0x7fd7380d1420 con 0x7fd74c102330 2024-04-26T18:47:29.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.190+0000 7fd750e00700 1 --2- 172.21.15.80:0/3796255670 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fd73c0a3e30 0x7fd73c0a62f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd740005950 tx=0x7fd74000a300 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:47:29.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.194+0000 7fd749ffb700 1 -- 172.21.15.80:0/3796255670 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd738030080 con 0x7fd74c102330 2024-04-26T18:47:29.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.393+0000 7fd753064700 1 -- 172.21.15.80:0/3796255670 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd74c02e490 con 0x7fd74c102330 2024-04-26T18:47:29.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.463+0000 7fd749ffb700 1 -- 172.21.15.80:0/3796255670 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v105) ==== 181+0+0 (secure 0 0 0) 0x7fd738013070 con 0x7fd74c102330 2024-04-26T18:47:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.466+0000 7fd753064700 1 -- 172.21.15.80:0/3796255670 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fd73c0a3e30 msgr2=0x7fd73c0a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.466+0000 7fd753064700 1 --2- 172.21.15.80:0/3796255670 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fd73c0a3e30 0x7fd73c0a62f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd740005950 tx=0x7fd74000a300 comp rx=0 tx=0).stop 2024-04-26T18:47:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.466+0000 7fd753064700 1 -- 172.21.15.80:0/3796255670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74c102330 msgr2=0x7fd74c103090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.466+0000 7fd753064700 1 --2- 172.21.15.80:0/3796255670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74c102330 0x7fd74c103090 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd738009990 tx=0x7fd7380047b0 comp rx=0 tx=0).stop 2024-04-26T18:47:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.466+0000 7fd753064700 1 -- 172.21.15.80:0/3796255670 shutdown_connections 2024-04-26T18:47:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.466+0000 7fd753064700 1 --2- 172.21.15.80:0/3796255670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd74c1094d0 0x7fd74c1035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.466+0000 7fd753064700 1 --2- 172.21.15.80:0/3796255670 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7fd73c0a3e30 0x7fd73c0a62f0 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd740005950 tx=0x7fd74000a300 comp rx=0 tx=0).stop 2024-04-26T18:47:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.466+0000 7fd753064700 1 --2- 172.21.15.80:0/3796255670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd74c101970 0x7fd74c102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.466+0000 7fd753064700 1 --2- 172.21.15.80:0/3796255670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74c102330 0x7fd74c103090 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.466+0000 7fd753064700 1 -- 172.21.15.80:0/3796255670 >> 172.21.15.80:0/3796255670 conn(0x7fd74c078920 msgr2=0x7fd74c0fff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:47:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.467+0000 7fd753064700 1 -- 172.21.15.80:0/3796255670 shutdown_connections 2024-04-26T18:47:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:29.467+0000 7fd753064700 1 -- 172.21.15.80:0/3796255670 wait complete. 2024-04-26T18:47:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2024-04-26T18:47:29.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:29 smithi080 ceph-mon[29135]: pgmap v345: 97 pgs: 97 active+clean; 2.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T18:47:29.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:29 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3796255670' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T18:47:29.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:29 smithi192 ceph-mon[32842]: pgmap v345: 97 pgs: 97 active+clean; 2.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T18:47:29.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:29 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3796255670' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T18:47:29.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:29 smithi082 ceph-mon[32808]: pgmap v345: 97 pgs: 97 active+clean; 2.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T18:47:29.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:29 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3796255670' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T18:47:30.134 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T18:47:30.372 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:47:30.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:30 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/3796255670' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-26T18:47:30.733 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:30 smithi080 ceph-mon[29135]: osdmap e105: 12 total, 12 up, 12 in 2024-04-26T18:47:30.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:30 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/3796255670' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-26T18:47:30.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:30 smithi192 ceph-mon[32842]: osdmap e105: 12 total, 12 up, 12 in 2024-04-26T18:47:30.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:30 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/3796255670' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-26T18:47:30.970 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:30 smithi082 ceph-mon[32808]: osdmap e105: 12 total, 12 up, 12 in 2024-04-26T18:47:31.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:31 smithi080 ceph-mon[29135]: pgmap v347: 65 pgs: 65 active+clean; 577 KiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:47:31.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:31 smithi192 ceph-mon[32842]: pgmap v347: 65 pgs: 65 active+clean; 577 KiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:47:31.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:31 smithi082 ceph-mon[32808]: pgmap v347: 65 pgs: 65 active+clean; 577 KiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:47:32.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.023+0000 7f1c7c83d700 1 -- 172.21.15.80:0/197512575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c78103e60 msgr2=0x7f1c781102b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:32.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.023+0000 7f1c7c83d700 1 --2- 172.21.15.80:0/197512575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c78103e60 0x7f1c781102b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000b0a0 tx=0x7f1c7000b3b0 comp rx=0 tx=0).stop 2024-04-26T18:47:32.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.024+0000 7f1c7c83d700 1 -- 172.21.15.80:0/197512575 shutdown_connections 2024-04-26T18:47:32.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.024+0000 7f1c7c83d700 1 --2- 172.21.15.80:0/197512575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c78103e60 0x7f1c781102b0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:32.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.024+0000 7f1c7c83d700 1 --2- 172.21.15.80:0/197512575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c781094e0 0x7f1c781098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:32.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.024+0000 7f1c7c83d700 1 --2- 172.21.15.80:0/197512575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c781034a0 0x7f1c78103920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:32.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.024+0000 7f1c7c83d700 1 -- 172.21.15.80:0/197512575 >> 172.21.15.80:0/197512575 conn(0x7f1c7807a590 msgr2=0x7f1c7807a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:47:32.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.024+0000 7f1c7c83d700 1 -- 172.21.15.80:0/197512575 shutdown_connections 2024-04-26T18:47:32.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.024+0000 7f1c7c83d700 1 -- 172.21.15.80:0/197512575 wait complete. 2024-04-26T18:47:32.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.024+0000 7f1c7c83d700 1 Processor -- start 2024-04-26T18:47:32.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.024+0000 7f1c7c83d700 1 -- start start 2024-04-26T18:47:32.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.025+0000 7f1c7c83d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c781034a0 0x7f1c7819f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:32.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.025+0000 7f1c7c83d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c78103e60 0x7f1c7819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:32.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.025+0000 7f1c7c83d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c781094e0 0x7f1c78199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:32.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.025+0000 7f1c7c83d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1c781136e0 con 0x7f1c78103e60 2024-04-26T18:47:32.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.025+0000 7f1c7c83d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1c78113560 con 0x7f1c781094e0 2024-04-26T18:47:32.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.025+0000 7f1c7c83d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1c78113860 con 0x7f1c781034a0 2024-04-26T18:47:32.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.025+0000 7f1c75d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c78103e60 0x7f1c7819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:32.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.025+0000 7f1c75d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c78103e60 0x7f1c7819fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:54520/0 (socket says 172.21.15.80:54520) 2024-04-26T18:47:32.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.025+0000 7f1c75d9b700 1 -- 172.21.15.80:0/445695675 learned_addr learned my addr 172.21.15.80:0/445695675 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-26T18:47:32.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.025+0000 7f1c76d9d700 1 --2- 172.21.15.80:0/445695675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c781094e0 0x7f1c78199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:32.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.025+0000 7f1c7659c700 1 --2- 172.21.15.80:0/445695675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c781034a0 0x7f1c7819f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:32.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.025+0000 7f1c75d9b700 1 -- 172.21.15.80:0/445695675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c781034a0 msgr2=0x7f1c7819f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:32.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.025+0000 7f1c75d9b700 1 --2- 172.21.15.80:0/445695675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c781034a0 0x7f1c7819f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:32.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.025+0000 7f1c75d9b700 1 -- 172.21.15.80:0/445695675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c781094e0 msgr2=0x7f1c78199a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:32.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.025+0000 7f1c75d9b700 1 --2- 172.21.15.80:0/445695675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c781094e0 0x7f1c78199a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:32.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.025+0000 7f1c75d9b700 1 -- 172.21.15.80:0/445695675 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c7819a180 con 0x7f1c78103e60 2024-04-26T18:47:32.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.025+0000 7f1c75d9b700 1 --2- 172.21.15.80:0/445695675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c78103e60 0x7f1c7819fd50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c00b530 tx=0x7f1c6c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:47:32.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.025+0000 7f1c677fe700 1 -- 172.21.15.80:0/445695675 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c015020 con 0x7f1c78103e60 2024-04-26T18:47:32.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.025+0000 7f1c7c83d700 1 -- 172.21.15.80:0/445695675 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c7819a470 con 0x7f1c78103e60 2024-04-26T18:47:32.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.025+0000 7f1c677fe700 1 -- 172.21.15.80:0/445695675 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c6c011ce0 con 0x7f1c78103e60 2024-04-26T18:47:32.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.025+0000 7f1c677fe700 1 -- 172.21.15.80:0/445695675 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c010dd0 con 0x7f1c78103e60 2024-04-26T18:47:32.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.026+0000 7f1c7c83d700 1 -- 172.21.15.80:0/445695675 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c781a66e0 con 0x7f1c78103e60 2024-04-26T18:47:32.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.026+0000 7f1c7c83d700 1 -- 172.21.15.80:0/445695675 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c7806a110 con 0x7f1c78103e60 2024-04-26T18:47:32.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.027+0000 7f1c677fe700 1 -- 172.21.15.80:0/445695675 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 26) ==== 138777+0+0 (secure 0 0 0) 0x7f1c6c018020 con 0x7f1c78103e60 2024-04-26T18:47:32.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.028+0000 7f1c677fe700 1 --2- 172.21.15.80:0/445695675 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f1c600a3db0 0x7f1c600a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:47:32.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.028+0000 7f1c7659c700 1 --2- 172.21.15.80:0/445695675 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f1c600a3db0 0x7f1c600a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:47:32.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.028+0000 7f1c677fe700 1 -- 172.21.15.80:0/445695675 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8316+0+0 (secure 0 0 0) 0x7f1c6c0cfd00 con 0x7f1c78103e60 2024-04-26T18:47:32.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.029+0000 7f1c7659c700 1 --2- 172.21.15.80:0/445695675 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f1c600a3db0 0x7f1c600a6270 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1c78101c10 tx=0x7f1c68009190 comp rx=0 tx=0).ready entity=mgr.24736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:47:32.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.033+0000 7f1c677fe700 1 -- 172.21.15.80:0/445695675 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1c6c01f020 con 0x7f1c78103e60 2024-04-26T18:47:32.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.228+0000 7f1c7c83d700 1 -- 172.21.15.80:0/445695675 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1c7802e490 con 0x7f1c78103e60 2024-04-26T18:47:32.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.484+0000 7f1c677fe700 1 -- 172.21.15.80:0/445695675 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v106) ==== 169+0+0 (secure 0 0 0) 0x7f1c6c09c580 con 0x7f1c78103e60 2024-04-26T18:47:32.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.487+0000 7f1c7c83d700 1 -- 172.21.15.80:0/445695675 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f1c600a3db0 msgr2=0x7f1c600a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:32.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.487+0000 7f1c7c83d700 1 --2- 172.21.15.80:0/445695675 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f1c600a3db0 0x7f1c600a6270 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1c78101c10 tx=0x7f1c68009190 comp rx=0 tx=0).stop 2024-04-26T18:47:32.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.487+0000 7f1c7c83d700 1 -- 172.21.15.80:0/445695675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c78103e60 msgr2=0x7f1c7819fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:47:32.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.487+0000 7f1c7c83d700 1 --2- 172.21.15.80:0/445695675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c78103e60 0x7f1c7819fd50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c00b530 tx=0x7f1c6c00b840 comp rx=0 tx=0).stop 2024-04-26T18:47:32.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.488+0000 7f1c7c83d700 1 -- 172.21.15.80:0/445695675 shutdown_connections 2024-04-26T18:47:32.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.488+0000 7f1c7c83d700 1 --2- 172.21.15.80:0/445695675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c781094e0 0x7f1c78199a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:32.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.488+0000 7f1c7c83d700 1 --2- 172.21.15.80:0/445695675 >> [v2:172.21.15.80:6800/1522002759,v1:172.21.15.80:6801/1522002759] conn(0x7f1c600a3db0 0x7f1c600a6270 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:32.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.488+0000 7f1c7c83d700 1 --2- 172.21.15.80:0/445695675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c781034a0 0x7f1c7819f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:32.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.488+0000 7f1c7c83d700 1 --2- 172.21.15.80:0/445695675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c78103e60 0x7f1c7819fd50 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:47:32.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.488+0000 7f1c7c83d700 1 -- 172.21.15.80:0/445695675 >> 172.21.15.80:0/445695675 conn(0x7f1c7807a590 msgr2=0x7f1c78102270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:47:32.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.488+0000 7f1c7c83d700 1 -- 172.21.15.80:0/445695675 shutdown_connections 2024-04-26T18:47:32.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-26T18:47:32.488+0000 7f1c7c83d700 1 -- 172.21.15.80:0/445695675 wait complete. 2024-04-26T18:47:32.490 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2024-04-26T18:47:32.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:32 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/445695675' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T18:47:32.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:32 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/445695675' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T18:47:32.969 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:32 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/445695675' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T18:47:33.204 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T18:47:33.231 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T18:47:33.266 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T18:47:33.297 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-26T18:47:33.298 DEBUG:teuthology.orchestra.run.smithi080:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-26T18:47:33.313 DEBUG:teuthology.orchestra.run.smithi082:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-26T18:47:33.330 DEBUG:teuthology.orchestra.run.smithi192:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-26T18:47:33.354 INFO:tasks.cephadm:Stopping all daemons... 2024-04-26T18:47:33.354 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-04-26T18:47:33.354 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mon.a 2024-04-26T18:47:33.486 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:33 smithi080 systemd[1]: Stopping Ceph mon.a for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:47:33.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:33 smithi192 ceph-mon[32842]: pgmap v348: 65 pgs: 65 active+clean; 577 KiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:47:33.612 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:33 smithi192 ceph-mon[32842]: from='client.? 172.21.15.80:0/445695675' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-04-26T18:47:33.613 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:33 smithi192 ceph-mon[32842]: osdmap e106: 12 total, 12 up, 12 in 2024-04-26T18:47:33.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:33 smithi082 ceph-mon[32808]: pgmap v348: 65 pgs: 65 active+clean; 577 KiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:47:33.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:33 smithi082 ceph-mon[32808]: from='client.? 172.21.15.80:0/445695675' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-04-26T18:47:33.719 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:33 smithi082 ceph-mon[32808]: osdmap e106: 12 total, 12 up, 12 in 2024-04-26T18:47:33.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:33 smithi080 ceph-mon[29135]: pgmap v348: 65 pgs: 65 active+clean; 577 KiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T18:47:33.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:33 smithi080 ceph-mon[29135]: from='client.? 172.21.15.80:0/445695675' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-04-26T18:47:33.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:33 smithi080 ceph-mon[29135]: osdmap e106: 12 total, 12 up, 12 in 2024-04-26T18:47:33.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:33 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-a[29131]: 2024-04-26T18:47:33.676+0000 7f650eeb2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:47:33.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:33 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-a[29131]: 2024-04-26T18:47:33.676+0000 7f650eeb2700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-04-26T18:47:33.743 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:33 smithi080 podman[95289]: 2024-04-26 18:47:33.698229734 +0000 UTC m=+0.158660478 container died d90b35aa1c5e00f079bfd87dca615947476f14d53918d5752b1dbd3cf292741a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, io.buildah.version=1.33.5) 2024-04-26T18:47:34.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:34 smithi080 podman[95289]: 2024-04-26 18:47:34.07032263 +0000 UTC m=+0.530753373 container cleanup d90b35aa1c5e00f079bfd87dca615947476f14d53918d5752b1dbd3cf292741a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-a, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-04-26T18:47:34.243 INFO:journalctl@ceph.mon.a.smithi080.stdout:Apr 26 18:47:34 smithi080 bash[95289]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-a 2024-04-26T18:47:34.483 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mon.a.service' 2024-04-26T18:47:34.544 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:47:34.544 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-04-26T18:47:34.544 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-04-26T18:47:34.544 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mon.b 2024-04-26T18:47:34.861 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:34 smithi082 systemd[1]: Stopping Ceph mon.b for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:47:35.195 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:34 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-b[32804]: 2024-04-26T18:47:34.862+0000 7f73772da700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:47:35.196 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:34 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-b[32804]: 2024-04-26T18:47:34.862+0000 7f73772da700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-04-26T18:47:35.196 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:34 smithi082 podman[69723]: 2024-04-26 18:47:34.903147021 +0000 UTC m=+0.162255069 container died a31eaa4ff132c70812714a7ab30862fc88e6c09c13b14640ae0dadc3e1a7d49c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-b, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-26T18:47:35.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:35 smithi082 podman[69723]: 2024-04-26 18:47:35.296038621 +0000 UTC m=+0.555146652 container cleanup a31eaa4ff132c70812714a7ab30862fc88e6c09c13b14640ae0dadc3e1a7d49c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-b, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240424) 2024-04-26T18:47:35.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:Apr 26 18:47:35 smithi082 bash[69723]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-b 2024-04-26T18:47:35.643 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mon.b.service' 2024-04-26T18:47:35.692 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:47:35.692 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-04-26T18:47:35.692 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-04-26T18:47:35.693 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mon.c 2024-04-26T18:47:36.020 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:35 smithi192 systemd[1]: Stopping Ceph mon.c for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:47:36.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:36 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-c[32828]: 2024-04-26T18:47:36.020+0000 7f4708e63700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:47:36.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:36 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-c[32828]: 2024-04-26T18:47:36.020+0000 7f4708e63700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-04-26T18:47:36.363 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:36 smithi192 podman[69453]: 2024-04-26 18:47:36.19449523 +0000 UTC m=+0.304543654 container died 4b76db465e29bb1b2acbf65a1f62efcd5049d78865e3c1e2e578cb43c642a785 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-c, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-26T18:47:36.839 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:36 smithi192 podman[69453]: 2024-04-26 18:47:36.5798631 +0000 UTC m=+0.689911513 container cleanup 4b76db465e29bb1b2acbf65a1f62efcd5049d78865e3c1e2e578cb43c642a785 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-c, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T18:47:36.840 INFO:journalctl@ceph.mon.c.smithi192.stdout:Apr 26 18:47:36 smithi192 bash[69453]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mon-c 2024-04-26T18:47:36.997 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mon.c.service' 2024-04-26T18:47:37.045 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:47:37.045 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-04-26T18:47:37.045 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-04-26T18:47:37.045 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mgr.x 2024-04-26T18:47:37.358 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:47:37 smithi080 systemd[1]: Stopping Ceph mgr.x for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:47:37.668 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:47:37 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:47:37.357+0000 7f475dfb7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:47:37.668 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:47:37 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x[29366]: 2024-04-26T18:47:37.357+0000 7f475dfb7700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-04-26T18:47:37.668 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:47:37 smithi080 podman[95411]: 2024-04-26 18:47:37.389760762 +0000 UTC m=+0.158875672 container died 6296c5fa5eda433ff16b26967d0d7220e64a719e91f1781147fede2878a29247 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-26T18:47:37.993 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:47:37 smithi080 podman[95411]: 2024-04-26 18:47:37.759916402 +0000 UTC m=+0.529031350 container cleanup 6296c5fa5eda433ff16b26967d0d7220e64a719e91f1781147fede2878a29247 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True) 2024-04-26T18:47:37.993 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Apr 26 18:47:37 smithi080 bash[95411]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-x 2024-04-26T18:47:38.326 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mgr.x.service' 2024-04-26T18:47:38.359 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:47:38.359 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-04-26T18:47:38.359 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-04-26T18:47:38.359 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mgr.y 2024-04-26T18:47:38.703 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:47:38 smithi082 systemd[1]: Stopping Ceph mgr.y for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:47:38.969 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:47:38 smithi082 podman[69846]: 2024-04-26 18:47:38.704432608 +0000 UTC m=+0.156445234 container died f32946a0fdec753a5f1be542008a16b17e91acae7508d727aac4b9ad6d3441fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux ) 2024-04-26T18:47:39.460 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:47:39 smithi082 podman[69846]: 2024-04-26 18:47:39.167541382 +0000 UTC m=+0.619554008 container cleanup f32946a0fdec753a5f1be542008a16b17e91acae7508d727aac4b9ad6d3441fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T18:47:39.460 INFO:journalctl@ceph.mgr.y.smithi082.stdout:Apr 26 18:47:39 smithi082 bash[69846]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-y 2024-04-26T18:47:39.587 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mgr.y.service' 2024-04-26T18:47:39.620 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:47:39.620 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-04-26T18:47:39.620 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-04-26T18:47:39.620 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mgr.z 2024-04-26T18:47:39.971 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:47:39 smithi192 systemd[1]: Stopping Ceph mgr.z for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:47:40.302 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:47:39 smithi192 podman[69574]: 2024-04-26 18:47:39.972369087 +0000 UTC m=+0.161948077 container died 879b3597ad7d639529ae082d77a8d8feb154076767c8e86079981eeb4b93b7cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-26T18:47:40.612 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:47:40 smithi192 podman[69574]: 2024-04-26 18:47:40.41068892 +0000 UTC m=+0.600267900 container cleanup 879b3597ad7d639529ae082d77a8d8feb154076767c8e86079981eeb4b93b7cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-04-26T18:47:40.612 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Apr 26 18:47:40 smithi192 bash[69574]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mgr-z 2024-04-26T18:47:40.875 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mgr.z.service' 2024-04-26T18:47:40.908 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:47:40.909 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-04-26T18:47:40.909 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-26T18:47:40.909 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.0 2024-04-26T18:47:41.218 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:47:40 smithi080 systemd[1]: Stopping Ceph osd.0 for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:47:41.493 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:47:41 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-0[41147]: 2024-04-26T18:47:41.214+0000 7f4da4c19700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:47:41.493 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:47:41 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-0[41147]: 2024-04-26T18:47:41.214+0000 7f4da4c19700 -1 osd.0 106 *** Got signal Terminated *** 2024-04-26T18:47:41.493 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:47:41 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-0[41147]: 2024-04-26T18:47:41.214+0000 7f4da4c19700 -1 osd.0 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T18:47:46.924 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:47:46 smithi080 podman[95531]: 2024-04-26 18:47:46.673102119 +0000 UTC m=+5.581310068 container died 5c8f6428f2123a78966345146bf53c3c774ec4bc1ff36e28277238efb4eb75ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-26T18:47:47.182 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:47:46 smithi080 podman[95531]: 2024-04-26 18:47:46.981695172 +0000 UTC m=+5.889903126 container cleanup 5c8f6428f2123a78966345146bf53c3c774ec4bc1ff36e28277238efb4eb75ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True) 2024-04-26T18:47:47.183 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:47:46 smithi080 bash[95531]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-0 2024-04-26T18:47:47.493 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:47:47 smithi080 podman[95548]: 2024-04-26 18:47:47.183343531 +0000 UTC m=+0.512121032 container remove 5c8f6428f2123a78966345146bf53c3c774ec4bc1ff36e28277238efb4eb75ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True) 2024-04-26T18:47:47.753 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:47:47 smithi080 podman[95640]: 2024-04-26 18:47:47.499640737 +0000 UTC m=+0.018376257 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:47:47.753 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:47:47 smithi080 podman[95640]: 2024-04-26 18:47:47.634806526 +0000 UTC m=+0.153542035 container create 4473e354933c385585540a53cc0dd71a4177f073bf7db611a6165297de3a297e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-26T18:47:48.180 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:47:47 smithi080 podman[95640]: 2024-04-26 18:47:47.88763642 +0000 UTC m=+0.406371931 container init 4473e354933c385585540a53cc0dd71a4177f073bf7db611a6165297de3a297e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-0-deactivate, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True) 2024-04-26T18:47:48.180 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:47:47 smithi080 podman[95640]: 2024-04-26 18:47:47.891340769 +0000 UTC m=+0.410076284 container start 4473e354933c385585540a53cc0dd71a4177f073bf7db611a6165297de3a297e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424) 2024-04-26T18:47:48.180 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:47:47 smithi080 podman[95640]: 2024-04-26 18:47:47.987859207 +0000 UTC m=+0.506594736 container attach 4473e354933c385585540a53cc0dd71a4177f073bf7db611a6165297de3a297e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-0-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-04-26T18:47:48.458 INFO:journalctl@ceph.osd.0.smithi080.stdout:Apr 26 18:47:48 smithi080 podman[95640]: 2024-04-26 18:47:48.180911949 +0000 UTC m=+0.699647457 container died 4473e354933c385585540a53cc0dd71a4177f073bf7db611a6165297de3a297e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-26T18:47:48.882 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.0.service' 2024-04-26T18:47:48.919 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:47:48.920 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-26T18:47:48.920 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-26T18:47:48.920 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.1 2024-04-26T18:47:49.220 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 26 18:47:48 smithi082 systemd[1]: Stopping Ceph osd.1 for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:47:49.719 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 26 18:47:49 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-1[37421]: 2024-04-26T18:47:49.254+0000 7f5a77196700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:47:49.720 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 26 18:47:49 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-1[37421]: 2024-04-26T18:47:49.254+0000 7f5a77196700 -1 osd.1 106 *** Got signal Terminated *** 2024-04-26T18:47:49.720 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 26 18:47:49 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-1[37421]: 2024-04-26T18:47:49.254+0000 7f5a77196700 -1 osd.1 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T18:47:54.970 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 26 18:47:54 smithi082 podman[69982]: 2024-04-26 18:47:54.717265635 +0000 UTC m=+5.586824298 container died 52637e04e9f7c1ddf355e8dc05da978a7cfb475f9d4899e7c64264d16d67e0b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=) 2024-04-26T18:47:55.372 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 26 18:47:55 smithi082 podman[69982]: 2024-04-26 18:47:55.112814078 +0000 UTC m=+5.982372737 container cleanup 52637e04e9f7c1ddf355e8dc05da978a7cfb475f9d4899e7c64264d16d67e0b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, ceph=True) 2024-04-26T18:47:55.372 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 26 18:47:55 smithi082 bash[69982]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-1 2024-04-26T18:47:55.669 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 26 18:47:55 smithi082 podman[70000]: 2024-04-26 18:47:55.372735866 +0000 UTC m=+0.644831933 container remove 52637e04e9f7c1ddf355e8dc05da978a7cfb475f9d4899e7c64264d16d67e0b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-26T18:47:55.970 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 26 18:47:55 smithi082 podman[70095]: 2024-04-26 18:47:55.572418805 +0000 UTC m=+0.017787814 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:47:55.970 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 26 18:47:55 smithi082 podman[70095]: 2024-04-26 18:47:55.698654706 +0000 UTC m=+0.144023692 container create 64594e9f0f53b274be3444152c6258f5ed87043aa2fe793ea5a8e5ebfd070569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-04-26T18:47:56.271 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 26 18:47:55 smithi082 podman[70095]: 2024-04-26 18:47:55.976964978 +0000 UTC m=+0.422333975 container init 64594e9f0f53b274be3444152c6258f5ed87043aa2fe793ea5a8e5ebfd070569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-04-26T18:47:56.271 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 26 18:47:55 smithi082 podman[70095]: 2024-04-26 18:47:55.980394878 +0000 UTC m=+0.425763871 container start 64594e9f0f53b274be3444152c6258f5ed87043aa2fe793ea5a8e5ebfd070569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-26T18:47:56.271 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 26 18:47:56 smithi082 podman[70095]: 2024-04-26 18:47:56.068280939 +0000 UTC m=+0.513649944 container attach 64594e9f0f53b274be3444152c6258f5ed87043aa2fe793ea5a8e5ebfd070569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5) 2024-04-26T18:47:56.537 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 26 18:47:56 smithi082 podman[70095]: 2024-04-26 18:47:56.272008417 +0000 UTC m=+0.717377421 container died 64594e9f0f53b274be3444152c6258f5ed87043aa2fe793ea5a8e5ebfd070569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-04-26T18:47:56.855 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.1.service' 2024-04-26T18:47:56.892 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:47:56.892 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-26T18:47:56.893 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-26T18:47:56.893 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.2 2024-04-26T18:47:57.207 INFO:journalctl@ceph.osd.2.smithi192.stdout:Apr 26 18:47:56 smithi192 systemd[1]: Stopping Ceph osd.2 for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:47:57.612 INFO:journalctl@ceph.osd.2.smithi192.stdout:Apr 26 18:47:57 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-2[38012]: 2024-04-26T18:47:57.206+0000 7f16cf76f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:47:57.612 INFO:journalctl@ceph.osd.2.smithi192.stdout:Apr 26 18:47:57 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-2[38012]: 2024-04-26T18:47:57.206+0000 7f16cf76f700 -1 osd.2 106 *** Got signal Terminated *** 2024-04-26T18:47:57.612 INFO:journalctl@ceph.osd.2.smithi192.stdout:Apr 26 18:47:57 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-2[38012]: 2024-04-26T18:47:57.206+0000 7f16cf76f700 -1 osd.2 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T18:48:02.990 INFO:journalctl@ceph.osd.2.smithi192.stdout:Apr 26 18:48:02 smithi192 podman[69699]: 2024-04-26 18:48:02.651152465 +0000 UTC m=+5.571024109 container died f8cfd702b4a2210baf1f0c95cafb54490ab4848f22a72f8ba47938f386ff36c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-2, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424) 2024-04-26T18:48:03.362 INFO:journalctl@ceph.osd.2.smithi192.stdout:Apr 26 18:48:03 smithi192 podman[69699]: 2024-04-26 18:48:03.098983282 +0000 UTC m=+6.018854923 container cleanup f8cfd702b4a2210baf1f0c95cafb54490ab4848f22a72f8ba47938f386ff36c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-26T18:48:03.362 INFO:journalctl@ceph.osd.2.smithi192.stdout:Apr 26 18:48:03 smithi192 bash[69699]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-2 2024-04-26T18:48:03.713 INFO:journalctl@ceph.osd.2.smithi192.stdout:Apr 26 18:48:03 smithi192 podman[69717]: 2024-04-26 18:48:03.400625398 +0000 UTC m=+0.748528954 container remove f8cfd702b4a2210baf1f0c95cafb54490ab4848f22a72f8ba47938f386ff36c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-2, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=) 2024-04-26T18:48:04.004 INFO:journalctl@ceph.osd.2.smithi192.stdout:Apr 26 18:48:03 smithi192 podman[69809]: 2024-04-26 18:48:03.616072723 +0000 UTC m=+0.017821478 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:48:04.004 INFO:journalctl@ceph.osd.2.smithi192.stdout:Apr 26 18:48:03 smithi192 podman[69809]: 2024-04-26 18:48:03.734889775 +0000 UTC m=+0.136638563 container create e5a8de1582d137ac7ffab04ca4fee79f9a6966b6bf7fe2712c0fb50cf7cdaec4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-26T18:48:04.301 INFO:journalctl@ceph.osd.2.smithi192.stdout:Apr 26 18:48:04 smithi192 podman[69809]: 2024-04-26 18:48:04.004538094 +0000 UTC m=+0.406286836 container init e5a8de1582d137ac7ffab04ca4fee79f9a6966b6bf7fe2712c0fb50cf7cdaec4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, ceph=True) 2024-04-26T18:48:04.301 INFO:journalctl@ceph.osd.2.smithi192.stdout:Apr 26 18:48:04 smithi192 podman[69809]: 2024-04-26 18:48:04.007929391 +0000 UTC m=+0.409678140 container start e5a8de1582d137ac7ffab04ca4fee79f9a6966b6bf7fe2712c0fb50cf7cdaec4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-04-26T18:48:04.301 INFO:journalctl@ceph.osd.2.smithi192.stdout:Apr 26 18:48:04 smithi192 podman[69809]: 2024-04-26 18:48:04.113159839 +0000 UTC m=+0.514908590 container attach e5a8de1582d137ac7ffab04ca4fee79f9a6966b6bf7fe2712c0fb50cf7cdaec4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-2-deactivate, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-26T18:48:04.566 INFO:journalctl@ceph.osd.2.smithi192.stdout:Apr 26 18:48:04 smithi192 podman[69809]: 2024-04-26 18:48:04.302196505 +0000 UTC m=+0.703945244 container died e5a8de1582d137ac7ffab04ca4fee79f9a6966b6bf7fe2712c0fb50cf7cdaec4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-26T18:48:05.040 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.2.service' 2024-04-26T18:48:05.077 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:48:05.077 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-26T18:48:05.078 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-26T18:48:05.078 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.3 2024-04-26T18:48:05.386 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 26 18:48:05 smithi080 systemd[1]: Stopping Ceph osd.3 for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:48:05.743 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 26 18:48:05 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-3[48122]: 2024-04-26T18:48:05.386+0000 7f9348d8a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:48:05.743 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 26 18:48:05 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-3[48122]: 2024-04-26T18:48:05.386+0000 7f9348d8a700 -1 osd.3 106 *** Got signal Terminated *** 2024-04-26T18:48:05.743 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 26 18:48:05 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-3[48122]: 2024-04-26T18:48:05.386+0000 7f9348d8a700 -1 osd.3 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T18:48:08.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:07 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:07.738+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:08.993 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 26 18:48:08 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-3[48122]: 2024-04-26T18:48:08.610+0000 7f9341376700 -1 osd.3 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.447295+0000 front 2024-04-26T18:47:44.447323+0000 (oldest deadline 2024-04-26T18:48:07.947421+0000) 2024-04-26T18:48:08.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:08 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:08.607+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:09.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:08 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:08.714+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:09.993 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 26 18:48:09 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-3[48122]: 2024-04-26T18:48:09.659+0000 7f9341376700 -1 osd.3 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.447295+0000 front 2024-04-26T18:47:44.447323+0000 (oldest deadline 2024-04-26T18:48:07.947421+0000) 2024-04-26T18:48:09.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:09 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:09.620+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:09.993 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:09 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:09.829+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:10.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:09 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:09.682+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:10.469 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:10 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:10.169+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:10.612 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:10 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:10.271+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.778078+0000 front 2024-04-26T18:47:44.778048+0000 (oldest deadline 2024-04-26T18:48:09.478053+0000) 2024-04-26T18:48:10.863 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:10 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:10.583+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:10.863 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:10 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:10.812+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:11.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:10 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:10.728+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:11.152 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 26 18:48:10 smithi080 podman[95760]: 2024-04-26 18:48:10.863637464 +0000 UTC m=+5.597445420 container died 292f718fae4e288ea01988426f7c3d7d03ae6d10971cfa38ab67c19622e10a58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-26T18:48:11.469 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:11 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:11.216+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:11.493 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 26 18:48:11 smithi080 podman[95760]: 2024-04-26 18:48:11.244711656 +0000 UTC m=+5.978519612 container cleanup 292f718fae4e288ea01988426f7c3d7d03ae6d10971cfa38ab67c19622e10a58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-3, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T18:48:11.493 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 26 18:48:11 smithi080 bash[95760]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-3 2024-04-26T18:48:11.612 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:11 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:11.259+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.778078+0000 front 2024-04-26T18:47:44.778048+0000 (oldest deadline 2024-04-26T18:48:09.478053+0000) 2024-04-26T18:48:11.612 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:11 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:11.192+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:11.838 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 26 18:48:11 smithi080 podman[95778]: 2024-04-26 18:48:11.51337465 +0000 UTC m=+0.651967556 container remove 292f718fae4e288ea01988426f7c3d7d03ae6d10971cfa38ab67c19622e10a58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424) 2024-04-26T18:48:11.838 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:11 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:11.590+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:12.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:11 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:11.708+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:12.125 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:11 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:11.837+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:12.125 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 26 18:48:11 smithi080 podman[95868]: 2024-04-26 18:48:11.760407847 +0000 UTC m=+0.017876657 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:48:12.125 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 26 18:48:11 smithi080 podman[95868]: 2024-04-26 18:48:11.889477354 +0000 UTC m=+0.146946138 container create fbcdf7685f1c1411e86699383a11434f3639f4a8d9a85b71f0adf48c43ccab02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5) 2024-04-26T18:48:12.125 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 26 18:48:12 smithi080 podman[95868]: 2024-04-26 18:48:12.126205368 +0000 UTC m=+0.383674153 container init fbcdf7685f1c1411e86699383a11434f3639f4a8d9a85b71f0adf48c43ccab02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, ceph=True, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-04-26T18:48:12.416 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 26 18:48:12 smithi080 podman[95868]: 2024-04-26 18:48:12.129517249 +0000 UTC m=+0.386986034 container start fbcdf7685f1c1411e86699383a11434f3639f4a8d9a85b71f0adf48c43ccab02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True) 2024-04-26T18:48:12.416 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 26 18:48:12 smithi080 podman[95868]: 2024-04-26 18:48:12.208917121 +0000 UTC m=+0.466385917 container attach fbcdf7685f1c1411e86699383a11434f3639f4a8d9a85b71f0adf48c43ccab02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-26T18:48:12.612 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:12 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:12.267+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.778078+0000 front 2024-04-26T18:47:44.778048+0000 (oldest deadline 2024-04-26T18:48:09.478053+0000) 2024-04-26T18:48:12.612 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:12 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:12.151+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:12.719 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:12 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:12.246+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:12.720 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:12 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:12.617+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:12.720 INFO:journalctl@ceph.osd.3.smithi080.stdout:Apr 26 18:48:12 smithi080 podman[95868]: 2024-04-26 18:48:12.417179761 +0000 UTC m=+0.674648550 container died fbcdf7685f1c1411e86699383a11434f3639f4a8d9a85b71f0adf48c43ccab02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-26T18:48:12.993 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:12 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:12.839+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:13.047 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.3.service' 2024-04-26T18:48:13.085 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:48:13.085 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-26T18:48:13.086 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-26T18:48:13.086 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.4 2024-04-26T18:48:13.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:12 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:12.721+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:13.464 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 26 18:48:13 smithi082 systemd[1]: Stopping Ceph osd.4 for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:48:13.464 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:13 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:13.236+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:13.612 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:13 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:13.298+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.778078+0000 front 2024-04-26T18:47:44.778048+0000 (oldest deadline 2024-04-26T18:48:09.478053+0000) 2024-04-26T18:48:13.612 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:13 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:13.163+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:13.719 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 26 18:48:13 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-4[44374]: 2024-04-26T18:48:13.463+0000 7f2cf1f35700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:48:13.720 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 26 18:48:13 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-4[44374]: 2024-04-26T18:48:13.464+0000 7f2cf1f35700 -1 osd.4 106 *** Got signal Terminated *** 2024-04-26T18:48:13.720 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 26 18:48:13 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-4[44374]: 2024-04-26T18:48:13.464+0000 7f2cf1f35700 -1 osd.4 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T18:48:13.993 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:13 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:13.819+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:13.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:13 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:13.589+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:14.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:13 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:13.700+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:14.612 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:14 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:14.180+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:14.612 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:14 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:14.328+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.778078+0000 front 2024-04-26T18:47:44.778048+0000 (oldest deadline 2024-04-26T18:48:09.478053+0000) 2024-04-26T18:48:14.719 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:14 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:14.262+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:14.838 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:14 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:14.552+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:14.999 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:14 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:14.730+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:15.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:14 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:14.838+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:15.327 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:15 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:15.132+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:15.612 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:15 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:15.327+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.778078+0000 front 2024-04-26T18:47:44.778048+0000 (oldest deadline 2024-04-26T18:48:09.478053+0000) 2024-04-26T18:48:15.719 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:15 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:15.272+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:15.720 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:15 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:15.225+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:15.871 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:15 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:15.583+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:16.105 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:15 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:15.718+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:16.105 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:15 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:15.718+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:16.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:15 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:15.871+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:16.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:15 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:15.871+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:16.362 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:16 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:16.298+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.778078+0000 front 2024-04-26T18:47:44.778048+0000 (oldest deadline 2024-04-26T18:48:09.478053+0000) 2024-04-26T18:48:16.362 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:16 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:16.105+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:16.363 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:16 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:16.105+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:16.719 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:16 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:16.251+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:16.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:16 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:16.223+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:16.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:16 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:16.223+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:16.884 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:16 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:16.630+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:16.884 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:16 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:16.630+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.396179+0000 front 2024-04-26T18:47:52.395936+0000 (oldest deadline 2024-04-26T18:48:16.396262+0000) 2024-04-26T18:48:17.070 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:16 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:16.728+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:17.070 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:16 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:16.728+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:17.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:16 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:16.884+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:17.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:16 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:16.884+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:17.340 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:17 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:17.070+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:17.340 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:17 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:17.070+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:17.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:17 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:17.234+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:17.470 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 26 18:48:17 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-4[44374]: 2024-04-26T18:48:17.152+0000 7f2cee529700 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:53.269897+0000 front 2024-04-26T18:47:53.269866+0000 (oldest deadline 2024-04-26T18:48:16.770030+0000) 2024-04-26T18:48:17.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:17 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:17.236+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:17.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:17 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:17.236+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:17.612 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:17 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:17.340+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.778078+0000 front 2024-04-26T18:47:44.778048+0000 (oldest deadline 2024-04-26T18:48:09.478053+0000) 2024-04-26T18:48:17.897 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:17 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:17.639+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:17.897 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:17 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:17.639+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.396179+0000 front 2024-04-26T18:47:52.395936+0000 (oldest deadline 2024-04-26T18:48:16.396262+0000) 2024-04-26T18:48:18.077 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:17 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:17.739+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:18.077 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:17 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:17.739+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:18.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:17 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:17.897+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:18.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:17 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:17.897+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:18.357 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:18 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:18.077+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:18.357 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:18 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:18.077+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:18.469 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 26 18:48:18 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-4[44374]: 2024-04-26T18:48:18.173+0000 7f2cee529700 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:53.269897+0000 front 2024-04-26T18:47:53.269866+0000 (oldest deadline 2024-04-26T18:48:16.770030+0000) 2024-04-26T18:48:18.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:18 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:18.280+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:18.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:18 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:18.197+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:18.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:18 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:18.197+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:18.612 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:18 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:18.357+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.778078+0000 front 2024-04-26T18:47:44.778048+0000 (oldest deadline 2024-04-26T18:48:09.478053+0000) 2024-04-26T18:48:18.612 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:18 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:18.357+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:53.579983+0000 front 2024-04-26T18:47:53.579427+0000 (oldest deadline 2024-04-26T18:48:17.580135+0000) 2024-04-26T18:48:18.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:18 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:18.636+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:18.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:18 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:18.636+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.396179+0000 front 2024-04-26T18:47:52.395936+0000 (oldest deadline 2024-04-26T18:48:16.396262+0000) 2024-04-26T18:48:18.993 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:18 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:18.873+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:18.993 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:18 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:18.873+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:19.033 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:18 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:18.773+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:19.033 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:18 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:18.773+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:19.098 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 26 18:48:18 smithi082 podman[70200]: 2024-04-26 18:48:18.835358085 +0000 UTC m=+5.558315080 container died f1f4a99c261504a1dd292f677f8a911b6d2dd4c5c39ce72412dbe70b725a8ebc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-4, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-26T18:48:19.362 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:19 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:19.033+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:19.362 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:19 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:19.033+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:19.398 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:19 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:19.304+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:19.398 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:19 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:19.201+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:19.398 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:19 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:19.201+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:19.399 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 26 18:48:19 smithi082 podman[70200]: 2024-04-26 18:48:19.181216635 +0000 UTC m=+5.904173640 container cleanup f1f4a99c261504a1dd292f677f8a911b6d2dd4c5c39ce72412dbe70b725a8ebc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-4, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-26T18:48:19.399 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 26 18:48:19 smithi082 bash[70200]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-4 2024-04-26T18:48:19.719 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 26 18:48:19 smithi082 podman[70221]: 2024-04-26 18:48:19.399195157 +0000 UTC m=+0.560773899 container remove f1f4a99c261504a1dd292f677f8a911b6d2dd4c5c39ce72412dbe70b725a8ebc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-26T18:48:19.750 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:19 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:19.403+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.778078+0000 front 2024-04-26T18:47:44.778048+0000 (oldest deadline 2024-04-26T18:48:09.478053+0000) 2024-04-26T18:48:19.750 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:19 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:19.403+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:53.579983+0000 front 2024-04-26T18:47:53.579427+0000 (oldest deadline 2024-04-26T18:48:17.580135+0000) 2024-04-26T18:48:19.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:19 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:19.666+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:19.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:19 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:19.666+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.396179+0000 front 2024-04-26T18:47:52.395936+0000 (oldest deadline 2024-04-26T18:48:16.396262+0000) 2024-04-26T18:48:19.993 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:19 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:19.913+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:19.994 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:19 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:19.913+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:20.023 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 26 18:48:19 smithi082 podman[70317]: 2024-04-26 18:48:19.786841668 +0000 UTC m=+0.017697800 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:48:20.023 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 26 18:48:19 smithi082 podman[70317]: 2024-04-26 18:48:19.917018935 +0000 UTC m=+0.147875095 container create b59578495ab6f8e7f0dfd7caef7e9688e1f091375a10239712522dd026fb1550 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424) 2024-04-26T18:48:20.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:19 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:19.750+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:20.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:19 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:19.750+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:20.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:19 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:19.993+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:20.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:19 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:19.993+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:20.317 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:20 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:20.225+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:20.318 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:20 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:20.225+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:20.318 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 26 18:48:20 smithi082 podman[70317]: 2024-04-26 18:48:20.177783839 +0000 UTC m=+0.408639953 container init b59578495ab6f8e7f0dfd7caef7e9688e1f091375a10239712522dd026fb1550 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T18:48:20.318 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 26 18:48:20 smithi082 podman[70317]: 2024-04-26 18:48:20.180839271 +0000 UTC m=+0.411695387 container start b59578495ab6f8e7f0dfd7caef7e9688e1f091375a10239712522dd026fb1550 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-26T18:48:20.318 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 26 18:48:20 smithi082 podman[70317]: 2024-04-26 18:48:20.26122931 +0000 UTC m=+0.492085425 container attach b59578495ab6f8e7f0dfd7caef7e9688e1f091375a10239712522dd026fb1550 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-4-deactivate, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-26T18:48:20.719 INFO:journalctl@ceph.osd.4.smithi082.stdout:Apr 26 18:48:20 smithi082 podman[70317]: 2024-04-26 18:48:20.471732979 +0000 UTC m=+0.702589093 container died b59578495ab6f8e7f0dfd7caef7e9688e1f091375a10239712522dd026fb1550 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True) 2024-04-26T18:48:20.720 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:20 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:20.317+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:20.787 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:20 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:20.418+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.778078+0000 front 2024-04-26T18:47:44.778048+0000 (oldest deadline 2024-04-26T18:48:09.478053+0000) 2024-04-26T18:48:20.787 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:20 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:20.418+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:53.579983+0000 front 2024-04-26T18:47:53.579427+0000 (oldest deadline 2024-04-26T18:48:17.580135+0000) 2024-04-26T18:48:20.961 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:20 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:20.639+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:20.961 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:20 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:20.639+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.396179+0000 front 2024-04-26T18:47:52.395936+0000 (oldest deadline 2024-04-26T18:48:16.396262+0000) 2024-04-26T18:48:21.093 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.4.service' 2024-04-26T18:48:21.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:20 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:20.787+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:21.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:20 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:20.787+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:21.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:21 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:21.000+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:21.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:21 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:21.000+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:21.130 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:48:21.130 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-26T18:48:21.130 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-26T18:48:21.130 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.5 2024-04-26T18:48:21.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:20 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:20.961+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:21.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:20 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:20.961+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:21.437 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:21 smithi192 systemd[1]: Stopping Ceph osd.5 for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:48:21.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:21 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:21.297+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:21.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:21 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:21.260+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:21.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:21 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:21.260+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:21.744 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:21 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:21.436+0000 7fed5cfe6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:48:21.744 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:21 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:21.436+0000 7fed5cfe6700 -1 osd.5 106 *** Got signal Terminated *** 2024-04-26T18:48:21.744 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:21 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:21.436+0000 7fed5cfe6700 -1 osd.5 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T18:48:21.744 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:21 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:21.451+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.778078+0000 front 2024-04-26T18:47:44.778048+0000 (oldest deadline 2024-04-26T18:48:09.478053+0000) 2024-04-26T18:48:21.744 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:21 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:21.451+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:53.579983+0000 front 2024-04-26T18:47:53.579427+0000 (oldest deadline 2024-04-26T18:48:17.580135+0000) 2024-04-26T18:48:21.919 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:21 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:21.618+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:21.919 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:21 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:21.618+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.396179+0000 front 2024-04-26T18:47:52.395936+0000 (oldest deadline 2024-04-26T18:48:16.396262+0000) 2024-04-26T18:48:22.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:21 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:21.744+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:22.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:21 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:21.744+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:22.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:21 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:21.983+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:22.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:21 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:21.983+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:22.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:21 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:21.919+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:22.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:21 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:21.919+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:22.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:22 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:22.226+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:22.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:22 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:22.226+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:22.720 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:22 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:22.265+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:22.784 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:22 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:22.480+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.778078+0000 front 2024-04-26T18:47:44.778048+0000 (oldest deadline 2024-04-26T18:48:09.478053+0000) 2024-04-26T18:48:22.785 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:22 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:22.480+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:53.579983+0000 front 2024-04-26T18:47:53.579427+0000 (oldest deadline 2024-04-26T18:48:17.580135+0000) 2024-04-26T18:48:22.902 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:22 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:22.642+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:22.903 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:22 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:22.642+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.396179+0000 front 2024-04-26T18:47:52.395936+0000 (oldest deadline 2024-04-26T18:48:16.396262+0000) 2024-04-26T18:48:23.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:22 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:22.785+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:23.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:22 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:22.785+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:23.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:22 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:22.968+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:23.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:22 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:22.968+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:23.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:22 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:22.902+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:23.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:22 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:22.902+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:23.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:23 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:23.234+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:23.469 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:23 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:23.178+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:23.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:23 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:23.178+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:23.862 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:23 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:23.743+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:23.862 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:23 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:23.743+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:23.863 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:23 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:23.509+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.778078+0000 front 2024-04-26T18:47:44.778048+0000 (oldest deadline 2024-04-26T18:48:09.478053+0000) 2024-04-26T18:48:23.863 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:23 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:23.509+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:53.579983+0000 front 2024-04-26T18:47:53.579427+0000 (oldest deadline 2024-04-26T18:48:17.580135+0000) 2024-04-26T18:48:23.863 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:23 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:23.509+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:57.580392+0000 front 2024-04-26T18:47:57.580435+0000 (oldest deadline 2024-04-26T18:48:23.480545+0000) 2024-04-26T18:48:23.952 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:23.677+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:23.952 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:23.677+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.396179+0000 front 2024-04-26T18:47:52.395936+0000 (oldest deadline 2024-04-26T18:48:16.396262+0000) 2024-04-26T18:48:24.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:23.952+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:24.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:23.952+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:24.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:23.952+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:24.362 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:23 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:23.971+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:24.362 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:23 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:23.971+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:24.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:24 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:24.226+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:24.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:24 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:24.159+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:24.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:24 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:24.159+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:24.862 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:24 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:24.476+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.778078+0000 front 2024-04-26T18:47:44.778048+0000 (oldest deadline 2024-04-26T18:48:09.478053+0000) 2024-04-26T18:48:24.862 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:24 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:24.476+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:53.579983+0000 front 2024-04-26T18:47:53.579427+0000 (oldest deadline 2024-04-26T18:48:17.580135+0000) 2024-04-26T18:48:24.862 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:24 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:24.476+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:57.580392+0000 front 2024-04-26T18:47:57.580435+0000 (oldest deadline 2024-04-26T18:48:23.480545+0000) 2024-04-26T18:48:24.863 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:24 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:24.719+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:24.863 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:24 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:24.719+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:24.978 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:24 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:24.636+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:24.978 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:24 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:24.636+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.396179+0000 front 2024-04-26T18:47:52.395936+0000 (oldest deadline 2024-04-26T18:48:16.396262+0000) 2024-04-26T18:48:25.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:24 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:24.978+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:25.244 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:24 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:24.978+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:25.244 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:24 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:24.978+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:25.362 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:25 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:25.000+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:25.362 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:25 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:25.000+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:25.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:25 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:25.184+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:25.469 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:25 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:25.184+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:25.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:25 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:25.184+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:25.744 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:25 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:25.428+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.778078+0000 front 2024-04-26T18:47:44.778048+0000 (oldest deadline 2024-04-26T18:48:09.478053+0000) 2024-04-26T18:48:25.744 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:25 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:25.428+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:53.579983+0000 front 2024-04-26T18:47:53.579427+0000 (oldest deadline 2024-04-26T18:48:17.580135+0000) 2024-04-26T18:48:25.744 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:25 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:25.428+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:57.580392+0000 front 2024-04-26T18:47:57.580435+0000 (oldest deadline 2024-04-26T18:48:23.480545+0000) 2024-04-26T18:48:25.978 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:25 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:25.677+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:25.978 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:25 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:25.677+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.396179+0000 front 2024-04-26T18:47:52.395936+0000 (oldest deadline 2024-04-26T18:48:16.396262+0000) 2024-04-26T18:48:26.027 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:25 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:25.744+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:26.028 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:25 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:25.744+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:26.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:25 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:25.978+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:26.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:25 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:25.978+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:26.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:25 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:25.978+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:26.362 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:26 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:26.028+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:26.362 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:26 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:26.028+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:26.362 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:26 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:26.028+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:26.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:26 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:26.216+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:26.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:26 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:26.207+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:26.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:26 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:26.207+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:26.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:26 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:26.207+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:26.773 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:26 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:26.404+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.778078+0000 front 2024-04-26T18:47:44.778048+0000 (oldest deadline 2024-04-26T18:48:09.478053+0000) 2024-04-26T18:48:26.774 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:26 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:26.404+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:53.579983+0000 front 2024-04-26T18:47:53.579427+0000 (oldest deadline 2024-04-26T18:48:17.580135+0000) 2024-04-26T18:48:26.774 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:26 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5[44798]: 2024-04-26T18:48:26.404+0000 7fed595da700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:57.580392+0000 front 2024-04-26T18:47:57.580435+0000 (oldest deadline 2024-04-26T18:48:23.480545+0000) 2024-04-26T18:48:26.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:26 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:26.638+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:26.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:26 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:26.638+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.396179+0000 front 2024-04-26T18:47:52.395936+0000 (oldest deadline 2024-04-26T18:48:16.396262+0000) 2024-04-26T18:48:26.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:26 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:26.638+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:01.097427+0000 front 2024-04-26T18:48:01.097319+0000 (oldest deadline 2024-04-26T18:48:26.397379+0000) 2024-04-26T18:48:27.112 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:26 smithi192 podman[69928]: 2024-04-26 18:48:26.8719531 +0000 UTC m=+5.551653640 container died 75925b8a69563c01bb50344bc97925ac469c5f4238d930a8a9281d7c647b1f41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-26T18:48:27.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:26 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:26.985+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:27.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:26 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:26.985+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:27.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:26 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:26.985+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:27.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:26 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:26.773+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:27.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:26 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:26.773+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:27.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:26 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:26.773+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:27.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:27 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:27.183+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:27.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:27 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:27.183+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.488904+0000 front 2024-04-26T18:47:59.489069+0000 (oldest deadline 2024-04-26T18:48:27.089692+0000) 2024-04-26T18:48:27.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:27 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:27.188+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:27.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:27 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:27.188+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:27.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:27 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:27.188+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:27.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:27 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:27.001+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:27.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:27 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:27.001+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:27.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:27 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:27.001+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:27.537 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:27 smithi192 podman[69928]: 2024-04-26 18:48:27.262028477 +0000 UTC m=+5.941729017 container cleanup 75925b8a69563c01bb50344bc97925ac469c5f4238d930a8a9281d7c647b1f41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-26T18:48:27.537 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:27 smithi192 bash[69928]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5 2024-04-26T18:48:27.862 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:27 smithi192 podman[69946]: 2024-04-26 18:48:27.538196477 +0000 UTC m=+0.663461167 container remove 75925b8a69563c01bb50344bc97925ac469c5f4238d930a8a9281d7c647b1f41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2) 2024-04-26T18:48:27.862 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:27 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:27.727+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:27.863 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:27 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:27.727+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:27.863 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:27 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:27.727+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:27.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:27 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:27.683+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:27.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:27 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:27.683+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.396179+0000 front 2024-04-26T18:47:52.395936+0000 (oldest deadline 2024-04-26T18:48:16.396262+0000) 2024-04-26T18:48:27.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:27 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:27.683+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:01.097427+0000 front 2024-04-26T18:48:01.097319+0000 (oldest deadline 2024-04-26T18:48:26.397379+0000) 2024-04-26T18:48:28.133 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:27 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:27.957+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:28.133 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:27 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:27.957+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:28.133 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:27 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:27.957+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:28.133 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:27 smithi192 podman[70039]: 2024-04-26 18:48:27.781287973 +0000 UTC m=+0.018219002 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:48:28.134 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:27 smithi192 podman[70039]: 2024-04-26 18:48:27.89421071 +0000 UTC m=+0.131141729 container create 050e5d851e31e48aabab2017a528efc318543038a4f4ddb98bd76e6bb4fcaef9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-26T18:48:28.134 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:28 smithi192 podman[70039]: 2024-04-26 18:48:28.133653619 +0000 UTC m=+0.370584635 container init 050e5d851e31e48aabab2017a528efc318543038a4f4ddb98bd76e6bb4fcaef9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:48:28.431 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:28 smithi192 podman[70039]: 2024-04-26 18:48:28.137040134 +0000 UTC m=+0.373971151 container start 050e5d851e31e48aabab2017a528efc318543038a4f4ddb98bd76e6bb4fcaef9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-04-26T18:48:28.431 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:28 smithi192 podman[70039]: 2024-04-26 18:48:28.225341593 +0000 UTC m=+0.462272619 container attach 050e5d851e31e48aabab2017a528efc318543038a4f4ddb98bd76e6bb4fcaef9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424) 2024-04-26T18:48:28.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:28 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:28.155+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:28.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:28 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:28.155+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.488904+0000 front 2024-04-26T18:47:59.489069+0000 (oldest deadline 2024-04-26T18:48:27.089692+0000) 2024-04-26T18:48:28.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:28 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:28.165+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:28.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:28 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:28.165+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:28.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:28 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:28.165+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:28.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:28 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:28.046+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:28.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:28 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:28.046+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:28.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:28 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:28.046+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:28.694 INFO:journalctl@ceph.osd.5.smithi192.stdout:Apr 26 18:48:28 smithi192 podman[70039]: 2024-04-26 18:48:28.431890395 +0000 UTC m=+0.668821406 container died 050e5d851e31e48aabab2017a528efc318543038a4f4ddb98bd76e6bb4fcaef9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T18:48:28.949 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:28 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:28.738+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:28.949 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:28 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:28.738+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:28.949 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:28 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:28.738+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:28.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:28 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:28.655+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:28.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:28 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:28.655+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.396179+0000 front 2024-04-26T18:47:52.395936+0000 (oldest deadline 2024-04-26T18:48:16.396262+0000) 2024-04-26T18:48:28.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:28 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:28.655+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:01.097427+0000 front 2024-04-26T18:48:01.097319+0000 (oldest deadline 2024-04-26T18:48:26.397379+0000) 2024-04-26T18:48:29.030 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.5.service' 2024-04-26T18:48:29.066 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:48:29.067 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-26T18:48:29.067 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-04-26T18:48:29.067 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.6 2024-04-26T18:48:29.362 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:28 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:28.949+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:29.362 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:28 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:28.949+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:29.362 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:28 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:28.949+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:29.381 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:29 smithi080 systemd[1]: Stopping Ceph osd.6 for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:48:29.381 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:28 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:28.998+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:29.381 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:28 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:28.998+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:29.381 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:28 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:28.998+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:29.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:29 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:29.119+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:29.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:29 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:29.119+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.488904+0000 front 2024-04-26T18:47:59.489069+0000 (oldest deadline 2024-04-26T18:48:27.089692+0000) 2024-04-26T18:48:29.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:29 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:29.178+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:29.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:29 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:29.178+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:29.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:29 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:29.178+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:29.743 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:29 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:29.381+0000 7f3560824700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:48:29.743 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:29 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:29.381+0000 7f3560824700 -1 osd.6 106 *** Got signal Terminated *** 2024-04-26T18:48:29.743 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:29 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:29.381+0000 7f3560824700 -1 osd.6 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T18:48:29.743 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:29 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:29.624+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:29.743 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:29 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:29.624+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.396179+0000 front 2024-04-26T18:47:52.395936+0000 (oldest deadline 2024-04-26T18:48:16.396262+0000) 2024-04-26T18:48:29.743 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:29 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:29.624+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:01.097427+0000 front 2024-04-26T18:48:01.097319+0000 (oldest deadline 2024-04-26T18:48:26.397379+0000) 2024-04-26T18:48:30.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:29 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:29.690+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:30.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:29 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:29.690+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:30.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:29 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:29.690+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:30.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:29 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:29.926+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:30.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:29 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:29.926+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:30.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:29 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:29.926+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:30.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:30 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:30.104+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:30.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:30 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:30.104+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.488904+0000 front 2024-04-26T18:47:59.489069+0000 (oldest deadline 2024-04-26T18:48:27.089692+0000) 2024-04-26T18:48:30.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:30 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:30.176+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:30.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:30 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:30.176+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:30.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:30 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:30.176+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:30.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:30 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:30.046+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:30.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:30 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:30.046+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:30.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:30 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:30.046+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:30.934 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:30 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:30.671+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:30.934 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:30 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:30.671+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:30.934 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:30 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:30.671+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:30.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:30 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:30.593+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:30.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:30 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:30.593+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.396179+0000 front 2024-04-26T18:47:52.395936+0000 (oldest deadline 2024-04-26T18:48:16.396262+0000) 2024-04-26T18:48:30.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:30 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:30.593+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:01.097427+0000 front 2024-04-26T18:48:01.097319+0000 (oldest deadline 2024-04-26T18:48:26.397379+0000) 2024-04-26T18:48:31.362 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:30 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:30.934+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:31.363 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:30 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:30.934+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:31.363 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:30 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:30.934+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:31.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:31 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:31.063+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:31.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:31 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:31.063+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.488904+0000 front 2024-04-26T18:47:59.489069+0000 (oldest deadline 2024-04-26T18:48:27.089692+0000) 2024-04-26T18:48:31.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:31 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:31.193+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:31.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:31 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:31.193+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:31.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:31 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:31.193+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:31.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:31 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:31.028+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:31.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:31 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:31.028+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:31.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:31 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:31.029+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:31.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:31 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:31.567+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:31.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:31 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:31.567+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.396179+0000 front 2024-04-26T18:47:52.395936+0000 (oldest deadline 2024-04-26T18:48:16.396262+0000) 2024-04-26T18:48:31.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:31 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:31.567+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:01.097427+0000 front 2024-04-26T18:48:01.097319+0000 (oldest deadline 2024-04-26T18:48:26.397379+0000) 2024-04-26T18:48:32.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:31 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:31.933+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:32.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:31 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:31.933+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:32.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:31 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:31.933+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:32.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:31 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:31.700+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:32.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:31 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:31.700+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:32.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:31 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:31.700+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:32.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:31 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:31.700+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:32.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:32 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:32.107+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:32.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:32 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:32.107+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.488904+0000 front 2024-04-26T18:47:59.489069+0000 (oldest deadline 2024-04-26T18:48:27.089692+0000) 2024-04-26T18:48:32.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:32 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:32.169+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:32.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:32 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:32.169+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:32.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:32 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:32.169+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:32.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:32 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:32.026+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:32.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:32 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:32.026+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:32.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:32 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:32.026+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:32.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:32 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:32.565+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:32.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:32 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:32.565+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.396179+0000 front 2024-04-26T18:47:52.395936+0000 (oldest deadline 2024-04-26T18:48:16.396262+0000) 2024-04-26T18:48:32.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:32 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:32.565+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:01.097427+0000 front 2024-04-26T18:48:01.097319+0000 (oldest deadline 2024-04-26T18:48:26.397379+0000) 2024-04-26T18:48:32.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:32 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:32.565+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:07.498217+0000 front 2024-04-26T18:48:07.498265+0000 (oldest deadline 2024-04-26T18:48:32.198366+0000) 2024-04-26T18:48:33.014 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:32 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:32.723+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:33.015 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:32 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:32.723+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:33.015 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:32 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:32.723+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:33.015 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:32 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:32.723+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:33.015 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:32 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:32.940+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:33.015 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:32 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:32.940+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:33.015 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:32 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:32.940+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:33.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:33 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:33.151+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:33.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:33 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:33.151+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.488904+0000 front 2024-04-26T18:47:59.489069+0000 (oldest deadline 2024-04-26T18:48:27.089692+0000) 2024-04-26T18:48:33.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:33 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:33.151+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:07.090350+0000 front 2024-04-26T18:48:07.090363+0000 (oldest deadline 2024-04-26T18:48:32.390268+0000) 2024-04-26T18:48:33.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:33 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:33.131+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:33.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:33 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:33.131+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:33.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:33 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:33.131+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:33.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:33 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:33.131+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:33.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:33 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:33.047+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:33.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:33 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:33.047+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:33.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:33 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:33.047+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:33.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:33 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:33.557+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:42.394627+0000 front 2024-04-26T18:47:42.394660+0000 (oldest deadline 2024-04-26T18:48:08.294740+0000) 2024-04-26T18:48:33.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:33 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:33.557+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.396179+0000 front 2024-04-26T18:47:52.395936+0000 (oldest deadline 2024-04-26T18:48:16.396262+0000) 2024-04-26T18:48:33.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:33 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:33.557+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:01.097427+0000 front 2024-04-26T18:48:01.097319+0000 (oldest deadline 2024-04-26T18:48:26.397379+0000) 2024-04-26T18:48:33.993 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:33 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6[55081]: 2024-04-26T18:48:33.557+0000 7f3558e10700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:07.498217+0000 front 2024-04-26T18:48:07.498265+0000 (oldest deadline 2024-04-26T18:48:32.198366+0000) 2024-04-26T18:48:34.030 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:33 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:33.974+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:34.030 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:33 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:33.974+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:34.030 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:33 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:33.974+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:34.031 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:33 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:33.730+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:34.031 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:33 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:33.730+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:34.031 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:33 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:33.730+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:34.031 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:33 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:33.730+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:34.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:34 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:34.179+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:34.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:34 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:34.179+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.488904+0000 front 2024-04-26T18:47:59.489069+0000 (oldest deadline 2024-04-26T18:48:27.089692+0000) 2024-04-26T18:48:34.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:34 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:34.179+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:07.090350+0000 front 2024-04-26T18:48:07.090363+0000 (oldest deadline 2024-04-26T18:48:32.390268+0000) 2024-04-26T18:48:34.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:34 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:34.111+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:34.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:34 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:34.111+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:34.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:34 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:34.111+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:34.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:34 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:34.111+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:34.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:34 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:34.006+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:34.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:34 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:34.006+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:34.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:34 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:34.006+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:34.948 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:34 smithi080 podman[95986]: 2024-04-26 18:48:34.695743046 +0000 UTC m=+5.435978737 container died 1daf923894a58fba1517eecbd4c706c191174013db705fec32053389514ae40e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-26T18:48:35.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:34 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:34.957+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:35.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:34 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:34.957+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:35.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:34 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:34.957+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:35.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:34 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:34.957+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:05.896063+0000 front 2024-04-26T18:48:05.896073+0000 (oldest deadline 2024-04-26T18:48:34.096408+0000) 2024-04-26T18:48:35.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:34 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:34.775+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:35.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:34 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:34.775+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:35.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:34 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:34.775+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:35.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:34 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:34.775+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:35.231 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:35 smithi080 podman[95986]: 2024-04-26 18:48:35.031176548 +0000 UTC m=+5.771412235 container cleanup 1daf923894a58fba1517eecbd4c706c191174013db705fec32053389514ae40e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-04-26T18:48:35.232 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:35 smithi080 bash[95986]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6 2024-04-26T18:48:35.232 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:35 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:35.025+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:35.232 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:35 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:35.025+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:35.232 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:35 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:35.025+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:35.232 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:35 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:35.025+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.229615+0000 front 2024-04-26T18:48:08.229735+0000 (oldest deadline 2024-04-26T18:48:34.030148+0000) 2024-04-26T18:48:35.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:35 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:35.178+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:35.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:35 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:35.178+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.488904+0000 front 2024-04-26T18:47:59.489069+0000 (oldest deadline 2024-04-26T18:48:27.089692+0000) 2024-04-26T18:48:35.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:35 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:35.178+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:07.090350+0000 front 2024-04-26T18:48:07.090363+0000 (oldest deadline 2024-04-26T18:48:32.390268+0000) 2024-04-26T18:48:35.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:35 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:35.079+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:35.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:35 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:35.079+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:35.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:35 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:35.079+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:35.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:35 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:35.079+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:35.493 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:35 smithi080 podman[96003]: 2024-04-26 18:48:35.232489462 +0000 UTC m=+0.536623880 container remove 1daf923894a58fba1517eecbd4c706c191174013db705fec32053389514ae40e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-26T18:48:35.935 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:35 smithi080 podman[96092]: 2024-04-26 18:48:35.550617552 +0000 UTC m=+0.017931750 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:48:35.936 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:35 smithi080 podman[96092]: 2024-04-26 18:48:35.683868419 +0000 UTC m=+0.151182641 container create f1f1dfd8721d2511a1ac666db2e9d6975be04a97989f7f56e98cdea77a4c6b42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:48:35.936 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:35 smithi080 podman[96092]: 2024-04-26 18:48:35.936510181 +0000 UTC m=+0.403824361 container init f1f1dfd8721d2511a1ac666db2e9d6975be04a97989f7f56e98cdea77a4c6b42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6-deactivate, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, org.label-schema.build-date=20240424) 2024-04-26T18:48:36.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:35 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:35.978+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:36.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:35 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:35.978+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:36.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:35 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:35.978+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:36.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:35 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:35.978+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:05.896063+0000 front 2024-04-26T18:48:05.896073+0000 (oldest deadline 2024-04-26T18:48:34.096408+0000) 2024-04-26T18:48:36.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:35 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:35.806+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:36.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:35 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:35.806+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:36.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:35 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:35.806+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:36.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:35 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:35.806+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:36.228 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:35 smithi080 podman[96092]: 2024-04-26 18:48:35.93995531 +0000 UTC m=+0.407269490 container start f1f1dfd8721d2511a1ac666db2e9d6975be04a97989f7f56e98cdea77a4c6b42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-26T18:48:36.228 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:36 smithi080 podman[96092]: 2024-04-26 18:48:36.036560163 +0000 UTC m=+0.503874346 container attach f1f1dfd8721d2511a1ac666db2e9d6975be04a97989f7f56e98cdea77a4c6b42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.vendor=CentOS) 2024-04-26T18:48:36.228 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:36 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:36.012+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:36.228 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:36 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:36.012+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:36.228 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:36 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:36.012+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:36.228 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:36 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:36.012+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.229615+0000 front 2024-04-26T18:48:08.229735+0000 (oldest deadline 2024-04-26T18:48:34.030148+0000) 2024-04-26T18:48:36.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:36 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:36.137+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:36.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:36 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:36.137+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.488904+0000 front 2024-04-26T18:47:59.489069+0000 (oldest deadline 2024-04-26T18:48:27.089692+0000) 2024-04-26T18:48:36.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:36 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:36.137+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:07.090350+0000 front 2024-04-26T18:48:07.090363+0000 (oldest deadline 2024-04-26T18:48:32.390268+0000) 2024-04-26T18:48:36.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:36 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:36.069+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:36.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:36 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:36.069+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:36.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:36 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:36.069+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:36.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:36 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:36.069+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:36.493 INFO:journalctl@ceph.osd.6.smithi080.stdout:Apr 26 18:48:36 smithi080 podman[96092]: 2024-04-26 18:48:36.22849979 +0000 UTC m=+0.695813972 container died f1f1dfd8721d2511a1ac666db2e9d6975be04a97989f7f56e98cdea77a4c6b42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:48:36.873 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.6.service' 2024-04-26T18:48:36.911 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:48:36.911 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-04-26T18:48:36.911 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-04-26T18:48:36.911 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.7 2024-04-26T18:48:37.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:36 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:36.957+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:37.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:36 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:36.957+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:37.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:36 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:36.957+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:37.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:36 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:36.957+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:05.896063+0000 front 2024-04-26T18:48:05.896073+0000 (oldest deadline 2024-04-26T18:48:34.096408+0000) 2024-04-26T18:48:37.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:36 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:36.794+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:37.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:36 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:36.794+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:37.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:36 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:36.794+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:37.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:36 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:36.794+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:37.192 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:36 smithi082 systemd[1]: Stopping Ceph osd.7 for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:48:37.193 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:37 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:37.092+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:37.193 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:37 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:37.092+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.488904+0000 front 2024-04-26T18:47:59.489069+0000 (oldest deadline 2024-04-26T18:48:27.089692+0000) 2024-04-26T18:48:37.193 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:37 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:37.092+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:07.090350+0000 front 2024-04-26T18:48:07.090363+0000 (oldest deadline 2024-04-26T18:48:32.390268+0000) 2024-04-26T18:48:37.193 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:37 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:37.106+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:37.193 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:37 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:37.106+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:37.193 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:37 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:37.106+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:37.193 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:37 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:37.106+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:37.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:36 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:36.980+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:37.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:36 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:36.980+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:37.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:36 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:36.980+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:37.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:36 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:36.980+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.229615+0000 front 2024-04-26T18:48:08.229735+0000 (oldest deadline 2024-04-26T18:48:34.030148+0000) 2024-04-26T18:48:37.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:37 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:37.192+0000 7ffa688c7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:48:37.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:37 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:37.192+0000 7ffa688c7700 -1 osd.7 106 *** Got signal Terminated *** 2024-04-26T18:48:37.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:37 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:37.192+0000 7ffa688c7700 -1 osd.7 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T18:48:38.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:37 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:37.952+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:38.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:37 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:37.952+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:38.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:37 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:37.952+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:38.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:37 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:37.952+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:05.896063+0000 front 2024-04-26T18:48:05.896073+0000 (oldest deadline 2024-04-26T18:48:34.096408+0000) 2024-04-26T18:48:38.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:37 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:37.826+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:38.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:37 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:37.826+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:38.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:37 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:37.826+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:38.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:37 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:37.826+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:38.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:37 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:37.976+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:38.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:37 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:37.976+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:38.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:37 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:37.976+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:38.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:37 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:37.976+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.229615+0000 front 2024-04-26T18:48:08.229735+0000 (oldest deadline 2024-04-26T18:48:34.030148+0000) 2024-04-26T18:48:38.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:38 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:38.079+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:38.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:38 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:38.079+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.488904+0000 front 2024-04-26T18:47:59.489069+0000 (oldest deadline 2024-04-26T18:48:27.089692+0000) 2024-04-26T18:48:38.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:38 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:38.079+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:07.090350+0000 front 2024-04-26T18:48:07.090363+0000 (oldest deadline 2024-04-26T18:48:32.390268+0000) 2024-04-26T18:48:38.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:38 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:38.106+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:38.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:38 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:38.106+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:38.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:38 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:38.106+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:38.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:38 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:38.106+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:39.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:38 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:38.917+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:39.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:38 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:38.917+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:39.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:38 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:38.917+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:39.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:38 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:38.917+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:05.896063+0000 front 2024-04-26T18:48:05.896073+0000 (oldest deadline 2024-04-26T18:48:34.096408+0000) 2024-04-26T18:48:39.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:38 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:38.825+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:39.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:38 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:38.825+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:39.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:38 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:38.825+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:39.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:38 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:38.825+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:39.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:39 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:39.065+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:39.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:39 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:39.065+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.488904+0000 front 2024-04-26T18:47:59.489069+0000 (oldest deadline 2024-04-26T18:48:27.089692+0000) 2024-04-26T18:48:39.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:39 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:39.065+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:07.090350+0000 front 2024-04-26T18:48:07.090363+0000 (oldest deadline 2024-04-26T18:48:32.390268+0000) 2024-04-26T18:48:39.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:39 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:39.133+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:39.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:39 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:39.133+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:39.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:39 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:39.133+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:39.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:39 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:39.133+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:39.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:39 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:39.005+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:39.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:39 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:39.005+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:39.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:39 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:39.005+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:39.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:39 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:39.005+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.229615+0000 front 2024-04-26T18:48:08.229735+0000 (oldest deadline 2024-04-26T18:48:34.030148+0000) 2024-04-26T18:48:40.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:39 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:39.893+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:40.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:39 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:39.893+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:40.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:39 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:39.893+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:40.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:39 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:39.893+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:05.896063+0000 front 2024-04-26T18:48:05.896073+0000 (oldest deadline 2024-04-26T18:48:34.096408+0000) 2024-04-26T18:48:40.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:39 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:39.823+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:40.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:39 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:39.823+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:40.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:39 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:39.823+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:40.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:39 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:39.823+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:40.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:39 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:39.823+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:48:40.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:40 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:40.052+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:40.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:40 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:40.052+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.488904+0000 front 2024-04-26T18:47:59.489069+0000 (oldest deadline 2024-04-26T18:48:27.089692+0000) 2024-04-26T18:48:40.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:40 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:40.052+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:07.090350+0000 front 2024-04-26T18:48:07.090363+0000 (oldest deadline 2024-04-26T18:48:32.390268+0000) 2024-04-26T18:48:40.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:40 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:40.052+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:15.291274+0000 front 2024-04-26T18:48:15.291303+0000 (oldest deadline 2024-04-26T18:48:39.291717+0000) 2024-04-26T18:48:40.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:40 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:40.086+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:40.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:40 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:40.086+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:40.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:40 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:40.086+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:40.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:40 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:40.086+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:40.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:40 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:40.029+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:40.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:40 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:40.029+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:40.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:40 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:40.029+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:40.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:40 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:40.029+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.229615+0000 front 2024-04-26T18:48:08.229735+0000 (oldest deadline 2024-04-26T18:48:34.030148+0000) 2024-04-26T18:48:40.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:40 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:40.029+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:15.131346+0000 front 2024-04-26T18:48:15.131269+0000 (oldest deadline 2024-04-26T18:48:39.231248+0000) 2024-04-26T18:48:41.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:40 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:40.880+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:41.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:40 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:40.880+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:41.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:40 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:40.880+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:41.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:40 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:40.880+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:05.896063+0000 front 2024-04-26T18:48:05.896073+0000 (oldest deadline 2024-04-26T18:48:34.096408+0000) 2024-04-26T18:48:41.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:40 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:40.813+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:41.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:40 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:40.813+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:41.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:40 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:40.813+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:41.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:40 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:40.813+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:41.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:40 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:40.813+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:48:41.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:40 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:40.982+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:41.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:40 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:40.982+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:41.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:40 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:40.982+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:41.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:40 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:40.982+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.229615+0000 front 2024-04-26T18:48:08.229735+0000 (oldest deadline 2024-04-26T18:48:34.030148+0000) 2024-04-26T18:48:41.244 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:40 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:40.982+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:15.131346+0000 front 2024-04-26T18:48:15.131269+0000 (oldest deadline 2024-04-26T18:48:39.231248+0000) 2024-04-26T18:48:41.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:41 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:41.014+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:41.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:41 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:41.014+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.488904+0000 front 2024-04-26T18:47:59.489069+0000 (oldest deadline 2024-04-26T18:48:27.089692+0000) 2024-04-26T18:48:41.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:41 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:41.014+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:07.090350+0000 front 2024-04-26T18:48:07.090363+0000 (oldest deadline 2024-04-26T18:48:32.390268+0000) 2024-04-26T18:48:41.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:41 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:41.014+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:15.291274+0000 front 2024-04-26T18:48:15.291303+0000 (oldest deadline 2024-04-26T18:48:39.291717+0000) 2024-04-26T18:48:41.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:41 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:41.131+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:41.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:41 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:41.131+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:41.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:41 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:41.131+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:41.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:41 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:41.131+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:41.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:41 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:41.131+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:48:42.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:41 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:41.860+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:42.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:41 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:41.860+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:42.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:41 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:41.860+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:42.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:41 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:41.860+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:05.896063+0000 front 2024-04-26T18:48:05.896073+0000 (oldest deadline 2024-04-26T18:48:34.096408+0000) 2024-04-26T18:48:42.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:41 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:41.777+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:42.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:41 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:41.777+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:42.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:41 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:41.777+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:42.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:41 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:41.777+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:42.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:41 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:41.777+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:48:42.469 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:42 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:42.101+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:42.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:42 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:42.101+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:42.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:42 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:42.101+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:42.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:42 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:42.101+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:42.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:42 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:42.101+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:48:42.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:41 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:41.972+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.687760+0000 front 2024-04-26T18:47:50.687709+0000 (oldest deadline 2024-04-26T18:48:14.787892+0000) 2024-04-26T18:48:42.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:41 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:41.972+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.488904+0000 front 2024-04-26T18:47:59.489069+0000 (oldest deadline 2024-04-26T18:48:27.089692+0000) 2024-04-26T18:48:42.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:41 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:41.972+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:07.090350+0000 front 2024-04-26T18:48:07.090363+0000 (oldest deadline 2024-04-26T18:48:32.390268+0000) 2024-04-26T18:48:42.470 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:41 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7[51075]: 2024-04-26T18:48:41.972+0000 7ffa60eb3700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:15.291274+0000 front 2024-04-26T18:48:15.291303+0000 (oldest deadline 2024-04-26T18:48:39.291717+0000) 2024-04-26T18:48:42.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:42 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:42.029+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:42.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:42 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:42.029+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:42.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:42 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:42.029+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:42.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:42 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:42.029+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.229615+0000 front 2024-04-26T18:48:08.229735+0000 (oldest deadline 2024-04-26T18:48:34.030148+0000) 2024-04-26T18:48:42.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:42 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:42.029+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:15.131346+0000 front 2024-04-26T18:48:15.131269+0000 (oldest deadline 2024-04-26T18:48:39.231248+0000) 2024-04-26T18:48:42.958 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:42 smithi082 podman[70422]: 2024-04-26 18:48:42.648659643 +0000 UTC m=+5.545679048 container died fb37219f1bae135f3774ec0df757e49b051f3d5fdda99c49e1cfe9f0da87f7e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-26T18:48:43.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:42 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:42.865+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:43.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:42 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:42.865+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:43.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:42 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:42.865+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:43.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:42 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:42.865+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:05.896063+0000 front 2024-04-26T18:48:05.896073+0000 (oldest deadline 2024-04-26T18:48:34.096408+0000) 2024-04-26T18:48:43.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:42 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:42.811+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:43.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:42 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:42.811+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:43.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:42 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:42.811+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:43.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:42 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:42.811+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:43.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:42 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:42.811+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:48:43.218 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:42 smithi082 podman[70422]: 2024-04-26 18:48:42.958917782 +0000 UTC m=+5.855937190 container cleanup fb37219f1bae135f3774ec0df757e49b051f3d5fdda99c49e1cfe9f0da87f7e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-26T18:48:43.218 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:42 smithi082 bash[70422]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7 2024-04-26T18:48:43.218 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:43 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:43.127+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:43.218 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:43 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:43.127+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:43.219 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:43 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:43.127+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:43.219 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:43 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:43.127+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:43.219 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:43 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:43.127+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:48:43.469 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:43 smithi082 podman[70439]: 2024-04-26 18:48:43.218641871 +0000 UTC m=+0.572155785 container remove fb37219f1bae135f3774ec0df757e49b051f3d5fdda99c49e1cfe9f0da87f7e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7, org.label-schema.build-date=20240424, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux ) 2024-04-26T18:48:43.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:43 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:43.000+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:43.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:43 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:43.000+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:43.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:43 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:43.000+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:43.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:43 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:43.000+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.229615+0000 front 2024-04-26T18:48:08.229735+0000 (oldest deadline 2024-04-26T18:48:34.030148+0000) 2024-04-26T18:48:43.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:43 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:43.000+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:15.131346+0000 front 2024-04-26T18:48:15.131269+0000 (oldest deadline 2024-04-26T18:48:39.231248+0000) 2024-04-26T18:48:43.872 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:43 smithi082 podman[70526]: 2024-04-26 18:48:43.611131251 +0000 UTC m=+0.095251988 container create 8539438e2769f49213765de34015ba6288d1895c7b0c561047444cd7350461bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-26T18:48:43.872 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:43 smithi082 podman[70526]: 2024-04-26 18:48:43.533821226 +0000 UTC m=+0.017941973 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:48:44.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:43 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:43.853+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:44.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:43 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:43.853+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:44.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:43 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:43.853+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:44.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:43 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:43.853+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:05.896063+0000 front 2024-04-26T18:48:05.896073+0000 (oldest deadline 2024-04-26T18:48:34.096408+0000) 2024-04-26T18:48:44.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:43 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:43.829+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:44.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:43 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:43.829+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:44.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:43 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:43.829+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:44.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:43 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:43.829+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:44.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:43 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:43.829+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:48:44.131 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:43 smithi082 podman[70526]: 2024-04-26 18:48:43.872976311 +0000 UTC m=+0.357097058 container init 8539438e2769f49213765de34015ba6288d1895c7b0c561047444cd7350461bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-26T18:48:44.131 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:43 smithi082 podman[70526]: 2024-04-26 18:48:43.876753418 +0000 UTC m=+0.360874156 container start 8539438e2769f49213765de34015ba6288d1895c7b0c561047444cd7350461bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T18:48:44.131 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:43 smithi082 podman[70526]: 2024-04-26 18:48:43.939096281 +0000 UTC m=+0.423217034 container attach 8539438e2769f49213765de34015ba6288d1895c7b0c561047444cd7350461bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424) 2024-04-26T18:48:44.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:43 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:43.957+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:44.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:43 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:43.957+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:44.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:43 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:43.957+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:44.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:43 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:43.957+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.229615+0000 front 2024-04-26T18:48:08.229735+0000 (oldest deadline 2024-04-26T18:48:34.030148+0000) 2024-04-26T18:48:44.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:43 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:43.957+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:15.131346+0000 front 2024-04-26T18:48:15.131269+0000 (oldest deadline 2024-04-26T18:48:39.231248+0000) 2024-04-26T18:48:44.450 INFO:journalctl@ceph.osd.7.smithi082.stdout:Apr 26 18:48:44 smithi082 podman[70526]: 2024-04-26 18:48:44.182975769 +0000 UTC m=+0.667096507 container died 8539438e2769f49213765de34015ba6288d1895c7b0c561047444cd7350461bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-26T18:48:44.450 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:44 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:44.130+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:44.450 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:44 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:44.130+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:44.450 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:44 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:44.130+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:44.450 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:44 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:44.130+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:44.450 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:44 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:44.130+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:48:44.774 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.7.service' 2024-04-26T18:48:44.811 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:48:44.811 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-04-26T18:48:44.811 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-04-26T18:48:44.811 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.8 2024-04-26T18:48:45.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:44 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:44.801+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:45.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:44 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:44.801+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:45.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:44 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:44.801+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:45.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:44 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:44.801+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:45.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:44 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:44.801+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:48:45.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:44 smithi192 systemd[1]: Stopping Ceph osd.8 for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:48:45.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:44 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:44.876+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:45.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:44 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:44.876+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:45.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:44 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:44.876+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:45.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:44 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:44.876+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:05.896063+0000 front 2024-04-26T18:48:05.896073+0000 (oldest deadline 2024-04-26T18:48:34.096408+0000) 2024-04-26T18:48:45.397 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:45 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:45.134+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:45.397 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:45 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:45.134+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:45.397 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:45 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:45.134+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:45.397 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:45 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:45.134+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:45.397 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:45 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:45.134+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:48:45.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:44 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:44.998+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:45.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:44 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:44.998+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:45.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:44 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:44.998+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:45.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:44 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:44.998+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.229615+0000 front 2024-04-26T18:48:08.229735+0000 (oldest deadline 2024-04-26T18:48:34.030148+0000) 2024-04-26T18:48:45.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:44 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:44.998+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:15.131346+0000 front 2024-04-26T18:48:15.131269+0000 (oldest deadline 2024-04-26T18:48:39.231248+0000) 2024-04-26T18:48:45.612 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:45 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:45.114+0000 7f4b02efe700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:48:45.612 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:45 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:45.114+0000 7f4b02efe700 -1 osd.8 106 *** Got signal Terminated *** 2024-04-26T18:48:45.612 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:45 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:45.114+0000 7f4b02efe700 -1 osd.8 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T18:48:46.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:45 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:45.887+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:46.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:45 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:45.887+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:46.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:45 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:45.887+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:46.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:45 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:45.887+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:05.896063+0000 front 2024-04-26T18:48:05.896073+0000 (oldest deadline 2024-04-26T18:48:34.096408+0000) 2024-04-26T18:48:46.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:45 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:45.818+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:46.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:45 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:45.818+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:46.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:45 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:45.818+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:46.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:45 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:45.818+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:46.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:45 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:45.818+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:48:46.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:45 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:45.965+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:46.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:45 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:45.965+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:46.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:45 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:45.965+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:46.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:45 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:45.965+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.229615+0000 front 2024-04-26T18:48:08.229735+0000 (oldest deadline 2024-04-26T18:48:34.030148+0000) 2024-04-26T18:48:46.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:45 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:45.965+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:15.131346+0000 front 2024-04-26T18:48:15.131269+0000 (oldest deadline 2024-04-26T18:48:39.231248+0000) 2024-04-26T18:48:46.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:46 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:46.088+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:46.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:46 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:46.088+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:46.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:46 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:46.088+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:46.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:46 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:46.088+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:46.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:46 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:46.088+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:48:47.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:46 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:46.862+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:47.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:46 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:46.862+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:47.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:46 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:46.862+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:47.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:46 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:46.862+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:05.896063+0000 front 2024-04-26T18:48:05.896073+0000 (oldest deadline 2024-04-26T18:48:34.096408+0000) 2024-04-26T18:48:47.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:46 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:46.819+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:47.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:46 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:46.819+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:47.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:46 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:46.819+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:47.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:46 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:46.819+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:47.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:46 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:46.819+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:48:47.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:46 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:46.987+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:47.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:46 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:46.987+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:47.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:46 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:46.987+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:47.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:46 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:46.987+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.229615+0000 front 2024-04-26T18:48:08.229735+0000 (oldest deadline 2024-04-26T18:48:34.030148+0000) 2024-04-26T18:48:47.244 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:46 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:46.987+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:15.131346+0000 front 2024-04-26T18:48:15.131269+0000 (oldest deadline 2024-04-26T18:48:39.231248+0000) 2024-04-26T18:48:47.370 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:47 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:47.073+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:47.370 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:47 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:47.073+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:47.371 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:47 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:47.073+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:47.371 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:47 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:47.073+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:47.371 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:47 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:47.073+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:48:48.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:47 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:47.902+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:48.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:47 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:47.902+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:48.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:47 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:47.902+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:48.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:47 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:47.902+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:05.896063+0000 front 2024-04-26T18:48:05.896073+0000 (oldest deadline 2024-04-26T18:48:34.096408+0000) 2024-04-26T18:48:48.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:47 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:47.840+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:48.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:47 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:47.840+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:48.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:47 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:47.840+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:48.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:47 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:47.840+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:48.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:47 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:47.840+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:48:48.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:47 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:47.992+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:48.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:47 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:47.992+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:48.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:47 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:47.992+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:48.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:47 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:47.992+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.229615+0000 front 2024-04-26T18:48:08.229735+0000 (oldest deadline 2024-04-26T18:48:34.030148+0000) 2024-04-26T18:48:48.244 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:47 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:47.992+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:15.131346+0000 front 2024-04-26T18:48:15.131269+0000 (oldest deadline 2024-04-26T18:48:39.231248+0000) 2024-04-26T18:48:48.469 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:48 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:48.057+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:48.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:48 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:48.057+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:48.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:48 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:48.057+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:48.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:48 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:48.057+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:48.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:48 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:48.057+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:48:48.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:48 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:48.057+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:23.244240+0000 front 2024-04-26T18:48:23.244128+0000 (oldest deadline 2024-04-26T18:48:47.943984+0000) 2024-04-26T18:48:49.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:48 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:48.888+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:49.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:48 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:48.888+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:49.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:48 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:48.888+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:49.113 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:48 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:48.888+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:05.896063+0000 front 2024-04-26T18:48:05.896073+0000 (oldest deadline 2024-04-26T18:48:34.096408+0000) 2024-04-26T18:48:49.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:48 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:48.803+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:49.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:48 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:48.803+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:49.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:48 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:48.803+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:49.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:48 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:48.803+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:49.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:48 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:48.803+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:48:49.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:48 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:48.977+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:49.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:48 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:48.977+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:49.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:48 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:48.977+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:49.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:48 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:48.977+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.229615+0000 front 2024-04-26T18:48:08.229735+0000 (oldest deadline 2024-04-26T18:48:34.030148+0000) 2024-04-26T18:48:49.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:48 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:48.977+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:15.131346+0000 front 2024-04-26T18:48:15.131269+0000 (oldest deadline 2024-04-26T18:48:39.231248+0000) 2024-04-26T18:48:49.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:48 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:48.977+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:22.732464+0000 front 2024-04-26T18:48:22.732391+0000 (oldest deadline 2024-04-26T18:48:48.032223+0000) 2024-04-26T18:48:49.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:49 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:49.101+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:49.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:49 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:49.101+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:49.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:49 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:49.101+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:49.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:49 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:49.101+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:49.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:49 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:49.101+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:48:49.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:49 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:49.101+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:23.244240+0000 front 2024-04-26T18:48:23.244128+0000 (oldest deadline 2024-04-26T18:48:47.943984+0000) 2024-04-26T18:48:50.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:49 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:49.871+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:40.692803+0000 front 2024-04-26T18:47:40.692763+0000 (oldest deadline 2024-04-26T18:48:10.693248+0000) 2024-04-26T18:48:50.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:49 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:49.871+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:50.693893+0000 front 2024-04-26T18:47:50.693805+0000 (oldest deadline 2024-04-26T18:48:15.393812+0000) 2024-04-26T18:48:50.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:49 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:49.871+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.094907+0000 front 2024-04-26T18:48:00.095020+0000 (oldest deadline 2024-04-26T18:48:25.895473+0000) 2024-04-26T18:48:50.112 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:49 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8[51360]: 2024-04-26T18:48:49.871+0000 7f4aff4f2700 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:05.896063+0000 front 2024-04-26T18:48:05.896073+0000 (oldest deadline 2024-04-26T18:48:34.096408+0000) 2024-04-26T18:48:50.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:49 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:49.818+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:50.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:49 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:49.818+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:50.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:49 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:49.818+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:50.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:49 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:49.818+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:50.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:49 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:49.818+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:48:50.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:49 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:49.818+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:24.877439+0000 front 2024-04-26T18:48:24.877374+0000 (oldest deadline 2024-04-26T18:48:49.577483+0000) 2024-04-26T18:48:50.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:49 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:49.982+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:50.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:49 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:49.982+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:50.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:49 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:49.982+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:50.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:49 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:49.982+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.229615+0000 front 2024-04-26T18:48:08.229735+0000 (oldest deadline 2024-04-26T18:48:34.030148+0000) 2024-04-26T18:48:50.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:49 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:49.982+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:15.131346+0000 front 2024-04-26T18:48:15.131269+0000 (oldest deadline 2024-04-26T18:48:39.231248+0000) 2024-04-26T18:48:50.244 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:49 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:49.982+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:22.732464+0000 front 2024-04-26T18:48:22.732391+0000 (oldest deadline 2024-04-26T18:48:48.032223+0000) 2024-04-26T18:48:50.469 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:50 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:50.149+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:50.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:50 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:50.149+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:50.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:50 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:50.149+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:50.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:50 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:50.149+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:50.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:50 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:50.149+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:48:50.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:50 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:50.149+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:23.244240+0000 front 2024-04-26T18:48:23.244128+0000 (oldest deadline 2024-04-26T18:48:47.943984+0000) 2024-04-26T18:48:50.740 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:50 smithi192 podman[70157]: 2024-04-26 18:48:50.439436929 +0000 UTC m=+5.425577246 container died 273ff410158bc89eeabbe2c5774049abeabd7fe25dfdb4195c7d9dd4b7c531f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, ceph=True, org.label-schema.schema-version=1.0) 2024-04-26T18:48:51.098 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:50 smithi192 podman[70157]: 2024-04-26 18:48:50.848342011 +0000 UTC m=+5.834482327 container cleanup 273ff410158bc89eeabbe2c5774049abeabd7fe25dfdb4195c7d9dd4b7c531f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=) 2024-04-26T18:48:51.099 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:50 smithi192 bash[70157]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8 2024-04-26T18:48:51.099 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:50 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:50.863+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:51.099 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:50 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:50.863+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:51.099 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:50 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:50.863+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:51.099 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:50 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:50.863+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:51.099 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:50 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:50.863+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:48:51.099 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:50 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:50.863+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:24.877439+0000 front 2024-04-26T18:48:24.877374+0000 (oldest deadline 2024-04-26T18:48:49.577483+0000) 2024-04-26T18:48:51.362 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:51 smithi192 podman[70175]: 2024-04-26 18:48:51.099569978 +0000 UTC m=+0.657390879 container remove 273ff410158bc89eeabbe2c5774049abeabd7fe25dfdb4195c7d9dd4b7c531f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux ) 2024-04-26T18:48:51.469 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:51 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:51.122+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:51.469 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:51 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:51.122+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:51.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:51 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:51.122+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:51.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:51 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:51.122+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:51.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:51 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:51.122+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:48:51.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:51 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:51.122+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:23.244240+0000 front 2024-04-26T18:48:23.244128+0000 (oldest deadline 2024-04-26T18:48:47.943984+0000) 2024-04-26T18:48:51.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:50 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:50.996+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:51.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:50 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:50.996+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:51.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:50 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:50.996+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:51.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:50 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:50.996+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.229615+0000 front 2024-04-26T18:48:08.229735+0000 (oldest deadline 2024-04-26T18:48:34.030148+0000) 2024-04-26T18:48:51.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:50 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:50.996+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:15.131346+0000 front 2024-04-26T18:48:15.131269+0000 (oldest deadline 2024-04-26T18:48:39.231248+0000) 2024-04-26T18:48:51.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:50 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:50.996+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:22.732464+0000 front 2024-04-26T18:48:22.732391+0000 (oldest deadline 2024-04-26T18:48:48.032223+0000) 2024-04-26T18:48:51.694 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:51 smithi192 podman[70265]: 2024-04-26 18:48:51.318512299 +0000 UTC m=+0.017167701 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:48:51.694 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:51 smithi192 podman[70265]: 2024-04-26 18:48:51.442177178 +0000 UTC m=+0.140832572 container create 798e3fc2a3ab9a74cb7632ba60df482eed406b27c9e63e22e05cd1d52ecb955b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-26T18:48:51.986 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:51 smithi192 podman[70265]: 2024-04-26 18:48:51.694871436 +0000 UTC m=+0.393526831 container init 798e3fc2a3ab9a74cb7632ba60df482eed406b27c9e63e22e05cd1d52ecb955b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux ) 2024-04-26T18:48:51.986 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:51 smithi192 podman[70265]: 2024-04-26 18:48:51.698221946 +0000 UTC m=+0.396877341 container start 798e3fc2a3ab9a74cb7632ba60df482eed406b27c9e63e22e05cd1d52ecb955b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-26T18:48:51.986 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:51 smithi192 podman[70265]: 2024-04-26 18:48:51.769869818 +0000 UTC m=+0.468525212 container attach 798e3fc2a3ab9a74cb7632ba60df482eed406b27c9e63e22e05cd1d52ecb955b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:48:51.986 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:51 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:51.856+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:51.986 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:51 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:51.856+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:51.986 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:51 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:51.856+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:51.986 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:51 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:51.856+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:51.987 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:51 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:51.856+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:48:51.987 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:51 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:51.856+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:24.877439+0000 front 2024-04-26T18:48:24.877374+0000 (oldest deadline 2024-04-26T18:48:49.577483+0000) 2024-04-26T18:48:52.298 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:51 smithi192 podman[70265]: 2024-04-26 18:48:51.986395762 +0000 UTC m=+0.685051161 container died 798e3fc2a3ab9a74cb7632ba60df482eed406b27c9e63e22e05cd1d52ecb955b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True) 2024-04-26T18:48:52.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:52 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:52.156+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:52.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:52 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:52.156+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:52.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:52 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:52.156+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:52.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:52 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:52.156+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:52.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:52 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:52.156+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:48:52.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:52 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:52.156+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:23.244240+0000 front 2024-04-26T18:48:23.244128+0000 (oldest deadline 2024-04-26T18:48:47.943984+0000) 2024-04-26T18:48:52.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:52 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:52.026+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:52.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:52 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:52.026+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:52.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:52 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:52.026+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:52.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:52 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:52.026+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.229615+0000 front 2024-04-26T18:48:08.229735+0000 (oldest deadline 2024-04-26T18:48:34.030148+0000) 2024-04-26T18:48:52.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:52 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:52.026+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:15.131346+0000 front 2024-04-26T18:48:15.131269+0000 (oldest deadline 2024-04-26T18:48:39.231248+0000) 2024-04-26T18:48:52.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:52 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:52.026+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:22.732464+0000 front 2024-04-26T18:48:22.732391+0000 (oldest deadline 2024-04-26T18:48:48.032223+0000) 2024-04-26T18:48:52.549 INFO:journalctl@ceph.osd.8.smithi192.stdout:Apr 26 18:48:52 smithi192 podman[70291]: 2024-04-26 18:48:52.540474228 +0000 UTC m=+0.548693384 container remove 798e3fc2a3ab9a74cb7632ba60df482eed406b27c9e63e22e05cd1d52ecb955b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-26T18:48:52.555 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.8.service' 2024-04-26T18:48:52.592 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:48:52.592 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-04-26T18:48:52.592 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-04-26T18:48:52.592 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.9 2024-04-26T18:48:52.892 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:52 smithi080 systemd[1]: Stopping Ceph osd.9 for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:48:52.892 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:52 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:52.891+0000 7f3d737dd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:48:52.892 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:52 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:52.891+0000 7f3d737dd700 -1 osd.9 106 *** Got signal Terminated *** 2024-04-26T18:48:52.892 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:52 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:52.891+0000 7f3d737dd700 -1 osd.9 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T18:48:53.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:52 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:52.862+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:53.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:52 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:52.863+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:53.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:52 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:52.863+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:53.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:52 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:52.863+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:53.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:52 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:52.863+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:48:53.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:52 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:52.863+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:24.877439+0000 front 2024-04-26T18:48:24.877374+0000 (oldest deadline 2024-04-26T18:48:49.577483+0000) 2024-04-26T18:48:53.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:53 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:53.059+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:53.243 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:53 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:53.059+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:53.244 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:53 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:53.059+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:53.244 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:53 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:53.059+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.229615+0000 front 2024-04-26T18:48:08.229735+0000 (oldest deadline 2024-04-26T18:48:34.030148+0000) 2024-04-26T18:48:53.244 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:53 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:53.059+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:15.131346+0000 front 2024-04-26T18:48:15.131269+0000 (oldest deadline 2024-04-26T18:48:39.231248+0000) 2024-04-26T18:48:53.244 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:53 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:53.059+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:22.732464+0000 front 2024-04-26T18:48:22.732391+0000 (oldest deadline 2024-04-26T18:48:48.032223+0000) 2024-04-26T18:48:53.469 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:53 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:53.174+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:53.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:53 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:53.174+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:53.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:53 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:53.174+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:53.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:53 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:53.174+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:53.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:53 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:53.174+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:48:53.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:53 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:53.174+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:23.244240+0000 front 2024-04-26T18:48:23.244128+0000 (oldest deadline 2024-04-26T18:48:47.943984+0000) 2024-04-26T18:48:54.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:53 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:53.861+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:54.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:53 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:53.861+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:54.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:53 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:53.861+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:54.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:53 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:53.861+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:54.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:53 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:53.861+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:48:54.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:53 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:53.861+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:24.877439+0000 front 2024-04-26T18:48:24.877374+0000 (oldest deadline 2024-04-26T18:48:49.577483+0000) 2024-04-26T18:48:54.469 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:54 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:54.181+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:54.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:54 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:54.181+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:54.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:54 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:54.181+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:54.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:54 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:54.181+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:54.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:54 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:54.181+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:48:54.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:54 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:54.181+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:23.244240+0000 front 2024-04-26T18:48:23.244128+0000 (oldest deadline 2024-04-26T18:48:47.943984+0000) 2024-04-26T18:48:54.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:54 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:54.079+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:54.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:54 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:54.079+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:54.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:54 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:54.079+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:54.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:54 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:54.079+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.229615+0000 front 2024-04-26T18:48:08.229735+0000 (oldest deadline 2024-04-26T18:48:34.030148+0000) 2024-04-26T18:48:54.494 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:54 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:54.079+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:15.131346+0000 front 2024-04-26T18:48:15.131269+0000 (oldest deadline 2024-04-26T18:48:39.231248+0000) 2024-04-26T18:48:54.494 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:54 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:54.079+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:22.732464+0000 front 2024-04-26T18:48:22.732391+0000 (oldest deadline 2024-04-26T18:48:48.032223+0000) 2024-04-26T18:48:55.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:54 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:54.876+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:55.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:54 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:54.876+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:55.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:54 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:54.876+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:55.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:54 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:54.876+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:55.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:54 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:54.876+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:48:55.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:54 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:54.876+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:24.877439+0000 front 2024-04-26T18:48:24.877374+0000 (oldest deadline 2024-04-26T18:48:49.577483+0000) 2024-04-26T18:48:55.469 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:55 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:55.144+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:55.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:55 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:55.144+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:55.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:55 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:55.144+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:55.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:55 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:55.144+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:55.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:55 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:55.144+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:48:55.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:55 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:55.144+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:23.244240+0000 front 2024-04-26T18:48:23.244128+0000 (oldest deadline 2024-04-26T18:48:47.943984+0000) 2024-04-26T18:48:55.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:55 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:55.125+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:55.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:55 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:55.125+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:55.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:55 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:55.125+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:55.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:55 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:55.125+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.229615+0000 front 2024-04-26T18:48:08.229735+0000 (oldest deadline 2024-04-26T18:48:34.030148+0000) 2024-04-26T18:48:55.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:55 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:55.125+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:15.131346+0000 front 2024-04-26T18:48:15.131269+0000 (oldest deadline 2024-04-26T18:48:39.231248+0000) 2024-04-26T18:48:55.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:55 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:55.125+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:22.732464+0000 front 2024-04-26T18:48:22.732391+0000 (oldest deadline 2024-04-26T18:48:48.032223+0000) 2024-04-26T18:48:55.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:55 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:55.125+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-26T18:48:30.933186+0000 front 2024-04-26T18:48:30.933135+0000 (oldest deadline 2024-04-26T18:48:55.033200+0000) 2024-04-26T18:48:56.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:55 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:55.917+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:56.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:55 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:55.917+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:56.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:55 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:55.917+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:56.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:55 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:55.917+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:56.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:55 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:55.917+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:48:56.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:55 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:55.917+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:24.877439+0000 front 2024-04-26T18:48:24.877374+0000 (oldest deadline 2024-04-26T18:48:49.577483+0000) 2024-04-26T18:48:56.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:56 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:56.161+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:56.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:56 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:56.161+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:56.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:56 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:56.161+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:56.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:56 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:56.161+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:56.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:56 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:56.161+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:48:56.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:56 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:56.161+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:23.244240+0000 front 2024-04-26T18:48:23.244128+0000 (oldest deadline 2024-04-26T18:48:47.943984+0000) 2024-04-26T18:48:56.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:56 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:56.161+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-26T18:48:30.245225+0000 front 2024-04-26T18:48:30.245190+0000 (oldest deadline 2024-04-26T18:48:55.545060+0000) 2024-04-26T18:48:56.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:56 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:56.154+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:56.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:56 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:56.154+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:56.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:56 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:56.154+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:56.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:56 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:56.154+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.229615+0000 front 2024-04-26T18:48:08.229735+0000 (oldest deadline 2024-04-26T18:48:34.030148+0000) 2024-04-26T18:48:56.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:56 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:56.154+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:15.131346+0000 front 2024-04-26T18:48:15.131269+0000 (oldest deadline 2024-04-26T18:48:39.231248+0000) 2024-04-26T18:48:56.494 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:56 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:56.154+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:22.732464+0000 front 2024-04-26T18:48:22.732391+0000 (oldest deadline 2024-04-26T18:48:48.032223+0000) 2024-04-26T18:48:56.494 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:56 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:56.154+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-26T18:48:30.933186+0000 front 2024-04-26T18:48:30.933135+0000 (oldest deadline 2024-04-26T18:48:55.033200+0000) 2024-04-26T18:48:57.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:56 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:56.957+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:57.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:56 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:56.957+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:57.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:56 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:56.957+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:57.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:56 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:56.957+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:57.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:56 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:56.957+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:48:57.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:56 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:56.957+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:24.877439+0000 front 2024-04-26T18:48:24.877374+0000 (oldest deadline 2024-04-26T18:48:49.577483+0000) 2024-04-26T18:48:57.423 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:57 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:57.113+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:57.423 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:57 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:57.113+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:57.423 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:57 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:57.113+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:57.424 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:57 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:57.113+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:57.424 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:57 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:57.113+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:48:57.424 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:57 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:57.113+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:23.244240+0000 front 2024-04-26T18:48:23.244128+0000 (oldest deadline 2024-04-26T18:48:47.943984+0000) 2024-04-26T18:48:57.424 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:57 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:57.113+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-26T18:48:30.245225+0000 front 2024-04-26T18:48:30.245190+0000 (oldest deadline 2024-04-26T18:48:55.545060+0000) 2024-04-26T18:48:57.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:57 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:57.150+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.925378+0000 front 2024-04-26T18:47:44.925609+0000 (oldest deadline 2024-04-26T18:48:09.025622+0000) 2024-04-26T18:48:57.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:57 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:57.150+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:52.526707+0000 front 2024-04-26T18:47:52.526748+0000 (oldest deadline 2024-04-26T18:48:15.426707+0000) 2024-04-26T18:48:57.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:57 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:57.150+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.728203+0000 front 2024-04-26T18:48:00.728191+0000 (oldest deadline 2024-04-26T18:48:23.528707+0000) 2024-04-26T18:48:57.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:57 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:57.150+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.229615+0000 front 2024-04-26T18:48:08.229735+0000 (oldest deadline 2024-04-26T18:48:34.030148+0000) 2024-04-26T18:48:57.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:57 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:57.150+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:15.131346+0000 front 2024-04-26T18:48:15.131269+0000 (oldest deadline 2024-04-26T18:48:39.231248+0000) 2024-04-26T18:48:57.494 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:57 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:57.150+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:22.732464+0000 front 2024-04-26T18:48:22.732391+0000 (oldest deadline 2024-04-26T18:48:48.032223+0000) 2024-04-26T18:48:57.494 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:57 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9[62153]: 2024-04-26T18:48:57.150+0000 7f3d6bdc9700 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-26T18:48:30.933186+0000 front 2024-04-26T18:48:30.933135+0000 (oldest deadline 2024-04-26T18:48:55.033200+0000) 2024-04-26T18:48:58.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:57 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:57.929+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:58.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:57 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:57.929+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:58.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:57 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:57.929+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:58.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:57 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:57.929+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:58.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:57 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:57.929+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:48:58.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:57 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:57.929+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:24.877439+0000 front 2024-04-26T18:48:24.877374+0000 (oldest deadline 2024-04-26T18:48:49.577483+0000) 2024-04-26T18:48:58.469 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:58 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:58.131+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:58.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:58 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:58.131+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:58.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:58 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:58.131+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:58.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:58 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:58.131+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:58.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:58 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:58.131+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:48:58.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:58 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:58.131+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:23.244240+0000 front 2024-04-26T18:48:23.244128+0000 (oldest deadline 2024-04-26T18:48:47.943984+0000) 2024-04-26T18:48:58.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:58 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:58.131+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-26T18:48:30.245225+0000 front 2024-04-26T18:48:30.245190+0000 (oldest deadline 2024-04-26T18:48:55.545060+0000) 2024-04-26T18:48:58.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:58 smithi080 podman[96210]: 2024-04-26 18:48:58.228581831 +0000 UTC m=+5.432116493 container died 7dddf836fc449fde614a740a6ed7abdd0369b06fdfaa574a545214aa0061c067 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424) 2024-04-26T18:48:58.766 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:58 smithi080 podman[96210]: 2024-04-26 18:48:58.574531632 +0000 UTC m=+5.778066309 container cleanup 7dddf836fc449fde614a740a6ed7abdd0369b06fdfaa574a545214aa0061c067 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T18:48:58.767 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:58 smithi080 bash[96210]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9 2024-04-26T18:48:59.184 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:58 smithi080 podman[96227]: 2024-04-26 18:48:58.767419122 +0000 UTC m=+0.532292323 container remove 7dddf836fc449fde614a740a6ed7abdd0369b06fdfaa574a545214aa0061c067 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T18:48:59.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:58 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:58.950+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:48:59.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:58 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:58.950+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:48:59.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:58 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:58.950+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:48:59.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:58 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:58.950+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:48:59.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:58 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:58.950+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:48:59.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:58 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:58.950+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:24.877439+0000 front 2024-04-26T18:48:24.877374+0000 (oldest deadline 2024-04-26T18:48:49.577483+0000) 2024-04-26T18:48:59.469 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:59 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:59.164+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:48:59.469 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:59 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:59.164+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:48:59.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:59 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:59.164+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:48:59.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:59 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:59.164+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:48:59.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:59 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:59.164+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:48:59.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:59 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:59.164+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:23.244240+0000 front 2024-04-26T18:48:23.244128+0000 (oldest deadline 2024-04-26T18:48:47.943984+0000) 2024-04-26T18:48:59.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:48:59 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:48:59.164+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-26T18:48:30.245225+0000 front 2024-04-26T18:48:30.245190+0000 (oldest deadline 2024-04-26T18:48:55.545060+0000) 2024-04-26T18:48:59.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:59 smithi080 podman[96322]: 2024-04-26 18:48:59.088328825 +0000 UTC m=+0.018396129 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:48:59.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:59 smithi080 podman[96322]: 2024-04-26 18:48:59.184939362 +0000 UTC m=+0.115006641 container create ed9ca3148c5113d69a2ad3b35a6d354015fa4585c7619607bcfbdc2fb024767b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-26T18:48:59.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:59 smithi080 podman[96322]: 2024-04-26 18:48:59.429462789 +0000 UTC m=+0.359530076 container init ed9ca3148c5113d69a2ad3b35a6d354015fa4585c7619607bcfbdc2fb024767b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-26T18:48:59.493 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:59 smithi080 podman[96322]: 2024-04-26 18:48:59.432491693 +0000 UTC m=+0.362558983 container start ed9ca3148c5113d69a2ad3b35a6d354015fa4585c7619607bcfbdc2fb024767b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-26T18:48:59.993 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:59 smithi080 podman[96322]: 2024-04-26 18:48:59.512640396 +0000 UTC m=+0.442707683 container attach ed9ca3148c5113d69a2ad3b35a6d354015fa4585c7619607bcfbdc2fb024767b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-26T18:48:59.993 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:48:59 smithi080 podman[96322]: 2024-04-26 18:48:59.725789537 +0000 UTC m=+0.655856819 container died ed9ca3148c5113d69a2ad3b35a6d354015fa4585c7619607bcfbdc2fb024767b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:49:00.289 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.9.service' 2024-04-26T18:49:00.311 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:49:00 smithi080 podman[96348]: 2024-04-26 18:49:00.266217992 +0000 UTC m=+0.530960269 container remove ed9ca3148c5113d69a2ad3b35a6d354015fa4585c7619607bcfbdc2fb024767b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-26T18:49:00.311 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:49:00 smithi080 systemd[1]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.9.service: Deactivated successfully. 2024-04-26T18:49:00.311 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:49:00 smithi080 systemd[1]: Stopped Ceph osd.9 for 2187ca98-03fa-11ef-bc93-c7b262605968. 2024-04-26T18:49:00.311 INFO:journalctl@ceph.osd.9.smithi080.stdout:Apr 26 18:49:00 smithi080 systemd[1]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.9.service: Consumed 12.582s CPU time. 2024-04-26T18:49:00.326 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:49:00.326 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-04-26T18:49:00.326 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-04-26T18:49:00.327 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.10 2024-04-26T18:49:00.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:59 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:59.976+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:49:00.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:59 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:59.976+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:49:00.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:59 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:59.976+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:49:00.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:59 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:59.976+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:49:00.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:59 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:59.976+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:49:00.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:48:59 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:48:59.976+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:24.877439+0000 front 2024-04-26T18:48:24.877374+0000 (oldest deadline 2024-04-26T18:48:49.577483+0000) 2024-04-26T18:49:00.469 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:00 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:00.187+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:49:00.469 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:00 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:00.187+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:49:00.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:00 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:00.187+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:49:00.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:00 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:00.187+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:49:00.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:00 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:00.187+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:49:00.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:00 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:00.187+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:23.244240+0000 front 2024-04-26T18:48:23.244128+0000 (oldest deadline 2024-04-26T18:48:47.943984+0000) 2024-04-26T18:49:00.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:00 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:00.187+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-26T18:48:30.245225+0000 front 2024-04-26T18:48:30.245190+0000 (oldest deadline 2024-04-26T18:48:55.545060+0000) 2024-04-26T18:49:00.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:00 smithi082 systemd[1]: Stopping Ceph osd.10 for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:49:00.969 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:00 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:00.643+0000 7f9cf9ee2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:49:00.970 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:00 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:00.643+0000 7f9cf9ee2700 -1 osd.10 106 *** Got signal Terminated *** 2024-04-26T18:49:00.970 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:00 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:00.643+0000 7f9cf9ee2700 -1 osd.10 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T18:49:01.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:01 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:01.021+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:49:01.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:01 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:01.021+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:49:01.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:01 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:01.021+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:49:01.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:01 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:01.021+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:49:01.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:01 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:01.021+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:49:01.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:01 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:01.021+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:24.877439+0000 front 2024-04-26T18:48:24.877374+0000 (oldest deadline 2024-04-26T18:48:49.577483+0000) 2024-04-26T18:49:01.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:01 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:01.230+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:49:01.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:01 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:01.230+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:49:01.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:01 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:01.230+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:49:01.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:01 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:01.230+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:49:01.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:01 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:01.230+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:49:01.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:01 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:01.230+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:23.244240+0000 front 2024-04-26T18:48:23.244128+0000 (oldest deadline 2024-04-26T18:48:47.943984+0000) 2024-04-26T18:49:01.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:01 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:01.230+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-26T18:48:30.245225+0000 front 2024-04-26T18:48:30.245190+0000 (oldest deadline 2024-04-26T18:48:55.545060+0000) 2024-04-26T18:49:02.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:02 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:02.036+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:49:02.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:02 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:02.036+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:49:02.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:02 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:02.036+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:49:02.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:02 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:02.036+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:49:02.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:02 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:02.036+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:49:02.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:02 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:02.036+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:24.877439+0000 front 2024-04-26T18:48:24.877374+0000 (oldest deadline 2024-04-26T18:48:49.577483+0000) 2024-04-26T18:49:02.719 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:02 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:02.264+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:49:02.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:02 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:02.264+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:49:02.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:02 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:02.264+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:49:02.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:02 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:02.264+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:49:02.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:02 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:02.264+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:49:02.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:02 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:02.264+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:23.244240+0000 front 2024-04-26T18:48:23.244128+0000 (oldest deadline 2024-04-26T18:48:47.943984+0000) 2024-04-26T18:49:02.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:02 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:02.264+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-26T18:48:30.245225+0000 front 2024-04-26T18:48:30.245190+0000 (oldest deadline 2024-04-26T18:48:55.545060+0000) 2024-04-26T18:49:03.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:03 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:03.046+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:49:03.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:03 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:03.046+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:49:03.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:03 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:03.046+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:49:03.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:03 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:03.046+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:49:03.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:03 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:03.046+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:49:03.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:03 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:03.046+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:24.877439+0000 front 2024-04-26T18:48:24.877374+0000 (oldest deadline 2024-04-26T18:48:49.577483+0000) 2024-04-26T18:49:03.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:03 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:03.256+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:49:03.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:03 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:03.256+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:49:03.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:03 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:03.256+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:49:03.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:03 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:03.256+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:49:03.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:03 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:03.256+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:49:03.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:03 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:03.256+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:23.244240+0000 front 2024-04-26T18:48:23.244128+0000 (oldest deadline 2024-04-26T18:48:47.943984+0000) 2024-04-26T18:49:03.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:03 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:03.256+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-26T18:48:30.245225+0000 front 2024-04-26T18:48:30.245190+0000 (oldest deadline 2024-04-26T18:48:55.545060+0000) 2024-04-26T18:49:04.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:04 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:04.041+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:49:04.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:04 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:04.041+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:49:04.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:04 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:04.041+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:49:04.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:04 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:04.041+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:49:04.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:04 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:04.041+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:49:04.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:04 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:04.041+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:24.877439+0000 front 2024-04-26T18:48:24.877374+0000 (oldest deadline 2024-04-26T18:48:49.577483+0000) 2024-04-26T18:49:04.719 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:04 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:04.279+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:49:04.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:04 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:04.279+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:49:04.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:04 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:04.279+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:49:04.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:04 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:04.279+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:49:04.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:04 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:04.279+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:49:04.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:04 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:04.279+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:23.244240+0000 front 2024-04-26T18:48:23.244128+0000 (oldest deadline 2024-04-26T18:48:47.943984+0000) 2024-04-26T18:49:04.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:04 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:04.279+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-26T18:48:30.245225+0000 front 2024-04-26T18:48:30.245190+0000 (oldest deadline 2024-04-26T18:48:55.545060+0000) 2024-04-26T18:49:05.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:05 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:05.072+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:49:05.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:05 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:05.072+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:49:05.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:05 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:05.072+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:49:05.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:05 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:05.072+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:49:05.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:05 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:05.072+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:49:05.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:05 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:05.072+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:24.877439+0000 front 2024-04-26T18:48:24.877374+0000 (oldest deadline 2024-04-26T18:48:49.577483+0000) 2024-04-26T18:49:05.719 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:05 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:05.273+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:43.638305+0000 front 2024-04-26T18:47:43.638174+0000 (oldest deadline 2024-04-26T18:48:09.538331+0000) 2024-04-26T18:49:05.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:05 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:05.273+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.538643+0000 front 2024-04-26T18:47:49.538568+0000 (oldest deadline 2024-04-26T18:48:15.438705+0000) 2024-04-26T18:49:05.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:05 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:05.273+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:48:00.739878+0000 front 2024-04-26T18:48:00.739689+0000 (oldest deadline 2024-04-26T18:48:25.439607+0000) 2024-04-26T18:49:05.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:05 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:05.273+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:08.841342+0000 front 2024-04-26T18:48:08.841413+0000 (oldest deadline 2024-04-26T18:48:32.341141+0000) 2024-04-26T18:49:05.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:05 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:05.273+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:17.542674+0000 front 2024-04-26T18:48:17.542613+0000 (oldest deadline 2024-04-26T18:48:41.042623+0000) 2024-04-26T18:49:05.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:05 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:05.273+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:23.244240+0000 front 2024-04-26T18:48:23.244128+0000 (oldest deadline 2024-04-26T18:48:47.943984+0000) 2024-04-26T18:49:05.720 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:05 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10[57830]: 2024-04-26T18:49:05.273+0000 7f9cf24ce700 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.80:6822 osd.6 since back 2024-04-26T18:48:30.245225+0000 front 2024-04-26T18:48:30.245190+0000 (oldest deadline 2024-04-26T18:48:55.545060+0000) 2024-04-26T18:49:06.235 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:05 smithi082 podman[70645]: 2024-04-26 18:49:05.97537524 +0000 UTC m=+5.455056097 container died bfa725cc41f037c2496b8b97684627cb680b78f082ed8347938927305df668a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240424) 2024-04-26T18:49:06.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:06 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:06.078+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:49:06.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:06 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:06.078+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:49:06.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:06 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:06.078+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:49:06.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:06 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:06.078+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:49:06.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:06 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:06.078+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:49:06.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:06 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:06.078+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:24.877439+0000 front 2024-04-26T18:48:24.877374+0000 (oldest deadline 2024-04-26T18:48:49.577483+0000) 2024-04-26T18:49:06.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:06 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:06.078+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-04-26T18:48:40.580155+0000 front 2024-04-26T18:48:40.580205+0000 (oldest deadline 2024-04-26T18:49:05.879957+0000) 2024-04-26T18:49:06.494 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:06 smithi082 podman[70645]: 2024-04-26 18:49:06.326764511 +0000 UTC m=+5.806445367 container cleanup bfa725cc41f037c2496b8b97684627cb680b78f082ed8347938927305df668a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T18:49:06.494 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:06 smithi082 bash[70645]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10 2024-04-26T18:49:06.895 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:06 smithi082 podman[70662]: 2024-04-26 18:49:06.495405096 +0000 UTC m=+0.513359555 container remove bfa725cc41f037c2496b8b97684627cb680b78f082ed8347938927305df668a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2) 2024-04-26T18:49:07.214 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:06 smithi082 podman[70753]: 2024-04-26 18:49:06.798915547 +0000 UTC m=+0.018511444 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:49:07.214 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:06 smithi082 podman[70753]: 2024-04-26 18:49:06.8963068 +0000 UTC m=+0.115902727 container create 813ce24d4a08811b12b786d8040e4fd7f9b33f7490801294943164f601202d59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-04-26T18:49:07.214 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:07 smithi082 podman[70753]: 2024-04-26 18:49:07.131711269 +0000 UTC m=+0.351307153 container init 813ce24d4a08811b12b786d8040e4fd7f9b33f7490801294943164f601202d59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-26T18:49:07.214 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:07 smithi082 podman[70753]: 2024-04-26 18:49:07.135264595 +0000 UTC m=+0.354860492 container start 813ce24d4a08811b12b786d8040e4fd7f9b33f7490801294943164f601202d59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10-deactivate, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-26T18:49:07.214 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:07 smithi082 podman[70753]: 2024-04-26 18:49:07.21494386 +0000 UTC m=+0.434539748 container attach 813ce24d4a08811b12b786d8040e4fd7f9b33f7490801294943164f601202d59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-26T18:49:07.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:07 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:07.089+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:49:07.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:07 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:07.089+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:49:07.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:07 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:07.089+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:49:07.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:07 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:07.089+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:49:07.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:07 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:07.089+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:49:07.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:07 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:07.089+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:24.877439+0000 front 2024-04-26T18:48:24.877374+0000 (oldest deadline 2024-04-26T18:48:49.577483+0000) 2024-04-26T18:49:07.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:07 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:07.089+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-04-26T18:48:40.580155+0000 front 2024-04-26T18:48:40.580205+0000 (oldest deadline 2024-04-26T18:49:05.879957+0000) 2024-04-26T18:49:07.470 INFO:journalctl@ceph.osd.10.smithi082.stdout:Apr 26 18:49:07 smithi082 podman[70753]: 2024-04-26 18:49:07.421381878 +0000 UTC m=+0.640977754 container died 813ce24d4a08811b12b786d8040e4fd7f9b33f7490801294943164f601202d59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2) 2024-04-26T18:49:08.009 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.10.service' 2024-04-26T18:49:08.045 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:49:08.045 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-04-26T18:49:08.045 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-04-26T18:49:08.045 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.11 2024-04-26T18:49:08.359 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:08 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:08.078+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:49:08.359 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:08 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:08.078+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:49:08.359 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:08 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:08.078+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:49:08.359 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:08 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:08.078+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:49:08.360 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:08 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:08.078+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:49:08.360 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:08 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:08.078+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:24.877439+0000 front 2024-04-26T18:48:24.877374+0000 (oldest deadline 2024-04-26T18:48:49.577483+0000) 2024-04-26T18:49:08.360 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:08 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:08.078+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-04-26T18:48:40.580155+0000 front 2024-04-26T18:48:40.580205+0000 (oldest deadline 2024-04-26T18:49:05.879957+0000) 2024-04-26T18:49:08.360 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:08 smithi192 systemd[1]: Stopping Ceph osd.11 for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:49:08.612 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:08 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:08.359+0000 7fa4d772f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:49:08.613 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:08 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:08.359+0000 7fa4d772f700 -1 osd.11 106 *** Got signal Terminated *** 2024-04-26T18:49:08.613 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:08 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:08.359+0000 7fa4d772f700 -1 osd.11 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T18:49:09.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:09 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:09.049+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:49:09.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:09 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:09.049+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:49:09.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:09 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:09.049+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:49:09.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:09 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:09.049+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:49:09.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:09 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:09.049+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:49:09.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:09 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:09.049+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:24.877439+0000 front 2024-04-26T18:48:24.877374+0000 (oldest deadline 2024-04-26T18:48:49.577483+0000) 2024-04-26T18:49:09.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:09 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:09.049+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-04-26T18:48:40.580155+0000 front 2024-04-26T18:48:40.580205+0000 (oldest deadline 2024-04-26T18:49:05.879957+0000) 2024-04-26T18:49:10.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:10 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:10.084+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:49:10.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:10 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:10.084+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:49:10.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:10 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:10.084+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:49:10.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:10 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:10.084+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:49:10.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:10 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:10.084+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:49:10.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:10 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:10.084+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:24.877439+0000 front 2024-04-26T18:48:24.877374+0000 (oldest deadline 2024-04-26T18:48:49.577483+0000) 2024-04-26T18:49:10.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:10 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:10.084+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-04-26T18:48:40.580155+0000 front 2024-04-26T18:48:40.580205+0000 (oldest deadline 2024-04-26T18:49:05.879957+0000) 2024-04-26T18:49:11.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:11 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:11.083+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:49:11.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:11 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:11.083+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:49:11.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:11 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:11.083+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:49:11.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:11 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:11.083+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:49:11.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:11 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:11.083+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:49:11.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:11 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:11.083+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:24.877439+0000 front 2024-04-26T18:48:24.877374+0000 (oldest deadline 2024-04-26T18:48:49.577483+0000) 2024-04-26T18:49:11.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:11 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:11.083+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-04-26T18:48:40.580155+0000 front 2024-04-26T18:48:40.580205+0000 (oldest deadline 2024-04-26T18:49:05.879957+0000) 2024-04-26T18:49:12.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:12 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:12.101+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:49:12.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:12 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:12.101+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:49:12.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:12 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:12.101+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:49:12.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:12 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:12.101+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:49:12.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:12 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:12.101+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:49:12.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:12 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:12.101+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:24.877439+0000 front 2024-04-26T18:48:24.877374+0000 (oldest deadline 2024-04-26T18:48:49.577483+0000) 2024-04-26T18:49:12.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:12 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:12.101+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-04-26T18:48:40.580155+0000 front 2024-04-26T18:48:40.580205+0000 (oldest deadline 2024-04-26T18:49:05.879957+0000) 2024-04-26T18:49:12.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:12 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:12.101+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6820 osd.8 since back 2024-04-26T18:48:45.880243+0000 front 2024-04-26T18:48:45.880262+0000 (oldest deadline 2024-04-26T18:49:11.780293+0000) 2024-04-26T18:49:13.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:13 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:13.067+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-04-26T18:47:44.571385+0000 front 2024-04-26T18:47:44.571269+0000 (oldest deadline 2024-04-26T18:48:06.871191+0000) 2024-04-26T18:49:13.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:13 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:13.067+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-04-26T18:47:49.772439+0000 front 2024-04-26T18:47:49.772570+0000 (oldest deadline 2024-04-26T18:48:15.072388+0000) 2024-04-26T18:49:13.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:13 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:13.067+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-04-26T18:47:59.073996+0000 front 2024-04-26T18:47:59.074024+0000 (oldest deadline 2024-04-26T18:48:26.074824+0000) 2024-04-26T18:49:13.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:13 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:13.067+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.80:6814 osd.3 since back 2024-04-26T18:48:06.075340+0000 front 2024-04-26T18:48:06.075310+0000 (oldest deadline 2024-04-26T18:48:31.375334+0000) 2024-04-26T18:49:13.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:13 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:13.067+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-04-26T18:48:13.076455+0000 front 2024-04-26T18:48:13.076486+0000 (oldest deadline 2024-04-26T18:48:38.976464+0000) 2024-04-26T18:49:13.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:13 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:13.067+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-04-26T18:48:24.877439+0000 front 2024-04-26T18:48:24.877374+0000 (oldest deadline 2024-04-26T18:48:49.577483+0000) 2024-04-26T18:49:13.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:13 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:13.067+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-04-26T18:48:40.580155+0000 front 2024-04-26T18:48:40.580205+0000 (oldest deadline 2024-04-26T18:49:05.879957+0000) 2024-04-26T18:49:13.363 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:13 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11[57944]: 2024-04-26T18:49:13.067+0000 7fa4d3d23700 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.192:6820 osd.8 since back 2024-04-26T18:48:45.880243+0000 front 2024-04-26T18:48:45.880262+0000 (oldest deadline 2024-04-26T18:49:11.780293+0000) 2024-04-26T18:49:14.060 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:13 smithi192 podman[70383]: 2024-04-26 18:49:13.794643603 +0000 UTC m=+5.558507773 container died 26b78e48ef57203fd56919f7636610290ede0707530eabdce38119aef03c09eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T18:49:14.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:14 smithi192 podman[70383]: 2024-04-26 18:49:14.15955819 +0000 UTC m=+5.923422365 container cleanup 26b78e48ef57203fd56919f7636610290ede0707530eabdce38119aef03c09eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-26T18:49:14.362 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:14 smithi192 bash[70383]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11 2024-04-26T18:49:14.829 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:14 smithi192 podman[70400]: 2024-04-26 18:49:14.477786351 +0000 UTC m=+0.679541741 container remove 26b78e48ef57203fd56919f7636610290ede0707530eabdce38119aef03c09eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-26T18:49:15.112 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:14 smithi192 podman[70492]: 2024-04-26 18:49:14.73266652 +0000 UTC m=+0.017761606 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:49:15.113 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:14 smithi192 podman[70492]: 2024-04-26 18:49:14.836801759 +0000 UTC m=+0.121896820 container create fd961af667a1cba9ee20fa22773dfcfff5deadfb9c63239ff27cfaceec59aa58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11-deactivate, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-26T18:49:15.407 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:15 smithi192 podman[70492]: 2024-04-26 18:49:15.114107409 +0000 UTC m=+0.399202473 container init fd961af667a1cba9ee20fa22773dfcfff5deadfb9c63239ff27cfaceec59aa58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-26T18:49:15.407 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:15 smithi192 podman[70492]: 2024-04-26 18:49:15.117984132 +0000 UTC m=+0.403079201 container start fd961af667a1cba9ee20fa22773dfcfff5deadfb9c63239ff27cfaceec59aa58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-26T18:49:15.407 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:15 smithi192 podman[70492]: 2024-04-26 18:49:15.197409094 +0000 UTC m=+0.482504168 container attach fd961af667a1cba9ee20fa22773dfcfff5deadfb9c63239ff27cfaceec59aa58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T18:49:15.741 INFO:journalctl@ceph.osd.11.smithi192.stdout:Apr 26 18:49:15 smithi192 podman[70492]: 2024-04-26 18:49:15.407200578 +0000 UTC m=+0.692295643 container died fd961af667a1cba9ee20fa22773dfcfff5deadfb9c63239ff27cfaceec59aa58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-osd-11-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux ) 2024-04-26T18:49:16.016 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@osd.11.service' 2024-04-26T18:49:16.054 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:49:16.055 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-04-26T18:49:16.055 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-04-26T18:49:16.055 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.a 2024-04-26T18:49:16.399 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 26 18:49:16 smithi080 systemd[1]: Stopping Ceph mds.a for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:49:16.743 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 26 18:49:16 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-a[69058]: 2024-04-26T18:49:16.399+0000 7f871fb0c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:49:16.744 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 26 18:49:16 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-a[69058]: 2024-04-26T18:49:16.399+0000 7f871fb0c700 -1 mds.a *** got signal Terminated *** 2024-04-26T18:49:19.791 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 26 18:49:19 smithi080 podman[96426]: 2024-04-26 18:49:19.518415492 +0000 UTC m=+3.271308506 container died 3de5c21d2b3fa11d9a4de87cef9190aea8e2d703808e4827acb7b9edc4f7e43f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424) 2024-04-26T18:49:20.158 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 26 18:49:19 smithi080 podman[96426]: 2024-04-26 18:49:19.899841239 +0000 UTC m=+3.652734253 container cleanup 3de5c21d2b3fa11d9a4de87cef9190aea8e2d703808e4827acb7b9edc4f7e43f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-a, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-26T18:49:20.158 INFO:journalctl@ceph.mds.a.smithi080.stdout:Apr 26 18:49:19 smithi080 bash[96426]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-a 2024-04-26T18:49:20.283 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.a.service' 2024-04-26T18:49:20.315 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:49:20.315 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-04-26T18:49:20.315 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-04-26T18:49:20.316 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.d 2024-04-26T18:49:20.493 INFO:journalctl@ceph.mds.d.smithi080.stdout:Apr 26 18:49:20 smithi080 systemd[1]: Stopping Ceph mds.d for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:49:20.993 INFO:journalctl@ceph.mds.d.smithi080.stdout:Apr 26 18:49:20 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-d[67772]: 2024-04-26T18:49:20.628+0000 7f3ca7137700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:49:20.993 INFO:journalctl@ceph.mds.d.smithi080.stdout:Apr 26 18:49:20 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-d[67772]: 2024-04-26T18:49:20.628+0000 7f3ca7137700 -1 mds.d *** got signal Terminated *** 2024-04-26T18:49:22.743 INFO:journalctl@ceph.mds.d.smithi080.stdout:Apr 26 18:49:22 smithi080 podman[96546]: 2024-04-26 18:49:22.482963242 +0000 UTC m=+1.954350741 container died 53e169058972cb62f75686b27611c2b04100afbd8a07d3511b082f36562dae4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T18:49:23.206 INFO:journalctl@ceph.mds.d.smithi080.stdout:Apr 26 18:49:22 smithi080 podman[96546]: 2024-04-26 18:49:22.80372035 +0000 UTC m=+2.275107840 container cleanup 53e169058972cb62f75686b27611c2b04100afbd8a07d3511b082f36562dae4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-d, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-26T18:49:23.206 INFO:journalctl@ceph.mds.d.smithi080.stdout:Apr 26 18:49:22 smithi080 bash[96546]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-d 2024-04-26T18:49:23.207 INFO:journalctl@ceph.mds.d.smithi080.stdout:Apr 26 18:49:22 smithi080 podman[96571]: 2024-04-26 18:49:22.979953462 +0000 UTC m=+0.500539334 container remove 53e169058972cb62f75686b27611c2b04100afbd8a07d3511b082f36562dae4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-d, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-26T18:49:23.229 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.d.service' 2024-04-26T18:49:23.263 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:49:23.263 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-04-26T18:49:23.263 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-04-26T18:49:23.263 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.g 2024-04-26T18:49:23.493 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 26 18:49:23 smithi080 systemd[1]: Stopping Ceph mds.g for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:49:23.993 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 26 18:49:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-g[68699]: 2024-04-26T18:49:23.598+0000 7f6e9be50700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:49:23.993 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 26 18:49:23 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-g[68699]: 2024-04-26T18:49:23.598+0000 7f6e9be50700 -1 mds.g *** got signal Terminated *** 2024-04-26T18:49:27.832 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 26 18:49:27 smithi080 podman[96679]: 2024-04-26 18:49:27.51486192 +0000 UTC m=+4.030487972 container died ece91e277231034aaa8c91edc74092ff7cab7b36d39da23e663576d3579f4783 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-g, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-04-26T18:49:28.124 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 26 18:49:27 smithi080 podman[96679]: 2024-04-26 18:49:27.915700276 +0000 UTC m=+4.431326321 container cleanup ece91e277231034aaa8c91edc74092ff7cab7b36d39da23e663576d3579f4783 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-g, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-26T18:49:28.124 INFO:journalctl@ceph.mds.g.smithi080.stdout:Apr 26 18:49:27 smithi080 bash[96679]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-g 2024-04-26T18:49:28.260 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.g.service' 2024-04-26T18:49:28.291 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:49:28.291 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-04-26T18:49:28.291 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-04-26T18:49:28.291 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.j 2024-04-26T18:49:28.743 INFO:journalctl@ceph.mds.j.smithi080.stdout:Apr 26 18:49:28 smithi080 systemd[1]: Stopping Ceph mds.j for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:49:28.743 INFO:journalctl@ceph.mds.j.smithi080.stdout:Apr 26 18:49:28 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-j[67319]: 2024-04-26T18:49:28.610+0000 7fe1bbbfc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:49:28.743 INFO:journalctl@ceph.mds.j.smithi080.stdout:Apr 26 18:49:28 smithi080 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-j[67319]: 2024-04-26T18:49:28.610+0000 7fe1bbbfc700 -1 mds.j *** got signal Terminated *** 2024-04-26T18:49:30.236 INFO:journalctl@ceph.mds.j.smithi080.stdout:Apr 26 18:49:29 smithi080 podman[96800]: 2024-04-26 18:49:29.970547725 +0000 UTC m=+1.459932422 container died 74b184685213e3aaabdbbabc8e4c0bf037a23271a66c61e7a4c7bf0d4fd87177 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-j, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0) 2024-04-26T18:49:30.493 INFO:journalctl@ceph.mds.j.smithi080.stdout:Apr 26 18:49:30 smithi080 podman[96800]: 2024-04-26 18:49:30.327805073 +0000 UTC m=+1.817189765 container cleanup 74b184685213e3aaabdbbabc8e4c0bf037a23271a66c61e7a4c7bf0d4fd87177 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-j, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424) 2024-04-26T18:49:30.493 INFO:journalctl@ceph.mds.j.smithi080.stdout:Apr 26 18:49:30 smithi080 bash[96800]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-j 2024-04-26T18:49:30.748 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.j.service' 2024-04-26T18:49:30.779 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:49:30.779 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-04-26T18:49:30.779 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-04-26T18:49:30.779 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.b 2024-04-26T18:49:31.159 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 26 18:49:30 smithi082 systemd[1]: Stopping Ceph mds.b for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:49:31.414 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 26 18:49:31 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-b[63537]: 2024-04-26T18:49:31.158+0000 7f044ef48700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:49:31.414 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 26 18:49:31 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-b[63537]: 2024-04-26T18:49:31.158+0000 7f044ef48700 -1 mds.b *** got signal Terminated *** 2024-04-26T18:49:35.450 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 26 18:49:35 smithi082 podman[70858]: 2024-04-26 18:49:35.166172519 +0000 UTC m=+4.188560824 container died cadf56e3235ac1c64e4a078f601ee949c020a203f1d2078f1fe9da4e435ecc9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-26T18:49:35.719 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 26 18:49:35 smithi082 podman[70858]: 2024-04-26 18:49:35.524657283 +0000 UTC m=+4.547045587 container cleanup cadf56e3235ac1c64e4a078f601ee949c020a203f1d2078f1fe9da4e435ecc9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2) 2024-04-26T18:49:35.719 INFO:journalctl@ceph.mds.b.smithi082.stdout:Apr 26 18:49:35 smithi082 bash[70858]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-b 2024-04-26T18:49:35.958 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.b.service' 2024-04-26T18:49:35.994 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:49:35.994 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-04-26T18:49:35.994 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-04-26T18:49:35.995 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.e 2024-04-26T18:49:36.220 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 26 18:49:36 smithi082 systemd[1]: Stopping Ceph mds.e for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:49:36.719 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 26 18:49:36 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-e[62895]: 2024-04-26T18:49:36.320+0000 7fb43cd64700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:49:36.719 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 26 18:49:36 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-e[62895]: 2024-04-26T18:49:36.320+0000 7fb43cd64700 -1 mds.e *** got signal Terminated *** 2024-04-26T18:49:39.862 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 26 18:49:39 smithi082 podman[70992]: 2024-04-26 18:49:39.522239687 +0000 UTC m=+3.310735150 container died 3558e8b965d56d0aa1916720075d01a87a8f94e6d3ac4417babbd97cad69ec89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-26T18:49:40.121 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 26 18:49:39 smithi082 podman[70992]: 2024-04-26 18:49:39.954013852 +0000 UTC m=+3.742509319 container cleanup 3558e8b965d56d0aa1916720075d01a87a8f94e6d3ac4417babbd97cad69ec89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-04-26T18:49:40.121 INFO:journalctl@ceph.mds.e.smithi082.stdout:Apr 26 18:49:39 smithi082 bash[70992]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-e 2024-04-26T18:49:40.324 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.e.service' 2024-04-26T18:49:40.355 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:49:40.356 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-04-26T18:49:40.356 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-04-26T18:49:40.356 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.h 2024-04-26T18:49:40.719 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 26 18:49:40 smithi082 systemd[1]: Stopping Ceph mds.h for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:49:40.719 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 26 18:49:40 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-h[63210]: 2024-04-26T18:49:40.656+0000 7f1e92700700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:49:40.720 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 26 18:49:40 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-h[63210]: 2024-04-26T18:49:40.656+0000 7f1e92700700 -1 mds.h *** got signal Terminated *** 2024-04-26T18:49:43.969 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 26 18:49:43 smithi082 podman[71115]: 2024-04-26 18:49:43.525020855 +0000 UTC m=+2.959235289 container died 5b4e2b0588079e1561eac610f7ba3cdef429660743192c6b43c0f2794a4aae9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-h, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True) 2024-04-26T18:49:44.449 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 26 18:49:44 smithi082 podman[71115]: 2024-04-26 18:49:44.190746961 +0000 UTC m=+3.624961404 container cleanup 5b4e2b0588079e1561eac610f7ba3cdef429660743192c6b43c0f2794a4aae9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T18:49:44.449 INFO:journalctl@ceph.mds.h.smithi082.stdout:Apr 26 18:49:44 smithi082 bash[71115]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-h 2024-04-26T18:49:44.607 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.h.service' 2024-04-26T18:49:44.638 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:49:44.638 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-04-26T18:49:44.639 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-04-26T18:49:44.639 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.k 2024-04-26T18:49:45.219 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 26 18:49:44 smithi082 systemd[1]: Stopping Ceph mds.k for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:49:45.220 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 26 18:49:44 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-k[62579]: 2024-04-26T18:49:44.968+0000 7fc98a41d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:49:45.220 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 26 18:49:44 smithi082 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-k[62579]: 2024-04-26T18:49:44.968+0000 7fc98a41d700 -1 mds.k *** got signal Terminated *** 2024-04-26T18:49:47.794 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 26 18:49:47 smithi082 podman[71234]: 2024-04-26 18:49:47.530983264 +0000 UTC m=+2.671960914 container died b9baf38284bf1bf4d1ed6bb73e1665abcf9cfdb23c0d5242d01fdac10ed09336 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-26T18:49:48.153 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 26 18:49:47 smithi082 podman[71234]: 2024-04-26 18:49:47.885740897 +0000 UTC m=+3.026718537 container cleanup b9baf38284bf1bf4d1ed6bb73e1665abcf9cfdb23c0d5242d01fdac10ed09336 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-k, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-26T18:49:48.153 INFO:journalctl@ceph.mds.k.smithi082.stdout:Apr 26 18:49:47 smithi082 bash[71234]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-k 2024-04-26T18:49:48.315 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.k.service' 2024-04-26T18:49:48.346 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:49:48.346 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-04-26T18:49:48.346 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-04-26T18:49:48.346 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.c 2024-04-26T18:49:48.641 INFO:journalctl@ceph.mds.c.smithi192.stdout:Apr 26 18:49:48 smithi192 systemd[1]: Stopping Ceph mds.c for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:49:48.906 INFO:journalctl@ceph.mds.c.smithi192.stdout:Apr 26 18:49:48 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-c[62967]: 2024-04-26T18:49:48.640+0000 7f2137430700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:49:48.906 INFO:journalctl@ceph.mds.c.smithi192.stdout:Apr 26 18:49:48 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-c[62967]: 2024-04-26T18:49:48.640+0000 7f2137430700 -1 mds.c *** got signal Terminated *** 2024-04-26T18:49:51.863 INFO:journalctl@ceph.mds.c.smithi192.stdout:Apr 26 18:49:51 smithi192 podman[70596]: 2024-04-26 18:49:51.521002703 +0000 UTC m=+2.988830738 container died 23af43080fd68406273a76118cb1d4afa69dd2bf92ee98167143acb212d49b6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-c, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-26T18:49:52.151 INFO:journalctl@ceph.mds.c.smithi192.stdout:Apr 26 18:49:51 smithi192 podman[70596]: 2024-04-26 18:49:51.950256586 +0000 UTC m=+3.418084620 container cleanup 23af43080fd68406273a76118cb1d4afa69dd2bf92ee98167143acb212d49b6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-c, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:49:52.151 INFO:journalctl@ceph.mds.c.smithi192.stdout:Apr 26 18:49:51 smithi192 bash[70596]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-c 2024-04-26T18:49:52.375 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.c.service' 2024-04-26T18:49:52.409 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:49:52.409 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-04-26T18:49:52.409 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-04-26T18:49:52.409 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.f 2024-04-26T18:49:52.721 INFO:journalctl@ceph.mds.f.smithi192.stdout:Apr 26 18:49:52 smithi192 systemd[1]: Stopping Ceph mds.f for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:49:53.112 INFO:journalctl@ceph.mds.f.smithi192.stdout:Apr 26 18:49:52 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-f[62651]: 2024-04-26T18:49:52.719+0000 7f45c152b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:49:53.112 INFO:journalctl@ceph.mds.f.smithi192.stdout:Apr 26 18:49:52 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-f[62651]: 2024-04-26T18:49:52.719+0000 7f45c152b700 -1 mds.f *** got signal Terminated *** 2024-04-26T18:49:55.779 INFO:journalctl@ceph.mds.f.smithi192.stdout:Apr 26 18:49:55 smithi192 podman[70730]: 2024-04-26 18:49:55.520194772 +0000 UTC m=+2.894147831 container died 0c5011581cc1a04ecf17795feedf9147066e7b873942121bfec2e92c23fcb662 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-f, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0) 2024-04-26T18:49:56.112 INFO:journalctl@ceph.mds.f.smithi192.stdout:Apr 26 18:49:55 smithi192 podman[70730]: 2024-04-26 18:49:55.887659109 +0000 UTC m=+3.261612175 container cleanup 0c5011581cc1a04ecf17795feedf9147066e7b873942121bfec2e92c23fcb662 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-f, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS) 2024-04-26T18:49:56.112 INFO:journalctl@ceph.mds.f.smithi192.stdout:Apr 26 18:49:55 smithi192 bash[70730]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-f 2024-04-26T18:49:56.246 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.f.service' 2024-04-26T18:49:56.278 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:49:56.279 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-04-26T18:49:56.279 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-04-26T18:49:56.279 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.i 2024-04-26T18:49:56.599 INFO:journalctl@ceph.mds.i.smithi192.stdout:Apr 26 18:49:56 smithi192 systemd[1]: Stopping Ceph mds.i for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:49:56.862 INFO:journalctl@ceph.mds.i.smithi192.stdout:Apr 26 18:49:56 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-i[63277]: 2024-04-26T18:49:56.599+0000 7f9ab62f9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:49:56.862 INFO:journalctl@ceph.mds.i.smithi192.stdout:Apr 26 18:49:56 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-i[63277]: 2024-04-26T18:49:56.599+0000 7f9ab62f9700 -1 mds.i *** got signal Terminated *** 2024-04-26T18:49:59.612 INFO:journalctl@ceph.mds.i.smithi192.stdout:Apr 26 18:49:59 smithi192 podman[70850]: 2024-04-26 18:49:59.523386089 +0000 UTC m=+3.029963898 container died af8838215a112750d7ab5753c895b783908394eb8060c4ad78518eb7b35520d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-i, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-04-26T18:50:00.128 INFO:journalctl@ceph.mds.i.smithi192.stdout:Apr 26 18:49:59 smithi192 podman[70850]: 2024-04-26 18:49:59.950767236 +0000 UTC m=+3.457345044 container cleanup af8838215a112750d7ab5753c895b783908394eb8060c4ad78518eb7b35520d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-i, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T18:50:00.128 INFO:journalctl@ceph.mds.i.smithi192.stdout:Apr 26 18:49:59 smithi192 bash[70850]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-i 2024-04-26T18:50:00.128 INFO:journalctl@ceph.mds.i.smithi192.stdout:Apr 26 18:50:00 smithi192 podman[70865]: 2024-04-26 18:50:00.119167039 +0000 UTC m=+0.589532622 container remove af8838215a112750d7ab5753c895b783908394eb8060c4ad78518eb7b35520d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True) 2024-04-26T18:50:00.333 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.i.service' 2024-04-26T18:50:00.365 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:50:00.365 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-04-26T18:50:00.365 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-04-26T18:50:00.366 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.l 2024-04-26T18:50:00.862 INFO:journalctl@ceph.mds.l.smithi192.stdout:Apr 26 18:50:00 smithi192 systemd[1]: Stopping Ceph mds.l for 2187ca98-03fa-11ef-bc93-c7b262605968... 2024-04-26T18:50:00.862 INFO:journalctl@ceph.mds.l.smithi192.stdout:Apr 26 18:50:00 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-l[62343]: 2024-04-26T18:50:00.672+0000 7fcc26af4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T18:50:00.862 INFO:journalctl@ceph.mds.l.smithi192.stdout:Apr 26 18:50:00 smithi192 ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-l[62343]: 2024-04-26T18:50:00.672+0000 7fcc26af4700 -1 mds.l *** got signal Terminated *** 2024-04-26T18:50:03.814 INFO:journalctl@ceph.mds.l.smithi192.stdout:Apr 26 18:50:03 smithi192 podman[70971]: 2024-04-26 18:50:03.530109833 +0000 UTC m=+2.951079999 container died ffca76a06a7cf7d0330cee0e4f5b6c48edab412108669860d406bf12ddef6c8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-26T18:50:04.112 INFO:journalctl@ceph.mds.l.smithi192.stdout:Apr 26 18:50:03 smithi192 podman[70971]: 2024-04-26 18:50:03.897412883 +0000 UTC m=+3.318383039 container cleanup ffca76a06a7cf7d0330cee0e4f5b6c48edab412108669860d406bf12ddef6c8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-l, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5) 2024-04-26T18:50:04.112 INFO:journalctl@ceph.mds.l.smithi192.stdout:Apr 26 18:50:03 smithi192 bash[70971]: ceph-2187ca98-03fa-11ef-bc93-c7b262605968-mds-l 2024-04-26T18:50:04.265 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2187ca98-03fa-11ef-bc93-c7b262605968@mds.l.service' 2024-04-26T18:50:04.296 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T18:50:04.296 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-04-26T18:50:04.297 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-26T18:50:04.496 INFO:teuthology.orchestra.run.smithi080.stdout:Deleting cluster with fsid: 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:50:06.931 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-26T18:50:07.124 INFO:teuthology.orchestra.run.smithi082.stdout:Deleting cluster with fsid: 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:50:09.565 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-26T18:50:09.755 INFO:teuthology.orchestra.run.smithi192.stdout:Deleting cluster with fsid: 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:50:12.105 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T18:50:12.136 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T18:50:12.167 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T18:50:12.192 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-26T18:50:12.194 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674925/remote/smithi080/crash 2024-04-26T18:50:12.195 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/crash -- . 2024-04-26T18:50:12.229 INFO:teuthology.orchestra.run.smithi080.stderr:tar: /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-26T18:50:12.230 INFO:teuthology.orchestra.run.smithi080.stderr:tar: Error is not recoverable: exiting now 2024-04-26T18:50:12.232 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674925/remote/smithi082/crash 2024-04-26T18:50:12.233 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/crash -- . 2024-04-26T18:50:12.273 INFO:teuthology.orchestra.run.smithi082.stderr:tar: /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-26T18:50:12.274 INFO:teuthology.orchestra.run.smithi082.stderr:tar: Error is not recoverable: exiting now 2024-04-26T18:50:12.276 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674925/remote/smithi192/crash 2024-04-26T18:50:12.276 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/crash -- . 2024-04-26T18:50:12.315 INFO:teuthology.orchestra.run.smithi192.stderr:tar: /var/lib/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-26T18:50:12.315 INFO:teuthology.orchestra.run.smithi192.stderr:tar: Error is not recoverable: exiting now 2024-04-26T18:50:12.316 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-26T18:50:12.316 DEBUG:teuthology.orchestra.run.smithi080:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-26T18:50:12.357 INFO:tasks.cephadm:Compressing logs... 2024-04-26T18:50:12.357 DEBUG:teuthology.orchestra.run.smithi080:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T18:50:12.400 DEBUG:teuthology.orchestra.run.smithi082:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T18:50:12.403 DEBUG:teuthology.orchestra.run.smithi192:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T18:50:12.424 INFO:teuthology.orchestra.run.smithi080.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.log 2024-04-26T18:50:12.424 INFO:teuthology.orchestra.run.smithi080.stderr:: No such file or directory 2024-04-26T18:50:12.424 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-26T18:50:12.424 INFO:teuthology.orchestra.run.smithi080.stderr:gzip/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.log: -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.g.log 2024-04-26T18:50:12.424 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.j.log 2024-04-26T18:50:12.427 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.3.log 2024-04-26T18:50:12.427 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.0.log 2024-04-26T18:50:12.427 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.j.log: /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mgr.x.log 2024-04-26T18:50:12.427 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mon.a.log 2024-04-26T18:50:12.427 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.6.log 2024-04-26T18:50:12.428 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mon.a.log: 87.8% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-26T18:50:12.428 INFO:teuthology.orchestra.run.smithi080.stderr: 90.3% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-26T18:50:12.434 INFO:teuthology.orchestra.run.smithi080.stderr: 94.6% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.j.log.gz 2024-04-26T18:50:12.436 INFO:teuthology.orchestra.run.smithi082.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.log 2024-04-26T18:50:12.436 INFO:teuthology.orchestra.run.smithi082.stderr:: No such file or directory 2024-04-26T18:50:12.436 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-26T18:50:12.436 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.7.log 2024-04-26T18:50:12.436 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.b.log 2024-04-26T18:50:12.436 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.4.log 2024-04-26T18:50:12.436 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.1.log 2024-04-26T18:50:12.436 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mgr.y.log 2024-04-26T18:50:12.437 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.h.log 2024-04-26T18:50:12.437 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mgr.y.log: 87.8% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-26T18:50:12.437 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.10.log 2024-04-26T18:50:12.437 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.h.log: --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-26T18:50:12.437 INFO:teuthology.orchestra.run.smithi082.stderr: 90.5% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-26T18:50:12.439 INFO:teuthology.orchestra.run.smithi192.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose --: No such file or directory 2024-04-26T18:50:12.439 INFO:teuthology.orchestra.run.smithi192.stderr: /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.log 2024-04-26T18:50:12.440 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.2.log 2024-04-26T18:50:12.440 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.f.log 2024-04-26T18:50:12.440 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-26T18:50:12.440 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.5.log 2024-04-26T18:50:12.440 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.c.log 2024-04-26T18:50:12.440 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mon.c.log 2024-04-26T18:50:12.440 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mgr.z.log 2024-04-26T18:50:12.440 INFO:teuthology.orchestra.run.smithi192.stderr:gzip/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.5.log: -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.i.log 2024-04-26T18:50:12.440 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.c.log: /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mgr.z.log: 87.8% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-26T18:50:12.440 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.i.log: /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mon.c.log: 90.5% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-26T18:50:12.440 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-26T18:50:12.440 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.11.log 2024-04-26T18:50:12.441 INFO:teuthology.orchestra.run.smithi192.stderr: 83.9% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-26T18:50:12.441 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.8.log 2024-04-26T18:50:12.441 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.11.log: 92.0% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mgr.z.log.gz 2024-04-26T18:50:12.441 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-26T18:50:12.443 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-26T18:50:12.443 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.a.log 2024-04-26T18:50:12.443 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-26T18:50:12.443 INFO:teuthology.orchestra.run.smithi080.stderr: 84.4% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-26T18:50:12.443 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.10.log: 91.9% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mgr.y.log.gz 2024-04-26T18:50:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.e.log 2024-04-26T18:50:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-26T18:50:12.447 INFO:teuthology.orchestra.run.smithi082.stderr: 84.0% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-26T18:50:12.451 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.l.log 2024-04-26T18:50:12.453 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.d.log 2024-04-26T18:50:12.460 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mon.b.log 2024-04-26T18:50:12.462 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-26T18:50:12.463 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.9.log 2024-04-26T18:50:12.467 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.d.log: 91.0% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-26T18:50:12.468 INFO:teuthology.orchestra.run.smithi080.stderr: 94.5% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.d.log.gz 2024-04-26T18:50:12.470 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-26T18:50:12.473 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.k.log 2024-04-26T18:50:12.475 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mon.b.log: 91.0% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-26T18:50:12.475 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-26T18:50:12.478 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.l.log: 91.0% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-26T18:50:12.483 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/cephadm.log: 92.4% 93.6% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.c.log.gz 2024-04-26T18:50:12.484 INFO:teuthology.orchestra.run.smithi192.stderr: -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-26T18:50:12.487 INFO:teuthology.orchestra.run.smithi192.stderr: 93.5% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.i.log.gz 2024-04-26T18:50:12.491 INFO:teuthology.orchestra.run.smithi192.stderr: 93.2% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.f.log.gz 2024-04-26T18:50:12.492 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.k.log: /var/log/ceph/cephadm.log: 93.3% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.h.log.gz 2024-04-26T18:50:12.493 INFO:teuthology.orchestra.run.smithi082.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-26T18:50:12.494 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.9.log: /var/log/ceph/cephadm.log: 94.5% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.g.log.gz 2024-04-26T18:50:12.494 INFO:teuthology.orchestra.run.smithi080.stderr: 93.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-26T18:50:12.523 INFO:teuthology.orchestra.run.smithi080.stderr: 94.4% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.a.log.gz 2024-04-26T18:50:12.544 INFO:teuthology.orchestra.run.smithi192.stderr: 94.6% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.l.log.gz 2024-04-26T18:50:12.548 INFO:teuthology.orchestra.run.smithi082.stderr: 94.4% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.k.log.gz 2024-04-26T18:50:12.749 INFO:teuthology.orchestra.run.smithi192.stderr: 92.0% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mon.c.log.gz 2024-04-26T18:50:12.804 INFO:teuthology.orchestra.run.smithi080.stderr: 90.1% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mgr.x.log.gz 2024-04-26T18:50:12.929 INFO:teuthology.orchestra.run.smithi082.stderr: 92.1% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mon.b.log.gz 2024-04-26T18:50:12.938 INFO:teuthology.orchestra.run.smithi082.stderr: 95.5% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.e.log.gz 2024-04-26T18:50:13.269 INFO:teuthology.orchestra.run.smithi080.stderr: 90.4% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mon.a.log.gz 2024-04-26T18:50:13.415 INFO:teuthology.orchestra.run.smithi192.stderr: 92.4% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.11.log.gz 2024-04-26T18:50:13.449 INFO:teuthology.orchestra.run.smithi082.stderr: 92.3% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.4.log.gz 2024-04-26T18:50:13.810 INFO:teuthology.orchestra.run.smithi192.stderr: 92.2% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.2.log.gz 2024-04-26T18:50:13.832 INFO:teuthology.orchestra.run.smithi080.stderr: 92.4% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.0.log.gz 2024-04-26T18:50:13.901 INFO:teuthology.orchestra.run.smithi080.stderr: 92.5% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.6.log.gz 2024-04-26T18:50:13.908 INFO:teuthology.orchestra.run.smithi192.stderr: 91.5% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.8.log.gz 2024-04-26T18:50:14.210 INFO:teuthology.orchestra.run.smithi080.stderr: 92.5% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.3.log.gz 2024-04-26T18:50:14.453 INFO:teuthology.orchestra.run.smithi080.stderr: 92.3% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.9.log.gz 2024-04-26T18:50:14.459 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-26T18:50:14.466 INFO:teuthology.orchestra.run.smithi080.stderr:real 0m2.042s 2024-04-26T18:50:14.472 INFO:teuthology.orchestra.run.smithi080.stderr:user 0m7.772s 2024-04-26T18:50:14.477 INFO:teuthology.orchestra.run.smithi080.stderr:sys 0m0.277s 2024-04-26T18:50:14.534 INFO:teuthology.orchestra.run.smithi082.stderr: 92.5% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.7.log.gz 2024-04-26T18:50:14.667 INFO:teuthology.orchestra.run.smithi082.stderr: 92.5% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.1.log.gz 2024-04-26T18:50:14.864 INFO:teuthology.orchestra.run.smithi082.stderr: 92.2% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.10.log.gz 2024-04-26T18:50:16.092 INFO:teuthology.orchestra.run.smithi082.stderr: 93.4% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-mds.b.log.gz 2024-04-26T18:50:16.109 INFO:teuthology.orchestra.run.smithi082.stderr: 2024-04-26T18:50:16.114 INFO:teuthology.orchestra.run.smithi082.stderr:real 0m3.676s 2024-04-26T18:50:16.120 INFO:teuthology.orchestra.run.smithi082.stderr:user 0m12.145s 2024-04-26T18:50:16.125 INFO:teuthology.orchestra.run.smithi082.stderr:sys 0m0.407s 2024-04-26T18:50:16.178 INFO:teuthology.orchestra.run.smithi192.stderr: 95.2% -- replaced with /var/log/ceph/2187ca98-03fa-11ef-bc93-c7b262605968/ceph-osd.5.log.gz 2024-04-26T18:50:16.185 INFO:teuthology.orchestra.run.smithi192.stderr: 2024-04-26T18:50:16.191 INFO:teuthology.orchestra.run.smithi192.stderr:real 0m3.762s 2024-04-26T18:50:16.196 INFO:teuthology.orchestra.run.smithi192.stderr:user 0m7.855s 2024-04-26T18:50:16.202 INFO:teuthology.orchestra.run.smithi192.stderr:sys 0m0.310s 2024-04-26T18:50:16.266 INFO:tasks.cephadm:Archiving logs... 2024-04-26T18:50:16.273 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674925/remote/smithi080/log 2024-04-26T18:50:16.281 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T18:50:17.461 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674925/remote/smithi082/log 2024-04-26T18:50:17.469 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T18:50:19.236 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674925/remote/smithi192/log 2024-04-26T18:50:19.259 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T18:50:20.411 INFO:tasks.cephadm:Removing cluster... 2024-04-26T18:50:20.419 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 --force 2024-04-26T18:50:20.611 INFO:teuthology.orchestra.run.smithi080.stdout:Deleting cluster with fsid: 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:50:20.878 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 --force 2024-04-26T18:50:21.074 INFO:teuthology.orchestra.run.smithi082.stdout:Deleting cluster with fsid: 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:50:21.411 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2187ca98-03fa-11ef-bc93-c7b262605968 --force 2024-04-26T18:50:21.613 INFO:teuthology.orchestra.run.smithi192.stdout:Deleting cluster with fsid: 2187ca98-03fa-11ef-bc93-c7b262605968 2024-04-26T18:50:21.874 INFO:tasks.cephadm:Removing cephadm ... 2024-04-26T18:50:21.881 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-26T18:50:21.906 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-26T18:50:21.929 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-26T18:50:21.950 INFO:tasks.cephadm:Teardown complete 2024-04-26T18:50:21.957 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T18:50:21.974 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T18:50:21.981 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T18:50:21.989 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T18:50:21.998 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T18:50:22.098 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T18:50:22.117 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T18:50:22.129 DEBUG:teuthology.orchestra.run.smithi080:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T18:50:22.138 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T18:50:22.146 DEBUG:teuthology.orchestra.run.smithi192:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T18:50:22.152 INFO:teuthology.orchestra.run.smithi080.stderr:bash: line 1: ntpq: command not found 2024-04-26T18:50:22.219 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-04-26T18:50:22.269 INFO:teuthology.orchestra.run.smithi192.stderr:bash: line 1: ntpq: command not found 2024-04-26T18:50:22.277 INFO:teuthology.orchestra.run.smithi080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T18:50:22.285 INFO:teuthology.orchestra.run.smithi080.stdout:=============================================================================== 2024-04-26T18:50:22.292 INFO:teuthology.orchestra.run.smithi080.stdout:^* hv01.front.sepia.ceph.com 3 7 377 70 +842us[ +850us] +/- 45ms 2024-04-26T18:50:22.297 INFO:teuthology.orchestra.run.smithi080.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 70 -498us[ -498us] +/- 63ms 2024-04-26T18:50:22.304 INFO:teuthology.orchestra.run.smithi080.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 -622us[ -622us] +/- 91ms 2024-04-26T18:50:22.310 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T18:50:22.316 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T18:50:22.322 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-04-26T18:50:22.327 INFO:teuthology.orchestra.run.smithi082.stdout:^* hv01.front.sepia.ceph.com 3 6 377 5 +738us[ +739us] +/- 46ms 2024-04-26T18:50:22.333 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 8 -631us[ -630us] +/- 63ms 2024-04-26T18:50:22.389 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 -681us[ -680us] +/- 91ms 2024-04-26T18:50:22.395 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T18:50:22.401 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T18:50:22.407 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2024-04-26T18:50:22.414 INFO:teuthology.orchestra.run.smithi192.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 +739us[ +785us] +/- 46ms 2024-04-26T18:50:22.462 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 -623us[ -623us] +/- 63ms 2024-04-26T18:50:22.513 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 -677us[ -677us] +/- 91ms 2024-04-26T18:50:22.519 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T18:50:22.527 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T18:50:22.542 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T18:50:22.549 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T18:50:22.565 DEBUG:teuthology.orchestra.run.smithi080:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T18:50:22.650 DEBUG:teuthology.orchestra.run.smithi082:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T18:50:22.727 DEBUG:teuthology.orchestra.run.smithi192:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T18:50:22.805 DEBUG:teuthology.orchestra.run.smithi080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T18:50:22.841 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T18:50:22.848 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T18:50:22.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T18:50:22.923 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T18:50:22.958 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T18:50:22.964 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T18:50:22.981 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T18:50:23.013 INFO:teuthology.task.internal:Duration was 1929.978570 seconds 2024-04-26T18:50:23.084 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T18:50:23.102 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T18:50:23.108 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T18:50:23.116 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T18:50:23.124 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T18:50:23.154 INFO:teuthology.orchestra.run.smithi080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T18:50:23.163 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T18:50:23.173 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T18:50:23.658 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T18:50:23.665 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi080.front.sepia.ceph.com 2024-04-26T18:50:23.671 DEBUG:teuthology.orchestra.run.smithi080:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T18:50:23.796 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T18:50:23.803 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T18:50:23.834 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi192.front.sepia.ceph.com 2024-04-26T18:50:23.840 DEBUG:teuthology.orchestra.run.smithi192:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T18:50:23.871 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T18:50:23.890 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T18:50:23.948 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T18:50:23.956 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T18:50:23.989 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T18:50:23.996 DEBUG:teuthology.orchestra.run.smithi080:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T18:50:24.017 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T18:50:24.026 DEBUG:teuthology.orchestra.run.smithi192:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T18:50:24.643 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T18:50:24.662 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T18:50:24.668 DEBUG:teuthology.orchestra.run.smithi080:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T18:50:24.697 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T18:50:24.729 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T18:50:24.788 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T18:50:24.811 DEBUG:teuthology.orchestra.run.smithi080:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T18:50:24.819 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T18:50:24.828 DEBUG:teuthology.orchestra.run.smithi192:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T18:50:24.838 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = core 2024-04-26T18:50:24.848 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2024-04-26T18:50:24.926 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = core 2024-04-26T18:50:24.933 DEBUG:teuthology.orchestra.run.smithi080:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T18:50:24.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T18:50:24.987 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T18:50:25.007 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T18:50:25.013 DEBUG:teuthology.orchestra.run.smithi192:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T18:50:25.033 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T18:50:25.040 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T18:50:25.058 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T18:50:25.065 DEBUG:teuthology.misc:Transferring archived files from smithi080:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674925/remote/smithi080 2024-04-26T18:50:25.071 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T18:50:25.150 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674925/remote/smithi082 2024-04-26T18:50:25.158 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T18:50:25.200 DEBUG:teuthology.misc:Transferring archived files from smithi192:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674925/remote/smithi192 2024-04-26T18:50:25.207 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T18:50:25.248 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T18:50:25.256 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T18:50:25.356 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T18:50:25.365 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T18:50:25.388 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T18:50:25.406 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T18:50:25.413 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T18:50:25.430 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T18:50:25.435 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T18:50:25.443 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T18:50:25.451 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T18:50:25.459 INFO:teuthology.orchestra.run.smithi080.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 18:50 /home/ubuntu/cephtest 2024-04-26T18:50:25.468 INFO:teuthology.orchestra.run.smithi082.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 18:50 /home/ubuntu/cephtest 2024-04-26T18:50:25.511 INFO:teuthology.orchestra.run.smithi192.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 18:50 /home/ubuntu/cephtest 2024-04-26T18:50:25.518 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T18:50:25.536 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T18:50:25.569 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/direct_io}} duration: 1929.9785704612732 flavor: default owner: scheduled_leonidus@teuthology success: true 2024-04-26T18:50:25.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T18:50:25.730 INFO:teuthology.run:pass